Miah, M. Saef Ullah and Junaida, Sulaiman and Sarwar, Talha and Naseer, Ateeqa and Ashraf, Fasiha and Kamal Zuhairi, Zamli and Jose, Rajan (2022) Sentence boundary extraction from scientific literature of electric double layer capacitor domain: Tools and techniques. Applied Sciences, 12 (3). pp. 1-19. ISSN 2076-3417. (Published)
|
Pdf
Sentence boundary extraction from scientific literature of electric double layer.pdf Available under License Creative Commons Attribution. Download (506kB) | Preview |
Abstract
Given the growth of scientific literature on the web, particularly material science, acquiring data precisely from the literature has become more significant. Material information systems, or chemical information systems, play an essential role in discovering data, materials, or synthesis processes using the existing scientific literature. Processing and understanding the natural language of scientific literature is the backbone of these systems, which depend heavily on appropriate textual content. Appropriate textual content means a complete, meaningful sentence from a large chunk of textual content. The process of detecting the beginning and end of a sentence and extracting them as correct sentences is called sentence boundary extraction. The accurate extraction of sentence boundaries from PDF documents is essential for readability and natural language processing. Therefore, this study provides a comparative analysis of different tools for extracting PDF documents into text, which are available as Python libraries or packages and are widely used by the research community. The main objective is to find the most suitable technique among the available techniques that can correctly extract sentences from PDF files as text. The performance of the used techniques Pypdf2, Pdfminer.six, Pymupdf, Pdftotext, Tika, and Grobid is presented in terms of precision, recall, f-1 score, run time, and memory consumption. NLTK, Spacy, and Gensim Natural Language Processing (NLP) tools are used to identify sentence boundaries. Of all the techniques studied, the Grobid PDF extraction package using the NLP tool Spacy achieved the highest f-1 score of 93% and consumed the least amount of memory at 46.13 MegaBytes.
| Item Type: | Article |
|---|---|
| Additional Information: | Indexed by Scopus |
| Uncontrolled Keywords: | Gensim; Material informatics; Material information system; Materials 4.0; NLP in material science; NLTK; PDF to text conversion; Sentence boundary extraction; Spacy |
| Subjects: | Q Science > QA Mathematics > QA76 Computer software T Technology > T Technology (General) T Technology > TA Engineering (General). Civil engineering (General) T Technology > TK Electrical engineering. Electronics Nuclear engineering |
| Faculty/Division: | Faculty of Industrial Sciences And Technology Institute of Postgraduate Studies College of Engineering Faculty of Computing |
| Depositing User: | Mr Muhamad Firdaus Janih@Jaini |
| Date Deposited: | 18 Mar 2022 04:12 |
| Last Modified: | 06 Sep 2022 07:46 |
| URI: | http://umpir.ump.edu.my/id/eprint/33377 |
| Download Statistic: | View Download Statistics |
Actions (login required)
 |
View Item |