What are the best tools or algorithms used to extract information from difference kind of paper?
Example:
Extracting the Author names, Journal Name, Year of publication from different journal papers.
Thank you
Dear Chalouli,
Did you mean extracting the information for published online papers or you mean text recognition?
Dear Chalouli,
What exactly do you mean by information extraction ?
do you want to extract the existing content into any pattern of your choice or you are looking for any summarized information of that document/content ? where automated knowledge will be found ?
Dear Mustafa,
First of all, thank you for caring and about my Q.
I meant Text recognition because I'll use it on a bench of PDF files that I've already. I'm searching now about the use of deep learning on detection on semantic text or something like that.
Dear Sheikh,
Thank you for answering. I'm looking to extract the existing content.
for example : Extracting Author name from article (Journal, Conference) as you know there is no unified form and journals write authors names with different styles and at different places
If your papers are also on Arxiv,
you can download the TeX versions
and read the .bbl files.
PDF is not a suited format for
text analysis.
Regards,
Joachim
The hard way is: convert PDFs to text (e.g. with Adobe IFilter),
then write a parser or rather a pattern matcher for possible
structures of papers. Unfortunately the font information
might get lost by conversion. Font info would help to identify
text segments. The grammar should be enriched with a
database of proper nouns. For example, if a section
contains some first names, the unknown words following
might be surnames. Numbers in the range 1900-2017 are
most likely publication years. The 'Keywords' keyword
follows the abstract. You will have to find lots of
similar heuristic rules.
Update 2. Oct. 2017: I'm currently experimenting
with a crawler in C# and have to read PDF as well.
With this example code it seems to be feasible.
https://mukteshmehta.wordpress.com/tag/adobe-pdf-ifilter-11/
Regards,
Joachim
If I'm not mistaken Mendeley or Qiqqa can do that type of extraction for you.
Thank you dear Altahir Abdalla Altahir for the answer.
What I'm looking for is how Mendeley do it?
Hi Mohammed,
For complementing the answer provided by M. J. Ebadi within the algorithmic point of view, I recommend to review the algorithm proposed in:Article Information extraction from research papers using conditiona...
Where they use CRFs to efficiently extract information from documents.
Kind regards.
Carlos.
- Badges
- Science topic