I want to extract the publication details (keywords, abstract, title, etc.) of an author from their google scholar profile through python code (i.e. giving an author name and affiliation should return the details of the publications in any suitable format, that can be processed further). I have tried with the Google scholar API but it is getting blocked due to multiple requests.
It will be really helpful, if can provide the solution for this.
Even it will be helpful if can provide the alternative to get prevented from getting blocked from GS.
Thanks
In the primary stage, the newspaper3k python library may help you. It will help you to sort out the author's name and titles of those article's. With these sorted outputs you may move further.
One way to deal with the API being blocked due to multiple requests can sometimes be to intentionally slow the code down (i.e. limit the number of requests per hour/day/whatever directly in the python code). I have found that this usually works - but may require you to leave the program running for a bit longer
Dear Nishith Kotak ,
here you can find API for Arxiv :
https://arxiv.org/help/api/user-manual#python_simple_example
Recently, I have made some positive experiences with scholarly, see https://scholarly.readthedocs.io/en/latest/quickstart.html. The docs also describe several methods to avoid blocks such as proxys or tor.
- Badges
- Science topic
- Similar topics
- Linguistics
- Composition Studies
- Publication