Given a URL of a web page how to extract required information from the page?
Ayoub Benayache
from the meta , it contains some information about the page or the site , it define some key words describe the site. crawling is another method to extract interested data form the targeted site
1 votes
1 thanks
Dashamir Hoxha
You can use wget and other Linux tools. Here is an example: https://unix.stackexchange.com/questions/181254/how-to-use-grep-and-cut-in-script-to-obtain-website-urls-from-an-html-file
0 votes
0 thanks
Daniel Knüttel
I would recommend python3 with a number of libraries.
- To fetch the data use urllib: https://docs.python.org/3.5/library/urllib.request.html#module-urllib.request
- The use either simple built-in fetures to remove all tags (if you want just text)
- Or use https://pypi.python.org/pypi/BeautifulSoup
- Or use an XML/HTML Library https://stackoverflow.com/questions/2505041/best-library-to-parse-html-with-python-3-and-example#2505127
The data can be accessed in a structured manner through these libraries and you will be able to extract all the data you might need.
1 votes
0 thanks
- Badges
- Science topic
- Similar topics
- Phytochemistry
- Extracts
More Poornima Naik's questions See All
Similar questions and discussions