I have tried to extract reviews from a online shopping site by using Octoparse and Parsehub.
Octoparse kept loading didnt give any output.
Parsehub just gave the reviews from single page not from whole sit. How to fix it?
Dear Mahtab
You can do all of this by programming (Python or Java) using JSoup or selenium to extrcat information from web pages
Good luck.
You can write a simple scrapper with python for that particular site using requests and bs4, take this guide as an example https://realpython.com/python-web-scraping-practical-introduction/
What exactly you want to do? If you want to train a model then datasets are available and if you want to extract the review of a specific product of specific website then you need to write a scrapper in python with some depth level to get all reviews.
Try using "web scraper", this scraper is an extension of chrome. I use this tool to scrape coursetalk.com the review on leaderboard category
- Badges
- Science topic
- Similar topics
- Philosophy
- Moral Philosophy
- Free Will