Hi
Can somebody tell if there is a way to get the customer reviews from any review website as data set for sentiment analysis through nvivo?(as it shows only 20 reviews per page )and we need around 4000 reviews.
Thanks
You can do it with web crawling... I think it will be the fastest way...
check this also
Conference Paper Legality and Ethics of Web Scraping
https://www.researchgate.net/post/Is_it_legal_to_use_web_scraped_data_for_research
Method:
you can write a script with PHP or Python
use for PHP: https://github.com/FriendsOfPHP/Goutte
use for Python: https://github.com/scrapy/scrapy
you have to send get requests with below curl:
curl --location --request GET 'https://www.mouthshut.com/Review/rar_reviews.aspx?cname=Nikon-Coolpix-5700&cid=925046528&page=6' \
--header 'Cookie: ' \
--header 'Content-Type: application/json; charset=utf-8' \
--header 'Referer: https://www.mouthshut.com/camera/Nikon-Coolpix-5700-reviews-925046528-page-6' \
--header 'User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.105 Safari/537.36'
You can try with Postman and get the curl request form it:
refer: https://stackoverflow.com/questions/49432735/converting-a-postman-request-to-curl
If you need more help let me know.
thank you...
Your best option if you aren't skilled in programming is to automatically scrape data across multiple pages with one of the many user-friendly services/apps out there. One example is https://www.parsehub.com/.
Another way to do this is to use the NCapture extension for google chrome (https://chrome.google.com/webstore/detail/ncapture/lgomjifbpjfhpodjhihemafahhmegbek?hl=en) and extract every page after viewing the max possible amount of review per page.
As mentioned, you can program web scraping as well, but if you don't have experience with R or Python, it might take some time to learn. Here is an introductory video: https://www.youtube.com/watch?v=XQgXKtPSzUI
- Badges
- Science topic