Hi Aniruddh Siddh,

You can work on the Ontology based crawler;

- Semantics can be provided with ontologies and therefore start with building an ontology as representation of concepts and relations concerning the domain of interest.

- The ontology based crawler uses the ontological concepts for improving its crawling performance.

- This type of crawlers uses semantic based approach (ontological matching) instead of keywords based one. The crawling process focuses on pages relevant to a given topic ontology.

Best regards,

Can you provide me links of some research papers in Ontology based crawler ?

of course. See some attached articles.

Tank you,

are there any papers for relating semantic web technology with social netwoks.

Hi,

See some attached articles about  the using and applications of Semantic web to Social Networks and Social Websites.

Best regards,

Hi,

Another type of ontology is knowledge graph such as Freebase (https://www.freebase.com/), which allows users to download the weekly data dumps or use API to access the information.

best regards,

A very efficient web scraping tool that might help you is DEiXTo: 

http://deixto.com/

Hello,

I specialize in public data gathering (web harvesting) from open access websites by programming a web-crawler. The data can later be used for statistical or content analysis.  For example, my recent collection was data from booking.com and tripadvisor.com with information about reviews, ratings and prices along with the accompanying data such as geographical region, addresses, and many more.  The data comes out in a form that is easily converted to SPSS or Excel format.

Technically, any website or social network can be a source of data. Please feel free to contact me if you are interested as I am open for research collaboration.

Sincerely,

Evgeny