Mr. Gamil , 

For Ist Question 

You can check below mentioned links . 

https://github.com/caesar0301/awesome-public-datasets

Read from below ink hope you get more information.

http://blog.bigml.com/2013/02/28/data-data-data-thousands-of-public-data-sources/#comment-7538

It might be of use to you is http://quandl.com; I use it all the time when I just want to play around with a dataset.

Most US government data is pre-packaged and they offer free HTML and FTP links for downloads. It often times comes in common analytics formats (SPSS, Strata) to ease uploading into those systems, e.g. it will give you the relational schema.

XML, so long as it is properly configured, is actually designed to 'auto-configure' the data. XML data binding, which required the use of certain API's has generally given way to having the author include a schema in the XML (lookup E4X) as a way to categorize and otherwise tag data and the dataset with descriptive attributes.

Your Second Question is not clear according to me.i

intruder detection over big data?

Actually detection of intrusion in cyber space now a days depends on Data , it can be network traffic etc .  I think you should clear your doubts regarding this .

Your 3rd Question 

Well you can used R, RapidMiner, Weka and Matlab. it is up to you which suits your problem. i have used these and I highly recommend  Weka and R.

thank you very much my dear Reshi Nawab

See the following link. It may be useful.

https://archive.ics.uci.edu/ml/datasets.html

https://archive.ics.uci.edu/ml/datasets.html

please, search in "https://archive.ics.uci.edu/ml/index.html" for a big dataset

Follow the link below to find the dataset for intrusion detection:

http://www.unb.ca/research/iscx/dataset/

For your first question,

https://github.com/caesar0301/awesome-public-datasets

see the above link and see the UCI repository also.

for ur 3rd question,

Bigdata-Hadoop, MongoDB is very useful for ur big data research.

Hi Gamil,

Here I list some URLs of interesting repositories of datasets: 

- http://www.datasciencecentral.com/profiles/blogs/big-data-sets-available-for-free

- http://datamob.org/datasets

- http://blog.bigml.com/2013/02/28/data-data-data-thousands-of-public-data-sources/

Hope you find them useful.

Best regards,

G!

http://hadoopilluminated.com/hadoop_illuminated/Public_Bigdata_Sets.html#d1575e4435

https://aws.amazon.com/public-data-sets/

http://bigdata-madesimple.com/70-websites-to-get-large-data-repositories-for-free/

1. You can get dataset from Pubmed.

2. Place your data in Cloud(one secondary node), install IDS(another secondary node).

3. You can go with Rapid Miner.

Gamil,

you can partner with data mining companies (such as www.cavaone.com), which can set up a project for you, gather the data, and deliver in whichever type format is best for you.  We are actively seeing partners in the academic area to align ourselves with.

Paul

Hi Gamil,

Some datasets:

Kaggle - https://www.kaggle.com/datasets

Amazon Web Services - AWS Public Datasets - https://aws.amazon.com/pt/datasets/?_encoding=UTF8&jiveRedirect=1

Socrata - https://opendata.socrata.com/

Google Public Data sets - https://cloud.google.com/bigquery/public-data/