What are the different datasets available for network intrusion detection in publucdomain except KDD CUP 99 data set?
You can request some realistic network datasets from CAIDA or PREDICT.
Right. Use improved dataset NSL-KDD Data Set. That will solve some problems of KDD'99
There are numerous datasets available, but all have some limitations. The most famous ones are (still) DARPA 98/99 and KDD99, but they have several shortcomings and have been criticized a lot, e.g., by Mahoney and Chan (e.g., see http://link.springer.com/chapter/10.1007/978-3-540-45248-5_13). Even so, they are still used today, but results and evaluations done by these datasets are quite worthless. Some improvements had been done by NSL-KDD as already mentioned; Qian et al. presented another redesign of the DARPA set (see http://link.springer.com/chapter/10.1007%2F11766155_32).
Real-world data can be found at the MAWI Working Group Traffic Archive and the WIDE project (see http://mawi.wide.ad.jp/mawi/). While real-world (recorded) data is a good challenge for a realistic comparison of IDSs, it often suffers from a missing ground truth. Further packet-, flow- and http- traces can be found at MOME (Cluster of European Projects aimed at Monitoring and Measurement, http://www.ist-mome.org/database/MeasurementData/index8db7.html) or Consortium Internet 2 (you may have to mail them because the public link seems to be removed?), CAIDA (http://www.caida.org/data/overview), the Waikato Internet Traffic Storage
(http://wand.net.nz/wits/), RIPE (https://labs.ripe.net/datarepository/data-sets), the Internet Traffic Archive (ita.ee.lbl.gov/html/traces.html), the UMassTraceRepository (http://traces.cs.umass.edu/index.php/Network/Network) or PREDICT (http://www.predict.org/Default.aspx?tabid=175).
For flow-based systems, labeled datasets can be found at http://www.simpleweb.org/wiki/Labeled_Dataset_for_Intrusion_Detection
As already mentioned, all available datasets have different limitations; e.g., see https://tnc2014.terena.org/core/poster/13 for an overview of some pros and cons.
Try to connect to any industry via institute for latest dataset otherwise try -
http://www.ll.mit.edu/ideval/data/
What kind of data-set you need? What is the purpose of your research? Maybe I could provide you some data-set or articles.
Hi Robert Koch
I am unable to find the link to the dataset from (http://link.springer.com/chapter/10.1007%2F11766155_32).
You have mentioned this in your answer. Do you have link to where I could download this dataset.
Your time and answer is much appreciated
Thanks
You can find it here: http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html
There is HTTP DATASET CSIC 2010 for testing web attack protection system. It can be downloaded at http://www.isi.csic.es/dataset/
The UNSW-NB15 data set:
https://www.researchgate.net/publication/287330529_UNSW-NB15_a_comprehensive_data_set_for_network_intrusion_detection_systems_UNSW-NB15_network_data_set
Also, the ISCX and Kyoto data sets.
Conference Paper UNSW-NB15: a comprehensive data set for network intrusion de...
Hi Folks,
Pls find our new IDS dataset, included most of the up-to-dated attacks (PCAP) along with labelled flows covering more than 80 features (CSV) here:
http://www.unb.ca/cic/datasets/ids-2017.html
Also, let me know your suggestions for other datasets that can be useful for researchers and producers in this domain.
Why not make your Own dataset? I think most people would agree when I say " Each network is different, and the type of attacks and attack durations will also be different depending on the services you have. So a dataset that is good for one scenario is not going to good for another and so are the attributes. Which is why we created this tool which allows you to make you own intrusion dataset and you get to choose your attributes!
Paper: Conference Paper INSecS-DCS: A Highly Customizable Network Intrusion Dataset ...
Software : https://github.com/nrajasin/Network-intrusion-dataset-creator
Most known datasets to existence so far are here in one place classified to their purpose, check it out:
https://github.com/AbertayMachineLearningGroup/network-threats-taxonomy/tree/master/Datasets
The reference survey paper is available at:
https://arxiv.org/pdf/1806.03517.pdf
Good Luck
- Badges
- Science topic
- Similar topics
- Biological Science
- Bioecology
- Systems Ecology
- Landscape Ecology
- Connectivity