Hello everybody,
I am currently evaluating two big data frameworks storm and flink I begin by test the number of messages processed by each frameworks. is there any other criteria I can use to evaluate these frameworks in real time?
Hello
Use the following criteria:
Overhead
Response Time
Platform Support
Programming Model
Performance
Ease of Use
Compatibility
Data Processing
Failure Tolerance
Security
More is explained in the links below.
https://www.xplenty.com/blog/2014/11/apache-spark-vs-hadoop-mapreduce/
http://www.infoworld.com/article/3014440/big-data/five-things-you-need-to-know-about-hadoop-v-apache-spark.html
You can use these links :
http://www.naturalspublishing.com/files/published/v6910010rnl56m.pdf
https://hal.inria.fr/hal-01199200/document
http://www.kdnuggets.com/2016/03/top-big-data-processing-frameworks.html
You can use the parallel Scaleup and Speedup measures. These measures are used to evaluate the performance of scalability of the algorithms.
Check my publication:
https://www.researchgate.net/publication/233910085_Parallel_Particle_Swarm_Optimization_Clustering_Algorithm_based_on_MapReduce_Methodology
Conference Paper Parallel Particle Swarm Optimization Clustering Algorithm ba...
i m preparing a program that models the behavior of a working fluid inside an ejector, but i kindly have a problem concerning the method used to determine the mixing pressure to ensure that the...
12 December 2020 4,207 0 View
What are the advantages and disadvantages of the utilisation of treated domestic wastewater in the mineral processing and especially in the phosphate flotation?
13 September 2017 7,524 4 View
It is possible to remove chloride from seawater by biomineralization . Which organisms can deal this process and which minerals will be formed.
04 September 2017 318 5 View
We have a siliceous sample which is constituted mainly by silica and quartz with calcite. We note the presence of some molluscs and rare radilaria. The chemical composition is shown below. XRD and...
04 March 2016 9,888 2 View
what is best tool to implement recommendation system?
18 February 2016 8,974 8 View
i evaluated hadoop and spark in batch mode with run time between this frameworks, in three volume dataset, and in secondary step, i want evaluate another frameworks in real time mode, i want know...
10 February 2016 287 0 View
i want know what is best tool for machine learning in big data, i used MLLIB API in spark framework and i want test another tool.
07 February 2016 7,411 8 View
How can I test the performance of Spark, flin and storm in stream mode? for exampel we test hadoop and spark tools with simple program with larg dataset
03 February 2016 8,017 3 View
Diatomaceous earths are used for acid filtration, however after few time the pores will be clogged by sulfur. We search minerallurgical techniques in order to reuse Diatomaceous earths.
09 October 2015 1,967 5 View
I would like to learn more about SPSS and Its application especially in regards to data analysis. Please suggest me how I can learn more about it. Thank you so much.
11 August 2024 9,101 4 View
I have reverse sequences (AB1 format), can I base on reverse DNA sequences to perform nucleotide alignment, convert nucleotides to amino acids and deposit the sequence in GenBank database?
11 August 2024 5,138 1 View
Hello, Why do i see this baseline drift when i compare my blank (black) to the sample (blue)? Any suggestions as to why this happened? Thank you!
11 August 2024 3,770 4 View
Willett, Shenoy et al. (2021) have developed a brain computer interface (BCI) that used neural signal collected from the hand area of the motor cortex (area M1) of a paralyzed patient. The...
10 August 2024 7,180 0 View
I am developing a predictive model for a water supply network that involves 20 influencing points. However, I only have historical data for 10 out of these 20 points. I would like to know how to...
10 August 2024 4,005 2 View
I'm currently exploring the application of Python in textile engineering, specifically in areas like data analysis, process automation, and the development of smart textiles. I'm interested in...
10 August 2024 7,429 2 View
How can I use the cif data obtained from rietveld refinement extracted via gsas2, for microstructural analysis using ETEX software?
09 August 2024 7,718 0 View
Let's say we have a standard, regular hexagonal honeycomb with a 3-arm primitive unit cell (something like the figure attached; the figure is only representative and not drawn to scale). The...
07 August 2024 1,937 1 View
A fungal strain was treated with nanoparticles. We want to do an environmental SEM analysis. So could anyone share your views on preparing the sample? Thank you.
07 August 2024 5,307 1 View
Hi, I have a question about normalizing the MTT OD values for doing the statistical analysis. So, if we have 3 different plates and we call them 3 different replicates, so, first we would...
07 August 2024 8,106 4 View