How performance of the Big data can be analysis, which framework should used ?
Is Hadoop and Spark Framework are good or other tool should use , is any Source for code or algorithm can find?
It depends on which kind of algorithms you used (data analysis, image processing, video processing, etc). Anyway you can analyse the accuracy of your model, response time and memory space (volume). For framework you can use Spark (graphx, MLLIB, streaming, etc.)
https://spark.apache.org/
https://spark.apache.org/mllib/
Hi,
The Performance evaluation of big data frameworks for large-scale data analytics. the behavior of frameworks has been characterized by parameters of the workloads such as block size, input data size, interconnect network or thread configuration. The analysis of the results has shown that replacing Hadoop with Spark or Flink ..
If large data sets collected in the Big Data database system come from the Internet, then sentiment analysis may be used.
- Badges
- Science topic
- Similar topics
- Mathematics
- Statistics
- Statistical Analysis
- Data Analysis
- Dataset
- Big Data