Using Cloudsim simulation or Hadoop for change in assignment of the tasks?

08 August 2018 0 6K Report

I'm working on computing (MapReduce) security of the Big Data processing systems. The problem is that I do not know, in a system like Hadoop, it's possible or not to change the assignment of the tasks by the programmer.

For instance, Suppose there is a problem with one of the nodes and I want to not to be assigned task to it after identifying that node as a malicious node.

1. I know that Hadoop does the task assignment automatically. And I

want to get this out of the automatic mode.

2. Is it necessary to compile and modify Hadoop source?

3. Can be designed an additional module for Hadoop?

4. Is not it better to use cloudsim for this? (that's mean, I simulate an environment like Hadoop in cloudsim.)

On the other hand, Implementing MapReduce in cloudsim has its own problems.

Please Help me, Which method to continue?

Do you have a better idea?

Badges
Science topic

How to compare two groups with only two measurements?

Hiiiii everyone! I have an enquiry on statistical analysis. I was looking for many forum and it's still cannot solve my problem. I want to compare means of two groups of data but only with two...

03 March 2021 8,796 3 View

What's the best way to measure growth rates in House sparrow chicks from day 2 to day 10?

What's the best way to measure growth rates in House sparrow chicks from day 2 to day 10? Since, the growth curve from day 2 to 10 won't be like the "Logistic curve" it might not follow logistic...

03 March 2021 1,401 3 View

How to increase a model accuracy ?

dear community, my model is based feature extraction from non stationary signals using discrete Wavelet Transform and then using statistical features then machine learning classifiers in order to...

03 March 2021 6,994 5 View

1. What is the impact of having different scales in a survey? and how can we solve this problem before and after data collection (Literature)?

1. What is the impact of having different scales in a survey? and how can we solve this problem before and after data collection (Literature-based reflection)? Thank you for your time and for...

03 March 2021 2,870 3 View

What degree of missing data in a particular case/participant results in Expectation-Maximisation no longer working?

I'm dealing with a mediation model and am using the PROCESS module in SPSS. Due to SPSS and PROCESS being limited in the imputation methods - being unable to handle multiple imputation - the other...

02 March 2021 4,362 1 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View

Does anyone know how to plot my station to a section plot on Ocean Data View (ODV)?

I made a vertical section plot with WOA .nc file on ODV, and now I want to plot my stations (csv. file) in it. Does anyone know how to import my points to the section? They are two different...

01 March 2021 3,610 1 View

How to address this issue in the analysis of Real-Time PCR results?

To dear Researchers, I was analyzing a series of concentration for estimation of Real-Time PCR efficiency. The concentration was 1:10. I used MS-excel to evaluate Slope. The result of slope was -8...

01 March 2021 8,683 4 View

How to arrange coordinates and extract climate dataset out of MPI-ESM-MR netcdf files?

Have a nice day everyone, I'm stuck in extracting datasets out of MPI-ESM-MR netcdf files because the latitude ranges from -3*10^6 to 3*10^6 and longitude ranges -5,9*10^6 to 5,9*10^6. Plus, the...

28 February 2021 912 3 View

Is there any Machine Learning/AI algorithm that lets you predict with incomplete features without missing value imputation process?

For instance, the model is trained with A,B,C,D,E features to predict F target. Then, I want to make prediction on a new data, but with only A,C,D,E is known without doing missing value imputation...

28 February 2021 1,556 6 View