Execution time of MR program on Hadoop-2.6.0 is more than on Hadoop-1.2.1 ?

18 February 2015 1 9K Report

I have executed my MapReduce program on these two version of Hadoop and observe that Hadoop-2.6.0 takes about double time in comparison to Hadoop-1.2.1. And also confused about the jar files of Hadoop-2 which is complicated while in Hadoop-1 it was so easy to add jar files. I am using eclipse kepler and Ubuntu 14.04 64 bit. Please help me.

Suzanne McIntosh

Try to look at the log files to characterize your job - for instance, in which part of the job execution does the YARN/MR2 run take longer - map phase? reduce phase? You can also check this article: http://blog.cloudera.com/blog/2014/04/apache-hadoop-yarn-avoiding-6-time-consuming-gotchas

Badges
Science topic

Similar topics
Computer Science and Engineering

More Sudhakar Singh's questions See All

Chlorinated organic formation in odor control scrubbers using hypochlorite?

I'm involved in a study of odor control technologies for municipal wastewater treatment plant. One of the control options involves a chemical 2-stage (acid/alkaline) packed bed scrubber. The...

03 March 2021 3,661 2 View

Which is a lucid standard comprehensive book to guide on psychological scale construction and its standardization?

02 March 2021 7,082 3 View

What test should I use to compare two or three means, if data is not normally distributed but sample size is > 30 in each group?

I personally feel this as a most confusing question. As per my understanding, if sample size is > 30, and sample is skewed, we can still use paramteric approach, as it will follow Z...

01 March 2021 1,587 6 View

Which fluorescent dye to use for measuring total ROS production?

Is DCFDA appropriate for measuring total ROS production, or can it only detect certain types of ROS? If I want to measure total ROS production, which dye should I use?

01 March 2021 9,447 3 View

Does any one can help me choose a reasonable basis set for intermediate metal ions interactions with guanine (i.e Fe2+, Mn2+, Cu2+ and exc.)?

Hello every body Does any one has any idea to help me choose a reasonable basis set for intermediate metal ions (i.e Fe2+, Mn2+, Cu2+ and exc.) interactions with guanine or other DNA organic...

01 March 2021 6,187 2 View

Tooth extraction and subsequent dental implant placement in Sprague-Dawley rats induce differential changes in anterior digastric myofibre size and ?

01 March 2021 7,254 3 View

How to define tie constraint between rigid body and another part in dynamic explicit model of Abaqus?

Hi dear researchers I connected a rigid body into the part of my structure by tie constraint and then I added displacement to rigid body, in static general step every thing is fine and these two...

28 February 2021 3,442 2 View

How to calculate Ligand-active site distance in a ligand-protein complex from MD simulation?

I have run a MD simulation of a ligand-protein complex in GROMACS using CHARMM forcefield. Reviewer has asked me to calculate Ligand-activesite distance and binding free energy of ligand with...

27 February 2021 4,703 1 View

How can we theoretically calculate Elemental analysis(percentage) of atoms in covalent organic framework?

For example in one research article the Elemental analysis values of COF-TpPa-1 ( Triformylphloroglucinol (Tp) (63 mg, 0.3 mmol), Paraphenylenediamine (Pa-1) (48 mg, 0.45 mmol) are as follows...

24 February 2021 1,265 6 View

Is there any teachers based in UK who would like to take part in my study?

24 February 2021 4,833 3 View

error in running a model in Abaqus

Excessive rotation of nodes in node set ErrNodeExcessRotation-Step1

17 August 2021 0 0 View

error in modelling model in Abaqus

Excessive rotation of nodes in node set ErrNodeExcessRotation-Step1

17 August 2021 0 0 View

MGL tools

20 June 2021 0 0 View

How climate change will influences human and animal behavioral change?

The role of climate change influencing the human behavior as well as economics interest

01 June 2021 0 0 View

what is the simplest definition of ion exchange capacity

What this unit identifies for the ion exchange capacity ca. 0.92 meq. g-1. I am a newcomer in the membrane area. I just started. I highly appreciate your help

08 May 2021 0 0 View

what is the simplest definition of ion exchange capacity

What this unit identifies for the ion exchange capacity ca. 0.92 meq. g-1. I am a newcomer in the membrane area. I just started. I highly appreciate your help

08 May 2021 0 0 View

flexibility of polymers chain

effect of double bond on the flexibility of polymers

07 April 2021 0 0 View

i have some problem with chtMultiRegionSimpleFoam

--> FOAM FATAL ERROR: Maximum number of iterations exceeded From function Foam::scalar Foam::species::thermo::T(Foam::scalar, Foam::scalar, Foam::scalar, Foam::scalar (Foam::species::thermo::*)(Foam::scalar, Foam::scalar) const, Foam::scalar (Foam::species::thermo::*)(Foam::scalar, Foam::scalar) const, Foam::scalar (Foam::species::thermo::*)(Foam::scalar) const) const [with Thermo = Foam::hConstThermo >; Type = Foam::sensibleEnthalpy; Foam::scalar = double; Foam::species::thermo = Foam::species::thermo >, Foam::sensibleEnthalpy>] in file /home/ubuntu/OpenFOAM/OpenFOAM-4.1/src/thermophysicalModels/specie/lnInclude/thermoI.H at line 66. FOAM aborting #0 Foam::error::printStack(Foam::Ostream&) at ??:? #1 Foam::error::abort() at ??:? #2 Foam::heRhoThermo >, Foam::sensibleEnthalpy> > > >::calculate() at ??:? #3 Foam::heRhoThermo >, Foam::sensibleEnthalpy> > > >::correct() at ??:? #4 ? at ??:? #5 __libc_start_main in "/lib/x86_64-linux-gnu/libc.so.6" #6 ? at ??:?

24 March 2021 0 0 View

Formulation of polymer color flakes

I am writing to request some information for making polymer color flakes. I would appreciate the help.

17 March 2021 0 0 View

Can we classify HV and LV lines based on line length?

I have dataset which shows the length of power lines. I need to classify the lines based on the line length. Is there a rule to classify the High voltage (HV) and low voltage (LV) lines based on...

03 March 2021 4,116 4 View