How to complete computation of large scale data?

More Sunil kumar Challa's questions See All

What does the disappearance of the XRD peak near 8 degrees, corresponding to the (002) plane of MXene, imply in a MXene-based nanocomposite?

I am trying to synthesize Mxene based nanocomposites. Interestingly, the characteritic peak dissapears which indicates the disruption in interlayer spacing of MXene. So, what might be other...

03 July 2024 5,702 3 View

How to prepare polyaniline emeraldine salt ( PANI -ES) sample for Transmission electron microscope (TEM) analysis?

I need to do TEM analysis for my Polyaniline emeraldine salt form. May I know which solvent is appropriate for preparing TEM sample?

25 June 2024 9,086 3 View

How can soil health be maintained or improved in agricultural systems to ensure long-term productivity?

27 April 2024 3,920 1 View

How can farmers adapt to climate change and mitigate its effects on crop production?

27 April 2024 3,858 8 View

Cloud Computing based pantry system using IoT?

I am researcher doing my research related to this topic, This paper is published in 2021 IEEE conference proceedings, if any one have this paper - Kindly share this paper and help me for my research

13 April 2024 4,713 4 View

What to do if mean_squared_error is high while doing Gradient Boosting Regression?

While doing Gradient boosting regression, I am getting the following values for mean_squared_error:8401567843.246913 mean_absolute_percentage_error: 0.20303839201988907 Is the result valid if...

10 April 2024 6,730 1 View

Can artificial intelligence ever replicate the nuanced emotional intelligence inherent in natural intelligence?

06 April 2024 4,468 2 View

Role of artificial intelligence in vermicomposting?

27 March 2024 5,841 2 View

How do traditional agricultural knowledge and modern scientific understanding intersect in natural farming?

24 March 2024 396 2 View

How to perform kruskal wallis test with covariate (continuous variable) with three independent groups and multiple dependent variables?

I have three independent groups ( like normal, diabetes and diabetic retinoapthy) and multiple dependent variables such as retinal parameters. I have other covariates such as age( continuous) and...

22 March 2024 2,760 13 View

how to stream data from files based on the timestamp?

I am trying to make an approach on how to stream data from files based on the timestamp field in the data. such that data gets ingested to processing applications based on the timestamp. I am...

23 January 2022 4,552 3 View

Best version of apache spark framework, can easily integrated with deep learning libraries ?

Can someone recommend the best version of apache spark, can easily integrated with deep learning libraries . Running under Microsoft Windows

24 May 2021 9,694 2 View

It is possible implement headonic regression model using apache spark milb?

My concern is to use Headonic regression model for market price index analysis.

10 September 2020 9,689 3 View

Which log file in linux system has digital foot prints after backdoor is planted through metasploit?

Hello All, I have planted back door on the one of the vulnerable machines in closed environment and i just curious to know which log file in Linux system log would contain digital foot prints of...

28 October 2019 7,995 1 View

How to find the predicted mortality rate to create an SMR..?

We are trying to create an SMR for our ICU network. We calculated the predicted mortality for all the patients for six months and plotted an ROC for the prediction tool used. However from the...

20 February 2019 3,597 10 View

Apache phoenix doesn't support constraint other than the primary key constraint ?

Since apache phoenix doesn't support foreign key or other constraint, what can be done to respect integrity since it is the job of the foreign key ?

24 May 2018 6,740 1 View

Any one help out how to query from ontology data set made in protege?

working on semantic web for which generating triplet dataset in protege and load into eclipse using jena inference rule to query form data every thing goes well but didn't able to get results at...

12 May 2018 2,151 2 View

Tomcat can run PHP code?

Apache Tomcat is an open software implementation of the Java Servlet.

04 May 2018 3,079 0 View

Is it possible to impose a cpu limit on executors in Apache storm?

Each executor is a thread inside a worker process. Is it possible to set some rule such that all the executors on a machine execute for (roughly) equal time? so that one executor is not hogging...

12 February 2018 8,517 1 View

How to implement checkpoints to grapple failures in graphs (Page Rank, K-means etc) in Apache Flink?

For streaming applications checkpoints can be configured easily but how to implement checkpoints to grapple failures in graphs (Page Rank, K-means etc) in Apache Flink? Thanks in anticipation.

29 January 2018 3,486 0 View

Mohamed Elhadad

Totally agreed with Mohammed Deeb . It is not just about using a platform or a technique, it is all about how to use it.

Not all programs will become faster when being parallelized. In most cases your algorithm may consists of parts that could be parallelized and other parts that are inherently sequential. You always have to compute the complexity of your algorithm and find-out whether there will be a performance gain of using parallel programming or not. It could be remarked that, in some cases the overheads when using parallel programming could make the program run much slower.

You have to search for a technique to pre-process your data efficiently.

Shafagat Mahmudova

Dear Sunil kumar Challa ,

Look the link, please, maybe useful.

Article Computational solutions to large-scale data management and analysis

Regards,

Shafagat