For the study of discrete sequence in MATLAB, having about 19056003 points, MATLAB is showing OUT OF MEMORY. Is it possible to fulfill the task in MATLAB?
Subhadip Ghosh you did not mention how many samples you are working with. If your PC can't support it, you can add more RAM. let me know the details if you want further help.
Subhadip Ghosh . From my experience, "out of memory" appears when your script is too "heavy" for your PC to process. Thus your computer halted the processing when its ram memory reaches its 100% capacity over a certain period.
My suggestion is.
Short term - Split your single script into several main processing scripts. Don't place all main (heavy) processing into a single script code.
Long term - Add more RAM to your workstation.
It seems more like a computer related problem than a MATLAB related problem. Your PC doesn't have enough memory.
The problem may be because you load the entire 19056003 values string and you don´t have enough memory. You could try, if possible:
- Split the string in smaller strings and work separately with them.
- Change the type of the string. Changing from double to integer for example would reduce RAM memory use.
You need to check the dimensions of your matrices. Try small sizes and see what is happening?,. If you have some sparse matrices in your system try to eliminate it by some mathematical elaboration.
Why can’t you break your signal down into smaller segments then combine the results after processing each segment independently? For most filtering operations there are ways of doing this exactly so the results are the same as what would have been obtained if it had been processed as a whole.
There are many reasons for the "OUT OF Memory" problem.
You need to check the dimensions of your matrices. Try small sizes and see what is happening?. If you have some sparse matrices in your system try to eliminate it by some mathematical elaboration
So I hope one of these links has a solution to your question.
https://www.youtube.com/watch?v=JHwi2aEfUJU
https://itectec.com/matlab/matlab-big-data-analysis-using-matlab-and-database-connection-is-it-possible
https://www.mathworks.com/help/matlab/matlab_prog/resolving-out-of-memory-errors.html
https://www.researchgate.net/post/For_Matlab_program_how_I_can_solve_the_problem_of_out_of_memory1
Or maybe you are running 32 bit MATLAB version where you have limitation of 2GB RAM usage in Matlab process. This is what you get when type "memory" in 32 bit MATLAB:
>> memory
Maximum possible array: 2047 MB (2.146e+09 bytes) *
Memory available for all arrays: 3226 MB (3.383e+09 bytes) **
Memory used by MATLAB: 486 MB (5.096e+08 bytes)
Physical Memory (RAM): 16265 MB (1.705e+10 bytes)
* Limited by contiguous virtual address space available.
** Limited by virtual address space available.
So although there are 16GB RAM on my PC, I can only address 2 GB for single array, and 3GB in total for all with 32 bit MATLAB.
Dear Subhadip Ghosh,
Try to split your data and the computations accordingly. If the problem continues increase the Java Heap Memory in the MATLAB settings as per the RAM availability, and restart the MATLAB. Hope it will help!
Best
Use the datastore function specifically designed to handle data too large to fit in memory :
https://in.mathworks.com/help/matlab/datastore.html
- Badges
- Science topic