I am using interfoam with dynamicmesh (500k cells). It works with 6-12 cores (laptop), I tried to do the same simulation in a 64 cores server but it marks an error. I tried to use less cores (18-48) but it is the same error. Someone could help me
ERROR:
Courant Number mean: 0.00908415 max: 0.317006
Interface Courant Number mean: 7.62032e-05 max: 0.317006
Time = 0.0061
PIMPLE: Iteration 1
[31] #0 Foam::error::printStack(Foam::Ostream&) at ??:?
[31] #1 Foam::sigFpe::sigHandler(int) at ??:?
[31] #2 ? in "/lib/x86_64-linux-gnu/libc.so.6"
[31] #3 Foam::GAMGSolver::scale(Foam::Field&, Foam::Field&, Foam::lduMatrix const&, Foam::FieldField const&, Foam::UPtrList const&, Foam::Field const&, unsigned char) const at ??:?
[31] #4 Foam::GAMGSolver::Vcycle(Foam::PtrList const&, Foam::Field&, Foam::Field const&, Foam::Field&, Foam::Field&, Foam::Field&, Foam::Field&, Foam::Field&, Foam::PtrList&, Foam::PtrList&, unsigned char) const at ??:?
[31] #5 Foam::GAMGSolver::solve(Foam::Field&, Foam::Field const&, unsigned char) const at ??:?
[31] #6 Foam::fvMatrix::solveSegregated(Foam::dictionary const&) at ??:?
[31] #7 Foam::fvMatrix::solve(Foam::dictionary const&) at ??:?
[31] #8 Foam::fvMatrix::solve() at ??:?
[31] #9 ? at ??:?
[31] #10 ? at ??:?
[31] #11 __libc_start_main in "/lib/x86_64-linux-gnu/libc.so.6"
[31] #12 ? at ??:?
[a231:02611] *** Process received signal ***
[a231:02611] Signal: Floating point exception (8)
[a231:02611] Signal code: (-6)
[a231:02611] Failing at address: 0x3eb00000a33
[a231:02611] [ 0] /lib/x86_64-linux-gnu/libc.so.6(+0x354b0)[0x7f025d03c4b0]
[a231:02611] [ 1] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f025d03c428]
[a231:02611] [ 2] /lib/x86_64-linux-gnu/libc.so.6(+0x354b0)[0x7f025d03c4b0]
[a231:02611] [ 3] /opt/openfoam8/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam10GAMGSolver5scaleERNS_5FieldIdEES3_RKNS_9lduMatrixERKNS_10FieldFieldIS1_dEERKNS_8UPtrListIKNS_17lduInterfaceFieldEEERKS2_h+0xce)[0x7f025e39aa8e]
[a231:02611] [ 4] /opt/openfoam8/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam10GAMGSolver6VcycleERKNS_7PtrListINS_9lduMatrix8smootherEEERNS_5FieldIdEERKS8_S9_S9_S9_S9_S9_RNS1_IS8_EESD_h+0x7b2)[0x7f025e3a06f2]
[a231:02611] [ 5] /opt/openfoam8/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZNK4Foam10GAMGSolver5solveERNS_5FieldIdEERKS2_h+0x7c7)[0x7f025e3a2fa7]
[a231:02611] [ 6] /opt/openfoam8/platforms/linux64GccDPInt32Opt/lib/libfiniteVolume.so(_ZN4Foam8fvMatrixIdE15solveSegregatedERKNS_10dictionaryE+0x14f)[0x7f02605726ef]
[a231:02611] [ 7] interFoam(_ZN4Foam8fvMatrixIdE5solveERKNS_10dictionaryE+0x191)[0x4b1801]
[a231:02611] [ 8] interFoam(_ZN4Foam8fvMatrixIdE5solveEv+0x135)[0x4b1ab5]
[a231:02611] [ 9] interFoam[0x4cd50b]
[a231:02611] [10] interFoam[0x43d379]
[a231:02611] [11] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f025d027830]
[a231:02611] [12] interFoam[0x4486c9]
[a231:02611] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 31 with PID 2611 on node a231 exited on signal 8 (Floating point exception).
--------------------------------------------------------------------------
decomposeParDict:
preservePatches (AMI1 AMI2);
numberOfSubdomains 32;
method scotch;
Dear Jose, your decomposeParDict looks fine. Here are possible factors that may cause the error:
1. preservePatches and scotch decomposition somehow interact with each other and it causes your program to crash. I think this is not very probable but to test, you could decompose your domain manually and make sure that AMI1 and AMI2 are not decomposed. Of course, this will only work with simple meshes.
2.Your GAMG settings are tuned for ~ 50k cells per core (for a 500k domain, using 10 cpu results in 50k cells per core. For 60core, you are already bellow 10k per core). Check for instance https://cfd.direct/openfoam/user-guide/v6-fvsolution/ to improve your settings.
3. Domain was decomposed for 64 cores and started with 32. Did you rerun "decomposePar -latestTime" ?
As far as I can remember I had a similar problem and was able to run gdb in parallel (a gdb session was started for each of the processes) which enabled me to get more information on the occurring error. If your problem persists, this could be the way to go. Good luck!
- Badges
- Science topic
- Similar topics
- Philosophy
- Moral Philosophy
- Free Will