Up to Specific issues in real coupled models
Hi, I'm having a problem getting IFS+NEMO3.6+OASIS3-MCT+XIOS to run if I chose the detached mode for XIOS. I have the error : Fatal error in PMPI_Intercomm_create: Invalid communicator, error stack: ... MPI_Intercomm_create must not contain the same processes; both contain process 128 According to the command to start the MPI processes: mpiexec.hydra \ -bootstrap slurm -genvall -machinefile mfile \ -n 1 ./xios_server.exe : \ -n 64 ./ifsmaster-ecconf -v ecmwf -e C36Q : \ -n 64 ./nemo.exe rank 0 should be XIOS, ranks 1-64 IFS, and ranks 65-128 NEMO. If I remember correctly, this is the same behaviour that I experienced some time ago when I tried to run XIOS in detached mode together with OASIS3-MCT. It seems that the actual error comes from oasis_get_intercomm (mod_oasis_method.F90), called from NEMO. Any idea of is happening ? Thanks, Best regards, Uwe
Hi Uwe, You told me that you have put in the namcouple file : $NBMODEL 3 ATMIFS oceanx xios.x $END Right ? Could you try to launch your executables in the same order as in the order in the namcouple, i.e something like : mpiexec.hydra \ -bootstrap slurm -genvall -machinefile mfile \ -n 64 ./ifsmaster-ecconf -v ecmwf -e C36Q : \ -n 64 ./nemo.exe : \ -n 1 ./xios_server.exe Best regards, Arnaud
Hi Arnaud, I tried both changing the order in the namcouple and in the launch command. It doesn't make a difference. But it's funny: I tried now all the combinations of ordering XIOS, NEMO, and IFS in the launching command. It does work(!) when IFS is the last executable mentioned on the command line, independent of the order of XIOS and NEMO: ifs-nem-xio: does not work ifs-xio-nem: does not work nem-ifs-xio: does not work nem-xio-ifs: works xio-ifs-nem: does not work xio-nem-ifs: works No idea why. Best regards, Uwe
