cpus_per_task is hardcoded to 128 in landice mesh_gen cases, which potentially slows down region mask creation for large meshes (antarctica, greenland) when using >128 cores.
For example, cpus_per_task is set here: https://github.com/MPAS-Dev/compass/blob/main/compass/landice/tests/antarctica/mesh.py#L38-L39 and used to create region masks here: https://github.com/MPAS-Dev/compass/blob/main/compass/landice/tests/antarctica/mesh.py#L156-L166. For antarctica and greenland high-res meshes, we tend to use 4–8 nodes so that ESMF_RegridWeightGen doesn't run out of memory, so during region mask creation most of the cores are sitting idle for a long time.
cpus_per_taskis hardcoded to 128 in landicemesh_gencases, which potentially slows down region mask creation for large meshes (antarctica,greenland) when using >128 cores.For example,
cpus_per_taskis set here: https://github.com/MPAS-Dev/compass/blob/main/compass/landice/tests/antarctica/mesh.py#L38-L39 and used to create region masks here: https://github.com/MPAS-Dev/compass/blob/main/compass/landice/tests/antarctica/mesh.py#L156-L166. Forantarcticaandgreenlandhigh-res meshes, we tend to use 4–8 nodes so that ESMF_RegridWeightGen doesn't run out of memory, so during region mask creation most of the cores are sitting idle for a long time.