OpenFOAM is a widely-used program for performing computational fluid dynamics simulations, and is regularly among the top 20 most-used applications on ARCHER. One historical quirk of OpenFOAM is its need to write a file per variable per MPI-process when running in parallel on multiple processors - this quickly becomes an issue when running simulations on ARCHER or other HPC facilities where the number of processors used is high and the number of files produced can quickly run into the 10,000s-100,000s (and clog up a user’s file number quota). With the release of v1706, the OpenFOAM developers have addressed this by adding an option to have all writing done to a single master file per variable (greatly reducing the total number of files generated). In this talk, I will be comparing the I/O performance of this new, collated writing method with the performance of the file-per-process method. Hopefully, this will help inform OpenFOAM users on ARCHER and elsewhere of the best method to use for their systems.

This online session is open to all. It will use the Blackboard Collaborate platform.

Video