NCSI: GPU-accelerated Moment Closure Schemes for Multi-phase CFD

Status	Completed
Mentor Name	Spencer Bryngelson
Mentor's XSEDE Affiliation	Research allocation
Mentor Has Been in XSEDE Community	3-4 years
Project Title	GPU-accelerated Moment Closure Schemes for Multi-phase CFD
Summary	Sub-grid models for flowing dispersions are essential for the high-fidelity simulations of cough droplets leaving your mouth, bubble clouds cavitating near ship propellers, and more. Still, these sub-grid models are complex with high arithmetic intensity, dominating the cost of their associated simulations. We will extend a current platform of quadrature-based moment methods to operate on GPUs and interact with large-scale CFD codes.
Job Description	The student will implement new quadrature moment methods into MFC, a hybrid MPI+OpenACC open-source multi-phase flow solver maintained, in part, by the mentor. This will build off of an ongoing effort that accelerates quadrature moment methods on GPUs via OpenACC. More realistic models for the dynamics of flowing bubbles, droplets, and solid particles will be added. The speed-up relative to a CPU baseline will be established.
Computational Resources	The student will use Bridges2 and Expanse GPU nodes. The mentor has already utilized these resources and confirmed their suitability for these simulations. MFC, our code, currently has no trouble running utilizing these resources. A relatively low number of node hours will be required as the primary challenge lies in the implementation, with MFC already performing well on weak- and strong-scaling metrics.
Contribution to Community	This project will utilize the latest XSEDE resources, including full multi-node multi-GPU simulations via MPI+OpenACC and Nvidia MPS. This will test their capabilities for large multi-phase flow simulations that are becoming ever more important in our world. For example, the Bell Prize this year went to COVID-related work, which our project closely brushes up against, albeit from a different angle. The success of this work will also showcase the capabilities of GPUs for accelerating sub-grid multi-phase fluid dynamics models. This is currently an under-utilized tool in the multi-phase fluid mechanics community and will draw attention to it and associated XSEDE resources.
Position Type	Intern
Training Plan	The mentor will play a semi-hands-on role with the student, bringing them up-to-speed on the latest best practices in GPU computing, OpenACC, MPI, and more as appropriate. In particular, the code will be fully open-source. The student will interact with learn from more senior members of the Computational Physics Group (PI Bryngelson).
Student Prerequisites/Conditions/Qualifications	C/C++ or the like
Duration	Semester
Start Date	01/03/2022
End Date	05/01/2022