Optimization and parallelization of the discrete ordinate method for radiation transport simulation in OpenFOAM: Hierarchical combination of shared and distributed memory approaches

Open Res Eur. 2021 Mar 24:1:2. doi: 10.12688/openreseurope.13017.1. eCollection 2021.

Abstract

This paper describes the reduction in memory and computational time for the simulation of complex radiation transport problems with the discrete ordinate method (DOM) model in the open-source computational fluid dynamics platform OpenFOAM. Finite volume models require storage of vector variables in each spatial cell; DOM introduces two additional discretizations, in direction and wavelength, making memory a limiting factor. Using specific classes for radiation sources data, changing the store of fluxes and other minor changes allowed a reduction of 75% in memory requirements. Besides, a hierarchical parallelization was developed, where each node of the standard parallelization uses several computing threads, allowing higher speed and scalability of the problem. This architecture, combined with optimization of some parts of the code, allowed a global speedup of x15. This relevant reduction in time and memory of radiation transport opens a new horizon of applications previously unaffordable.

Keywords: CFD; Photochemical reactors; distributed memory; hierarchical parallelization; multithreaded computing; shared memory.

Grants and funding

This research was financially supported by the European Union’s Horizon 2020 research and innovation programme under the grant agreement No 820718 (project PANI WATER), funded under the Indo-EU International Water cooperation sponsored jointly by European Commission and Department of Science and Technology, India. The authors also gratefully acknowledge the financial support of Comunidad de Madrid and European Structural Funds [FOTOCAOS project, Y2018/EMT-5062].