JODIS - a Simple JOb DIstribution Service for clusters and the TeraGrid

From Advanced Computing Environments Lab

We present JODIS, a web service framework that allows distribution of application workloads to high performance and high throughput computing (HPC, HTC) systems. Our high-level task submission API interfaces to a variety of operating and queuing systems (PBS, SGE, Condor), and several commonly-used middleware systems (gsiSSH, SSH). JODIS has been demonstrated to run tens of millions of jobs on multiple computational resources at San Diego State University and the TeraGrid and can be easily migrated to other resources. JODIS is also capable of splitting jobs across multiple HPC and HTC systems. The service-oriented architecture (SOA) follows the emerging ubiquitous-computing design in allowing detailed simulation applications to offload its computing needs to more appropriately suited HPC and HTC resources. In this paper, we report on our use of the JODIS framework in support of the NSF CI-TEAM CyberCHEQS project. We use the framework to support a 3D numerical heat transfer and fluid flow simulator called Flame3D that simulates multiphase combustion processes. The application offloads related chemical equilibrium calculations onto CI resources by sending requests to JODIS for complex Gibbs free energy minimization calculations.

More to come...