Neptune: A Domain Specific Language for Deploying HPC Software on Cloud Platforms

Report ID: 
2011-02
Authors: 
Chris Bunch, Navraj Chohan, Chandra Krintz, and Khawaja Shams
Date: 
2011-02-01 04:00:00

Abstract

In this paper, we present the design and implementation of Neptune, a domain specific language (DSL) that automates configuration and deployment of existing HPC software via cloud computing platforms. We integrate Neptune into a popular, open-source cloud platform, and extend the platform with support for user-level and automated placement of cloud services and HPC components. Such platform integration of Neptune facilitates hybrid-cloud application executionas well as portability across disparate cloud fabrics.

We evaluate Neptune using different applications that employ a wide range of popular HPC packages for their implementation including MPI, X10, MapReduce, DFSP, and dwSSA. In addition, we show how Neptune can be extended to support other HPC software and application domains.

Document

PDF icon 2011-02.pdf