AIMCI

Grant

• OAC Core: AIMCI: AI-Guided Resource Management for Advanced Cyberinfrastructure
• PI: Zhiling Lan. Co-PI: Michael E. Papka
• Sponsor: National Science Foundation, Office of Advanced Cyberinfrastructure (OAC) Core program
• NSF Award #2402901
• Start Date: October 1, 2024
• End Date: September 30, 2027
• Award Amount: $600,000

Overview

Advanced cyberinfrastructure (CI) is undergoing disruptive changes in system architectures and application workloads. Each facility typically hosts a blend of high-performance systems with various configurations and capabilities. These systems are composed of a multitude of components, embodying heterogeneity in various aspects, ranging from computing to memory and storage. Concurrently, the landscape of cyberinfrastructure workloads is rapidly expanding beyond traditional computational simulations to encompass a hybrid mix of applications including deep learning applications, data-centric applications, as well as coupled workflows involving distributed computing systems. The emerging applications come with diverse resource requirements and exhibit distinct computing characteristics.

Current resource management approaches are designed for the traditional paradigm, namely numerical simulations on homogeneous systems. They heavily rely on heuristics and manual processing, making them inadequate for addressing the substantial challenges introduced by the evolving workload and system architecture.

We advocate the necessity of an artificial intelligence (AI)-guided approach to tackle the complex challenges of CI resource management. We envision that state-of-the-art AI technologies will play a pivotal role in delivering predictive insights and optimizing decision-making in the constantly evolving CI landscape, while humans can focus on critical tasks of oversight and validation.

Press release: OAC Core: AIMCI: Artificial Intelligence for Managing Cyberinfrastructure