Event Details

Emerging Trends: Enhancing LLMs for Parallel Code Generation with Graph-Guided In-Context Learning

Thu, Sep 11, 2025
2:00 PM - 3:00 PM
Location: EEB EEB 132
Speaker: Ali Jannesari, Associate Professor, Iowa State University | Director, Laboratory for Software Analytics and Pervasive Parallelism (SwaPP)

Talk Title: Enhancing LLMs for Parallel Code Generation with Graph-Guided In-Context Learning

Abstract: One of the significant challenges in adopting Large Language Models (LLMs) for parallel code generation and code analysis is the representation of source code. Current models struggle due to the lack of numerical awareness, insufficient handling of composite data structures, and inadequate representation of variable dependencies and program semantics. These limitations significantly reduce the accuracy and reliability of the generated parallel code. At the same time, In-Context Learning (ICL) has proven to be a powerful mechanism for extending the capabilities of LLMs across a wide range of tasks. Building on this insight, this talk presents AUTOPARLLM, a framework that integrates graph neural networks (GNNs) with LLMs to create richer program contexts. AUTOPARLLM leverages a new graph-based program representation, PerfoGraph, which is specifically designed to capture numerical properties, program dependencies, and semantic relationships essential for parallel code generation. We demonstrate the effectiveness of AUTOPARLLM on 12 applications from two widely used benchmark suites of parallel programs. Our results show that AUTOPARLLM improves the performance of state-of-the-art LLMs by up to 19.9% in code quality metrics and achieves up to 17% higher speedups in execution efficiency. In addition, we introduce OMPSCORE, a new metric tailored for evaluating the quality of parallel code.

Biography: Ali Jannesari is an Associate Professor and the director of the Laboratory for Software Analytics and Pervasive Parallelism (SwAPP) at the Department of Computer Science of Iowa State University. He primarily works at the intersection of High-Performance Computing (HPC) and AI. Prior to joining the faculty at ISU, he was a Senior Research Fellow at the University of California, Berkeley. During his time in Germany, he led the Multicore Programming Group at the Technical University of Darmstadt and was a junior research group leader at RWTH Aachen University. He also worked as a PostDoc fellow at the Karlsruhe Institute of Technology (KIT). Dr. Jannesari holds a Habilitation Degree from the Technical University of Darmstadt and received his Ph.D. in computer science from the Karlsruhe Institute of Technology.

Host: Dr. Paul Bogdan, pbogdan@usc.edu