ARTFEED — Contemporary Art Intelligence

KernelArc: Multi-Agent AI Framework Achieves Top GPU Kernel Optimization Results

ai-technology · 2026-08-19

The paper presents KernelArc, a framework designed for multi-agent autonomous optimization of GPU kernels across various workloads. In contrast to traditional single-agent methods, KernelArc utilizes specialized agents that work concurrently and communicate solely through shared memory conclusions. The framework features a deterministic benchmark guard and read-only state shared among agents, incorporating plateau-triggered drafting to improve exploration. Testing was performed on NVIDIA H100 and B200 GPUs utilizing representative SOL-ExecBench workloads. KernelArc's optimized outputs encompass a wide array of GPU tasks, such as custom BF16 GEMM, static cuBLASLt Expert-API configuration tables, and more. On July 30, 2026, the public SOL-ExecBench leaderboard showed these submissions leading in L1, L2, Quantization, and FlashInfer tasks, highlighting the effectiveness of shared multi-agent search in enhancing optimization results. This innovation marks a substantial leap in automated GPU kernel tuning, influencing high-performance computing and AI inference efficiency.

Key facts

  • KernelArc is a multi-agent framework for autonomous GPU kernel optimization.
  • Strategy-specialized agents run in parallel and coordinate through conclusions-only shared memory.
  • The system includes a deterministic benchmark guard and read-only cross-agent state with plateau-triggered drafting.
  • Evaluated on NVIDIA H100 and B200 GPUs.
  • Uses category-representative SOL-ExecBench workloads.
  • Generated implementations include custom BF16 GEMM, cuBLASLt Expert-API configurations, fused mixture-of-experts backward, shape-gated decoder-layer fusion, native NVFP4 grouped-query attention, and paged prefill attention.
  • At the July 30, 2026 SOL-ExecBench leaderboard snapshot, submissions ranked first on L1, L2, Quantization, and FlashInfer tasks.
  • Shared multi-agent search broadens exploration and reaches stronger results.

Entities

Institutions

  • arXiv
  • NVIDIA
  • SOL-ExecBench
  • cuBLASLt
  • FlashInfer

Sources