FlashDrive: A Co-Design Framework for Real-Time VLA Inference in Autonomous Driving
A new arXiv paper (2608.12932) introduces FlashDrive, an algorithm-system co-design framework aimed at reducing the computational cost of Vision-Language-Action (VLA) models for autonomous driving. The authors identify four structural bottlenecks in VLA inference: visual encoding waste on overlapping frames, language-model prefill recomputation, serial generation of low-entropy reasoning tokens, and uniform compute in flow-matching denoising. FlashDrive targets all four stages simultaneously, leveraging temporal overlap for streaming KV-cache reuse, low per-token entropy, and intra-block shortcuts. The paper is categorized as 'new' on arXiv and is available at the provided URL. The framework promises to make end-to-end reasoning feasible for real-time control in autonomous vehicles.
Key facts
- FlashDrive is an algorithm-system co-design framework for VLA models in autonomous driving.
- VLA inference has four structural bottlenecks: visual encoding, language-model prefill, reasoning token generation, and flow-matching denoising.
- FlashDrive targets all four bottlenecks simultaneously.
- Key insight: temporal overlap enables streaming KV-cache reuse across frames.
- Low per-token entropy and strong intra-block structure allow for lightweight algorithmic shortcuts.
- The paper is announced as 'new' on arXiv with ID 2608.12932.
- The paper is available at https://arxiv.org/abs/2608.12932.
- The goal is to reduce computational cost for real-time control in autonomous driving.
Entities
Institutions
- arXiv