SemaTune: Semantic-Aware OS Tuning with LLMs
SemaTune is a framework designed for host-side steady-state OS tuning, utilizing bounded language-model guidance. It overcomes the shortcomings of current controllers that view scheduler, power, memory, and I/O controls as black-box variables, focusing solely on optimizing a scalar reward while neglecting cross-knob policy structures, which can lead to degraded service states. By creating a compact decision context from knob schemas, telemetry, current configurations, recent action-response histories, and past runs, SemaTune operates with a rapid loop for low-latency updates and a slower loop for periodic strategy revisions. All modifications are validated prior to reaching kernel or sysctl interfaces, enhancing the understanding of OS-control meaning and improving long-term services without the need for application metrics.
Key facts
- SemaTune is a host-side framework for steady-state OS tuning.
- It uses bounded language-model guidance.
- Existing controllers treat OS controls as black-box variables.
- Existing controllers optimize a scalar reward.
- Existing controllers ignore cross-knob policy structure.
- Existing controllers can send services into degraded regions.
- SemaTune uses knob schemas, telemetry, configuration, history, and prior runs.
- SemaTune has a fast loop and a slower loop for updates.
- Changes pass through typed validation before reaching kernel or sysctl interfaces.
Entities
—