DynaSchedBench: Calibrated Benchmarks for LLM Scheduling Agents

A new diagnostic framework called DynaSchedBench has been developed by researchers to tackle the Dynamic Flexible Job Shop Scheduling Problem (DFJSP). This framework resolves a methodological conflict where static benchmarks may lead to overfitting, while uncalibrated generators can obscure the true capabilities of algorithms. Utilizing a Sequential Event-Space Calibrator (SESC), DynaSchedBench calculates a Schedule Stress Index (SSI) that categorizes instances based on their difficulty levels. SESC demonstrates greater computational efficiency compared to evolutionary baselines and consistently meets target metrics. Additionally, the framework features modular elements for instance generation, snapshot-based simulation, agents, evaluation, and visualization, facilitating thorough testing of real-time scheduling agents.