DEI: Heterogeneous LLMs Enhance Quality-Diversity Search
There's this new distributed framework for Quality-Diversity search called DEI, which stands for Diversity in Evolutionary Inference. Unlike standard searches that stick to similar models, DEI takes advantage of different large language models (LLMs) as mutation operators between nodes. Each LLM brings its own creative flair, adding diversity to the behavior. It builds on something called the Digital Red Queen framework, where nodes share their best solutions after each round to kick off the next stage, creating competitive interactions among models. In tests using Core War, a competitive programming environment, a four-node mix of models—including GPT-5.4-mini and Claude Sonnet 4.6—performed really well.
Key facts
- DEI assigns heterogeneous LLMs as mutation operators across peer nodes.
- Nodes communicate with non-blocking collective operations.
- DEI extends the Digital Red Queen framework.
- Nodes share local optimal solutions at the end of each round.
- Cross-model adversarial pressure drives robustness beyond intra-model self-play.
- Evaluated on the Core War domain.
- Core War is a competitive programming benchmark with Redcode warrior programs.
- Ensemble includes GPT-5.4-mini, Claude Sonnet 4.6, GPT-5.2, and Claude Haiku 4.5.
Entities
Institutions
- arXiv