bioMoR: Biology-Guided Mixture-of-Recursions for Genomic Learning
bioMoR is a novel framework that applies Mixture-of-Recursions (MoR) to gene-level and pathway-level learning in genomics. It is the first to integrate structured biological knowledge into an MoR backbone, identifying three key locations: graph-based information sharing to refine token embeddings, a structural bias to guide self-attention toward biologically related tokens, and a graph-aware router that uses neighborhood information to determine recursion depth. The framework aims to improve efficiency in high-dimensional omics analysis by adaptively routing tokens, as only a subset of genes or pathways requires deep computation. The paper is available on arXiv under the identifier 2608.06727.
Key facts
- bioMoR applies Mixture-of-Recursions to gene-level and pathway-level learning.
- It is the first framework to apply MoR to genomics.
- Three integration points for biological knowledge are identified.
- Graph-based information sharing refines token embeddings.
- Structural bias guides self-attention toward biologically related tokens.
- Graph-aware router uses neighborhood information for recursion depth.
- The paper is available on arXiv with ID 2608.06727.
- The framework targets high-dimensional omics analysis.
Entities
Institutions
- arXiv