arXiv Study on Sparse-Dense Hybrid Retrieval for Financial Documents
A new arXiv paper (2608.00183) investigates sparse-dense hybrid retrieval for financial document search, focusing on the FinDER benchmark of expert-annotated questions over corporate 10-K filings. The study identifies a methodological flaw: when the retrieval unit exceeds the dense encoder's input window, the dense model misses a significant portion of labeled evidence, skewing comparisons with full-text sparse baselines. By segmenting the corpus into encoder-sized windows, the researchers corrected this issue. On the corrected corpus, fusing BM25 with a compact dense encoder improved reference-level Hit@10 by roughly 28 percent over either component alone. Additionally, training-free reciprocal rank fusion outperformed equal-weight blending in an exploratory comparison. The paper then explores whether per-query fusion weight selection helps, using an oracle over the in... (truncated for brevity). The study contributes to improving retrieval accuracy in financial document search, a domain characterized by short, acronym-heavy queries and long, table-dense documents.
Key facts
- Paper arXiv:2608.00183 studies sparse-dense hybrid retrieval on FinDER benchmark.
- FinDER includes expert-annotated questions over corporate 10-K filings.
- Methodological issue: retrieval unit larger than dense encoder's input window causes dense model to miss evidence.
- Correction: segmenting corpus into encoder-sized windows.
- Fusing BM25 and compact dense encoder improves Hit@10 by ~28% over either component.
- Training-free reciprocal rank fusion outperforms equal-weight blend in exploratory comparison.
- Paper explores per-query fusion weight selection using an oracle.
- Domain: financial document retrieval with short, acronym-heavy queries and long, table-dense documents.
Entities
Institutions
- arXiv
- FinDER