Context and Moral Knowledge in Schwartz Value Detection
A recent investigation published on arXiv explores the influence of context and explicit moral understanding on the identification of Schwartz values in political texts. Researchers utilized the ValuesML/Touché ValueEval framework to analyze sentence, window, and full-document inputs, alongside no-RAG and retrieval-augmented configurations with a curated moral knowledge database. They employed supervised DeBERTa-v3-base/large encoders and zero-shot LLMs ranging from 12B to 123B parameters. Findings indicate that increased context does not always yield better results: while full-document context enhances supervised DeBERTa encoders by 3.8–4.8 macro-F1 points compared to sentence-only input, it does not consistently benefit zero-shot LLMs. Additionally, retrieved moral knowledge proves more effective in matched comparisons, enhancing all tested model families and context conditions under early fusion, though larger models show diminishing returns.
Key facts
- Study on Schwartz value detection in political texts
- Uses ValuesML/Touché ValueEval format
- Compares sentence, window, and full-document inputs
- Tests no-RAG and retrieval-augmented settings with moral knowledge base
- Uses supervised DeBERTa-v3-base/large encoders
- Tests zero-shot LLMs from 12B to 123B parameters
- Full-document context improves DeBERTa by 3.8–4.8 macro-F1
- Retrieved moral knowledge improves all models under early fusion
Entities
Institutions
- arXiv
- ValuesML
- Touché