REPREC: Lightweight LLM-Based Sequential Recommendation via User Embedding Alignment
A team of researchers has introduced REPREC, an efficient framework designed for sequential recommendations utilizing large language models. This method transforms a fixed-size user embedding from a static sequential encoder into soft tokens through a simple MLP injector, allowing a frozen LLM to operate without the need for fine-tuning or extra components. This innovation lowers both training complexity and deployment expenses while preserving personalization. Notably, it circumvents item-level conditioning across extensive histories and keeps the pretrained backbones intact. Experimental results validate its effectiveness.
Key facts
- REPREC reformulates LLM-based sequential recommendation through lightweight user representation alignment.
- It uses a frozen sequential encoder and a frozen LLM.
- A lightweight MLP injector maps user embeddings into soft tokens.
- Only the injector is trained; backbones remain unchanged.
- The approach avoids LLM fine-tuning, additional modules, and representation distillation.
- It reduces training complexity and deployment cost.
- The framework is designed for sequential recommendation tasks.
- The paper is available on arXiv with ID 2607.24845.
Entities
Institutions
- arXiv