LinkedIn's SLM Framework for Job Understanding
LinkedIn has developed a unified semantic modeling framework for large-scale job understanding, powered by a small language model (SLM). The framework addresses the challenge of transforming unstructured job postings into standardized attributes. It involves fine-tuning an open-source SLM with synthetic tasks augmented by reasoning traces, targeting both taxonomy-guided classification and entity extraction. A multi-adapter architecture with attribute grouping is introduced to enhance scalability and efficiency. The system achieves robust zero-shot generalization across structured and unstructured contexts.
Key facts
- LinkedIn developed a unified semantic modeling framework for job understanding.
- The framework is powered by a small language model (SLM).
- It transforms unstructured job postings into standardized attributes.
- Fine-tuning uses synthetic tasks with reasoning traces.
- Tasks include taxonomy-guided classification and entity extraction.
- A multi-adapter architecture with attribute grouping is used.
- The system achieves zero-shot generalization.
- The paper is available on arXiv.