Teaching LLMs to Speak Spotify - Yves Raimond & Jacqueline Wood, Spotify

AI Engineer19m 40s
0 comments · 0 votesOpen discussionClose discussion
Sign in to join the discussion

    Video summary

    Yves Raimond frames Spotify's move from curated playlists and ranked recommendationsA recommendation system ranks or selects items for a user by estimating which options are most relevant to their interests, intent or context. toward generative personalizationAI personalization adapts information, recommendations, interfaces, or agent behavior to an individual or group using permitted context and observed needs.. DJ steering, prompted playlists, editable taste profiles and personalized podcast briefs illustrate how users can direct or inspect recommendations and generated experiences.

    Jacqueline Wood explains how content embeddings are quantized into discrete semantic IDsA semantic ID is a compact identifier assigned to an item so an AI model can use information about its meaning or similarity., added to an open-weight language model's vocabulary, and connected to natural language. Spotify's NEO recipe grounds the new tokens while freezing the pretrained backbone, then tunes the full model on several recommendation and retrieval tasks, with optional post-training.

    In the speaker's reported ablations, multitask trainingMultitask training teaches one AI model using several related tasks instead of optimizing it for only one task. matched or exceeded single-task alternatives, while preserving the pretrained backbone protected language ability. The team also compared decoding methods and favored beam search over top-p sampling for recommendation accuracy, while noting a latency trade-off.

    The evaluation section argues that interaction metrics alone cannot show whether a recommendation fits a user's intent or whether its explanation is accurate. Spotify grounds language-model judgesA large language model as a judge is an evaluation method in which a language model scores, compares or critiques another system's output using stated criteria. with listening-history summaries and behavioral signals, and reports improved agreement with human preferences, especially for ambiguous queries.

    Original YouTube thumbnailWatch on YouTube