Scaling Human Judgment: How Dropbox Uses LLMs to Improve Labeling for RAG Systems

To improve the relevance of responses produced by Dropbox Dash, Dropbox engineers began using LLMs to augment human labelling, which plays a crucial role in identifying the documents that should be used to generate the responses. Their approach offers useful insights for any system built on retrieval-augmented generation (RAG). By Sergio De Simone