Measuring Distributional Shifts in Text: The Advantage of Language Model-Based Embeddings

no code implementations • 4 Dec 2023 • Gyandev Gupta, Bashir Rastegarpanah, Amalendu Iyer, Joshua Rubin, Krishnaram Kenthapadi

Then we study the effectiveness of our approach when applied to text embeddings generated by both LLMs and classical embedding algorithms.

Language Modelling