no code implementations • 26 Mar 2024 • Micheal Abaho, Danushka Bollegala, Gary Leeming, Dan Joyce, Iain E Buchan
To address insensitive fine-tuning, we propose Mask Specific Language Modeling (MSLM), an approach that efficiently acquires target domain knowledge by appropriately weighting the importance of domain-specific terms (DS-terms) during fine-tuning.