Search Results for author: Marcin Sowański

Found 3 papers, 2 papers with code

Large Language Models for Expansion of Spoken Language Understanding Systems to New Languages

1 code implementation3 Apr 2024 Jakub Hoscilowicz, Pawel Pawlowski, Marcin Skorupa, Marcin Sowański, Artur Janicki

In the on-device scenario (tiny and not pretrained SLU), our method improved the Overall Accuracy from 5. 31% to 22. 06% over the baseline Global-Local Contrastive Learning Framework (GL-CLeF) method.

Contrastive Learning Machine Translation +3

Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?

no code implementations27 Jan 2023 Jakub Hościłowicz, Marcin Sowański, Piotr Czubowski, Artur Janicki

In this article, we use probing to investigate phenomena that occur during fine-tuning and knowledge distillation of a BERT-based natural language understanding (NLU) model.

Knowledge Distillation Natural Language Understanding

Cannot find the paper you are looking for? You can Submit a new open access paper.