Search Results for author: Vithya Yogarajan

Found 11 papers, 4 papers with code

Language Models for Code-switch Detection of te reo Māori and English in a Low-resource Setting

no code implementations Findings (NAACL) 2022 Jesin James, Vithya Yogarajan, Isabella Shields, Catherine Watson, Peter Keegan, Keoni Mahelona, Peter-Lucas Jones

We also show that BiLSTM with pre-trained Māori-English sub-word embeddings outperforms large-scale contextual language models such as BERT on down streaming tasks of detecting Māori language.

Transfer Learning Word Embeddings

Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies

no code implementations3 Dec 2023 Vithya Yogarajan, Gillian Dobbie, Te Taka Keegan, Rostam J. Neuwirth

The importance and novelty of this survey are that it explores the perspective of under-represented societies.

Fairness

Challenges in Annotating Datasets to Quantify Bias in Under-represented Society

no code implementations11 Sep 2023 Vithya Yogarajan, Gillian Dobbie, Timothy Pistotti, Joshua Bensemann, Kobe Knowles

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications.

Gender Classification

Neuromodulation Gated Transformer

1 code implementation5 May 2023 Kobe Knowles, Joshua Bensemann, Diana Benavides-Prado, Vithya Yogarajan, Michael Witbrock, Gillian Dobbie, Yang Chen

We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect.

Effectiveness of Debiasing Techniques: An Indigenous Qualitative Analysis

no code implementations17 Apr 2023 Vithya Yogarajan, Gillian Dobbie, Henry Gouk

An indigenous perspective on the effectiveness of debiasing techniques for pre-trained language models (PLMs) is presented in this paper.

Improving Predictions of Tail-end Labels using Concatenated BioMed-Transformers for Long Medical Documents

1 code implementation3 Dec 2021 Vithya Yogarajan, Bernhard Pfahringer, Tony Smith, Jacob Montiel

Improving the tail-end label predictions in multi-label classifications of medical text enables the potential to understand patients better and improve care.

Multi-Label Classification Multi-Label Learning

Seeing The Whole Patient: Using Multi-Label Medical Text Classification Techniques to Enhance Predictions of Medical Codes

2 code implementations29 Mar 2020 Vithya Yogarajan, Jacob Montiel, Tony Smith, Bernhard Pfahringer

We also show that high dimensional embeddings pre-trained using health-related data present a significant improvement in a multi-label setting, similarly to the way they improve performance for binary classification.

Binary Classification General Classification +2

Automatic end-to-end De-identification: Is high accuracy the only metric?

no code implementations27 Jan 2019 Vithya Yogarajan, Bernhard Pfahringer, Michael Mayo

De-identification of electronic health records (EHR) is a vital step towards advancing health informatics research and maximising the use of available data.

De-identification

A survey of automatic de-identification of longitudinal clinical narratives

no code implementations16 Oct 2018 Vithya Yogarajan, Michael Mayo, Bernhard Pfahringer

Use of medical data, also known as electronic health records, in research helps develop and advance medical science.

De-identification

Cannot find the paper you are looking for? You can Submit a new open access paper.