Search Results for author:
Found 35 papers, 0 papers with code
User-centered & Robust NLP OSS: Lessons Learned from Developing & Maintaining RSMTool
For the last 5 years, we have developed and maintained RSMTool – an open-source tool for evaluating NLP systems that automatically score written and spoken responses.
Automated Evaluation of Writing -- 50 Years and Counting
In this theme paper, we focus on Automated Writing Evaluation (AWE), using Ellis Page{'}s seminal 1966 paper to frame the presentation.
Using PRMSE to evaluate automated scoring systems in the presence of label noise
The effect of noisy labels on the performance of NLP systems has been studied extensively for system training.
The many dimensions of algorithmic fairness in educational applications
We illustrate that total fairness may not be achievable and that different definitions of fairness may require different solutions.
My Turn To Read: An Interleaved E-book Reading Tool for Developing and Struggling Readers
Literacy is crucial for functioning in modern society.
Writing Mentor: Self-Regulated Writing Feedback for Struggling Writers
Writing Mentor is a free Google Docs add-on designed to provide feedback to struggling writers and help them improve their writing in a self-paced and self-regulated fashion.
Automated Scoring: Beyond Natural Language Processing
In this position paper, we argue that building operational automated scoring systems is a task that has disciplinary complexity above and beyond standard competitive shared tasks which usually involve applying the latest machine learning techniques to publicly available data in order to obtain the best accuracy.
Atypical Inputs in Educational Applications
In large-scale educational assessments, the use of automated scoring has recently become quite common.
Second Language Acquisition Modeling
We present the task of \textit{second language acquisition (SLA) modeling}.
Speech- and Text-driven Features for Automated Scoring of English Speaking Tasks
We consider the automatic scoring of a task for which both the content of the response as well its spoken fluency are important.
A Large Scale Quantitative Exploration of Modeling Strategies for Content Scoring
We explore various supervised learning strategies for automated scoring of content knowledge for a large corpus of 130 different content-based questions spanning four subject areas (Science, Math, English Language Arts, and Social Studies) and containing over 230, 000 responses scored by human raters.
Building Better Open-Source Tools to Support Fairness in Automated Scoring
Automated scoring of written and spoken responses is an NLP application that can significantly impact lives especially when deployed as part of high-stakes tests such as the GRE® and the TOEFL®.
Is getting the right answer just about choosing the right words? The role of syntactically-informed features in short answer scoring
Developments in the educational landscape have spurred greater interest in the problem of automatically scoring short answer questions.
Using Pivot-Based Paraphrasing and Sentiment Profiles to Improve a Subjectivity Lexicon for Essay Data
We demonstrate a method of improving a seed sentiment lexicon developed on essay data by using a pivot-based paraphrasing system for lexical expansion coupled with sentiment profile enrichment using crowdsourcing.
