Search Results for author: Stephen MacNeil

Found 9 papers, 0 papers with code

The Silicone Ceiling: Auditing GPT's Race and Gender Biases in Hiring

no code implementations7 May 2024 Lena Armstrong, Abbey Liu, Stephen MacNeil, Danaë Metaxa

In Study 1, we ask GPT to score resumes with 32 different names (4 names for each combination of the 2 gender and 4 racial groups) and two anonymous options across 10 occupations and 3 evaluation tasks (overall rating, willingness to interview, and hireability).

Fairness

"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models

no code implementations14 Mar 2024 Seth Bernstein, Paul Denny, Juho Leinonen, Lauren Kan, Arto Hellas, Matt Littlefield Sami Sarsa, Stephen MacNeil

Grasping complex computing concepts often poses a challenge for students who struggle to anchor these new ideas to familiar experiences and understandings.

Comparing Traditional and LLM-based Search for Image Geolocation

no code implementations18 Jan 2024 Albatool Wazzan, Stephen MacNeil, Richard Souvenir

Participants using traditional search more accurately predicted the location of the image compared to those using the LLM-based search.

Conversational Search Information Retrieval +2

More Robots are Coming: Large Multimodal Models (ChatGPT) can Solve Visually Diverse Images of Parsons Problems

no code implementations3 Nov 2023 Irene Hou, Owen Man, Sophie Mettille, Sebastian Gutierrez, Kenneth Angelikas, Stephen MacNeil

These capabilities have prompted instructors to rapidly adapt their courses and assessment methods to accommodate changes in learning objectives and the potential for academic integrity violations.

Multiple-choice

The Robots are Here: Navigating the Generative AI Revolution in Computing Education

no code implementations1 Oct 2023 James Prather, Paul Denny, Juho Leinonen, Brett A. Becker, Ibrahim Albluwi, Michelle Craig, Hieke Keuning, Natalie Kiesler, Tobias Kohn, Andrew Luxton-Reilly, Stephen MacNeil, Andrew Peterson, Raymond Pettit, Brent N. Reeves, Jaromir Savelka

Second, we report the findings of a survey of computing students and instructors from across 20 countries, capturing prevailing attitudes towards LLMs and their use in computing education contexts.

Ethics

Comparing Code Explanations Created by Students and Large Language Models

no code implementations8 Apr 2023 Juho Leinonen, Paul Denny, Stephen MacNeil, Sami Sarsa, Seth Bernstein, Joanne Kim, Andrew Tran, Arto Hellas

In this paper, we explore the potential of LLMs in generating explanations that can serve as examples to scaffold students' ability to understand and explain code.

Cannot find the paper you are looking for? You can Submit a new open access paper.