Search Results for author: Julien Dirani

Found 4 papers, 2 papers with code

MEG Evidence That Modality-Independent Conceptual Representations Encode Visual but Not Lexical Representations

no code implementations18 Dec 2023 Julien Dirani, Liina Pylkkänen

Conversely, lexical representations did not appear to partake in modality-independent semantic knowledge.

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

1 code implementation20 Nov 2023 David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, Samuel R. Bowman

We present GPQA, a challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry.

Multiple-choice

Debate Helps Supervise Unreliable Experts

1 code implementation15 Nov 2023 Julian Michael, Salsabila Mahdi, David Rein, Jackson Petty, Julien Dirani, Vishakh Padmakumar, Samuel R. Bowman

Comparing debate to a baseline we call consultancy, where a single expert argues for only one answer which is correct half of the time, we find that debate performs significantly better, with 84% judge accuracy compared to consultancy's 74%.

Reading Comprehension

The Temporal Evolution of Modality-Independent Representations of Conceptual Categories

no code implementations24 Jun 2022 Julien Dirani, Liina Pylkkänen

We thus show evidence for the spontaneous activation of modality-independent semantic categories in picture naming and word reading, supporting theories in which amodal conceptual representations exist.

Cannot find the paper you are looking for? You can Submit a new open access paper.