no code implementations • 18 Dec 2023 • Julien Dirani, Liina Pylkkänen
Conversely, lexical representations did not appear to partake in modality-independent semantic knowledge.
1 code implementation • 20 Nov 2023 • David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, Samuel R. Bowman
We present GPQA, a challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry.
1 code implementation • 15 Nov 2023 • Julian Michael, Salsabila Mahdi, David Rein, Jackson Petty, Julien Dirani, Vishakh Padmakumar, Samuel R. Bowman
Comparing debate to a baseline we call consultancy, where a single expert argues for only one answer which is correct half of the time, we find that debate performs significantly better, with 84% judge accuracy compared to consultancy's 74%.
no code implementations • 24 Jun 2022 • Julien Dirani, Liina Pylkkänen
We thus show evidence for the spontaneous activation of modality-independent semantic categories in picture naming and word reading, supporting theories in which amodal conceptual representations exist.