![[to read] No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding](/content/images/size/w600/2025/03/IMG_4259.jpeg)
Michael Krumdick, Charles Lovering, Varshini Reddy, Seth Ebner, Chris Tanner (Kensho Technologies, MIT) link:https://arxiv.org/abs/2503.05061 I'll create a dialogue among lab members discussing the academic paper "No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding" based on your guidelines. (1) A:
Ziqian Zhong, Jacob Andreas - Massachusetts Institute of Technology link:https://proceedings.neurips.cc/paper_files/paper/2024/file/bccdd196d798a51a4961989984a9ed4a-Paper-Conference.pdf (1) A: Welcome everyone to today's lab meeting. We're excited to have Ziqian Zhong presenting their paper "Algorithmic Capabilities of Random Transformers," which
Jingtong Su (NYU & Meta AI, FAIR), Julia Kempe (NYU & Meta AI, FAIR), Karen Ullrich (Meta AI, FAIR) link: https://proceedings.neurips.cc/paper_files/paper/2024/file/439bf902de1807088d8b731ca20b0777-Paper-Conference.pdf (1) A: Good afternoon, everyone! Today we have a presentation from the author about their recent paper titled "
Alexander Spangher (University of Southern California, Information Sciences Institute), Nanyun Peng (University of California, Los Angeles), Sebastian Gehrmann (Bloomberg), Mark Dredze (Bloomberg) link: https://aclanthology.org/2024.emnlp-main.1216/ (1) A: Good morning everyone! Today we have a presentation from our colleague, who will be discussing their recent paper titled
Authors and Affiliations: * Emre Can Acikgoz¹, Jeremiah Greer², Akul Datta¹, Ze Yang¹, William Zeng², Oussama Elachqar², Emmanouil Koukoumidis², Dilek Hakkani-Tür¹, Gokhan Tur¹ * ¹University of Illinois Urbana-Champaign * ²Oumi link: https://arxiv.org/abs/2502.08820 Dialogue A: Good morning everyone! Today we have a presentation from Emre, who will be sharing
Last updated: 2/29/2025 Yasaman Razeghi¹, Robert L. Logan IV¹, Matt Gardner², Sameer Singh¹³ | ¹Department of Computer Science, University of California, Irvine, USA; ²Microsoft Semantic Machines, USA; ³Allen Institute for Artificial Intelligence, USA link : https://arxiv.org/abs/2202.07206 Discussion: Attending: * Author (Yasaman Razeghi) * HoL (Head of Lab)
Things will be up and running here shortly, but you can subscribe in the meantime if you'd like to stay up to date and receive emails when new content is published!