Reliable ML from Unreliable Data

Workshop @ NeurIPS 2025


Upper Level Room 2, San Diego Convention Center   |  Dec 6, 2025

Official NeurIPS Workshop Page: neurips.cc/virtual/2025/loc/san-diego/workshop/109580



Distributions shift, chatbots get jail-broken, users game algorithms — how do we build reliable machine learning when data are missing, corrupted, or strategically manipulated?


This workshop bridges theory and practice to tackle these challenges, bringing together researchers working on distribution shift, adversarial robustness, and strategic behaviour to chart principled yet deployable solutions for Reliable ML from Unreliable Data.


Schedule (Sat Dec 6, 2025)

All times are local San Diego time (PST).

Start End Agenda
8:00 AM 8:30 AM Invited talk by Chris Harshaw
Title: The Conflict Graph Design: Estimating Causal Effects Under Network Interference
8:30 AM 9:00 AM Invited talk by Surbhi Goel
Title: Reliable Human-AI Collaboration via Agreement and Competition
9:00 AM 9:30 AM Coffee Break
9:30 AM 10:00 AM Invited talk by Samory Kpotufe
Title: Mixed-Sample SGD: an end-to-end Analysis of Supervised Transfer Learning
10:00 AM 10:30 AM Best-paper Talks
10:30 AM 11:00 AM Invited talk by Amin Karbasi
Title: Adversarial Reasoning
11:00 AM 12:00 PM Poster Session 1
12:00 PM 1:15 PM Lunch
1:30 PM 2:15 PM Poster Session 2
2:15 PM 3:00 PM Panel with Ahmad Beirami, Parikshit Gopalan, Tatsunori Hashimoto, and Chara Podimata
3:00 PM 3:30 PM Coffee Break
3:30 PM 4:00 PM Invited talk by Steve Hanneke
Title: Understanding Reliable and Probably Useful Learning
4:00 PM 5:00 PM Poster Session 3

Poster titles and poster-session assignments are available on the NeurIPS virtual workshop page.

Invited Speakers

Surbhi Goel
Surbhi Goel University of Pennsylvania
    
Steve Hanneke
Steve Hanneke Purdue University
    
Chris Harshaw
Chris Harshaw Columbia University
    
Amin Karbasi
Amin Karbasi Cisco & Yale University
    
Samory Kpotufe
Samory Kpotufe Columbia University

Invited Panelists

Ahmad Beirami
Ahmad Beirami Ex-Google Deepmind, Meta, and EA
  
Parikshit Gopalan
Parikshit Gopalan Apple
  
Tatsunori Hashimoto
Tatsunori Hashimoto Stanford
  
Chara Podimata
Chara Podimata MIT

Best Papers

Runner-up best paper Runner-up Best Paper

Why is Your Language Model a Poor Implicit Reward Model?

Noam Razin, Yong Lin, Jiarui Yao, and Sanjeev Arora

Runner-up best paper Runner-up Best Paper

Watch the Weights: Unsupervised monitoring and control of fine-tuned LLMs

Ziqian Zhong and Aditi Raghunathan

Cash prizes for the best paper awards are generously sponsored by Intelligible

Intelligible logo

Call for Papers

We invite work that advances theory, empirical understanding, or systems design for robust and reliable machine learning under imperfect data – including, but not limited to, the following topics:

  • Distribution shift and transfer learning
  • Adversarial robustness and defenses
  • Strategic behavior in socio-technical systems
  • Learning with missing or biased data; and truncated statistics
  • Causal inference beyond overlap, with confounders, or with errors
  • LLM safety and alignment
  • Robustness in interactive environments
Submissions may report new results, negative findings, benchmarks, or visionary perspectives.

  • Long track: up to 9 pages (excluding references).
  • Short track: up to 4 pages (excluding references).
  • Formatting: use the official NeurIPS 2025 style files and submit a single PDF (which should be anonymized, like NeurIPS submissions; see these instructions on anonymization).
  • Appendix: include any supplementary material in the same PDF — no page limit for the appendix.

Important Dates

  • Submission deadline:     — previous deadline
  • Notification of decisions: Mon Sep 22 2025 (AoE)
  • Workshop: Sat Dec 6, 2025 (at NeurIPS 2025)
  • Submission link: OpenReview
  • Accepted papers: OpenReview accepted papers list

The workshop is non-archival; authors are free to publish revised versions elsewhere. Every submission will receive at least two reviews from our program committee, and accepted papers will be presented as talks or posters.

Organizers

Andrew Ilyas
Andrew Ilyas Stanford / CMU
Alkis Kalavasis
Alkis Kalavasis Yale University
Anay Mehrotra
Anay Mehrotra Yale University
Manolis Zampetakis
Manolis Zampetakis Yale University

Program Committee

We thank our reviewers for their valuable contributions

Nivasini Ananthakrishnan
Joshua Wolff Anderson
Carmel Baharav
Kapilan Balagopalan
Mark Bedaywi
Chengdi Cao
Aunabil Chakma
Syomantak Chaudhuri
Weixin Chen
Keertana Chidambaram
Jessica Dai
Yan Dai
Mohammadreza Daneshvaramoli
Siddartha Devic
Qiwei Di
Spyros Dragazis
Valia Efthymiou
Enfa Fane
Qiang Fu
Georgios Gkrinias
Sruthi Gorantla
Anxin Guo
Mingfei Guo
Xiaobo Guo
Zhicheng Guo
Sophia Simeng Han
Jennifer Hsia
Giannis Iakovidis
Hyewon Jeong
Vikram Kher
Alexandros Kouridakis
Jane H. Lee
Kelvin M. Leung
Jiaxun Li
Shuchen Li
Vasilis Livanos
Kuan Lu
Mingchen Ma
Katerina Mamali
Marina Mancoridis
Argyris Mouzakis
Tamalika Mukherjee
Pranay Mundra
Anh Tuan Nguyen
Changdae Oh
Hillary Nana Yaa Owusu
Atasi Panda
Yorgos Pantis
Cassandra Parent
Seongheon Park
Yash Patel
Charilaos Pipis
Charalampos Platanos
Eleni Psaroudaki
Hao Qin
Shreyaa Raghavan
Herlock Rahimi
Vinod Raman
Kartik Ravisankar
Saeyoung Rho
Roy Rinberg
Baturay Saglam
Sourav Sahoo
Sebastian Schmidt
Junyi Sha
Deep Shah
Parnian Shahkar
Mohit Sharma
Yunyi Shen
Flora C. Shi
Prabhav Singh
Neha Sontakke
Vaidehi Srinivas
Vishwak Srinivasan
Kevin Stangl
Konstantinos Stavropoulos
Miltiadis Stouras
Anzo Teh
Thanos Tolias
Toan Tran
Thodoris Tsilivis
Panagiotis Tsimpos
Konstantinos Tsirkas
Annie S Ulichney
Lukas Vogl
Shu Wan
Erchi Wang
Xiuyuan Wang
Yufeng Wu
Eric Xia
Chulin Xie
Jianzhu Yao
Aditya Sirish A Yelgundhalli
Xifan Yu
Jack Zhang
Rui Zhang
Weiqiang Zheng
Yifan Zhu

Last updated November 29, 2025 by Anay Mehrotra