Vashisth Tiwari
PhD @ Carnegie Mellon
Hi! 👋
I’m a PhD student at Carnegie Mellon University’s LTI, advised by Emma Strubell and Zico Kolter. Previously, I completed my master’s at CMU and a bachelor’s in Physics and Mathematics at the University of Rochester.
My research focuses on developing better, more efficient LLMs by improving training dynamics and data quality. I am particularly interested in knowledge distillation, synthetic data generation, and reinforcement learning for post-training.
I’ve been fortunate to learn from wonderful mentors: Oleksii and Adi at Nvidia (summer 2026), Giulia DeSalvo at DeepMind (summer 2025), and Beidi Chen, Lucio Dery, Clara Na at CMU.
news
| Sep 30, 2026 | NeurIPS'26 (Don’t Discard Your Rollouts: Reusing Teacher RL Traces for Student Distillation) 🎉 |
|---|---|
| Sep 29, 2026 | COLM'26 (Measuring Five-Nines Reliability: Sample-Efficient LLM Evaluation in Saturated Benchmarks). Blog · Heading to 📍San Francisco for COLM, Oct 5–9! |
| Apr 01, 2026 | Research Intern @Nvidia (📍Santa Clara) w/ Oleksii and Adi on Nemotron Post-training |
| May 19, 2025 | Student Researcher @Google (📍Seattle) w/ Giulia DeSalvo on synthetic data for post-training |
| May 15, 2025 | ACL Main (Energy considerations on LLM inference) |
| Apr 14, 2025 | Will be joining CMU-LTI PhD Fall’25 cohort |
| Jan 23, 2025 | ICLR'25 (MagicDec) |
| Aug 19, 2024 | Released MagicDec: Breaking Throughput-Latency Trade-off for Long Context Generation with Speculative Decoding. Blog |