Vashisth Tiwari
PhD @ Carnegie Mellon
Hi! 👋
I’m a PhD student at Carnegie Mellon University’s LTI, advised by Emma Strubell and Zico Kolter. Previously, I completed my master’s at CMU and a bachelor’s in Physics and Mathematics at the University of Rochester.
I’m broadly interested in bringing some formalism and better understanding to how and why LLM training methods work, and in improving the efficiency of LLMs (through better data and improved training dynamics). My work so far has focused on distillation and reinforcement learning during post-training.
I’ve been fortunate to learn from wonderful mentors: Oleksii and Adi at Nvidia (summer 2026), Giulia DeSalvo at DeepMind (summer 2025), and Beidi Chen, Lucio Dery, Clara Na at CMU.
news
| Sep 30, 2026 | NeurIPS'26 (Don’t Discard Your Rollouts: Reusing Teacher RL Traces for Student Distillation) 🎉 |
|---|---|
| Sep 29, 2026 | COLM'26 (Measuring Five-Nines Reliability: Sample-Efficient LLM Evaluation in Saturated Benchmarks). Blog · Heading to 📍San Francisco for COLM, Oct 5–9! |
| Apr 01, 2026 | Research Intern @Nvidia (📍Santa Clara) w/ Oleksii and Adi on Nemotron Post-training |
| May 19, 2025 | Student Researcher @Google (📍Seattle) w/ Giulia DeSalvo on synthetic data for post-training |
| May 15, 2025 | ACL Main (Energy considerations on LLM inference) |
| Apr 14, 2025 | Will be joining CMU-LTI PhD Fall’25 cohort |
| Jan 23, 2025 | ICLR'25 (MagicDec) |
| Aug 19, 2024 | Released MagicDec: Breaking Throughput-Latency Trade-off for Long Context Generation with Speculative Decoding. Blog |