Queue Management for Large Language Model Serving
- Archit Patke
- Dhemath Reddy
- et al.
- 2024
- SoCC 2024
I am Saurabh Jha, a research staff member at IBM Research at Yorktown Heights, NY (since 2021). I received my Ph.D. in 2021 and MS in 2016 in Computer Science from the University of Illinois at Urbana-Champaign (UIUC). I received my B.Tech from VIT University. Before joining UIUC, I worked as a visiting scholar at NTU Singapore.
My current research interests include design and assessment of autonomous agents. I work at the intersection of Machine Learning (with a particular interest in causal and generative models) and Systems (focusing on dependability).
I have published papers in prestigious journals and conferences (such as VLDB, NSDI, SuperComputing, ICS, OSDI, ASPLOS, DSN, ISSRE, and ICML).
Awards and Honors
Recent Professional Service