Machine Learning + Computer Systems · UC Berkeley
I am a professor in EECS at UC Berkeley, working at the intersection of machine learning and computer systems. My research asks how new systems abstractions can enable new forms of machine learning and AI.
Over the past fifteen years, my students and collaborators have built systems spanning large-scale graph learning, distributed machine learning, model serving and tuning, LLM inference and evaluation, and AI agents. This work includes GraphLab, PowerGraph, GraphX, Clipper, Ray Serve, Ray Tune, Alpa, vLLM, SGLang, Chatbot Arena, LLM-as-a-Judge, Gorilla, the Berkeley Function Calling Leaderboard (BFCL), MemGPT, SkyRL and LEANN, among other projects.
A recurring theme is building not only new algorithms but also the systems and research communities that make new ideas practical and widely used. Many of these systems were led by PhD students I advised, who have gone on to academic positions, AI research labs, and companies they founded.
One question has shaped my agenda: If we solve today's hot problems, what new problems will those solutions create? In 2008, when most of the field was developing new models, I bet that scaling learning to much larger datasets and more parallel compute would become the challenge, and began working on ML systems. In 2015, as the field focused on scaling training, I bet that serving large models and adapting them to new contexts would come next, and began working on inference systems.
Today I am betting that many of the hard problems in AI agents will be solved. My group asks how systems must change for thousands of highly capable agents, how people can steer and negotiate through them, and how models can move from learning from data to learning from teachers. We also work on post-training and new neural architectures. More on these bets →
A single line of inquiry: each era asks what systems a new kind of machine learning needs, and each builds on the ideas and people of the one before.
Machine-learning algorithms have structure that systems can exploit.
GraphLab and PowerGraph, from doctoral work at CMU · GraphX, now part of Apache Spark
Training a model is only the beginning; the rest of the ML lifecycle is a systems problem.
Clipper (Daniel Crankshaw) · Ray Serve (Simon Mo) · Ray Tune (Richard Liaw)
Large models made inference efficiency and evaluation central research problems.
Alpa (Lianmin Zheng) · vLLM · SGLang (Lianmin Zheng, Ying Sheng) · Chatbot Arena and LLM-as-a-Judge · Gorilla (Shishir Patil, Tianjun Zhang)
If many hard problems in agents are solved, systems, human oversight and learning itself will have to change.
Agent-first systems · humans steering agent teams · learning from teachers · MemGPT (Charles Packer, Sarah Wooders, Kevin Lin) · SkyRL · LEANN · new architectures (MRNN, sparse attention)
Read the full research story, including the people behind each project →
Former students and postdocs, with the thesis and projects from their time in the group and selected subsequent roles, as listed in my CV. Dates indicate advising periods, not necessarily full degree enrollment or completion.
Recent papers from the group. Foundational papers for each project are linked from the research story, and the full list is on Google Scholar and in the CV.