Machine Learning + Computer Systems · UC Berkeley
I am a professor in EECS at UC Berkeley, working at the intersection of machine learning and computer systems. My research asks how new systems abstractions can enable new forms of machine learning and AI.
Over the past fifteen years, my students and collaborators have built systems spanning large-scale graph learning, distributed machine learning, model serving and tuning, LLM inference and evaluation, and AI agents. This work includes LEANN, SkyRL, Gorilla, the Berkeley Function Calling Leaderboard (BFCL), Chatbot Arena, LLM-as-a-Judge, SGLang, MemGPT, vLLM, Alpa, Ray Serve, Ray Tune, Clipper, GraphX, PowerGraph and GraphLab, among other projects.
Much of this work involved building open-source systems and communities so that new ideas could be used widely in practice. Many of these systems were led by PhD students I advised, who have gone on to academic positions, AI research labs, and companies they founded.
One question has shaped my agenda: If we solve today's hot problems, what new problems will those solutions create? In 2008, when most of the field was developing new models, I bet that scaling learning to much larger datasets and more parallel compute would become the challenge, and began working on ML systems. In 2015, as the field focused on scaling training, I bet that serving large models and adapting them to new contexts would come next, and began working on inference systems.
Today I am betting that many of the hard problems in AI agents will be solved. My group is studying how systems must change for thousands of highly capable agents, how people can steer and negotiate through them, and how models can move from learning from data to learning from teachers. We also work on post-training and new neural architectures. More on these bets →
The main areas of my research, from graph systems to AI agents.
If many hard problems in agents are solved, we will need to change how systems are built, how people oversee agents, and how models learn.
Agent-first systems · humans steering agent teams · learning from teachers · MemGPT (Charles Packer, Sarah Wooders, Kevin Lin) · SkyRL · LEANN · new architectures (MRNN, sparse attention)
Large models made inference efficiency and evaluation central research problems.
Alpa (Lianmin Zheng) · vLLM · SGLang (Lianmin Zheng, Ying Sheng) · Chatbot Arena and LLM-as-a-Judge · Gorilla (Shishir Patil, Tianjun Zhang)
Once a model is trained, it still has to be served, composed with other models and tuned, and each of these steps is a systems problem.
Clipper (Daniel Crankshaw) · Ray Serve (Simon Mo) · Ray Tune (Richard Liaw)
Machine-learning algorithms have structure that systems can exploit.
GraphLab and PowerGraph, from doctoral work at CMU · GraphX, now part of Apache Spark
Read the full research story, including the people behind each project →
Former students and postdocs, with the thesis and projects from their time in the group and selected subsequent roles, as listed in my CV. Dates indicate advising periods, not necessarily full degree enrollment or completion.
Recent papers from the group. Foundational papers for each project are linked from the research story, and the full list is on Google Scholar and in the CV.