[2603.12229] Language Model Teams as Distributed Systems

[Submitted on 12 Mar 2026]

View a PDF of the paper titled Language Model Teams as Distributed Systems, by Elizabeth Mieczkowski and 4 other authors

View PDF
HTML (experimental)

Abstract:Large language models (LLMs) are growing increasingly capable, prompting recent interest in LLM teams. Yet, despite increased deployment of LLM teams at scale, we lack a principled framework for addressing key questions such as when a team is helpful, how many agents to use, how structure impacts performance — and whether a team is better than a single agent. Rather than designing and testing these possibilities through trial-and-error, we propose using distributed systems as a principled foundation for creating and evaluating LLM teams. We find that many of the fundamental advantages and challenges studied in distributed computing also arise in LLM teams, highlighting the rich practical insights that can come from the cross-talk of these two fields of study.