ARTFEED — Contemporary Art Intelligence

Longitudinal Study of Human-AI Collaboration in Open-Source Coding

ai-technology · 2026-08-17

A recent preprint available on arXiv (2608.13884) offers a longitudinal examination of human-AI collaboration within open-source software development, concentrating on two AI infrastructure projects: vLLM and SGLang. The analysis spans from February 2023 to June 2026 for vLLM and from January 2024 to June 2026 for SGLang, encompassing a total of 33,228 merged pull requests (18,290 from vLLM and 14,938 from SGLang). Researchers calculated seven engineering metrics, including pull request throughput and contributor diversity. The development timeline was divided into four distinct eras, reflecting significant shifts in AI-assisted software engineering. Results show marked improvements in development speed, with one project's PR throughput increasing by 21 times, suggesting potential benefits for biomedical AI agents and bioinformatics development. The study provides valuable empirical insights at the team level, an area previously underexplored. The authors remain unnamed in the abstract, but the work is categorized under cross-listing on arXiv.

Key facts

  • Study analyzed 33,228 merged pull requests from vLLM and SGLang repositories.
  • vLLM data covers February 2023 to June 2026, with 18,290 PRs.
  • SGLang data covers January 2024 to June 2026, with 14,938 PRs.
  • Seven engineering metrics were computed: PR throughput, cycle time, contributor diversity, PR comment density, merge rate, new-author participation, and PR size.
  • Development was segmented into four eras aligned with major changes in AI-assisted software development.
  • Both projects showed substantial increases in development velocity and AI-developer collaboration signals.
  • PR throughput increased 21-fold (exact metric not specified in abstract).
  • Implications for biomedical AI agents and bioinformatics pipeline development are discussed.
  • The study is a descriptive longitudinal analysis at the team level.
  • Preprint available on arXiv with ID 2608.13884.

Entities

Institutions

  • arXiv
  • vLLM
  • SGLang

Sources