AI Engineering

Vision

Our goal is not merely to launch features, but to ensure they land successfully and provide real value to our customers. We strive to develop a best-in-class product that exceeds expectations across all user groups by meeting high-quality standards while ensuring reliability and maintaining an ease of operation and scalability to meet diverse customer needs. All team members should remain mindful of our target customers and the multiple platforms we support in everything we do.

Ensure our product excels in all aspects especially for our primary customer organization archetypes of large enterprises. This includes scalability, adaptability, and seamless upgrade paths. When designing and implementing features, always keep in mind compatibility for all our deployment options: self-managed, dedicated and Software as a Service (SaaS).

Develop our technical, diverse and global team to drive results that support our product and customer growth, while maintaining our values and unique way of working.

Mission

GitLab’s unique way of working asynchronously, handbook first method, utilization of the product we develop and clear focus on our values enables very high productivity. We focus on constantly improving quality, usability and reliability of our product to reach maximum customer satisfaction. Community contributions and customer interactions rely on efficient and effective communication. We are a data-driven, customer experience first, open core organization delivering one secure, reliable, world leading DevSecOps platform. Join us in setting new standards, driving innovation, pushing the boundaries of DevSecOps, and consistently delivering exceptional results for our customers.

Organizational Structure

@startwbs
* Tim Zallmann (VP of AI)
** Donald Cook - Editors, Chat & Client
*** Chat EM (open role)
**** Web Chat
**** Chat Engine
*** Amr Elhusseiny
**** Duo CLI
**** VSCode
*** Duo Client SDK
*** Erran Carey - Principal Engineer
** Martin Wortschack - Models, Gateway & Infra
*** Duo Service Infra
*** Model Evaluation Infra
*** Mohamed Hamda (Acting EM)
**** Gateway Services
**** AI Health + Connectivity
**** Model Selection
** Sebastian Rehm - Agent Foundations
*** Annie Ying
**** Agent Developer
**** Flow Components
*** Sebastian Rehm
**** Agent Observability
**** Runner Execution
**** Agent Tools
*** Jafar Soltani
**** Flow Creation / Editing
**** AI Catalog Curation
**** External Agents
** Matt Nohr - Events, Code Review & Flows
*** DAP Events
*** DAP Code Review
*** DAP Repository Flows
*** François Rosé
**** Code Review
** Direct ICs
*** Shekhar Patnaik
*** Liki Simonot
*** Denys Mishunov
*** Igor Drozdov
*** Jessie Young
*** Eduardo Bonet
@endwbs

AI Engineering Teams

This section provides an overview of all teams invested in implementing and maintaining AI features. Our AI portfolio is a cross-category effort.

These are the teams (please update them if they are stale):

Team Responsible For
Agent Foundations The agentic AI foundations section:
AI Coding Code Suggestions, Duo Code Review, code-related slash commands (/explain, /refactor, /tests, /fix), Semantic Indexing, Duo Context Exclusion, Repository X-Ray
AI Core Infra Abstraction Layer / AI Gateway for LLM integration to the application (GitLab Chat, Code Suggestions and other AI capabilities)
AI Core Infra (formerly Model Validation) Custom feature evaluators, evaluation support, automated evaluation tooling
AI Clients: Developer Clients VS Code extension, JetBrains plugin, Duo CLI
AI Clients: Duo Client SDK GitLab Language Server and shared client SDK powering AI features across all editor extensions
AI Clients: Duo Chat Duo Chat across web and IDE surfaces (Web Chat, Chat Engine)
AI Model Services Model Selection (model lifecycle, selection engine & UI) / Health & Connectivity (Duo Health Check, setup, connectivity) / Gateway Services (Prompt Registry, Events tracking, AIGW billing)
Global Search Abstraction Layer / Vector Storage / Semantic
Infrastructure Platforms - Runway AI Gateway Scalability / Runway infrastructure

Counterparts

The AI department engineering structure is different from the Product structure. To read about how we collaborate and who are the counterparts, you can check the AI product’s page.

ClickHouse Datastore usage

ClickHouse usage by Analytics:Platform Insights group

AI Experimentation

We strongly encourage team members to experiment and develop AI-related projects as part of their exploration and learning journey. These experimental initiatives help accelerate our work and allow AI teams to embrace emerging challenges and opportunities.

Existing projects may be reviewed by product and engineering teams on a case-by-case basis for potential migration into GitLab-managed projects.

To protect GitLab’s brand while maintaining our commitment to transparency, all experimental AI projects must prominently display the following disclaimer at the top of their README:

“⚠️ This is an unofficial project. It is not endorsed or supported by GitLab Inc. and is not recommended for use in production environments.”


Agent Foundations
The Agent Foundations stage builds the foundations for GitLab's agentic AI experiences, including Agent Developer, AI Catalog, and Agent Execution.
AI Catalog — Design Principles & Vision
Design principles and vision for the AI Catalog, defining what the catalog is, what it is not, and the principles that guide every design and engineering decision.
AI Clients
The AI Clients stage owns the surfaces through which developers and users interact with GitLab Duo AI capabilities — including editor extensions, the Duo CLI, the Duo Chat web interface, and the shared client SDK.
AI Coding Group
The AI Coding Group is part of the AI Engineering organization focused on user-facing AI-powered coding features.
AI Core Infra Group
The AI Core Infra group is focused on how to support other product groups at GitLab with the AI Abstraction Layer, and GitLab AI feature development.
AI Model Services Group
The AI Model Services group owns GitLab Duo's customer-facing model operations/intelligence layer, which models are available and how they're selected, the health and connectivity of the customer experience, and the gateway service surface (prompts, internal events, and AIGW billing).
Duo Chat Group
We are dedicated to enhancing DevSecOps productivity by building an AI natural language interface to GitLab's Platform.
Global Search Group
The Global Search team is focused on bringing world class search functionality to GitLab.com and self-managed instances.