Code Suggestions

Overview

Code Suggestions is one of the main features developed by the Code Creation group. It provides AI-generated code within IDEs through two main capabilities:

• Code Completion: Short AI-generated suggestions intended to complete an existing line or block of code
• Code Generation: Longer AI-generated suggestions intended to create entire functions, classes, code blocks, etc.

Key Concepts

A lot of the terms we use in this area sound similar and can be confusing at first. Here are the basic terms we use:

• Code Creation: The group name and a collection of features relating to providing AI generated code
• Code Suggestions: A feature within Code Creation that provides AI-generated code within an IDE
  • Code Completion: A short AI-generated suggestion intended to complete an existing line or block of code
  • Code Generation: A longer AI-generated suggestion intended to create entire functions, classes, code blocks, etc.
• Duo Chat: Another feature that interacts with GitLab Duo Chat to write new code, refactor existing code, or scan code for vulnerabilities

If it helps, here are these terms in a diagram:

stateDiagram
    direction LR

    state "Code Creation" as creation
    state "Code Suggestions" as suggestions
    state "Code Completion" as completion
    state "Code Generation" as generation
    state "Duo Chat Features" as duo

    creation --> suggestions
    creation --> duo
    suggestions --> completion
    suggestions --> generation

Technical Implementation

For detailed technical information about how Code Suggestions works, including architecture diagrams and API details, see the Engineering Overview.

Dashboards and Monitoring

• User Metrics (README) - usage, acceptance rate, latency, error rates, etc (Tableau)
• General Metric Reporting - can find code suggestions rate limiting, X-Ray usage, etc (Tableau)
• Log Visualization Dashboard - another view of latency, response codes, number of requests, etc (Kibana)
• Latency Dashboard: Breakdown of server-side latency for code suggestions (Kibana)
• LSP Sentry Alerts and the corresponding Slack channel where the alerts are posted: #g_code_creation_alerts

Documentation

• Development Guide - Development guide for engineers
• Quick Start - GitLab Documentation
• GitLab Documentation - GitLab Documentation
• Direction
• Difference between Code Completion and Code Generation - YouTube
• Engineering Overview - Technical overview of Code Suggestions
• Epic

View page source - Edit this page - please contribute.