๐Ÿณ Cooking with Agents in VS Code

Liam Hampton โ€” Microsoft ยท AI Engineer Conference
Video thumbnail
โฑ ~17 min ๐ŸŽค Liam Hampton ๐Ÿข Microsoft ๐Ÿท GitHub Copilot ยท VS Code ยท Agents

1 Introduction & The Agent Landscape

โ–ถ 00:16 Liam opens by acknowledging the explosion of AI agents across CLIs, terminals, chat windows, and editors โ€” and warns against the "agents can solve the world's problems" mindset. Developers still attempt one-shot prompts expecting complete applications or fixes in a single request.

โ–ถ 01:16 From a business perspective, companies are asking about ROI and productivity boosts, yet AI infrastructure spending hasn't delivered proportional returns. The key message: be deliberate about how you use AI tools and be mindful of token spend.

โ–ถ 01:42 Fun anecdote: a viral repo gained popularity by making LLMs "talk like a pirate" โ€” the compressed language actually reduces token expenditure while maintaining quality.

2 Types of Agents: Local, Background & Cloud

โ–ถ 02:38 Three distinct agent categories:

๐ŸŸข Local Agents

  • Run inside VS Code on your local machine
  • Use remote models (GPT, Claude) or local ones
  • Side-by-side, hands-on โ€” human in the loop
  • Maximum developer control

๐ŸŸ  Background Agents

โ–ถ 03:07
  • Via GitHub Copilot CLI (also in VS Code)
  • Isolated via Git worktrees
  • Semi-autonomous (50/50 oversight)
  • Autopilot mode (preview) โ€” skips confirmations

๐ŸŸฃ Cloud Agents

โ–ถ 03:37
  • Scale outside your organization
  • Leverage GitHub cloud services
  • Best for hands-off tasks
  • Run in GitHub Actions (isolated)

Git worktree explained: A branch mapped to an isolated subdirectory โ€” its own working copy with an associated branch, similar to a regular Git branch but physically separated.

3 When to Use Each Agent Type

โ–ถ 04:07

Local Agent โ€” High Involvement

โœ… Writing Tests

  • Hands-on with tests
  • Understand the codebase deeply
  • "In the weeds" approach
Background Agent โ€” Medium Involvement

โœ… Building UI / Front-end

โ–ถ 04:34

  • 50/50 oversight
  • Arduous, time-consuming tasks
  • Don't want to be fully out of the loop
Cloud Agent โ€” Low Involvement

โœ… Documentation

โ–ถ 04:59

  • READMEs, contribution guidelines
  • Making repos open-source friendly
  • Fully hands-off

4 VS Code as the Single Entry Point

โ–ถ 05:29 The core thesis: VS Code serves as a unified entry point for all AI agent interactions. It supports:

The goal: reduce cognitive load by centralizing agent management in one place.

5 Live Demo: Three Agents, One Codebase

โ–ถ 05:56 Liam demonstrates running three different agent types simultaneously on a single Python CRUD (product store) application.

Step 1 โ€” Background Agent: Create Front-End UI

Step 2 โ€” Cloud Agent: Open-Source Documentation

โ–ถ 07:24

Step 3 โ€” Local Agent: Write Unit Tests

โ–ถ 07:50

Results

โ–ถ 09:41 All three agents complete successfully:

โ–ถ 11:06 "One codebase, three problems, three separate agents fixed all at the same time."

6 How Cloud Agents Work Under the Hood

โ–ถ 11:35

7 Customization: Instructions, Skills & Agents

โ–ถ 12:33 Four customization layers (applicable to Copilot AND other AI tools):

๐Ÿ“‹ Custom Instructions

Define how the agent behaves

๐Ÿค– Custom Agents

Specialized agents for specific tasks (e.g., test writing)

๐Ÿ“ Prompt Files

Pre-built prompts for common tasks

โšก Agent Skills

Newer version of agents.md โ€” reusable capabilities

8 VS Code Chat Customization Modal

โ–ถ 13:29 Liam walks through the VS Code chat settings (via the cog icon in Copilot chat pane):

โ–ถ 14:44 Third-party support: Claude plugins, hooks, instructions, and skills are all accessible from the same modal. Not restricted to GitHub Copilot.

9 Resources: Awesome Copilot & MCP Servers

โ–ถ 15:14

Awesome Copilot

MCP (Model Context Protocol)

โ–ถ 15:42

10 Key Takeaways

โ–ถ 16:13

1. Don't rely on one-shot prompts โ€” agents work best with iterative, targeted tasks distributed across the right agent type.
2. Three agent types serve different needs: Local (high control), Background (semi-autonomous via Git worktrees), Cloud (fully autonomous in GitHub Actions).
3. VS Code is the hub โ€” a single entry point for managing local, background, cloud, and third-party agents simultaneously.
4. Autopilot mode (preview) enables background agents to work without constant confirmation โ€” use carefully.
5. Cloud agents are safe โ€” network firewalls, no main-branch access, isolated environments.
6. Customization is universal โ€” instructions, agents, prompts, and skills work across Copilot AND third-party tools.
7. MCP extends everything โ€” connects agents to Azure, Playwright, docs, and more.
8. Token spend matters โ€” be deliberate about which agent type you use and how you prompt.

โฑ Timestamp Index

00:16Introduction & agent proliferation warning
00:46One-shot prompt fallacy
01:16ROI & business perspective on AI spend
01:42Token spend & "talk like a pirate" repo
02:07GitHub Copilot agents overview
02:38Local agents explained
03:07Background agents & Git worktrees
03:37Cloud agents explained
04:07When to use local agents (tests)
04:34When to use background agents (UI)
04:59When to use cloud agents (docs)
05:29VS Code as single entry point
05:56Demo begins: Python CRUD app
06:26Autopilot mode explained
07:24Cloud agent: open-source docs
07:50Local agent: custom test agent
08:46Iterating with local agent
09:41All agents complete
10:31Testing background agent output
11:06New front-end UI reveal
11:35Cloud agents: GitHub Actions
12:04MCP servers & safeguards
12:33Customization layers
13:29VS Code chat modal walkthrough
14:44Third-party support (Claude)
15:14Awesome Copilot resource
15:42MCP overview
16:13Wrap-up & closing