WebLLM

Installation

Get started with WebLLM in your project

Overview

WebLLM provides multiple installation options depending on your use case:

  • Browser Extension - For end users to enable AI on any website
  • NPM Package - For developers building AI-powered applications
  • CDN - For quick prototyping without a build step

Browser Extension

The WebLLM Chrome extension enables AI access on any website through the navigator.llm API.

Installation

  1. Download the extension from the Chrome Web Store (coming soon)
  2. Click "Add to Chrome"
  3. Configure your API keys or local models in the extension settings

Development Installation

To load the extension locally for development:

NPM Package

For developers building applications with WebLLM.

Installation

Or with yarn:

Or with pnpm:

What Gets Installed

The webllm package includes:

  • @webllm/client - Browser SDK and polyfill
  • @webllm/server - Core orchestration (for daemon mode)
  • CLI tools for running a local daemon

CDN Installation

For quick prototyping or static HTML pages:

Or use ES modules:

Vercel AI SDK Provider

If you're using the Vercel AI SDK, install the WebLLM provider:

Usage:

Next Steps