WebLLM

Browser Usage

Use the navigator.llm API directly in the browser

Quick Start

Install the Client SDK

Basic Usage

API Methods

navigator.llm.generate()

General text generation

navigator.llm.summarize()

Summarize text content

navigator.llm.translate()

Translate text between languages

navigator.llm.stream()

Stream responses in real-time

Task-Based Routing

Specify task type for automatic model selection:

Available Tasks
coding
Code generation
creative
Creative writing
summarization
Text summarization
qa
Question answering
educational
Teaching/explaining
general
General purpose
Hints

speed: fastest, fast, balanced, quality

quality: draft, standard, high, best

maxTokens: Output length limit

temperature: Creativity (0-1)

Error Handling

CDN Usage (No Build Step)

Next Steps

API Reference

Complete API documentation

View API Docs →
Examples

Working code examples

View Examples →