Local chat
A conversation with history, streaming, a stop button and several sessions you can fork.
Prompt API …
This browser cannot run this demo
Use Chrome on desktop and check chrome://on-device-internals. Setup guide ·
Status page ·
Frequently asked questions
What it does
A chat with the on-device model that remembers what was said. You can keep several sessions, fork one to explore two directions from the same point, and watch how much of the model's context is used.
How to use it
- Write a message and press Send (or Enter; Shift+Enter adds a line).
- The reply streams in. Press Stop to cancel it.
- “New” starts an empty session. “Fork” copies the current one so you can continue it a different way. “Delete” removes it. Switch between sessions in the Session list.
- “Context used” shows how much of the model's memory the conversation takes. When it is full, start a new session.
How much of the model's memory this conversation takes. When it is full, start a new session.