Platform

Everything you need to build on durable context.

A workspace to chat over your documents, an OpenAI-compatible API to build on them, and a dashboard that makes the reuse — and the savings — legible. Run it hosted on lab358 Cloud, or in your own AWS account.

Join the waitlist Talk to us

The lab358 Playground answering a question grounded in an indexed document, showing a cache-hit badge and time-to-first-token on the message. — The Playground — answering from an indexed document, with cache hit and time-to-first-token on every message.

The lab358 usage dashboard showing reuse rate, tokens, and cost for the current period. — The usage dashboard — reuse rate, tokens, and cost for the period.

What's in the box.

Playground

A streaming chat UI over your indexed documents, with the model and preset picker and a cache-hit / time-to-first-token readout on every message.

Documents

Upload once, precompute the index once — then reuse it across every chat and agent. Versioned, access-controlled per document, with a readiness status (Indexed / Indexing / Queued / Failed) so you can see what's live.

Presets & agents

Save a system prompt plus model and document configuration as a preset, then apply it across the Playground and the API so behaviour is consistent.

API, SDK & CLI

An OpenAI-compatible completions API, TypeScript and Python SDKs, and a command-line client — point your existing tools at lab358 and go.

Usage & observability

A live dashboard: tokens in and out, reuse rate, and cost, broken down by API key, model, and preset — so the efficiency win is legible.

Team & access

Invite members with roles, mint and scope API keys, and (on Business) sign in with SSO. Every config change is captured in an exportable audit log.

A CLOSER LOOK

Inside the console.

Documents

Upload a document once and index it once. A readiness Status shows when it's live and ready to reuse, and every chat, agent, and API call draws on the same index — versioned and access-controlled per document.

Presets

Save a system prompt together with a model and document configuration as a preset, then apply it across the Playground and the API so behaviour stays consistent everywhere you use it.

Team & access

Invite members with roles, mint and scope API keys, and sign in with SSO on Business. Every configuration change is captured in an exportable audit log.

API & SDK

Bring your own tools.

lab358 speaks the OpenAI API, so the SDKs and tools you already use just work — point them at the lab358 base URL.

OpenAI-compatible · drop-in

from openai import OpenAI

client = OpenAI(
    base_url="https://cloud.lab358.ai/v1",
    api_key="lab358_…",
)

resp = client.chat.completions.create(
    model="lab358/model",
    messages=[{"role": "user", "content": "Summarize the Q3 board deck."}],
    # reuse a document you indexed once
    extra_body={"documents": ["doc_board"]},
)

Start building on durable context.

Join the waitlist See pricing

Loading…

from openai import OpenAI client = OpenAI( base_url="https://cloud.lab358.ai/v1", api_key="lab358_…", ) resp = client.chat.completions.create( model="lab358/model", messages=[{"role": "user", "content": "Summarize the Q3 board deck."}], # reuse a document you indexed once extra_body={"documents": ["doc_board"]}, )