Braintrust integration

Create Dataset

Create a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.

Create Experiment

Create an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.

Create Project

Create a Braintrust project, or return the existing project unchanged when its name already exists.

Create Prompt

Upsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submitted configuration. MCP attachments and tool-function bindings are unsupported.

Delete Project

Soft-delete a Braintrust project and return its deletion state.

Delete Experiment, Dataset, or Prompt

Delete one Braintrust experiment, dataset, or prompt by UUID for explicit lifecycle cleanup.

Fetch Events

Fetch one newest-to-oldest page of project log, experiment, or dataset events.

Get Braintrust Resource

Get one project, experiment, dataset, prompt, or function by UUID.

Insert Dataset Events

Upsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.

Insert Experiment Events

Upsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event's current values.

List Braintrust Resources

List and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.

Query Braintrust Data

Run one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor unchanged.