- Category: artificial intelligence
- Auth: API_KEY
- Composio-managed OAuth available? N/A
- Tools: 17
- Triggers: 0
- Slug:
BRAINTRUST - Version: 20261030_00
Tools
Create Dataset
Create Dataset
Slug:
BRAINTRUST_CREATE_DATASETCreate a named dataset under a Braintrust project, or return the existing dataset unchanged when its name already exists in that project.Input Parameters
Dataset name, which must be unique within the project. Braintrust returns the existing dataset unchanged when this name already exists.
Output
Create Experiment
Create Experiment
Slug:
BRAINTRUST_CREATE_EXPERIMENTCreate an experiment under a Braintrust project. When its name already exists, Braintrust returns the existing experiment unchanged unless ensure_new is true, which creates an experiment with a unique name.Input Parameters
Generate a unique experiment name on a name conflict. When false, Braintrust returns the existing same-name experiment unchanged.
Output
Create Project
Create Project
Slug:
BRAINTRUST_CREATE_PROJECTCreate a Braintrust project, or return the existing project unchanged when its name already exists.Input Parameters
Project name. Braintrust returns an existing project unchanged when this name already exists, so use a unique name when a new project is required.
Organization name for the rare case where the API key’s active data plane supports organization selection. This does not reliably switch organizations.
Output
Create Prompt
Create Prompt
Slug:
BRAINTRUST_CREATE_PROMPTUpsert a versioned prompt configuration under a Braintrust project without invoking it. The same project and slug reuse the prompt ID but create a new version that replaces the stored prompt configuration with the submitted configuration. MCP attachments and tool-function bindings are unsupported.Input Parameters
Prompt identity slug within the project. Reusing the same project and slug keeps the prompt ID but creates a new version that replaces the stored prompt configuration with the submitted configuration.
Structured prompt block, model options, and parser configuration. MCP attachments and tool_functions are rejected by this schema.
string ("llm" | "scorer" | "task" | "tool" | "custom_view" | "preprocessor" | "facet" | "classifier" | "tag" | "parameters" | "sandbox")
Braintrust function classification assigned to the prompt.
Output
Delete Project
Delete Project
Delete Experiment, Dataset, or Prompt
Delete Experiment, Dataset, or Prompt
Fetch Events
Fetch Events
Slug:
BRAINTRUST_FETCH_EVENTSFetch one newest-to-oldest page of project log, experiment, or dataset events.Input Parameters
Maximum full traces to request. A page can contain more events because one trace may contain multiple events.
Opaque continuation token returned by a previous call. Omit it for the first page and pass it back unchanged to continue newest-to-oldest.
Output
Get Braintrust Resource
Get Braintrust Resource
Insert Dataset Events
Insert Dataset Events
Slug:
BRAINTRUST_INSERT_DATASET_EVENTSUpsert a batch of examples into an existing Braintrust dataset. New or omitted IDs insert events; an existing supplied ID replaces that event’s current values.Input Parameters
Dataset examples to upsert, in the order represented by returned row IDs. An event with an existing supplied ID replaces that event’s current values.
Output
Insert Experiment Events
Insert Experiment Events
Slug:
BRAINTRUST_INSERT_EXPERIMENT_EVENTSUpsert a batch of result events into an existing Braintrust experiment. New or omitted IDs insert events; an existing supplied ID replaces that event’s current values.Input Parameters
Experiment result events to upsert. Row IDs in the response align with this list in the same order. An event with an existing supplied ID replaces that event’s current values.
Output
List Braintrust Resources
List Braintrust Resources
Slug:
BRAINTRUST_LIST_RESOURCESList and filter one page of projects, experiments, datasets, prompts, or functions visible to the connected Braintrust API key.Input Parameters
Optional organization-name filter. It does not switch the API key’s active data-plane organization.
Opaque continuation token returned by a previous call. Omit for the first page and pass it back unchanged to continue.
Kind of Braintrust resource to list.
Output
Query Braintrust Data
Query Braintrust Data
Slug:
BRAINTRUST_QUERY_DATARun one bounded synchronous read-only BTQL query over Braintrust project logs, an experiment, or a dataset. The first-page query must end with a positive LIMIT; continue later pages by passing the returned next_cursor unchanged.Input Parameters
Read-only BTQL SELECT query. It must query project_logs(…), experiment(…), or dataset(…) and end with an explicit positive LIMIT. Required on the first page; omit it when passing next_cursor.
Optional timezone offset in minutes using JavaScript’s Date.getTimezoneOffset convention: positive values are behind UTC. For example, 480 is US Pacific Standard Time (UTC-08:00).
Opaque continuation token returned by a previous QUERY_DATA call. Pass it back unchanged; the original query and options are carried authoritatively.
Output
Summarize Experiment or Dataset
Summarize Experiment or Dataset
Slug:
BRAINTRUST_SUMMARIZE_RESOURCEReturn metadata and optional aggregate summaries for one Braintrust experiment or dataset.Input Parameters
For experiments, summarize scores and metrics; for datasets, summarize data. Set false to return metadata only.
Optional baseline experiment UUID. Valid only when resource_type is experiment and include_aggregates is true. When omitted, Braintrust may select the configured baseline or a recent experiment.
Output
Update Dataset
Update Dataset
Update Experiment
Update Experiment
Update Project
Update Project
Update Prompt
Update Prompt
Slug:
BRAINTRUST_UPDATE_PROMPTUpdate a Braintrust prompt’s metadata or configuration without invoking it. At least one non-null mutable field is required.Input Parameters
Prompt block, model options, or parser fields to deep-merge. MCP attachments and tool_functions are unsupported and rejected.
Replacement template syntax, stored inside the provider’s prompt_data object.