- Category: artificial intelligence
- Auth: API_KEY
- Composio-managed OAuth available? N/A
- Tools: 42
- Triggers: 0
- Slug:
HONEYHIVE - Version: 20261101_00
Tools
Add datapoints to dataset
Add datapoints to dataset
Compare Experiment Runs
Compare Experiment Runs
Compare Runs Events
Compare Runs Events
HONEYHIVE_COMPARE_RUNS_EVENTSTool to compare events between two experiment runs side-by-side. Use when analyzing differences in model behavior, performance metrics, or outputs between evaluation runs. Returns matched event pairs with their respective data from both runs for comparison.Input Parameters
Output
Batch Create Datapoints
Batch Create Datapoints
HONEYHIVE_CREATE_BATCH_DATAPOINTSTool to create multiple datapoints in a single batch operation. Use when you need to bulk-import events into a dataset or create many datapoints at once. Supports filtering by date range, event IDs, or custom criteria. Efficient for migrating large numbers of events to evaluation datasets.Input Parameters
Output
Create Batch Model Events
Create Batch Model Events
Create Batch Tool Events
Create Batch Tool Events
Create Configuration
Create Configuration
HONEYHIVE_CREATE_CONFIGURATIONCreates a new configuration in HoneyHive for managing LLM or pipeline settings. Use this to define reusable configurations with specific models, prompts, and parameters that can be deployed across different environments (dev, staging, prod). Configurations enable version control and environment-specific management of your AI application settings.Input Parameters
Output
Create Datapoint
Create Datapoint
HONEYHIVE_CREATE_DATAPOINTTool to create a new datapoint with input-output pairs. Use when you need to add a single datapoint with inputs, ground truth, conversation history, and metadata.Input Parameters
Output
Create Dataset
Create Dataset
Create Event
Create Event
HONEYHIVE_CREATE_EVENTTool to create a new event in HoneyHive to track execution of different parts of your application. Use when you need to log a model call, tool execution, or chain step. Events can be grouped into sessions and nested hierarchically using parent_id and children_ids.Input Parameters
Output
Create Metric
Create Metric
HONEYHIVE_CREATE_METRICTool to create a new metric in HoneyHive. Use when you need to define how to evaluate model outputs, whether through code (PYTHON), AI evaluation (LLM), human review (HUMAN), or combining multiple metrics (COMPOSITE). Important: LLM metrics require both model_provider and model_name to be specified.Input Parameters
Output
Create Model Event
Create Model Event
Create Tool
Create Tool
HONEYHIVE_CREATE_TOOLCreates a new tool definition in a HoneyHive project. Use this to register functions or plugins that can be invoked and tracked within HoneyHive. Tools are defined with a JSON Schema for their parameters, allowing HoneyHive to validate inputs and track tool usage in your AI workflows. Tool names must be unique within a project.Input Parameters
Output
Delete Datapoint
Delete Datapoint
Delete Dataset
Delete Dataset
End Evaluation Run
End Evaluation Run
HONEYHIVE_END_EVALUATION_RUNTool to update an evaluation run’s status and metadata. Use to mark a run as completed after finishing evaluations, or update run properties like name, metadata, configuration, and associated event/datapoint IDs.Input Parameters
Output
Get Configurations
Get Configurations
Get Datasets
Get Datasets
HONEYHIVE_GET_DATASETSRetrieve datasets from HoneyHive for a specified project. Use this tool when you need to: - List all datasets within a project - Find datasets by type (evaluation or fine-tuning) - Retrieve a specific dataset by its ID Returns dataset details including name, description, datapoints count, type, and timestamps.Input Parameters
Output
Get Events
Get Events
HONEYHIVE_GET_EVENTSTool to query events with filters and projections from HoneyHive. Use this action when you need to retrieve events with lightweight filtering (limit 1000 results). For bulk exports or more complex queries, use the Retrieve Events action instead. Supports filtering by date range, event properties, and field projections.Input Parameters
Output
Get Events By Session ID
Get Events By Session ID
HONEYHIVE_GET_EVENTS_BY_SESSION_IDTool to retrieve the complete tree of nested events for a specific session. Use when you need to analyze all events (model calls, tool calls, chains) that occurred within a session, including their hierarchical relationships, inputs, outputs, metrics, and costs. Returns a tree structure with recursive children.Input Parameters
Output
Get Events Chart
Get Events Chart
HONEYHIVE_GET_EVENTS_CHARTTool to retrieve charting and analytics data for events over time. Use when you need aggregated metrics (duration, cost, token usage) grouped by time buckets or fields. Supports percentile analysis (p50, p95, p99) for latency monitoring and custom filters for targeted analytics.Input Parameters
Output
Get Metrics
Get Metrics
HONEYHIVE_GET_METRICSRetrieves all metrics associated with a HoneyHive project. Returns a list of metrics including their configuration (name, type, description, thresholds, evaluator details) and metadata (creation/update timestamps, sampling settings). Use this tool when you need to: - List all metrics configured for a project - Get metric IDs for updating metrics via HONEYHIVE_UPDATE_METRIC - Understand what evaluations are set up for a project Prerequisites: Obtain a valid project_name using HONEYHIVE_GET_PROJECTS first.Input Parameters
Output
Get Projects
Get Projects
Get Evaluation Run Details
Get Evaluation Run Details
Get Run Metrics
Get Run Metrics
HONEYHIVE_GET_RUN_METRICSTool to get event metrics for an experiment run. Use when you need to retrieve metrics computed on events within a specific experiment run. Returns an array of event objects with their associated metrics, which can be filtered by date range or custom filters.Input Parameters
Output
Get Evaluation Runs
Get Evaluation Runs
HONEYHIVE_GET_RUNSTool to retrieve a list of evaluation runs from HoneyHive. Use when you need to: - List all evaluation runs for analysis - Find runs by status, name, or dataset - Get specific runs by their IDs - Paginate through large sets of evaluation runs Returns evaluation details including status, results, configuration, and timestamps.Input Parameters
Output
Get Runs Schema
Get Runs Schema
Get Session
Get Session
HONEYHIVE_GET_SESSIONRetrieve a complete session tree by session ID from HoneyHive. Use this tool to fetch the full session hierarchy including all nested events (model calls, tool calls, chains) with their inputs, outputs, durations, and metadata. Returns a recursive tree structure with aggregated metrics. Prerequisites: You need a valid session ID from HONEYHIVE_START_SESSION or HONEYHIVE_RETRIEVE_EVENTS.Input Parameters
Output
List Tools
List Tools
Retrieve Datapoint
Retrieve Datapoint
HONEYHIVE_RETRIEVE_DATAPOINTRetrieve a specific datapoint by its ID from HoneyHive. Use this tool when you need the full details of a single datapoint, including its inputs, ground truth, conversation history, linked datasets, and metadata. Prerequisites: You need a valid datapoint ID. Get datapoint IDs from: - HONEYHIVE_RETRIEVE_DATAPOINTS (list datapoints by project/dataset) - HONEYHIVE_ADD_DATAPOINTS_TO_DATASET (returns IDs of newly created datapoints)Input Parameters
Output
Retrieve Datapoints
Retrieve Datapoints
HONEYHIVE_RETRIEVE_DATAPOINTSRetrieve datapoints from a HoneyHive project. Use this tool to fetch evaluation datapoints containing inputs, ground truth, and metadata. Supports filtering by specific datapoint IDs or dataset name. Commonly used to: - Review existing test cases before running evaluations - Export datapoints for analysis - Verify datapoint contents after adding them to a datasetInput Parameters
Output
Retrieve Events
Retrieve Events
HONEYHIVE_RETRIEVE_EVENTSRetrieve and export events from a HoneyHive project. Use this tool to query traced events (model calls, tool calls, sessions, chains) with optional filters by event_type, metadata, feedback scores, or date range. Returns events with their inputs, outputs, duration, and metrics. Supports pagination for large result sets (max 7500 per page).Input Parameters
Output
Retrieve Experiment Result
Retrieve Experiment Result
Start Evaluation Run
Start Evaluation Run
HONEYHIVE_START_EVALUATION_RUNCreates a new evaluation run to group and track multiple session events for analysis. Use this action when you want to: - Compare model performance across multiple sessions - Create evaluation batches for quality assurance - Link existing events to datasets for structured evaluation Prerequisites: - Get project ID using Get Projects action - Get event IDs from Start Session or Retrieve Events actions - (Optional) Get dataset ID from Get Datasets actionInput Parameters
Output
Start Session
Start Session
HONEYHIVE_START_SESSIONStart a new HoneyHive session for tracing and observability. Use this tool to initiate a tracking session that groups together related model, tool, and chain events. Returns a session_id that should be used to link subsequent events to this session. Common use cases: - Start tracing a user conversation - Begin logging an LLM pipeline execution - Initialize observability for a batch processing jobInput Parameters
Output
Update Configuration
Update Configuration
HONEYHIVE_UPDATE_CONFIGURATIONTool to update an existing HoneyHive configuration. Use when you need to modify a configuration’s name, provider, model parameters, environments, or other settings. You must provide the configuration ID (obtainable via Get Configurations action) and the name field. All other fields are optional and will only update if provided.Input Parameters
Output
Update Datapoint
Update Datapoint
HONEYHIVE_UPDATE_DATAPOINTUpdate an existing datapoint by ID. Use this to modify any combination of inputs, ground_truth, history, metadata, linked_datasets, or linked_evals for a datapoint. Requires a valid datapoint ID obtained from retrieve_datapoints or add_datapoints_to_dataset.Input Parameters
Output
Update Dataset
Update Dataset
Update Event
Update Event
HONEYHIVE_UPDATE_EVENTUpdate an existing HoneyHive event by ID. Use to attach feedback, metrics, metadata, outputs, config, user properties, or update duration on events created via start_session or batch event creation. At least one optional field must be provided alongside the event_id.Input Parameters
Output
Update Metric
Update Metric
Update Project
Update Project
HONEYHIVE_UPDATE_PROJECTUpdates an existing HoneyHive project’s name or description. Use this action to modify project metadata after creation. You must provide the project_id and at least one field to update (name or description). To find project IDs, use the Get Projects action first.Input Parameters
Output
Update Tool
Update Tool
HONEYHIVE_UPDATE_TOOLTool to update an existing tool in HoneyHive. Use when you need to modify a tool’s name, description, parameters, or type after confirming its ID. At least one optional field must be provided alongside the required tool ID.