Automate LangSmith for free on Stepper

New Run

Triggers when a new run (LLM trace) is created in LangSmith.

• 1 parameter s
• Project

New Feedback

Triggers when new feedback is submitted for a run.

• 1 parameter s
• Feedback Key

Create Run

Creates a new run (LLM trace entry) in LangSmith. Use this to log LLM calls from your Stepper workflows.

• 10 parameter s
• Run Name
• Run Type
• Inputs
• Outputs
• Project
• Parent Run ID
• Error
• Start Time
• End Time
• Tags

Update Run

Updates an existing run with outputs, end time, or error information. Useful for streaming completions.

• 4 parameter s
• Run ID
• Outputs
• End Time
• Error

Create Feedback

Submits feedback (evaluation score) for a specific run in LangSmith.

• 6 parameter s
• Run ID
• Feedback Key
• Score
• Value
• Comment
• Correction

Create Dataset

Creates a new evaluation dataset in LangSmith.

• 3 parameter s
• Dataset Name
• Description
• Data Type

Create Example

Adds a new example (input/output pair) to an existing dataset.

• 4 parameter s
• Dataset
• Inputs
• Outputs
• Metadata

Update Example

Updates an existing example in a dataset.

• 3 parameter s
• Example ID
• Inputs
• Outputs

Create Project

Creates a new LangSmith project (tracer session) to group related runs.

• 2 parameter s
• Project Name
• Description

Get Run

Retrieves a specific run by its ID.

• 1 parameter s
• Run ID

Make HTTP Request

Make an HTTP request to any URL with full control over method, headers, and body.