Skip to content

Agentic harness validation

Natural language in.
Production-grade stack out.

Describe a task in plain English. validtr recommends the optimal agent harness (LLM, framework, MCP servers, skills), provisions it in Docker, executes, generates tests, and scores the result. Below the threshold? It adjusts the stack and retries.

localhost:4040
validtr Web UI dashboard: describe a task, pick a provider, run validation, and browse scored runs
◈

Agent harness validation

Recommends and provisions the full harness (LLM, framework, MCP servers, skills), then executes it in an isolated Docker container.

≣

Token count

Captures real token usage per run and projects it across Light, Standard, and Heavy workflows, priced from a live catalog.

◆

Scoring

Generates tests from the spec and computes a composite score across test passing, execution, syntax, and completeness, retrying below the threshold.

How it works

One loop, end to end

Every task runs through the same pipeline: analyze the request, recommend and provision a harness, execute it in Docker, generate tests, and score the result, adjusting the stack and retrying until it clears your threshold.

InputThe validtr pipelineOutput
Plain-English
task
1 Analyze
2 Recommend
3 Provision
4 Execute
5 Test
6 Score
↺ retry < threshold
Validated
harness

See it in action

From prompt to validated harness

localhost:4040

Scored, end to end

Every run, scored and projected

validtr run
validtr CLI output: best stack found, validation score breakdown, and harness token projection

Start here

MIT Licensed