Skip to content
The Register

Jev AI Agent Trace Evaluator — Score LLM Traces

Evaluate supplied AI-agent traces for evidence support, tool relevance, and review need using a TypeSafe Jev key. It never executes tools.

Jev AI Agent Trace Evaluator — Score LLM Traces returns 12 documented output fields, including state, questions, index, sourceId and trace. Every field carries a declared type, a written description and an example value. 18 runs are recorded on Apify.

Run it on ApifyPay per result · no subscription
12
Output fields
3
Inputs
18
Runs
2026-10-15
Last run

01 — output

What it returns

Every field the extractor writes to its dataset, with its type, a written description and an example value.

FieldTypeWhat it holdsExample
statestringnullCurrent state of this record in its own lifecycle.
questionsobjectnullQuestions as recorded for this row.
indexstring | number | boolean | array | objectnullPosition of this row within the run.1
sourceIdstring | number | boolean | array | objectnullIdentifier of the input record this row came from.rec_01
tracestring | number | boolean | array | objectnullTrace as recorded for this row.[]
evidenceSupportstring | number | boolean | array | objectnullEvidence Support as recorded for this row.[]
toolRelevancestring | number | boolean | array | objectnullTool Relevance as recorded for this row.[]
humanReviewProbabilitystring | number | boolean | array | objectnullHuman Review Probability as recorded for this row.[]
statusstring | number | boolean | array | objectnullOutcome recorded for this row.ok
minConfidencestring | number | boolean | array | objectnullMin Confidence as recorded for this row.[]
judgmentsstring | number | boolean | array | objectnullThe full structured judgement returned by the model.{"stance":{"choice":"recommended"}}
modelstring | number | boolean | array | objectnullIdentifier of the model that produced the judgement.jev-latest

02 — sample

One record

Assembled from the example values declared on the schema above, not invented at render time.

{
  "state": "",
  "questions": "",
  "index": 1,
  "sourceId": "rec_01",
  "trace": "[]",
  "evidenceSupport": "[]",
  "toolRelevance": "[]",
  "humanReviewProbability": "[]"
}

03 — input

What you give it

InputTypeDescription
recordsarrayrequiredRows with request, tool result, and final answer context.
typesafeApiKeystringoptionalSecret — supply your own value.
maxItemsintegeroptionalHard cap on processed trace rows.

04 — run

Run Jev AI Agent Trace Evaluator on your own input

It runs in the cloud on Apify. Nothing to install, and you are billed per result returned rather than per attempt.

Open on Apify ↗

05 — questions

Asked before running it

12 of 12 fields described

What does Jev AI Agent Trace Evaluator — Score LLM Traces return?
It returns 12 documented output fields: state, questions, index, sourceId, trace, evidenceSupport, toolRelevance, humanReviewProbability, status, minConfidence, judgments and model. Each field declares its type, a description of what it holds, and an example value.
What input does Jev AI Agent Trace Evaluator — Score LLM Traces require?
records is required. A further 2 inputs are optional. The full input schema, with types and defaults, is below.
Does Jev AI Agent Trace Evaluator — Score LLM Traces need an API key or login?
Yes — typesafeApiKey is marked secret and must be supplied by you. Nothing else in the input schema needs credentials.
How do I run Jev AI Agent Trace Evaluator — Score LLM Traces?
It runs on Apify. Start it from its listing with the inputs above, or call the Apify API with the Actor's ID. Results land in a dataset you can export as JSON, CSV or Excel, or read through the Apify API into your own pipeline.