Skip to main content
POST
Validate Decision Scorer

Authorizations

Splunk-AO-API-Key
string
header
required

Body

application/json

Test a decision evaluator on one query and response that the user types, before it is saved.

The input is text only. The job scores a synthetic trace with one LLM span, or the span alone, at the one node type of scorer_configuration. reference_output is the ground truth. It is needed when scorer_configuration.ground_truth is true, and ignored otherwise.

model_name
string
required
Required string length: 1 - 255
question
string
required
Required string length: 1 - 2000
scorer_configuration
DecisionScorerTestConfiguration · object
required

The evaluator settings of a decision Test request, the same place as the LLM scorer_configuration.

scoreable_node_types holds exactly one node type. input_type defaults to the decision default for it (get_decision_input_type).

query
string
required
response
string
required
answer_options
reference_output
string | null

Response

Successful Response

task_result_id
string<uuid4>
required