The Luna Studio UI is Splunk Agent Observability’s web app for building real-time custom evaluators tuned to your AI agent. You bring a human-labelled test set; Luna Studio generates a training set from it, fine-tunes a Luna evaluator on the result, and lets you register eligible evaluators in the Splunk Agent Observability evaluators store for use in evaluation, observability, and guardrails.
If you’ve ever wanted an evaluator that understands your definition of “tone consistent”, “grounded answer”, or “policy-violating output” — without writing a custom evaluator from scratch — Luna Studio is built for that.
Enterprise tier and your own deployment. Luna Studio is part of the enterprise tier of Splunk Agent Observability and is deployed by Splunk Agent Observability into your own cluster or cloud. See Availability and deployment, or contact
us to get started.
The Projects page — your home base in Luna Studio
What you can do
Fine-tune a custom Luna evaluator
Pick an evaluator template, supply a test set, generate a training set, and launch a training run — all in a guided flow.
Create synthetic data
Upload a representative CSV test set, fetch a CSV over HTTP(S), or import one from Splunk Agent Observability. In the run wizard, test sets require at least 300 rows total and 100 per class; Luna Studio targets 2,000 synthetic labelled examples and can append enhancement rows to the final training split.
Track training runs
Filter, star, and compare runs across the complete data-generation, training, registration, failure, and cancellation lifecycle.
Register custom evaluators
Once an eligible Luna evaluator is ready, register it so it shows up across the Splunk Agent Observability platform.
Who Luna Studio is for
- ML and AI engineers who need evaluators tailored to a specific domain (legal, healthcare, RAG over internal docs, multilingual support, etc.).
- Applied scientists who want to skip the boilerplate of fine-tuning evaluator models.
- Platform teams standardizing how their organization evaluates LLM applications across many products.
Start here
Availability and deployment
How Luna Studio is provisioned for your organization, and what’s fixed at deployment time.
Quickstart
The fastest path from sign up to a registered evaluator.
Core concepts
Projects, runs, evaluators, test sets, training sets, and how they fit together.
Where to go next
- New to evaluators? Read Core concepts.
- Already have a Splunk Agent Observability account? Jump to the Quickstart.
- Wondering which platforms we support? See Integrations overview.
- Stuck? Check the FAQ and Troubleshooting.