Skip to main content

Overview

The Rubric Sandbox is a fully-functional environment pre-loaded with synthetic healthcare data. Use it to:
  • Explore the platform without uploading your own data
  • Test evaluators on realistic healthcare scenarios
  • Learn the workflow before production deployment
  • Demo Rubric to your team

Launch Sandbox

Start exploring with pre-loaded data →

Pre-loaded Data

The sandbox includes three healthcare AI projects with realistic synthetic data:

Voice Triage

247 patient callsSimulated triage conversations with varied symptoms, urgency levels, and outcomes.

Clinical Notes

183 SOAP notesAI-generated clinical documentation from patient encounters.

DICOM Analysis

89 imaging studiesChest X-rays and CT scans with AI findings and annotations.
All sandbox data is synthetic and contains no real PHI. It’s designed to be realistic for testing purposes.

Voice Triage Dataset

The voice triage project includes calls across all urgency levels:
Triage LevelCountExample Scenarios
Emergency23Chest pain + cardiac symptoms, stroke signs, severe allergic reaction
Urgent67High fever with rash, severe abdominal pain, difficulty breathing
Semi-urgent89Persistent headache, UTI symptoms, minor injuries
Routine68Medication refills, follow-up scheduling, general questions
Sample data:
{
  "transcript": [
    {"speaker": "agent", "text": "How can I help you today?"},
    {"speaker": "patient", "text": "I've had this terrible headache for 3 days..."}
  ],
  "ai_decision": {
    "triage_level": "urgent",
    "symptoms": ["headache", "photophobia", "neck_stiffness"],
    "red_flags": ["meningitis_signs"],
    "confidence": 0.87
  },
  "expected": {
    "triage_level": "emergency",
    "rationale": "Headache with neck stiffness requires immediate evaluation"
  }
}

Clinical Notes Dataset

AI-generated documentation from various encounter types:
Note TypeCountSpecialties
SOAP Notes98Primary care, urgent care
Progress Notes45Internal medicine, cardiology
Discharge Summaries40Hospital medicine

DICOM Dataset

Medical imaging with AI analysis:
ModalityCountFindings
Chest X-ray52Pneumonia, cardiomegaly, nodules
CT Chest27Pulmonary embolism, masses, effusions
CT Head10Stroke, hemorrhage, masses

Sandbox Features

Everything works in the sandbox just like production:

Run Evaluations

from rubric import Rubric

# Connect to sandbox
client = Rubric(
    api_key="gr_sandbox_demo",  # Public sandbox key
    environment="sandbox"
)

# Run evaluation on pre-loaded data
evaluation = client.evaluations.create(
    name="Sandbox Triage Evaluation",
    project="sandbox-voice-triage",
    dataset="ds_sandbox_triage_golden",
    
    evaluators=[
        {"type": "triage_accuracy"},
        {"type": "red_flag_detection"},
        {"type": "guideline_compliance"}
    ]
)

# View results
results = client.evaluations.wait(evaluation.id)
print(f"Triage Accuracy: {results.metrics['triage_accuracy']}%")

Review Interface

Explore the clinician review UI:
  1. Go to Sandbox → Voice Triage → Review Queue
  2. Click on a flagged call
  3. Listen to audio playback (synthetic TTS)
  4. View transcript with highlighted symptoms
  5. Submit a review grade

Experiments

Compare model versions:
  1. Go to Sandbox → Voice Triage → Experiments
  2. View the pre-configured “Model v2 vs v3” experiment
  3. Explore side-by-side metric comparison
  4. See statistical significance analysis

Dashboards

Explore monitoring dashboards:
  • Real-time metrics visualization
  • Trend analysis over time
  • Error pattern detection
  • Reviewer agreement metrics

Walkthrough: Your First Evaluation

1

Open Sandbox

Navigate to app.rubric.ai/sandbox and log in (or use guest access).
2

Select Voice Triage Project

Click on the “Voice Triage” project card to open it.
3

View Logs

Click Logs in the sidebar. Browse the pre-loaded patient calls. Click any log to see details:
  • Full transcript
  • AI decision breakdown
  • Extracted symptoms
  • Red flags detected
4

Run an Evaluation

  1. Click Evaluations in the sidebar
  2. Click New Evaluation
  3. Select the “Golden Test Set” dataset
  4. Choose evaluators: Triage Accuracy, Red Flag Detection
  5. Click Run Evaluation
5

View Results

Once complete, explore:
  • Overall metrics summary
  • Per-sample breakdown
  • Failed cases analysis
  • Comparison with baseline
6

Review Flagged Calls

  1. Click Review Queue in the sidebar
  2. Select a flagged call
  3. Use the review interface to grade the AI’s decision
  4. Submit your review

API Access

The sandbox has full API access with a public demo key:
from rubric import Rubric

# Sandbox client
client = Rubric(
    api_key="gr_sandbox_demo",
    environment="sandbox"
)

# List sandbox projects
projects = client.projects.list()
for p in projects:
    print(f"{p.name}: {p.sample_count} samples")

# Get sandbox datasets
datasets = client.datasets.list(project="sandbox-voice-triage")
for ds in datasets:
    print(f"{ds.name}: {ds.sample_count} samples")
The sandbox API key (gr_sandbox_demo) has limited permissions:
  • Read access to all sandbox data
  • Can create evaluations (auto-deleted after 24 hours)
  • Cannot modify sandbox datasets
  • Rate limited to 100 requests/minute

Limitations

The sandbox has some restrictions compared to production:
FeatureSandboxProduction
Data persistence24 hoursPermanent
Custom datasetsRead-onlyFull CRUD
Team membersDemo user onlyUnlimited
API rate limit100/minPlan-based
SSO/SAMLNot availableAvailable
WebhooksDisabledAvailable

Moving to Production

Ready to use your own data? Here’s how to transition:
  1. Sign up for a production account at app.rubric.ai/signup
  2. Create your workspace and configure settings
  3. Generate API keys for your environments
  4. Upload your data using the same SDK patterns you learned in the sandbox
# Switch from sandbox to production
from rubric import Rubric

# Production client
client = Rubric(
    api_key="gr_live_your_key",  # Your production key
    environment="production"     # Default, can be omitted
)

# Your code works the same!
client.calls.log(...)
client.evaluations.create(...)

Next Steps