Create Your Account
Verify Email
Check your inbox and click the verification link.
Complete Profile
Add your name, role, and organization details.
SSO Options
Rubric supports enterprise SSO providers:
Provider Setup Google Workspace Automatic with Google email Okta SAML configuration required Azure AD SAML configuration required OneLogin SAML configuration required
Enterprise SSO configuration is available on the Team and Enterprise plans. Contact support for setup assistance.
Workspace Configuration
Your workspace is the top-level container for all projects, datasets, and team members.
Create a Workspace
After signup, you’ll be prompted to create your first workspace
Choose a workspace name (e.g., “Acme Health AI”)
Select your plan tier
Add a billing method (required for paid plans)
Workspace Settings
Navigate to Settings → Workspace to configure:
Setting Description Workspace Name Display name for your organization Workspace Slug URL-friendly identifier (e.g., acme-health) Default Region Data residency region (US, EU, or custom) Retention Policy How long to keep logged data
API Key Management
API keys authenticate your applications with Rubric.
Create an API Key
Go to Settings → API Keys
Click Create API Key
Choose a name (e.g., “Production Triage App”)
Select scopes (permissions)
Copy and securely store the key
API keys are shown only once. Store them securely in your secrets manager (AWS Secrets Manager, HashiCorp Vault, etc.).
Key Types
Type Prefix Use Case Live gr_live_Production environments Test gr_test_Development and testing
Scopes
Scope Permissions readView projects, logs, evaluations writeCreate logs, run evaluations adminManage team, settings, billing
# Using specific scopes
from rubric import Rubric
# Read-only client for dashboards
reader = Rubric( api_key = "gr_live_readonly_key" )
# Full access for production
client = Rubric( api_key = "gr_live_full_key" )
Rotate Keys
To rotate an API key:
Create a new key with the same scopes
Update your applications to use the new key
Delete the old key
Team Management
Invite Team Members
Go to Settings → Team
Click Invite Member
Enter their email address
Assign a role
Roles
Role Permissions Owner Full access, billing, delete workspace Admin Manage team, projects, settings Member Create projects, run evaluations Reviewer Review tasks only (clinician role) Viewer Read-only access to dashboards
Reviewer Credentials
For clinical reviewers, you can verify and store credentials:
Navigate to Settings → Team → Reviewers
Click Add Reviewer
Enter credential information:
License type (MD, DO, NP, RN, etc.)
License number
State/jurisdiction
Expiration date
Upload verification documentation
Rubric can automatically verify licenses against state medical boards. Contact support to enable this feature.
Notification Settings
Configure how you receive alerts and updates.
Notification Channels
Channel Use Case Email Daily digests, evaluation complete Slack Real-time alerts, review assignments Webhook Custom integrations, CI/CD PagerDuty Critical safety alerts
Set Up Slack Integration
Go to Settings → Integrations → Slack
Click Connect to Slack
Select a channel for notifications
Configure alert types
# Slack notification example
client.projects.update(
project = "patient-triage" ,
notifications = {
"slack" : {
"channel" : "#ai-safety-alerts" ,
"events" : [ "evaluation_complete" , "safety_threshold_breach" ]
}
}
)
Alert Thresholds
Configure automatic alerts when metrics breach thresholds:
client.projects.update(
project = "patient-triage" ,
alert_rules = [
{
"metric" : "under_triage_rate" ,
"threshold" : 0.01 , # 1%
"comparison" : "greater_than" ,
"severity" : "critical" ,
"channels" : [ "slack" , "pagerduty" ]
},
{
"metric" : "red_flag_recall" ,
"threshold" : 0.95 , # 95%
"comparison" : "less_than" ,
"severity" : "warning" ,
"channels" : [ "slack" ]
}
]
)
Security Settings
Two-Factor Authentication (2FA)
Enable 2FA for your account:
Go to Settings → Security
Click Enable 2FA
Scan the QR code with your authenticator app
Enter the verification code
Save backup codes securely
For HIPAA compliance, we recommend requiring 2FA for all team members. Admins can enforce this in Settings → Security → Require 2FA .
Session Management
View and manage active sessions:
Go to Settings → Security → Sessions
View all active sessions with device/location info
Click Revoke to end suspicious sessions
Enable “Single session only” for stricter security
Audit Log
Access your complete audit trail:
Go to Settings → Security → Audit Log
Filter by user, action type, or date range
Export logs for compliance documentation
Data Residency
Choose where your data is stored:
Region Location Compliance US AWS us-east-1 HIPAA, SOC 2 EU AWS eu-west-1 GDPR, HIPAA Custom Your VPC Enterprise only
Data residency is set at the workspace level and cannot be changed after creation. Contact support if you need to migrate regions.
Next Steps
Create Your First Evaluation Run evaluators on your data
Try the Sandbox Explore with sample healthcare data