API · Human Judgment

Embed human review in your stack

When evaluations or approvals are continuous, move from managed pilots to API-mediated queues of reviewers, experts, or red teamers.

Base URL

https://datadaylabor.com/api/v1

Auth: Bearer API key (issued after pilot or enterprise onboarding). Sandbox keys available for design partners.

Platform fee (target)

From $499/mo platform + usage-based judgments. Exact unit rates depend on skill tier and SLA.

Request API access

Endpoints (1.0)

MethodPathPurpose
POST/api/v1/tasksSubmit judgment task batch
GET/api/v1/tasks/:idRetrieve status + results
POST/api/v1/webhooksRegister result webhook
GET/api/v1/rubrics/:idFetch rubric version
GET/api/healthLiveness
POST/api/judgmentDemo queue (public sandbox)

Submit task (example)

{
  "rubric_id": "factuality_v1",
  "skill_tier": "specialist",
  "sla_hours": 24,
  "items": [
    {
      "id": "item_001",
      "input": { "prompt": "…", "model_output": "…", "sources": ["…"] },
      "metadata": { "model": "customer-model-a" }
    }
  ]
}

Result shape (example)

{
  "task_id": "tsk_…",
  "status": "complete",
  "items": [
    {
      "id": "item_001",
      "scores": { "factual_accuracy": 0.9, "groundedness": 0.85 },
      "label": "accept_with_notes",
      "rationale": "Minor unsupported clause in paragraph 2",
      "reviewer_tier": "specialist",
      "provenance": {
        "rubric_version": "factuality_v1",
        "gold_overlap": false,
        "adjudicated": false,
        "decided_at": "2026-07-15T12:04:11Z"
      }
    }
  ]
}
Production API keys require an active retainer or enterprise agreement. Use the public POST /api/judgment demo to explore response shape without auth.