Skip to main content

Readiness

:::info Source Sourced from services/assessment-service/SERVICE_READINESS.md in the documentation repo. :::

1. Level per Milestone​

MLevelScope
M0—Design
M1L3Basic MCQ/fill-blank quizzes + scoring
M2L3AI question generation (authoring)
M3L4Branching scenarios + SCORM 2004 scoring
M4L4—
M5L4AI rubric grading (high-risk AI); adaptive difficulty

2. Gates​

G1 Domain​

  • QuizBank, BranchingScenario, AttemptResult aggregates + invariants.
  • DAG validation; grading rule evaluation.
  • 95% unit / 80% mutation.

G2 API​

  • OpenAPI; idempotency; cursor.
  • Pact: consumer from authoring; producer to progress.

G3 Events​

  • assessment.quiz_bank.*, assessment.attempt_result.scored.v1, assessment.branching_scenario.completed.v1.
  • Outbox + inbox.

G4 Sync​

  • QuizBank + Scenario server_authoritative; AttemptResult append_only.

G5 AI​

  • AIClient port only.
  • Prompts registered + eval sets.
  • Rubric grading classified high-risk; HITL enforced.
  • Provenance on every AI artifact.

G6 Observability​

  • Scoring SLIs; AI override rate; appeal rate.

G7 Performance​

  • Serve p95 < 200ms.
  • Scoring p95 < 500ms.
  • AI grade p95 < 3s.

G8 Security​

  • Answer keys encrypted; tenant iso green.
  • Anti-cheat controls tested.

3. SLOs​

Quiz serve < 200ms p95 · Scoring < 500ms p95 · AI grade < 3s p95 · 99.99% availability.

4. DoD​

  • Tests green.
  • OpenAPI + Pact + event schemas.
  • AI prompt eval pass if touched.
  • Migration fwd+back.
  • Two-tenant iso green.

5. Release Checklists​

S1 (M1)​

  • Basic quizzes functional.
  • Offline scoring proven.
  • Progress event triggers certification correctly.

S4 (M3)​

  • Branching scenarios GA.
  • SCORM 2004 scoring passes conformance.
  • Answer-key encryption audited.

S6 (M5)​

  • AI rubric grading GA (behind feature flag + HITL).
  • Bias monitoring quarterly report.
  • Appeal workflow complete.