Reviewer packet · Practical assessment reviewer demo

Fix invite acceptance regression

Alex Chen · Senior Backend Developer

Alex Chen: decision ready · suggested 9/10 overall · no major evidence gaps · no anomaly flags

Candidate feedback note
Assessment: Fix invite acceptance regression
Summary: Kept the production change small. Verified the valid pending path still passes after changing branch order.
Strengths:
- Submitted verification evidence for the final change.
- Provided code-change evidence for reviewer inspection.
- Included AI session evidence so reviewers can inspect the working process.
Follow-up focus:
- Be ready to walk through the main tradeoff, the verification path, and how AI assistance was directed.

Anomaly flags

No anomaly flags.

AI fluency Reviewer only

Models used: claude-sonnet-4-5 · parsed 6 JSONL lines across 1 session(s)

Process analysis Reviewer only

Activity timeline

Chronology reconstructed from the recorded event chain. Active-work time excludes idle gaps — unlike raw wall-clock completion time.

Code changes

git snapshot at submit · 2026-04-30T18:29:03.000Z. Every line below is candidate-submitted evidence; nothing is edited or summarized.

## git status
 M src/invites.js
 M test/invites.test.js

## git diff
-  if (membership?.retryableError) return true;
   if (new Date(invite.expiresAt).getTime() <= now.getTime()) return false;
+  if (membership?.retryableError) return true;

## git status
clean

## git diff

AI session replay

Reconstructed turn by turn from the candidate's recorded sessions — prompts, agent responses, and tool calls in order. Raw exports stay available under “Inspect raw evidence”.

Claude JSONL export: candidate asked Claude to inspect invite tests, review the branch-order fix, run npm test, and explain product/infra follow-up questions.

codex session: inspected invite tests, identified retryableError branch above expiry guard, moved expiry check before retry path, ran npm test, reviewed edge cases.

Post-interview transcript review Reviewer only

No interview transcript artifact stored yet.

Inspect raw evidence

Unprocessed records exactly as captured — the source of truth behind every rendered section above.

{
  "score": 87,
  "score10": 9,
  "taskDecomposition": "observable",
  "verification": "observable",
  "aiCollaboration": "observable in recorded AI session evidence",
  "reviewerConfidence": "usable evidence packet"
}

{
  "verified": true,
  "coveredEvents": 6,
  "totalEvents": 6,
  "lastAuditHash": "sample-tamper-evident-chain"
}

{
  "status": "recording",
  "provider": "fly-machines",
  "appName": "agentic-evidence-vms",
  "machineId": "e82ee40c0d5758",
  "region": "sjc",
  "image": "registry.fly.io/agentic-evidence-vms:candidate-vm-terminal-router",
  "teardownDueAt": "2026-04-30T22:04:13.000Z"
}

codex session: inspected invite tests, identified retryableError branch above expiry guard, moved expiry check before retry path, ran npm test, reviewed edge cases.

Claude JSONL export: candidate asked Claude to inspect invite tests, review the branch-order fix, run npm test, and explain product/infra follow-up questions.

## git status
clean

## git diff

## git status
 M src/invites.js
 M test/invites.test.js

## git diff
-  if (membership?.retryableError) return true;
   if (new Date(invite.expiresAt).getTime() <= now.getTime()) return false;
+  if (membership?.retryableError) return true;

{
  "tests": "npm test -> 4/4 tests passed. HotTea runner -> 4/4 checks passed.",
  "diff": "Moved invite expiry validation before the retryable membership-error branch and added regression coverage for expired retryable invites, revoked invites, valid pending invites, and already-active members.",
  "notes": "Kept the production change small. Verified the valid pending path still passes after changing branch order."
}

[
  {
    "type": "candidate_prompt",
    "createdAt": "2026-04-30T18:07:10.000Z"
  },
  {
    "type": "agent_response",
    "createdAt": "2026-04-30T18:07:12.000Z"
  },
  {
    "type": "candidate_prompt",
    "createdAt": "2026-04-30T18:18:22.000Z"
  },
  {
    "type": "agent_response",
    "createdAt": "2026-04-30T18:18:24.000Z"
  },
  {
    "type": "test_run",
    "createdAt": "2026-04-30T18:28:51.000Z",
    "passed": true
  },
  {
    "type": "evidence_submission",
    "createdAt": "2026-04-30T18:31:44.000Z"
  }
]

Copy/paste reviewer note

Formatted for an ATS or assessment-platform review field. This is a reviewer aid, not a hiring verdict.

HotTea reviewer note
Candidate: Alex Chen
Assessment: Fix invite acceptance regression
Automated evidence signal: 9/10 heuristic (not a hiring score) · Suggested review aid: 9/10 (AI fluency + verification)
Verdict draft: decision ready · prefilled overall 9/10 · 0 evidence gap(s)
Reviewer decision: Strong hire · confidence high · saved 2026-04-30T18:45:00.000Z
Reviewer scores: not yet scored
Evidence captured: 1 AI session transcript(s), 1 Claude JSONL export(s), 0 external AI evidence upload(s), 2 git snapshot(s), 1 test run(s), 6 recorder event(s)
Summary: Kept the production change small. Verified the valid pending path still passes after changing branch order.
Verification observed: observable
AI fluency observed: observable in recorded AI session evidence
Post-interview transcript review: no transcript artifact stored
Report: /sample-report
Suggested follow-up questions:
1. Walk through the highest-impact change and why that was the right first move.
2. Explain one tradeoff or shortcut from the assessment and what would change in production.
3. Describe how AI was used, what was accepted or rejected, and how the result was verified.

Copy reviewer noteOpen ATS handoff

Interview transcript artifacts

0 transcript artifact(s) stored and summarized for reviewer follow-up. They remain reviewer-only and do not change the automated score.