Home
Programs Full Access — $495 Free Assessment For Experts (B2C) For Companies (B2B) Handbook Outline Curriculum Licensing
About About Us Credentials Contact Press & Media
Full Access · $495
The SME Handbook · Outline

Artifact-first. Graded like the industry grades. Domain-anchored.

Every module produces or corrects a real artifact — a prompt, a rubric, a golden answer, an audit. Every artifact is scored against published rubrics with written feedback. The method is the lesson.

FOUNDATIONS COHORT AUDITOR §
Original Frameworks

The spine of every program.

The GRADE Loop

Golden answer first · Reverse-engineer criteria · Atomize (one idea per criterion) · Difficulty-check against a live model · Evaluate blind.

The Four Failure Families

Fabrication · Omission · Misapplication · Presentation. Every QC review maps errors to a family before a word of feedback is written.

The Self-Containment Test

"Could a stranger judge this criterion true/false without seeing the prompt, the sources, or any other criterion?" Drilled until reflexive.

How every module works

The same three parts, in every module, from F1 to R4.

Consistency is the point. You always know what a module contains, how long it takes, and how you will know whether it landed — so the only thing that varies between modules is the difficulty of the craft itself.

PART 1

A video explainer

The method demonstrated rather than described — worked on a real artifact, at the pace you would actually work. Recorded, so you can stop it and rewind the part that mattered.

PART 2

A written explainer

The same ground in prose, with the rules, the tables and the checklists you will keep open on a second screen while you build. This is the part you return to a year from now.

PART 3

A short quiz

A brief check at the end of the module. Not a hurdle — a mirror. It tells you whether you actually absorbed the module before you build on top of it.

Every module in this Handbook carries all three. The chips beneath each module below are a reminder, not an exception list.

What this page is

This is the outline. The Handbook itself is behind full access.

Everything below — all eighteen modules, F1 through R4, and what each one asks of you — is published in full and free to read. We would rather you knew exactly what you were buying before you bought it.

What one payment unlocks is the Handbook itself: the eighteen video explainers, the eighteen written explainers with their rules, tables and checklists, the module quizzes, the comprehensive exam, and the Handbook as a PDF and Word file you keep.

  • Free · this outline, every module title and scope
  • Free · the 32-question self-assessment
  • Free · the two sample films further down
Unlock the Handbook — $495

One payment. No cohort, no start date, no subscription.

Part 1 · Modules F1–F6

Foundations — Modules F1–F6

F1

The Expert Data Economy

How models are trained (pretraining → SFT → RLHF → evals) in plain language; who buys expert data and why; where the money concentrates; honest market risks.

Video explainerWritten explainerModule quiz
F2

Anatomy of a Task

Prompts, input files, golden answers, rubrics, spec sheets; attempter/reviewer/auditor roles; how a package flows through QA.

Video explainerWritten explainerModule quiz
F3

Prompt Craft I

Realistic persona and context, timelessness, jurisdiction clarity, explicit deliverables, objective gradability. Exercise: repair three broken prompts.

Video explainerWritten explainerModule quiz
F4

Rubric Craft I

The rubric as the training signal; self-contained criteria; one idea per criterion; verb-first, objective wording. Exercise: five criteria, auto-checked.

Video explainerWritten explainerModule quiz
F5

Working the Platforms

Application mechanics, the expert profile, time and rate economics, contractor basics, burnout prevention.

Video explainerWritten explainerModule quiz
F6

The Integrity Code

What we never do — and why integrity is the graduate’s competitive asset. Signed as a condition of certification.

Video explainerWritten explainerModule quiz
Part 2 · Modules C1–C8

The Core Sequence — Modules C1–C8

Legal and Finance tracks share the spine; each applies it through domain labs.

C1

Prompt Craft II

Tasks that stump strong models legitimately: multi-step dependency chains, document-grounding, plausible red herrings. Legal lab: layperson-voice, jurisdiction-identifiable scenarios. Finance lab: cascading calculations across documents.

Video explainerWritten explainerModule quiz
C2

Building Input Worlds

Realistic synthetic source material; document-authenticity standards; file hygiene. Artifact you produce: a 3-document input set.

Video explainerWritten explainerModule quiz
C3

Rubric Craft II

The GRADE Loop end-to-end: composition, logical-progression ordering, bounded ranges, the name-swap test, offline evaluability.

Video explainerWritten explainerModule quiz
C4

Negative Criteria & Weighting

Affirmative failure-mode negatives; criticality discipline; weighting so reasoning carries ~75–80% of points. Legal lab: IRAC-decomposed rubrics. Finance lab: formula-vs-solution separation.

Video explainerWritten explainerModule quiz
C5

The Golden Answer

Perfect-answer-first; citation integrity verified against primary sources. Artifact you produce: a golden answer + rubric pair, peer-graded blind.

Video explainerWritten explainerModule quiz
C6

Annotation & Preference Work

SFT vs. RLHF evaluation; strict annotation formats; preference justifications; timed calibration practice.

Video explainerWritten explainerModule quiz
C7

Surviving QC

Reading feedback without ego; the Four Failure Families on your own work; self-review checklists; professional escalation.

Video explainerWritten explainerModule quiz
C8

Career Architecture

Portfolio assembly; platform strategy; rate negotiation with real market data; the attempter → reviewer → auditor ladder. Capstone review.

Video explainerWritten explainerModule quiz
Part 3 · Modules R1–R4

Reviewer & Auditor — Modules R1–R4

R1

The Reviewer’s Method

Verify first, annotate second; independent verification of every claim against primary sources; ambiguity analysis; documenting "considered but not flagged."

Video explainerWritten explainerModule quiz
R2

Audit Practice

Full-package audits: prompt ↔ inputs ↔ golden ↔ rubric consistency; criterion-by-criterion rubric audit; findings vs. preferences; severity discipline.

Video explainerWritten explainerModule quiz
R3

Feedback That Teaches

Consolidated, specific, warm, actionable author-facing feedback; the economics of review throughput.

Video explainerWritten explainerModule quiz
R4

Calibration Capstone

Three packages audited independently, calibrated against reference audits — inter-rater agreement becomes your credential evidence.

Video explainerWritten explainerModule quiz
Sample the teaching

Two lessons from inside the program.

Not a trailer — the actual method, in the same voice you get in every module.

8 min Masterclass: AI rubric design Golden answers, floor and ceiling, bounded ranges, negative traps, and the six rules a criterion has to satisfy before a machine can grade against it.
10 min Demystifying AI evaluation The five-part arc of the work: the reality of evaluation, building prompts and files, designing rubrics, the auditor mindset, and lasting in the industry.
At the end of the Handbook

One comprehensive exam, across everything.

Module quizzes tell you whether a module landed. The comprehensive exam asks the harder question: can you hold the whole craft at once, the way a real task package demands — a prompt, its files, its rubric and its audit, all of which have to agree with one another.

It spans the whole Handbook

Not a recap of the final module. Questions draw across F1 to R4 and deliberately cross module boundaries, because that is where the real failures live — a rubric criterion that contradicts the prompt, a file that leaks the answer the rubric is testing for.

It is scenario-based

You are shown real task packages and asked what is wrong with them, what would be rejected, and why. Recognising a defective prompt is a different skill from writing a good one, and reviewers are paid for the first.

It is the gateway to certification

Passing it is what a proctored credential is eventually built on. Until the certification launches, it is the honest self-test: it tells you whether you are ready to submit work for money.

The comprehensive exam is untimed, and you can sit it as many times as you like. It is included with full access, like everything else here.