Quality, verified

Not AI slop. Independently fact-checked.

Anyone can bolt an AI onto a question bank. We do the part almost nobody does: the questions our AI writes are independently reviewed by a separate examiner-grade AI, fact-checked against real FAA source material — and we publish the results.

95.3%

of audited written questions passed full independent review — answer, distractors and explanation

94.3%

of audited oral questions — factually sound & on-standard

1,096

questions in published audits

2026-09-03

most recent published audit

Written full-pass over time

lifetime 95.3% · 3 audits latest run 96.6% (2026-09-03, n=118)

Oral soundness over time

lifetime 94.3% · 7 audits latest run 94.0% (2026-08-31, n=117)

Written: 3 published audits, 338 questions, most recent 2026-09-03 — the marked answer independently verified correct in 100.0% of them. Oral: 7 published audits, 758 questions, most recent 2026-08-31. Covers all three ratings (General · Airframe · Powerplant).

What the problems actually were

One pass rate hides the difference between a mislabelled option and a wrong answer. Here is every defect found across all 3 published audits — 338 questions — by kind, most serious first.

Counts in red could have changed which answer you should pick. The rest left the answer key correct and got the supporting text wrong.

1More than one answer was defensibleA second option could be argued from FAA source material, so a well-prepared candidate could reason soundly and still be marked wrong.

1Question tested the wrong thingThe question itself was sound, but it tested a different knowledge code than the one it was filed under — so it counted toward the wrong part of your readiness.

2Explanation stated something falseThe marked answer was right, but the explanation beneath it asserted something untrue. This is the error that survives the exam and follows you to the hangar.

12Explanation cited the wrong option letterThe marked answer was right and so was the reasoning — the explanation just named the wrong letter, arguing correctly for the answer while calling it C when it was A. Your answer key is unaffected; the explanation is confusing to read.

0Marked answer was wrong — none foundAcross every question reviewed, the reviewer agreed with our answer key every time.

How we check

A pipeline runs continuously in the background — no student ever waits behind a quality gate.

Generate

Our AI writes a practice question and its explanation, grounded in the FAA handbooks and regulations for that ACS code.

Independently review

A separate examiner-grade AI — not the one that wrote it — fact-checks the answer, the wrong-answer choices, and the explanation against FAA source material.

Catch & constrain

Anything questionable is flagged. Recurring problems become permanent written constraints on how new questions get generated — so the same mistake cannot come back. We track the pass rate and publish it, openly, right here.

● Here's one we caught

The answer was right. The reasoning was right. The explanation pointed at the wrong letter.

Flagged explanation

The explanation described schematic diagrams correctly — and then dismissed option A, the marked answer, as though it were the installation-diagram distractor. It meant option B.

Corrected to FAA standard

Option A is correct and the reasoning behind it was correct; only the letter was wrong. The installation-diagram distractor is B. The answer key never changed — but a student re-reading that explanation would find it arguing against the answer it had just marked right.

Logged in our audit records against ACS knowledge code AM.I.B.K4.

This is the most common defect we find, and the mildest. It cannot cost you a question, because the answer key is untouched. We publish it and we email it anyway: a student whose explanation contradicts itself has no way of knowing which half to trust, and “probably the answer key” is not good enough the week before a written.

And if you already saw it, we tell you

When an audit finds a problem in a question you were served, you get an email naming the error and the correction — whether or not it changed your answer, and whether or not you got it right. An instructor reads and approves every correction before it is sent.

You shouldn’t have to wonder which of the things you studied were wrong.

Quality audit methodology and results are published in good faith. Individual questions, prompts, and model details are proprietary.