Resources
Learn the line.
Tutorials from the first run to the passport, short posts from the bench, and the words we use.
Tutorials
From first run to passport.
Step by step, with the labels you will see on screen.
- Tutorial4 min read
Your first run: instructions hidden in pasted text
From sign up to a verified passport: connect an HTTPS endpoint, seal a one goal plan, watch the run and verify the result.
- Tutorial3 min read
Read a FAIL, fix it, retest on the same plan
Open a finding, read its smallest example, fix the cause, and prove the fix with a retest on the same sealed plan.
- Tutorial3 min read
Gate a release from CI with an API key
Start a run on a sealed plan from your pipeline, wait for it to finish, and fail the build unless the verdict is PASS.
- Tutorial3 min read
Turn row level rules into an access policy
Import the row rules your data layer already enforces, with a sample of test rows, and test that each role sees only its rows.
- Tutorial2 min read
Connect a system on a private network
Test a system with no public address: run Plimsoll Link beside it, outbound only, and connect the system through it.
Posts
Notes from the bench.
- Post3 min read
Thirteen attempts at one run
Run D took thirteen attempts and passed three times. Almost nothing that stopped it was about the system under test.
- Post2 min read
The grant our own test could not see
deskbook's first line support could read every trading desk's internal material. A leak test that trusted deskbook's own configuration reported nothing.
- Post2 min read
The control that would not leak
Three attempts in a row ended INCONCLUSIVE because a control could not fail. The cause turned out to be a real defence.
Glossary
The words on the passport.
- The line
- The committed limit a check must stay on the right side of.
- Bound
- The exact one sided 95% limit on the true rate, from the counts.
- Cluster
- A group of related questions counted once, as a single test.
- Commitment
- The sealed plan: questions, limits, policy, seed and system fingerprint.
- Seal
- The record's fingerprint; drawn as the passport's pattern.
- INCONCLUSIVE
- Nothing failed, but the evidence cannot prove the limit yet.
- Control
- A planted fault the test must catch, proving it can fail.
- Plimsoll Link
- An outbound only connector for systems on a private network.