Peter Parker

Peter Parker

Production machine learning and applied AI, with the numbers to check.

Eight years of production machine learning in health and government, most of it behind a wall. These projects put the work where it can be inspected: each one ends with a measured result in a table, reproducible from its public repository with one command.

The portfolio

Ten projects, built in sequence over twelve months. A project gets a link here the day its repository turns public, and a repository turns public only when it has a measured result to show.

01

Intervention Targeting Engine

Planned

Tells an organisation which customers, cases or patients to spend a limited intervention budget on: only the ones whose outcome the intervention actually changes. Retention offers, outreach, fraud review, clinical follow-up: a large share of every such budget goes to people who would have behaved the same way regardless, and this finds them.

uplift modelling · S/T/X/DR/R meta-learners and causal forests · budget-constrained policy optimisation · sensitivity analysis

02

Model Selection at a Tenth of the Cost

Planned

Answers "which AI model should we use, and did the new version get worse?" with statistical confidence, using about a tenth of the evaluation calls a full benchmark needs. For a team re-evaluating models every month, that is a day instead of a week and tens of dollars instead of thousands, and it exposes the benchmark questions that were never measuring anything.

item response theory (2PL/3PL) · computerised adaptive testing · benchmark reliability and bias

03

AI Release Gate

Planned

No prompt or model change reaches users unless it is proven not to have regressed: the discipline a test suite gives code, applied to AI, with an audit trail a regulator can read. Includes a public month-by-month record of how the major vendors' "frozen" models silently change, which is the evidence most teams wish they had when something breaks.

LLM evaluation platform · judge calibration · confidence intervals and power analysis · CI regression gating · longitudinal drift

04

Compliant AI Gateway

In progress

Lets a bank, insurer, hospital or government department use frontier AI models without personal data ever leaving the boundary, with a tamper-evident record of every call and a hard cap on every team's spend. This is the single blocker most regulated organisations cite for AI adoption, removed, with the latency overhead measured and published.

provider routing by configuration · OpenTelemetry span and cost record per call · PII detection and reversible redaction · data-residency routing · semantic cache · hash-chained audit log · per-team budgets

05

Verified Filings Analyst

Planned

Answers questions across thousands of financial filings where every figure is traced to, and checked against, the number the company actually filed; a wrong number fails loudly instead of reaching a decision. Cuts analyst hours, and eliminates by construction the invented figure that stops finance and legal teams trusting AI with documents.

retrieval over SEC filings · table-aware chunking · hybrid retrieval with reranking · XBRL fact-level grounding and automatic verification

06

Frontier Quality at a Fraction of the Bill

Planned

Proves, with measurements, that a small model an organisation owns and hosts matches a frontier API on a high-volume task at a small fraction of the per-call cost, and shows exactly at what volume the switch pays for itself. For a team spending five figures a month on API calls, this is the project that finds most of it.

QLoRA fine-tuning · AWQ / GPTQ / GGUF quantisation · vLLM serving · quality, latency and cost frontier

07

Access-to-Information Redaction

Planned

Turns an access-to-information request from days of staff reading into hours of review: every proposed redaction carries the exemption category it rests on, a reviewer approves page by page with a full audit log, and the tool publishes how often it withholds what must go and, the number blunt PII tools never show, how often it keeps what must stay.

context-dependent PII redaction · exemption-category decision layer (rules plus LLM) · document layout parsing and OCR · per-category redaction confusion matrix · reviewer workflow with audit log

08

Capacity Planning Forecaster

Planned

Forecasts demand (emergency-department arrivals, call volume, orders) with uncertainty ranges that actually hold when conditions shift, and turns them into a staffing number at a chosen service level. Overstaffing costs money and understaffing costs patients or customers; this puts a defensible number on both, site by site, rolling up to the region.

hierarchical probabilistic forecasting · neural forecasters (N-HiTS, PatchTST) against statistical baselines · MinT reconciliation · adaptive conformal intervals · CRPS and pinball loss · decision layer

09

Real-Time Fraud and Risk Decisioning Platform

Planned

Scores every transaction in under 50 milliseconds, thousands per second, before the money moves, and keeps working as fraud patterns shift, without the training-versus-production mismatch that quietly breaks most deployed models. The platform around the model is what organisations are actually missing, and this is a working one you can watch run.

streaming feature store · point-in-time correctness · online/offline parity tests · shadow deployment · drift-triggered retraining · expected-loss review queue

10

Self-Healing Production AI

Planned

When a production system fails, this captures the failure with full context, drafts the fix, has a second AI review it adversarially, and hands an engineer a ready-to-approve pull request. Triage in minutes instead of days, engineers back on new work, and nothing changes without a person saying yes.

agentic incident triage · failure clustering · adversarial second-model review · human-gated patch proposals · confidence routing

Alongside

Built outside the twelve-month sequence, to the same standard.

11

Overload

Live

A running coach that rebuilds next week's plan from what the runner actually ran, every week, adjusting load and recovery from every logged session rather than handing out a static template, for a few dollars a month in model calls instead of a human coach's monthly fee.

agentic running coach · LangGraph agent graph · Claude · training-load and recovery modelling from logged runs

13

Grounded Email Response Drafting

Planned

For an inbox that receives hundreds of thousands of enquiries a year, a draft reply for each one, grounded in the organisation's own documents, with every claim cited to the passage that supports it and a clear escalation when the documents cannot answer. A person reads, edits and sends; the system sends nothing.

grounded response drafting · hybrid retrieval over a policy corpus · LangGraph triage, retrieve, draft, verify, escalate · citation verification · faithfulness measured with a calibrated judge · human approval before anything is sent

14

Department News Digest

Planned

One product, configured per department in a few lines, that reads the day's news, public forums and social feeds, removes the duplicates, ranks what matters to that audience, and delivers a short digest with every claim cited and every quote verified against its source. One system in place of dozens of people each doing this by hand, at a few dollars a month per department.

multi-source ingestion (RSS, GDELT, Reddit API, Bluesky) · clustering and deduplication · per-audience relevance ranking · cited summarisation with quote verification · LangGraph pipeline on GCP Cloud Run · precision and recall against a labelled week

How this was built

Design, methodology, evaluation choices and judgement are Peter Parker's. AI coding assistants were used for implementation and drafting, the way a senior engineer uses them in 2026. Every number in every results table is reproducible from its repository with one command, and that reproducibility is the evidence that matters. Each repository also records one approach that was tried and did not work, with the evidence.