Public learning proof

Learning Proof

A first-class proof chain showing whether the V2 engine is actually improving over time, whether the aggregate still matches ledger truth, and whether calibration and challenger workflows are healthy enough to support public claims.

Generated 08/08/2026, 05:17:44

HEALTHY

Predictions Analysed

84K+

83,775 exact surfaced forecasts

Settled Forecasts

79,696

Exact settled surfaced V2 ledger

Model Brier

0.2065

Lower is better

Alpha

-0.0045

Market Brier minus model Brier

ROI

-2.41%

Flat-stake surfaced ROI

Calibration Freshness

19.6h

SLA: 24h

Aggregate Reconciliation

Healthy

Last reconciled 08/08/2026, 05:18:38

Max drift 0.000000

Calibration SLA

Within SLA

Last updated 07/08/2026, 09:40:59

Challenger Activity

Active

Last activity 08/08/2026, 04:05:01

Pending promotions: 0 · recent decisions: 25

Rolling Walk-Forward Evidence

Shareable audit of persisted pre-match V2 forecasts. Rows are grouped by forecast-created week, and a cohort is only evaluated once that market has at least 100 prior surfaced settled forecasts. Forecast rows are not the same as executed bets: many markets can come from one fixture. This is deliberately separate from the tiny scheduled weekly comparison jobs.

Generated 08/08/2026, 05:18:42

Scope: 365d, surfaced-only, engine opportunities-engine-v2, cohort field createdAt, settled-outcome field settledAt. This validates stored forecasts against the market Brier baseline; it is not a claim that every row was executable at unlimited stake size.

Evaluated Holdout

79,198

5,842 fixtures, 79,696 eligible rows

Cohorts

1 warm-up cohorts skipped

Alpha vs Market

-0.0046

Market Brier minus model Brier

Flat ROI

-2.44%

-1932.77u over holdout rows

CLV Check

-1.56%

24.9% hit, 29,750 samples

Market	Eligible	Holdout	Fixtures	Cohorts	Alpha	ROI	Model Brier	Market Brier	Avg CLV	Range
All Markets	79,696	79,198	5,842	18	-0.0046	-2.44%	0.2065	0.2019	-1.56%	27/03/2026 to 07/08/2026
Asian Handicap	20,425	17,769	4,179	17	-0.0138	-9.84%	0.2194	0.2055	n/a	27/03/2026 to 07/08/2026
Goals Over/Under	14,593	14,470	4,228	18	-0.0048	-2.25%	0.1934	0.1886	-1.58%	27/03/2026 to 07/08/2026
Match Winner	9,575	8,378	3,622	17	-0.0032	-0.04%	0.2020	0.1988	-1.31%	27/03/2026 to 07/08/2026
Half Goals	9,581	7,515	3,578	17	+0.0420	+7.48%	0.2041	0.2461	+1.08%	27/03/2026 to 07/08/2026
Double Chance	5,717	4,410	2,105	17	-0.0097	-5.20%	0.2302	0.2205	-0.78%	27/03/2026 to 07/08/2026
Corners	5,756	3,764	1,160	11	-0.0130	-6.43%	0.2168	0.2038	n/a	28/03/2026 to 07/08/2026
BTTS	3,601	2,831	1,762	17	-0.0049	-7.31%	0.2442	0.2393	-1.01%	28/03/2026 to 07/08/2026
Team Goals	2,729	2,503	736	9	+0.0189	+60.70%	0.2190	0.2379	-1.54%	06/05/2026 to 07/08/2026
Correct Score	3,241	2,432	1,187	4	-0.0019	-25.15%	0.0525	0.0506	n/a	29/03/2026 to 08/05/2026
Clean Sheet	1,621	1,454	1,406	17	-0.0081	-6.55%	0.2209	0.2127	n/a	28/03/2026 to 07/08/2026
Even/Odd Goals	1,910	700	643	14	-0.0036	-5.46%	0.2535	0.2498	+0.34%	27/03/2026 to 07/08/2026
HT/FT	609	309	261	3	-0.0031	-16.89%	0.1172	0.1141	n/a	03/04/2026 to 05/05/2026

Win to Nil evidence quarantined

Old Win to Nil rows were recomputed with strict settlement rules, then excluded from headline proof because the original odds feed mapped stale market IDs into Win to Nil. These rows remain visible here as an audit trail, but they do not count toward public ROI, Brier, alpha, CLV, or market-family proof.

Quarantined Rows

6,459

6,801 historical Win to Nil rows

Active Proof Rows

0 settled rows currently counting

Removed ROI

+846.47%

Audit-only; +57568.60u is excluded

Strict Audit ROI

+1007.87%

5,957 recomputable rows, still excluded

Dominant Bad Pattern

31.27

Win to Nil - Home / No / key=no / side=home

Reason: win_to_nil_market_id_contamination_2026_04_14. Last quarantine write: 04/07/2026, 13:58:27. Latest captured row: 11/04/2026, 17:43:06. Latest active row: n/a. Generated 08/08/2026, 10:38:11.

Match	Stored Bet	Book	Captured	Score	Stored	Strict	Unit
Rayo Vallecano vs Elche La Liga	Win to Nil - Home / No @ 41.00 - Stored outcome differed from strict Win to Nil settlement	bet365	03/04/2026, 14:21:34	1-0	won	lost	-1.00u
Grenoble Foot 38 vs Clermont Ligue 2	Win to Nil - Home / No @ 29.00 - Stored outcome differed from strict Win to Nil settlement	bet365	03/04/2026, 14:21:24	2-2	lost	won	+28.00u
Grenoble Foot 38 vs Clermont Ligue 2	Win to Nil - Home / No @ 29.00 - Stored outcome differed from strict Win to Nil settlement	bet365	03/04/2026, 14:18:32	2-2	lost	won	+28.00u
Nottingham Forest vs Burnley Premier League	Win to Nil - Home / No @ 41.00 - Highest contaminated stored odds	bet365	11/04/2026, 14:55:36	4-1	won	won	+40.00u
Rayo Vallecano vs Espanyol La Liga	Win to Nil - Home / No @ 41.00 - Highest contaminated stored odds	bet365	11/04/2026, 14:05:01	1-0	lost	lost	-1.00u
Cambridge United vs Notts County League Two	Win to Nil - Home / No @ 41.00 - Highest contaminated stored odds	bet365	11/04/2026, 13:46:51	4-0	lost	lost	-1.00u

Proof Chain Windows

Exact surfaced settled windows comparing older periods against recent behavior.

Window	Sample	Brier	Market Brier	Alpha	ROI	Avg CLV	CLV Hit
Older 7d	2,497	0.2179	0.2216	+0.0037	12.90%	-0.78	12.8%
Recent 7d	1,815	0.2160	0.2188	+0.0029	1.98%	-0.03	20.6%
Older 30d	6,922	0.2100	0.2098	-0.0002	4.57%	-0.41	9.8%
Recent 30d	7,783	0.2127	0.2159	+0.0032	8.49%	-0.49	16.1%

7-Day Improvement

Older 7d vs recent 7d, with 95% confidence intervals on the change.

Brier Improvement

+0.0020

95% CI -0.0078 to 0.0117

Directional only · improved

Alpha Improvement

0.0000

95% CI 0.0000 to 0.0000

Directional only · worsened

ROI Improvement

-10.91pp

95% CI -20.09 to -1.74pp

Statistically clear · worsened

Avg CLV Improvement

+0.76%

95% CI 0.12 to 1.39%

Statistically clear · improved

CLV Hit Improvement

+7.74pp

95% CI 4.85 to 10.62pp

Statistically clear · improved

30-Day Improvement

Older 30d vs recent 30d for a broader view of whether the learning story survives over longer horizons.

Brier Improvement

-0.0026

95% CI -0.0084 to 0.0032

Directional only · worsened

Alpha Improvement

0.0000

95% CI 0.0000 to 0.0100

Statistically clear · improved

ROI Improvement

+3.91pp

95% CI -1.38 to 9.20pp

Directional only · improved

Avg CLV Improvement

-0.08%

95% CI -0.41 to 0.24%

Directional only · worsened

CLV Hit Improvement

+6.29pp

95% CI 4.90 to 7.68pp

Statistically clear · improved

Market

Eligible

Holdout

Fixtures

Cohorts

Alpha

ROI

Model Brier

Market Brier

Avg CLV

Range

All Markets

79,696

79,198

5,842

-0.0046

-2.44%

0.2065

0.2019

-1.56%

27/03/2026 to 07/08/2026

Asian Handicap

20,425

17,769

4,179

-0.0138

-9.84%

0.2194

0.2055

n/a

27/03/2026 to 07/08/2026

Goals Over/Under

14,593

14,470

4,228

-0.0048

-2.25%

0.1934

0.1886

-1.58%

27/03/2026 to 07/08/2026

Match Winner

9,575

8,378

3,622

-0.0032

-0.04%

0.2020

0.1988

-1.31%

27/03/2026 to 07/08/2026

Half Goals

9,581

7,515

3,578

+0.0420

+7.48%

0.2041

0.2461

+1.08%

27/03/2026 to 07/08/2026

Double Chance

5,717

4,410

2,105

-0.0097

-5.20%

0.2302

0.2205

-0.78%

27/03/2026 to 07/08/2026

Corners

5,756

3,764

1,160

-0.0130

-6.43%

0.2168

0.2038

n/a

28/03/2026 to 07/08/2026

BTTS

3,601

2,831

1,762

-0.0049

-7.31%

0.2442

0.2393

-1.01%

28/03/2026 to 07/08/2026

Team Goals

2,729

2,503

736

+0.0189

+60.70%

0.2190

0.2379

-1.54%

06/05/2026 to 07/08/2026

Correct Score

3,241

2,432

1,187

-0.0019

-25.15%

0.0525

0.0506

n/a

29/03/2026 to 08/05/2026

Clean Sheet

1,621

1,454

1,406

-0.0081

-6.55%

0.2209

0.2127

n/a

28/03/2026 to 07/08/2026

Even/Odd Goals

1,910

700

643

-0.0036

-5.46%

0.2535

0.2498

+0.34%

27/03/2026 to 07/08/2026

HT/FT

609

309

261

-0.0031

-16.89%

0.1172

0.1141

n/a

03/04/2026 to 05/05/2026

Match

Stored Bet

Book

Captured

Score

Stored

Strict

Unit

Rayo Vallecano vs Elche

La Liga

Win to Nil - Home / No

@ 41.00 - Stored outcome differed from strict Win to Nil settlement

bet365

03/04/2026, 14:21:34

1-0

won

lost

-1.00u

Grenoble Foot 38 vs Clermont

Ligue 2

Win to Nil - Home / No

@ 29.00 - Stored outcome differed from strict Win to Nil settlement

bet365

03/04/2026, 14:21:24

2-2

lost

won

+28.00u

Grenoble Foot 38 vs Clermont

Ligue 2

Win to Nil - Home / No

@ 29.00 - Stored outcome differed from strict Win to Nil settlement

bet365

03/04/2026, 14:18:32

2-2

lost

won

+28.00u

Nottingham Forest vs Burnley

Premier League

Win to Nil - Home / No

@ 41.00 - Highest contaminated stored odds

bet365

11/04/2026, 14:55:36

4-1

won

+40.00u

Rayo Vallecano vs Espanyol

La Liga

Win to Nil - Home / No

@ 41.00 - Highest contaminated stored odds

bet365

11/04/2026, 14:05:01

1-0

lost

-1.00u

Cambridge United vs Notts County

League Two

Win to Nil - Home / No

@ 41.00 - Highest contaminated stored odds

bet365

11/04/2026, 13:46:51

4-0

lost

-1.00u

Window

Sample

Brier

Market Brier

Alpha

ROI

Avg CLV

CLV Hit

Older 7d

2,497

0.2179

0.2216

+0.0037

12.90%

-0.78

12.8%

Recent 7d

1,815

0.2160

0.2188

+0.0029

1.98%

-0.03

20.6%

Older 30d

6,922

0.2100

0.2098

-0.0002

4.57%

-0.41

9.8%

Recent 30d

7,783

0.2127

0.2159

+0.0032

8.49%

-0.49

16.1%