PDE-OBS Full Dataset Progress

A public, auditable view of generation completeness, artifact integrity, strict quality, recovery provenance, and final aggregate validation.

Campaign: numerics-full-t15-6c7c7e31
Stored trajectory: T=15
Final strict QC running

Snapshot updated 2026-08-19T03:36:45-04:00. Generation and artifact integrity are complete; release acceptance remains pending until the separate strict aggregate job writes and validates its summary.

3,360of 3,360 shards
560,000of 560,000 samples
7PDE families
100%generation complete
Artifact integrity

Every expected shard and sidecar is present

CheckVerified result
HDF5 / manifest / SHA256 / metadata / quality3,360 complete sets
Missing or mismatched expected rows0
Partials / live locks0 / 0
Live generation / duplicate outputs0 / 0
Approximate storage235 GiB
Strict scientific gate

All shard-level PDE checks pass without relaxing the threshold

Maximum accepted pde_loss0.04991468784379508
Required ceiling0.05
R4 recovery maximum0.04819975344171334

No model training was run. Recovery preserved logical sample identities and stored T=15, used exact-seed diagnostics, and produced non-overlapping replacements only for absent or rejected rows.

Final aggregate validation

One strict QC job is reading all 3,360 shards

Generation completeJobs 2130068 and 2130070 completed all six R4 rows with verified sidecars and checksums.
Read-only full audit complete560,000 samples, seven PDEs × 80,000, zero missing rows, partials, locks, or overlaps.
Expected-plan reconciliation completeJob 2130270 found exactly two stale Burgers time_steps values in the expected plan, not a data-quality failure. The original plan remains unchanged and the reconciled QC plan has zero content-spec mismatches.
Strict QC job 2130280 runninglong-40core-shared; 1 CPU / 8 GiB; validates shards, requires all PDEs, and enforces pde_loss ≤ 0.05.
Release acceptance pendingAccepted only after summary.json proves 3,360 shards / 560,000 samples and strict quality success.
Reproducibility anchors

Frozen and reconciled plan identities

Original combined plan

numerics-full-t15-6c7c7e31.quality-recovered-combined.jsonl

SHA256 f97bf441c211cc5d8bdf9602837e826bbd360d9656b53d4e1942092f4e4d2e19

Preserved unchanged.

Final-QC expected plan

numerics-full-t15-6c7c7e31.quality-recovered-final-qc.jsonl

SHA256 1173212693fe72d098c5077c73bc2314df8012c886a8e4fb78cb99d8010cfd81

Changes only two documented R2 Burgers internal time-grid values; 3,360 unique rows / 560,000 samples.

Download the machine-readable progress snapshot.