Production terrain QA

Validation you can inspect.

Post-tile terrain outputs are compared directly with their source surfaces at defined validation areas. The programme covers global GEBCO bathymetry at Level 10 and higher-detail regional topo-bathymetric sources at Level 13, reporting completion, sample counts and residual statistics in metres.

01 / Level 13 regional validation

Authoritative regional surfaces. Post-tile fidelity.

Three Level 13 outputs were checked against established regional elevation and bathymetry datasets at defined survey coordinates. Each run completed all 256 scheduled tiles and 1,081,600 elevation comparisons. These statistics describe fidelity of the produced Quantized Mesh terrain to the selected source surface; they are not independent estimates of absolute seabed or ground-truth accuracy.

Level 13 validation resultsresidual statistics in metres
Data sourceSurvey coordinateSource blockTilesValid samplesFailedInvalidRMSEMAEBiasP95 abs.Max abs.
AusBathyTopo 250 m (Australia) 202337°S, 124°EDATASET_22_z13_x13824_y2400256 / 2561,081,600001.17290.3322+0.00171.690058.2439
EMODnet Bathymetry DTM 202452°N, 30°WDATASET_13_z13_x6816_y6448256 / 2561,081,600000.35760.1450−0.00080.700012.1366
NOAA NCEI U.S. Coastal Relief Model28°N, 90°WDATASET_18_z13_x4096_y5360256 / 2561,081,600000.00240.00210.00000.00000.0067

Regional source fidelity

All three Level 13 runs completed without tile or sample loss. Residual magnitudes differ substantially because the sources have different native resolutions, vertical references and terrain regimes; the results are therefore within-dataset fidelity checks rather than a ranking of the underlying datasets.

Reference systems matter

AusBathyTopo uses WGS 84 / EPSG:4326 with MSL heights and depths. The EMODnet run uses the MSL-converted DTM variant. The tested NOAA Gulf Coastal Relief Model uses WGS 84 horizontally and EGM2008 vertically.

02 / GEBCO Level 10 validation

Global bathymetry. Controlled derivative fidelity.

Three completed Level 10 validation blocks compare smoothed panDEM bathymetric terrain with the native GEBCO reference. Together they cover 3,072 tiles and 12,979,200 valid comparisons, with zero failed tiles and zero invalid samples. The test measures changes introduced by smoothing, resampling, tiling and encoding; it does not treat GEBCO as independent ground truth.

GEBCO Level 10 validation runssurvey coordinates were not specified in the supplied GEBCO validation record
Data sourceCoordinateSource blockTilesValid samplesFailedInvalidRMSEMAEBiasP95 abs.Max abs.
GEBCO · Run 1Not specifiedGEBCO_z10_x896_y4481,024 / 1,0244,326,400004.95822.9287−2.885610.2000128.1911
GEBCO · Run 2Not specifiedGEBCO_z10_x896_y3521,024 / 1,0244,326,400005.69053.6983−3.662111.790093.2711
GEBCO · Run 3Not specifiedGEBCO_z10_x1280_y2881,024 / 1,0244,326,400006.32103.8729−3.829112.8300275.6236

Combined Level 10 result

Pooled RMSE is 5.6839 m, mean MAE is 3.5000 m, pooled bias is −3.4589 m and mean regional P95 is 11.6067 m. The cumulative maximum absolute residual is 275.6236 m. Under the project-specific QA rubric, each submitted run scores 4.85/5.00 (97.0%).

Primary watch item

The recurring signal is a small negative vertical bias: all three GEBCO runs are lower/deeper than the reference on average. The supplied analysis identifies this as a trend to monitor as geographic validation coverage expands, while typical and P95 errors remain tightly controlled.

03 / Interpretation

Engineering QA, not a ground-truth claim.

The validation programme is designed to quantify how faithfully the production pipeline carries source elevation through smoothing, resampling, triangulation, tile construction and encoding. Source resolution, datum and terrain character differ by dataset, so cross-source residuals should be read in context rather than as direct quality rankings between providers.

The GEBCO rating bands are purpose-built panDEM engineering QA thresholds. The supplied white paper explicitly notes that GEBCO, ASPRS, USGS, GDAL and Esri do not prescribe pass/fail metre thresholds for a deliberately smoothed GEBCO derivative. ASPRS/USGS statistical concepts inform the methodology, but their numerical accuracy classes are not adopted here.