SWMM BENCH

swmm-bench comparison report

Benchmark regression-20260826-090426 · 2026-08-26T09:05:06.514967+00:00

12 issues across 11 models

Failed 0 High 0 Review 4 Hidden as matching 110

Hostdebian
Operating systemLinux-6.12.96+deb13-amd64-x86_64-with-glibc2.41
Python3.14.3
Schema5

Comparison overview

Start with exceptions, then open the report tables or output series that need inspection.

Output comparisons6160 hidden as matching
Report comparisons6150 hidden as matching
Diagnostics0 errors78 warnings
Run matrix2 × 61engines × models

Distance by selected baseline

Each model run is a cluster of selected engines compared with the baseline engine. Click a bar to open that comparison.

Clustered bar chart of report or output distances by model and engine.

Ctrl/Cmd-click to select multiple engines. Choose an axis, then Ctrl + wheel or pinch zooms, Shift + drag selects a zoom window, and Alt + drag pans. Linear scale keeps the y-axis minimum at 0; logarithmic scale omits zero distances.

Issues

Failed run or report error High >10% difference Review 1–10% difference

More filters
Next
2 issues runswmm-07c371f vs runswmmrs-56ce94c 0.028021 0 2 detail rows
hydraulics/slot-surcharge_tunnelmh.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.028021 0 Open report
hydraulics/slot-surcharge_tunnelmh.inp Output runswmm-07c371f vs runswmmrs-56ce94c 0.023333 — Open output
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.020049 0 1 detail row
hydrology/groundwater-si_gw_model.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.020049 0 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.018810 0 1 detail row
hydrology/rdii-assignment_groundwater-si_gw_model.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.018810 0 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.005408 2 1 detail row
hydrology/outfall-runon.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.005408 2 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.001439 6 1 detail row
hydraulics/weirs-rainfall-2weirs-4subs.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.001439 6 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.001315 2 1 detail row
hydrology/lid-infiltration-trench-paired.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.001315 2 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.001288 2 1 detail row
controls/rtc-master_extran_rtc.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.001288 2 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.000646 2 1 detail row
routing/kinwave-routing_kinwave.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.000646 2 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.000421 20 1 detail row
hydraulics/elevation-offsets_outfalls-all_outfall_types_model.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.000421 20 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.000045 42 1 detail row
routing/steady-attenuation_steady_flow.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.000045 42 Open report
1 issue runswmm-07c371f vs runswmmrs-56ce94c 0.000014 2 1 detail row
hydrology/lid-bioretention-paired.inp Report runswmm-07c371f vs runswmmrs-56ce94c 0.000014 2 Open report

Report comparison explorer

hydraulics/slot-surcharge_tunnelmh.inp

runswmm-07c371f vs runswmmrs-56ce94c · overall distance 0.028021

Table Distance Rows runswmm-07c371f Rows runswmmrs-56ce94c Top differences
conduit_surcharge_summary 0.000000 1 1 No notable differences.
flow_classification_summary 0.000000 1 1 No notable differences.
flow_routing_continuity 0.000000 12 12 No notable differences.
link_flow_summary 0.004713 3 3
3 differing cells.
Row Column runswmm-07c371f runswmmrs-56ce94c Abs diff Rel diff
OverflowGate Maximum_Flow_CFS 0.06 0.055 0.0049999999999999975 0.0833333333333333
Gate Maximum_Flow_CFS 649.3 650.0 0.7000000000000455 0.001076923076923147
StoragePipe Maximum_Flow_CFS 309.87 310.0 0.12999999999999545 0.00041935483870966274
node_depth_summary 0.135833 4 4
4 differing cells.
Row Column runswmm-07c371f runswmmrs-56ce94c Abs diff Rel diff
Overflow Average_Depth_Feet 0.0 13.0 13.0 1.0
Overflow Maximum_Depth_Feet 0.0 13.0 13.0 1.0
Overflow Reported_Max_Depth_Feet 0.0 13.0 13.0 1.0
Overflow Maximum_HGL_Feet -50.0 -37.0 13.0 0.26
node_flooding_summary 0.000000 1 1 No notable differences.
node_inflow_summary 0.003085 4 4
4 differing cells.
Row Column runswmm-07c371f runswmmrs-56ce94c Abs diff Rel diff
Overflow Maximum_Total_Inflow_CFS 0.06 0.055 0.0049999999999999975 0.0833333333333333
LoadNode Maximum_Total_Inflow_CFS 6.39 6.4 0.010000000000000675 0.0015625000000001055
ToTunnel Maximum_Total_Inflow_CFS 649.3 650.0 0.7000000000000455 0.001076923076923147
Regulator Maximum_Total_Inflow_CFS 309.87 310.0 0.12999999999999545 0.00041935483870966274
node_surchage_summary 0.000000 1 1 No notable differences.
outfall_loading_summary 0.022794 2 2
4 differing cells.
Row Column runswmm-07c371f runswmmrs-56ce94c Abs diff Rel diff
Overflow Avg_Flow_CFS 0.02 0.022 0.0019999999999999983 0.09090909090909084
Overflow Max_Flow_CFS 0.06 0.055 0.0049999999999999975 0.0833333333333333
ToTunnel Avg_Flow_CFS 48.34 48.0 0.3400000000000034 0.0070335126189491805
ToTunnel Max_Flow_CFS 649.3 650.0 0.7000000000000455 0.001076923076923147
storage_volume_summary 0.000135 1 1
1 differing cells.
Row Column runswmm-07c371f runswmmrs-56ce94c Abs diff Rel diff
Regulator Maximum_Outflow_CFS 649.3 650.0 0.7000000000000455 0.001076923076923147
time_step_critical_elements 0.000000 0 0 No notable differences.

Output comparison explorer

hydraulics/slot-surcharge_tunnelmh.inp

runswmm-07c371f vs runswmmrs-56ce94c · Composite distance · overall distance 0.023333 · 54 plotted series

Typical-over-time 0.023333 · event 0.023333

About output distance — Typical/event composite + missing penalty

The primary score blends typical-over-time disagreement with event disagreement. The typical weight is 75%; the event weight is 25%.

typical distance = min(mean(|A − B|) / max(|A|, |B|), 1) event distance = min(RMSE(A − B) / max(RMS(A), RMS(B)), 1) series distance = missing fraction + (1 − missing fraction) × (typical weight × typical distance + event weight × event distance)

One-sided timestamps within the shared timeline, one-sided null or invalid values, and semantic series absent from one engine count as missing. Paired null values are neutral. Trailing-only timestamps are reported as timeline coverage and do not affect value distance. Displayed component scores include this missing-value penalty.

The overall output distance is the equal-weight arithmetic mean of all semantic-series distances. Scores at or below 1% are green, scores at or below 10% are yellow, and larger scores are red.

Report-table comparisons use a separate cell-weighted relative-distance metric.

Select an output series

Overall output distance — Composite distance 0.023333
Selected series distance — Composite distance —
Typical-over-time distance —
Event distance —

Ctrl + wheel or pinch to zoom time. Shift + drag selects a time window; Alt + drag pans.

Time-series comparison chart for runswmm-07c371f and runswmmrs-56ce94c.

View plotted timesteps as a table
The timestamp and paired values used in the selected graph.
Timestamp runswmm-07c371f runswmmrs-56ce94c

Average analysis duration by engine

Run matrix 2 engines × 61 models
Performance table (2 engines × 61 models)
controls/math-operator-matrix.inp
1.000 s
0.24 MB
exit 0
1.000 s
- MB
exit 0
controls/rtc-many-rules.inp
1.000 s
0.39 MB
exit 0
1.000 s
0.38 MB
exit 0
controls/rtc-master_extran_rtc.inp
1.000 s
3.53 MB
exit 0
1.000 s
6.93 MB
exit 0
controls/variables-expressions-rain.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydraulics/culvert-roadway-exfiltration.inp
1.000 s
0.25 MB
exit 0
1.000 s
0.38 MB
exit 0
hydraulics/elevation-offsets_outfalls-all_outfall_types_model.inp
1.000 s
- MB
exit 0
1.000 s
0.57 MB
exit 0
hydraulics/forcemain-darcy-weisbach.inp
1.000 s
0.25 MB
exit 0
1.000 s
0.67 MB
exit 0
hydraulics/inertial-damping-full_exam80a-sw5.inp
1.000 s
0.41 MB
exit 0
1.000 s
0.57 MB
exit 0
hydraulics/inlets-inlet_capture_test.inp
1.000 s
0.59 MB
exit 0
1.000 s
0.75 MB
exit 0
hydraulics/inlets-onsag-slotted-custom.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydraulics/inlets-rainfall-drop-matrix.inp
1.000 s
0.35 MB
exit 0
1.000 s
0.41 MB
exit 0
hydraulics/outfalls-all_outfall_types_model.inp
1.000 s
- MB
exit 0
1.000 s
0.75 MB
exit 0
hydraulics/outlet-tabular-depth_extran3-rc.inp
1.000 s
0.35 MB
exit 0
1.000 s
0.39 MB
exit 0
hydraulics/shapes-swmm5_shapes.inp
1.000 s
0.28 MB
exit 0
1.000 s
0.38 MB
exit 0
hydraulics/slot-surcharge_tunnelmh.inp
1.000 s
0.54 MB
exit 0
1.000 s
0.80 MB
exit 0
hydraulics/storage-cross-section-matrix.inp
1.000 s
0.39 MB
exit 0
1.000 s
0.36 MB
exit 0
hydraulics/weirs-rainfall-2weirs-4subs.inp
1.000 s
3.44 MB
exit 0
1.000 s
5.86 MB
exit 0
hydrology/climate-dly0204.inp
1.000 s
- MB
exit 0
1.000 s
0.83 MB
exit 0
hydrology/climate-file-evaporation.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/climate-td3200.inp
1.000 s
- MB
exit 0
1.000 s
0.56 MB
exit 0
hydrology/curvenumber-lid-example_lid_rb.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/greenville-lid-snow-groundwater.inp
1.000 s
0.35 MB
exit 0
1.000 s
0.66 MB
exit 0
hydrology/groundwater-si_gw_model.inp
1.000 s
0.38 MB
exit 0
1.000 s
0.40 MB
exit 0
hydrology/lid-bioretention-paired.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/lid-controls-ghcnd.inp
1.000 s
- MB
exit 0
1.000 s
0.34 MB
exit 0
hydrology/lid-example_lid_rb.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/lid-green-roof-paired.inp
1.000 s
- MB
exit 0
1.000 s
0.37 MB
exit 0
hydrology/lid-infiltration-trench-paired.inp
1.000 s
0.52 MB
exit 0
1.000 s
1.51 MB
exit 0
hydrology/lid-porous-pavement-paired.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/lid-rain-barrel-paired.inp
1.000 s
- MB
exit 0
1.000 s
0.59 MB
exit 0
hydrology/lid-rain-garden-paired.inp
1.000 s
- MB
exit 0
1.000 s
0.53 MB
exit 0
hydrology/lid-roof-disconnection-runon.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/lid-vegetative-swale-paired.inp
1.000 s
- MB
exit 0
1.000 s
0.39 MB
exit 0
hydrology/modified-green-ampt.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/modified-horton.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/ncdc-rainfall.inp
1.000 s
0.25 MB
exit 0
1.000 s
0.32 MB
exit 0
hydrology/outfall-runon.inp
1.000 s
0.54 MB
exit 0
1.000 s
0.55 MB
exit 0
hydrology/rainfall-format-matrix.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
hydrology/rdii-assignment_groundwater-si_gw_model.inp
1.000 s
0.47 MB
exit 0
1.000 s
0.33 MB
exit 0
hydrology/snowmelt-small_snowmelt_model.inp
1.000 s
0.36 MB
exit 0
1.000 s
0.30 MB
exit 0
routing/kinwave-divider-types.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
routing/kinwave-routing_kinwave.inp
1.000 s
0.29 MB
exit 0
1.000 s
0.55 MB
exit 0
routing/kinwave-storage-shapes.inp
1.000 s
0.52 MB
exit 0
1.000 s
0.41 MB
exit 0
routing/pump-storage-table-matrix.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
routing/steady-attenuation_steady_flow.inp
1.000 s
3.48 MB
exit 0
1.000 s
6.71 MB
exit 0
save_interfaces/save_hotstart.inp
1.000 s
0.41 MB
exit 0
1.000 s
0.66 MB
exit 0
save_interfaces/save_outflows.inp
1.000 s
- MB
exit 0
1.000 s
0.77 MB
exit 0
save_interfaces/save_rainfall.inp
1.000 s
0.38 MB
exit 0
1.000 s
0.59 MB
exit 0
save_interfaces/save_rdii.inp
1.000 s
0.39 MB
exit 0
1.000 s
0.40 MB
exit 0
save_interfaces/save_runoff.inp
1.000 s
0.50 MB
exit 0
1.000 s
0.41 MB
exit 0
use_interfaces/hotstart-use.inp
1.000 s
0.39 MB
exit 0
1.000 s
0.59 MB
exit 0
use_interfaces/inflows-use-toy.inp
1.000 s
0.26 MB
exit 0
1.000 s
0.56 MB
exit 0
use_interfaces/rainfall-use.inp
1.000 s
0.46 MB
exit 0
1.000 s
0.37 MB
exit 0
use_interfaces/rdii-use-text.inp
1.000 s
- MB
exit 0
1.000 s
- MB
exit 0
use_interfaces/rdii-use.inp
1.000 s
0.35 MB
exit 0
1.000 s
0.84 MB
exit 0
use_interfaces/runoff-use.inp
1.000 s
0.67 MB
exit 0
1.000 s
2.86 MB
exit 0
water-quality/landuse-function-matrix.inp
1.000 s
0.51 MB
exit 0
1.000 s
0.54 MB
exit 0
water-quality/treatment-expression-rainfall.inp
1.000 s
- MB
exit 0
1.000 s
0.57 MB
exit 0
water-quality/treatment-variable-matrix.inp
1.000 s
0.39 MB
exit 0
1.000 s
- MB
exit 0
water-quality/treatment-waterquality-events_example.inp
1.000 s
3.52 MB
exit 0
1.000 s
6.90 MB
exit 0
water-quality/waterquality-events_example.inp
1.000 s
3.48 MB
exit 0
1.000 s
6.83 MB
exit 0
What this report includes

Detailed report tables are embedded when distance is above 1% or warnings require attention. Output time-series data follows the same threshold. Not comparable or matching comparisons: 50 report-table; 60 output. Graph JSON is parsed only after opening a comparison. The JSON results retain every computed comparison.