← Network
Model Card v3.1.1
Fidelity-based behavioral measurement for network traffic.
Version
v3.1.1
CICIDS Fri F1
0.972
CIC-2018 F1
0.876
Scales
4
CPU only
Air-gapped
Download model card Download benchmark PDF Run live demo

VERITY measures whether network traffic is consistent with calibrated normal behavior. When the observed behavior and the calibrated baseline diverge, the divergence is the detection. This works on traffic the system has never seen before, across encryption boundaries, and across network types — using the same instrument with no modification.

No attack signatures are learned. No labeled attack data is used for threshold derivation. No GPU is required. No internet connection is needed. The system calibrates from a benign observation window and measures deviation. A novel attack is not a special case — it is the default operating mode.

Label usage (full disclosure): In offline evaluation, benign rows are selected using ground-truth labels (oracle benign selection). In deployment, calibration uses an assumed-benign observation window with contamination checks. Scale contribution is calibration-emergent: each scale's weight is derived from its benign hold-out intensity — scales that produce high false-alarm rates on calibration data are automatically suppressed. No labels are used in scale weighting. Detection thresholds use only benign calibration data.

Four measurement scales operate independently on the same traffic. Each calibrates from benign only. Each captures anomalies invisible to the others:

Scale weighting emerges from calibration. Each scale is measured on a benign hold-out during calibration. Scales with low benign intensity (well-calibrated) receive high weight. Scales with high benign intensity (noisy) are automatically suppressed. The data's own geometry decides which perspectives to trust.

Mode discovery decomposes heterogeneous benign populations into behavioral modes using deterministic, silhouette-validated clustering. When geometric separation is present, modes are retained; otherwise global calibration is used.

┌──────────────────────────────────────────────────────────────────────┐
│                                                                      │
│  OPERATIONAL PROFILE                                                 │
│                                                                      │
│  Total footprint:        ~50 MB (engine + encoder + atlas)           │
│  Hardware requirement:   CPU only — no GPU required                  │
│  Encoding throughput:    70,000+ flows/sec (Apple Silicon)           │
│                          15,000+ flows/sec (CPU only)                │
│  Detection throughput:   1,300–2,100 flows/sec (full engine)         │
│  Cold-start calibration: 60 seconds on benign observation window     │
│  Recalibration:          Milliseconds (threshold re-derive)          │
│  Dependencies:           Python · numpy · scikit-learn · torch-cpu   │
│  Network requirement:    None — fully air-gapped operation           │
│  Operator parameters:    One — α (false positive budget)             │
│  Scale weighting:        Calibration-emergent (no labels)            │
│  Mode discovery:         Deterministic, silhouette-validated         │
│  Measurement scales:     4 (MICRO · MESO · CAMPO · TRAJECTORY)      │
│                                                                      │
└──────────────────────────────────────────────────────────────────────┘

All multi-scale results use calibration-emergent weighted composition. Flow-only results are unchanged.

Accuracy Profiles

All results: 5-fold cross-validated. Calibration on benign only. Default α=0.05.

CICIDS-2017 (Enterprise, weighted multi-scale)

DayFlowsAUC±F1PRFPRModes
Friday500,0000.9980.0000.9720.9461.0005.0%12
Thursday362,0760.9980.0000.9100.8370.9975.0%12
Tuesday322,0780.9960.0000.4700.3071.0005.0%9
Wednesday496,6410.9980.0000.9570.9181.0005.0%11

Thursday: AUC 0.998 with 12 stable modes (silhouette 0.552). Per-mode calibration on infiltration traffic — measuring each flow against its own kind of benign.

CSE-CIC-IDS-2018 (Enterprise, 10 daily captures)

Random-sampled 500K flows (seed=42) from full daily captures (5.4M–7.4M rows each).

DayFlowsAUC±F1Attack Types
Fri 16-02500,0001.0000.0000.948DoS Hulk (1.8M in full capture)
Tue 20-02500,0001.0000.0000.773DDoS-LOIC (289K in full capture)
Wed 21-02500,0001.0000.0000.929DDoS-HOIC (1.08M in full capture)
Wed 14-02500,0000.9930.0000.781FTP/SSH Brute Force
Thu 15-02500,0000.9930.0000.348DoS GoldenEye/Slowloris
Fri 02-03500,0000.9940.0000.592Botnet Ares
Wed 28-02500,0000.9950.0000.318Infiltration
Thu 01-03500,0000.9910.0000.287Infiltration/NMAP
Fri 23-02500,0000.9970.0010.003Web Attack (20 flows in sample)
Thu 22-02500,0000.9980.0000.002Web Attack (18 flows in sample)

Three days at AUC 1.000 correspond to volumetric DoS/DDoS floods with degenerate feature profiles — AUC 1.000 is expected, not exceptional. Two days show F1 ≈ 0 because they contain fewer than 25 attacks in 500K flows — base rate, not instrument failure. Attack-weighted F1 across all 10 days: 0.876 (versus published supervised baselines: LightGBM F1 0.740, RandomForest F1 0.744).

MAWIFlow (Real Backbone, flow-level)

YearFlowsAUC±
2016†500,0000.9490.000
2021†500,0000.9220.000

† Random sample of 500,000 flows (seed=42).

MAWI 2016/2021 reported at flow level. Multi-scale mode discovery finds strong structure (sil 0.95) but fragments per-mode calibration at 11–13 modes — deferred to v3.2.

MAWI 2011 (Real Backbone, weighted multi-scale)

YearFlowsAUC±Modes
201176,3770.8920.00114

76K flows. Multi-scale weighted composition stable across folds.

Other Domains (flow-level)

DatasetYearDomainFlowsAUC±F1PRFPR
NSL-KDD Train1999Legacy125,9730.9930.0010.9530.9440.9712.5%
UNSW Train2015Modern82,3320.9930.0020.9610.9600.9772.3%
BCCC-IoT2024Smart Home268,0490.9830.0000.9250.9750.9112.7%
UNSW Test2015Modern175,3410.9800.0010.9240.9750.9142.7%
NSL-KDD Test1999Legacy22,5430.9690.0020.8780.9600.9122.6%
TON-IoT2021IoT500,0000.9480.0010.6460.7970.5523.6%
DoH2020Encrypted269,6430.9380.0010.6810.9920.5195.0%
IoT-DIAD2024IoT500,0000.8640.0030.5040.7790.6913.0%

DoH: updated from 0.931 to 0.938 after a feature-mapping patch. Precision ≥ 0.989 at all α levels.

GPU Cluster Behavioral Fidelity (same measurement principles)

BenchmarkMetricResult
GWDG A100 GPU failuresDetection16/16 (100%)
GWDG healthy baselinesFalse alarm0/5 (0%)
Lingjun labeled GPU hostsAUC (5-fold)0.952 ± 0.007
Lingjun labeled GPU hostsF1 at α=0.07~0.80
Speed (Mac Mini)Throughput21,000+ flows/sec
Package sizeCompressed155 KB

Comparison to Supervised Baselines

BenchmarkVERITY (no labels)SupervisedMethod
MAWI 2016AUC 0.949AUC 0.902RF (Schraven et al. 2026)
MAWI 2021AUC 0.922AUC 0.903RF (Schraven et al. 2026)
CIC-2018 (weighted F1)F1 0.876F1 0.744RF (arXiv 2606.29797)
CICIDS-2017 FriAUC 0.998AUC 0.999CNN-BiLSTM
NSL-KDD TrainAUC 0.993AUC 0.997XGBoost

Cross-Temporal Resilience

Supervised RFVERITY
Same-year AUC (2016)0.9020.949
Same-year AUC (2021)0.9030.922
5-year transfer (2011→2016)0.942
10-year transfer (2011→2021)0.610.53
Recovery methodRelabel + retrain (weeks, GPU)Recalibrate (minutes, CPU)

Both approaches degrade under decade-scale concept drift. The operational difference is recovery cost.

FPR Consistency

At α=0.05, observed FPR ranges 2.3–5.3% across all evaluated datasets: legacy (1999), modern (2015), enterprise (2017–2018), IoT (2021–2024), real backbone (2011–2021), GPU clusters (2025–2026). FPR is controlled by α.

Documented Limitations

Calibration assumes a clean benign observation window. A contamination check warns on elevated anomaly rates in the calibration window; operator responsibility until automated integrity verification ships. Cross-temporal transfer degrades over a decade (AUC 0.53, comparable to supervised RF 0.61); recalibration recovers in minutes. Encoder coverage is strongest on enterprise/academic benign traffic — IoT and encrypted DNS feature mappings are weaker (DoH AUC 0.938 after feature-mapping patch). Adversarial evasion testing against adaptive mimicry has not been conducted. MAWI multi-scale produces fold instability at high mode counts — reported flow-only until adaptive mode granularity ships (v3.2).

All numbers from canonical validation logs. Weighted composition (calibration-emergent, no labels) as primary. The engine is the validation. Run it yourself.