You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Previous README had wrong license (AGPL, now MIT), wrong API examples
(compute_bac_metrics doesn't exist), and no mention of autoresearch.
New README covers both capabilities with working examples:
- Metrics pipeline: CLI and Python API with correct function names
- Autoresearch: three-stage pipeline, quick start, multi-cycle, persistence
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Metrics aggregation and statistical analysis for [NetGraph](https://github.com/networmix/NetGraph)simulation results.
3
+
Metrics and autonomous research tools for [NetGraph](https://github.com/networmix/NetGraph)network simulations.
4
4
5
-
## Overview
5
+
## What It Does
6
6
7
-
NetLab processes NetGraph workflow outputs (JSON artifacts) to compute statistical metrics across random seeds and failure scenarios. Provides CLI and Python API for batch analysis, cross-seed aggregation, and visualization.
7
+
NetLab has two capabilities:
8
8
9
-
## Features
9
+
1.**Metrics pipeline** — computes verified reliability metrics (BAC, latency, alpha) from ngraph simulation results. Per-direction, occurrence-count-weighted, hand-verified against 252 assertions.
-**CostPower**: CapEx/Power totals, USD/Watt per Gbit (offered and at p99.9 reliability)
19
-
20
-
### Cross-Seed Analysis
21
-
22
-
- Positional alignment of time-series data by iteration index
23
-
- Median and IQR (interquartile range) computation
24
-
- Variable-length series handling with NaN padding
25
-
26
-
### Visualization
27
-
28
-
- Cross-seed plots with median curves and IQR bands
29
-
- Baseline-normalized delta comparisons
30
-
- Statistical significance heatmaps (p-values)
11
+
2.**Autoresearch** — LLM-driven topology exploration. Describe a connectivity idea in natural language, and the system generates a valid ngraph scenario, runs the simulation, computes metrics, and produces a structural interpretation. The LLM also proposes the next experiment, closing the research loop.
31
12
32
13
## Installation
33
14
@@ -43,68 +24,177 @@ cd NetLab
43
24
make dev
44
25
```
45
26
46
-
## Usage
27
+
## Metrics
47
28
48
29
### CLI
49
30
50
31
```bash
51
-
# Compute metrics for scenarios
52
-
netlab metrics tests/data/scenarios/
32
+
# Compute metrics for all scenarios in a directory
|**BAC**| Delivered bandwidth distribution across failure iterations. AUC, quantiles, availability at thresholds, BW at probability levels. Per-direction breakdown. |
next_hypothesis.md # suggested next experiment (LLM-generated)
145
+
status.yml # analyzed | failed | skipped
146
+
```
147
+
148
+
### Key Design Decision
149
+
150
+
The LLM never extracts numbers from results. The metrics pipeline (same code that passed 252 hand-calculated assertions) computes all numbers programmatically. The LLM receives verified metrics and provides only interpretation — connecting numbers to topology structure.
0 commit comments