Skip to content

Commit b162102

Browse files
committed
Add local velocity benchmark
1 parent 64466cc commit b162102

1 file changed

Lines changed: 97 additions & 0 deletions

File tree

Lines changed: 97 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,97 @@
1+
# Benchmark: Wikipedia Deep-Dive (Local Velocity Experiment)
2+
3+
> **🧪 Experiment Context**
4+
> **Objective:** Evaluate the impact of **Local Instantaneous Velocity** vs. **Global Trajectory Smoothing** on agent navigation performance.
5+
> **Hypothesis:** We initially feared local velocity () would cause oscillation due to high-frequency noise in the embedding space.
6+
> **Reality:** Experiments reveal that Global Smoothing introduces "Semantic Inertia," causing the agent to cling to the starting concept. **Local Velocity allows for rapid context switching**, essential for multi-hop reasoning.
7+
> **Input Data:**,
8+
9+
---
10+
11+
## 1. Comparative Executive Summary
12+
13+
This experiment compares the default "Global Heading" implementation against the experimental "Local Velocity" implementation.
14+
15+
| Metric | Global Heading (Baseline) | Local Velocity (Experimental) | Improvement |
16+
| --- | --- | --- | --- |
17+
| **Tech Scenario Steps** | 23 Steps (77s) | **2 Steps (18s)** | **10x Efficiency** |
18+
| **Revolution Scenario Steps** | 12 Steps (35s) | **8 Steps (37s)** | **33% Fewer Steps** |
19+
| **Trajectory Characteristic** | High Inertia (Hard to switch topics) | **High Agility** (Snaps to new contexts) | **Eliminated Looping** |
20+
| **Outcome** | Prone to "Orbiting" the target | Direct Interception | **Validated** |
21+
22+
---
23+
24+
## 2. Scenario A: The "Zero-Inertia" Run (Jacquard Machine → CPU)
25+
26+
**Challenge:** Trace the technological evolution from early looms to modern processors.
27+
**Key Difficulty:** Breaking away from the "Textile" semantic cluster to enter the "Computing" cluster.
28+
29+
### 2.1 The Trajectory Comparison
30+
31+
#### 🔴 Global Heading (Baseline) - *The Trap*
32+
33+
The agent kept the "Jacquard Machine" (Start Node) in its heading vector too long. It reached computer hardware but kept circling back to specific components rather than the core concept.
34+
35+
* *Path:* `Jacquard` -> ... -> `ACPI` -> `AMD Turbo Core` -> `Opteron` -> `X86-64` -> `Opteron` (Loop)
36+
37+
#### 🟢 Local Velocity (Winner) - *The Snap*
38+
39+
The agent moved based *only* on the previous step. Once it hit a "Gateway Node" (`History of computing hardware`), it immediately discarded the "Textile" context and drove full speed toward the CPU.
40+
41+
```mermaid
42+
graph TD
43+
Start("🧶 Jacquard machine") -->|Link: History| Step1["📜 History of computing hardware"]
44+
Step1 -->|Link: CPU| EndNode("💻 Central processing unit")
45+
46+
style Start fill:#f9f,stroke:#333,stroke-width:2px
47+
style Step1 fill:#ff9,stroke:#333,stroke-width:2px
48+
style EndNode fill:#bbf,stroke:#333,stroke-width:4px
49+
50+
```
51+
52+
### 2.2 Technical Analysis
53+
54+
* **Semantic Inertia:** Global Heading failed because `Jacquard machine` is semantically distant from `CPU`. By averaging the start vector, the agent was "held back" by its history.
55+
* **Gateway Exploitation:** `History of computing hardware` acts as a semantic bridge. Local Velocity allowed the agent to use this bridge to perform a **90-degree semantic turn** without penalty.
56+
57+
---
58+
59+
## 3. Scenario B: The "Temporal Bridge" (Coffee → French Revolution)
60+
61+
**Challenge:** Find the connection between a beverage and a major political event.
62+
63+
### 3.1 The Trajectory
64+
65+
```mermaid
66+
graph TD
67+
Start("☕ Coffee") -->|Association| Step1["⚔️ Battle of Vienna"]
68+
Step1 -->|Context| Step2["⚔️ Great Turkish War"]
69+
Step2 -->|Context| Step3["⚔️ Austro-Turkish War"]
70+
Step3 -->|Exploration| Step4["⚔️ Anapa campaign (1788/1790)"]
71+
Step4 -.->|Dead End?| Step5["📅 1790 (Year)"]
72+
Step5 -->|Reflex Trigger| EndNode("🔥 French Revolution")
73+
74+
style Start fill:#f9f,stroke:#333,stroke-width:2px
75+
style Step5 fill:#ff9,stroke:#333,stroke-width:2px
76+
style EndNode fill:#bbf,stroke:#333,stroke-width:4px
77+
78+
```
79+
80+
### 3.2 Analysis of Agent Behavior
81+
82+
* **The Historical Route:** Unlike the Global run (which went via `American Revolution`), the Local run took a fascinating historical detour: Coffee -> Vienna (Coffee House Culture origins) -> Ottoman Wars.
83+
* **The "Year" Bridge (Step 5):** The agent got stuck in obscure wars (`Anapa campaign`). However, because it relies on *local* signals, it identified the link `1790` (the year) as a high-potential node.
84+
* **The Pivot:** Once at `1790`, the `French Revolution` is a dominant semantic neighbor. The agent used a temporal node to bridge a gap between "Ottoman Wars" and "French Politics."
85+
86+
---
87+
88+
## 4. Architectural Conclusions
89+
90+
### 4.1 "Forgetfulness" is a Feature
91+
92+
In high-dimensional Knowledge Graphs (like Wikipedia), the path to the target is often **non-linear**.
93+
94+
* Global Heading assumes a straight line (Geodesic).
95+
* Local Velocity acts like **Brownian Motion with Gradient Descent**.
96+
97+
**Conclusion:** For semantic exploration, it is better to "forget" where you came from and focus entirely on where the current node can take you.

0 commit comments

Comments
 (0)