Releases: Eamon2009/Quadtrix.cpp
Releases · Eamon2009/Quadtrix.cpp
v1.1.1
Quadtrix.cpp v1.1.1
Release Date: May 19, 2026
Minor maintenance release with bug fixes and tooling improvements.
What's Changed
Bug Fixes
- Fixed frontend session management edge cases
- Resolved backend request timeout handling
- Corrected API response formatting issues
New Features
- Added Python benchmark script for performance profiling
- Enhanced training metrics collection
Improvements
- Updated documentation
- Dependency version bumps
Setup
# Frontend
cd frontend
npm install
npm run build
# Backend
cd backend
pip install -r requirements.txtCompatible with all v1.1.0 models and configurations.
What's Changed
- Implement Core Engine Entry Point (Training & Multi-Mode Inference) by @Eamon2009 in #7
- Integrate Python Inference Refactor and Frontend API Layer by @Eamon2009 in #8
- updating by @Eamon2009 in #9
- Refactor codebase, enhance documentation, and add new features by @Eamon2009 in #26
- Add benchmarking, documentation updates, and GitHub Packages workflow by @Eamon2009 in #30
- Revert dependency bump and enhance documentation and licensing by @Eamon2009 in #31
- Revert dependency bump and enhance documentation and licensing (#31) by @Eamon2009 in #38
- Implement core engine entry point and refactor Python inference by @Eamon2009 in #37
- Revert dependency bump and improve documentation for benchmarks by @Eamon2009 in #39
- Add Quadtrix benchmark dimensions and comparison tool by @Eamon2009 in #40
- Entry point for Python benchmark (#41) by @Eamon2009 in #41
- Core PyTorch benchmark suite for Quadtrix by @Eamon2009 in #42
Full Changelog: v1.1.0...v1.1.1
What's Changed
- Implement Core Engine Entry Point (Training & Multi-Mode Inference) by @Eamon2009 in #7
- Integrate Python Inference Refactor and Frontend API Layer by @Eamon2009 in #8
- updating by @Eamon2009 in #9
- Refactor codebase, enhance documentation, and add new features by @Eamon2009 in #26
- Add benchmarking, documentation updates, and GitHub Packages workflow by @Eamon2009 in #30
- Revert dependency bump and enhance documentation and licensing by @Eamon2009 in #31
- Revert dependency bump and enhance documentation and licensing (#31) by @Eamon2009 in #38
- Implement core engine entry point and refactor Python inference by @Eamon2009 in #37
- Revert dependency bump and improve documentation for benchmarks by @Eamon2009 in #39
- Add Quadtrix benchmark dimensions and comparison tool by @Eamon2009 in #40
- Entry point for Python benchmark (#41) by @Eamon2009 in #41
- Core PyTorch benchmark suite for Quadtrix by @Eamon2009 in #42
Full Changelog: v1.1.0...v1.1.1
v1.1.0
Quadtrix v1.1.0
Date: 2026-05-09 | Device: NVIDIA T4 (CUDA / bf16) | Framework: PyTorch 2.10.0+cu128
Model Configuration
| Parameter | Value |
|---|---|
| Layers | 6 |
| Heads | 6 |
| Embedding dim | 100 |
| Block size | 190 |
| Batch size | 64 |
| Dropout | 0.2 |
| Learning rate | 3e-4 |
| Total parameters | 10,837,257 |
Training Details
| Field | Value |
|---|---|
| Steps | 8,000 |
| Eval every | 200 steps |
| Optimizer seed | 1337 |
| Train tokens | 14,080,249 |
| Val tokens | 1,564,473 |
| Precision | bf16 |
| MFU | 60.0% |
Results
| Metric | Value |
|---|---|
| Best val loss | 2.3918 |
| Final train loss | 2.2825 |
| Total loss drop | 8.57 |
| Peak throughput | 19,602 tok/s |
| Mean throughput | 18,756 tok/s |
| Peak grad norm | 2.2504 |
| Mean grad norm | 1.6894 |
| Training time | 82m 43s |
| Checkpoint | best_model.pt |
Notes
- Throughput ramps from ~279 tok/s at step 0 to a steady ~19,600 tok/s after the first eval interval, reflecting CUDA kernel warm-up.
- Gradient norms remain stable throughout training (mean 1.69), with no anomalous spikes observed.
What's Changed
- build(deps): bump @tanstack/react-query from 5.100.6 to 5.100.9 in /frontend by @dependabot[bot] in #23
- Revert "build(deps): bump @tanstack/react-query from 5.100.6 to 5.100.9 in /frontend" by @Eamon2009 in #25
Full Changelog: v1.01...v1.1.0
What's Changed
- build(deps): bump @tanstack/react-query from 5.100.6 to 5.100.9 in /frontend by @dependabot[bot] in #23
- Revert "build(deps): bump @tanstack/react-query from 5.100.6 to 5.100.9 in /frontend" by @Eamon2009 in #25
New Contributors
- @dependabot[bot] made their first contribution in #23
Full Changelog: v1.01...v1.1.0
Quadtrix v1.01
Quadtrix v1.0
Efficiency metrics
First release — token-level language model trained on CPU.
Training run
| Metric | Value |
|---|---|
| Loss reduction | 69.7% (10.82 → 3.25) |
| Best loss | 3.252 (step 2510) |
| Peak throughput | 435 tok/s |
| Wall time | ~61 min |
Loss curve
Model config
| Parameter | Value |
|---|---|
| Parameters | 6,684,497 |
| Architecture | 4 layers · 4 heads · 64d embedding |
| Batch · block size | 16 · 32 |
| Learning rate | 1e-3 |
| Dropout | 0.1 |
| Train tokens | 7,065,137 |
| Val tokens | 785,016 |
How to run
python engine/main.py
python engine/inference.pyNotes
- Training ran on CPU (PyTorch 2.4.1) with steady 60% bf16 MFU throughout
- Loss converged from 10.82 → 3.25 over 2,690 steps in ~61 minutes
- Gradient norms stable; no spikes or divergence observed
- Checkpoint saved at step 2510 (best validation loss)