PandaProbe is an open source agent engineering platform. It helps teams collaboratively trace, evaluate, monitor, and debug AI agents. You can use PandaProbe cloud or self host the service.
Visit our client docs or jump to a quickstart Python
Prerequisites: Docker must be installed and running.
git clone https://github.com/chirpz-ai/pandaprobe.git
cd pandaprobe
./start.shOnce running, open:
- Dashboard — http://localhost:3000
- API reference — http://localhost:8000/scalar
sequenceDiagram
participant Client as 📡 SDK / HTTP Client
participant API as ⚡ FastAPI
participant Auth as 🔐 Auth Service
participant IdP as 🌐 Supabase / Firebase
participant Identity as 👥 Identity Service
participant Trace as Trace Service
participant Eval as 🧪 Eval Service
participant DB as 🗄️ PostgreSQL
participant Redis as 📮 Redis
participant Worker as ⚙️ Celery Worker
participant LLM as 🤖 LLM Engine (LiteLLM)
Note over Client,API: Management Plane (Bearer token)
Client->>API: Authorization: Bearer <idp_token>
API->>Auth: Verify token
Auth->>IdP: Validate with provider
IdP-->>Auth: User identity
Auth-->>API: Authenticated user
API->>Identity: /user, /organizations, /projects
Identity->>DB: Read / write
DB-->>Identity: Result
Identity-->>Client: Response
Note over Client,API: Data Plane (API key)
Client->>API: X-API-Key + X-Project-Name
API->>Identity: Resolve org & project
Identity-->>API: Project context
API->>Trace: POST /traces
Trace->>Redis: Enqueue ingestion job
Redis-->>Client: 202 Accepted
Redis->>Worker: Pick up job
Worker->>DB: Persist trace + spans
API->>Trace: GET /traces, /sessions
Trace->>DB: Query with filters
DB-->>Trace: Rows
Trace-->>Client: Paginated response
API->>Eval: POST /evaluations
Eval->>Redis: Enqueue eval job
Redis-->>Client: 202 Accepted
Redis->>Worker: Pick up job
Worker->>LLM: LLM-as-a-judge call
LLM-->>Worker: Verdict + score
Worker->>DB: Persist evaluation result
| Service | Description | Port |
|---|---|---|
| frontend | Next.js dashboard | 3000 |
| app | FastAPI application server | 8000 |
| worker | Celery background worker | — |
| beat | Celery Beat scheduler | — |
| postgres | PostgreSQL 16 | 5432 |
| redis | Redis 7 (broker + cache) | 6379 |
We welcome contributions! Please read the Contributing Guide for instructions on setting up your development environment, building from source, running tests, and submitting pull requests.
Built by the Chirpz AI team. Contact sina@pandaprobe.com for enquiries.
PandaProbe is licensed under Apache 2.0 — see LICENSE for details.