feat: deterministic E2E, distributed tracing, incremental export, Hermes lazy screens

[distributed-nerd]

Summary

Four reliability/performance/observability initiatives, each as a focused commit:

• Deterministic E2E test suite — hermetic per-test seeding, expectation-based waits, a mock network layer, tolerance-based visual regression, and flaky detection with a 5-run stability gate.
• End-to-end distributed tracing — W3C Trace Context propagation across mobile → backend → ML service → webhooks, OTLP export, and an OTel Collector + Tempo + Grafana stack.
• Incremental CDC export pipeline — change data capture with ordered LSNs, watermark checkpoints, pluggable CSV/JSON/Parquet adapters, idempotency, conflict resolution, and retry.
• Differential Hermes bytecode / lazy screens — eager critical screens + on-demand lazy chunks, a startup performance budget, and CI enforcement.

Closes #669
Closes #670
Closes #671
Closes #672

Changes by area

Deterministic E2E (e2e/, .detoxrc.js, .github/workflows/e2e-detox.yml, src/utils/e2e/)

• Hermetic seeding via launch args with a fixed clock/locale/timezone; a guarded in-app bootstrap seeds storage, rehydrates the store, and installs a deterministic fetch interceptor — a strict no-op in production.
• Expectation-based wait helpers (no fixed sleeps); named mock-network scenarios (happy-path, charge-failure, degraded-network).
• Visual regression now uses pixelmatch tolerance thresholds (configurable per snapshot / via env) instead of exact byte hashing, with diff artifacts.
• Flaky detection: jest.retryTimes + a reporter that records tests passing only on retry, an optional fail-on-flaky gate, and a 5-run CI stability matrix.
• Docs: docs/e2e-deterministic-testing.md.

Distributed tracing (backend/services/shared/, src/services/network/, ml-service/, infra/, backend/services/webhook.ts)

• Dependency-free, OpenTelemetry-shaped tracer with W3C traceparent/tracestate, span kinds/status/events, PII scrubbing, and OTLP/HTTP export.
• Consistent sampler (rate-based, endpoint-based, error-based) that honors parent decisions so traces stay whole.
• Backend instrumentation helpers (server / db / external / business-logic spans); webhook delivery emits a producer span and propagates context.
• Mobile traced apiClient; FastAPI ML service with model-load / feature-compute / inference spans.
• OTel Collector + Tempo + Grafana compose stack; docs/distributed-tracing.md.

Incremental export (backend/services/exportService.ts, backend/services/subscription/, backend/services/billing/accountingExport/, backend/services/shared/apiResponse.ts)

• Append-only change log with ordered LSNs, delete tombstones, per-entity versions, and schema versioning.
• Watermark-checkpointed incremental runs (per-batch checkpoint for clean resume).
• Pluggable CSV/JSON/Parquet adapters — pure and deterministic, so re-running a window yields byte-identical output (idempotency).
• Bidirectional conflict resolution (source/external/version/last-write wins), retry with exponential backoff, per-channel concurrency lock, and run metrics.
• Integration tests against a mock external sink; docs/incremental-export.md.

Hermes bytecode / lazy screens (metro.config.js, babel.config.js, app.config.js, src/navigation/, scripts/check-performance-budget.js)

• Critical screens (Home, SubscriptionDetail, Analytics, Payment) stay eager; all others load on demand via React.lazy + Suspense, with an error boundary that retries from the full bundle if a chunk is unavailable.
• Metro inlineRequires defers module evaluation so dynamically-imported screens become separately-loadable chunks.
• app.config.js declares eager/lazy tiers and the startup performance budget; check-performance-budget.js enforces the 2s ceiling, ≥30% startup improvement and ≥20% peak-memory reduction, wired into the CI bundle-size job.
• Also fixes latent AppNavigator type errors (missing routes/imports). docs/hermes-differential-bytecode.md.

Testing

• New pure-TS unit/integration tests pass (tracing core, export pipeline, webhook tracing integration, E2E launch-args): 29 tests green via standalone ts-jest.
• npm run perf:budget passes (sample metrics show ~38% startup and ~23% memory improvement vs baseline).
• Typecheck: no new errors introduced in touched files; 19 pre-existing AppNavigator errors fixed.

Notes / constraints

• The repo's jest-expo preset is broken at baseline (RN 0.85 mismatch), so the full RN test runner could not be exercised in this environment; pure-TS logic was validated with a standalone ts-jest config.
• Detox runs, the live ML service, and the OTel collector require simulators/services not available in CI here; configs and code are provided and unit-tested where possible.
• New devDependencies: pixelmatch, pngjs, @types/pngjs; runtime react-native-launch-arguments (lazy-required, guarded).

[drips-wave]

@distributed-nerd Great news! 🎉 Based on an automated assessment of this PR, the linked Wave issue(s) no longer count against your application limits.

You can now already apply to more issues while waiting for a review of this PR. Keep up the great work! 🚀

Learn more about application limits