Skip to content

fix(helm): align Hindsight probes with DB pressure remediation #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
allyblockcast wants to merge 2 commits into
base: main
Choose a base branch
from
Open

fix(helm): align Hindsight probes with DB pressure remediation #20

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a254da8
fix(helm): align Hindsight probe and worker slot defaults
Jul 8, 2026
c81ae00
fix(helm): align probes with live DB pressure remediation
Jul 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 12 additions & 17 deletions helm/hindsight/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,16 +46,15 @@ api:
timeoutSeconds: 5
failureThreshold: 3

# readinessProbe hits /health (checks DB connectivity) rather than /version:
# unlike liveness, readiness must detect a DB outage so k8s pulls the pod
# from rotation instead of routing traffic to a pod that can't serve it.
# Keep readiness on the cheap process/version endpoint so DB pressure cannot
# cascade into kube probe failures while workers are draining backlog.
readinessProbe:
httpGet:
path: /health
path: /version
port: 8888
initialDelaySeconds: 10
periodSeconds: 5
timeoutSeconds: 3
timeoutSeconds: 5
failureThreshold: 3

# Pod disruption budget
Expand Down Expand Up @@ -147,19 +146,18 @@ worker:
port: 8889
initialDelaySeconds: 30
periodSeconds: 10
timeoutSeconds: 5
timeoutSeconds: 30
failureThreshold: 3

# readinessProbe hits /health (checks DB connectivity) rather than /metrics:
# unlike liveness, readiness must detect a DB outage so k8s pulls the pod
# from rotation instead of routing traffic to a pod that can't serve it.
# Keep readiness on the worker's metrics endpoint so DB pressure cannot
# cascade into kube probe failures while workers are draining backlog.
readinessProbe:
httpGet:
path: /health
path: /metrics
port: 8889
initialDelaySeconds: 10
periodSeconds: 5
timeoutSeconds: 3
timeoutSeconds: 30
failureThreshold: 3

# Worker-specific environment variables
Expand All @@ -169,12 +167,9 @@ worker:
# Number of tasks to claim per poll cycle
HINDSIGHT_API_WORKER_BATCH_SIZE: "1"
# Bound per-worker task and DB write concurrency for the default embedded DB.
# consolidation and retain each get a reserved slot; the remaining slot is
# shared by reservation-less task types (file_convert_retain,
# refresh_mental_model, graph_maintenance, import_documents). Keep
# MAX_SLOTS one greater than the sum of reservations below or the shared
# pool collapses to zero and those task types silently stop running.
HINDSIGHT_API_WORKER_MAX_SLOTS: "3"
# consolidation and retain each get one reserved slot to avoid unbounded DB
# pressure from either queue while the embedded DB drains backlog.
HINDSIGHT_API_WORKER_MAX_SLOTS: "2"
HINDSIGHT_API_WORKER_CONSOLIDATION_MAX_SLOTS: "1"
HINDSIGHT_API_WORKER_RETAIN_MAX_SLOTS: "1"
HINDSIGHT_API_RETAIN_MAX_CONCURRENT: "1"
Expand Down