Commit daa42ec
committed
fix(datastore): compare resource version under COLLATE "C" consistently
KSUIDs are base62 with mixed case and only sort chronologically under
byte-order. Several subqueries on the resources table compared r2.version
against r1.version without an explicit collation, so Postgres and Aurora
fell back to the database's locale-aware default. In locale order 'U' > 'f'
while in byte order 'U' < 'f', so a chronologically-later KSUID can lose
the "is this the latest version?" check to an earlier KSUID that happens
to have an uppercase letter in a locale-significant position.
Observed effect: the resources table keeps every version of every resource
(including a terminal delete row after destroy). LoadResourcesByStack and
the CountResources* variants use a "latest row is not a delete" filter
via a NOT EXISTS subquery. Under locale ordering, a prior update row
with an uppercase-in-position-N version can sort ahead of the later
delete row, the filter picks the update as latest, operation != delete
passes, and the destroyed resource leaks back as managed. That's how
a lgtm-task row from a long-destroyed stack reappeared in a reconcile
plan as a spurious delete.
COLLATE "C" is already used for the same comparison in many queries in
these files — the affected subqueries were the ones that slipped through.
Postgres + Aurora only; SQLite's default collation is byte-order so the
bug doesn't manifest there.
Adds a postgres_test that inserts two rows for a single ksuid — an
earlier update with a locale-greater version and a chronologically-later
delete with a locale-lesser version — and asserts LoadResourcesByStack
returns nothing. Skips when no local Postgres is available.1 parent f7b27ce commit daa42ec
3 files changed
Lines changed: 92 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1159 | 1159 | | |
1160 | 1160 | | |
1161 | 1161 | | |
1162 | | - | |
| 1162 | + | |
1163 | 1163 | | |
1164 | 1164 | | |
1165 | 1165 | | |
| |||
1194 | 1194 | | |
1195 | 1195 | | |
1196 | 1196 | | |
1197 | | - | |
| 1197 | + | |
1198 | 1198 | | |
1199 | 1199 | | |
1200 | 1200 | | |
| |||
1253 | 1253 | | |
1254 | 1254 | | |
1255 | 1255 | | |
1256 | | - | |
| 1256 | + | |
1257 | 1257 | | |
1258 | 1258 | | |
1259 | 1259 | | |
| |||
1304 | 1304 | | |
1305 | 1305 | | |
1306 | 1306 | | |
1307 | | - | |
| 1307 | + | |
1308 | 1308 | | |
1309 | 1309 | | |
1310 | 1310 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1602 | 1602 | | |
1603 | 1603 | | |
1604 | 1604 | | |
1605 | | - | |
| 1605 | + | |
1606 | 1606 | | |
1607 | 1607 | | |
1608 | 1608 | | |
| |||
3257 | 3257 | | |
3258 | 3258 | | |
3259 | 3259 | | |
3260 | | - | |
| 3260 | + | |
3261 | 3261 | | |
3262 | 3262 | | |
3263 | 3263 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
| 11 | + | |
11 | 12 | | |
12 | 13 | | |
13 | 14 | | |
| |||
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| 20 | + | |
| 21 | + | |
19 | 22 | | |
20 | 23 | | |
21 | 24 | | |
| |||
54 | 57 | | |
55 | 58 | | |
56 | 59 | | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
0 commit comments