Skip to content

Fix outstanding pre-release issues#25

Open
salcock wants to merge 18 commits into
masterfrom
fix-remaining-prerel
Open

Fix outstanding pre-release issues#25
salcock wants to merge 18 commits into
masterfrom
fix-remaining-prerel

Conversation

@salcock
Copy link
Copy Markdown
Collaborator

@salcock salcock commented May 17, 2026

Specifically:

salcock added 17 commits May 15, 2026 09:28
Also fixed some bugs in the configurable RV and RIS endpoint URLs,
where the env variables were not being loaded before bgpfinder
tries to use them.
Updated routeviews and ris finders to inherit from the BaseFinder
class.

Re-factor main scraping method to be more modular and easier to
understand (with less indentation).
This ensures backwards compatibility with (buggy) behavior in
the CAIDA bgpstream broker.

Data requests with a dataAddedSince of 0 will continue to apply
the "dataAddedSince" that is requested.
Also replace README with something more appropriate for a
complete project.
This ensures optional .env variables are handled properly in
the containers.
This ensures that an initial deployment will populate its
collectors table right away without manual intervention.
 * don't apply result cap to scrapes, only to user requests.
 * ensure scrape timestamps only move forward in time
 * set default collector scrape timestamps to unixts(0)
Remove deprecated "version" from docker-compose.yaml
@salcock salcock requested a review from zbisch May 17, 2026 16:15
Enable use of "host:port,host2:port2" syntax for specifying
multiple hosts.

Automatically add `target_session_attrs=read-write` to connection
strings for the scraper so it doesn't try to write to a readonly
replica.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant