Sonic dynamic model loading#25

Draft

trevin-lee wants to merge 34 commits into

fastmachinelearning:masterfrom

trevin-lee:SonicDynamicModelLoading

Commits on Oct 13, 2025

RetryAction compiles

Martin
authored and
trevin-lee
committed
Include RetryAction in SonicClientBase

Martin
authored and
trevin-lee
committed
Update PR comments

Martin
authored and
trevin-lee
committed
PR comments, fix fillDescriptions

Martin
authored and
trevin-lee
committed
rebase 15_1_0_pre6

Martin
authored and
trevin-lee
committed
Add update server function for client

Martin
authored and
trevin-lee
committed
Add test for Triton retry action in BuildFile.xml
trevin-lee
committed
Implement retry logic in RetryActionDiffServer and add connectToServer method in TritonClient. Update BuildFile.xml and fix formatting in header files.
trevin-lee
committed
Add RetryActionDiffServer class documentation, implement testing constructor for TritonClient, and update BuildFile.xml to include Catch2 for testing.
trevin-lee
committed
SonicTriton: implement retry action against different server; update tests; remove old cfg
trevin-lee
committed
Refactor RetryActionDiffServer to utilize TritonService for server selection; remove unused parameters and improve documentation.
trevin-lee
committed
rebase 15_1_0_pre6

Martin
authored and
trevin-lee
committed
Fixes to compile

Martin
authored and
trevin-lee
committed
PR comments

Martin
authored and
trevin-lee
committed
Move retry options to customize.py

Martin
authored and
trevin-lee
committed
more clean ups

Martin
authored and
trevin-lee
committed
First draft for server health

Martin
authored and
trevin-lee
committed
remove redundant

Martin
authored and
trevin-lee
committed
Use getBestServer in RetryDiffServerAction

Martin
authored and
trevin-lee
committed
Add dynamic model loading and unloading to TritonService
trevin-lee
committed
Update DynamicModelLoadingProducer to use model input for base class requirements
trevin-lee
committed

Commits on Nov 2, 2025

Commits on Nov 3, 2025

Commits on Jan 7, 2026

Address code review feedback for dynamic model loading
trevin-lee
committed

Commits on Jan 8, 2026

Commits on Jan 28, 2026

Commits on Feb 6, 2026