Cost Estimate

[luis-gasparschroeder]

Description

vCache should give a cost estimate.

Impact

• Who: End user
• What: Cost estimate
• Why: Value add

Proposed Solution

Stats engine should output approx cost savings based on model and input/output.

Acceptance Criteria

• Followed coding conventions
• Implemented or updated tests
• Input: Model, token input/output
• Output: Cost without cache, Cost with cache,...

Risks & Dependencies

That this works across models

Additional Context

--