Proxying == Logging suspicions
guard-sdk does the same locally https://guard-sdk.js.org
Its basic function is something you could vibe code in a few minutes :-)
Not to mention the whole privacy issue.
Openrouter offers per API-key spending limits.
Came here to say this. And you get access to lots of models!
Made an easy tool to install and manage those limit keys. Even has a gui.
https://github.com/day50-dev/limit-model-spending
> The Service is provided "as is." We are not liable for downtime, data loss, or errors in token counting or cost calculation.
lmao
We self-host LiteLLM which allows to set the budget per day/week, and it's free.
The pricing is very steep. I can see a market for this as an application with one time purchase but as a subscription?
LiteLLM already provides this feature, no need of another proxy
9 comments:
Proxying == Logging suspicions
guard-sdk does the same locally https://guard-sdk.js.org
Its basic function is something you could vibe code in a few minutes :-)
Not to mention the whole privacy issue.
Openrouter offers per API-key spending limits.
Came here to say this. And you get access to lots of models!
Made an easy tool to install and manage those limit keys. Even has a gui.
https://github.com/day50-dev/limit-model-spending
> The Service is provided "as is." We are not liable for downtime, data loss, or errors in token counting or cost calculation.
lmao
We self-host LiteLLM which allows to set the budget per day/week, and it's free.
The pricing is very steep. I can see a market for this as an application with one time purchase but as a subscription?
LiteLLM already provides this feature, no need of another proxy