Not everyone can run a 300B model on their own. Although, self hosting an OSS webui that talks to the API instead of opening their client (chatgpt.com) has proved viable
Oh so you use chatgpt (or open source models) via them? Are there privacy guarantees and what about uncensored models. We are spiraling into times where asking who owns that big piece of land next to Canada might be highly controversial
That’s what small models with tool calling abilities are for (beside the obvious advantage of live information). Sometimes it works like a charm, sometimes not.
Not everyone can run a 300B model on their own. Although, self hosting an OSS webui that talks to the API instead of opening their client (chatgpt.com) has proved viable
Yea that’s why things like https://openrouter.ai/ exist.
Oh so you use chatgpt (or open source models) via them? Are there privacy guarantees and what about uncensored models. We are spiraling into times where asking who owns that big piece of land next to Canada might be highly controversial
That’s what small models with tool calling abilities are for (beside the obvious advantage of live information). Sometimes it works like a charm, sometimes not.