That’s the solution I take. I use Proxmox for a Windows VM which runs Ollama. That VM can then be used for gaming in the off chance a LLM isn’t loaded. It usually is. I use only one 3090 due to the power load of my two servers on top of my [many] HDDs. The extra load of 2 isn’t something I want to worry about.

I point to that machine through LiteLLM* which is then accessed through nginx which allows only Local IPs. Those two are in a different VM that hosts most of my docker containers.

*I found using Ollama and Open WebUI causes the model to get unloaded since they send slightly different calls. LiteLLM reduces that variance.

Understandable! Apologies if I came across overly chastising towards you specifically.

Instent vs impact is pretty hard in this case. Part of my response is from conversations with friends in STEM fields and the impacts of the male centric nature of the space (comp sci especially) has on them. Especially with how much men self-reinforce that position. It truly is an exclusionary space for them.

I hadn’t read as many comments in this thread yet and there are some well thought out discussions here too, which I’m glad to read.

I do get the joke; Even so, to this post’s credit, that this comment [at time of writing] is +3 is a great representation of their challenges.

The whole point is about people feeling legitimate using the platform. Jokes feeding on the trope “there aren’t women on the Internet” reinforces alienation. It makes sense they wouldn’t feel comfortable if dismissal is the community upvoted response to them -already- feeling unwelcome.

What alternates do you use? I ask this less from self hosting and more for my software teams.

We currently use jira, confluence and gitlab vcs and CI for mostly AWS development. Any non jira (/confluence ) items you’d recommend?

Thank you for your translation services