Ask HN: How to ask questions to LLMs privately?
It’s an incredible time we live in. We can ask any question we want the previously we may have been embarrassed to ask and get an answer and learn and improve ourselves daily. Just one thing I can’t wrap my mind around is privacy. We all seem to be asking sometimes stupid and some times incredibly personal questions to these llms. Questions that we may not even speak out loud from embarrassment or shame or other such emotions to even our closest people. How are these companies using our data ? More importantly what are you all doing to protect yourself from misuse of your information? Or is it if you want to use it you have to give up such privacy and uncomfortableness ? What are some solutions available today that people are using there are somewhat privacy, preserving or fully privacy preserving?
Self host using open models. There are multiple ways to do it but one pretty straightforward way is to run Ollama[1] and - if you want web chat - OpenWebUI[2].
[1]: https://github.com/ollama/ollama
[2]: https://github.com/open-webui/open-webui
The same as its always been: run your own.
To give folks more of a toehold: LM Studio is a cross platform interface that makes it relatively easy to play with local models.
https://lmstudio.ai
Check HugstonOne. The definition of privacy.