- Joined
- Sep 15, 2014
- Messages
- 4,370
- Likes
- 8,896
- Degree
- 8
If you like A.I. but don't want your queries going to random servers and being saved for who knows how long this is for you.
The biggest problem with A.I./LLM like ChatGPT is the privacy aspect, since all the data gets sent to ChatGPT/Microsoft and their servers. What happens afterwards is anyone's guess.
That's where Private / Local LLM Tools come into play. You download the open source LLM libraries or whatever within your desktop APP and can run queries privately. They all have Linux, Mac OS X, and Microsoft Windows versions.
Note: AnythingLLM - this one lets you upload your own PDFs and documents and then run questions and queries against the documents. The tests I ran have been extremely successful so that's something to note.
I actually know very little about each model, like LLAMA or DeepSeek. I'm not an expert in any of this but as I continue to explore I'll post updates.
These are some of the LLM for Desktop that you can use to run your queries locally and privately. Most of the credit for this goes to @SmokeTree:
--
AnythingLLM: https://anythingllm.com/
This one allows you to upload PDFs and other documents then ask the A.I. questions against the documents.
--
LM Studio: https://lmstudio.ai/
--
Msty: https://msty.app/
--
Ollama: https://ollama.com/
(I haven't tried this one)
--
Since they all run locally and privately, none of the above can tell you what time it is in London at the moment unless you enable them. So far I have not been successful in enabling that for any of them, but I haven't tried that hard.
They all can code pretty decently as well.
The biggest problem with A.I./LLM like ChatGPT is the privacy aspect, since all the data gets sent to ChatGPT/Microsoft and their servers. What happens afterwards is anyone's guess.
That's where Private / Local LLM Tools come into play. You download the open source LLM libraries or whatever within your desktop APP and can run queries privately. They all have Linux, Mac OS X, and Microsoft Windows versions.
Note: AnythingLLM - this one lets you upload your own PDFs and documents and then run questions and queries against the documents. The tests I ran have been extremely successful so that's something to note.
I actually know very little about each model, like LLAMA or DeepSeek. I'm not an expert in any of this but as I continue to explore I'll post updates.
These are some of the LLM for Desktop that you can use to run your queries locally and privately. Most of the credit for this goes to @SmokeTree:
--
AnythingLLM: https://anythingllm.com/
This one allows you to upload PDFs and other documents then ask the A.I. questions against the documents.
--
LM Studio: https://lmstudio.ai/
--
Msty: https://msty.app/
--
Ollama: https://ollama.com/
(I haven't tried this one)
--
Since they all run locally and privately, none of the above can tell you what time it is in London at the moment unless you enable them. So far I have not been successful in enabling that for any of them, but I haven't tried that hard.
They all can code pretty decently as well.