{
"$type": "site.standard.document",
"bskyPostRef": {
"cid": "bafyreicebq346fkhatfm3r3ej76snhs5kblyby2nnyqw3iuywjmoyuc66e",
"uri": "at://did:plc:haakkg7y3xdghcdmprxeexso/app.bsky.feed.post/3mnrj65eqi3g2"
},
"path": "/t/ai-apps/38394#post_2",
"publishedAt": "2026-06-08T09:25:57.000Z",
"site": "https://discuss.privacyguides.net",
"textContent": "According to the description the model runs on your device. The fact that it is AI doesn’t really matter. It’s still just software running on your device.\n\n* * *\n\nHere is a little bit more Background to understand how these AI services actually work. Let’s take ChatGPT as an example.\n\nIt consists of two parts, “Chat” and “GPT”.\n\n * Chat is the part people interact with. It’s where your information is stored.\n * GPT is the part where AI happens. Your prompt plus all the relevant context already stored in “Chat” is sent to GPT for processing with every prompt. GPT returns an answer which is stored in Chat and becomes part of the context.\n\n\n\nGPT has no memory, it does not learn. It just produces an output for a given input. For GPT to get better, OpenAI has to train a new model, with maybe better methods and definitely more and maybe better data.\n\n* * *\n\nYou could self-host the Chat part with Open Source Software like OpenWebUI and use an API key to use it with GPT. That would give you more control, but not more privacy. Every information GPT needs to produce an output is still sent to GPT every time you write a prompt. OpenAI can store all the information received via their API.\n\nYou can also self-host the GPT part, using an Open-Weights Model like GPT-OSS, Gemma, Ministral or Qwen on vLLM or Ollama-Server. Since those would be running on your own hardware, no information would be sent to any company.\n\nThere are also a lot of applications, that combine all the parts, like “LM Studio”, “Ollama” or the Android App “Ensu”.\n\nWhen Firefox added AI, the best feature they introduced was “Local on Device Translation”, which runs an AI model specialized in language translation on your computer. No third party will get the text you are viewing in your browser, if you are using that translation feature.",
"title": "AI apps"
}