{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreicmbt6acnohvpbhqcahkcr23tpxwjwusrqdm4znyym2veu24bjole",
    "uri": "at://did:plc:haakkg7y3xdghcdmprxeexso/app.bsky.feed.post/3mlkvrryz3e62"
  },
  "path": "/t/layering-local-llm-over-commercial-llm-for-privacy/13843#post_5",
  "publishedAt": "2026-05-11T08:38:10.000Z",
  "site": "https://discuss.privacyguides.net",
  "textContent": "For a counselling service, you’d need a fairly decent model, and that would be an issue. I think in the future (give it time) a SLM with specific domain knowledge (eg in psychology) could be useful.\n\nI do not think you can just use some general LLM and expect the right result, especially if it doesn’t have proper rails for what it should say. LLMs logic processing often will agree with you on things where you’re wrong and in complex human-to-human relationships this leads people to believe they are in the right when they are not in regard to their behavior.\n\nI also don’t believe you can sanitize the input into the cloud LLM, really only way to do it is either local or public. Sanitation might introduce contextual changes which means you’re not telling the cloud LLM what you really mean.\n\nPrince:\n\n> Since open source LLMs are advancing rapidly, I’ll hold off until I’m able to run one entirely locally. Thanks again for the insightful ideas! I appreciate you taking the time to share your perspective.\n\nIdeally if you can hold off until DDR6. This is going to be a major game changer for local LLMs. Also by then we will have video cards with a decent amount of VRAM standard.",
  "title": "Layering Local LLM Over Commercial LLM for Privacy?"
}