{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihmzp5w2bkol4p7gac5vvym73upaamlehpo4arfwgg24phdhhquxy",
    "uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mmcgsms6jzj2"
  },
  "path": "/t/prompt-engineering-the-protocol-of-intent-the-theoretical-foundation/175880#post_9",
  "publishedAt": "2026-05-20T15:39:33.000Z",
  "site": "https://discuss.huggingface.co",
  "textContent": "narrowing the decision space is one of the things that my prompt engineering series is focused on. however…\n\nin order to understand why 99% accuracy my not be possible, its important to understand where those hallucinations come from.\n\nand the first step to doing that is understanding that there are 2 intended out put vectors for a conversation\n\n  1. definite responce\n  2. explored respnce\n\n\n\ndefinite response is something like if you want an email made, and you already know the target, the subject, the tone, the specified contents, etc.\nexplored responce is something i deal with more often when you are exploring a topic of conversation and you dont know where it is going to go, like asking a question you dont know the answer to.\n\nmost hallucinations seem to come in the second category from my observations.\none might call that evidence, and it is, but i dont do empirical studies, so the evidence is still observational from me.\nbut in one of my prompt engineering papers i point out that in exploritory conversation one what is known as conversational entropy.\na useful way of understanding and measureing that entropy is imagining that before you start a conversation with an LLM that entropy is at 99%.\none of the goals of prompting at all is narowing the entropy vector.\n\nbad promopting takes dozens of prompts to move from 99% to 70%\n\nmost conversations want to be around or under 30%.\n\nthe direct outputs happen around 10% for example.\n\nwhat does all this mean? the AI has access to ALOT of information. that is not a question. however, what it also has access to is every word in the english language (for example) and no built in direction for conversation. that is actually the minimum that the human in the conversation provides. how does this information tie together for this conversation.\n\nwhen the conversation is fresh, and the entropy is high, the halucinations are more likely to happen, then the halucinations are more likely. as the entropy lowers the likelyhood of halucination.\n\nand now we look at the most prominant reason halucinations happen is due to agents being trained for completion in the short term.\nwhat this looks like is - answer to question\nnot - correct answer to question\n\nnow, in the work i do, i had to develop guardrails, because strict rules turned it in to an execution agent and not a conversation/ exploration agent.\n\nand this matters for me because most my work is either creative (so i only know then intended direction, not necessarily the exact content) or im answering questions that have no exsisting answer (something else that does not have a predefined output). because of this, in most scenarios, a pure execution agent is of no use.\nin the back round a pure execution agent can handle handoffs and the like, but for pure exploration (like Protocol of intent) or new problem solving, i need an agent with room for exploration. if if there is no conversational exploration, that cannot happen.\nso those guardrails look something like - ‘done do this, do that; and here is 3 reasons why’\n\ni have been useing this system successfully for months. and not with 1 agent. i have been coordinating single projects across 5 agents, 4 of which have completely different architectures and training regiments.\nso it works, and it works for me. does the process i have still have issues? yes, however those issues can be isolated and addressed. which is arguably more important, and what i have been building to on this responce.\nknowing that an agent can and will hallucinate is important, but what is of equal importance is being able to identify what type of hallucination it is, so that one can then mitigate those types of halucinations.\na system that fails is almost guaranteed after a certain level of complexity. the real issue is whether it will fail in understandable ways that arent catastrophic.",
  "title": "Prompt Engineering - The Protocol of Intent: The Theoretical Foundation"
}