{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihvy2svuz6anbkbad3swheeyspc3zhelmfs2cv64oztzqihj45koe",
    "uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mqkghw6p5jx2"
  },
  "path": "/t/alphaavatar-v0-6-4-a-self-hostable-realtime-multimodal-assistant-runtime-with-shared-perception-and-env-memory/177684#post_10",
  "publishedAt": "2026-07-13T18:15:03.000Z",
  "site": "https://discuss.huggingface.co",
  "textContent": "Hi Knack — thank you, this is extremely helpful.\n\n“Absence is only information if you can prove you were looking” is probably the clearest formulation of the problem I have seen. It also reveals that absence detection cannot be implemented only at the Memory or proactive-policy layer. The perception/runtime layer must first be able to provide an observation-coverage receipt: what source was active, what time window was covered, whether sampling was continuous enough, and whether the result was genuinely empty rather than simply unavailable.\n\nThat suggests a useful distinction for AlphaAvatar:\n\n  * positive observation: the runtime observed something;\n\n  * negative observation: the runtime actively checked a sufficiently covered window and did not observe the expected event;\n\n  * missing observation: the runtime cannot make a claim because coverage was incomplete or unavailable.\n\n\n\n\nOnly the second case should be allowed to produce an absence candidate.\n\nYour point about probability estimates is also reassuring. I agree that a bounded, monotonic, auditable ranking signal is more useful in practice than pretending to have a well-calibrated probability over sparse person-model dimensions. Capping surprisal and reducing its influence when the underlying dimension has little evidence both seem like sensible safeguards.\n\nThe separation between surprisal, salience, and provenance is especially valuable. They answer different questions:\n\n  * surprisal: how much did this update the model?\n\n  * salience: how retrievable should it be?\n\n  * provenance: where did it come from, and how much authority does it have?\n\n\n\n\nCollapsing those into a single importance score would make policy decisions difficult to inspect.\n\nI also strongly agree that surprisal should rank candidates, never decide outcomes. Whether something becomes durable memory, updates a current-state projection, triggers reflection, or causes proactive interaction should remain a runtime policy decision.\n\nThe reflection loop failure you described is particularly relevant to AlphaAvatar’s future architecture. I will need to make the distinction between primary evidence and derived content explicit:\n\n  * observations, user statements, and raw tool results are evidence;\n\n  * summaries, reflections, inferred claims, and absence candidates are derived artifacts.\n\n\n\n\nDerived artifacts may reference evidence and produce new claims, but they must not increase the evidence count that triggers further reflection. Otherwise the system can quietly become self-referential without producing an obvious runtime error.\n\nThe Shannon/Knack example also makes provenance more concrete than a generic confidence score. A user-stated claim, a self-description, and a reflection-generated inference must not compete in the same slot with equal authority. Source role and authority should participate directly in conflict resolution, and a self- or reflection-derived claim should never silently overwrite an explicit user statement.\n\nThis discussion is helping clarify several future boundaries for AlphaAvatar:\n\n  * observation coverage before absence inference;\n\n  * evidence versus derived artifacts;\n\n  * surprisal as ranking rather than policy;\n\n  * source-aware claim authority;\n\n  * class-specific retention and decay;\n\n  * reflection triggers that count only primary evidence.\n\n\n\n\nAnd yes, keeping this discussion public makes sense. The examples and failure cases are likely useful to other people working on persistent assistants as well.\n\nThank you again for sharing the lessons from your own implementation. They are exactly the kind of subtle failures that are much easier to prevent architecturally than to diagnose later.",
  "title": "AlphaAvatar v0.6.4: a self-hostable realtime multimodal assistant runtime with shared perception and ENV memory"
}