{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreia7dqtp66jasjjxo3bmu25zdvcxygiv4b3go5mn6442pwntza76zq",
    "uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mnpq3par2so2"
  },
  "path": "/t/holo-hsl-a-100m-change-rate-based-multimodal-toy-model-on-a-single-rtx-4070/176599#post_1",
  "publishedAt": "2026-06-07T16:19:21.000Z",
  "site": "https://discuss.huggingface.co",
  "tags": [
    "ggunio/holo-demo-space",
    "https://holo-demo-p5txmh4dda-as.a.run.app"
  ],
  "textContent": "Hi everyone,\n\nI’d like to share a small personal research POC I built: HoLo/HSL.\n\nHoLo is a ~100M parameter toy-scale multimodal model trained on a single consumer GPU (RTX 4070).\nIt is not meant to compete with existing models, and the generation quality is still very rough. At this stage, the goal is simply to test whether the core architecture can work.\n\nThe main idea is to explore whether change-rate, rather than tokens, can serve as a shared signal substrate across modalities such as text, image, audio, and video.\n\nWhat currently works:\n\n  * byte-native input/output pipeline\n  * text, image-frame, audio, and early video generation plumbing\n  * closure signal for distinguishing end-of-content vs end-of-window\n  * multimodal signal-space visualization\n  * phase/affect channel experiments\n  * external memory/offload toy experiments\n  * synthetic sensor-fusion toy experiments\n  * a small public demo showing the generated signal trajectory\n\n\n\nImportant caveats:\n\n  * This is a feasibility study, not a benchmark claim.\n  * The model is very small.\n  * Generation quality is currently poor.\n  * Some experiments are toy-scale.\n  * I am not claiming superiority over existing systems.\n\n\n\nStill, I wanted to share it because the full pipeline now runs end-to-end, and I think the change-rate / signal-substrate direction may be interesting for multimodal research.\n\nSPACE : ggunio/holo-demo-space\n\nPaper:\n\n[Zenodo link](https://doi.org/10.5281/zenodo.20581805)\n\nDemo: https://holo-demo-p5txmh4dda-as.a.run.app\n\nGitHub:\n\n[GitHub link](https://github.com/Woojiggun/holo-hsl)\n\nI’d be happy to hear feedback, especially on the architecture, evaluation design, and possible next experiments.",
  "title": "HoLo/HSL: a 100M change-rate-based multimodal toy model on a single RTX 4070"
}