External Publication
Visit Post

[Continuation] DRM Transformer: From Open Geometry to Negotiated Geometry in AI Alignment

Hugging Face Forums [Unofficial] May 23, 2026
Source

Hi Jean,

Thank you for the thoughtful response. I agree strongly with your distinction between measuring geometry and designing geometry. In fact, this is exactly the reason I currently maintain two different but related lines of work:

  • Aletheion-LLM-v2 as an epistemic tomography and measurement framework.

  • DRM Transformer as a geometric architecture designed from the beginning to test whether closed/curved manifolds can be induced structurally.

Aletheion-v2 is very useful for measuring internal epistemic states, uncertainty, confidence, phase-like organization, and token-level tomography. But in the current main branch, its geometry remained essentially flat/diagonal. It did not converge to a closed toroidal geometry such as T².

That result is important to me. It suggests that if we only add epistemic heads or measurement layers on top of a mostly standard Transformer, we may be able to observe and diagnose internal geometry, but not necessarily force the model into a closed geometric regime.

The DRM Transformer was built to test the stronger hypothesis: that geometry should not only be measured after the fact, but also designed into the attention mechanism itself.

In DRM Transformer, attention is not based on standard Euclidean dot-product similarity. It is based on geodesic distance under a learned metric tensor:

G(x) = I + U(x)U(x)^T

The model also introduces token mass, gravitational deformation, semantic anchors, gamma scaling, and variable effective dimensionality. So the model is not merely being observed geometrically; it is being trained inside a geometry where curvature and path cost are part of the computational substrate.

This is why I think applying mass and gravitational deformation becomes much more meaningful in a closed or near-closed manifold. In an open geometry, mass can deform local neighborhoods, but the space still has no global closure. In a closed toroidal geometry, deformation has global consequences: trajectories wrap, return, interfere, stabilize, and form persistent cycles. That makes structural alignment much more interesting, because the model is no longer operating in an indifferent open space.

So I would frame the difference like this:

Aletheion-v2 is better for epistemic measurement.

DRM Transformer is better for geometric induction.

Aletheion tells us what geometry is present.

DRM Transformer asks whether we can build the geometry we want from the beginning.

Your point that standard models already exhibit measurable phase dynamics is very important. I do not disagree with that. My concern is that naturally emerging geometry may be partial, unstable, architecture-specific, or not closed enough to support structural alignment. If the goal is only to observe phase regimes, then measurement may be sufficient. But if the goal is to create intrinsic geometric friction, semantic path cost, and negotiation dynamics inside the model, then the architecture itself may need to be modified.

In other words:

Measure first, yes.

But if the measured geometry remains open, flat, or only locally curved, then design becomes necessary.

That is the motivation behind DRM Transformer. It is not meant to replace measurement. It is meant to create a geometry where the kind of measurement you describe can reveal stronger topological structure: persistent cycles, closed trajectories, toroidal signatures, and eventually stable geometric regimes for alignment.

I would be very interested in comparing your phase metrics, especially kappa/desynchronization and readiness states, against DRM Transformer runs. If your measurement framework can detect negotiation, recovery, destabilization, and phase resilience in standard architectures, then applying it to DRM could help answer the key question:

Does a model trained inside a closed or near-closed geodesic manifold exhibit stronger structural stability than a model where geometry only emerges implicitly?

That comparison would be extremely valuable.

So my position is:

The geometry you describe may already partially exist in standard models.

But DRM Transformer is testing whether we can make that geometry explicit, closed, trainable, and structurally useful for alignment.

Just for note, this is aletheion-llm-v2 repo:

github.com

GitHub - gnai-creator/aletheion-llm-v2: Decoder-only LLM with integrated epistemic...

Decoder-only LLM with integrated epistemic tomography. Knows what it doesn't know.

Best, Felipe

Discussion in the ATmosphere

Loading comments...