Title: Could Tagalog’s Focus System Inspire a Higher-Level Attention Mechanism in Transformers?

I’ve been thinking about a possible architectural idea inspired by linguistics, and I’m curious what researchers here think. Transformer models rely heavily on soft attention — a continuous weighting mechanism that distributes focus across tokens. This works remarkably well for capturing statistical dependencies and long-range interactions. However, in linguistics, some languages (notably Tagalog and other Philippine-type languages) encode something quite different: an explicit “event pivot” system. Through symmetrical voice morphology, Tagalog grammatically selects which participant (actor, patient, location, beneficiary, etc.) becomes the structural center of the event — without demoting the others to passive status. In other words, instead of just softly weighting information, the language makes a discrete structural choice about the event’s cognitive anchor. This made me wonder: Could future architectures benefit from a higher-level “pivot selection” layer on top of soft attention? For example: * First select an event-level structural center (actor-focused, patient-focused, etc.) * Then allow standard attention to operate within that pivoted frame This would combine: * Hard structural anchoring (discrete role selection) * Soft probabilistic attention (continuous weighting) In many complex reasoning cases (multi-entity narratives, pronoun resolution, legal text, multi-hop logic), the challenge is not just weighting information — but stabilizing the event center during inference. I’m not suggesting copying Tagalog morphology into models. Rather, I’m wondering whether Philippine-type focus systems hint at a cognitive principle: that intelligent systems may require explicit structural anchoring in addition to distributed attention. Has there been work on hierarchical pivot selection above attention layers? Or event-frame-level routing mechanisms beyond token-level attention? Curious to hear thoughts from both NLP and linguistic perspectives.