julesh (@julesh@mathstodon.xyz)

If I understand correctly, recurrent neural networks and transformers embody the 2 broad possibilities for sequence recognition: RNNs encode data in time, transformers encode data in spaceI wish I could know whether the cortex works fundamentally more like RNNs or more like transformers, or if it's the wrong question and the answer is a secret third option.