Oscillating State-Space Models: Or, A Robot Does TheDishes

Some early experimentation suggests that these new ideas might replace the transformer as a fundamental neural network design.