Online Stateful Sequence

A model must process an indefinite event stream one tick at a time and maintain a compact evolving hidden state that can be updated without revisiting past inputs. Which architecture family is most naturally aligned with that requirement?