During my tests, I also encountered the issue where entries occurring in close temporal succession are more strongly linked to one another. But there are still weak connections that link based on meaning. That’s not a bad thing, or it could even be an advantage. The memory system is designed for an embodied agent capable of retrieving scenes (comprising episodes, generalizations, and transitions) while attention-based edges enable the formation of more nuanced associations. I have now implemented “distance-residual attention” to attenuate the influence of temporal proximity.