[this is payback from plasma when i had to tell you the entirety of sasuke's shitty story]

I don't think that's a bad way to look at it. Rather than taking memories from us, perhaps this place conceals them. I told Mister Won this happens often, sometimes without people realizing it.

If something bad happens to them, their mind will help them cope by making them forget. It's still there, deep within them.