Avengers didn't stay together