This has intrigued me too! I can think of many possibilities: earth is totally uninhabitable now. It's able to support the smaller remaining pop. They actually grew so big again that other groups had to set out for other solar systems. Who knows.

Fun to think about though!