Players stay in-game, even after leaving. They can even count as a party. I have joined parties made up of players that have already left.