Sometimes, you just gotta decide that gameplay is a little more important than immersion. Most people don't want to play rounds for more than two hours at a time, and that's fine. Often times, people get removed from the round permanently, and as much fun as being re-inserted as whatever wacky flavor-of-the-round is, most of us want to play the main part of the game. That's why the vote exists, to keep rounds from dragging on unnecessarily. Now, if something really cool is going on, and everyone is happy with the round going on, it can, if a majority of people vote to extend the round. But if most people vote for the round to end, that means they want the round to end, and removing the vote just removes the agency of most players in favor of the small handful who have crazy ideas, and anything even remotely feasible to do really shouldn't take more than an hour or so to set up.
My two bits.