Why don't you make it so that if the person changes their mind... as soon as they leave it removes their vote, and lets them redo their vote if they vote and come back. For if some reason he/she /no'd earlier in the game and it's been an hour and they want to rtv, then let them leave and comeback to redo their vote.
Yes, I'm still around...