I think IP address blacklisting/whitelisting won't work. And it's too much hastle to maintain them manually. A kind of PoW/PoS/ProofOfSomething scheme would be more viable.
Yes, you are right. It will probably be a lot of effort to maintain the blacklist. What do you think of my scheme to value user votes?