"Higher taxes don't necessarily mean less freedom with your money; a collective good that a group largely (or even unanimously) in favor of purchasing might go unpurchased due to the free rider problem."

When you are taxed, that money may or may not go toward something you want to purchase (and many times, the people in the middle and upper classes are paying for programs that they will never use). That money is gone and you have that much less to spend, save, or invest.

You also don't really have a say in where it's spent.