I never understood it in the USA, when you go and buy anything you have to pay tax on top of it!

What's that all about? I've been to the USA many times and worked there, but still don't understand why my bag of crisps goes up in price at the checkout.