It's just another of the dozens of types of tax we pay over the years when growing a business. But it can work in your favour at times being VAT registered.
Grumpy is right though. It's the buyer paying it to the seller (as there will be VAT on your bills from the suppliers) - but you're clearing that bill. So you're giving it to the supplier, and then he pays it to HMRC. Though if you were VAT registered, the amount you paid on that bill, you'd claim back each quarter.
It's money floating around that in the end, gets paid for by the end user who cannot claim it back. So your customers who sort of pay your wage, pay you money which you pay to the supplier which includes vat, he claims it back from the government, so it's the end customers that can't claim it back who has to stand the costs. All the VAT registered people involved just pass it around for a while. Sort of.