For most hams, it is a simple answer: BOTH!
As for which to get first, it depends on who you talk to. On the air, that is. If you are looking for a very versatle radio for mostly local communications and repeaters, then VHF/UHF works and is often less expensive. You can get a Wouxun 2m/440 HT with various toys and antennas for well under $200. Mag-mount "dual-band" mobile antennas start at around $15 and are adequate for local simplex and repeaters. If you use any of the internet-linked repeaters you can have pretty wide coverage with modest VHF/UHF gear.
10/12M tend to be a bit more expensive, not as often used for local communication, and only useful for DX under favorable band conditions. Antennas are also as expensive, or more expensive than VHF/UHF, and much larger to be as efficient. A 10/12M radio is very limited compared to a multi-band HF rig that may not cost much more.
Most hams start out with 2m/440, and then move on to HF as they get more interested and upgrade their license. You just seem to get more for your money.
My two-cents worth,
Dave_W6DPS