1. You don't need an expensive turntable to start.
2. You don't need an expensive cartridge to start.
3. Make sure your amp/reciever has a phono line-in. If it does...
4. Buy a cheap/moderately prices new turntable, one at the low end of your budget. It should come with a cartridge/needle. Or...
5. Go out and do some thriftstore or garage saling. Buy a turntable that you know works. Preferable one that will not require a $100 cartridge/needle replacement to start using. However, DO replace your cartridge/needle. Could be as low as $10 (US).
6. Set it up and have fun.
Even though most people don't realize it, there are more turntable options availabe now than ever before. Unfortunately, the fact that most people don't know has largely driven them, and the people who purchase them, into two groups.
A. Audiophiles/DJs who spend LARGE sums of money on their turntable setups. For DJs, it's required that they spend at least enough to have something similar to what they'll be using in clubs so they don't look like an idiot at a gig. For audiophiles it's usually about being as geeky and snobbish as possible so they can look down their nose at you and scoff at your lack of knowledge/expensive equipment. Some of these people spend, literally, tens of thousands of dollars (and sometimes even more) on a turntable/sound system setup. Does it sound different? Duh! Of course it does! Is it necessary? Hells no! And for me it very quickly reaches a point where the fun of just throwing on some records during dinner and some wine with friends is no longer fun.
B. People who don't care about any of that and just want to play some records. People who have inherited a stack of vinyl and aren't sure what to do with it (happening a lot, actually). People who have rediscovered the joy of holding them and looking at their cover art. People who want to reminisce and remember "the good old days". People who still have their records from back in the day. And people who are just discovering them. Whithout meaning any insult, this is you.
Falling into both of those categories may or may not be people who believe the sound quality is best on vinyl. For the moment, that's neither here nor there.
The truth is that there are pieces of vinyl in this world approaching the number of ants living on it. There is A LOT. Far more vinyl has been pressed in the last 100 years (and continues to be pressed) than cds. And with the internet you can get cheap vinyl from all over the world. Sooo...
Don't stress about it. Because if you do it will make your head spin.
Get an inexpensive player, make sure it has a new cartridge/needle, get some vinyl - cheap or otherwise - and just have a good time. Figure out if it's really something you want to invest a lot of time and money into before it becomes stressful and the fun factor disappears.
Yes, it's true that it won't be as good for your records, but only marginally so. Yes, it's true that the sound won't be as prestine, but I don't believe that's what you're caring about at the moment, nor should it be. A heavy base does make a difference. The material your tone arm and needle are made out of does make difference. But a one pound, 100% plastic turntable STILL plays records. A lot of the knowledge and advice people have given is absolutely true, it just doesn't matter if all you want to do is play some records and have a good time.
The one thing I totally agree about is finding something with a dust hood/cover. If you don't buy something with a hood/cover, be sure to always put your records away when you're done playing them.
Apologies to everyone for the long post. I just think listening to music should be as close to pure fun and enjoyment as possible and any turntable conversation seems to quickly turn into anything but that. I guess it's a personal pet peeve.
---------------------------------------------------------------------
For the record (hah, puns!), I have a coffin with two Technics SL-1200MK2 (which replaced my old Technics SL-1200s, and I still like them more than all the other Technics) and a Behringer DDM4000 mixer. That setup is currently running through my home stereo system (technical details spared). It was once used professionally, now it's just FOR FUN. I used to own a Clearaudio Ovation that I bought used from a friend when he upgraded to something even more ridiculous. I loved it, because the sound was nice AND it had a 78 rpm setting. But it started doing this thing where it wasn't keeping steady pitch (changing speed so it sounded slightly warbly). I took it to a "repair guy" and ended up selling it to him, still broken, for what I had paid for it. I've also owned any number of inexpensive to moderately high priced turntables over the last 30 years (all of them played records just fine, btw). Right now I've got a funky old Zenith that I bought at a garage sale just to play those old classical 78s (which you can buy for ridiculously cheap).
Edit: Snubbish? Snubbish you say?
[Edited 11/25/12 20:32pm]