If you really want to learn and do so inexpensively, go buy a manual focus 35mm camera.
By using an old camera (1970s - 1980s) you don't have any of the automatic features that can take away from the actual learning process.
By buying a manual focus, manual exposure camera you're forced to know how to properly expose a scene, as well as how to focus properly. With a digital SLR camera, you can take a photo that may be underexposed, overexposed, whatever, and you can just open it in Photoshop and try to correct it. With shooting 35mm film every shot costs you money and, unless you've got a darkroom, it will be your final shot (though some photo labs may correct these problems for you, but ask them not to) so it teaches you to really think about the photo opportunity at hand and how to best capture it.
The best thing is, they're so inexpensive and there's still huge potential in them. I know people that shoot with an old manual focus camera and take pretty good photos. Take a look at any photos taken from the 1970s-1980s and even in the early 90s. If you look at old National Geographic magazines the majority of photos where taken with a 35mm SLR. It's not the same in fashion/advertising because they were shooting medium and large format film for that, but for things like travel photos, photojournalism, wildlife, etc. 35mm SLRs with no automatic controls were used.
The best part is, after you've shot for a while and understand everything and find that you want to upgrade, you then know what you need in a camera and can make a better purchase decision. It doesn't cost you much to get started, so while you're shooting you can save up money for when you do decide to upgrae to a better setup. A 35mm SLR body and lens may cost you $50 from a pawn shop, and cheap film to get you started it also cheap.
Of course, you can always drop the $1,000 up front and buy a DSLR, it's all up to you, but typically people who start from the basics learn the technique better and end up better photographers.
As for learning, go to the library and take out some books. Also,
www.photo.net is a good site for learning.