I started coding a couple of years ago with Java for a desktop app. I really didn't know where to start, so I picked it because it was available. I dabbled in web stuff to have a web site (css, xhtml, php, a little mySQL), and now I am back to that as I need a much better website in order to start marketing.
Many people will probably disagree with me on this, but I found Head Start Java to be a good introduction to Java. I picked it up when I wanted to learn the language. I started a program that focused on drilling a user in Jeopardy questions (I have a huge fascination with Jeopardy), but I didn't really like Swing, so I have added the project to my long list of things that I have started but never finished.
I started with Java Swing (O'Reilly) and Complete Reference (Schildt). It's funny--Java's tough, but I really didn't know the difference because I had no GUI language with which to compare. I had done a lot of (non-GUI) work in Mathematica (which I love), so I found Java cumbersome, but I also was interested by the story of the development of OOP and I figured it was worthwhile to learn.
Now I've found Python, which has a lot of the characteristics of Mathematica, and is very fun. But I have to fix my Java printing issues before I can play with it. (If I can figure out how to deploy it as a GUI desktop app I could better justify spending more time with it).
I still feel like a newbie, though.