I'll add another "Welcome Joe". If this place gets a bit too "California" on you just give a shout, there are a couple other East Coasters around here.
Just to give some equal time, some other online homebrew sites are
http://www.morebeer.com and
http://www.williamsbrewing.com. With that said, do some Googling and find a homebrew store close to you and also look around for a nearby homebrew club. Supporting your local shop is just The Right Thing To Do, you can save a bit on shipping for large or heavy items like carboys, it's good to know where to run when you are all ready to brew but your yeast didn't proof or you broke your hydrometer or you otherwise need something in a hurry, but mostly it's just good to have an occasional face-to-face with another brewer. Web sites, chat rooms, and forums only take you so far.
To underscore BRB's comments - it's generally best to start off with a basic brewing kit rather than try to purchase all the individual pieces because the cost is competitive and you're sure to discover on your first brewing day that you forgot something. Good starter kits are anywhere from $60 - $150 depending on whether you get a plastic or glass fermenter and what optional equipment is included. Most basic kits do not include a kettle, so plan on getting a 12-16 quart pot and a big spoon if you don't have them already. I also agree that an extract ale ingredient kit would be your best start before trying to brew from a recipe. You'll eventually be creating your own killer all-grain recipe, but it's usually best to learn to walk before running a marathon.
I'm currently working up to a jog ...
-JAI
