Believe it or not...

I'm going to Yankee Stadium for the first time in my life next Saturday. Now, I'm not all too familiar with New York, since I've only been there two or three times.
I live in New Jersey, and I was wondering what is the easiest way to get to Yankee Stadium? I assume driving there would not be such a great idea (due to traffic and limited parking spaces). So, for you guys who have made the trip many times, what do you recommend? I'm thinking about taking a train into New York and then hopping on to the subway to get to the Stadium. Does that sound logical? Or should I take a bus?