There is nothing cuter than a baby kitten! Congratulations...he's a doll!
As for the vet, I'd take him first thing. They'll get you on a schedule for his vaccinations and may perhaps recommend a certain type of food.
If you plan on letting him go outside, I'd ask the vet about micro-chipping him too.
But, I gues the first thing you'll need is a litter box, some food, and a few toys. Plus a good sense of humor! Kittens can be so mischevious....espcially at 3 or 4 in the morning. Every kitten I've ever had has been fascinated with my hair while I'm asleep.
Have lots of fun with your new baby and, again, congratulations!