Good luck with it, you seem to be on the right path, reading links and all for info. My wife and I recently attempted the same thing for a runt kitten (only 2.5 ounces, when the others were nearly 4.5 and 3+). Sadly for little "Tiny", it didn't work. The websites we consulted for info stressed that failure is always a possibility, and not to feel too bad if you can't bring the wee one around, but it still affected my wife pretty hard, she's got a kind heart (plus being pregnant herself, her emotions are on the surface).
The stuff we bought was 'Just Born', from the local PetCo. I think they had the same product for puppies, I don't remember. And no, you can't give them cow's milk, they can't digest it. The websites my wife and I looked at for kittens said you can try goat's milk, however-might hold true for pups as well, but I could be wrong. Also, dunno about puppies, but the info we found for kittens warned that if you exclusively rear the young by hand, there can be behavioural problems.
One last thing...every one of the websites I saw about kittens, and a few I just now looked up for puppies, stresses the importance of weighing them on a small scale, to measure their progress.