www.writingonyourpalm.net . The main guy has extensive experience with Palms and Pocket PCs.
I'm personally pleased with my Palm Zire 72. Since I quit smoking a couple of years ago I seem to be upgrading every year. (Much cheaper!)
ON EDIT: THIS MODEL COMES ENCASED IN A BLUE, RUBBERY KIND OF EXTERIOR. NOTE THAT IT *WILL* RUB OFF IN BITS OVER TIME. LUCKY FOR PALM I PREFER THE WAY IT LOOKS--ALL METALLIC--WITH ALL THE BLUE RUBBER PICKED OFF.
The Zire 72 may be too much for your needs, though. 1 megapixel camera, videocamera, mp3 player, etc., check palm.com if you want more information, but I think the Tungsten E might be right up your alley:
http://www.palmone.com/us/products/handhelds/tungsten-e /. There are universal keyboards out there; make sure to get one of those, and not a proprietary one. Also, I don't think there have been any PDAs that will take AAA batteries since Handspring's Visor line folded about three years ago.
Just a note that I have some experience with Pocket PCs. My company (sales-oriented) recently switched focus from laptops to Pocket PCs (although laptops are still necessary, we don't need to take them on the road any longer). The machines are all right, and for our hardware purposes (i.e. connected scanners), a Palm just wouldn't fit the bill. Having said that, I much prefer the interface of Palm applications, and therefore will be taking my Palm as well as the company's PPC along with me.