I'm going to answer my own question, for the benefit of others.
The secret sauce as the K-Lite Codec Pack. You can get from here:
http://www.codecguide.com/about_kl.htmAfter installing the "Full" package, my .mp4 files will play in the included basic player, or in Windows Media Player.