I just stumbled across the free FlowPlayer Flash player for embedding videos in a web page. I can’t imagine a more simple solution. It’s just one SWF file and some specific markup for putting it to work on a web page.
Let me know if there is a friendlier open source solution out there. This seems to work well enough.