Taken from the HTML 5 spec <video> and <audio> are now documented and have landed in Firefox 3.1 (currently available for developers and testers in the nightly builds). These will play Xiph's Ogg Vorbis and Theora media which are both open and royalty free.
Now web authors can include media without requiring users have plugins or proprietary players.