Brett Gaylor at WebMadeMovies has posted an HTML5 demo of popcorn.js, “a javascript library for manipulating open video on the web.” The demo plays a video while using semantic data in the video to trigger machine-translated subtitles, map lookups, Twitter feeds and other elements on the page. If you’re using a WebM-enabled browser the page serves a WebM video, otherwise it serves an Ogg or MP4 video depending on the browser's capabilities.
See Brett’s post or the popcorn.js wiki page for more info. You can also download the source from the Mozilla github repo.