Use Media Source Extensions with raw video frames

10
votes

I'm trying to do live realtime streaming of H264 video from a server to the browser. The H264 stream is not wrapped inside a MP4 container, but instead it finds it's way to the browser (through web sockets) in the form of raw H264 frames.

The question is: Is it possible to feed the media source extensions with raw frames instead of a file container such as MP4 or WebM?

The mp4 solutions such as MPEG-DASH do not give me the flexibility that I need with regard to low latency, multiple video synchronization and other elements that I need to achieve.

1
videovideo-streaminghtml5-videoh.264media-source
The question is still relevant... – galbarm
did you find any way to stream raw h264 frames? – thunderbird
No. I stopped the research for the time being but I'll get back to this later. I'll share my conclusions here. – galbarm
It's impossible to use MSE for raw H264 but I found a way streaming live h264 with relatively low latency. The following 2 questions I asked will show you how: stackoverflow.com/questions/30617673/… & stackoverflow.com/questions/30868854/… – galbarm

1 Answers

4
votes

MP4 boxing is required for MSE, and far too cumbersome to implement in a browser.

With raw h264, you can try to use Broadway, a h264 decoder (via emscripten) implementation for the browser.

See a real time example in my dedicated project https://github.com/131/h264-live-player