The muxer prebuffers packets until each stream has been seen so a proper header can be written. However if mencoder inserts "repeat last frame" chunks with len == 0 before the encoder is configured and first real frame is output or a broken file starts a stream with such frames, then muxer won't find needed info for writing initial header.