Bug 5940

Summary:	Spews copious amounts of output even at warning level
Product:	Fedora EPEL	Reporter:	Brian J. Murrell <brian>
Component:	ffmpeg	Assignee:	leigh scott <leigh123linux>
Status:	RESOLVED INVALID
Severity:	normal
Priority:	P1
Version:	7
Hardware:	x86_64
OS:	GNU/Linux
namespace:

Description Brian J. Murrell 2021-03-02 16:17:47 CET

Even when using warning level, ffmpeg is spewing copious amounts of output when reading a particular video stream URL:

$ ffmpeg -loglevel warning -i 'https://cbcvott-a.akamaihd.net/p//44b8224-013ac9ec99e/CBC_THE_NATIONAL-2021-03-01_1867659331897-v1-29234669/CBC_THE_NATIONAL-2021-03-01_1867659331897-v1-29234669__desktop.m3u8?cbcott=st=1614672934~exp=1614759334~acl=/*~hmac=c6aadc8eeacbd00b3c9a8ae6d68bde1f0157176fb009e47379cec76260ec593d' -map 0:0 -map 0:1 -codec:v copy -codec:a copy 'foo.mp4'
[AVIOContext @ 0x2929a00] Statistics: 1435192 bytes read, 0 seeks
[hls,applehttp @ 0x21ff6a0] No longer receiving playlist 2
[NULL @ 0x295b0c0] ct_type:0 pic_struct:0
stream #3:
  keyframe=0
  duration=0.033
  dts=15.906  pts=15.906
  size=4406
[AVIOContext @ 0x294ba40] Statistics: 884728 bytes read, 0 seeks
[hls,applehttp @ 0x21ff6a0] No longer receiving playlist 3
[NULL @ 0x2992a20] ct_type:0 pic_struct:0
stream #4:
  keyframe=0
  duration=0.033
  dts=15.906  pts=15.906
  size=2812
[AVIOContext @ 0x2998f60] Statistics: 568888 bytes read, 0 seeks
[hls,applehttp @ 0x21ff6a0] No longer receiving playlist 4
[NULL @ 0x29ca020] ct_type:0 pic_struct:0
stream #5:
  keyframe=0
  duration=0.033
  dts=15.906  pts=15.906
  size=1706
[AVIOContext @ 0x29c6e80] Statistics: 334264 bytes read, 0 seeks
[hls,applehttp @ 0x21ff6a0] No longer receiving playlist 5
[NULL @ 0x29d93e0] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=15.921  pts=15.921
  size=353
stream #1:
  keyframe=0
  duration=0.033
  dts=15.939  pts=15.939
  size=9186
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #2:
  keyframe=0
  duration=0.033
  dts=15.939  pts=15.939
  size=7256
stream #3:
  keyframe=0
  duration=0.033
  dts=15.939  pts=15.939
  size=4308
stream #4:
  keyframe=0
  duration=0.033
  dts=15.939  pts=15.939
  size=2676
stream #5:
  keyframe=0
  duration=0.033
  dts=15.939  pts=15.939
  size=1601
stream #0:
  keyframe=1
  duration=0.023
  dts=15.944  pts=15.944
  size=360
stream #0:
  keyframe=1
  duration=0.023
  dts=15.968  pts=15.968
  size=405
stream #1:
  keyframe=0
  duration=0.033
  dts=15.973  pts=15.973
  size=12875
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=15.991  pts=15.991
  size=367
[AVIOContext @ 0x2876e60] Statistics: 96575 bytes read, 0 seeks
[hls,applehttp @ 0x21ff6a0] HLS request for url 'https://cbcvott-a.akamaihd.net/p//44b8224-013ac9ec99e/CBC_THE_NATIONAL-2021-03-01_1867659331897-v1-29234669/segments/The-National_700kbps_23_13_52_a1/a1_1.aac', offset 0, playlist 0
[hls,applehttp @ 0x21ff6a0] Opening 'https://cbcvott-a.akamaihd.net/p//44b8224-013ac9ec99e/CBC_THE_NATIONAL-2021-03-01_1867659331897-v1-29234669/segments/The-National_700kbps_23_13_52_a1/a1_1.aac' for reading
[https @ 0x2a59fa0] request: GET /p//44b8224-013ac9ec99e/CBC_THE_NATIONAL-2021-03-01_1867659331897-v1-29234669/segments/The-National_700kbps_23_13_52_a1/a1_1.aac HTTP/1.1
User-Agent: Lavf/57.83.100
Accept: */*
Connection: close
Host: cbcvott-a.akamaihd.net
Icy-MetaData: 1


[aac @ 0x28a7c00] Stripped 73 HLS ID3 bytes
id3v2 ver:4 flags:00 len:63
[aac @ 0x28a7c00] HLS ID3 audio timestamp 1441257
stream #1:
  keyframe=1
  duration=0.033
  dts=16.006  pts=16.006
  size=67152
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=16.014  pts=16.014
  size=372
frame=  181 fps=0.0 q=-1.0 size=    1792kB time=00:00:06.01 bitrate=2441.1kbits/s speed=  11x    ^Mstream #0:
  keyframe=1
  duration=0.023
  dts=16.037  pts=16.037
  size=365
stream #1:
  keyframe=0
  duration=0.033
  dts=16.039  pts=16.039
  size=7150
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=16.060  pts=16.060
  size=364
stream #1:
  keyframe=0
  duration=0.033
  dts=16.073  pts=16.073
  size=8189
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=16.084  pts=16.084
  size=365
stream #1:
  keyframe=0
  duration=0.033
  dts=16.106  pts=16.106
  size=8330
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=16.107  pts=16.107
... [and on and on, until it actually starts hexdumping]
[NULL @ 0x2917c60] ct_type:0 pic_struct:0
stream #0:
  keyframe=1
  duration=0.023
  dts=64.010  pts=64.010
  size=408
00000000  ff f1 50 80 33 1f fc 21 1a d4 85 ce 91 62 82 b0 ..P.3..!.....b..
00000010  d0 a0 10 27 b4 69 ca 3c 8a 45 a5 d5 46 4e 65 78 ...'.i.<.E..FNex
00000020  05 ca 86 82 00 04 48 02 c0 c7 76 54 c8 12 3a 22 ......H...vT..:"
00000030  64 11 1a 60 ab 7a 46 4f b2 4f 68 19 58 93 c7 6c d..`.zFO.Oh.X..l
00000040  7e 00 9a 48 48 92 2a 10 da 22 f0 b8 18 08 4c 6d ~..HH.*.."....Lm
00000050  61 5c 94 42 7e bf a8 34 69 16 0a 93 f7 79 74 1d a\.B~..4i....yt.
00000060  a1 ce da 6a 3b b2 18 3a 6b 7b c9 5d 55 1b ed db ...j;..:k{.]U...
00000070  2b f1 59 1f e2 99 e9 9c d3 af 27 b8 c7 ad 67 76 +.Y.......'...gv
00000080  64 01 63 f2 fe 43 8c f5 a6 67 ea 5f 0f 96 fd db d.c..C...g._....
00000090  0b 30 dc 96 57 71 7d bc d0 3a 55 25 cf e7 b4 5a .0..Wq}..:U%...Z
000000a0  8d d6 77 c2 f5 9f 68 e8 78 97 dc 13 7d be 1a 57 ..w...h.x...}..W
000000b0  83 e4 12 75 9b 53 17 a9 0d 2b da 3d 51 43 58 c9 ...u.S...+.=QCX.
000000c0  16 9b 1e 23 64 66 29 0c c8 41 59 f7 32 68 85 22 ...#df)..AY.2h."
000000d0  3b 4e 64 d5 60 7e a9 ff 3c ce 0c b0 87 fb ff bf ;Nd.`~..<.......
000000e0  ea b9 12 4b a3 e0 f1 85 b8 6b b0 76 cd 3f a7 72 ...K.....k.v.?.r
000000f0  0b f4 86 b7 60 42 e1 c3 cf 6c 76 0f cc 62 37 73 ....`B...lv..b7s
00000100  fd e8 77 a2 c8 92 17 a6 c4 4e 57 05 a2 1d 24 1b ..w......NW...$.
00000110  6f db 25 dc 1a fe f0 fa 32 88 ed 27 ea a8 f6 73 o.%.....2..'...s
00000120  ad b7 f2 3a bb 9c 1f 16 b3 7c b4 c6 01 14 14 78 ...:.....|.....x
00000130  7b e1 92 97 97 8f a1 d4 f3 f8 71 ff 45 31 5d bd {.........q.E1].
00000140  32 ca 34 18 b4 d8 ce 3a d0 af 1c 80 28 21 e9 13 2.4....:....(!..
00000150  76 57 e0 01 27 0f f2 ed cb 3f 2b 9e 11 2b ab 5a vW..'....?+..+.Z
00000160  4f 29 44 bd 17 35 3e 6a ba 83 b8 36 62 4a 00 0d O)D..5>j...6bJ..
00000170  c0 f6 8f 8f 0c d6 f5 1b c6 98 7e 2d bd 3a d5 63 ..........~-.:.c
00000180  c1 fc 86 1e 80 3e c5 ca 86 82 00 05 00 0b 79 80 .....>........y.
00000190  08 03 01 8e c7 60 03 f8                         .....`..
stream #1:
  keyframe=0
  duration=0.033
  dts=64.021  pts=64.021
  size=5945
00000000  00 00 00 01 09 f0 00 00 01 06 01 07 00 00 76 00 ..............v.
00000010  00 03 00 04 04 11 b5 00 31 47 41 39 34 03 c2 ff ........1GA94...
00000020  fc 94 ad fd 80 80 ff 80 00 00 01 41 9a 76 ec 62 ...........A.v.b
00000030  23 ff dc 50 3f 3e 18 73 f5 dd ec d3 f9 50 ca 1d #..P?>.s.....P..
00000040  6d 97 cc 4e 01 09 7c 58 1e 7b ad f1 06 e4 b4 4e m..N..|X.{.....N
00000050  13 94 1f 46 ad f4 33 c8 65 c9 16 fb b1 e8 af 63 ...F..3.e......c
00000060  62 21 83 da a7 ff ae 4c 2f bb f6 c0 eb 2f 6c 48 b!.....L/..../lH
00000070  a7 f4 e7 17 af c8 45 b6 40 08 00 fd bc ce 1d bf ......E.@.......
00000080  c0 e3 2e fb 51 b8 bf bc 22 1f 90 a0 34 23 f6 46 ....Q..."...4#.F
00000090  31 9a 24 36 93 7f c9 92 69 59 f4 5f d5 6d b4 a2 1.$6....iY._.m..
000000a0  8e e4 1d 70 4d 4a 75 54 46 af 68 3d 23 92 1c 05 ...pMJuTF.h=#...
000000b0  c5 f1 c8 2c bd 0f 44 7e af 5a 5f 04 f9 6e cb a7 ...,..D~.Z_..n..
000000c0  52 4e e3 db 7c 3f 96 24 47 51 2d 7b b4 21 dc 28 RN..|?.$GQ-{.!.(
000000d0  34 26 b3 e8 de 73 49 d4 d0 70 78 01 50 08 6b 3e 4&...sI..px.P.k>
000000e0  38 be 32 16 9b 13 58 6b ae 16 91 5d 92 f3 23 bd 8.2...Xk...]..#.
000000f0  5e 01 8a ab 90 ef 77 34 13 2f fc 0a c2 f7 7b aa ^.....w4./....{.
00000100  aa a3 3f 06 96 9b b0 3c db 53 d5 cb 85 81 a9 0e ..?....<.S......
00000110  ab 02 1b a2 d8 c6 a2 b6 ad db 12 da 03 9a b0 d5 ................
00000120  27 c6 99 17 0d 08 5c 5e 55 74 fe 41 06 f4 ea 90 '.....\^Ut.A....
00000130  d0 75 e5 66 5a 30 a1 6c 27 88 8a a8 df 35 b5 31 .u.fZ0.l'....5.1
00000140  c8 c7 ab 85 e3 d6 49 27 27 7e 74 93 08 9b eb c6 ......I''~t.....
00000150  19 b6 9e e4 88 d3 2f 89 08 0d e4 58 e0 85 d0 15 ....../....X....
00000160  8d 31 9e 4e dd f7 57 6f bf b6 af 0d 27 ed f1 fa .1.N..Wo....'...
00000170  cf e2 a1 71 7f 20 6b 71 41 e4 37 80 24 fb 15 72 ...q. kqA.7.$..r
00000180  c8 1f 28 f6 e0 24 dd d0 18 24 38 2f cd 09 80 af ..(..$...$8/....
00000190  06 e9 bc 41 02 6c 73 ae b9 ad b2 5d ae 9d 76 29 ...A.ls....]..v)
000001a0  38 1b 08 6f 4a 0e 02 9a 71 ca 14 6d 3e f9 23 32 8..oJ...q..m>.#2
000001b0  f7 ab e3 c3 21 8c ac d4 08 08 31 b5 4d 9d 11 fa ....!.....1.M...
000001c0  df 46 57 3f 4b b6 00 e5 f6 c6 1c 0a c4 12 39 27 .FW?K.........9'
000001d0  fc b8 6f 70 e1 35 4e ac d9 4d 6a 2a 58 b1 07 7e ..op.5N..Mj*X..~
000001e0  f6 47 10 9d 9d 3a 82 cf 94 3b e2 29 9c 12 4c f6 .G...:...;.)..L.
000001f0  d1 8b 6c b5 89 ff 62 b5 cb 81 1d fe 67 b9 15 92 ..l...b.....g...
00000200  44 76 ab 43 81 2f b2 85 22 e0 bd 8b 60 f2 e9 ac Dv.C./.."...`...
00000210  ed 05 11 3d 91 41 56 42 11 7d 17 ad 09 ac 6e 22 ...=.AVB.}....n"
00000220  b5 30 a8 95 e9 50 22 4f 4c 29 84 6b cc 8d 42 1c .0...P"OL).k..B.
00000230  3e 92 99 e8 c3 cd 26 31 19 ee 23 3f c7 cb b6 a0 >.....&1..#?....
00000240  e3 c4 87 ed 72 8c 4f db 83 ab 08 1c 89 dc 21 59 ....r.O.......!Y
00000250  a9 52 a2 22 d5 ac ea 5e 6b 8c 6f ef c1 8c 57 41 .R."...^k.o...WA
00000260  14 7c 82 d8 c6 83 38 5f 24 2f 68 d2 14 1e db 84 .|....8_$/h.....
00000270  13 13 c3 eb 78 d5 15 cc ac 59 58 2a 61 0f 43 87 ....x....YX*a.C.
00000280  f7 6f 33 14 dd 56 b5 db 7e 8f b1 dc 64 11 a0 8f .o3..V..~...d...
00000290  73 d2 53 a1 f6 5b cb 9f f8 22 c7 a6 a5 73 a9 91 s.S..[..."...s..
000002a0  40 0d e0 41 94 a6 84 b1 41 db e5 52 c1 3e 9b 1a @..A....A..R.>..
000002b0  ed 2e 4e a6 3b 01 f5 4f 5d d9 0f a1 a6 d1 5e 5d ..N.;..O].....^]
000002c0  fe 5a f4 56 8a d8 03 d1 b4 7f 04 5c 2e f0 0d 75 .Z.V.......\...u
000002d0  71 0c ba a1 25 ca 5d 4d c9 0c 5e 0e 79 61 24 8b q...%.]M..^.ya$.
000002e0  67 3f a9 b3 8e 74 d4 33 66 07 80 66 21 e6 8d eb g?...t.3f..f!...
000002f0  47 3a e9 c3 39 ca 8b a2 a8 cf 0d 39 4d 80 d7 07 G:..9......9M...
00000300  97 e4 86 a4 9c 83 5a 05 24 36 e5 2a ad ae e2 79 ......Z.$6.*...y
00000310  84 b1 ab c7 ac 80 7a 57 6c c1 16 85 6d 15 88 b3 ......zWl...m...
00000320  0c f8 7e 4a 43 71 9d 63 fd f3 e4 d0 ec 41 8e 8e ..~JCq.c.....A..
00000330  1d 7c aa 21 09 64 37 98 4e 04 b4 24 53 12 7b 50 .|.!.d7.N..$S.{P
00000340  f6 b0 ad 77 98 4f 08 c6 69 0f 8b bb b8 bd 20 05 ...w.O..i..... .
00000350  aa 27 d9 44 01 4f 43 ac 10 4d 6e d3 13 d4 5e 22 .'.D.OC..Mn...^"
00000360  ba 5e 7b c1 da 88 63 d5 57 74 aa e1 bb de a6 1b .^{...c.Wt......
00000370  ff c9 dd be a4 66 f8 65 64 f8 5b 15 92 81 72 c7 .....f.ed.[...r.
00000380  49 0a a2 26 1f 07 12 fc 79 33 c1 d1 51 28 ef 8c I..&....y3..Q(..
00000390  dd 0c 57 62 c4 4c a1 c9 58 26 4f d5 1c 65 cb 0e ..Wb.L..X&O..e..
000003a0  90 2a f5 3a d9 58 f0 a2 82 3f 17 9f 53 39 fa 85 .*.:.X...?..S9..
... [and on and on ...]

The above URL will only be short-lived, so unless you try to reproduce this fairly soon (next day or so), the URL will be invalid.  I will be able to supply a new URL if you find the above one invalid.

Comment 1 leigh scott 2021-03-02 16:59:02 CET

The link is 403 already.
It would be better for you to report the issue to ffmpeg bugzilla.

Comment 2 leigh scott 2021-03-02 17:00:47 CET

FTR I don't use RHEL7, this means I can't offer any support.

Comment 3 Brian J. Murrell 2021-03-02 17:06:07 CET

(In reply to leigh scott from comment #1)
> The link is 403 already.

Could be geoblocked.  I guess you will just have to take my word for it.

> It would be better for you to report the issue to ffmpeg bugzilla.

To which they will immediately reply to try a newer version.

But I can already tell you that Fedora's ffmpeg-4.3.1-16.fc33.x86_64 does not have this problem.  Only EPEL7's ffmpeg-3.4.8-1.el7.x86_64 has it and I would be entirely surprised if upstream doesn't suggestion upgrading to 4.x and closing the ticket.

Comment 4 leigh scott 2021-03-02 17:10:36 CET

El7 is too old for a major ffmpeg update and rebuild of all dependant packages.

Comment 5 Brian J. Murrell 2021-03-02 17:15:47 CET

(In reply to leigh scott from comment #4)
> El7 is too old for a major ffmpeg update and rebuild of all dependant
> packages.

Don't disagree, but EL7 is still within supported windows and having a bug like this that fills up filesystems with GBs of stdout is pretty nasty.

With the recent RH shenanigans with CentOS, EL8 does not have a stable upgrade/support path so upgrading to it is fraught with uncertainty at this point and as a result staying on EL7 is the only sane thing to do right now.

Comment 6 Brian J. Murrell 2021-03-03 14:13:48 CET

This turns out to have been "something" (unknown as of now and not really that interested in trying to figure out where from) was sending the ffmpeg process an "h" on it's stdin while it was operating (in a script, from a cron job).

Simply adding a </dev/null to the ffmpeg invocation seems to have resolved that.