Hidden Stream Support (STN_table)

Post by **Curly** » Thu Jan 11, 2024 8:38 am

I've started to implement this. The first thing I noticed by chance is missing playlists. Here is 3.36 listing RATATOUILLE:

Code: Select all

C:\Standalone\eac3to 3.36>eac3to g:\rips\RATATOUILLE
1) 00001.mpls (angle 1), 1:50:33
   [27+28+0+1+2+5+8+9+12+13+16+18+21+17+33+34+49+37+50+40+51+43+52+46+53+56+54+59+55+62+65].m2ts
   - Chapters, 31 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

2) 00001.mpls (angle 2), 1:50:33
   [27+29+0+3+2+6+8+10+12+14+16+19+21+31+33+35+49+38+50+41+51+44+52+47+53+57+54+60+55+63+65].m2ts
   - Chapters, 31 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

3) 00001.mpls (angle 3), 1:50:33
   [27+30+0+4+2+7+8+11+12+15+16+20+21+32+33+36+49+39+50+42+51+45+52+48+53+58+54+61+55+64+65].m2ts
   - Chapters, 31 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

4) 00012.mpls, 00021.m2ts, 0:28:00
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

5) 00017.mpls, 00033.m2ts, 0:26:23
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

6) 00137.mpls, 0:50:58
   [143+144+83+145+146+147+148+149+150+151].m2ts
   - Chapters, 18 chapters
   - MPEG2, 480i60 /1.001 (16:9)
   - AC3, English, stereo, 48kHz

7) 00056.mpls, 00081.m2ts+00082.m2ts+00080.m2ts, 0:15:06
   - Chapters, 10 chapters
   - MPEG2, 480i60 /1.001 (16:9)
   - AC3, English, stereo, 48kHz

It's wrong! There is another playlist 143 that is not shown, while DGDemux shows it. Here is 3.45 fixed to show it:

Code: Select all

D:\Don\Programming\Delphi\EAC3TO>eac3to G:\Rips\RATATOUILLE
1) 00001.mpls (angle 1), 1:50:33
   [27+28+0+1+2+5+8+9+12+13+16+18+21+17+33+34+49+37+50+40+51+43+52+46+53+56+54+59+55+62+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

2) 00001.mpls (angle 2), 1:50:33
   [27+29+0+3+2+6+8+10+12+14+16+19+21+31+33+35+49+38+50+41+51+44+52+47+53+57+54+60+55+63+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

3) 00001.mpls (angle 3), 1:50:33
   [27+30+0+4+2+7+8+11+12+15+16+20+21+32+33+36+49+39+50+42+51+45+52+48+53+58+54+61+55+64+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

4) 00143.mpls (angle 1), 1:50:33
   [27+28+0+1+2+5+8+9+12+13+16+18+21+17+33+34+49+37+50+40+51+43+52+46+53+56+54+59+55+62+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

5) 00143.mpls (angle 2), 1:50:33
   [27+29+0+3+2+6+8+10+12+14+16+19+21+31+33+35+49+38+50+41+51+44+52+47+53+57+54+60+55+63+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

6) 00143.mpls (angle 3), 1:50:33
   [27+30+0+4+2+7+8+11+12+15+16+20+21+32+33+36+49+39+50+42+51+45+52+48+53+58+54+61+55+64+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

7) 00137.mpls, 0:50:58
   [143+144+83+145+146+147+148+149+150+151].m2ts
   - Chapters, 19 chapters
   - MPEG2, 480i60 /1.001 (16:9)
   - AC3, English, stereo, 48kHz

8) 00012.mpls, 00021.m2ts, 0:28:00
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

9) 00017.mpls, 00033.m2ts, 0:26:23
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz

10) 00056.mpls, 00081.m2ts+00082.m2ts+00080.m2ts, 0:15:06
    - Chapters, 11 chapters
    - MPEG2, 480i60 /1.001 (16:9)
    - AC3, English, stereo, 48kHz

The reason 3.36 misses it is because eac3to tries not to show duplicate playlists, but the comparison does not consider the STN_table. MPLS 1 and 143 differ only in the STN_table, i.e., different streams are hidden.

OK, with that out of the way, here is 3.45 with hidden stream marking:

Code: Select all

D:\Don\Programming\Delphi\EAC3TO>eac3to G:\Rips\RATATOUILLE 1)
Running in fast mode
Keeping dialnorm
analyze: 100%
M2TS, 1 video track, 5 audio tracks, 4 subtitle tracks, 1:50:32, 123.814p
1: Chapters, 32 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: RAW/PCM, English, 5.1 channels, 24 bits, 48kHz, dialnorm: 0dB
4: AC3 EX, English, 5.1 channels, 640kbps, 48kHz, dialnorm: -31dB
5: AC3 EX, French, 5.1 channels, 640kbps, 48kHz, dialnorm: -31dB
6: AC3 EX, Spanish, 5.1 channels, 640kbps, 48kHz, dialnorm: -31dB
7: *AC3, English, 2.0 channels, 192kbps, 48kHz, dialnorm: -27dB
8: Subtitle (PGS), English
9: Subtitle (PGS), French
10: Subtitle (PGS), Spanish
11: *Subtitle (PGS), English

Asterisk denotes hidden. All the angles specify the same MPLS, so you get the same results for 2) and 3).

It would be nice to have the marking when just doing "eac3to RATATOUILLE" but currently that top-level listing does not show subs (already on the bug list). I may just leave it this way, haven't decided. Your thoughts? After deciding that, the next step will be an option to not demux hidden streams.

SomeHumanPerson · Post by **SomeHumanPerson** » Fri Jan 12, 2024 12:13 am

Great work!

Curly wrote:It would be nice to have the marking when just doing "eac3to RATATOUILLE" but currently that top-level listing does not show subs (already on the bug list). I may just leave it this way, haven't decided. Your thoughts?

That's a tough call. Some discs (often Warner, Universal, Paramount, Sony) have so many subtitle languages that if you include them in the top level display, it becomes horribly cluttered.

On the other hand, if hidden playlists are enabled, and you have duplicate playlists that differ only by certain hidden subtitle tracks, then it's going to be annoying to figure that out (either analyze each one then scroll back and forth between the results, or open two windows side-by-side, or some play on that approach).

My first thought was, maybe show only the hidden subtitle tracks in the top level display. But that doesn't make sense, either in general (just confusing), or in the case of a playlist with mostly hidden tracks (I see this in the "Japanese" playlist quite often -- everything but the Japanese subs are marked as hidden) where you still get the clutter problem.

What about... at least showing a count of hidden and non-hidden subtitle tracks in the top level display? I have no idea how difficult that would be to implement with eac3to's codebase but it seems generally simple in concept.

The output might look something like this (see my addition at the bottom):

Code: Select all

6) 00143.mpls (angle 3), 1:50:33
   [27+30+0+4+2+7+8+11+12+15+16+20+21+32+33+36+49+39+50+42+51+45+52+48+53+58+54+61+55+64+65].m2ts
   - Chapters, 32 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)
   - RAW/PCM, English, multi-channel, 48kHz
   - AC3, English, multi-channel, 48kHz
   - AC3, French, multi-channel, 48kHz
   - AC3, Spanish, multi-channel, 48kHz
   - AC3, English, stereo, 48kHz
   - Subtitle (PGS), 3 language(s) + 1 hidden language(s)

Does that seem like a reasonable compromise and/or a workable feature?

On the cosmetic aspect, maybe "tracks" would be preferred over "languages", maybe the first number should be a "total" that includes the hidden count (e.g. "4 track(s) total, 1 hidden* ")...

Changing the subject, I notice that your playlist analysis of playlist 1 shows 123.814p ...

Any idea what's going on there?

Post by **Curly** » Fri Jan 12, 2024 5:06 am

Thank you. Yeah, I guess the clutter issue is the reason it was done that way. I'm going to leave things as they are for now because TBH I have lots more important things to do. Your suggestion remains on the table for the future.

Good eyes on spotting the 123.814p. I'll fix it.

I also don't like "1080p24 /1001", i.e., the extra space in there. I'll fix that too.

Post by **Curly** » Fri Jan 12, 2024 6:51 am

Hardy har har, the new STN_table support is already paying off. I noticed using the new support that for JFK_DIRECTORS_CUT the DV stream is hidden (confirmed by BDInfo). So I checked with DGDemux and found that we don't have hidden marking for video, only for audio and subs. I'll tell the rock star about it.

SomeHumanPerson · Post by **SomeHumanPerson** » Fri Jan 12, 2024 10:12 am

Curly wrote: ↑
Fri Jan 12, 2024 6:51 am
So I checked with DGDemux and found that we don't have hidden marking for video, only for audio and subs. I'll tell the rock star about it.

Post by **Rocky** » Fri Jan 12, 2024 10:46 am

You better have popped that popcorn in lard, tallow, or coconut oil. If you used vegetable (seed) oil, like corn oil, you are poisoning yourself and will die young.

I already fixed DGDemux to show hidden on the video streams. Will make a slipstream after the hubblec4 upload finishes. Don't want to risk interrupting it.