[RESOLVED] Issue with subtitles demuxing

[Guest 2]

[admin: Moved subtitles-related posts from the EAC3 issues thread to this new thread. The order of posts may not be completely accurate and some posts have been edited to get rid of EAC3 issues and other superfluous matter. Links may be broken. Members, please make a separate thread for each issue. Thank you.]

REJOICE! I have just bought Onward BD for the daughter of my cousin and it's even more messed up as structure:

0802.mpls = 00901.m2ts+01438.m2ts+00903.m2ts+01482.m2ts+00905.m2ts+01483.m2ts+00907.m2ts+01440.m2ts+01484.m2ts+00911.m2ts+01442.m2ts+00913.m2ts+01444.m2ts+00915.m2ts+01446.m2ts+00917.m2ts+01448.m2ts+01312.m2ts+01450.m2ts+01314.m2ts+01452.m2ts+01589.m2ts+01318.m2ts+01456.m2ts+01320.m2ts+01485.m2ts+01322.m2ts+01458.m2ts+01324.m2ts+01486.m2ts+01326.m2ts+01460.m2ts+01328.m2ts+01487.m2ts+01330.m2ts+01488.m2ts+01332.m2ts+01489.m2ts+01334.m2ts+01462.m2ts+01336.m2ts+01490.m2ts+01338.m2ts+01491.m2ts+01340.m2ts+01492.m2ts+01342.m2ts+01464.m2ts+01352.m2ts+01493.m2ts+01344.m2ts+01494.m2ts+01346.m2ts+01495.m2ts+01348.m2ts+01496.m2ts+01350.m2ts+01466.m2ts+01362.m2ts+01468.m2ts+01354.m2ts+01497.m2ts+01356.m2ts+01470.m2ts+01358.m2ts+01498.m2ts+01360.m2ts+01499.m2ts+01372.m2ts+01500.m2ts+01364.m2ts+01472.m2ts+01382.m2ts+01474.m2ts+01374.m2ts+01501.m2ts+01366.m2ts+01502.m2ts+01368.m2ts+01503.m2ts+01370.m2ts+01476.m2ts+01376.m2ts+01504.m2ts+01378.m2ts+01434.m2ts+01479.m2ts+01381.m2ts+01481.m2ts+00007.m2ts

And track list:

Streams:
1011: Video [AVC 23.976 1080p 16:9]
1100: DTS HDMA C+L+R+SL+SR 48 1536 [eng]
1101: DTS HDHR C+L+R+SL+SR 48 1536
1102: AC3 2.0 48 320 [eng]
1103: E-AC3 7.1 48 896 [deu]
1104: E-AC3 7.1 48 896 [ita]
1105: AC3 5.1 48 640 [ces]
1106: AC3 2.0 48 320 [eng]
1200: PGS subtitles [eng]
1201: PGS subtitles [deu]
1202: PGS subtitles [ita]
1203: PGS subtitles [ces]
1204: PGS subtitles [eng]
1205: PGS subtitles [deu]
1206: PGS subtitles [ita]

SUP files timing difference examples (when OCR with SubtitleEdit to .ass):

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

Some (and there are more than one) are relatively huge (1 sec out of sync).

The difference between 0803.mpls and the MKV version is 1 second. Perhaps the little out of sync are where the m2ts changes.

-----

In the meantime I gave a try to TSMuxer.

It extract a good eac3 (same lenght as AC3 as the movie, not -1 second like MakeMKV) but gives bad DTS-HDMA leading to FFMPEG errors when converting to AC3. The DTS extraction works ok on Solo movie. WTF.

The ASS from the SUP are almost equal to the ones of MakeMKV, with a max difference of .01 frames and the same max difference of 1 secondwith DGIndex ones.

I am thinking, now, that the issue is not only with EAC3 but with SUP too.

-----

Please notice that I am finding discrepancies in total frames too:

DGindexNV 147252
MakeMKV 147246
TSMuxer (nightly 2020_0702) 147252

Pheeeeeew.

-----

Updating the ASS from SUP sync issue: here is the comparison with TSMuxer ASS too.

Rocky, feel free to split this thread in two, if you prefer to face audio and sub things separately.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] TSMuxer
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

-----

I checked the BD of Avatar (extended collector's cut) for SUP issue.

There are 3 main MPLS with different versions of the movie, each with complex M2TS combo.

Same problem and this is a very old BD I have, not a new one with strange protections or whatsoever.

EDIT: My OCD made another victim.

I have tried to compare the subtitles of a simple structure BD, i.e. MPLS = 1 M2TS only, and there are discrepancies there too.

BD name is Promare, an anime, OCR to SRT format, to be sure not to touch other triggers.

DGIndexNV:

1 00:03:04,684 --> 00:03:08,563 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,688 --> 00:03:12,109 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,192 --> 00:03:13,235 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,276 --> 00:03:14,569 <i>segregazioniste nei confronti dei Burnish...</i>

MakeMKV:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

TSMuxer:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

EDIT: eac3to same values as MakeMKV and TSMuxer

[Guest 2]

I care about real problems that you can demonstrate that in some way make the subs unusable.

Very easy.

Demux the sup(s) with DGIndexNV plus any other tool such as eac3to, MakeMKV or TSMuxer and look at their timings, even without OCRing them.

I suggest you to use SubtitleEdit, as I find it really comfortable but you can use any tool that can show you the timings of sup.

From the english subtitle of Onward:

Code: Select all

DGIndexNV                              MakeMKV

1                                      1
00:00:49,841 --> 00:00:53,554          00:00:49,841 --> 00:00:53,[b]512[/b]
WILDEN: <i>Long ago,                   WILDEN: <i>Long ago,
the world was full of wonder.</i>      the world was full of wonder.</i>

2                                      2
00:00:56,765 --> 00:00:58,392          00:00:56,765 --> 00:00:58,350
(WHINNYING)                            (WHINNYING)

3                                      3
00:00:59,810 --> 00:01:01,645          00:00:59,810 --> 00:01:01,603
<i>It was adventurous...</i>           <i>It was adventurous...</i>

[…]

37                                     37
00:03:18,615 --> 00:03:19,699          00:03:18,532 --> 00:03:19,658
I'm a mighty warrior.                  I'm a mighty warrior.

[…]

1466                                   1466
01:05:26,089 --> 01:05:27,090          01:05:25,880 --> 01:05:27,048
(GRUNTS)                               (GRUNTS)

[…]

1902                                   1902
01:36:02,799 --> 01:36:03,800          01:36:01,923 --> 01:36:03,758
<i>♪ Yeah, it's true</i>               <i>♪ Yeah, it's true</i>

As you can see, the issue can go from wrong duration (1,2,3) to wrong starting time, from a few frames (37) up to almost one second (1466, 1902).

On some other movies, I saw errors of more than one second.

[Guest 2]

Please remember I found discrepancies in single M2TS movies too.

[Rocky]

Candidate fix for subtitles demuxing:

http://rationalqm.us/dgdemux/binaries/DGDemux_pgs.exe

[Rocky]

Fix for DGDemux released as slipstream 32. Corresponding changes for DGIndexNV are in progress.

[Guest 2]

Candidate fix for subtitles demuxing

Will try tomorrow when home

[Rocky]

Cool, thank you.

On the dinner plate:

* Port EAC3 and PGS subtitle fixes to DGDecNV and release with the version 4 MKV fix.
* Fix chapters for DGDemux episode demuxing.
* 3D planes for DGDemux.
* Look into W64 channel placement for DGDemux.
* More tonemapping curves for DGHDRtoSDR and other reported issues.

[Guest 2]

On the dinner plate

Getting hungry!

[Natasha]

admin, send me a PM, I will make you happy.

https://www.youtube.com/watch?v=yC3ttBeOgb4

[Guest 2]

Cool, thank you.

Some discepancies on "In full bloom":

TSMuxer & eac3to:

1
00:00:29,520 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:32,160 --> 00:00:33,160
Noti...

3
00:00:33,600 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,760 --> 00:00:36,800
di fioritura...

DGDemux:

1
00:00:29,280 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:31,920 --> 00:00:33,160
Noti...

3
00:00:33,360 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,520 --> 00:00:36,800
di fioritura...

Line 2 is about 1 second different.

[Rocky]

Investigating...

[Rocky]

Are you sure you are using the latest version 1.0.0.32? I tested it with PID 1201 and the first 4 subtitles match what you have shown for TSMUXER and EAC3TO, not what you have shown for DGDemux.



BTW, what's up with the PID 1200 PGS track? It does not look valid.

[admin]

admin, send me a PM, I will make you happy.

Sorry Nattie, this is more my style:

https://youtu.be/2HD6a0XoyDA?t=945 (live vocals no lipsync)
https://youtu.be/TrFwSjJafeA?list=PLfKw ... mTxT8&t=15 (beautiful tears)
https://www.youtube.com/watch?v=kDTvGtqbXH0 (the kids be like Bryan McKnight OMG)
https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)

[Guest 2]

Are you sure you are using the latest version 1.0.0.32?

Yes and WTF... I demuxed again and sup(s) are correct.

Perhaps I had a old sup when I tried it and I was convinced that it was from latest version. I have so many BD on SSD to make tests on that I lost idea of what was demuxed with old and new softare.

Sorry to have made you losing your precious time.

Anyway I will do more testing in the next days, when you will release DGIndexNV.

BTW, what's up with the PID 1200 PGS track? It does not look valid.

It doesn't look valid with any demuxer I tried. BDs sometimes have authoring or subtitle errors. Really dunno.

[Rocky]

Good news, Guest 2, thank you.

I want a 100TB SSD. My 2TB drives are getting full.

[Guest]

Not quite 100TB but
https://www.newegg.com/p/pl?N=100011693%20601354671
or
https://www.newegg.com/p/pl?cm_sp=CAT_S ... 0601328522

[Rocky]

Cheaper to just add more 2TB drives.

[Guest 2]

https://www.liqid.com/products/composab ... ie-aic-ssd

I offloaded my storage to a FreeNAS, built with what was laying in the garage.

Nice rig, though.

[Curly]

https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)

After Britney's great performance that creepy guy sneaks up behind Britney and scares her. Then hawks his stupid CDs in her face. Then starts to give her the second CD and when she reaches for it he takes it away and gives it to his co-host. What a loser, no respect.

[Bullwinkle]

Leave it to Curly to get to the heart of the matter.

[Sherman]

Without the guy:

https://www.youtube.com/watch?v=RChFnl73Xp0

[Rocky]

Fix released in slipstream 212. Marking RESOLVED.

[Levi]

Check these out, Sherman.

https://www.youtube.com/watch?v=NuxNaZxf5Iw
https://youtu.be/Umy3NDAGkbM?t=89
https://www.youtube.com/watch?v=rCo1PYHwWZ4

[Sherman]

Wow, Levi, thanks!

Britney Jean's early work is unreal too:

https://www.youtube.com/watch?v=76pYZjhVylw

I'm going to ask Mr. Peabody if we can go back and watch the Mickey Mouse Club live!