Corrupted DGI file

Support forum for DGDecNV
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

It sometimes happens that the DGI index file is missing some parts. Not always, randomly.

Such as:

corrupted

Code: Select all

DGAVCIndexFileNV23 DGIndexNV 236.0.0.0 X64
D:\Eseguibili\Media\DGDecNV\

G:\Raw\Viy - La maschera del demonio 31606364160

DEVICE 0
DECODE_MODES 0,0,0,0,0
STREAM 1 0
PKTSIZ 192
VPID 4113
RANGE 0 0 31606364159 0
DEMUX 4352,4353,4608,4609
DEPTH 8
CHROMA_LOCATION 0
ASPECT 1 1
COLORIMETRY 2 2 2
correct

Code: Select all

DGAVCIndexFileNV23 DGIndexNV 236.0.0.0 X64
D:\Eseguibili\Media\DGDecNV\

G:\Raw\Viy - La maschera del demonio\BDMV\STREAM\00002.m2ts 31606364160

DEVICE 0
DECODE_MODES 0,0,0,0,0
STREAM 1 0
PKTSIZ 192
VPID 4113
RANGE 0 0 31606364159 0
DEMUX 
DEPTH 8
CHROMA_LOCATION 0
ASPECT 1 1
COLORIMETRY 2 2 2
The remaining part is always correct.

I can't reproduce it. It just plain happens.
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

How are you opening the stream when you get these failures?
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Sun Nov 21, 2021 7:44 am
How are you opening the stream when you get these failures?
Drag and drop, as I always do, plus mpls selection.
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

After clicking Open MPLS in the MPLS chooser dialog, did you do anything else in DGIndexNV before doing save project?

If the video opens and displays then the source path must be correct and I use that path to make the DGI entry. So it seems something must have corrupted it after opening.
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Sun Nov 21, 2021 1:11 pm
Drag and drop what, exactly? Can you give the full path to the source thingie that you dropped?
My default working path is dropping the directory of the BD rip, looking if there is something to crop and checking the demux window to look at chosen streams. Last thing is saving the dgi.

I don't play with anything strange. I have, sometimes, error with some cpi (if I recall well) at the end of indexing but it usually doesn't give any problem, if it can help you.

The corruption is absolutely random but the strange thing is that it is in the header of the dgi and not in the frame list, that is way longer. So, I think to exclude any write corruption on the hw side.

Is the header written after the frame indexing and listing (time related) or it is written as first thing and then the frame list occurs?
Rocky wrote:
Sun Nov 21, 2021 1:11 pm
Thing is, if the video opens and displays then the source path must be correct and I use that path to make the DGI entry. So it seems something must have corrupted it after opening.
I don't use any "special" or unicode character in path. After indexing to a corrupted DGI, I simply relaunch indexing, without changing anything in the path. Of course, I notice the corruption after closing DGIndexNV, trying to encode, and noticing error. When noticed, I reopen DGIndexNV and index again with the very same steps.
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

1. "error with some cpi"

Non comprende. What is cpi?

2. Are you demuxing when this happens? If so, does it happen when you do not demux?

3. The header is written first and then the frame list etc. You are doing full paths and have only one file, so the source file path must be getting corrupted after it is successfully opened.

4. How often does it happen? I ran 10 index operations in a row and all were fine.
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Mon Nov 22, 2021 8:05 am
Non comprende.
In italian: non capisco or non ho capito :D
Rocky wrote:
Mon Nov 22, 2021 8:05 am
What is cpi?
Sorry, I can't remember the exact error output. I can remember that the error rarely happens and at the end of indexing only. Perhaps an authoring error.
Rocky wrote:
Mon Nov 22, 2021 8:05 am
Are you demuxing when this happens? If so, does it happen when you do not demux?
Usually I index and demux and if not working I rewrite DGI without demuxing. I don't know if it is a coincidence or not.
Rocky wrote:
Mon Nov 22, 2021 8:05 am
How often does it happen?
Lately I am rarely encoding. Anyway, it has happened frequently enough to tickle my attention. If I told a statistic, it could be 1/25.

Any idea how to debug or have a log of what happens to be ready when it will happen again?
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

"Any idea how to debug or have a log of what happens to be ready when it will happen again?"

I could add a popup if the source file path is wrong at the point of save project. Then if you get the error on encode but didn't get the popup then we could think your encode process is doing something to the DGI file. But easier would be to just check the DGI after save project before starting any encode process. That's what I am doing, checking after the save project. Frankly, the code is so simple I don't see any way to attribute this to DGIndexNV.

I'd want to check into this cpi error thing as a first priority. Who is issuing the error? What does it mean?
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Mon Nov 22, 2021 11:07 am
Frankly, the code is so simple I don't see any way to attribute this to DGIndexNV.
Well, it seems that I have found a way to reproduce the bug.

1) Drag and drop the directory of the ripped BD
2) Select a MPLS (the main one, usually) and open it
3) Drag and drop the same directory again
4) Close the MPLS selection window with the upper right X
5) Save the DGI, it will be corrupted plus a nice error will popup at the end of the indexing

Image

It seems the good old drag and drop issue came back.
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

Ah, now something I can get my fangs into. Thank you, tormento, I'm on it.

Image
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Mon Nov 22, 2021 11:55 am
Image
WTF. What a nice job by your dentist.
User avatar
Rocky
Moose Approved
Posts: 2421
Joined: Fri Sep 06, 2019 12:57 pm

Corrupted DGI file

Post by Rocky »

I didn't have the $$$. Bullwinkle did it for me. Normally, I keep my mouth shut. You know I'm famous, right?
User avatar
tormento
DG Approved/Curly Approved/Moose Approved
Posts: 688
Joined: Mon Sep 20, 2010 2:18 pm

Corrupted DGI file

Post by tormento »

Rocky wrote:
Mon Nov 22, 2021 12:30 pm
You know I'm famous, right?
You are the one and only.

Fire your agent. He is hiding your bling bling.
User avatar
Curly
Moose Approved
Posts: 188
Joined: Sun Mar 15, 2020 11:05 am

Corrupted DGI file

Post by Curly »

"It seems the good old drag and drop issue came back."

Image
User avatar
Britney
Curly Approved
Posts: 80
Joined: Sun Aug 09, 2020 3:24 pm

Corrupted DGI file

Post by Britney »

Beauty resides within. The surface is a meaningless mirage.
User avatar
Sherman
Moose Approved
Posts: 360
Joined: Mon Jan 06, 2020 10:19 pm

Corrupted DGI file

Post by Sherman »

Did Balti teach you that?
User avatar
Bullwinkle
Moose Approved
Posts: 295
Joined: Thu Sep 05, 2019 6:37 pm

Corrupted DGI file

Post by Bullwinkle »

Her mama.
User avatar
DG
Curly Approved
Posts: 64
Joined: Thu Dec 31, 2020 9:55 am

Corrupted DGI file

Post by DG »

Sherman, we need you to fix this drag/drop issue, as Rocky will be busy for a while. I've engaged a new dentist for Rocky and he will be gnawing acorns as good as new in a jiffy. Don't forget he lost all of his teeth in the BIG ACCIDENT. Sadly, reimplantation was not successful. The monitor will have to wait.
User avatar
Sherman
Moose Approved
Posts: 360
Joined: Mon Jan 06, 2020 10:19 pm

Corrupted DGI file

Post by Sherman »

Right away, Mr DG. You can always count on me. If you need any help with moderating the forum let me know. And can we have a Sherman Approved rank?
User avatar
Curly
Moose Approved
Posts: 188
Joined: Sun Mar 15, 2020 11:05 am

Corrupted DGI file

Post by Curly »

Nobody wants to be approved by a six-year-old. Get over it. :roll:
User avatar
Sherman
Moose Approved
Posts: 360
Joined: Mon Jan 06, 2020 10:19 pm

Corrupted DGI file

Post by Sherman »

Mind your own beeswax, curly head.
User avatar
Mr. Peabody
Posts: 36
Joined: Tue Dec 24, 2019 9:20 am

Corrupted DGI file

Post by Mr. Peabody »

“Mind your own beeswax” and “it’s none of your beeswax” are common phrases you might hear being shouted by six-year-olds on the school playground. For the uninitiated, they basically mean “mind your own business” or “it’s none of your business,” but some people think it’s more complicated than that.
http://www.todayifoundout.com/index.php ... d-beeswax/
User avatar
Levi
Moose Approved
Posts: 32
Joined: Sat Apr 18, 2020 6:12 pm

Corrupted DGI file

Post by Levi »

Rocky wrote:
Sun Nov 21, 2021 1:11 pm
So it seems something must have corrupted it after opening.
Rocky was right!
User avatar
Sherman
Moose Approved
Posts: 360
Joined: Mon Jan 06, 2020 10:19 pm

Corrupted DGI file

Post by Sherman »

Mr tormento, please re-download 236 and update DGIndexNV. Now if you drop again, it will close everything already loaded. If you then cancel, too bad, you'll have nothing. At least it won't get confused and generate a bogus DGI file. Don't hate me. Or more precisely, don't stick me with any poisonous spines!

Marking resolved. Ha ha ha! :twisted:

EDIT: Wait, I can't do that because I am not a moderator. :cry:
User avatar
DG
Curly Approved
Posts: 64
Joined: Thu Dec 31, 2020 9:55 am

Corrupted DGI file

Post by DG »

Thank you, Sherman. Bullwinkle will mark it resolved when he returns to his stable. Don't feel bad, I can't do it too. What's up with that? :?
Post Reply