[RESOLVED] Demuxing Matroska sources is slower
Re: Demuxing Matroska sources is slower
Go for it, DG!
Re: Demuxing Matroska sources is slower
Got rid of the code duplication. Things look a lot cleaner. Back over to you Rocky. Please test it carefully.
Re: Demuxing Matroska sources is slower
Thanks, DG!
Yeah, I looked at the automatic determination and found some code for it online. But you're right, the code is complex with many corner cases. And it made my poor little Sciuridae brain hurt, so I took the easy way out. What with Sherman gone, what's a squirrel to do?
Yeah, I looked at the automatic determination and found some code for it online. But you're right, the code is complex with many corner cases. And it made my poor little Sciuridae brain hurt, so I took the easy way out. What with Sherman gone, what's a squirrel to do?
Re: Demuxing Matroska sources is slower
Is there a new test version available to test? I also use DGDecNV to demux from MKV and noticed what I thought was "slow" but assumed it was just part of the process. I just indexed and demuxed a 32GB MKV with h264 and ac3 and it took 0:12:21.
Re: Demuxing Matroska sources is slower
I'll put a test version up after breakfast in a few hours. It will help only if you have HDDs in the flow, rather than all SSD's.
Re: Demuxing Matroska sources is slower
Here's a test version. If you have an HDD in your flow, then set the option 'Optimize for HDD'. If you have all SSDs, then don't set this option, as it will reduce performance a little.
Note that there has been very little testing by me yet. I plan to test extensively today. Your feedback will be greatly appreciated. It's important that we get this right, as MKV has become quite important with the greater use of MakeMKV for ripping directly to MKV.
http://rationalqm.us/misc/DGIndexNV_mkvfix.exe
Note that there has been very little testing by me yet. I plan to test extensively today. Your feedback will be greatly appreciated. It's important that we get this right, as MKV has become quite important with the greater use of MakeMKV for ripping directly to MKV.
http://rationalqm.us/misc/DGIndexNV_mkvfix.exe
Re: Demuxing Matroska sources is slower
Here are my test results. I used "Optimize for HDD" since the source and destination are both HDD.
dgdecnv2053.0.0.222 (64 bit): 0:12:20
dgdecnv2053.0.0.222 (64 bit)_mkvfix: 0:09:09
dgdecnv2053.0.0.222 (64 bit): 0:12:20
dgdecnv2053.0.0.222 (64 bit)_mkvfix: 0:09:09
Re: Demuxing Matroska sources is slower
To get valid results, you have to do 'flushmem' and power cycle the disks before every run, otherwise the OS and disk caching come into play.
https://chadaustin.me/flushmem/
https://chadaustin.me/flushmem/
Re: Demuxing Matroska sources is slower
Results didn't change much.Rocky wrote: ↑Sat Jan 02, 2021 9:28 amTo get valid results, you have to do 'flushmem' and power cycle the disks before every run, otherwise the OS and disk caching come into play.
https://chadaustin.me/flushmem/
dgdecnv2053.0.0.222 (64 bit)_mkvfix (flushmen & power cycle): 0:09:33
Re: Demuxing Matroska sources is slower
Yes, but do it for the case of no optimize for HDD. That's where we expect to see the slowness. Things also depend on how good your HDDs are.
Re: Demuxing Matroska sources is slower
I've compared against one source with TrueHD audio, no differences in the files produced between the official and test version. The optimized version was as fast as in the previous tests.
Re: Demuxing Matroska sources is slower
Great to hear, Boulder! Thanks for your testing.
Re: Demuxing Matroska sources is slower
I've noticed that the test version uses quite a lot of memory, and doesn't release it when the job is complete even when the clip is closed. I just demuxed one UHD clip and memory usage is about 4600 MB after it's finished and closed. I haven't checked if this happens all the time or just in this one case.
Re: Demuxing Matroska sources is slower
Ooh, a memory leak. Nice find, thank you Boulder!
Please re-download DGIndexNV_mkvfix. It should be fixed.
http://rationalqm.us/misc/DGIndexNV_mkvfix.exe
Please re-download DGIndexNV_mkvfix. It should be fixed.
http://rationalqm.us/misc/DGIndexNV_mkvfix.exe
Re: Demuxing Matroska sources is slower
Released as slipstream 223. Hoping I didn't break anything. Marking RESOLVED.