TIF -> JPEG extremely slow

[imhotep]

Hi Folks,

I have a serious issue with tif files. I try to convert tif to jpeg. The first few files are converted but very slow. Log file says:

Code: Select all

709.9: Show message:  "Stapel JPEG-sicher fertiggestellt: 6 Elemente in 3:18.754 Sekunden.  33.1 Sekunden pro Bild."  

Next bunch with 8 files takes even longer. After more than 2 hours two files are processed.

The files are 16Bit Tiff created with ASP2 from Nikon D800 Raw files. The file size varies between 140MB and 200MB.

I am using a desktop PC with the following data:
Linux 3.11.10-17-desktop
openSUSE 13.1 (Bottle) (x86_64)
KDE: 4.11.5
RAM: 16 GB
CPU: AMD FX 8120 Eight-Core Processor, 3.1 GHz

Does anybody here experience the same phenomenon?

Regards,

Karsten

[imhotep]

After some changes on the settings Aftershot is able to convert TIFF to JPEG. But it is extremely slow.

The log says:

Code: Select all

29293.19: Show message:  "Stapel  fertiggestellt: 20 Elemente in 7:27:48.839 Sekunden.  1.34e+03 Sekunden pro Bild. (6 Errors)" 

As far as I understand that means 1340 seconds per image which is more than 22 minutes per image! Sorry guys, but that's unacceptable!

[afx]

Hmm,
not on my old Quad Pehnom..
What settings? Any plugins?

cheers
afx

[imhotep]

Well, might be a difference between 32Bit and 64 Bit architecture. I am using the 64 Bit one.

If you want to reproduce it, just do the following steps:

1. Create a bunch of Nikon D800 Raw images. If you don't have a d800 on your own, just download a raw file and create at least 20 copies. Download for example: http://s3.amazonaws.com/movies.dpreview ... 00.NEF.zip

2. Convert the raw files with ASP2 to 16 Bit Tiff. Resulting file size should be > 140 MB

3. Convert a number of 3 to 5 Tiff images to Jpeg, resolution 1024*nnn
In my case this works most of the time.

4. Convert the entire bunch of at least 20 Tiff images to Jpeg, resolution 1024*nnn. Don't restart ASP2 before doing this.
This last step took more than 7 hours on my machine, which is not a weak one

Would be interesting to see whether you can reproduce the issue.

According the settings: I just decreased the numer ob batch items from 5 to 3.

[afx]

Initial run:
951.757: Show message: "Batch Export Files complete: 6 items in 54.882 seconds. 9.15 seconds per image."
Which is already dog slow compared to the NEF->TIF conversion which only takes about .8 to 1.2s per image....
Second run with 22 images:
1401.712: Show message: "Batch Export Files complete: 22 items in 1:56.669 seconds. 5.3 seconds per image."

Batch items in flight is 3 on my quad i7 Linux box without OpenCL (no time for a Windows test on the Quad Phenom right now)

All on 32bit AS.

cheers
afx

[afx]

And now the 64bit run:
364.680: Show message: "Batch Export Files complete: 22 items in 4:14.277 seconds. 11.6 seconds per image."
Watching the progress counter it seems that the processing of images varies significantly enough to notice longer delays on the progress counter.

And a second run:
509.937: Show message: "Batch Export Files complete: 22 items in 2:04.242 seconds. 5.65 seconds per image."

So it is slow but not as broken as on your box...

cheers
afx

[imhotep]

Thanks for the effort so far. It seems I have to do some performance tests the next days.

I did convert 18 Tiff Files with Darktable and it took 23 seconds. The same files took hours again with ASP2. Everything on the same machine.
I'll continue testing the next days....

[afx]

Can you install the 32bit version (I have both installed in parallel) and compare?
Do you any defaults set for rendered files?

cheers
afx

[imhotep]

Hi Folks,

meanwhile I've been able to solve the issue. During my tests I recognized that NEF-Conversion is also very slow. So actually entire app was slow. Don't know why but got the idea to remove the ".AfterShotPro"-Directory. Now it's beck to normal, I would say.
I did two tests with the I/O Thread setting. Everything works fine.

I consider this issue as fixed. However, I have to admit that this kind of unpredictable behavior of ASP and the according guess gaming getting more and more annoying to me. And it costs hours and hours

Tests with one I/O Thread

Code: Select all

109.672: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
139.20: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 29.669 Sekunden.  1.48 Sekunden pro Bild." 

196.685: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
236.388: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 39.706 Sekunden.  1.99 Sekunden pro Bild." 

285.299: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
315.873: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 30.576 Sekunden.  1.53 Sekunden pro Bild." 

Tests with two I/O Threads

Code: Select all

132.21: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
156.390: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 24.624 Sekunden.  1.23 Sekunden pro Bild. (2 Errors)" 

231.584: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
247.844: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 16.599 Sekunden.  0.83 Sekunden pro Bild."

282.770: Show message:  "20 Versionen an Stapel JPEG-sicher gesendet" 
298.699: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 16.220 Sekunden.  0.811 Sekunden pro Bild. (1 Error)" 

[imhotep]

NEF Conversion to JPEG, two I/O Threads:

Code: Select all

865.980: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 10.796 Sekunden.  0.54 Sekunden pro Bild."

943.905: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 7.004 Sekunden.  0.35 Sekunden pro Bild."

986.616: Show message:  "Stapel JPEG-sicher fertiggestellt: 20 Elemente in 7.477 Sekunden.  0.374 Sekunden pro Bild." 

[afx]

You did not keep the old user directory do compare and see what the actual issue was?

cheers
afx

[imhotep]

Yes I did. But I have no idea what to look for.
I assume it is a conflict between 32 Bit and 64 Bit since the directory was already created with the 32 Bit Version. When the 64 Bit Version was installed the first time, the directory has not been renewed.

Any idea what to look for?

[afx]

Just diff the tree and look for changed files initially.
(apart from the cache, exclude that).

Pay special attention to the defaults.

cheers
afx