[BUG] Folder in Catalog Loses Some Imported Photos

Postby garibaldi on Sat Apr 28, 2012 6:57 pm

Hello,

I am running ASP 1.0.1.10 on Ubuntu 12.04 amd64. Recently I have noticed a strange bug where if ASP crashes, after I relaunch only some of the images in the folder I was working on before the crash are still in the catalog. If I attempt to reimport the folder, the images still do not appear in the catalog. Below are some debug messages:

reimport the folder:
Code: Select all
45812.963: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25"
45813.81: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
</rdf:RDF>
</x:xmpmeta>
"
45813.81: Adding master versions
45813.366: Adding master versions
45813.367: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150775.JPG"
45813.431: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150776.JPG"
45813.443: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150777.JPG"
45813.454: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150778.JPG"
45813.466: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150779.JPG"
45813.477: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45813.490: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"


remove the images from the directory in the filesystem, delete the folder in the catalog, move the images back into the directory in the filesystem, and then reimport the folder:
Code: Select all
45911.523: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25"
45911.620: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
</rdf:RDF>
</x:xmpmeta>
"
45911.621: Adding master versions
45912.321: Adding master versions
45912.322: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150775.JPG"
45912.631: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
45912.635: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
45912.660: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150776.JPG"
45912.670: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150777.JPG"
45912.680: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150778.JPG"
45912.691: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150779.JPG"
45912.702: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45912.721: Importing: "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45912.721: CameraReader::runInline() - camera reader already exists
45912.730: defaults:  "DefaultRendered.xmp"
45912.775: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45912.790: Importing: "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45912.790: CameraReader::runInline() - camera reader already exists
45914.204: Adding master versions
45914.235: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45914.237: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45918.336: set sort order ascending


remove the images from the directory in the filesystem, delete the folder in the catalog, move the images back into the directory in the filesystem, rename all of the images (prefix the filenames with an "a"), and then reimport (this works):
Code: Select all
45968.844: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc=""
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="false"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="/home/garibaldi/Pictures/2011/06/25"
   bibp:KeywordList=""
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
</rdf:RDF>
</x:xmpmeta>
"
45968.844: Adding master versions
45968.939: Adding master versions
45972.249: trashing "/home/garibaldi/Pictures/ASP_Catalogs/2011/assets/home/garibaldi/Pictures/2011/06/25/.cache.noindex/{a0b0ade5-452a-5b42-9c42-83dd49ba2aa7}.prv.noindex"
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.WAV"
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.THM"
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.XMP"
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.BIB"
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.wav"
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.thm"
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.xmp"
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.bib"
45972.252: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.xmp"
45972.252: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45973.395: trashing "/home/garibaldi/Pictures/ASP_Catalogs/2011/assets/home/garibaldi/Pictures/2011/06/25/.cache.noindex/{dff2d463-e422-bb4f-9fba-3761b72d87c5}.prv.noindex"
45973.396: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.WAV"
45973.396: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.THM"
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.XMP"
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.BIB"
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.wav"
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.thm"
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.xmp"
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.bib"
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.xmp"
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
46004.374: set sort order ascending
46004.591: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc=""
   bibp:LibraryID="1046"
   bibp:LibraryUuid="{b38b9521-cca7-014b-adea-581b56f9bfb2}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="false"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="/home/garibaldi/Pictures/2011/06/25"
   bibp:KeywordList=""
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
</rdf:RDF>
</x:xmpmeta>
"
46004.592: Adding master versions
46004.691: Adding master versions
46004.691: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46004.707: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46004.711: defaults:  "DefaultRendered.xmp"
46004.725: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46004.729: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46004.744: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46004.747: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46004.764: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46004.767: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46004.784: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46004.786: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46004.803: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46004.806: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46004.823: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46004.825: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46005.309: Adding master versions
46005.332: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46005.334: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46005.544: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46005.588: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46005.591: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46005.865: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46005.868: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46006.24: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46006.266: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46008.411: Cannot open file '/opt/supportfiles/images/addButton.svg', because: No such file or directory
46008.411: Cannot open file '/opt/supportfiles/images/addButton.svg', because: No such file or directory
46008.412: Cannot open file '/opt/supportfiles/images/removeButton.svg', because: No such file or directory
46008.412: Cannot open file '/opt/supportfiles/images/removeButton.svg', because: No such file or directory
46009.966: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25"
46010.66: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
</rdf:RDF>
</x:xmpmeta>
"
46010.67: Adding master versions
46010.351: Adding master versions
46010.351: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46010.599: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
46010.628: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46010.632: defaults:  "DefaultRendered.xmp"
46010.667: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46010.692: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46010.717: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46010.736: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46010.812: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46010.854: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46010.881: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46010.904: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46010.927: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46010.945: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46010.969: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46010.985: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46012.822: Adding master versions
46012.855: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG"
46012.868: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46012.911: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG"
46013.772: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG"
46013.777: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG"
46014.482: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG"
46014.485: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG"
46015.303: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG"
46017.517: set sort order ascending


It seems like the filenames for the images are stuck in the database, and not getting cleared out even after I remove the folder from the catalog. Thus, when they are reimported, ASP thinks they are already present (even though they are not) and does not import them. Any ideas on how I can correct this bug?

Thanks!
garibaldi
 
Posts: 6
Joined: Fri Mar 02, 2012 12:47 am
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
motherboard: Lenovo 2516CTO
processor: i5 M 520
ram: 8GB
Video Card: i5 Intel Integrated Graphics
sound_card: 5 Series 3400 Series Chipset High Definition Audio
Hard_Drive_Capacity: 500GB
Monitor/Display Make & Model: LG M2762D-PM

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby afx on Sat Apr 28, 2012 9:48 pm

The only way to fix broken catalogs is the recreate from scratch.
This of course requires that you have XMPs for all your images.

cheers
afx
The AfterShot Survival Guide
Send bugs to the Monkey // AfterShot Kickstart Guide // sRGB clipping sucks and Adobe RGB is just as bad
Bibble since 2005 // W7 64 on quad Phenom // Ubuntu 12.4 on quad i7 and dualcore AMD // Images
User avatar
afx
Moderator
 
Posts: 990
Joined: Thu Jan 12, 2012 1:38 pm
Location: München
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
Video Card: FirePro 4900
Monitor/Display Make & Model: NEC PA301w, ColorMunki

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby snifong on Wed May 02, 2012 2:27 am

I have seen something very similar. It's when I export to GIMP to edit a photo. The exported tif file shows up in the catalog while I'm editing but as soon as I save the file in GIMP, it disappears from the catalog. Once gone, no amount of imported/copying/renaming can get it back.

-Shane
snifong
 
Posts: 1
Joined: Wed May 02, 2012 2:20 am
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
processor: Intel Core 2 Duo
ram: 4GB
Hard_Drive_Capacity: 320GB
Monitor/Display Make & Model: HP dv6000

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby elslunko on Wed May 02, 2012 3:57 pm

snifong wrote:I have seen something very similar. It's when I export to GIMP to edit a photo. The exported tif file shows up in the catalog while I'm editing but as soon as I save the file in GIMP, it disappears from the catalog. Once gone, no amount of imported/copying/renaming can get it back.

-Shane


That has to do with ASP not supporting TIFFs with alpha channels. Really. Super. Annoying. If I hit save on a file and forget to flatten the image I have to go back into gimp, open it, flatten, then re-import.

If that doesn't work you'll have to make sure to remove the alpha channel in the layers menu in GIMP.
User avatar
elslunko
 
Posts: 40
Joined: Thu Jan 12, 2012 2:32 pm
operating_system: Linux
System_Drive: S
32bit or 64bit: 64 Bit

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby afx on Wed May 02, 2012 4:00 pm

Now why would a tiff default to have alpha channels????
Only GIMP is silly enough to do this.

cheers
afx
The AfterShot Survival Guide
Send bugs to the Monkey // AfterShot Kickstart Guide // sRGB clipping sucks and Adobe RGB is just as bad
Bibble since 2005 // W7 64 on quad Phenom // Ubuntu 12.4 on quad i7 and dualcore AMD // Images
User avatar
afx
Moderator
 
Posts: 990
Joined: Thu Jan 12, 2012 1:38 pm
Location: München
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
Video Card: FirePro 4900
Monitor/Display Make & Model: NEC PA301w, ColorMunki

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby elslunko on Wed May 02, 2012 11:31 pm

afx wrote:Now why would a tiff default to have alpha channels????
Only GIMP is silly enough to do this.

cheers
afx


It does whenever you add a new layer. Wonder if there's a way to turn it off for at least duplicate layers.
User avatar
elslunko
 
Posts: 40
Joined: Thu Jan 12, 2012 2:32 pm
operating_system: Linux
System_Drive: S
32bit or 64bit: 64 Bit

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Postby grubernd on Tue May 15, 2012 12:36 am

seems to be fixed under gimp 2.8
at least on the windows version i am testing here.

in gimp 2.8 they changed the general image handling - multi-layer images and anything using more advanced features will only be saved to native xcf, any other format needs to be exported. various multi-layer images i exported did not have alpha-channels in them, since i did not create any.
btw, if you do simple edits in the main layer for jpgs or tiffs etc you can still save over the original. i think the new behaviour is very preferrable.
use the Monkey to report bugs - include as much precise information as you can provide!
Bibble since 2004 - lots of it in my public archive: http://bilder.grubernd.at
User avatar
grubernd
Moderator
 
Posts: 167
Joined: Thu Jan 12, 2012 8:17 pm
Location: graz, austria
operating_system: Linux
System_Drive: G
32bit or 64bit: 64 Bit
processor: from atom to quadcore
Hard_Drive_Capacity: not enough


Return to Bugs & Suggestions

Who is online

Users browsing this forum: No registered users and 0 guests