[BUG] Folder in Catalog Loses Some Imported Photos

Bugs & Suggestions
Post Reply
garibaldi
Posts: 27
Joined: Fri Mar 02, 2012 12:47 am
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
motherboard: Lenovo 2516CTO
processor: i5 M 520
ram: 8GB
Video Card: i5 Intel Integrated Graphics
sound_card: 5 Series 3400 Series Chipset High Definition Audio
Hard_Drive_Capacity: 500GB
Monitor/Display Make & Model: LG M2762D-PM
Contact:
Contact garibaldi

[BUG] Folder in Catalog Loses Some Imported Photos

Post by garibaldi »

Hello,

I am running ASP 1.0.1.10 on Ubuntu 12.04 amd64. Recently I have noticed a strange bug where if ASP crashes, after I relaunch only some of the images in the folder I was working on before the crash are still in the catalog. If I attempt to reimport the folder, the images still do not appear in the catalog. Below are some debug messages:

reimport the folder:

Code: Select all

45812.963: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25"
45813.81: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
 <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
 </rdf:RDF>
</x:xmpmeta>
"
45813.81: Adding master versions
45813.366: Adding master versions
45813.367: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150775.JPG"
45813.431: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150776.JPG"
45813.443: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150777.JPG"
45813.454: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150778.JPG"
45813.466: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150779.JPG"
45813.477: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45813.490: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
remove the images from the directory in the filesystem, delete the folder in the catalog, move the images back into the directory in the filesystem, and then reimport the folder:

Code: Select all

45911.523: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25"
45911.620: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
 <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
 </rdf:RDF>
</x:xmpmeta>
"
45911.621: Adding master versions
45912.321: Adding master versions
45912.322: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150775.JPG"
45912.631: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
45912.635: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
45912.660: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150776.JPG"
45912.670: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150777.JPG"
45912.680: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150778.JPG"
45912.691: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150779.JPG"
45912.702: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45912.721: Importing: "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45912.721: CameraReader::runInline() - camera reader already exists
45912.730: defaults:  "DefaultRendered.xmp"
45912.775: Scanning file  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45912.790: Importing: "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45912.790: CameraReader::runInline() - camera reader already exists
45914.204: Adding master versions
45914.235: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG"
45914.237: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG"
45918.336: set sort order ascending
remove the images from the directory in the filesystem, delete the folder in the catalog, move the images back into the directory in the filesystem, rename all of the images (prefix the filenames with an "a"), and then reimport (this works):

Code: Select all

45968.844: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
 <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc=""
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="false"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="/home/garibaldi/Pictures/2011/06/25"
   bibp:KeywordList=""
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
 </rdf:RDF>
</x:xmpmeta>
" 
45968.844: Adding master versions 
45968.939: Adding master versions 
45972.249: trashing "/home/garibaldi/Pictures/ASP_Catalogs/2011/assets/home/garibaldi/Pictures/2011/06/25/.cache.noindex/{a0b0ade5-452a-5b42-9c42-83dd49ba2aa7}.prv.noindex" 
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.WAV" 
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.THM" 
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.XMP" 
45972.250: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.BIB" 
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.wav" 
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.thm" 
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.xmp" 
45972.251: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.bib" 
45972.252: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG.xmp" 
45972.252: trashing "/home/garibaldi/Pictures/2011/06/25/P1150780.JPG" 
45973.395: trashing "/home/garibaldi/Pictures/ASP_Catalogs/2011/assets/home/garibaldi/Pictures/2011/06/25/.cache.noindex/{dff2d463-e422-bb4f-9fba-3761b72d87c5}.prv.noindex" 
45973.396: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.WAV" 
45973.396: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.THM" 
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.XMP" 
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.BIB" 
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.wav" 
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.thm" 
45973.397: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.xmp" 
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.bib" 
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG.xmp" 
45973.398: trashing "/home/garibaldi/Pictures/2011/06/25/P1150781.JPG" 
46004.374: set sort order ascending 
46004.591: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
 <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc=""
   bibp:LibraryID="1046"
   bibp:LibraryUuid="{b38b9521-cca7-014b-adea-581b56f9bfb2}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="false"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="/home/garibaldi/Pictures/2011/06/25"
   bibp:KeywordList=""
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
 </rdf:RDF>
</x:xmpmeta>
" 
46004.592: Adding master versions 
46004.691: Adding master versions 
46004.691: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46004.707: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46004.711: defaults:  "DefaultRendered.xmp" 
46004.725: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46004.729: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46004.744: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46004.747: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46004.764: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46004.767: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46004.784: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46004.786: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46004.803: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46004.806: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46004.823: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46004.825: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46005.309: Adding master versions 
46005.332: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46005.334: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46005.544: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46005.588: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46005.591: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46005.865: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46005.868: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46006.24: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46006.266: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46008.411: Cannot open file '/opt/supportfiles/images/addButton.svg', because: No such file or directory
46008.411: Cannot open file '/opt/supportfiles/images/addButton.svg', because: No such file or directory
46008.412: Cannot open file '/opt/supportfiles/images/removeButton.svg', because: No such file or directory
46008.412: Cannot open file '/opt/supportfiles/images/removeButton.svg', because: No such file or directory
46009.966: Show message:  "Importing from /home/garibaldi/Pictures/2011/06/25" 
46010.66: Starting import with settings :  "<x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0">
 <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
  <rdf:Description rdf:about=""
    xmlns:bibp="http://www.bibblelabs.com/BibblePrivate/5.0/"
   bibp:MoveCopy="2"
   bibp:LibraryLoc="/2011"
   bibp:LibraryID="1"
   bibp:LibraryUuid="{075045e0-9321-504c-b9dc-6815611c97af}"
   bibp:Organize="0"
   bibp:FolderTemplate=""
   bibp:Recurse="true"
   bibp:RenameOn="false"
   bibp:FileTemplate=""
   bibp:ImportPath="{3c1e84ed-2fa4-4cba-a3b2-e654a50aa5b3}//06/25"
   bibp:KeywordList="2011"
   bibp:FolderFilter=""
   bibp:QueueName=""
   bibp:QueueType="0"
   bibp:QueueOnlyNewFiles="false"
   bibp:JobName=""
   bibp:PresetList=""/>
 </rdf:RDF>
</x:xmpmeta>
" 
46010.67: Adding master versions 
46010.351: Adding master versions 
46010.351: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46010.599: Container __CATALOG_ROOT__/assets/home/garibaldi/Pictures/2011/06/25
46010.628: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46010.632: defaults:  "DefaultRendered.xmp" 
46010.667: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46010.692: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46010.717: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46010.736: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46010.812: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46010.854: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46010.881: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46010.904: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46010.927: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46010.945: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46010.969: Scanning file  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46010.985: Importing: "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46012.822: Adding master versions 
46012.855: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150776.JPG" 
46012.868: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46012.911: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150775.JPG" 
46013.772: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150778.JPG" 
46013.777: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150777.JPG" 
46014.482: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150779.JPG" 
46014.485: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150780.JPG" 
46015.303: Extracting RAW data:  "/home/garibaldi/Pictures/2011/06/25/aP1150781.JPG" 
46017.517: set sort order ascending
It seems like the filenames for the images are stuck in the database, and not getting cleared out even after I remove the folder from the catalog. Thus, when they are reimported, ASP thinks they are already present (even though they are not) and does not import them. Any ideas on how I can correct this bug?

Thanks!
Top
afx
Posts: 1675
Joined: Thu Jan 12, 2012 1:38 pm
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
Video Card: FirePro 4900
Monitor/Display Make & Model: NEC PA301w, ColorMunki
Location: München
Contact:
Contact afx

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by afx »

The only way to fix broken catalogs is the recreate from scratch.
This of course requires that you have XMPs for all your images.

cheers
afx
Send bugs to the Monkey // AfterShot Kickstart Guide // sRGB clipping sucks and Adobe RGB is just as bad
Bibble since 2005 // W7 64 on quad Phenom // Ubuntu 14.4 on quad i7 and dualcore AMD // Images
Top
snifong
Posts: 1
Joined: Wed May 02, 2012 2:20 am
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
processor: Intel Core 2 Duo
ram: 4GB
Hard_Drive_Capacity: 320GB
Monitor/Display Make & Model: HP dv6000

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by snifong »

I have seen something very similar. It's when I export to GIMP to edit a photo. The exported tif file shows up in the catalog while I'm editing but as soon as I save the file in GIMP, it disappears from the catalog. Once gone, no amount of imported/copying/renaming can get it back.

-Shane
Top
elslunko
Posts: 41
Joined: Thu Jan 12, 2012 2:32 pm
operating_system: Linux
System_Drive: S
32bit or 64bit: 64 Bit

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by elslunko »

snifong wrote:I have seen something very similar. It's when I export to GIMP to edit a photo. The exported tif file shows up in the catalog while I'm editing but as soon as I save the file in GIMP, it disappears from the catalog. Once gone, no amount of imported/copying/renaming can get it back.

-Shane
That has to do with ASP not supporting TIFFs with alpha channels. Really. Super. Annoying. If I hit save on a file and forget to flatten the image I have to go back into gimp, open it, flatten, then re-import.

If that doesn't work you'll have to make sure to remove the alpha channel in the layers menu in GIMP.
Top
afx
Posts: 1675
Joined: Thu Jan 12, 2012 1:38 pm
operating_system: Linux
System_Drive: N/A
32bit or 64bit: 64 Bit
Video Card: FirePro 4900
Monitor/Display Make & Model: NEC PA301w, ColorMunki
Location: München
Contact:
Contact afx

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by afx »

Now why would a tiff default to have alpha channels????
Only GIMP is silly enough to do this.

cheers
afx
Send bugs to the Monkey // AfterShot Kickstart Guide // sRGB clipping sucks and Adobe RGB is just as bad
Bibble since 2005 // W7 64 on quad Phenom // Ubuntu 14.4 on quad i7 and dualcore AMD // Images
Top
elslunko
Posts: 41
Joined: Thu Jan 12, 2012 2:32 pm
operating_system: Linux
System_Drive: S
32bit or 64bit: 64 Bit

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by elslunko »

afx wrote:Now why would a tiff default to have alpha channels????
Only GIMP is silly enough to do this.

cheers
afx
It does whenever you add a new layer. Wonder if there's a way to turn it off for at least duplicate layers.
Top
grubernd
Posts: 248
Joined: Thu Jan 12, 2012 8:17 pm
operating_system: Linux
System_Drive: N/A
Location: Graz, Austria

Re: [BUG] Folder in Catalog Loses Some Imported Photos

Post by grubernd »

seems to be fixed under gimp 2.8
at least on the windows version i am testing here.

in gimp 2.8 they changed the general image handling - multi-layer images and anything using more advanced features will only be saved to native xcf, any other format needs to be exported. various multi-layer images i exported did not have alpha-channels in them, since i did not create any.
btw, if you do simple edits in the main layer for jpgs or tiffs etc you can still save over the original. i think the new behaviour is very preferrable.
Bibble since 2004. Aftershot until 2020. From then on darktable.
Top
Post Reply

Return to “Bugs & Suggestions”