Author Topic: Unable to remove photo from catalog that has been deleted outside PMP  (Read 17221 times)

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Windows 10 with PMP build 4910

I deleted some photos from windows explorer and they showed up as empty thumbnails with red filenames.

I selected these photos and from the context menu and selected Remove from Catalog and then Delete but the catalog still shows them.

I tried re-indexing and adding the folder to the catalog again but I still cannot remove the missing photos.

I have managed to do this before but now it refuses.

I have attached the support log files for your reference.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #1 on: August 19, 2020, 06:25:35 PM »
Keith,

Could I have you turn on some debug logging and try again?  Then you can post the log in your reply.

In Photo Mechanic's preferences folder you'll create a text file named PMDebug.txt and enter the following text:

CATALOG_DEBUG_LOGGING ON

The location of the preferences folder is:

C:\Users\<your username>\AppData\Roaming\Camera Bits, Inc\Photo Mechanic\

Then quit and start Photo Mechanic Plus again and repeat the operation.  When it fails, quit and post the log.

Thanks,

-Kirk

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #2 on: August 19, 2020, 08:15:36 PM »
Kirk, unfortunately I recreated the database because of so many items I could not delete and now the issue has gone away  :(  I should have kept a copy of the catalog (next time).

Sorry about that.  If it happens again I will generate more logs with debug info.  I am working quite extensively with PMP so hopefully the issue will re-surface.

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #3 on: August 21, 2020, 12:33:35 AM »
OK, it started failing again so I have attached the log with the debug info.

I selected two missing files and selected Remove items from Catalog from the context menu then select Delete Items, it failed so I did the same thing again but chose to Remove the items and it also failed.

Hope this helps.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #4 on: August 21, 2020, 08:54:39 AM »
Keith,

OK, it started failing again so I have attached the log with the debug info.

I selected two missing files and selected Remove items from Catalog from the context menu then select Delete Items, it failed so I did the same thing again but chose to Remove the items and it also failed.

What are the set of steps that you performed that produces the problem?  Does the behavior change if you don't use the "Delete" option?  (You shouldn't need to Delete, the items don't exist.)

Could we also get the following file from you?  "cat_state.sq3" which is in the following folder:

%LOCALAPPDATA%\Camera Bits, Inc\Photo Mechanic\catalog\state

Can we also get the following catalog database?

"E:/All Photos/Ningaloo Fish/Photo Mechanic Plus/Ningaloo Fish E3/catalog.pmdb"

If it's too large to upload here, can you put it on a sharing service (like Dropbox) and get us a link to it?

Thanks,

-Kirk
« Last Edit: August 21, 2020, 10:41:19 AM by Kirk Baker »

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #5 on: August 21, 2020, 10:17:04 PM »
Hi Kirk,

I am not sure what caused the issue but this is what I did that I think caused the issue:
  • From Windows explorere I deleted the entire contents of one folder that had about 300 photos.  I did NOT delete the folder.  This folder WAS cataloged.
  • From within PMP I copied photos to the empty folder
  • In the Browse tab I went to Keywords and selected a keyword that had photos that were now deleted.
  • Missing photos were shown as empty thumbnails and red file names (I did NOT create proxies for any photos)
  • I seleted missing photos and tried to remove them from the catalog.  No error message was issued and the missing photos remained in the catalog
Attached cat_state.sq3 but the other is just too large.

Here is a link to the catalog that is on my Google Drive:

https://drive.google.com/file/d/1aIm7snAkGFaWa1cIyaLYWHmn9QTidqzW/view?usp=sharing

Hope that helps.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #6 on: August 24, 2020, 10:17:39 AM »
Thanks, Keith.

Are your D:\ and E:\ drives mirror copies of each other?

-Kirk

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #7 on: August 24, 2020, 04:48:38 PM »
Are your D:\ and E:\ drives mirror copies of each other?

No, D: is an internal drive partition and E: is an external SSD drive.  All photos and the catalog are on the E: drive.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #8 on: September 17, 2020, 03:10:38 PM »
Keith,

We believe this problem should be fixed in Beta 22: http://forums.camerabits.com/index.php?topic=13531.0

Please give it a try.

Thanks,

-Kirk

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #9 on: September 19, 2020, 05:50:59 PM »
Hi Kirk,

Windows 10 fully updated and PMP Build 5089

sorry for the delay.  Unfortunately this is not fixed and in fact is worse.  Below are some steps I took.

  • Created a copy of a photo in the Rename directory (originally 2 files now 3)
  • Re-scanned the top level folder to the catalog and the Browse window showed 3 files.
  • In Windows Explorer I deleted the newly copied file
  • Re-scanned the top level folder
  • Browse showed 3 files with the deleted file with no thumbnail and a yellow dot showing it is missing from the directory.
  • Right-clicked the missing file and selected Remove from Catalog and tried both options (Delete and Remove)
  • The file remained with no error message shown
  • I restarted PMP but no difference

In my testing I also noticed once that after re-scanning the top directory the copied file did not appear in the browser until I restarted PMP.

I also re-indexed the catalog but that did not help either.

I have attached the log of all operations as well as a copy of the database for you.

All files (photos and catalog) are on the E: external SSD drive.

I would still like to see an option to sync a folder with the catalog (right click a folder and select sync) which would remove missing files and add new files.  This would be much easier than going through the process of adding an existing folder to the catalog via the Scan to Catalog dialog.

Hope this helps.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #10 on: September 20, 2020, 03:46:12 PM »
Hi Kirk,

Windows 10 fully updated and PMP Build 5089

sorry for the delay.  Unfortunately this is not fixed and in fact is worse.  Below are some steps I took.

  • Created a copy of a photo in the Rename directory (originally 2 files now 3)
  • Re-scanned the top level folder to the catalog and the Browse window showed 3 files.
  • In Windows Explorer I deleted the newly copied file
  • Re-scanned the top level folder
  • Browse showed 3 files with the deleted file with no thumbnail and a yellow dot showing it is missing from the directory.
  • Right-clicked the missing file and selected Remove from Catalog and tried both options (Delete and Remove)
  • The file remained with no error message shown
  • I restarted PMP but no difference

In my testing I also noticed once that after re-scanning the top directory the copied file did not appear in the browser until I restarted PMP.

I also re-indexed the catalog but that did not help either.

I have attached the log of all operations as well as a copy of the database for you.

All files (photos and catalog) are on the E: external SSD drive.

I would still like to see an option to sync a folder with the catalog (right click a folder and select sync) which would remove missing files and add new files.  This would be much easier than going through the process of adding an existing folder to the catalog via the Scan to Catalog dialog.

Hope this helps.

Thanks, Keith.

We'll take a look at it tomorrow.

-Kirk

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #11 on: September 21, 2020, 09:38:24 AM »
Keith,

Unfortunately the log doesn't have much information in it.  Would you mind turning on logging and repeating the test?

Run Photo Mechanic Plus, go to the Help menu and choose "Edit Debug Settings..." and then set the checkbox "CATALOG_DEBUG_LOGGING", then click the "Close" button.  Next restart Photo Mechanic Plus and repeat your test, then from the Help menu, choose "Reveal Support Data..." and post the zipped log here, please.

Thanks,

-Kirk

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #12 on: September 21, 2020, 06:59:09 PM »
Hi Kirk,

OK, this is what I have done:

  • In order to remove the missing file from the catalog I copied an existing file and renamed it to be the same as the missing file, then I could delete it.
  • Re-indexed the catalog and enabled debugging as instructed
  • Restarted PMP and browsed to the folder (Rename) to work with
  • In windows explorer I copied an existing file (Moorish Idol_IMG_2807.jpg) which became (Moorish Idol_IMG_2807 - Copy.jpg)
  • Ran Scan to Catalog on the top level folder to refresh the Rename folder and the new file appears
  • In windows explorer I deleted the (Moorish Idol_IMG_2807 - Copy.jpg) file
  • The Browse windows updates automatically to show the deleted file is now missing
  • Tried to remove from the catalog and selected both Remove and Delete but the files remains
  • Closed PMP and tried to remove the file again without success
  • Genereated the log using Reveal Support Data

Both log zip file and database have been attached.

Hope this helps.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25025
    • View Profile
    • Camera Bits, Inc.
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #13 on: September 21, 2020, 09:06:06 PM »
Thanks, Keith.  Could we also have your cat_state.sq3 file, please?

At: %LOCALAPPDATA%\Camera Bits, Inc\Photo Mechanic\catalog\state

-Kirk

Offline KeithRJ

  • Full Member
  • ***
  • Posts: 228
    • View Profile
    • Keith & Vlasta Ross-Jones
Re: Unable to remove photo from catalog that has been deleted outside PMP
« Reply #14 on: September 22, 2020, 05:27:37 PM »
Hi Kirk,

here is the file you requested.

Regards
Keith