Author Topic: Catalog not updating some pic metadata; set color class  (Read 5646 times)

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Catalog not updating some pic metadata; set color class
« on: March 09, 2022, 07:27:20 AM »
Mac 10.14.6; PM+ 6.0, build 6245 (14de08a)

I browse the catalog, then change the color class of a pic. The catalog does not know that the color class has been changed, as evidenced by a search or browse of the catalog; it remains as the previous values. If I select the pic, then scan to catalog, I have 2 thumbnails, one seems to have the updated color class, the other the original value prior to me changing it. Curiously, both thumbnails have the green dot, but other images in the same folder have the grey dot.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #1 on: March 09, 2022, 08:05:44 AM »
Mac 10.14.6; PM+ 6.0, build 6245 (14de08a)

I browse the catalog, then change the color class of a pic. The catalog does not know that the color class has been changed, as evidenced by a search or browse of the catalog; it remains as the previous values. If I select the pic, then scan to catalog, I have 2 thumbnails, one seems to have the updated color class, the other the original value prior to me changing it. Curiously, both thumbnails have the green dot, but other images in the same folder have the grey dot.

What is the name of the image?
What is the full path to the image?

I'd like you to turn on CATALOG_DEBUG_LOGGING, and repeat what you did to get the duplicates.  You can do this by going to the Help menu and choosing the "Edit Debug Settings..." command and then setting the checkbox next to CATALOG_DEBUG_LOGGING, clicking the Close button and restarting Photo Mechanic Plus.

Then after reproducing the problem, I'd like to see your Photo Mechanic Plus log.  In Photo Mechanic Plus go to the Help menu and choose "Reveal Support Data..." and moments later a Finder window will come forward with the zipped log file selected.  Use the 'Attachments and other options' link when you're composing your reply to this message and there you'll be able to upload your zipped PM log file.

Thanks,

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #2 on: March 13, 2022, 06:23:02 AM »
Hello,  Mac 10.14.6; PM+ 6.0, build 6245 (14de08a)

After looking around I see that the cause of the meta-data not being updated is the same as the problem in this post:

http://forums.camerabits.com/index.php?topic=14832.0

It seems there are several methods used by PM+ to refer to a picture, and one of the methods using the file path works, and the other method can't find the information.
Code: [Select]
[2022-03-11 09:06:19.754 Fri] [28893:3fc1030521e4:3fc1033e1a44] [DBG_] DYN: handle_document_remove_batch: remove_batch=["/Volumes/mediashare/MediaShared/Pictures/pics2021/202101/202101-MichSatelliteNite.jpg"]
[2022-03-11 09:06:19.756 Fri] [28893:3fc1030521e4:3fc10927cc0c] [DBG_] DYN: CBits::AM::CatalogMetadataUpdateTask.try_spawn_metadata_update: [START] uuid="6f43a08e-a989-4848-7f73-5c707a15acbb"
[2022-03-11 09:06:19.756 Fri] [28893:3fc1030521e4:3fc1033e19cc] [DBG_] DYN: CBits::AM::CatalogMetadataUpdateTask.try_spawn_metadata_update: [START] checkpoint=[1, 14947]
[2022-03-11 09:06:19.756 Fri] [28893:3fc1030521e4:3fc10927cc0c] [DBG_] DYN: CBits::AM::ProxyTaskControl.hold_work=: flag=true
[2022-03-11 09:06:19.757 Fri] [28893:3fc1030521e4:3fc10927cc0c] [DBG_] DYN: CBits::AM::ProxyTaskControl.gen_holding=: flag=true
[2022-03-11 09:06:19.757 Fri] [28893:3fc1030521e4:3fc10927cc0c] [DBG_] DYN: CBits::AM::ProxyTaskControl.upload_holding=: flag=true
[2022-03-11 09:06:19.757 Fri] [28894:3ffcd5ea6534:3ffcd634eb54] [DBG_] CatSvc: CBits::AM::DB::CatalogDB.apply_change_journal_batch: batch_ops=["rm"]
[2022-03-11 09:06:19.758 Fri] [28894:3ffcd5ea6534:3ffcd634eb54] [DBG_] CatSvc: CBits::AM::DB::CatalogDB.apply_delete_batch: [START] n_recs=1
[2022-03-11 09:06:19.758 Fri] [28894:3ffcd5ea6534:3ffcd634eb54] [WARN] CatSvc: apply_delete_batch: row_key not found in database: "503f8f7c-2cf4-4348-6714-779f5b56c79b/pics2021/202101/202101-MichSatelliteNite.jpg"
[2022-03-11 09:06:19.758 Fri] [28894:3ffcd5ea6534:3ffcd634eb54] [DBG_] CatSvc: CBits::AM::DB::CatalogDB.apply_delete_batch: [FINISH] elapsed=0.000372
[

So what I did after enabling the catalog debugging info, attempted to remove a picture from the catalog in a browse screen. Of course this failed, so I use the Finder to alter the path to the picture. All pictures in that directory then have the yellow dot whereas previously they had a no color or grey dot. After altering the path via Finder, I removed the picture from the catalog. It worked!  Next, I altered the path back to what it was originally (by changing the containing directory name via Finder).

Next I added it back into the catalog using the navigator to navigate back to the directory and selecting the picture and including it in the catalog. It now has a green dot, whereas all its brethren in the same directory still have the gray dot.

Next I zipped up the logs and have attached them.

I do believe that originally I used the navigator to move these images from the boot drive to NAS disc. Perhaps that was the problem. I thought using the navigator would inform the catalog; perhaps not.


Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #3 on: March 14, 2022, 09:21:37 AM »
In the folder "/Volumes/mediashare/MediaShared/Pictures", is there a .pmshare file?  If so, could you post it here, please?  By default, the Finder will hide the file.  If you do the following in a Terminal window, you can make a visible copy:

cp /Volumes/mediashare/MediaShared/Pictures/.pmshare /Volumes/mediashare/MediaShared/Pictures/pmshare

Back in the Finder you should now see a file called pmshare in that folder.  Please post it here.  Use the 'Attachments and other options' link when you're composing your reply to this message and there you'll be able to upload your pmshare file.

Also, in the Terminal window, can you do the following?

ls -al /Volumes

...and copy and paste the output here, please?

Thanks,

-Kirk
« Last Edit: March 14, 2022, 10:29:15 AM by Kirk Baker »

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #4 on: March 14, 2022, 10:54:00 AM »
Yes, there is a .pmshare, contents:
Code: [Select]
--- !ruby/struct:CBits::AM::Serialized::V01::SharepointRec
share_uuid: 503f8f7c-2cf4-4348-6714-779f5b56c79b
params: {}
version: 2
File gzip attached

For /Volumes we have:
Code: [Select]
ll -a /Volumes/
total 0
drwxr-xr-x+ 12 root  wheel   384 Mar 14 13:39 .
drwxr-xr-x  29 root  wheel   928 Jul 21  2021 ..
drwxr-xr-x  16 gb    admin   612 Jan 24 17:24 MediaArchive3
drwxr-xr-x  19 gb    admin   714 Feb  1 11:32 MediaCatalogs
drwxrwxr-x  13 gb    admin   416 Jan  5 08:43 SanDisk1t
drwxr-xr-x   4 root  wheel   272 Jan 21 18:35 Time Machine Backups
drwxr-xr-x+  3 root  wheel    96 Mar 14 13:39 com.apple.TimeMachine.localsnapshots
drwx------@  1 root  wheel   264 Mar 14 13:45 com.apple.TimeMachine.wsTM-7C1ED368-EEF0-463B-89FA-D13603E1CB2C
drwx------@  1 gb    admin  2200 Mar  8 13:06 gbshare
drwx------@  1 gb    admin   636 Mar 14 07:27 mediashare
drwxr-xr-x  15 gb    admin   884 Jan 19  2019 workspaceCaseSensitive
lrwxr-xr-x   1 root  wheel     1 Mar  4 12:22 wsHD -> /

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #5 on: March 14, 2022, 11:02:22 AM »
Thanks.  Is there also a .pmshare file at:

/Volumes/mediashare

And if so, does it have a share_uuid of bda6d60a-beb8-4b02-74b4-ea6aedc7ac62 ?

Do you have any "Shared Folders" (See Catalog->Manage Shared Folders...), and if so, what are the paths?  (screenshot is fine.)

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #6 on: March 14, 2022, 04:15:24 PM »
Yes at /Volumes/mediashare:
cat .pmshare
--- !ruby/struct:CBits::AM::Serialized::V01::SharepointRec
share_uuid: bda6d60a-beb8-4b02-74b4-ea6aedc7ac62
params: {}
version: 2

pic.png was attached

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #7 on: March 14, 2022, 04:52:20 PM »
Yes at /Volumes/mediashare:
cat .pmshare
--- !ruby/struct:CBits::AM::Serialized::V01::SharepointRec
share_uuid: bda6d60a-beb8-4b02-74b4-ea6aedc7ac62
params: {}
version: 2

pic.png was attached

OK, I think we've found the problem.  When did you create the shared folder on 'mediashare'?  Was it before or after you had added some images to your catalog?

I think what is happening is that there are two .pmshare files along the path from /Volumes/mediashare/MediaShared/Pictures/ to the root of the disk.  Sometimes one is used and other times the other one is used.

Are you cataloging these images on multiple computers?  https://docs.camerabits.com/support/solutions/articles/48001157499-manage-shared-folders

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #8 on: March 15, 2022, 08:07:39 AM »
I usually catalog on a desktop. I lookup and maybe modify pics on a laptop. I use a rsync script to sync the laptop db to the desktop.

So maybe I changed the "Manage Shared Folders" and the old .pmshare file was left and still some pics were catalogged with the old /Volumes/mediashare/ folder.

So for my situation I probably don't need any of that, as NAS mounts would have the same path for desktop or laptop.

Would you agree? 

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #9 on: March 15, 2022, 09:14:29 AM »
I usually catalog on a desktop. I lookup and maybe modify pics on a laptop. I use a rsync script to sync the laptop db to the desktop.

So maybe I changed the "Manage Shared Folders" and the old .pmshare file was left and still some pics were catalogged with the old /Volumes/mediashare/ folder.

So for my situation I probably don't need any of that, as NAS mounts would have the same path for desktop or laptop.

Would you agree?

Yes, absolutely.

Though I would like to try and figure out how to reproduce the problem and figure a way to prevent it from happening.  Though that may not be possible depending on order of operations.

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #10 on: March 15, 2022, 10:35:24 AM »
I am guessing I probably cataloged some images without any .pmshare s; then saw the "Manage Shared Folders" menu and thought I should add mediashare. Then changed it to to  just the picture path, "/Volumes/mediashare/MediaShared/Pictures" .  Perhaps a warning about changing it? Also what needs to be done when changing it?  If I eliminate the .pmshare s then I must re-catalog the images cataloged with the .pmshare, correct?
 
The documentation seems to me a little thin, maybe a work in progress being filled out. I do like the pdf for PM and hope eventually there is one for PM+

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #11 on: March 15, 2022, 11:18:41 AM »
I am guessing I probably cataloged some images without any .pmshare s; then saw the "Manage Shared Folders" menu and thought I should add mediashare. Then changed it to to  just the picture path, "/Volumes/mediashare/MediaShared/Pictures" .  Perhaps a warning about changing it?

How did you change it?  The UI doesn't provide for changing a path, only adding or deleting a path.  Did you delete it and then add a variant on that path?

Also what needs to be done when changing it?  If I eliminate the .pmshare s then I must re-catalog the images cataloged with the .pmshare, correct?

I think you should be able to delete the .pmshare file (you may just want to rename it instead of deleting it) and then do a Reintegrate Forgotten Catalog operation on your catalog.  Since there are two of them in your path, one created spontaneously when you added photos, and the other when you made the shared folder, you can choose which one to keep, but I'd suggest keeping the one closest to the root folder of your drive.


The documentation seems to me a little thin, maybe a work in progress being filled out. I do like the pdf for PM and hope eventually there is one for PM+

What is this PDF that you mentioned?

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #12 on: March 15, 2022, 12:16:57 PM »

How did you change it?  The UI doesn't provide for changing a path, only adding or deleting a path.  Did you delete it and then add a variant on that path?

Delete then Add path

I think you should be able to delete the .pmshare file (you may just want to rename it instead of deleting it) and then do a Reintegrate Forgotten Catalog operation on your catalog.  Since there are two of them in your path, one created spontaneously when you added photos, and the other when you made the shared folder, you can choose which one to keep, but I'd suggest keeping the one closest to the root folder of your drive.

By spontaneously do you mean automagically? Maybe I added the top level one? Or does PM+ add one at the top of each mounted volume?  So I do need the  .pmshare files that PM+ automagically adds to track the uuid of the volume, correct?


The documentation seems to me a little thin, maybe a work in progress being filled out. I do like the pdf for PM and hope eventually there is one for PM+

What is this PDF that you mentioned?

-Kirk

PDF attached

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Catalog not updating some pic metadata; set color class
« Reply #13 on: March 15, 2022, 01:54:40 PM »
Ah, yes that's a PDF print of: http://wiki.camerabits.com/en/index.php?title=User_Manual_Flat_View

I'm not super happy with the new documentation system.  We're looking into other options.

-Kirk

Offline ibgb

  • Newcomer
  • *
  • Posts: 46
    • View Profile
Re: Catalog not updating some pic metadata; set color class
« Reply #14 on: March 18, 2022, 08:31:57 AM »
FYI
I renamed the downstream "/Volumes/mediashare/MediaShared/Pictures" .pmshare and tried the reintegrate catalog command.

No luck. I do know how to correct those pics, as previously discussed.

To fix this: Would it work if somebody removes a path in "Manage Shared Folders", to go upstream to the root .pmshare and change the catalog to use that root .pmshare uuid? Sometimes it might.