Author Topic: Image previews missing  (Read 38123 times)

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #60 on: November 09, 2020, 08:55:50 PM »
Thanks, Kirk.

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #61 on: November 30, 2020, 04:58:47 PM »
Hi Kirk

I bought the license and started indexing the NAS again. This time, I moved my NAS to a wired GigE network.  I connected my mini and the NAS to a Google Wifi Router's GigE ports and I get better speeds.  However, i see the following errors.

Mon 16:29:45] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2005/07/12/DSC_7372.NEF", "msg"=>"file not found"}
[Mon 16:29:45] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2005/07/12/DSC_7373.NEF", "msg"=>"file not found"}
[Mon 16:29:45] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2005/07/12/DSC_7374.NEF", "msg"=>"file not found"}
[Mon 16:29:45] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2005/07/12/DSC_7375.NEF", "msg"=>"file not found"}
[Mon 16:29:45] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2005/07/12/DSC_7376.NEF", "msg"=>"file not found"}

Hundreds of those, but the files are there.

▶ ll /Volumes/Pictures/2005/07/12/DSC_7376.NEF
-rwxrwxrwx  1 kumar  staff   5.1M Jul 12  2005 /Volumes/Pictures/2005/07/12/DSC_7376.NEF

The mount is still there and I am running Jiggler as well so my mac does not go to sleep.

Any idea why these files are not found by PM+?  I need to do a sync again after this pass is done (it is going at 3/sec, so another day or so).

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 24756
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #62 on: November 30, 2020, 05:56:47 PM »
▶ ll /Volumes/Pictures/2005/07/12/DSC_7376.NEF
-rwxrwxrwx  1 kumar  staff   5.1M Jul 12  2005 /Volumes/Pictures/2005/07/12/DSC_7376.NEF

The mount is still there and I am running Jiggler as well so my mac does not go to sleep.

Any idea why these files are not found by PM+?  I need to do a sync again after this pass is done (it is going at 3/sec, so another day or so).

Can you do a list like you did above, but also add a parameter that shows the access control lists?

ls -le /Volumes/Pictures/2005/07/12/DSC_7376.NEF

Please paste the output to your reply.

Thanks,

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #63 on: November 30, 2020, 06:01:01 PM »
▶ ls -le /Volumes/Pictures/2005/07/12/DSC_7376.NEF
-rwxrwxrwx  1 kumar  staff  5349990 Jul 12  2005 /Volumes/Pictures/2005/07/12/DSC_7376.NEF

~


I have 100s more errors now, but different.

[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/17", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/22", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/22", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/25", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/28", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/29", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/29", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/29", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/29", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/29", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/30", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/30", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/30", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/30", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/31", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/31", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/31", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/31", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res/backgroundimages", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res/backgroundimages", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res/ecard", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res", "msg"=>"path not found"}
[Mon 17:58:49] {"cmd"=>"metadata_fetch", "file"=>"/Volumes/Pictures/2008/08/Anirudh/res", "msg"=>"path not found"}

▶ ls -le /Volumes/Pictures/2008/08/31
total 1033294
-rwxrwxrwx  1 kumar  staff  12506592 Sep  1  2008 DSC_4975.NEF
-rwxrwxrwx  1 kumar  staff  12564432 Sep  1  2008 DSC_4976.NEF
-rwxrwxrwx  1 kumar  staff  13245279 Sep  1  2008 DSC_4983.NEF
-rwxrwxrwx  1 kumar  staff  12934713 Sep  1  2008 DSC_4984.NEF
-rwxrwxrwx  1 kumar  staff  13302408 Sep  1  2008 DSC_4985.NEF
-rwxrwxrwx  1 kumar  staff  12923205 Sep  1  2008 DSC_4986.NEF
-rwxrwxrwx  1 kumar  staff  12957726 Sep  1  2008 DSC_4987.NEF
-rwxrwxrwx  1 kumar  staff  13226770 Sep  1  2008 DSC_4988.NEF
-rwxrwxrwx  1 kumar  staff  12987441 Sep  1  2008 DSC_4989.NEF
-rwxrwxrwx  1 kumar  staff  11803759 Sep  1  2008 DSC_4990.NEF
-rwxrwxrwx  1 kumar  staff  13058234 Sep  1  2008 DSC_4991.NEF
-rwxrwxrwx  1 kumar  staff  12716494 Sep  1  2008 DSC_4992.NEF
-rwxrwxrwx  1 kumar  staff  11509736 Sep  1  2008 DSC_4993.NEF
-rwxrwxrwx  1 kumar  staff  13022963 Sep  1  2008 DSC_4994.NEF
-rwxrwxrwx  1 kumar  staff  12462733 Sep  1  2008 DSC_4995.NEF
-rwxrwxrwx  1 kumar  staff  13516508 Sep  1  2008 DSC_4996.NEF
-rwxrwxrwx  1 kumar  staff  13115740 Sep  1  2008 DSC_4997.NEF
-rwxrwxrwx  1 kumar  staff  12255380 Sep  1  2008 DSC_4998.NEF
-rwxrwxrwx  1 kumar  staff  12243381 Sep  1  2008 DSC_4999.NEF
-rwxrwxrwx  1 kumar  staff  12413895 Sep  1  2008 DSC_5000.NEF
-rwxrwxrwx  1 kumar  staff  11294156 Sep  1  2008 DSC_5001.NEF
-rwxrwxrwx  1 kumar  staff  11050521 Sep  1  2008 DSC_5002.NEF
-rwxrwxrwx  1 kumar  staff  11448810 Sep  1  2008 DSC_5003.NEF
-rwxrwxrwx  1 kumar  staff  11828716 Sep  1  2008 DSC_5004.NEF
-rwxrwxrwx  1 kumar  staff  11505297 Sep  1  2008 DSC_5005.NEF
-rwxrwxrwx  1 kumar  staff  11911119 Sep  1  2008 DSC_5006.NEF
-rwxrwxrwx  1 kumar  staff  12275481 Sep  1  2008 DSC_5007.NEF
-rwxrwxrwx  1 kumar  staff  11668898 Sep  1  2008 DSC_5008.NEF
-rwxrwxrwx@ 1 kumar  staff  73310580 Sep  2  2008 DSC_5011-Edit.tif
-rwxrwxrwx  1 kumar  staff  10257256 Sep  1  2008 DSC_5011.NEF
-rwxrwxrwx@ 1 kumar  staff  73311036 Sep  2  2008 DSC_5012-Edit.tif
-rwxrwxrwx  1 kumar  staff  10679152 Sep  1  2008 DSC_5012.NEF
-rwxrwxrwx  1 kumar  staff  12514650 Sep  1  2008 DSC_5013.NEF

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #64 on: November 30, 2020, 06:06:31 PM »
I would not be surprised if this is some idiocy with OSX and SMB.  My external HDD will arrive in a week or so, I will try to copy my ~4TB photos to it (that will be weeks) and then create a new catalog or something.

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #65 on: December 04, 2020, 11:12:02 AM »
Hi Kirk

I successfully built the catalog but for those few errors.  I did a full catalog sync.

1) Now, I disconnected the NAS and I did a Catalog - Browse - EXIF - chose a lens and I do not see any previews :(.

This is the build I am on. Photo Mechanic Plus Version 6.0, build 5376 (14f9534)

2) Even after I did a full sync, I do not see the 2008/08/29 images in the catalog (and one more set that is missing from 2011).


Catalog size on disk is 11,928,923,896 bytes (12 GB on disk) for 29,083 items.  It is still less than the 100+ GB that support told me the catalog should be for nearly 140k images.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 24756
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #66 on: December 04, 2020, 11:45:29 AM »
I'd like to see your Photo Mechanic log.  In Photo Mechanic go to the Help menu and choose "Reveal Support Data..." and moments later a Finder window will come forward with the zipped log file selected.  Use the 'Attachments and other options' link when you're composing your reply to this message and there you'll be able to upload your zipped PM log file.

Thanks,

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #67 on: December 04, 2020, 11:51:05 AM »
Error while generating logs.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 24756
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #68 on: December 04, 2020, 01:02:52 PM »
Error while generating logs.

OK, the combined size must be too large for a single zip file.  In the folder where the zip file is created, you'll have to manually select them and compress them and then post them here.

Thanks,

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #69 on: December 04, 2020, 01:14:25 PM »
Kirk

It failed before I chose the directory.  I forgot where the log files are on Mac.  Can you please point me to that directory?

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #70 on: December 04, 2020, 01:32:21 PM »
Rebooting my mac allowed me to generate the log zip file.  Attached.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 24756
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #71 on: December 04, 2020, 03:52:35 PM »
Rebooting my mac allowed me to generate the log zip file.  Attached.

Thank you for the log file.  Our image processing/metadata parsing code is getting a number of errors while building the proxies.  Unfortunately, the algorithm isn't moving on to the next file once it gets an error.  It keeps retrying endlessly.  We'll have to fix that.

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #72 on: December 04, 2020, 04:03:02 PM »
I see.  Is this something that may be fixed if I build from a local USB drive? I am getting the drive shortly, so I am going to copy the files over from NAS to the USB drive and start a new catalog. 

Nonetheless, I will wait for a new build and update. It will be many days before I am done copying the files over anyway.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 24756
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #73 on: December 04, 2020, 04:11:55 PM »
I see.  Is this something that may be fixed if I build from a local USB drive?

It's certainly possible, but we've got to fix it either way.

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 83
    • View Profile
Re: Image previews missing
« Reply #74 on: December 04, 2020, 04:23:11 PM »
No worries.  I will give it a shot from the USB drive.

Unrelated question.  I saw that PhotoMechanic tells us if there is a new build to download.  Doesn't Photo Mechanic Plus do that? Is there a way to be notified if there is a new build to try?