Author Topic: Image previews missing  (Read 61296 times)

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #75 on: December 04, 2020, 05:31:25 PM »
No worries.  I will give it a shot from the USB drive.

Unrelated question.  I saw that PhotoMechanic tells us if there is a new build to download.  Doesn't Photo Mechanic Plus do that? Is there a way to be notified if there is a new build to try?

Yes, it does the same thing.  It will notify you when a new build is available unless you've turned off the updates checking.

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #76 on: December 08, 2020, 10:07:40 AM »
Hi Kirk

I got the external HDD, a 12 TB WD Elements. I copied all the images from my NAS to the external HDD.  I deleted my existing catalog, created a new catalog and included images from my 2TB SSD and 12TB HDD to the catalog.  The catalog itself is on the 500GB SSD of Mac Mini.

The catalog is built, but "Catalog Image Preview Generation" is stuck at 11357 batches remaining since yesterday.

I did a full sync to see if it changes anything.  It did not. 

The catalog itself is 12.31GB on my disk, which is an improvement from before (NAS) but I have 141k images, so the numbers don't match the 35-40GB disk space expected.

I have attached the catalog screen where it hangs and the PM log file.

Offline Bill Kelly

  • Software Developer
  • Full Member
  • ***
  • Posts: 131
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #77 on: December 08, 2020, 12:14:09 PM »
The catalog is built, but "Catalog Image Preview Generation" is stuck at 11357 batches remaining since yesterday.

Thanks for the logs.

It appears the Preview Generation stall is due to a bug causing a Catalog sub-program to abort when loading TIFF files. (E.g. 20100410-_SAK5636_HDR.tif)

We have a fix completed in our development branch, and ready for the next PM Plus build, which should be deployed soon.

Sorry for the inconvenience.

-Bill


Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #78 on: December 08, 2020, 12:20:07 PM »
Sounds good Bill, thanks.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #79 on: December 08, 2020, 02:59:27 PM »
This build addresses the problem: http://forums.camerabits.com/index.php?topic=13781.0

Please give it a try.

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #80 on: December 08, 2020, 03:35:17 PM »
Hi Kirk

Should I start a new catalog? Or do a full sync? How do I regenerate proxies?

Offline Bill Kelly

  • Software Developer
  • Full Member
  • ***
  • Posts: 131
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #81 on: December 08, 2020, 05:00:26 PM »
Hi,

Should I start a new catalog? Or do a full sync? How do I regenerate proxies?

I'd recommend a Full Sync for now, which will attempt to generate missing proxies. The latest build should prevent it from getting stuck where it used to.

(Note that based on indications from your logfiles, there may be some subset of proxies which are not detected as missing, due to an apparent mismatch between the proxy database and files actually present in the proxies folder. This latest build will not yet resolve that unexpected case, so you may still end up with a few gaps after the Full Sync. I expect our next build of PM Plus to be able to repair any such gaps.)

Regards,

Bill


Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #82 on: December 08, 2020, 05:27:50 PM »
Thanks. I am doing a full sync now. I will update how it goes and the log file.

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #83 on: December 08, 2020, 06:46:16 PM »
I got the new build, started a full sync.  It is stuck at "Catalog Image Preview Generation" 11344 batches for over an hour now.

I have attached screenshots and logs.

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #84 on: December 08, 2020, 07:05:27 PM »
tail -f on dyn.log shows me that it is spinning here endlessly.

[2020-12-08 19:04:25.887 Tue] [59375:3ffa7d8561e8:3ffa65c58614] [DBG_] DYN: CBits::AM::ProxyGenTask.schedule_proxy_gen_on_fiber: [START] {"cat_uuids"=>["98a22c6d-db9a-4bca-60b7-823c9c1dbc85"], "paths"=>[["amdoc://49dc4bb2-e790-4f44-64b6-39b45d5bd283/2003/09/25/PICT0435.JPE", "/Volumes/Backup/Pictures/2003/09/25/PICT0435.JPE"]], "size"=>1600}
[2020-12-08 19:04:25.887 Tue] [59375:3ffa7d8561e8:3ffa65c58614] [WARN] Hub: <70345083424860>[127.0.0.1:63361] CILA::PROTO::RPCServerConn.rpc_dispatch: exception: RuntimeError/rpc_dispatch_fwd: nil map to fwd_rpc from fwd_rpc_id in portkey to=[[70345083424860, 70344686797120], 0] msg="image_resize_batch" location=/Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1150:in `rpc_dispatch_fwd', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1081:in `do_rpc_forward', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1051:in `rpc_dispatch', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:469:in `do_rpc_dispatch_or_forward_msg', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:454:in `block in dispatch_rpc_messages', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:442:in `rpc_dispatch_nest', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:449:in `dispatch_rpc_messages', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:425:in `block in st_recv_rpc_run', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/noraise.rb:24:in `noraise', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:425:in `st_recv_rpc_run', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:257:in `receive_data', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/eventmachine.rb:193:in `run_machine', /Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/eventmachine.rb:193:in `run', ./dyn/script/start_dyn_platform.rb:156:in `<main>'
[2020-12-08 19:04:25.887 Tue] [59375:3ffa7d8561e8:3ffa65c58074] [DBG_] DYN: CBits::AM::ProxyGenTask.schedule_proxy_gen_on_fiber: [FINISH] uuid={"cat_uuids"=>["98a22c6d-db9a-4bca-60b7-823c9c1dbc85"], "paths"=>[["amdoc://49dc4bb2-e790-4f44-64b6-39b45d5bd283/2003/09/25/PICT0435.JPE", "/Volumes/Backup/Pictures/2003/09/25/PICT0435.JPE"]], "size"=>1600}
[2020-12-08 19:04:25.887 Tue] [59375:3ffa7d8561e8:3ffa65c58074] [ERR!] CILA::FiberPool: fiber outer exception: image_resize_batch failed: ["image_resize_batch: RuntimeError/rpc_dispatch_fwd: nil map to fwd_rpc from fwd_rpc_id in portkey"] - ["/Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:649:in `call'", "/Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:665:in `method_missing'", "./archive/common/am_cache.rb:735:in `gen_local_scaled_image_batch'", "./archive/common/am_cache.rb:698:in `gen_proxy_batch'", "./archive/app/am_app_util.rb:2153:in `gen_local_proxy_batch'", "./archive/app/am_app_util.rb:2318:in `block in schedule_proxy_gen_on_fiber'", "/Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/fiberpool.rb:60:in `call'", "/Applications/Photo Mechanic Plus.app/Contents/pmruby/lib/ruby/site_ruby/2.2.0/cila/fiberpool.rb:60:in `block in add_fiber'"]

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #85 on: December 08, 2020, 07:39:50 PM »
Would you mind posting the full log files, please?

Thanks,

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #86 on: December 08, 2020, 08:50:16 PM »
Sorry, I thought I uploaded it along with the screenshots.  Attached again.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Image previews missing
« Reply #87 on: December 09, 2020, 06:26:02 PM »
Could you please try this build? https://www.camerabits.com/download/PhotoMechanicPlusR5415_5266cf93.dmg

The sample image you provided is damaged.  It won't decode properly, but the catalog task shouldn't crash on it either.  I have made changes to the library to prevent that crash from occurring again.

Thanks,

-Kirk

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #88 on: December 09, 2020, 06:46:29 PM »
Ok. Is there a new build for me to try?

Offline obelix74

  • Member
  • **
  • Posts: 87
    • View Profile
Re: Image previews missing
« Reply #89 on: December 09, 2020, 06:47:12 PM »
Sorry just saw the new build.