Author Topic: Newly added subdirectories not recognized by catalog  (Read 2626 times)

Offline Sonadiatoms

  • Newcomer
  • *
  • Posts: 17
    • View Profile
Newly added subdirectories not recognized by catalog
« on: January 16, 2023, 01:02:13 AM »
I added new folders with image files in them to a subdirectory within the directory set to sync to the catalog.  However, when I sync, it is not recognized.  No new images are added.  I have even tried adding the specific subdirectory to the catalog path, but nothing happens when I try to add it, presumably because it's "supposed" be covered under the umbrella of the top level directory. 

Not sure what to do now.


I see this in the "Errors and Warnings" section, not sure if related:

[Sun 19:54:18] Error: RPCServerConn.rpc_dispatch: exception: RuntimeError/Catalog "Diffusion_Catalog" - database connection closed to=38 msg="end_async_search" location=./archive/common/catalog.rb:273:in `__check_db_open__', ./archive/common/catalog.rb:260:in `end_async_search', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc_object.rb:69:in `block in initialize', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1114:in `call', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1114:in `block in do_rpc_dispatch', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1113:in `catch', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1113:in `do_rpc_dispatch', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/proto/rpc.rb:1062:in `block in rpc_dispatch', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/fiberpool.rb:60:in `call', C:/Program Files/Camera Bits/Photo Mechanic Plus/pmruby/lib/ruby/site_ruby/2.2.0/cila/fiberpool.rb:60:in `block in add_fiber'

Offline ahoward

  • Camera Bits Staff
  • Hero Member
  • *****
  • Posts: 973
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #1 on: January 16, 2023, 11:16:55 AM »
Is this only a problem when you do a sync? Or are other actions that would update the catalog also failing? For example, if you open a folder as contact-sheet and then right-click an image and choose "Include in Catalog" does that fail as well? Or if you go to "Scan to Catalog" and choose the folder you'd like to add, do the items from that folder get added?

Offline ahoward

  • Camera Bits Staff
  • Hero Member
  • *****
  • Posts: 973
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #2 on: January 16, 2023, 03:12:31 PM »
Please also let us know what kind of files are in the subfolder you created.

Offline Sonadiatoms

  • Newcomer
  • *
  • Posts: 17
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #3 on: January 17, 2023, 03:43:10 AM »
It appears that catalog sync is the problem.  I am able to add the images to catalog using the right-click->add to catalog in the contact sheet. 
They are all PNG images.

Offline ahoward

  • Camera Bits Staff
  • Hero Member
  • *****
  • Posts: 973
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #4 on: January 17, 2023, 09:01:18 AM »
A screenshot of your Catalog Sync window and a window showing the files in the folder with their folder structure may be helpful.

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Newly added subdirectories not recognized by catalog
« Reply #5 on: January 17, 2023, 09:29:06 AM »
I added new folders with image files in them to a subdirectory within the directory set to sync to the catalog.  However, when I sync, it is not recognized.  No new images are added.  I have even tried adding the specific subdirectory to the catalog path, but nothing happens when I try to add it, presumably because it's "supposed" be covered under the umbrella of the top level directory. 

I see this in the "Errors and Warnings" section, not sure if related:

[Sun 19:54:18] Error: RPCServerConn.rpc_dispatch: exception: RuntimeError/Catalog "Diffusion_Catalog" - database connection closed

Does the timestamp in the above error message correspond with the time during your Catalog Sync operation?

-Kirk

Offline Sonadiatoms

  • Newcomer
  • *
  • Posts: 17
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #6 on: January 17, 2023, 04:38:31 PM »
Strangely, sync is once again working with some other subfolders within the main folder.  I didn't change anything. 

@Kirk:  I wish I had screenshotted the error message to get its date stamp.  The error field is now blank so I can't check.

However, one side effect of using the workaround suggested earlier (of opening a contact sheet and right clicking -> add to catalog) is that whenever I try to open any of those items in Windows Explorer, only the top level directory (with my different disk drives) opens up, rather than the actual file.  This makes those pretty hard to work with. 
I am reluctant to "remove from catalog" for these folders, in case that might cause future sync issues.   

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Newly added subdirectories not recognized by catalog
« Reply #7 on: January 17, 2023, 04:52:09 PM »
Strangely, sync is once again working with some other subfolders within the main folder.  I didn't change anything. 

@Kirk:  I wish I had screenshotted the error message to get its date stamp.  The error field is now blank so I can't check.

It was in your original post and I quoted it, but here it is again: [Sun 19:54:18]

However, one side effect of using the workaround suggested earlier (of opening a contact sheet and right clicking -> add to catalog) is that whenever I try to open any of those items in Windows Explorer, only the top level directory (with my different disk drives) opens up, rather than the actual file.  This makes those pretty hard to work with. 
I am reluctant to "remove from catalog" for these folders, in case that might cause future sync issues.

What is an example of the path of one of the files?

-Kirk

Offline Sonadiatoms

  • Newcomer
  • *
  • Posts: 17
    • View Profile
Re: Newly added subdirectories not recognized by catalog
« Reply #8 on: January 17, 2023, 06:30:49 PM »
Quote
It was in your original post and I quoted it, but here it is again: [Sun 19:54:18]
I meant making a note of when the failed sync happened, sorry for the confusion.

Quote
What is an example of the path of one of the files?
C:\Users\Username\Dropbox\2D-Assets\AI_StableDiffusion\_SD-Gens\_Best-DreamlikeDiffusion\Fun Factory Bauhaus

The top level directory of the catalog is "_SD-Gens"

Offline Kirk Baker

  • Senior Software Engineer
  • Camera Bits Staff
  • Superhero Member
  • *****
  • Posts: 25020
    • View Profile
    • Camera Bits, Inc.
Re: Newly added subdirectories not recognized by catalog
« Reply #9 on: January 18, 2023, 09:12:14 AM »
Quote
What is an example of the path of one of the files?
C:\Users\Username\Dropbox\2D-Assets\AI_StableDiffusion\_SD-Gens\_Best-DreamlikeDiffusion\Fun Factory Bauhaus

The top level directory of the catalog is "_SD-Gens"

The above is just a directory, what is the full path to the file?  What method are you using to get Windows Explorer to show the file?

-Kirk