Ingesting Same Photos Multiple Times?

[DylanHeuer]

Hello there,

Ever since I updated my photo mechanic plus (currently Build 6424), it has been ingesting the same photos multiple times.

Sometimes when I shoot an event, I'd ingest the first batch of photos to my laptop during the middle of it. Then head back out and shoot with the same card (without formatting it), and when I come back to ingest the new batch of photos, it'll upload new batch of photos AND the old batch.

I have "incremental ingest: copy new photos only" checked on, but it doesn't seem to stop the first batch of photos from uploading again.

See attached screenshot for reference.

Any advice you may have would be greatly appreciated.

Thank you!

[Kirk Baker]

I'd like to see your Photo Mechanic Plus log.  In Photo Mechanic Plus go to the Help menu and choose "Reveal Support Data..." and moments later a Finder window will come forward with the zipped log file selected.  Use the 'Attachments and other options' link when you're composing your reply to this message and there you'll be able to upload your zipped PM log file.

Thanks,

-Kirk

[DylanHeuer]

Hi Kirk,

Here's the log. Let me know if that works for you.

Thanks,
DH

[Kirk Baker]

Dylan,

Thank you for the log.  Incremental Ingest is unable to create/read/write files to its cache (where it stores information about the files you ingested previously).  I see that it's in an unusual location:

/Users/dylanheuer/Applications/ingest/incremental

Did you change the location of the Disk Cache in the Caching page of the Preferences dialog?  It's usually in this location:

/Users/dylanheuer/Library/Caches/Photo Mechanic

If you've changed it and PM doesn't have permission to create/write files there, then various features are going to fail to work correctly.  I suggest clicking the "Use Default" button to restore the Disk Cache path and see if that improves things for you.

-Kirk

[DylanHeuer]

Thank you. I can give that a try. Where can I click on "Use Default" to restore it?

[Kirk Baker]

Dylan,

Thank you. I can give that a try. Where can I click on "Use Default" to restore it?

Sorry, I wasn't clear enough.  In the Caching page of the Preferences dialog in Photo Mechanic Plus, near the top of the page.

Other things I saw in your log: I noticed that for a time, your DNS server's IP address was 0.0.0.0 which is invalid.  There's also a number of errors and odd things going when uploading to SmugMug.

-Kirk

[Colin Hackley]

Hi Kirk,

I'm on Max OS 11.6.5 and often encounter this same problem of PM 6+ ingesting previously ingested files that are still on the hard drive (and being managed by PM+).

The files on the card and on my hard drive always have the same names (I do not tell PM to rename the files on ingest).

I always have Incremental Ingest (copy new photos only) selected in the ingest box.

There does not seem to be a rhyme or reason as to why PM+ (Although I have had this happen on PM and PM+ versions) decides it wants ingest everything on the card and when it scans the card and only pulls in the new files.

I went to check my cache page settings per the conversation above and noticed that I have "Empty Disk Cache on Quit" selected (a setting I have had selected for years to free up resources on my computer). Would emptying the cache on Quit contribute to PM and PM+ "forgetting" about previously ingested files and pulling them back onto the hard drive again?

Would any of the other remove cached files choices on that page contribute to this problem?

This issue can be a real bummer when you are on deadline and PM+ starts pulling in all the contents from a big card when you really only need the last 50 files.

Thank you,
Colin

[Kirk Baker]

Colin,

I'm on Max OS 11.6.5 and often encounter this same problem of PM 6+ ingesting previously ingested files that are still on the hard drive (and being managed by PM+).

The files on the card and on my hard drive always have the same names (I do not tell PM to rename the files on ingest).

I always have Incremental Ingest (copy new photos only) selected in the ingest box.

There does not seem to be a rhyme or reason as to why PM+ (Although I have had this happen on PM and PM+ versions) decides it wants ingest everything on the card and when it scans the card and only pulls in the new files.

I went to check my cache page settings per the conversation above and noticed that I have "Empty Disk Cache on Quit" selected (a setting I have had selected for years to free up resources on my computer). Would emptying the cache on Quit contribute to PM and PM+ "forgetting" about previously ingested files and pulling them back onto the hard drive again?

Would any of the other remove cached files choices on that page contribute to this problem?

This issue can be a real bummer when you are on deadline and PM+ starts pulling in all the contents from a big card when you really only need the last 50 files.

Does the problem happen to you only twice a year?  When the system clock changes due to the transition from standard time <-> daylight savings time, the times of files on the card are reported as being one hour different than when they were taken.  This causes Ingest to see them as different and it ingests them again.

-Kirk

[Colin Hackley]

Hi Kirk,

Thanks for the response, I did have the time change issue happen this spring (I didn't know at the time why it was happening, but I that makes sense) is there any way to avoid that or do you just have to start with fresh cards on the time change?

Returning to the previous question I feel like this happens more often than the time changes. Can just fine tuning the clocks on your cameras do this? Every so often I will re-synchronize my camera clocks so images display in sequence when viewing images sorted by capture time.

Thank you,

Colin

[Kirk Baker]

Colin,

Thanks for the response, I did have the time change issue happen this spring (I didn't know at the time why it was happening, but I that makes sense) is there any way to avoid that or do you just have to start with fresh cards on the time change?

It's a problem that has existed for a long time.  Though now that time changes are soon to be a thing of the past, it shouldn't affect anyone much longer.

Returning to the previous question I feel like this happens more often than the time changes. Can just fine tuning the clocks on your cameras do this? Every so often I will re-synchronize my camera clocks so images display in sequence when viewing images sorted by capture time.

No, unless somehow doing so alters the time of existing images on the card.

-Kirk