Photo Mechanic Version 6.0, build 6890 (ffcbb4c) duplicate downloads

[rcohn]

At first I thought I had done something wrong when I saw some duplicate files downloaded a few days ago, and I went through and deleted the duplicates, but yesterday PM re-downloaded the entire card even though there should have only been a limited number of new files on the card. I had changed time zones so wanted to download the remaining files and wipe the card before changing the camera time.

Deleting these duplicate files is a real mess since I have already culled a number of files and now they are downloaded as singles. Carefully fixing this is going to take me a while. However, my biggest concern is whether I did something wrong or if there is a problem with this build. First thing I'm going to do is revert to 6.0, build 6784 (409cf99) which had been rock solid. I had already had a problem with the previous build which was supposed to be fixed with 6890.

The screenshot shows image number 00016 downloaded and named on 10/27/23 and the same image numbered 03593 which was downloaded last night 11/3/23).

Using a MacBook Pro 16 inch 2021 with M1 Pro chip. Ventura 13.5.1.

I'm pretty sure this is not user error, but I could be wrong.

[Kirk Baker]

At first I thought I had done something wrong when I saw some duplicate files downloaded a few days ago, and I went through and deleted the duplicates, but yesterday PM re-downloaded the entire card even though there should have only been a limited number of new files on the card. I had changed time zones so wanted to download the remaining files and wipe the card before changing the camera time.

Deleting these duplicate files is a real mess since I have already culled a number of files and now they are downloaded as singles. Carefully fixing this is going to take me a while. However, my biggest concern is whether I did something wrong or if there is a problem with this build. First thing I'm going to do is revert to 6.0, build 6784 (409cf99) which had been rock solid. I had already had a problem with the previous build which was supposed to be fixed with 6890.

The screenshot shows image number 00016 downloaded and named on 10/27/23 and the same image numbered 03593 which was downloaded last night 11/3/23).

Using a MacBook Pro 16 inch 2021 with M1 Pro chip. Ventura 13.5.1.

I'm pretty sure this is not user error, but I could be wrong.

If you still have the image on the card, what is the modification time of the image on the card?

-Kirk

[ahoward]

I did my best to simulate your workflow and the time zone change to see if I could reproduce the issue and I was not able. Daylight savings time can mess up incremental Ingest until the card is formatted, so it's not impossible that a time change could cause the issue as well.

Carefully fixing this is going to take me a while.

It's possible that we can take care of this pretty easily using the frame value. If you want to give that a shot, I'd ask you to give our support team a call, as its an easy process to show you but a lengthy one to type out.

[rcohn]

Thank you Kirk and ahoward, I purposely have not reformatted the card. I have attached a screenshot of the image on the card in the Mac Finder. Created Friday, October 27, 2023 at 12:26 PM. I have also attached screenshots for the downloaded and renamed file and the associated .xmp file. I did delete the duplicate download so can't look at that.

Since I didn't change the time in the camera until after downloading this card I don't see how the camera could know there was a time change from Arizona to NJ. I also had this problem before the end of Daylight Savings Time on Saturday night so even if the camera has an internal knowledge of this date (which I do not believe is the case) that time change is not likely to be the cause. I will try to find the time to call the support team tomorrow, but will the person who answers know about my problem or will I have to try to explain it all again?

Thanks,

Ric Cohn

[ahoward]

I will try to find the time to call the support team tomorrow, but will the person who answers know about my problem or will I have to try to explain it all again?

Feel free to ask for Andrew, I'm in at 9 am PST.

[Kirk Baker]

Ric,

Thank you Kirk and ahoward, I purposely have not reformatted the card. I have attached a screenshot of the image on the card in the Mac Finder. Created Friday, October 27, 2023 at 12:26 PM. I have also attached screenshots for the downloaded and renamed file and the associated .xmp file. I did delete the duplicate download so can't look at that.

Since I didn't change the time in the camera until after downloading this card I don't see how the camera could know there was a time change from Arizona to NJ. I also had this problem before the end of Daylight Savings Time on Saturday night so even if the camera has an internal knowledge of this date (which I do not believe is the case) that time change is not likely to be the cause. I will try to find the time to call the support team tomorrow, but will the person who answers know about my problem or will I have to try to explain it all again?

When the system's time zone changes or when there is a change due to daylight savings time transition, the modification time of files on disks changes as well.  Ingest records the modification times of the files it copies to a file (for later use by Incremental Ingest.)  If the time offset on the system changes, the system will report modification times for files different than it did before (they'll change by some number of hours depending on the situation).  This causes Incremental Ingest to ingest files that have already been ingested.

This problem has affected Incremental Ingest for many years.  Now, if you're saying that not all of the images shot prior to your time zone change were copied again, then we may have a different situation.  We'd need to analyze the incremental ingest data files and the files on your card.

-Kirk

[rcohn]

Kirk,

If I'm understanding you correctly, it is the computer's changing its time zone that causes this? That of course happens automatically when you travel to a different time zone and connect to the internet. That is very good information to know. I will need to make sure all files are downloaded before connecting to the internet if I shoot in one time zone and don't have an opportunity to download those files before traveling to a new time zone (although harder for me to remember and deal with).

Ric

[Kirk Baker]

Ric,

If I'm understanding you correctly, it is the computer's changing its time zone that causes this? That of course happens automatically when you travel to a different time zone and connect to the internet. That is very good information to know. I will need to make sure all files are downloaded before connecting to the internet if I shoot in one time zone and don't have an opportunity to download those files before traveling to a new time zone (although harder for me to remember and deal with).

And you'll need to either remove the old images from the card or reformat it in camera, or they'll be downloaded again.

-Kirk

[rcohn]

Kirk,

I did find the duplicate file from the screen shot in the original post. I forgot that I moved them all to a separate folder rather than the trash in case I made a mistake and haven't deleted it yet. The downloaded duplicate has the same Created time as my screenshot from the card. Why it only differs by 1 hour instead of 3 is a mystery to me, but the important thing is I can see why PM would think it is a new file.

Thanks as always for your help,

Ric

[Kirk Baker]

You're welcome, Ric.

-Kirk