If i remember correctly it also happens when no contact sheet was open. I will observe this closer.
Kirk, the reason why I actually don't close PM (and a few other programs) before I shut down is that I really like OS X' feature to automatically load all programs that ran at shutdown. I boot from a SSD and the whole process is so quick, even when additional programs are starting, that I see it as a great convenience.