Thanks Alex and Tero. I followed these steps from the link Tero sent:
Settings: as I mentioned, I have “Write XMP ID to Files on Import” and “Enable Clip and XMP Metadata Linking” enabled on both machines, and “Save Media Cache files next to originals when possible” UNchecked on both machines.
After that I reimported the sequence, and the markers were back. Thanks!