You can right click on the marker and select delete.
You can also find the Edit Details window and filter for markers, then Control+ select and delete a whole lot at once.
If your default project has markers, you will get the markers back when a new project is created. Save a new default project the way you want it.
F1 is your friend.