Well, they are all menu icons, as you surmised.
The icons with the page fold in the upper-right corner represents a menu template.
The icon with the star over it represents the default menu (the menu that gets imported into the project when you press Ctrl/Cmd + M (Windows/Mac).