So true. There are images I would NEVER put on glossy and others that I would ONLY put on glossy. It all depends on how you want the final image to look.
Plus each brand and type of paper looks different. It is not just a glossy/matte issue.
Play with it.