Because when you press save, it saves the gimp project. It makes sense, because you're working on a project in gimp, and that project has to be converted to a different format for use as an image.
It's like expecting MS Word to print the page when you click save.