The setting for notifications in the Gmail app settings overrides the general notification setting in Settings. Turn it on in the Gmail app settings.