Size of Header Media Section

Hello! I deliberately activated the header media only on my frontpage. On all other pages sadly the Header Media Section is pretty big and does not vanish so that the content is not placed directly under the menu bar (what I would favor). Is there a way to control the size of the header media section on pages where I deactivated the header media? Thanks in advance.