Thanks for your answer. I tried the solution you provided and it worked. The I removed it again (since it really should be unnecessary) and it still worked. No idea what I did wrong in the first place, but thanks a lot anyways.
I am still running into problems with letsencrypt resp. reverse proxy config though, but I think better start a new thread for that one.