Ah okay, so if I already use an internal dns and do not care about ssh to my netmaker instance I will just remove this config. Now everything works as expected. This took me 2 weeks to figure out. Wouldn't have guessed, that there is something fishy in my docker-compose since it was the default.
Thank you a lot!