My problem is solved by turning hole punching on at the network level and off for the client running on the server.