Without UDP hole punching it can still take up to a minute. So sometimes you just need to wait a minute for things to start working