Two network egress issue
# client
h
a few issues still with this v18 sever/client for me. 1) 18.7 client seems to have lost all egress functionality. two different networks, different locations. I can ping the egress nodes on their wireguard interfaces, but the egress ranges are unresponsive, although an existing external client still has connectivity 2) the existing nodes from 18.5 and 18.6 don't show the new 18.7 client versions in the dashboard. 3) My linux and synology hosts are trying to checkin to an old server that I was testing with a different domain: dashboard.netmaker-test.my.net. They were properly removed from the networks (leave, uninstall) but the routes still show with ip a). They pull the correct server, but then hang for 20 seconds or so, and then report the old server as unresponsive 4) windows client commands give no feedback in the shell, but pull seems to work at least - no help or other options available 5) 18.7 server ui no longer has an option to set the default external client dns server which I gather is deprecated. The existing default DNS server for my main network is still visible in the network details in the ui, but cannot be removed or edited. 6) back to an issue apparent since v16: a host runnign netclient on the same network as an egress gateway loses connectivity to the netmaker server (dashboard, ssh) until the client is diconnected. this was possible in the old netclient ui, but disconnecting the network in the v18+ ui has no effect. disabling the interface in the windows network connections does restore access to the dashboard and ssh connectvity to the server. 7) I cannot create new external clients on the upgraded egress gateway, just hangs with pending - I imagine that deleting the existing external clients and recreatign the egress node might fix this if something big has changed, but this causes a few issues for my environment. I will try to test after hours and revert to a snapshot if it all goes wrong. 8) I'm sure it's going to be awesome again soon!
j
thank you for the feedback, this is very helpful. We're aware of several of these and are working on fixes. For #1, can you share information about the iptables and nftables available on the host? There are known issues with conflicts between iptables and nftables that we are hoping to resolve in the next release.
h
Hi @jolly-london-20127 iptables v1.8.7 (nf_tables) on Ubuntu 22.04
Anything else that would help? I'm not too familiar with iptables/nf_tables
j
Can you check if iptables-legacy or iptables-nft are available?@bored-island-21407 anything you can add?
h
Those commands are not available
b
I would like to see the routing table on the egress and the allowed ips on a node that cannot connect to the egress range
so only nft?
h
nftables v1.0.2 (Lester Gooch)
b
what is output of
nft list ruleset
on egress gateway?
h
I have to go back to 17.1 to get back to the network with that egress node. couple of mins
Copy code
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.1     0.0.0.0         UG    0      0        0 eth0
xxx.xxx.xxx.200    192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
10.12.14.0      0.0.0.0         255.255.255.0   U     0      0        0 netmaker
10.20.30.254    0.0.0.0         255.255.255.255 UH    0      0        0 netmaker
xxx.xxx.xxx.196   192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
xxx.xxx.xxx.127  192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
xxx.xxx.xxx.127 192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
xxx.xxx.xxx.175  192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
xxx.xxx.xxx.49   192.168.1.1     255.255.255.255 UGH   0      0        0 eth0
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 eth0
Not sure the formatting is too good here. I can send it another way if you can't copy it out
This is the egress gateway that also tries to reach 10.20.30.0 which was an early test of 18.4
b
what is your egress range cidr
are you trying to get a v0.18.x node to talk to a v0.17.1 egress?
h
No, but I have a 17.1 egress node on a different network and server behind the same NAT
the egress range is 192.168.1.0/24
b
the last line in your routing table does not make sense to me 192.168.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
can you actually connect to anything on the egress range from the egress node? I should think not with that routing rule
h
Well external clients can connect. i can reach the webui of servers behind that NAT. other clients not
b
nvm mind that is just the way route presents info..... can you provide the output of
ip route
rather than
route -n
h
default via 192.168.1.1 dev eth0 proto static xxx.xxx.xxx200 via 192.168.1.1 dev eth0 10.12.14.0/24 dev netmaker proto kernel scope link src 10.12.14.2 10.20.30.254 dev netmaker xxx.xxx.xxx.196 via 192.168.1.1 dev eth0 xxx.xxx.xxx.127 via 192.168.1.1 dev eth0 xxx.xxx.xxx.127 via 192.168.1.1 dev eth0 xxx.xxx.xxx.175 via 192.168.1.1 dev eth0 xxx.xxx.xxx.49 via 192.168.1.1 dev eth0 192.168.1.0/24 dev eth0 proto kernel scope link src 192.168.1.69
b
I am totally confused on what you are telling me... ext clients can connect ?? to what .. where is the ingress in this picture?
h
on the same node as the egress
b
so the node is both an ingress and a egress
h
yes
b
ok, got it
what is output of
nft list ruleset
Unfortunately I have to go and do some parenting. I'll try to check back soon, so let me know if there's anything else I can send through that would help
b
let me know when you are back; I have two workarounds for this issue (actually just submitted PR for this exact issue this morning) but I need to explain them to you and then you can choose.
would like to also go over your other points sometime
h
Ok, great. Glad you can match it to something you have identified and that you have a solution. I'd be happy to test, but some hungry children to attend to just now. Will drop you a line later on
hey @bored-island-21407 . I'm at my desk for the next few hours (UK time), if you're available. otherwise I'll be online in your afternoon
b
tied up with meeting most of morning
2 Views