Lambda Labs <-> Azure VPC

Have you looked into VPN solutions? Tailscale is easy to set up. Also look at traditional VPN solutions like WireGuard and OpenVPN.