Site-to-site VPN, as simple as a WireGuard tunnel, along with something like IPMIView for remote management at the hardware level.
For everything else, I like to run a sort of jumpbox with something like Apache Guacamole to simplify access from multiple locations/devices.