settings to have internet access at supermicro IPMI nodes...

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
I have following ststems: I am managing a 3HP servers, 16Supermicro nodes and 2 cisco switches to setup a private cloud using MAAS.

3HP Servers configured on IP: 172.16.65.116/117/118
2Cisco Switches: 172.16.65.240 * .241
16Supermicro Nodes IP : 172.16.65.100-115

Management station : 172.16.65.2

Now I installed ubuntu 16.04 on 172.16.65.100 and trying to setup MAAS controler and then local cloud. But I cant access internet at any supermicro IPMI nodes. any help ????
 

pricklypunter

Well-Known Member
Nov 10, 2015
1,708
515
113
Canada
All nodes have Physical layer connectivity for sure? No damaged cables etc?
How is IPMI setup on each node, using shared resources or using dedicated ports?
Is this only an IPMI problem, i.e the host's themselves plus the others have Internet working fine? How are you handling your routing? Where do your nodes receive their DNS from and is that working properly? Do you have a DHCP server configured, if so is the scope correct? Any Firewalls involved? Are they configured properly? Is your Gateway IP reachable from all nodes? Are all nodes reachable from the Switches? I'm assuming, as you haven't shown a Netmask, all nodes are in the same Subnet, if not, how do you route between them?
 

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
netmap.jpg Yes, All nodes have Physical layer connectivity . No damage in cables.
IPMI nodes using failover clustering with dedicated ports. Using same networking setup, management stations are working fine.
No DHCP installed. All are manually configured on 172.16.65.0/24 network. Please have a look of this networking schema .
 

MiniKnight

Well-Known Member
Mar 30, 2012
3,072
973
113
NYC
What do you mean "IPMI nodes"? Are those the IPMI interfaces or the normal network?

Your MAAS node needs access to all three networks. You should be able to test connectivity through that node.

With the 16 nodes can they access the internet normally? I'd try a live CD on them. If they can't get to the internet then you've got a routing problem.
 

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
As I am working through mgmt station remotely, Server provider is saying that its IPMI interface. So whatever the case , either IPMI interface or normal network , internet access should be accessible from each and every node individually, right ???
 

MiniKnight

Well-Known Member
Mar 30, 2012
3,072
973
113
NYC
You've got a service provider offering IPMI onto WAN? That's crazy. The only internet access to your IPMI should be through a VPN to a management network that does not route to the internet.

If you're trying to use the IPMI interface NIC as a maas provisioning or data NIC that's also not ideal. You can do this with VLANs but you need to ensure the OS can access the IPMI NIC since there are BIOS settings that will normally prevent that from happening.
 

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
Thanks MiniKnight, thanks a lot for your guide in this post .

Actually, They offered me HP windows server 2012 configured on 172.16.65.2 with NAT/Firewall on public IP 81.244.x.x .

This machine is like management station . First I do login on this HP management machine remotely. Then all resources, I get access locally.

IPMI is configurred on LAN not WAN. But when I installed Ubuntu 16.04 on 172.16.65.100 then after ubuntu installation , I unable to install again new linux packages in order to setup MAAS . I can not ping any of the machine locally on same network even.

IPMI interface has internet access. Can you please guide me what should be the VNET details and settings in order to setup MAAS on any supermicro nodes.

in 3 HP servers from network map , one is windows server remote management station and other 2 HP server are iLO2 installed.
 
Last edited:

MiniKnight

Well-Known Member
Mar 30, 2012
3,072
973
113
NYC
Maybe that's the issue?

Let me rephrase to make sure I'm understanding correctly. The HP WS2012 you use like a virtual desktop? Then manage from there?

Can you ping from each of the interfaces on that machine to the Internet? That's where I'd start.

Can you boot a LiveCD on the Supermicro? I think that would be best to troubleshoot why you don't have access.

Maybe also ask from your host. If they've given you a desktop maybe they are blocking WAN traffic.
 

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
yes , exactly the way I manages from here . Except supermicro nodes , I can ping to internet from every remaing resources. but when I installs Ubuntu on any supermicro nodes then after executing 'ifconfig ' command its shows by default 2 interface i.e. lo & virbr0 . two other ethernet cards shows availble using command 'ifconfig -a' is : enp6s0f0 & enp6s0f1 . but every time shows network not reachable.
 

pricklypunter

Well-Known Member
Nov 10, 2015
1,708
515
113
Canada
If you haven't done so already, you will need to configure your network interfaces in Ubuntu to use your static IP scheme and bring the interface up, probably at least one of them during install, so you can pull down latest packages etc, but certainly afterwards. First, confirm your network interface names, then use your favourite command line editor, vi or nano etc to configure each interface with its respective IP address, Netmask, Gateway Network address, Broadcast address and DNS server etc.

Each interface config (ensxxxx) should look something like this:

auto ensxxxx
iface ensxxxx inet static
address 172.16.65.xxx
netmask 255.255.255.0
gateway 172.16.65.1
network 172.16.65.0
broadcast 172.16.65.255
dns-nameservers 172.16.65.xxx

Once you configure them, you will need to either reboot your Ubuntu or take down the interfaces and bring them back up to flush your old settings (ifdown/ ifup etc)

Hope that helps :)
 
  • Like
Reactions: Patrick

linuxgigs

New Member
Dec 29, 2016
6
0
1
41
India
Hello Everyone , Very very happy new year !!!

auto ensxxxx
iface ensxxxx inet static
address 172.16.65.xxx
netmask 255.255.255.0
gateway 172.16.65.1
network 172.16.65.0
broadcast 172.16.65.255
dns-nameservers 172.16.65.xxx

I have set this configurations. interface OFF & ON settings also performed but still I am getting the same error after ping to gateway 172.16.65.1 even . Can you please guide me with all the possibility !!!
 

pricklypunter

Well-Known Member
Nov 10, 2015
1,708
515
113
Canada
Happy New Year! It sounds to me like either your interface is not up or is configured incorrectly. It may even be an IP conflict. Shut down all but one node temporarily, then shut down one of that nodes interfaces and work on getting the single remaining interface working first, then go from there :)
 

shoguneye

Member
Jan 21, 2016
38
6
8
61
I have following ststems: I am managing a 3HP servers, 16Supermicro nodes and 2 cisco switches to setup a private cloud using MAAS.

3HP Servers configured on IP: 172.16.65.116/117/118
2Cisco Switches: 172.16.65.240 * .241
16Supermicro Nodes IP : 172.16.65.100-115

Management station : 172.16.65.2

Now I installed ubuntu 16.04 on 172.16.65.100 and trying to setup MAAS controler and then local cloud. But I cant access internet at any supermicro IPMI nodes. any help ????
 

shoguneye

Member
Jan 21, 2016
38
6
8
61
Hi, just a heads up on IPMI and Supermicro gear. I've run into situations where the IPMI NIC piggybacks onto another live NIC, I presume depending on the power up order. Quite promiscuous and very annoying. I couldn't figure out why the unused ipmi nic with no cable attached had a DHCP address and was accessible to the 'net' This could have remote access/support implications attempting to troubleshoot after an event.