does anyone have experience with Mellanox SX6790?
my problem is that it should meet the FDR speed, but the server reports rate: 40 Gb / sec (4X QDR)
Infiniband device 'mlx5_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: ec0d: 9a03: 002c: 47c0
base member: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 40 Gb / sec (4X QDR)
link_layer: InfiniBand
if I connect the servers (without a switch) to direct then FDR is running
[root @ localhost ~] # ibstatus
Infiniband device 'mlx4_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: 001e: 6703: 00e2: fdb3
base member: 0x4
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb / sec (4X FDR)
link_layer: InfiniBand
Infiniband device 'mlx5_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: ec0d: 9a03: 002c: 47c0
base member: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb / sec (4X FDR)
link_layer: InfiniBand
do you have an idea where the problem is?
my problem is that it should meet the FDR speed, but the server reports rate: 40 Gb / sec (4X QDR)
Infiniband device 'mlx5_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: ec0d: 9a03: 002c: 47c0
base member: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 40 Gb / sec (4X QDR)
link_layer: InfiniBand
if I connect the servers (without a switch) to direct then FDR is running
[root @ localhost ~] # ibstatus
Infiniband device 'mlx4_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: 001e: 6703: 00e2: fdb3
base member: 0x4
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb / sec (4X FDR)
link_layer: InfiniBand
Infiniband device 'mlx5_0' port 1 status:
default gid: fe80: 0000: 0000: 0000: ec0d: 9a03: 002c: 47c0
base member: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 56 Gb / sec (4X FDR)
link_layer: InfiniBand
do you have an idea where the problem is?