Does infinity support roce card?

[fqhuang]

I got the same issue like this: #5.

my card is mlx5 with roce mode:
CA 'mlx5_0'
CA type: MT4119
Number of ports: 1
Firmware version: 16.29.1016
Hardware version: 0
Node GUID: 0x0c42a103007555a4
System image GUID: 0x0c42a103007555a4
Port 1:
State: Active
Physical state: LinkUp
Rate: 100
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x00010000
Port GUID: 0x0e42a1fffe7555a4
Link layer: Ethernet

Thanks!
Toby

[claudebarthels]

Hello Toby,

no, Infinity does not support RoCE cards. However, the changes that would be required have already been factored out into single class: infinity/src/infinity/queues/QueuePairFactory. This class is responsible for establishing the connections, and returning connected and fully functional queue pairs. As far as I understand, the connection setup is the primary difference between InfiniBand and RoCE - the rest of the code is agnostic to the network technology.

Unfortunately, I never had access to RoCE cards - hence there is no QueuePairFactory for RoCE networks.

Hope this helps,
Claude

[fqhuang]

Hello Claude,
Thanks, I will try to modify it.

Toby

[ShaneKirkbride]

@fqhuang were you successful? at adding RoCE functionality?

[fqhuang]

@ShaneKirkbride no, I don't use this lib for RoCE finally.

[sarthak-moorjani]

Hi @fqhuang - What did you finally use for RoCE?

@claudebarthels - Thanks for the great library. I am also facing the same issue since I have RoCE cards, could you help me in explaining that what exactly might need to change for this to work for RoCE cards? And where can I find the relevant documentation to make these changes?
Also, do you think that the changes be bulky or small changes in connection establishment?

Thank you!

[sarthak-moorjani]

Basically the issue I am facing is that the programs hangs after I run a read write test.. Exactly like in the first comment of the issue here -
#5