* [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
@ 2015-06-14 10:13 Or Gerlitz
[not found] ` <1434276784-15909-1-git-send-email-ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
0 siblings, 1 reply; 6+ messages in thread
From: Or Gerlitz @ 2015-06-14 10:13 UTC (permalink / raw)
To: Doug Ledford
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA, Amir Vadai, Tal Alon,
Matan Barak, Moshe Lazer, Or Gerlitz
From: Moshe Lazer <moshel-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Add a device capability flag IB_DEVICE_IP_SUM to denote checksum offload
support. Devices should set this flag if they support insertion of IP, TCP
and UDP checksums on outgoing IP packets sent over IB UD or ETH RAW_PACKET QPs.
In addition add a send flag IBV_SEND_IP_CSUM to utilize this capability.
Signed-off-by: Moshe Lazer <moshel-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Signed-off-by: Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
---
This is a rpost of the code we sent earlier on January,
I understand that people's focus nowadays is around
the few threads that deal with kernel changes, but
let's get it in to sit in the patchworks again...
include/infiniband/verbs.h | 4 +++-
man/ibv_post_send.3 | 4 ++++
2 files changed, 7 insertions(+), 1 deletions(-)
diff --git a/include/infiniband/verbs.h b/include/infiniband/verbs.h
index cfa1156..78b5997 100644
--- a/include/infiniband/verbs.h
+++ b/include/infiniband/verbs.h
@@ -115,6 +115,7 @@ enum ibv_device_cap_flags {
IBV_DEVICE_RC_RNR_NAK_GEN = 1 << 12,
IBV_DEVICE_SRQ_RESIZE = 1 << 13,
IBV_DEVICE_N_NOTIFY_CQ = 1 << 14,
+ IBV_DEVICE_IP_CSUM = 1 << 18,
IBV_DEVICE_XRC = 1 << 20,
IBV_DEVICE_MANAGED_FLOW_STEERING = 1 << 29
};
@@ -627,7 +628,8 @@ enum ibv_send_flags {
IBV_SEND_FENCE = 1 << 0,
IBV_SEND_SIGNALED = 1 << 1,
IBV_SEND_SOLICITED = 1 << 2,
- IBV_SEND_INLINE = 1 << 3
+ IBV_SEND_INLINE = 1 << 3,
+ IBV_SEND_IP_CSUM = 1 << 4
};
struct ibv_sge {
diff --git a/man/ibv_post_send.3 b/man/ibv_post_send.3
index 33fbb50..8070996 100644
--- a/man/ibv_post_send.3
+++ b/man/ibv_post_send.3
@@ -98,6 +98,10 @@ The attribute send_flags describes the properties of the \s-1WR\s0. It is either
.TP
.B IBV_SEND_INLINE \fR Send data in given gather list as inline data
in a send WQE. Valid only for Send and RDMA Write. The L_Key will not be checked.
+.TP
+.B IBV_SEND_IP_CSUM \fR Offload the IP and TCP/UDP checksum calculation.
+Valid only for QPs with Transport Service Type \fBIBV_QPT_UD\fR or \fBIBV_QPT_RAW_PACKET\fR.
+This feature supported only when \fBIBV_DEVICE_IP_CSUM\fR the flag is set in the device capability flags.
.SH "RETURN VALUE"
.B ibv_post_send()
returns 0 on success, or the value of errno on failure (which indicates the failure reason).
--
1.7.1
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
[not found] ` <1434276784-15909-1-git-send-email-ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
@ 2015-06-18 15:21 ` Christoph Lameter
[not found] ` <alpine.DEB.2.11.1506181021160.13957-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
2015-06-18 16:38 ` Jason Gunthorpe
1 sibling, 1 reply; 6+ messages in thread
From: Christoph Lameter @ 2015-06-18 15:21 UTC (permalink / raw)
To: Or Gerlitz
Cc: Doug Ledford, linux-rdma-u79uwXL29TY76Z2rM5mHXA, Amir Vadai,
Tal Alon, Matan Barak, Moshe Lazer
We run those patches and we would like to see them upstream.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
[not found] ` <1434276784-15909-1-git-send-email-ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2015-06-18 15:21 ` Christoph Lameter
@ 2015-06-18 16:38 ` Jason Gunthorpe
[not found] ` <20150618163842.GA14348-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
1 sibling, 1 reply; 6+ messages in thread
From: Jason Gunthorpe @ 2015-06-18 16:38 UTC (permalink / raw)
To: Or Gerlitz
Cc: Doug Ledford, linux-rdma-u79uwXL29TY76Z2rM5mHXA, Amir Vadai,
Tal Alon, Matan Barak, Moshe Lazer
On Sun, Jun 14, 2015 at 01:13:04PM +0300, Or Gerlitz wrote:
> From: Moshe Lazer <moshel-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
>
> Add a device capability flag IB_DEVICE_IP_SUM to denote checksum offload
> support. Devices should set this flag if they support insertion of IP, TCP
> and UDP checksums on outgoing IP packets sent over IB UD or ETH RAW_PACKET QPs.
It would be really nice to see the man page discuss exactly what is
done here, there are quite a few different options for checksum.
IPoIB maps this to 'NETIF_F_IP_CSUM', so only UDP/TCP checksum in
IPv4.
What value should be placed in the checksum header(s) prior to issuing
the send? It looks like IPoIB uses the CHECKSUM_PARTIAL protocol ?
This should all be made clear in the man page, IMHO.
Jason
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
[not found] ` <alpine.DEB.2.11.1506181021160.13957-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
@ 2015-07-01 15:17 ` Christoph Lameter
[not found] ` <alpine.DEB.2.11.1507011015400.20250-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
0 siblings, 1 reply; 6+ messages in thread
From: Christoph Lameter @ 2015-07-01 15:17 UTC (permalink / raw)
To: Or Gerlitz
Cc: Doug Ledford, linux-rdma-u79uwXL29TY76Z2rM5mHXA, Amir Vadai,
Tal Alon, Matan Barak, Moshe Lazer
Is there any release schedule and/or upstream repo where I can see changes
for libibverbs and libmlx4?
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
[not found] ` <alpine.DEB.2.11.1507011015400.20250-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
@ 2015-07-29 16:32 ` Doug Ledford
0 siblings, 0 replies; 6+ messages in thread
From: Doug Ledford @ 2015-07-29 16:32 UTC (permalink / raw)
To: Christoph Lameter, Or Gerlitz
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA, Amir Vadai, Tal Alon,
Matan Barak, Moshe Lazer
[-- Attachment #1: Type: text/plain, Size: 1562 bytes --]
On 07/01/2015 11:17 AM, Christoph Lameter wrote:
> Is there any release schedule and/or upstream repo where I can see changes
> for libibverbs and libmlx4?
>
I'm working on libibverbs right now. The upstream git repo has not
changed, it's the same as it always was.
Or, Jason asked for some (IMO very much needed) documentation on this
feature via man page additions. For instance, the changelog calls out
that this is only used for TCP/UDP packets over IB UD QPs or Eth Raw
QPs. Well, IB UD QPs sending IP packets is IPoIB, which is generally a
kernel protocol. So, when it comes to user space, is this realistically
a Raw Eth QP only thing?
Also, the man page entry calls out what I would classify as hardware
limitations in the general IB verbs man page. I would think it would
more appropriately call out that the support is hardware dependent and
then provide some means for the hardware to specify what types of IP
CSUM offloads it supports. For instance, although there's been talk of
making connected mode IPoIB go faster by dropping the TCP checksum and
relying on the RC EC code instead and just ignoring the TCP checksum.
Another alternative would be to add TCP checksum support to your
firmware for connected mode QPs, so it's possible that in the future the
types of IP CSUM support could grow. This patchset doesn't allow for
that or for distinguishing between hardware that has new or old firmware.
--
Doug Ledford <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
GPG KeyID: 0E572FDD
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 884 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support
[not found] ` <20150618163842.GA14348-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
@ 2015-08-11 8:39 ` Or Gerlitz
0 siblings, 0 replies; 6+ messages in thread
From: Or Gerlitz @ 2015-08-11 8:39 UTC (permalink / raw)
To: Jason Gunthorpe
Cc: Or Gerlitz, Doug Ledford,
linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, Amir Vadai,
Tal Alon, Matan Barak, Moshe Lazer, Bodong Wang
On Thu, Jun 18, 2015 at 7:38 PM, Jason Gunthorpe
<jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org> wrote:
> On Sun, Jun 14, 2015 at 01:13:04PM +0300, Or Gerlitz wrote:
>> From: Moshe Lazer <moshel-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
>>
>> Add a device capability flag IB_DEVICE_IP_SUM to denote checksum offload
>> support. Devices should set this flag if they support insertion of IP, TCP
>> and UDP checksums on outgoing IP packets sent over IB UD or ETH RAW_PACKET QPs.
>
> It would be really nice to see the man page discuss exactly what is
> done here, there are quite a few different options for checksum.
>
> IPoIB maps this to 'NETIF_F_IP_CSUM', so only UDP/TCP checksum in
> IPv4.
>
> What value should be placed in the checksum header(s) prior to issuing
> the send? It looks like IPoIB uses the CHECKSUM_PARTIAL protocol ?
yes, we can follow here on how IPoIB uses this device capability. In that case,
AFAIK and from quick look on the TX section for CHECKSUM_PARTIAL in
include/linux/skbuff.h --
nothing special is assumed to be placed in the checksum field at the
header/s prior to issuing the send, agree?
Or.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2015-08-11 8:39 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-06-14 10:13 [PATCH REPOST libibverbs] Add IP and TCP/UDP TX checksum offload support Or Gerlitz
[not found] ` <1434276784-15909-1-git-send-email-ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2015-06-18 15:21 ` Christoph Lameter
[not found] ` <alpine.DEB.2.11.1506181021160.13957-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
2015-07-01 15:17 ` Christoph Lameter
[not found] ` <alpine.DEB.2.11.1507011015400.20250-wcBtFHqTun5QOdAKl3ChDw@public.gmane.org>
2015-07-29 16:32 ` Doug Ledford
2015-06-18 16:38 ` Jason Gunthorpe
[not found] ` <20150618163842.GA14348-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-08-11 8:39 ` Or Gerlitz
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.