From: Carsten Aulbert <carsten.aulbert@aei.mpg.de>
To: netfilter@vger.kernel.org
Subject: Possible to load balance (nftlb) mostly NFS traffic with important connections?
Date: Sat, 15 May 2021 09:21:59 +0200 [thread overview]
Message-ID: <9cbbeb2e-f09c-5eca-f86c-6f3b25cd9ea3@aei.mpg.de> (raw)
[-- Attachment #1: Type: text/plain, Size: 1646 bytes --]
Dear experts,
we are operating a compute cluster with a number of storage systems
serving data via NFS via LACP-bonded 10 Gbit/s links (usually 2 or 4).
From time to time, users may overload a server and use up all available
bandwidth for hours and sometimes days at a time and I am currently
exploring if we could use tools like nftlb[1] to achieve the following:
(a) For (NFS|any) traffic have at least two tiers (farms?), one are
standard compute nodes and one are interactive log-in nodes/web servers.
The former should have a much lower bandwidth priority as the latter.
These targets can easily be distinguished by IP ranges/netmasks.
(b) Sometimes we need to perform bandwidth intensive/sensitive
operations, e.g. just today I would like to move a user's file system
from one too busy box to another but sending the ZFS snapshot over via
mbuffer takes really long and I would like to prioritize this connection
as well, i.e. I know the source and destination IP as well as target TCP
port.
I am still learning to migrate from iptables to nft while I stumbled
over nftlb which looks to support what I want, but I am not sure yet -
and I have not found many documents describing potential set-ups and
thus I wanted to ask the experts here first.
Base of all our systems is currently Debian 10 (buster) and thus kernel
4.19.
Cheers and thanks a lot in advance for any insights/pointers/...!
Carsten
[1] https://github.com/zevenet/nftlb
--
Dr. Carsten Aulbert, Max Planck Institute for Gravitational Physics,
Callinstraße 38, 30167 Hannover, Germany, Phone +49 511 762 17185
[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/pkcs7-signature, Size: 5178 bytes --]
next reply other threads:[~2021-05-15 7:21 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-05-15 7:21 Carsten Aulbert [this message]
2021-05-21 10:47 ` Possible to load balance (nftlb) mostly NFS traffic with important connections? Laura García Liébana
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=9cbbeb2e-f09c-5eca-f86c-6f3b25cd9ea3@aei.mpg.de \
--to=carsten.aulbert@aei.mpg.de \
--cc=netfilter@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.