From: Ankit Kumar <ankit1455@gmail.com>
To: Sadman Sakib <sadmankiba@gmail.com>
Cc: fio@vger.kernel.org
Subject: Re: Does fio support running workload with NVMe-oF on top of SPDK?
Date: Sun, 2 Apr 2023 23:45:12 +0530 [thread overview]
Message-ID: <CAKi7+wdhri-BAD8UzzS6oG3uCZMW17RoRfa5HX9ShFLNnu6QHA@mail.gmail.com> (raw)
In-Reply-To: <CALy08mb+6uq=ds2fVZ2B8YF5P4FvZgMsD0qx3ZTEY6EuFJ2ADw@mail.gmail.com>
Hi Sadman,
Yes you can run fio on NVMe-oF fabrics setup with xnvme ioengine,
using the SPDK driver.
Configuring subsystem can be done via:
https://github.com/spdk/spdk/blob/master/scripts/rpc.py
To run fio you just need to specify the backend as SPDK, namespace id
and filename which will contain address and port. Something like this:
--xnvme_be="spdk"
--xnvme_dev_nsid="1"
--filename="192.168.100.8\:4420"
There is also a spdk ioengine, but not part of the fio source code and
it's maintained in the spdk repository.
If you want to run spdk ioengine directly without xnvme, please check:
https://github.com/spdk/spdk/tree/master/examples/nvme/fio_plugin
Regards
Ankit
On Sat, Apr 1, 2023 at 7:30 AM Sadman Sakib <sadmankiba@gmail.com> wrote:
>
> Hi,
>
> I was wondering if Fio supports running workload on remote SSD with
> NVMe-oF on top of SPDK. I was able to run fio on local SSD with
> "xnvme" engine on top of xNVMe driver, which builts on SPDK driver. I
> followed the "xNVMe ioengine Part 2" guide in fio-blog repository. The
> job file I used is as below:
>
> [job1]
> ioengine=xnvme
> xnvme_dev_nsid=1
> thread=1
> rw=randread
> bs=4k
> filename=0000\:22\:00.0
> direct=1
> iodepth=1
> size=1G
>
> I was also able to run workload on NVMe-oF with SPDK perf example that
> is shipped with SPDK using a command like below-
> spdk_nvme_perf -q 128 -o 4096 -w randread -r 'trtype:RDMA adrfam:IPv4
> traddr:192.168.100.8 trsvcid:4420' -t 300
>
> So, I think to run Fio with NVMe-oF on SPDK, I will need to set
> transport type, address and port with fio options. But, I did not find
> such options in the fio doc page. Does fio currently support NVMe-oF
> on top of SPDK which may not be documented in the doc page?
>
> Best,
> Sadman
prev parent reply other threads:[~2023-04-02 18:17 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-04-01 1:44 Does fio support running workload with NVMe-oF on top of SPDK? Sadman Sakib
2023-04-02 18:15 ` Ankit Kumar [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAKi7+wdhri-BAD8UzzS6oG3uCZMW17RoRfa5HX9ShFLNnu6QHA@mail.gmail.com \
--to=ankit1455@gmail.com \
--cc=fio@vger.kernel.org \
--cc=sadmankiba@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).