* Slow concurrent reads on mounted loopback images
@ 2024-03-21 17:49 GRANGER Nicolas
2024-03-22 2:49 ` Gao Xiang
0 siblings, 1 reply; 2+ messages in thread
From: GRANGER Nicolas @ 2024-03-21 17:49 UTC (permalink / raw
To: linux-erofs@lists.ozlabs.org
[-- Attachment #1: Type: text/plain, Size: 555 bytes --]
Hi erofs team,
I'm working on a small daemon that caches and mounts disk images containing datasets based on usage (https://github.com/CEA-LIST/scratch_manager).
My understanding is that this is a good use-case for EROFS. However, in my experience concurrent reads on loopback mounted disk images are rather slow.
I tested both squashfs and erofs images so I don't think it is specific to erofs, I just can't figure out where the bottleneck is. By any chance would you have any any tips to share on that subject?
Best,
Nicolas Granger
[-- Attachment #2: Type: text/html, Size: 1076 bytes --]
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: Slow concurrent reads on mounted loopback images
2024-03-21 17:49 Slow concurrent reads on mounted loopback images GRANGER Nicolas
@ 2024-03-22 2:49 ` Gao Xiang
0 siblings, 0 replies; 2+ messages in thread
From: Gao Xiang @ 2024-03-22 2:49 UTC (permalink / raw
To: GRANGER Nicolas, linux-erofs@lists.ozlabs.org
Hi GRANGER,
On 2024/3/22 01:49, GRANGER Nicolas wrote:
> Hi erofs team,
>
>
> I'm working on a small daemon that caches and mounts disk images containing datasets based on usage (https://github.com/CEA-LIST/scratch_manager <https://github.com/CEA-LIST/scratch_manager>).
>
> My understanding is that this is a good use-case for EROFS. However, in my experience concurrent reads on loopback mounted disk images are rather slow.
>
> I tested both squashfs and erofs images so I don't think it is specific to erofs, I just can't figure out where the bottleneck is. By any chance would you have any any tips to share on that subject?
Thanks for the information. I don't know more about "scratch_manager",
but does "scratch_manager" really use loopback devices? if yes, which
kernel version are you using, and could you try with loop direct-io
mode?
Later the EROFS project will land native solutions for dataset and AI
models and we will evaluate this use cases formally.
Thanks,
Gao Xiang
>
>
> Best,
>
> Nicolas Granger
>
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2024-03-22 2:50 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-03-21 17:49 Slow concurrent reads on mounted loopback images GRANGER Nicolas
2024-03-22 2:49 ` Gao Xiang
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).