From: Simon Horman <horms@kernel.org> To: David Howells <dhowells@redhat.com> Cc: Christian Brauner <christian@brauner.io>, Jeff Layton <jlayton@kernel.org>, Gao Xiang <hsiangkao@linux.alibaba.com>, Dominique Martinet <asmadeus@codewreck.org>, Matthew Wilcox <willy@infradead.org>, Steve French <smfrench@gmail.com>, Marc Dionne <marc.dionne@auristor.com>, Paulo Alcantara <pc@manguebit.com>, Shyam Prasad N <sprasad@microsoft.com>, Tom Talpey <tom@talpey.com>, Eric Van Hensbergen <ericvh@kernel.org>, Ilya Dryomov <idryomov@gmail.com>, netfs@lists.linux.dev, linux-cachefs@redhat.com, linux-afs@lists.infradead.org, linux-cifs@vger.kernel.org, linux-nfs@vger.kernel.org, ceph-devel@vger.kernel.org, v9fs@lists.linux.dev, linux-erofs@lists.ozlabs.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH 26/26] netfs, afs: Use writeback retry to deal with alternate keys Date: Mon, 1 Apr 2024 14:53:51 +0100 [thread overview] Message-ID: <20240401135351.GD26556@kernel.org> (raw) In-Reply-To: <20240328163424.2781320-27-dhowells@redhat.com> On Thu, Mar 28, 2024 at 04:34:18PM +0000, David Howells wrote: ... > +void afs_issue_write(struct netfs_io_subrequest *subreq) > { > + struct netfs_io_request *wreq = subreq->rreq; > struct afs_operation *op; > - struct afs_wb_key *wbk = NULL; > - loff_t size = iov_iter_count(iter); > + struct afs_vnode *vnode = AFS_FS_I(wreq->inode); > + unsigned long long pos = subreq->start + subreq->transferred; > + size_t len = subreq->len - subreq->transferred; > int ret = -ENOKEY; > > - _enter("%s{%llx:%llu.%u},%llx,%llx", > + _enter("R=%x[%x],%s{%llx:%llu.%u},%llx,%zx", > + wreq->debug_id, subreq->debug_index, > vnode->volume->name, > vnode->fid.vid, > vnode->fid.vnode, > vnode->fid.unique, > - size, pos); > + pos, len); > > - ret = afs_get_writeback_key(vnode, &wbk); > - if (ret) { > - _leave(" = %d [no keys]", ret); > - return ret; > - } > +#if 0 // Error injection > + if (subreq->debug_index == 3) > + return netfs_write_subrequest_terminated(subreq, -ENOANO, false); > > - op = afs_alloc_operation(wbk->key, vnode->volume); > - if (IS_ERR(op)) { > - afs_put_wb_key(wbk); > - return -ENOMEM; > + if (!test_bit(NETFS_SREQ_RETRYING, &subreq->flags)) { > + set_bit(NETFS_SREQ_NEED_RETRY, &subreq->flags); > + return netfs_write_subrequest_terminated(subreq, -EAGAIN, false); > } > +#endif > + > + op = afs_alloc_operation(wreq->netfs_priv, vnode->volume); > + if (IS_ERR(op)) > + return netfs_write_subrequest_terminated(subreq, -EAGAIN, false); > > afs_op_set_vnode(op, 0, vnode); > - op->file[0].dv_delta = 1; > + op->file[0].dv_delta = 1; > op->file[0].modification = true; > - op->store.pos = pos; > - op->store.size = size; > - op->flags |= AFS_OPERATION_UNINTR; > - op->ops = &afs_store_data_operation; > + op->store.pos = pos; > + op->store.size = len, nit: this is probably more intuitively written using len; > + op->flags |= AFS_OPERATION_UNINTR; > + op->ops = &afs_store_data_operation; > > -try_next_key: > afs_begin_vnode_operation(op); > > - op->store.write_iter = iter; > - op->store.i_size = max(pos + size, vnode->netfs.remote_i_size); > - op->mtime = inode_get_mtime(&vnode->netfs.inode); > + op->store.write_iter = &subreq->io_iter; > + op->store.i_size = umax(pos + len, vnode->netfs.remote_i_size); > + op->mtime = inode_get_mtime(&vnode->netfs.inode); > > afs_wait_for_operation(op); > - > - switch (afs_op_error(op)) { > + ret = afs_put_operation(op); > + switch (ret) { > case -EACCES: > case -EPERM: > case -ENOKEY: > case -EKEYEXPIRED: > case -EKEYREJECTED: > case -EKEYREVOKED: > - _debug("next"); > - > - ret = afs_get_writeback_key(vnode, &wbk); > - if (ret == 0) { > - key_put(op->key); > - op->key = key_get(wbk->key); > - goto try_next_key; > - } > + /* If there are more keys we can try, use the retry algorithm > + * to rotate the keys. > + */ > + if (wreq->netfs_priv2) > + set_bit(NETFS_SREQ_NEED_RETRY, &subreq->flags); > break; > } > > - afs_put_wb_key(wbk); > - _leave(" = %d", afs_op_error(op)); > - return afs_put_operation(op); > + netfs_write_subrequest_terminated(subreq, ret < 0 ? ret : subreq->len, false); > } > > /* ...
WARNING: multiple messages have this Message-ID (diff)
From: Simon Horman <horms@kernel.org> To: David Howells <dhowells@redhat.com> Cc: Dominique Martinet <asmadeus@codewreck.org>, linux-mm@kvack.org, Marc Dionne <marc.dionne@auristor.com>, linux-afs@lists.infradead.org, Paulo Alcantara <pc@manguebit.com>, linux-cifs@vger.kernel.org, Matthew Wilcox <willy@infradead.org>, Steve French <smfrench@gmail.com>, linux-cachefs@redhat.com, Gao Xiang <hsiangkao@linux.alibaba.com>, Ilya Dryomov <idryomov@gmail.com>, Shyam Prasad N <sprasad@microsoft.com>, Tom Talpey <tom@talpey.com>, ceph-devel@vger.kernel.org, Eric Van Hensbergen <ericvh@kernel.org>, Christian Brauner <christian@brauner.io>, linux-nfs@vger.kernel.org, netdev@vger.kernel.org, v9fs@lists.linux.dev, Jeff Layton <jlayton@kernel.org>, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, netfs@lists.linux.dev, linux-erofs@lists.ozlabs.org Subject: Re: [PATCH 26/26] netfs, afs: Use writeback retry to deal with alternate keys Date: Mon, 1 Apr 2024 14:53:51 +0100 [thread overview] Message-ID: <20240401135351.GD26556@kernel.org> (raw) In-Reply-To: <20240328163424.2781320-27-dhowells@redhat.com> On Thu, Mar 28, 2024 at 04:34:18PM +0000, David Howells wrote: ... > +void afs_issue_write(struct netfs_io_subrequest *subreq) > { > + struct netfs_io_request *wreq = subreq->rreq; > struct afs_operation *op; > - struct afs_wb_key *wbk = NULL; > - loff_t size = iov_iter_count(iter); > + struct afs_vnode *vnode = AFS_FS_I(wreq->inode); > + unsigned long long pos = subreq->start + subreq->transferred; > + size_t len = subreq->len - subreq->transferred; > int ret = -ENOKEY; > > - _enter("%s{%llx:%llu.%u},%llx,%llx", > + _enter("R=%x[%x],%s{%llx:%llu.%u},%llx,%zx", > + wreq->debug_id, subreq->debug_index, > vnode->volume->name, > vnode->fid.vid, > vnode->fid.vnode, > vnode->fid.unique, > - size, pos); > + pos, len); > > - ret = afs_get_writeback_key(vnode, &wbk); > - if (ret) { > - _leave(" = %d [no keys]", ret); > - return ret; > - } > +#if 0 // Error injection > + if (subreq->debug_index == 3) > + return netfs_write_subrequest_terminated(subreq, -ENOANO, false); > > - op = afs_alloc_operation(wbk->key, vnode->volume); > - if (IS_ERR(op)) { > - afs_put_wb_key(wbk); > - return -ENOMEM; > + if (!test_bit(NETFS_SREQ_RETRYING, &subreq->flags)) { > + set_bit(NETFS_SREQ_NEED_RETRY, &subreq->flags); > + return netfs_write_subrequest_terminated(subreq, -EAGAIN, false); > } > +#endif > + > + op = afs_alloc_operation(wreq->netfs_priv, vnode->volume); > + if (IS_ERR(op)) > + return netfs_write_subrequest_terminated(subreq, -EAGAIN, false); > > afs_op_set_vnode(op, 0, vnode); > - op->file[0].dv_delta = 1; > + op->file[0].dv_delta = 1; > op->file[0].modification = true; > - op->store.pos = pos; > - op->store.size = size; > - op->flags |= AFS_OPERATION_UNINTR; > - op->ops = &afs_store_data_operation; > + op->store.pos = pos; > + op->store.size = len, nit: this is probably more intuitively written using len; > + op->flags |= AFS_OPERATION_UNINTR; > + op->ops = &afs_store_data_operation; > > -try_next_key: > afs_begin_vnode_operation(op); > > - op->store.write_iter = iter; > - op->store.i_size = max(pos + size, vnode->netfs.remote_i_size); > - op->mtime = inode_get_mtime(&vnode->netfs.inode); > + op->store.write_iter = &subreq->io_iter; > + op->store.i_size = umax(pos + len, vnode->netfs.remote_i_size); > + op->mtime = inode_get_mtime(&vnode->netfs.inode); > > afs_wait_for_operation(op); > - > - switch (afs_op_error(op)) { > + ret = afs_put_operation(op); > + switch (ret) { > case -EACCES: > case -EPERM: > case -ENOKEY: > case -EKEYEXPIRED: > case -EKEYREJECTED: > case -EKEYREVOKED: > - _debug("next"); > - > - ret = afs_get_writeback_key(vnode, &wbk); > - if (ret == 0) { > - key_put(op->key); > - op->key = key_get(wbk->key); > - goto try_next_key; > - } > + /* If there are more keys we can try, use the retry algorithm > + * to rotate the keys. > + */ > + if (wreq->netfs_priv2) > + set_bit(NETFS_SREQ_NEED_RETRY, &subreq->flags); > break; > } > > - afs_put_wb_key(wbk); > - _leave(" = %d", afs_op_error(op)); > - return afs_put_operation(op); > + netfs_write_subrequest_terminated(subreq, ret < 0 ? ret : subreq->len, false); > } > > /* ...
next prev parent reply other threads:[~2024-04-01 13:53 UTC|newest] Thread overview: 125+ messages / expand[flat|nested] mbox.gz Atom feed top 2024-03-28 16:33 [PATCH 00/26] netfs, afs, 9p, cifs: Rework netfs to use ->writepages() to copy to cache David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:33 ` [PATCH 01/26] cifs: Fix duplicate fscache cookie warnings David Howells 2024-03-28 16:33 ` David Howells 2024-04-15 11:25 ` Jeff Layton 2024-04-15 11:25 ` Jeff Layton 2024-04-15 13:03 ` David Howells 2024-04-15 13:03 ` David Howells 2024-04-15 22:51 ` Steve French 2024-04-15 22:51 ` Steve French 2024-04-16 22:40 ` David Howells 2024-04-16 22:40 ` David Howells 2024-03-28 16:33 ` [PATCH 02/26] 9p: Clean up some kdoc and unused var warnings David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:33 ` [PATCH 03/26] netfs: Update i_blocks when write committed to pagecache David Howells 2024-03-28 16:33 ` David Howells 2024-04-15 11:28 ` Jeff Layton 2024-04-15 11:28 ` Jeff Layton 2024-04-16 22:47 ` David Howells 2024-04-16 22:47 ` David Howells 2024-03-28 16:33 ` [PATCH 04/26] netfs: Replace PG_fscache by setting folio->private and marking dirty David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:33 ` [PATCH 05/26] mm: Remove the PG_fscache alias for PG_private_2 David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:33 ` [PATCH 06/26] netfs: Remove deprecated use of PG_private_2 as a second writeback flag David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:33 ` [PATCH 07/26] netfs: Make netfs_io_request::subreq_counter an atomic_t David Howells 2024-03-28 16:33 ` David Howells 2024-03-28 16:34 ` [PATCH 08/26] netfs: Use subreq_counter to allocate subreq debug_index values David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 09/26] mm: Provide a means of invalidation without using launder_folio David Howells 2024-03-28 16:34 ` David Howells 2024-04-15 11:41 ` Jeff Layton 2024-04-15 11:41 ` Jeff Layton 2024-04-17 9:02 ` David Howells 2024-03-28 16:34 ` [PATCH 10/26] cifs: Use alternative invalidation to " David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 11/26] 9p: " David Howells 2024-03-28 16:34 ` David Howells 2024-04-15 11:43 ` Jeff Layton 2024-04-15 11:43 ` Jeff Layton 2024-04-16 23:03 ` David Howells 2024-04-16 23:03 ` David Howells 2024-03-28 16:34 ` [PATCH 12/26] afs: " David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 13/26] netfs: Remove ->launder_folio() support David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 14/26] netfs: Use mempools for allocating requests and subrequests David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 15/26] mm: Export writeback_iter() David Howells 2024-03-28 16:34 ` David Howells 2024-04-03 8:59 ` Christoph Hellwig 2024-04-03 8:59 ` Christoph Hellwig 2024-04-03 10:10 ` David Howells 2024-04-03 10:10 ` David Howells 2024-04-03 10:14 ` Christoph Hellwig 2024-04-03 10:14 ` Christoph Hellwig 2024-04-03 10:55 ` David Howells 2024-04-03 10:55 ` David Howells 2024-04-03 12:41 ` Christoph Hellwig 2024-04-03 12:41 ` Christoph Hellwig 2024-04-03 12:58 ` David Howells 2024-04-03 12:58 ` David Howells 2024-04-05 6:53 ` Christoph Hellwig 2024-04-05 6:53 ` Christoph Hellwig 2024-04-05 10:15 ` Christian Brauner 2024-04-05 10:15 ` Christian Brauner 2024-03-28 16:34 ` [PATCH 16/26] netfs: Switch to using unsigned long long rather than loff_t David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 17/26] netfs: Fix writethrough-mode error handling David Howells 2024-03-28 16:34 ` David Howells 2024-04-15 12:40 ` Jeff Layton 2024-04-15 12:40 ` Jeff Layton 2024-04-17 9:04 ` David Howells 2024-04-17 9:04 ` David Howells 2024-03-28 16:34 ` [PATCH 18/26] netfs: Add some write-side stats and clean up some stat names David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 19/26] netfs: New writeback implementation David Howells 2024-03-28 16:34 ` David Howells 2024-03-29 10:34 ` Naveen Mamindlapalli 2024-03-29 10:34 ` Naveen Mamindlapalli 2024-03-30 1:06 ` Vadim Fedorenko 2024-03-30 1:06 ` Vadim Fedorenko 2024-03-30 1:06 ` Vadim Fedorenko 2024-03-30 1:06 ` Vadim Fedorenko 2024-03-30 1:03 ` Vadim Fedorenko 2024-03-30 1:03 ` Vadim Fedorenko 2024-03-28 16:34 ` [PATCH 20/26] netfs, afs: Implement helpers for new write code David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 21/26] netfs, 9p: " David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 22/26] netfs, cachefiles: " David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 23/26] netfs: Cut over to using new writeback code David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 24/26] netfs: Remove the old " David Howells 2024-03-28 16:34 ` David Howells 2024-04-15 12:20 ` Jeff Layton 2024-04-15 12:20 ` Jeff Layton 2024-04-17 10:36 ` David Howells 2024-04-17 10:36 ` David Howells 2024-03-28 16:34 ` [PATCH 25/26] netfs: Miscellaneous tidy ups David Howells 2024-03-28 16:34 ` David Howells 2024-03-28 16:34 ` [PATCH 26/26] netfs, afs: Use writeback retry to deal with alternate keys David Howells 2024-03-28 16:34 ` David Howells 2024-04-01 13:53 ` Simon Horman [this message] 2024-04-01 13:53 ` Simon Horman 2024-04-02 8:32 ` David Howells 2024-04-02 8:32 ` David Howells 2024-04-10 17:38 ` Simon Horman 2024-04-10 17:38 ` Simon Horman 2024-04-11 7:09 ` David Howells 2024-04-11 7:09 ` David Howells 2024-04-02 8:46 ` [PATCH 19/26] netfs: New writeback implementation David Howells 2024-04-02 8:46 ` David Howells 2024-04-02 10:48 ` [PATCH 00/26] netfs, afs, 9p, cifs: Rework netfs to use ->writepages() to copy to cache Christian Brauner 2024-04-02 10:48 ` Christian Brauner 2024-04-04 7:51 ` [PATCH 21/26] netfs, 9p: Implement helpers for new write code David Howells 2024-04-04 7:51 ` David Howells 2024-04-04 8:01 ` David Howells 2024-04-04 8:01 ` David Howells 2024-04-08 15:53 ` [PATCH 23/26] netfs: Cut over to using new writeback code David Howells 2024-04-08 15:53 ` David Howells 2024-04-15 12:49 ` [PATCH 00/26] netfs, afs, 9p, cifs: Rework netfs to use ->writepages() to copy to cache Jeff Layton 2024-04-15 12:49 ` Jeff Layton
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20240401135351.GD26556@kernel.org \ --to=horms@kernel.org \ --cc=asmadeus@codewreck.org \ --cc=ceph-devel@vger.kernel.org \ --cc=christian@brauner.io \ --cc=dhowells@redhat.com \ --cc=ericvh@kernel.org \ --cc=hsiangkao@linux.alibaba.com \ --cc=idryomov@gmail.com \ --cc=jlayton@kernel.org \ --cc=linux-afs@lists.infradead.org \ --cc=linux-cachefs@redhat.com \ --cc=linux-cifs@vger.kernel.org \ --cc=linux-erofs@lists.ozlabs.org \ --cc=linux-fsdevel@vger.kernel.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=linux-nfs@vger.kernel.org \ --cc=marc.dionne@auristor.com \ --cc=netdev@vger.kernel.org \ --cc=netfs@lists.linux.dev \ --cc=pc@manguebit.com \ --cc=smfrench@gmail.com \ --cc=sprasad@microsoft.com \ --cc=tom@talpey.com \ --cc=v9fs@lists.linux.dev \ --cc=willy@infradead.org \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.