From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-18.2 required=3.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED, USER_IN_DEF_DKIM_WL autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9CAAAC433DB for ; Thu, 11 Feb 2021 17:57:52 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 69AD764E05 for ; Thu, 11 Feb 2021 17:57:52 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232549AbhBKRwe (ORCPT ); Thu, 11 Feb 2021 12:52:34 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:47438 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232193AbhBKRPs (ORCPT ); Thu, 11 Feb 2021 12:15:48 -0500 Received: from mail-yb1-xb36.google.com (mail-yb1-xb36.google.com [IPv6:2607:f8b0:4864:20::b36]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 1972DC061786 for ; Thu, 11 Feb 2021 09:15:08 -0800 (PST) Received: by mail-yb1-xb36.google.com with SMTP id q12so4158946ybm.8 for ; Thu, 11 Feb 2021 09:15:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=8VLvsqUgy0hM9zLhK7gOOsENLHipoK1f59JWtGDzmMU=; b=l9ON6eqapkTIm5gu1QK85Hc1MTr84lWAPXIF3DBz7VTzGC3BZdO2yjputtwkapxU2+ NfrkNLkiNdExkuXnfcSGeUAg4sPl4ISOSrmxxvoWYTbjrah4MHaaXJLszV1WD89yok+m hc6YoziDGDi4+Ac/8tsdYmmTdDAlpSBIu7TkxAKNEf81IM7Hb1i0dRWVId+9RHLZIgKk 5fALsXsWgWYjTdMZvfkzV2pimGmtkmN5GX01akHLg5cISMosVouBwU/E4rZS2ne3zpkp 9YMmhHVe8Ms0y8upL2a7HkLmhrhbCt7/1ULF/WQdWg3ww4KArdQi4swnLkJ3oXaFVK// ffTg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=8VLvsqUgy0hM9zLhK7gOOsENLHipoK1f59JWtGDzmMU=; b=GJaKuGJjPsH7PW302EYzCjEJRkZQd3pQ1tAY700SYPwM6J573aXm0wpMhuWdzA5I88 UjREqHvqHc7Y+oJz2qbTvBpVcgQQkwmXDh/OBUO3LzuyAOW8GD/b4qtNbFH6BficMMrI TkO2P6wmpm9KxertpNRSolAIDzAfWSf39auVtTXPITSpqIhZkwf4FikFUR3TODn42wRV QXHYH4pgqJfhQJrp0FtcAM/SMLnDwL6McJ6tePh0bkXM4hiewOQA4+YoGzUWM5oMeRCD bpkZmu/MnOb2nogvq/lQKClSIeDMx9Up0QpNDqGGItnS/pipMbqu8eCD+6CP09DZeV5b BPkg== X-Gm-Message-State: AOAM5311OXCWbBathE+qaHIcKm9A/DR92S0JQ3awJr2fjlPqZ7gKHuz9 bp7e00Ux1AZUaJaAoAQBrm4aTCoPAg6zifOk5RVqog== X-Google-Smtp-Source: ABdhPJyGRwaJZh1jgstd10TgmMoFO0WGA2g9k6jW/LtbmE8drgusUCptPmzi0v2U/tKiMUtdaN757OdaF7ssFVO32V4= X-Received: by 2002:a25:3345:: with SMTP id z66mr12961119ybz.466.1613063707018; Thu, 11 Feb 2021 09:15:07 -0800 (PST) MIME-Version: 1.0 References: <20201218031703.3053753-1-saravanak@google.com> <56f7d032-ba5a-a8c7-23de-2969d98c527e@nvidia.com> <17939709-f6f4-fa9c-836f-9779081c4087@nvidia.com> <6a43e209-1d2d-b10a-4564-0289d54135d3@nvidia.com> In-Reply-To: From: Saravana Kannan Date: Thu, 11 Feb 2021 09:14:30 -0800 Message-ID: Subject: Re: [PATCH v1 0/5] Enable fw_devlink=on by default To: "Rafael J. Wysocki" Cc: Jon Hunter , Greg Kroah-Hartman , Android Kernel Team , LKML , Jisheng Zhang , Kevin Hilman , John Stultz , Nicolas Saenz Julienne , Marc Zyngier , linux-tegra Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Feb 11, 2021 at 7:03 AM Rafael J. Wysocki wrote: > > On Thu, Feb 11, 2021 at 1:02 AM Saravana Kannan wrote: > > > > On Thu, Jan 28, 2021 at 7:03 AM Jon Hunter wrote: > > > > > > > > > On 14/01/2021 16:56, Jon Hunter wrote: > > > > > > > > On 14/01/2021 16:47, Saravana Kannan wrote: > > > > > > > > ... > > > > > > > >>> Yes this is the warning shown here [0] and this is coming from > > > >>> the 'Generic PHY stmmac-0:00' device. > > > >> > > > >> Can you print the supplier and consumer device when this warning is > > > >> happening and let me know? That'd help too. I'm guessing the phy is > > > >> the consumer. > > > > > > > > > > > > Sorry I should have included that. I added a print to dump this on > > > > another build but failed to include here. > > > > > > > > WARNING KERN Generic PHY stmmac-0:00: supplier 2200000.gpio (status 1) > > > > > > > > The status is the link->status and looks like the supplier is the > > > > gpio controller. I have verified that the gpio controller is probed > > > > before this successfully. > > > > > > > >> So the warning itself isn't a problem -- it's not breaking anything or > > > >> leaking memory or anything like that. But the device link is jumping > > > >> states in an incorrect manner. With enough context of this code (why > > > >> the device_bind_driver() is being called directly instead of going > > > >> through the normal probe path), it should be easy to fix (I'll just > > > >> need to fix up the device link state). > > > > > > > > Correct, the board seems to boot fine, we just get this warning. > > > > > > > > > Have you had chance to look at this further? > > > > Hi Jon, > > > > I finally got around to looking into this. Here's the email[1] that > > describes why it's done this way. > > > > [1] - https://lore.kernel.org/lkml/YCRjmpKjK0pxKTCP@lunn.ch/ > > > > > > > > The following does appear to avoid the warning, but I am not sure if > > > this is the correct thing to do ... > > > > > > index 9179825ff646..095aba84f7c2 100644 > > > --- a/drivers/base/dd.c > > > +++ b/drivers/base/dd.c > > > @@ -456,6 +456,10 @@ int device_bind_driver(struct device *dev) > > > { > > > int ret; > > > > > > + ret = device_links_check_suppliers(dev); > > > + if (ret) > > > + return ret; > > > + > > > ret = driver_sysfs_add(dev); > > > if (!ret) > > > driver_bound(dev); > > > > So digging deeper into the usage of device_bind_driver and looking at > > [1], it doesn't look like returning an error here is a good option. > > When device_bind_driver() is called, the driver's probe function isn't > > even called. So, there's no way for the driver to even defer probing > > based on any of the suppliers. So, we have a couple of options: > > > > 1. Delete all the links to suppliers that haven't bound. > > Or maybe convert them to stateless links? Would that be doable at all? Yeah, I think it should be doable. > > > We'll still leave the links to active suppliers alone in case it helps with > > suspend/resume correctness. > > 2. Fix the warning to not warn on suppliers that haven't probed if the > > device's driver has no probe function. But this will also need fixing > > up the cleanup part when device_release_driver() is called. Also, I'm > > not sure if device_bind_driver() is ever called when the driver > > actually has a probe() function. > > > > Rafael, > > > > Option 1 above is pretty straightforward. > > I would prefer this -> Ok > > > Option 2 would look something like what's at the end of this email + > > caveat about whether the probe check is sufficient. > > -> because "fix the warning" really means that we haven't got the > device link state machine right and getting it right may imply a major > redesign. > > Overall, I'd prefer to take a step back and allow things to stabilize > for a while to let people catch up with this. Are you referring to if/when we implement Option 2? Or do you want to step back for a while even before implementing Option 1? -Saravana > > > Do you have a preference between Option 1 vs 2? Or do you have some > > other option in mind? > > > > Thanks, > > Saravana > > > > diff --git a/drivers/base/core.c b/drivers/base/core.c > > index 5481b6940a02..8102b3c48bbc 100644 > > --- a/drivers/base/core.c > > +++ b/drivers/base/core.c > > @@ -1247,7 +1247,8 @@ void device_links_driver_bound(struct device *dev) > > */ > > device_link_drop_managed(link); > > } else { > > - WARN_ON(link->status != DL_STATE_CONSUMER_PROBE); > > + WARN_ON(link->status != DL_STATE_CONSUMER_PROBE && > > + dev->driver->probe); > > WRITE_ONCE(link->status, DL_STATE_ACTIVE); > > } > > > > @@ -1302,7 +1303,8 @@ static void __device_links_no_driver(struct device *dev) > > if (link->supplier->links.status == DL_DEV_DRIVER_BOUND) { > > WRITE_ONCE(link->status, DL_STATE_AVAILABLE); > > } else { > > - WARN_ON(!(link->flags & DL_FLAG_SYNC_STATE_ONLY)); > > + WARN_ON(!(link->flags & DL_FLAG_SYNC_STATE_ONLY) && > > + dev->driver->probe); > > WRITE_ONCE(link->status, DL_STATE_DORMANT); > > } > > }