From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0ADA7C4743D for ; Mon, 7 Jun 2021 03:38:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id DB085611C1 for ; Mon, 7 Jun 2021 03:38:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230209AbhFGDkR (ORCPT ); Sun, 6 Jun 2021 23:40:17 -0400 Received: from esa3.hgst.iphmx.com ([216.71.153.141]:55825 "EHLO esa3.hgst.iphmx.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230127AbhFGDkP (ORCPT ); Sun, 6 Jun 2021 23:40:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1623037104; x=1654573104; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=ENE69q+sDnhSIA+PGnx8nb8sPt5bnyrZ1ts0Ld0eghHeArlPbeb9nMfl /Z6ORv8+lGYdmf5bafmhDeuX1ahJ8xQ+N52mMMy0z/GO4owDGxgXcfh4C oyA3AzyDyroH+2BPcsah5DPU+GqjraHio7VWAAwdjEAdDYrnUzFsT0JDu Ss82LWZRkZ5Gkda4TyBSq6rZ/gou75XL1O0ZayirmQ+Oa8fegC6UAPMT9 SSvU0bBAUQXhEl8amRCyCN/AIMFDv8qakLNPSLgMzBqBX+3nu+N9ZFA+5 0np4p7S4WndCkkqDhnGQ1TgTeDhJYiq93Vm5AZbD83wrak3xUd8l5UTna A==; IronPort-SDR: jq0j9fFt6COp7zarw5FuCs+4biiVs9eOwFQSHuHcQFuXILGFjkk0JgE6jZGR/OOElGklQvAYVp 987EqpcNPDZqJDivLxsBjFXAakeFOH++yD/Iv7wJ3yuzvuv8s9is4D9XLHc/kkf2B4hEHd9gYT zvzjF7DvevuouZCq0NwFyhhaK/Gp648ubEdEFba+llTOpghMWPDRgNO0C3bHhCZmZA+GVmGIQk o0TWJ9CyhCOUKLo4frI3GzoaXp9Q0Hu7SHLmUXM/9ejcg6IeuIW0kXQv7R1h7tFWrod8FeLtGR olc= X-IronPort-AV: E=Sophos;i="5.83,254,1616428800"; d="scan'208";a="175732252" Received: from mail-mw2nam10lp2100.outbound.protection.outlook.com (HELO NAM10-MW2-obe.outbound.protection.outlook.com) ([104.47.55.100]) by ob1.hgst.iphmx.com with ESMTP; 07 Jun 2021 11:38:23 +0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LJBGfi0gWejM6NplGFWXNvfhcRjp0yabv+83TyhabdLwT0+a6Dvk6Xk2U5uAb9e/jBAHEHLxI8GO16/hm891aBzcwgdx32IYR2fINa05JS2m75CwR25VcYvEt9UkKGsOV5SIXet5q/cjHagEkREdsCAh4QnhQt5rbWn9uRZHaBHZ/Qbs+iR2mHK6Z7z7GHuhiLZbRkE/7vKU2ObB/AOpt2mNOB7CRXfUdXGOy+hiC5EWC12y8R6xlp/QzmSTd5tiPZpg7LWzSlGUl8eRYa9TGS906PL6kOPVugJZSiOemY6Dh8e/ht16jNAyao5FqiENDCr03yvmWAltZpvaVpKdHw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=ftzBvILs/ln+vcctsygvTPKyMKY8mixs2b73IsIArB6K1ocjWyrygTeYqf2Pag9dUoktn4EAVwetHZoXkaIzJ5GZ/ruWOUGIzA3MNJaQjuAojXLg20NVq/eb3HECRY2IBFcBSD7y6UfPGii+7X/DhUE23X/qxleoJego38ARp/SDEtpmQ7xdu2AnUfKqs7T+vmsXUOpEkwsZaQRvLuQ21zTCrJCgA3So6I6TgoM8G8T+WffEU3EibMfANa3lledBaztJKwnoWLUharH5r09M8h+J7Id2ooBTsK41R3hBil5kK+7gX6YTn7rrKRfrZFfjxyipvsIX15bfOAIaenM5+Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=wdc.com; dmarc=pass action=none header.from=wdc.com; dkim=pass header.d=wdc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sharedspace.onmicrosoft.com; s=selector2-sharedspace-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=ravX0AhFZjoFNsTpDbE2QJQecc3W8uUMf1JSCz5nIMiYz58NJNiDNBObrpxABdK1itnx2jUOnwKGGcd3XgUTN4/u66refrBLzQmZbUbJ3dAByDPGbe9jNhK97NFOVi2rfSBngitIPMo2+RfOfQEUZd8KxHTQg6ZtcA0z6PXNaVs= Received: from CO6PR04MB7812.namprd04.prod.outlook.com (2603:10b6:303:138::6) by CO6PR04MB7780.namprd04.prod.outlook.com (2603:10b6:5:359::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.21; Mon, 7 Jun 2021 03:38:23 +0000 Received: from CO6PR04MB7812.namprd04.prod.outlook.com ([fe80::a153:b7f8:c87f:89f8]) by CO6PR04MB7812.namprd04.prod.outlook.com ([fe80::a153:b7f8:c87f:89f8%8]) with mapi id 15.20.4195.030; Mon, 7 Jun 2021 03:38:23 +0000 From: Anup Patel To: Guo Ren , Atish Patra , Palmer Dabbelt CC: "anup@brainfault.org" , "drew@beagleboard.org" , Christoph Hellwig , "wefu@redhat.com" , "lazyparser@gmail.com" , "linux-riscv@lists.infradead.org" , "linux-kernel@vger.kernel.org" , "linux-arch@vger.kernel.org" , "linux-sunxi@lists.linux.dev" , "guoren@linux.alibaba.com" , Paul Walmsley Subject: RE: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support Thread-Topic: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support Thread-Index: AQHXTGyTk+HLcFgtPEChsdrUswIwKarqRJuAgAAMWQCAAABbgIAADXqAgAAFs4CABEeUAIAMkQUAgAaHrgCAABm6QIAFdrYAgACrsNA= Date: Mon, 7 Jun 2021 03:38:23 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: kernel.org; dkim=none (message not signed) header.d=none;kernel.org; dmarc=none action=none header.from=wdc.com; x-originating-ip: [122.167.153.147] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 96206912-0038-4d86-e3ae-08d92965b3b3 x-ms-traffictypediagnostic: CO6PR04MB7780: x-microsoft-antispam-prvs: wdcipoutbound: EOP-TRUE x-ms-oob-tlc-oobclassifiers: OLM:6790; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: CAgsIWz36F+f5JzRniXdxHVNk6KBp26pmNX8+7lBT+HdlMZVuFINoAow+Pi4SX94jG5JMa+rXRLvolZysDJ2xYOK0dpYFAwcUu6xSTL4ijpMvovgTsSIc/gL7v/EWzK3kMoxhwJ22d+odI420XN6kPXIvem7UFbU7B3EfidECCVTD4LXa2BtH1RrxkWMlXllZ/uPCibwMwjqLuFh/lWdY8THkPWhps4CwWXNLyKXuas/9OU2tFqVY5cUqqKLfwcithC8Z0H6UuSBJfIGMVVRuHvVJmFOowP3LhEX46DCcXABgOHjM0b1uFy16QxVciBCy9LYPba3YX51jflCWhwB9eqBNg/Ynu1jOAE0dSa3pcN3YmGrcRu4hCb9GaGeO68vXa63V+7CR2mFC9wU4QDuxr51frmvoqYxEukzQgXa1YqxU6VQZFLetVmx9Lygujh5KDTh9X91vzF/h+woQJibEC89d3rArw/MUahQkI+KOAe8oFK/itO+RwcCiTNsWnS2EuNbQC6MDj78I9LznsKiabiU7ZJzLWemjmYPWmG+1UnWcsmOzWABx7aXqYkKiL2VxEdKN1wpabsbE86ku35WhqJC3z7sxJEVsbMXLWUjfqFcPGfwhcipkGUWD5Cgw+sEfZRbpNPBJrlQkuNlKaTTDVdFAlXZi54fR2BqKv7VPS7DpQET1PH8yXXXGoSXAWGsVAGKTugz1wxuvIqQKqzalhVdcUMlPTLjGhP9b2syxNKxg0yNhktGv+AygpNBW/0opTO437ZesYy4CZeynVVWVA== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CO6PR04MB7812.namprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(396003)(136003)(376002)(346002)(39860400002)(966005)(7416002)(30864003)(478600001)(186003)(2906002)(66446008)(83380400001)(8936002)(66556008)(66946007)(38100700002)(122000001)(71200400001)(86362001)(55016002)(8676002)(66476007)(64756008)(9686003)(53546011)(6506007)(7696005)(26005)(76116006)(316002)(52536014)(110136005)(5660300002)(33656002)(4326008)(54906003);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata: =?utf-8?B?OGVVZEsrVi9rZFZaMUFYOVR0TjZUUEdNd3lrNkJMaDdWem9YZEQ1dHZWWURq?= =?utf-8?B?a0pYVkx5SDJONXYrOHpCR1JVQUlpbGVQNzIrK0djSGd4ME9YUzg3cDZDZE1U?= =?utf-8?B?ZnZqeHduUjd4dnpyL09RTTliRC96NUgzTWpwcHRxOEU5RGJQa3AyaTMzaG1M?= =?utf-8?B?eEw4bXRVUW5uV015UENyeXZOMGo2akJucmorWG5ZM2pZZ1JGZlBrbDQ0dVdr?= =?utf-8?B?WEVwelV0UHpNMHpxV2lRWnNnVnJHUXU3WlVlTGRjaGNGT0hKTDVwVWJZalpj?= =?utf-8?B?Z2hLb3JaZUMyMmZmQUNnSXpOSWtRM09SVExxb2luQmNWMjZucnZMSEZZc2ox?= =?utf-8?B?Qy8vTzQ0MzB2eHlBb24yMmJlOEdvWTJaUEgvUDdoV0xiYndwUDFKRmVlY0Y0?= =?utf-8?B?T3NXR0dLMGdhLzBHV0ZNcHlqOXNrVFZYTGJwLyt0ek9TOHRIS2VqblZUQ1hD?= =?utf-8?B?aE5yWmxkYkFSQnByQ1dCeFUvcWliUWxvOFNGQnozVnBrUU91MUhSN1ZabzRM?= =?utf-8?B?S2Joek9oMjkrNWZzTXhxVktjTE5RMmtoRmhBMnVjbWZnNkpDQTlWNWZnNXc4?= =?utf-8?B?aG1wR0N5L0NRZTRCZ1l3dVhEMmNRWTdmaE53MlJNdUw4WXppOUR6UGdMeFdp?= =?utf-8?B?enplMmp1WHVRNjFLUm40dEcreFdJZUhIQkRLRlNCd2dXblFJRFBQTWtFd3ZT?= =?utf-8?B?V3E4QlE5MGVSOGNxdHQ0cWluOEZ5cEJMN2FnYW1DSmVhOFMwWmpLdVJNenZi?= =?utf-8?B?Q3NPREduVmMyUW1wckZtNU9DV1VwQUZmMlhOWVV0MFdxTUpUSGVKQjJOM2w0?= =?utf-8?B?Z3JTVHJWcFhYSlMyWWw3clRMVHJuSUZvcTRMVFR0QnkwTXJLMklsYVVKZElr?= =?utf-8?B?Mm9OaWVjQmc1aXVrL3pRYXFZdHFHVkEwSkVwbXBSWmJtNzZNd1FUeGxTZTI4?= =?utf-8?B?bUoxd3ZqeC9kK0FKTGcrSWVRNkpVZlRFNE9NMEQ5WWIrdHdQaDVoZGoxRUxv?= =?utf-8?B?a2NYSUIrYVdUeWViekl6SzZ6OTBocXZXMmE5Mkd3K0FBallpM3VUVkF6WnRs?= =?utf-8?B?Nmp2bzlpbkg3eldpUHZicW1FVldpMzFQN1BDOGlZVUxocFJrZHU4ZzYwaTQ1?= =?utf-8?B?Um1UN3JvZ0JwRXNPWkpFOVE0MDlSd1RmUWFQdk1vN3dsSFQ0M1A4T09rWTdv?= =?utf-8?B?VXozWkxSb1hNcWR0K2k0dDJDc3lRaVF1OUhFcnNTaUZyRHVFUkEzMjl0c3My?= =?utf-8?B?V3gzbTM4OWdndFlrNkJ1bThoak9neUprNmdKTEFhQ0Fra2VaV2RJUDkyREdI?= =?utf-8?B?R0d5QXZ6S2NRc2pkQWN2Q1BUNE5BcEl5K21jZWhzRWI0V01hdVZWbG96NWRv?= =?utf-8?B?VUYwV3VqT0piZFd3UzFuK05YVkNJUG1nZGhWakdKNlFpRkdWMHd0d09FZU9y?= =?utf-8?B?MTIrOXpRSlQ2VGQ4amk2Z1R2TXJnSFJ3eUVEYlpzL2FXZnNwY3BhaGFUQkM1?= =?utf-8?B?bkQyYlNZU2tjUGtpRDZSWXJUWWtPek8ySkwxUDdIa2FsQTlwaHJhZklTU24z?= =?utf-8?B?SVJwMG1yZkRjd0lYaklXbHhrenhEMEtQYTczNXRNZU8wblMyWmEvdllGK0d1?= =?utf-8?B?RnI5MnV3SnYyY21YSkRXeFdlQmFmMUpoRSsveDYydkprbmI2dzNLbHlBU1N3?= =?utf-8?B?UFVhUU9SNU5lbVBJZU5ydVBwUGdxSXlVNHpELy9uUlE0eklRNDk5K1RUWHFm?= =?utf-8?Q?DYFvsDS9xzEQvBCSDZ00K84NFt96ccZk0oSEI38?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: wdc.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CO6PR04MB7812.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 96206912-0038-4d86-e3ae-08d92965b3b3 X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Jun 2021 03:38:23.1040 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: b61c8803-16f3-4c35-9b17-6f65f441df86 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: oAtcBDrf8sJK6U/Yq7cv5Y+rsaZ9VbFR+Y5ETei3tU02XHwKZeh76PPurjwrwf7v26l7rDqghHY5rOg4J/Fuqg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR04MB7780 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org DQoNCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCj4gRnJvbTogR3VvIFJlbiA8Z3VvcmVu QGtlcm5lbC5vcmc+DQo+IFNlbnQ6IDA2IEp1bmUgMjAyMSAyMjo0Mg0KPiBUbzogQW51cCBQYXRl bCA8QW51cC5QYXRlbEB3ZGMuY29tPjsgQXRpc2ggUGF0cmEgPGF0aXNocEBhdGlzaHBhdHJhLm9y Zz4NCj4gQ2M6IFBhbG1lciBEYWJiZWx0IDxwYWxtZXJAZGFiYmVsdC5jb20+OyBhbnVwQGJyYWlu ZmF1bHQub3JnOw0KPiBkcmV3QGJlYWdsZWJvYXJkLm9yZzsgQ2hyaXN0b3BoIEhlbGx3aWcgPGhj aEBsc3QuZGU+OyB3ZWZ1QHJlZGhhdC5jb207DQo+IGxhenlwYXJzZXJAZ21haWwuY29tOyBsaW51 eC1yaXNjdkBsaXN0cy5pbmZyYWRlYWQub3JnOyBsaW51eC0NCj4ga2VybmVsQHZnZXIua2VybmVs Lm9yZzsgbGludXgtYXJjaEB2Z2VyLmtlcm5lbC5vcmc7IGxpbnV4LQ0KPiBzdW54aUBsaXN0cy5s aW51eC5kZXY7IGd1b3JlbkBsaW51eC5hbGliYWJhLmNvbTsgUGF1bCBXYWxtc2xleQ0KPiA8cGF1 bC53YWxtc2xleUBzaWZpdmUuY29tPg0KPiBTdWJqZWN0OiBSZTogW1BBVENIIFJGQyAwLzNdIHJp c2N2OiBBZGQgRE1BX0NPSEVSRU5UIHN1cHBvcnQNCj4gDQo+IEhpIEFudXAgYW5kIEF0aXNoLA0K PiANCj4gT24gVGh1LCBKdW4gMywgMjAyMSBhdCAyOjAwIFBNIEFudXAgUGF0ZWwgPEFudXAuUGF0 ZWxAd2RjLmNvbT4gd3JvdGU6DQo+ID4NCj4gPg0KPiA+DQo+ID4gPiAtLS0tLU9yaWdpbmFsIE1l c3NhZ2UtLS0tLQ0KPiA+ID4gRnJvbTogUGFsbWVyIERhYmJlbHQgPHBhbG1lckBkYWJiZWx0LmNv bT4NCj4gPiA+IFNlbnQ6IDAzIEp1bmUgMjAyMSAwOTo0Mw0KPiA+ID4gVG86IGd1b3JlbkBrZXJu ZWwub3JnDQo+ID4gPiBDYzogYW51cEBicmFpbmZhdWx0Lm9yZzsgZHJld0BiZWFnbGVib2FyZC5v cmc7IENocmlzdG9waCBIZWxsd2lnDQo+ID4gPiA8aGNoQGxzdC5kZT47IEFudXAgUGF0ZWwgPEFu dXAuUGF0ZWxAd2RjLmNvbT47IHdlZnVAcmVkaGF0LmNvbTsNCj4gPiA+IGxhenlwYXJzZXJAZ21h aWwuY29tOyBsaW51eC1yaXNjdkBsaXN0cy5pbmZyYWRlYWQub3JnOyBsaW51eC0NCj4gPiA+IGtl cm5lbEB2Z2VyLmtlcm5lbC5vcmc7IGxpbnV4LWFyY2hAdmdlci5rZXJuZWwub3JnOyBsaW51eC0N Cj4gPiA+IHN1bnhpQGxpc3RzLmxpbnV4LmRldjsgZ3VvcmVuQGxpbnV4LmFsaWJhYmEuY29tOyBQ YXVsIFdhbG1zbGV5DQo+ID4gPiA8cGF1bC53YWxtc2xleUBzaWZpdmUuY29tPg0KPiA+ID4gU3Vi amVjdDogUmU6IFtQQVRDSCBSRkMgMC8zXSByaXNjdjogQWRkIERNQV9DT0hFUkVOVCBzdXBwb3J0 DQo+ID4gPg0KPiA+ID4gT24gU2F0LCAyOSBNYXkgMjAyMSAxNzozMDoxOCBQRFQgKC0wNzAwKSwg UGFsbWVyIERhYmJlbHQgd3JvdGU6DQo+ID4gPiA+IE9uIEZyaSwgMjEgTWF5IDIwMjEgMTc6MzY6 MDggUERUICgtMDcwMCksIGd1b3JlbkBrZXJuZWwub3JnIHdyb3RlOg0KPiA+ID4gPj4gT24gV2Vk LCBNYXkgMTksIDIwMjEgYXQgMzoxNSBQTSBBbnVwIFBhdGVsIDxhbnVwQGJyYWluZmF1bHQub3Jn Pg0KPiA+ID4gd3JvdGU6DQo+ID4gPiA+Pj4NCj4gPiA+ID4+PiBPbiBXZWQsIE1heSAxOSwgMjAy MSBhdCAxMjoyNCBQTSBEcmV3IEZ1c3RpbmkNCj4gPiA+IDxkcmV3QGJlYWdsZWJvYXJkLm9yZz4g d3JvdGU6DQo+ID4gPiA+Pj4gPg0KPiA+ID4gPj4+ID4gT24gV2VkLCBNYXkgMTksIDIwMjEgYXQg MDg6MDY6MTdBTSArMDIwMCwgQ2hyaXN0b3BoIEhlbGx3aWcNCj4gPiA+IHdyb3RlOg0KPiA+ID4g Pj4+ID4gPiBPbiBXZWQsIE1heSAxOSwgMjAyMSBhdCAwMjowNTowMFBNICswODAwLCBHdW8gUmVu IHdyb3RlOg0KPiA+ID4gPj4+ID4gPiA+IFNpbmNlIHRoZSBleGlzdGluZyBSSVNDLVYgSVNBIGNh bm5vdCBzb2x2ZSB0aGlzIHByb2JsZW0sDQo+ID4gPiA+Pj4gPiA+ID4gaXQgaXMgYmV0dGVyIHRv IHByb3ZpZGUgc29tZSBjb25maWd1cmF0aW9uIGZvciB0aGUgU09DDQo+ID4gPiA+Pj4gPiA+ID4g dmVuZG9yIHRvDQo+ID4gPiBjdXN0b21pemUuDQo+ID4gPiA+Pj4gPiA+DQo+ID4gPiA+Pj4gPiA+ IFdlJ3ZlIGJlZW4gdGFsa2luZyBhYm91dCB0aGlzIHByb2JsZW0gZm9yIGNsb3NlIHRvIGZpdmUg eWVhcnMuDQo+ID4gPiA+Pj4gPiA+IFNvIG5vLCBpZiB5b3UgZG9uJ3QgbWFuYWdlIHRvIGdldCB0 aGUgZmVhdHVyZSBpbnRvIHRoZSBJU0ENCj4gPiA+ID4+PiA+ID4gaXQgY2FuJ3QgYmUgc3VwcG9y dGVkLg0KPiA+ID4gPj4+ID4NCj4gPiA+ID4+PiA+IElzbid0IGl0IGEgZ29vZCBnb2FsIGZvciBM aW51eCB0byBzdXBwb3J0IHRoZSBjYXBhYmlsaXRpZXMNCj4gPiA+ID4+PiA+IHByZXNlbnQgaW4g dGhlIFNvQyB0aGF0IGEgY3VycmVudGx5IGJlaW5nIGZhYidkPw0KPiA+ID4gPj4+ID4NCj4gPiA+ ID4+PiA+IEkgYmVsaWV2ZSB0aGUgQ01PIGdyb3VwIG9ubHkgc3RhcnRlZCBsYXN0IHllYXIgWzFd IHNvIHRoZQ0KPiA+ID4gPj4+ID4gUlY2NEdDIFNvQ3MgdGhhdCBhcmUgZ29pbmcgaW50byBtYXNz IHByb2R1Y3Rpb24gdGhpcyB5ZWFyDQo+ID4gPiA+Pj4gPiB3b3VsZCBub3QgaGF2ZSBoYWQgdGhl IG9wcG9ydW50aXkgb2YgdXRpbGl6aW5nIGFueSBSSVNDLVYgSVNBDQo+ID4gPiA+Pj4gPiBleHRl bnNpb24gZm9yIGhhbmRsaW5nIGNhY2hlIG1hbmFnZW1lbnQuDQo+ID4gPiA+Pj4NCj4gPiA+ID4+ PiBUaGUgY3VycmVudCBMaW51eCBSSVNDLVYgcG9saWN5IGlzIHRvIG9ubHkgYWNjZXB0IHBhdGNo ZXMgZm9yDQo+ID4gPiA+Pj4gZnJvemVuIG9yIHJhdGlmaWVkIElTQSBzcGVjcy4NCj4gPiA+ID4+ PiAoUmVmZXIsIERvY3VtZW50YXRpb24vcmlzY3YvcGF0Y2gtYWNjZXB0YW5jZS5yc3QpDQo+ID4g PiA+Pj4NCj4gPiA+ID4+PiBUaGlzIG1lYW5zIGV2ZW4gaWYgZW11bGF0ZSBDTU8gaW5zdHJ1Y3Rp b25zIGluIE9wZW5TQkksIHRoZQ0KPiA+ID4gPj4+IExpbnV4IHBhdGNoZXMgd29uJ3QgYmUgdGFr ZW4gYnkgUGFsbWVyIGJlY2F1c2UgQ01PIHNwZWNpZmljYXRpb24NCj4gPiA+ID4+PiBpcyBzdGls bCBpbiBkcmFmdCBzdGFnZS4NCj4gPiA+ID4+IEJlZm9yZSBDTU8gc3BlY2lmaWNhdGlvbiByZWxl YXNlLCBjb3VsZCB3ZSB1c2UgYSBzYmlfZWNhbGwgdG8NCj4gPiA+ID4+IHNvbHZlIHRoZSBjdXJy ZW50IHByb2JsZW0/IFRoaXMgaXMgbm90IGFnYWluc3QgdGhlIHNwZWNpZmljYXRpb24sDQo+ID4g PiA+PiB3aGVuIENNTyBpcyByZWFkeSB3ZSBjb3VsZCBsZXQgdXNlcnMgY2hvb3NlIHRvIHVzZSB0 aGUgbmV3IENNTyBpbg0KPiBMaW51eC4NCj4gPiA+ID4+DQo+ID4gPiA+PiBGcm9tIGEgdGVjaCB2 aWV3LCBDTU8gdHJhcCBlbXVsYXRpb24gaXMgdGhlIHNhbWUgYXMgc2JpX2VjYWxsLg0KPiA+ID4g Pj4NCj4gPiA+ID4+Pg0KPiA+ID4gPj4+IEFsc28sIHdlIGFsbCBrbm93IGhvdyBtdWNoIHRpbWUg aXQgdGFrZXMgZm9yIFJJU0NWIGludGVybmF0aW9uYWwNCj4gPiA+ID4+PiB0byBmcmVlemUgc29t ZSBzcGVjLiBKdWRnaW5nIGJ5IHRoYXQgd2UgYXJlIGxvb2tpbmcgYXQgYW5vdGhlcg0KPiA+ID4g Pj4+IDMtNCB5ZWFycyBhdCBtaW5pbXVtLg0KPiA+ID4gPg0KPiA+ID4gPiBTb3JyeSBmb3IgYmVp bmcgc2xvdyBoZXJlLCB0aGlzIHRocmVhZCBnb3QgYnVyaWVkLg0KPiA+ID4gPg0KPiA+ID4gPiBJ J3ZlIGJlZW4gdHJ5aW5nIHRvIHdvcmsgd2l0aCBhIGhhbmRmdWwgb2YgZm9sa3MgYXQgdGhlIFJJ U0MtVg0KPiA+ID4gPiBmb3VuZGF0aW9uIHRvIHRyeSBhbmQgZ2V0IGEgc3Vic2V0IG9mIHRoZSB2 YXJpb3VzIGluLWRldmVsb3BtZW50DQo+ID4gPiA+IHNwZWNpZmljYXRpb25zIChzb21lIHNpbXBs ZSBDTU9zLCBzb21ldGhpbmcgYWJvdXQgbm9uLWNhY2hpbmcgaW4NCj4gPiA+ID4gdGhlIHBhZ2Ug dGFibGVzLCBhbmQgc29tZSB3YXkgdG8gcHJldmVudCBzcGVjdWxhdGl2ZSBhY2Nlc3NlIGZyb20N Cj4gPiA+ID4gZ2VuZXJhdGluZyBjb2hlcmVuY2UgdHJhZmZpYyB0aGF0IHdpbGwgYnJlYWsgbm9u LWNvaGVyZW50IHN5c3RlbXMpLg0KPiA+ID4gPiBJJ20gbm90IHN1cmUgd2UgY2FuIGdldCB0aGlz IHRvZ2V0aGVyIHF1aWNrbHksIGJ1dCBJJ2QgcHJlZmVyIHRvDQo+ID4gPiA+IGF0IGxlYXN0IHRy eSBiZWZvcmUgd2UganVtcCB0byB0YWtpbmcgdmVuZG9yLXNwZWNpZmljZWQgYmVoYXZpb3IgaGVy ZS4NCj4gPiA+ID4gSXQncyBvYnZpb3VzbHkgYW4gdXAtaGlsbCBiYXR0bGUgdG8gdHJ5IGFuZCBn ZXQgc3BlY2lmaWNhdGlvbnMNCj4gPiA+ID4gdGhyb3VnaCB0aGUgcHJvY2VzcyBhbmQgSSdtIGNl cnRhaW5seSBub3QgZ29pbmcgdG8gcHJvbWlzZSBpdCB3aWxsDQo+ID4gPiA+IHdvcmssIGJ1dCBJ J20gaG9waW5nIHRoYXQgdGhlIGltcGVuZGluZyBuZWVkIHRvIGF2b2lkIGZvcmtpbmcgdGhlDQo+ ID4gPiA+IElTQSB3aWxsIGJlIHN1ZmZpY2llbnQgdG8gZ2V0IHBlb3BsZSBiZWhpbmQgcHJvZHVj aW5nIHNvbWUNCj4gPiA+ID4gc3BlY2lmaWNhdGlvbnMgaW4gYSB0aW1lbHkNCj4gPiA+IGZhc2hp b24uDQo+ID4gPiA+DQo+ID4gPiA+IEkgd2Fzbid0IGF3YXJlIHRoYW4gdGhpcyBjaGlwIGhhZCBu b24tY29oZXJlbnQgZGV2aWNlcyB1bnRpbCBJIHNhdw0KPiA+ID4gPiB0aGlzIHRocmVhZCwgc28g d2UnZCBiZWVuIG1vc3RseSBmb2N1c2VkIG9uIHRoZSBCZWFnbGUgViBjaGlwLg0KPiA+ID4gPiBU aGF0IHdhcyBpbiBhIHNlbnNlIGFuIGVhc2llciBwcm9ibGVtIGJlY2F1c2UgdGhlIFNpRml2ZSBJ UCBpbiBpdA0KPiA+ID4gPiB3YXMgbmV2ZXIgZGVzaWduZWQgdG8gaGF2ZSBub24tY29oZXJlbnQg ZGV2aWNlcyBzbyB3ZSdkIGhhdmUgdG8NCj4gPiA+ID4gbWFrZSBhbnl0aGluZyB3b3JrIHZpYSBh IHNlcmllcyBvZiBzbG93IHdvcmthcm91bmRzLCB3aGljaCB3b3VsZA0KPiA+ID4gPiBtYWtlIGVt dWxhdGluZyB0aGUgZXZlbnR1YWxseSBzdGFuZGFyZGl6ZWQgYmVoYXZpb3IgcmVhc29uYWJsZSBp bg0KPiA+ID4gPiB0ZXJtcyBvZiBwZXJmb3JtYW5jZSAoaWUsIGV2ZXJ5dGhpbmcgd291bGQgYmUg c3VwZXIgc2xvdyBzbyB3aG8gcmVhbGx5DQo+IGNhcmVzKS4NCj4gPiA+ID4NCj4gPiA+ID4gSSBk b24ndCB0aGluayByZWx5aW5nIG9uIHNvbWUgc29ydCBvZiBTQkkgY2FsbCBmb3IgdGhlIENNT3Mg d2hvdWxkDQo+ID4gPiA+IGJlIHN1Y2ggYSBwZXJmb3JtYW5jZSBoaXQgdGhhdCBpdCB3b3VsZCBw cmV2ZW50IHRoZXNlIHN5c3RlbXMgZnJvbQ0KPiA+ID4gPiBiZWluZyB2aWFibGUsIGJ1dCBhc3N1 bWluZyB5b3UgaGF2ZSByZWFzb25hYmxlIHBlcmZvcm1hbmNlIG9uIHlvdXINCj4gPiA+ID4gbm9u LWNhY2hlZCBhY2Nlc3NlcyB0aGVuIHRoYXQncyBwcm9iYWJseSBub3QgZ29pbmcgdG8gYmUgdmlh YmxlIHRvDQo+ID4gPiA+IHRyYXAgYW5kIGVtdWxhdGUuICBBdCB0aGF0IHBvaW50IGl0IHJlYWxs eSBqdXN0IGJlY29tZXMgc2lsbHkgdG8NCj4gPiA+ID4gcHJldGVuZCB0aGF0IHdlJ3JlIHN0aWxs IG1ha2luZyB0aGluZ3Mgd29yayBieSBlbXVsYXRpbmcgdGhlDQo+ID4gPiA+IGV2ZW50dWFsbHkg cmF0aWZpZWQgYmVoYXZpb3IsIGFzIGFueW9uZSB3aG8gYWN0dWFsbHkgdHJpZXMgdG8gdXNlDQo+ ID4gPiA+IHRoaXMgdGhpbmcgdG8gZG8gSU8gd291bGQgbmVlZCBvdXQgb2YgdHJlZSBwYXRjaGVz LiAgSSdtIG5vdCBzdXJlDQo+ID4gPiA+IGV4YWN0bHkgd2hhdCB0aGUgcGxhbiBpcyBmb3IgdGhl IHBhZ2UgdGFibGUgYml0cyBpbiB0aGUNCj4gPiA+ID4gc3BlY2lmaWNhdGlvbiByaWdodCBub3cs IGJ1dCBpZiB5b3UgY2FuIGdpdmUgbWUgYSBwb2ludGVyIHRvIHNvbWUNCj4gPiA+ID4gZG9jdW1l bnRhdGlvbiB0aGVuIEknbSBoYXBweSB0byB0cnkgYW5kIHB1c2ggZm9yIHNvbWV0aGluZw0KPiBj b21wYXRpYmxlLg0KPiA+ID4gPg0KPiA+ID4gPiBJZiB3ZSBjYW4ndCBtYWtlIHRoZSBwcm9jZXNz IHdvcmsgYXQgdGhlIGZvdW5kYXRpb24gdGhlbiBJJ2QgYmUNCj4gPiA+ID4gc3Ryb25nbHkgaW4g ZmF2b3Igb2YganVzdCBiaXRpbmcgdGhlIGJ1bGxldCBhbmQgc3RhcnRpbmcgdG8gdGFrZQ0KPiA+ ID4gPiB2ZW5kb3Itc3BlY2lmaWMgY29kZSB0aGF0J3MgYmVlbiBpbXBsZW1lbnRlZCBpbiBoYXJk d2FyZSBhbmQgaXMNCj4gPiA+ID4gbmVjZXNzYXJyeSB0byBtYWtlIHRoaW5ncyB3b3JrIGFjY2Vw dGFibHkuICBUaGF0J3Mgb2J2aW91c2x5IGENCj4gPiA+ID4gc3ViLW9wdGltYWwgc29sdXRpb24g YXMgaXQnbGwgbGVhZCB0byBhIGJ1bmNoIG9mIElTQQ0KPiA+ID4gPiBmcmFnbWVudGF0aW9uLCBi dXQgYXQgbGVhc3Qgd2UnbGwgYmUgYWJsZSB0byBrZWVwIHRoZSBzb2Z0d2FyZSBzdGFjaw0KPiB0 b2dldGhlci4NCj4gPiA+ID4NCj4gPiA+ID4gQ2FuIHlvdSB0ZWxsIHVzIHdoZW4gdGhlc2Ugd2ls bCBiZSBpbiB0aGUgaGFuZHMgb2YgdXNlcnM/ICBUaGF0J3MNCj4gPiA+ID4gcHJldHR5IGltcG9y dGFudCBoZXJlLCBhcyBJIGRvbid0IHdhbnQgdG8gYmUgYmxvY2tpbmcgcmVhbCB1c2Vycw0KPiA+ ID4gPiBmcm9tIGhhdmluZyB0aGVpciBoYXJkd2FyZSB3b3JrLiAgSUlSQyB0aGVyZSB3ZXJlIHNv bWUgcGxhbnMgdG8NCj4gPiA+ID4gZGlzdHJpYnV0ZSBlYXJseSBib2FyZHMsIGJ1dCBpdCBsb29r cyBsaWtlIHRoZSBmb3VuZGF0aW9uIGdvdA0KPiA+ID4gPiBpbnZvbHZlZCBhbmQgSSBndWVzcyBJ IGxvc3QgdGhlIHRocmVhZCBhdCB0aGF0IHBvaW50Lg0KPiA+ID4gPg0KPiA+ID4gPiBTb3JyeSB0 aGlzIGlzIGFsbCBzdWNoIGEgaGVhZGFjaGUsIGJ1dCBob3BlZnVsbHkgd2UgY2FuIGdldCB0aGlu Z3MNCj4gPiA+ID4gc29ydGVkIG91dC4NCj4gPiA+DQo+ID4gPiBJIHRhbGtlZCB3aXRoIHNvbWUg b2YgdGhlIFJJU0MtViBmb3VuZGF0aW9uIGZvbGtzLCB3ZSdyZSBub3QgZ29pbmcNCj4gPiA+IHRv IGhhdmUgYW4gSVNBIHNwZWNpZmljYXRpb24gZm9yIHRoZSBub24tY29oZXJlbnQgc3R1ZmYgYW55 IHRpbWUNCj4gPiA+IHNvb24uICBJIHRvb2sgYSBsb29rIGF0IHRoaXMgY29kZSBhbmQgSSBkZWZp bmF0ZWx5IGRvbid0IHdhbnQgdG8NCj4gPiA+IHRha2UgaXQgYXMgaXMsIGJ1dCBJJ20gbm90IG9w cG9zZWQgdG8gdGFraW5nIHNvbWV0aGluZyB0aGF0IG1ha2VzIHRoZQ0KPiBoYXJkd2FyZSB3b3Jr IGFzIGxvbmcgYXMgaXQncyBhIGxvdCBjbGVhbmVyLg0KPiA+ID4gV2UndmUgYWxyZWFkeSBnb3Qg dHdvIG9mIHRoZXNlIG5vbi1jb2hlcmVudCBjaGlwcywgSSdtIHN1cmUgbW9yZQ0KPiA+ID4gd2ls bCBjb21lLCBhbmQgSSdkIHJhdGhlciBoYXZlIHRoZSBleHRyYSBoZWFkYWNoZXMgdGhhbiBtYWtl DQo+ID4gPiBldmVyeW9uZSBmb3JrIHRoZSBzb2Z0d2FyZSBzdGFjay4NCj4gPg0KPiA+IFRoYW5r cyBmb3IgY29uZmlybWluZy4gVGhlIENNTyBleHRlbnNpb24gaXMgc3RpbGwgaW4gZWFybHkgc3Rh Z2VzIHNvDQo+ID4gaXQgd2lsbCBjZXJ0YWlubHkgdGFrZSBtb3JlIHRpbWUgZm9yIHRoZW0uIEFm dGVyIENNTyBleHRlbnNpb24gaXMNCj4gPiBmaW5hbGl6ZWQsIGl0IHdpbGwgdGFrZSBzb21lIG1v cmUgdGltZSB0byBoYXZlIGFjdHVhbCBSSVNDLVYgcGxhdGZvcm1zIHdpdGgNCj4gQ01PIGltcGxl bWVudGVkLg0KPiA+DQo+ID4gPg0KPiA+ID4gQWZ0ZXIgdGFsa2luZyB0byBBdGlzaCBpdCBsb29r cyBsaWtlIHRoZXJlJ3MgbGlrZWx5IHRvIGJlIGFuIFNCSQ0KPiA+ID4gZXh0ZW5zaW9uIHRvIGhh bmRsZSB0aGUgQ01Pcywgd2hpY2ggc2hvdWxkIGxldCB1cyBhdm9pZCB0aGUgYnVsayBvZg0KPiA+ ID4gdGhlIHZlbmRvci1zcGVjaWZpYyBiZWhhdmlvciBpbiB0aGUga2VybmVsLiAgSSBrbm93IHNv bWUgcGVvcGxlIGFyZQ0KPiA+ID4gd29ycmllZCBhYm91dCBhZGRpbmcgdG8gdGhlIFNCSSBzdXJm YWNlLiAgSSdtIHdvcnJpZWQgYWJvdXQgdGhhdA0KPiA+ID4gdG9vLCBidXQgdGhhdCdzIHdheSBi ZXR0ZXIgdGhhbiBzdGlja2luZyBhIGJ1bmNoIG9mIHZlbmRvci1zcGVjaWZpYw0KPiA+ID4gaW5z dHJ1Y3Rpb25zIGludG8gdGhlIGtlcm5lbC4gIFRoZSBTQkkgZXh0ZW5zaW9uIHNob3VsZCBtYWtl IGZvciBhDQo+ID4gPiBzdHJhaWdodC1mb3J3YXJkIGNhY2hlIGZsdXNoIGltcGxlbWVudGF0aW9u IGluIExpbnV4LCBzbyBsZXQncyBqdXN0IHBsYW4gb24NCj4gdGhhdCBnZXR0aW5nIHRocm91Z2gg cXVpY2tseSAoYXMgaGFzIGJlZW4gZG9uZSBiZWZvcmUpLg0KPiA+DQo+ID4gWWVzLCBJIGFncmVl LiBXZSBjYW4gaGF2ZSBqdXN0IGEgc2luZ2xlIFNCSSBjYWxsIHdoaWNoIGlzIG1lYW50IGZvcg0K PiA+IERNQSBzeW5jIHB1cnBvc2Ugb25seSB3aGljaCBtZWFucyBpdCB3aWxsIGZsdXNoL2ludmFs aWRhdGUgcGFnZXMgZnJvbQ0KPiA+IGFsbCBjYWNoZSBsZXZlbHMgaXJyZXNwZWN0aXZlIG9mIHRo ZSBjYWNoZSBoaWVyYXJjaHkgKGkuZS4NCj4gPiBmbHVzaC9pbnZhbGlkYXRlIHRvIFJBTSkuIFRo ZSBDTU8gZXh0ZW5zaW9uIG1pZ2h0IG1vcmUgZ2VuZXJpYyBjYWNoZQ0KPiA+IG9wZXJhdGlvbnMg d2hpY2ggY2FuIHRhcmdldCBhbnkgY2FjaGUgbGV2ZWwuDQo+ID4NCj4gPiBJIGFtIGFscmVhZHkg cHJlcGFyaW5nIGEgd3JpdGUtdXAgZm9yIFNCSSBETUEgc3luYyBjYWxsIGluIFNCSSBzcGVjLiBJ DQo+ID4gd2lsbCBzaGFyZSBpdCB3aXRoIHlvdSBzZXBhcmF0ZWx5IGFzIHdlbGwuDQo+ID4NCj4g PiA+DQo+ID4gPiBVbmZvcnR1bmF0ZWx5IHdlJ3ZlIHlldCB0byBjb21lIHVwIHdpdGggYSB3YXkg dG8gaGFuZGxlIHRoZQ0KPiA+ID4gbm9uLWNhY2hlYWJsZSBtYXBwaW5ncyB3aXRob3V0IGludHJv ZHVjaW5nIGEgZGVncmVlIG9mDQo+ID4gPiB2ZW5kb3Itc3BlY2lmaWMgYmVoYXZpb3Igb3Igc2Vy aW91c2x5IGltcGFjdGluZyBwZXJmb3JtYW5jZSAobWFyaw0KPiA+ID4gdGhlbSBhcyBub3QgdmFs aWQgYW5kIGRlYWwgd2l0aCB0aGVtIGluIHRoZSB0cmFwIGhhbmRsZXIpLiAgSSdtIG5vdA0KPiA+ ID4gcmVhbGx5IHN1cmUgaXQgY291bnRzIGFzIHN1cHBvcnRpbmcgdGhlIGhhcmR3YXJlIGlmIGl0 J3MgbWFzc2l2ZWx5DQo+ID4gPiBzbG93LCBzbyB0aGF0IHJlYWxseSBsZWF2ZXMgdXMgd2l0aCB2 ZW5kb3Itc3BlY2lmaWMgbWFwcGluZ3MgYXMgdGhlIG9ubHkNCj4gb3B0aW9uIHRvIG1ha2UgdGhl c2UgY2hpcHMgd29yay4NCj4gPg0KPiA+IEEgUklTQy1WIHBsYXRmb3JtIGNhbiBoYXZlIG5vbi1j YWNoZWFibGUgbWFwcGluZ3MgaXMgZm9sbG93aW5nDQo+ID4gcG9zc2libGUNCj4gPiB3YXlzOg0K PiA+IDEpIEZpeGVkIHBoeXNpY2FsIGFkZHJlc3MgcmFuZ2UgYXMgbm9uLWNhY2hlYWJsZSB1c2lu ZyBQTUFzDQo+ID4gMikgQ3VzdG9tIHBhZ2UgdGFibGUgYXR0cmlidXRlcw0KPiA+IDMpIFN2cG1i dCBleHRlbnNpb24gYmVpbmcgZGVmaW5lZCBieSBSVkkNCj4gPg0KPiA+IEF0aXNoIGFuZCBtZSBi b3RoIHRoaW5rIGl0IGlzIHBvc3NpYmxlIHRvIGhhdmUgUklTQy1WIHNwZWNpZmljIERNQSBvcHMN Cj4gPiBpbXBsZW1lbnRhdGlvbiB3aGljaCBjYW4gaGFuZGxlIGFsbCBhYm92ZSBjYXNlLiBBdGlz aCBpcyBhbHJlYWR5DQo+ID4gd29ya2luZyBvbiBETUEgb3BzIGltcGxlbWVudGF0aW9uIGZvciBS SVNDLVYuDQo+IE5vdCBvbmx5IERNQSBvcHMsIGJ1dCBhbHNvIGljYWNoZV9zeW5jICYgX192ZHNv X2ljYWNoZV9zeW5jLiBQbGVhc2UgaGF2ZSBhDQo+IGxvb2sgYXQ6DQo+IGh0dHBzOi8vbG9yZS5r ZXJuZWwub3JnL2xpbnV4LXJpc2N2LzE2MjI5NzAyNDktNTA3NzAtMTItZ2l0LXNlbmQtZW1haWwt DQo+IGd1b3JlbkBrZXJuZWwub3JnL1QvI3UNCg0KVGhlIGljYWNoZV9zeW5jIGFuZCBfX3Zkc29f aWNhY2hlX3N5bmMgd2lsbCBoYXZlIHRvIGJlIGFkZHJlc3NlZA0KZGlmZmVyZW50bHkuIFRoZSBT QkkgRE1BIHN5bmMgZXh0ZW5zaW9uIGNhbm5vdCBhZGRyZXNzIHRoaXMuDQoNCkl0IHNlZW1zIEFs bHdpbm5lciBEMSBoYXZlIG1vcmUgbm9uLXN0YW5kYXJkIHN0dWZmOg0KMSkgQ3VzdG9tIFBURSBi aXRzIGZvciBJTy1jb2hlcmVudCBhY2Nlc3MNCjIpIEN1c3RvbSBkYXRhIGNhY2hlIGZsdXNoL2lu dmFsaWRhdGUgZm9yIERNQSBzeW5jDQozKSBDdXN0b20gaWNhY2hlIGZsdXNoL2ludmFsaWRhdGUN Cg0KT3RoZXIgaGFuZCwgQmVhZ2xlViBoYXMgb25seSB0d28gcHJvYmxlbXM6DQoxKSBDdXN0b20g cGh5c2ljYWwgYWRkcmVzcyByYW5nZSBmb3IgSU8tY29oZXJlbnQgYWNjZXNzDQoyKSBDdXN0b20g TDIgY2FjaGUgZmx1c2gvaW52YWxpZGF0ZSBmb3IgRE1BIHN5bmMNCg0KRnJvbSBhYm92ZSAjMiwg Y2FuIGJlIHNvbHZlZCBieSBTQkkgRE1BIHN5bmMgY2FsbCBhbmQNCkxpbnV4IERNQSBvcHMgZm9y IGJvdGggQmVhZ2xlViBhbmQgQWxsd2lubmVyIEQxDQoNCk9uIEJlYWdsZVYsIGlzc3VlICMxIGNh biBiZSBzb2x2ZWQgdXNpbmcgImRtYS1yYW5nZXMiLg0KDQpPbiBBbGx3aW5uZXIgRDEsIGlzc3Vl cyAjMSBhbmQgIzMgbmVlZCB0byBiZSBhZGRyZXNzZWQNCnNlcGFyYXRlbHkuDQoNCkkgdGhpbmsg c3VwcG9ydGluZyBCZWFnbGVWIGluIHVwc3RyZWFtIExpbnV4IGlzIHJlbGF0aXZlbHkNCmVhc3kg Y29tcGFyZWQgdG8gQWxsd2lubmVyIEQxLg0KDQpAR3VvLCBwbGVhc2UgY2hlY2sgaWYgeW91IGNh biByZXNlcnZlIGRlZGljYXRlZA0KcGh5c2ljYWwgYWRkcmVzcyByYW5nZSBmb3IgSU8tY29oZXJl bnQgYWNjZXNzIChqdXN0IGxpa2UNCkJlYWdsZVYpLiBJZiB5ZXMsIHRoZW4gd2UgY2FuIHRhY2ts ZSBpc3N1ZSAjMSBmb3IgQWxsd2lubmVyDQpEMSB1c2luZyAiZG1hLXJhbmdlcyIgRFQgcHJvcGVy dHkuDQoNClJlZ2FyZHMsDQpBbnVwDQoNCj4gDQo+IA0KPiA+DQo+ID4gPg0KPiA+ID4gVGhpcyBp bXBsZW1lbnRhdGlvbiwgd2hpY2ggYWRkcyBzb21lIEtjb25maWcgZW50cmllcyB0aGF0IGNvbnRy b2wNCj4gPiA+IHBhZ2UgdGFibGUgYml0cywgZGVmaW5hdGVseSBpc24ndCBzdWl0YWJsZSBmb3Ig dXBzdHJlYW0uICBBbGxvd2luZw0KPiA+ID4gdXNlcnMgdG8gc2V0IGFyYml0cmFyeSBwYWdlIHRh YmxlIGJpdHMgd2lsbCBldmVudHVhbGx5IGNvbmZsaWN0IHdpdGgNCj4gPiA+IHRoZSBzdGFuZGFy ZCwgYW5kIGlzIGp1c3QgZ29pbmcgdG8gYmUgYSBtZXNzLiAgSXQnbGwgYWxzbyBsZWFkIHRvDQo+ ID4gPiBrZXJuZWxzIHRoYXQgYXJlIG9ubHkgY29tcGF0aWJsZSB3aXRoIHNwZWNpZmljIGRlc2ln bnMsIHdoaWNoIHdlJ3JlDQo+ID4gPiB0cnlpbmcgdmVyeSBoYXJkIHRvIGF2b2lkLiAgQXQgYSBi YXJlIG1pbmltdW0gd2UnbGwgbmVlZCBzb21lIHdheSB0bw0KPiA+ID4gZGV0ZWN0IHN5c3RlbXMg d2l0aCB0aGVzZSBwYWdlIHRhYmxlIGJpdHMgYmVmb3JlIHNldHRpbmcgdGhlbSwgYW5kDQo+ID4g PiBzb21lIGRlc2NyaXB0aW9uIG9mIHdoYXQgdGhlIGJpdHMgYWN0dWFsbHkgZG8gc28gd2UgY2Fu IHJlYXNvbiBhYm91dA0KPiB0aGVtLg0KPiA+DQo+ID4gWWVzLCB2ZW5kb3Igc3BlY2lmaWMgS2Nv bmZpZyBvcHRpb25zIGFyZSBzdHJpY3QgTk8gTk8uIFdlIGNhbid0DQo+ID4gZ2l2ZS11cCB0aGUg Z29hbCBvZiB1bmlmaWVkIGtlcm5lbCBpbWFnZSBmb3IgYWxsIHBsYXRmb3Jtcy4NCj4gPg0KPiA+ IFJlZ2FyZHMsDQo+ID4gQW51cA0KPiANCj4gDQo+IA0KPiAtLQ0KPiBCZXN0IFJlZ2FyZHMNCj4g IEd1byBSZW4NCj4gDQo+IE1MOiBodHRwczovL2xvcmUua2VybmVsLm9yZy9saW51eC1jc2t5Lw0K From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1142BC4743D for ; Mon, 7 Jun 2021 03:41:03 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9F826611C1 for ; Mon, 7 Jun 2021 03:41:02 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9F826611C1 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=wdc.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To:References: Message-ID:Date:Subject:CC:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=K8ygo+ETmSAY/cIP1V7STxXEoBA/Mx3Pxx6NBeUT8eY=; b=fvhNJu5UGqyoZX ZSDoOECQ9HdqcJsWKbRLnVByj0lTX3drgnuTxZMoD3l9fNXW965NyAH3IYMNzrUqsV8xvLUPT/Jmu RrufaCQC/9Jv7z2vvBrjSh/uEqDUreJ6Y2+k9wqmV8U/iCc9mHX+bJqRtF2DTpenEdf9b44+QaY89 jwelyMRty/Nvr0hTRYCKADTili1QeqnCLY52q+Vrk/nOrPLIj3MqB5kvBN3Qpz3ngrxoWqZIwFTAo OO2gzFDe8KsNqVrSdC0bGnGmFFpFFn3l6uFjtZ8Eo26Gb11K+dmy3AEjaM9dNt65fKCRDnFkfRqSf C7/fIKtKX+ldDB7ospFg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1lq65x-001OHR-EU; Mon, 07 Jun 2021 03:38:33 +0000 Received: from esa3.hgst.iphmx.com ([216.71.153.141]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1lq65r-001OGI-LX for linux-riscv@lists.infradead.org; Mon, 07 Jun 2021 03:38:31 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1623037106; x=1654573106; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=lZouWDdfxBqCEwMKbQBIhMGyUmLSOtiuRt/IbamEvqU68bI/AhaTrfwW ZeUjDyvQl3D0M5FwgQNRe2uXHazSgp5vWmDF5Q62IZQnbCqRNtXvTp5td VuRnSZf8w3Q3EolhXtxAORyBOr1/GrFOaP49a3R1pZQ4HdOMhIdVBNUHb o29vGgYnsTQ+wXqe7e9II0CzfqLkq9tFHKZevOoCmqhYXfSUjJMUX6fXy r2yfnyfCwUny/EUHhQj8u58niuM0VgqznmUPznmfaF3ANwalepFUQaz/h r+9twfK+5VCI4YNXsVKbkTRpmspabFbBS+3cYXPWKXIAzFwK/xrSkXeRt w==; IronPort-SDR: jq0j9fFt6COp7zarw5FuCs+4biiVs9eOwFQSHuHcQFuXILGFjkk0JgE6jZGR/OOElGklQvAYVp 987EqpcNPDZqJDivLxsBjFXAakeFOH++yD/Iv7wJ3yuzvuv8s9is4D9XLHc/kkf2B4hEHd9gYT zvzjF7DvevuouZCq0NwFyhhaK/Gp648ubEdEFba+llTOpghMWPDRgNO0C3bHhCZmZA+GVmGIQk o0TWJ9CyhCOUKLo4frI3GzoaXp9Q0Hu7SHLmUXM/9ejcg6IeuIW0kXQv7R1h7tFWrod8FeLtGR olc= X-IronPort-AV: E=Sophos;i="5.83,254,1616428800"; d="scan'208";a="175732252" Received: from mail-mw2nam10lp2100.outbound.protection.outlook.com (HELO NAM10-MW2-obe.outbound.protection.outlook.com) ([104.47.55.100]) by ob1.hgst.iphmx.com with ESMTP; 07 Jun 2021 11:38:23 +0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LJBGfi0gWejM6NplGFWXNvfhcRjp0yabv+83TyhabdLwT0+a6Dvk6Xk2U5uAb9e/jBAHEHLxI8GO16/hm891aBzcwgdx32IYR2fINa05JS2m75CwR25VcYvEt9UkKGsOV5SIXet5q/cjHagEkREdsCAh4QnhQt5rbWn9uRZHaBHZ/Qbs+iR2mHK6Z7z7GHuhiLZbRkE/7vKU2ObB/AOpt2mNOB7CRXfUdXGOy+hiC5EWC12y8R6xlp/QzmSTd5tiPZpg7LWzSlGUl8eRYa9TGS906PL6kOPVugJZSiOemY6Dh8e/ht16jNAyao5FqiENDCr03yvmWAltZpvaVpKdHw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=ftzBvILs/ln+vcctsygvTPKyMKY8mixs2b73IsIArB6K1ocjWyrygTeYqf2Pag9dUoktn4EAVwetHZoXkaIzJ5GZ/ruWOUGIzA3MNJaQjuAojXLg20NVq/eb3HECRY2IBFcBSD7y6UfPGii+7X/DhUE23X/qxleoJego38ARp/SDEtpmQ7xdu2AnUfKqs7T+vmsXUOpEkwsZaQRvLuQ21zTCrJCgA3So6I6TgoM8G8T+WffEU3EibMfANa3lledBaztJKwnoWLUharH5r09M8h+J7Id2ooBTsK41R3hBil5kK+7gX6YTn7rrKRfrZFfjxyipvsIX15bfOAIaenM5+Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=wdc.com; dmarc=pass action=none header.from=wdc.com; dkim=pass header.d=wdc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sharedspace.onmicrosoft.com; s=selector2-sharedspace-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yM9LSSDd9c5ygs5enSZQ0Xl/JePrcBV7wJitBq4PGRI=; b=ravX0AhFZjoFNsTpDbE2QJQecc3W8uUMf1JSCz5nIMiYz58NJNiDNBObrpxABdK1itnx2jUOnwKGGcd3XgUTN4/u66refrBLzQmZbUbJ3dAByDPGbe9jNhK97NFOVi2rfSBngitIPMo2+RfOfQEUZd8KxHTQg6ZtcA0z6PXNaVs= Received: from CO6PR04MB7812.namprd04.prod.outlook.com (2603:10b6:303:138::6) by CO6PR04MB7780.namprd04.prod.outlook.com (2603:10b6:5:359::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.21; Mon, 7 Jun 2021 03:38:23 +0000 Received: from CO6PR04MB7812.namprd04.prod.outlook.com ([fe80::a153:b7f8:c87f:89f8]) by CO6PR04MB7812.namprd04.prod.outlook.com ([fe80::a153:b7f8:c87f:89f8%8]) with mapi id 15.20.4195.030; Mon, 7 Jun 2021 03:38:23 +0000 From: Anup Patel To: Guo Ren , Atish Patra , Palmer Dabbelt CC: "anup@brainfault.org" , "drew@beagleboard.org" , Christoph Hellwig , "wefu@redhat.com" , "lazyparser@gmail.com" , "linux-riscv@lists.infradead.org" , "linux-kernel@vger.kernel.org" , "linux-arch@vger.kernel.org" , "linux-sunxi@lists.linux.dev" , "guoren@linux.alibaba.com" , Paul Walmsley Subject: RE: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support Thread-Topic: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support Thread-Index: AQHXTGyTk+HLcFgtPEChsdrUswIwKarqRJuAgAAMWQCAAABbgIAADXqAgAAFs4CABEeUAIAMkQUAgAaHrgCAABm6QIAFdrYAgACrsNA= Date: Mon, 7 Jun 2021 03:38:23 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: kernel.org; dkim=none (message not signed) header.d=none;kernel.org; dmarc=none action=none header.from=wdc.com; x-originating-ip: [122.167.153.147] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 96206912-0038-4d86-e3ae-08d92965b3b3 x-ms-traffictypediagnostic: CO6PR04MB7780: x-microsoft-antispam-prvs: wdcipoutbound: EOP-TRUE x-ms-oob-tlc-oobclassifiers: OLM:6790; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: CAgsIWz36F+f5JzRniXdxHVNk6KBp26pmNX8+7lBT+HdlMZVuFINoAow+Pi4SX94jG5JMa+rXRLvolZysDJ2xYOK0dpYFAwcUu6xSTL4ijpMvovgTsSIc/gL7v/EWzK3kMoxhwJ22d+odI420XN6kPXIvem7UFbU7B3EfidECCVTD4LXa2BtH1RrxkWMlXllZ/uPCibwMwjqLuFh/lWdY8THkPWhps4CwWXNLyKXuas/9OU2tFqVY5cUqqKLfwcithC8Z0H6UuSBJfIGMVVRuHvVJmFOowP3LhEX46DCcXABgOHjM0b1uFy16QxVciBCy9LYPba3YX51jflCWhwB9eqBNg/Ynu1jOAE0dSa3pcN3YmGrcRu4hCb9GaGeO68vXa63V+7CR2mFC9wU4QDuxr51frmvoqYxEukzQgXa1YqxU6VQZFLetVmx9Lygujh5KDTh9X91vzF/h+woQJibEC89d3rArw/MUahQkI+KOAe8oFK/itO+RwcCiTNsWnS2EuNbQC6MDj78I9LznsKiabiU7ZJzLWemjmYPWmG+1UnWcsmOzWABx7aXqYkKiL2VxEdKN1wpabsbE86ku35WhqJC3z7sxJEVsbMXLWUjfqFcPGfwhcipkGUWD5Cgw+sEfZRbpNPBJrlQkuNlKaTTDVdFAlXZi54fR2BqKv7VPS7DpQET1PH8yXXXGoSXAWGsVAGKTugz1wxuvIqQKqzalhVdcUMlPTLjGhP9b2syxNKxg0yNhktGv+AygpNBW/0opTO437ZesYy4CZeynVVWVA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CO6PR04MB7812.namprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(396003)(136003)(376002)(346002)(39860400002)(966005)(7416002)(30864003)(478600001)(186003)(2906002)(66446008)(83380400001)(8936002)(66556008)(66946007)(38100700002)(122000001)(71200400001)(86362001)(55016002)(8676002)(66476007)(64756008)(9686003)(53546011)(6506007)(7696005)(26005)(76116006)(316002)(52536014)(110136005)(5660300002)(33656002)(4326008)(54906003); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: =?utf-8?B?OGVVZEsrVi9rZFZaMUFYOVR0TjZUUEdNd3lrNkJMaDdWem9YZEQ1dHZWWURq?= =?utf-8?B?a0pYVkx5SDJONXYrOHpCR1JVQUlpbGVQNzIrK0djSGd4ME9YUzg3cDZDZE1U?= =?utf-8?B?ZnZqeHduUjd4dnpyL09RTTliRC96NUgzTWpwcHRxOEU5RGJQa3AyaTMzaG1M?= =?utf-8?B?eEw4bXRVUW5uV015UENyeXZOMGo2akJucmorWG5ZM2pZZ1JGZlBrbDQ0dVdr?= =?utf-8?B?WEVwelV0UHpNMHpxV2lRWnNnVnJHUXU3WlVlTGRjaGNGT0hKTDVwVWJZalpj?= =?utf-8?B?Z2hLb3JaZUMyMmZmQUNnSXpOSWtRM09SVExxb2luQmNWMjZucnZMSEZZc2ox?= =?utf-8?B?Qy8vTzQ0MzB2eHlBb24yMmJlOEdvWTJaUEgvUDdoV0xiYndwUDFKRmVlY0Y0?= =?utf-8?B?T3NXR0dLMGdhLzBHV0ZNcHlqOXNrVFZYTGJwLyt0ek9TOHRIS2VqblZUQ1hD?= =?utf-8?B?aE5yWmxkYkFSQnByQ1dCeFUvcWliUWxvOFNGQnozVnBrUU91MUhSN1ZabzRM?= =?utf-8?B?S2Joek9oMjkrNWZzTXhxVktjTE5RMmtoRmhBMnVjbWZnNkpDQTlWNWZnNXc4?= =?utf-8?B?aG1wR0N5L0NRZTRCZ1l3dVhEMmNRWTdmaE53MlJNdUw4WXppOUR6UGdMeFdp?= =?utf-8?B?enplMmp1WHVRNjFLUm40dEcreFdJZUhIQkRLRlNCd2dXblFJRFBQTWtFd3ZT?= =?utf-8?B?V3E4QlE5MGVSOGNxdHQ0cWluOEZ5cEJMN2FnYW1DSmVhOFMwWmpLdVJNenZi?= =?utf-8?B?Q3NPREduVmMyUW1wckZtNU9DV1VwQUZmMlhOWVV0MFdxTUpUSGVKQjJOM2w0?= =?utf-8?B?Z3JTVHJWcFhYSlMyWWw3clRMVHJuSUZvcTRMVFR0QnkwTXJLMklsYVVKZElr?= =?utf-8?B?Mm9OaWVjQmc1aXVrL3pRYXFZdHFHVkEwSkVwbXBSWmJtNzZNd1FUeGxTZTI4?= =?utf-8?B?bUoxd3ZqeC9kK0FKTGcrSWVRNkpVZlRFNE9NMEQ5WWIrdHdQaDVoZGoxRUxv?= =?utf-8?B?a2NYSUIrYVdUeWViekl6SzZ6OTBocXZXMmE5Mkd3K0FBallpM3VUVkF6WnRs?= =?utf-8?B?Nmp2bzlpbkg3eldpUHZicW1FVldpMzFQN1BDOGlZVUxocFJrZHU4ZzYwaTQ1?= =?utf-8?B?Um1UN3JvZ0JwRXNPWkpFOVE0MDlSd1RmUWFQdk1vN3dsSFQ0M1A4T09rWTdv?= =?utf-8?B?VXozWkxSb1hNcWR0K2k0dDJDc3lRaVF1OUhFcnNTaUZyRHVFUkEzMjl0c3My?= =?utf-8?B?V3gzbTM4OWdndFlrNkJ1bThoak9neUprNmdKTEFhQ0Fra2VaV2RJUDkyREdI?= =?utf-8?B?R0d5QXZ6S2NRc2pkQWN2Q1BUNE5BcEl5K21jZWhzRWI0V01hdVZWbG96NWRv?= =?utf-8?B?VUYwV3VqT0piZFd3UzFuK05YVkNJUG1nZGhWakdKNlFpRkdWMHd0d09FZU9y?= =?utf-8?B?MTIrOXpRSlQ2VGQ4amk2Z1R2TXJnSFJ3eUVEYlpzL2FXZnNwY3BhaGFUQkM1?= =?utf-8?B?bkQyYlNZU2tjUGtpRDZSWXJUWWtPek8ySkwxUDdIa2FsQTlwaHJhZklTU24z?= =?utf-8?B?SVJwMG1yZkRjd0lYaklXbHhrenhEMEtQYTczNXRNZU8wblMyWmEvdllGK0d1?= =?utf-8?B?RnI5MnV3SnYyY21YSkRXeFdlQmFmMUpoRSsveDYydkprbmI2dzNLbHlBU1N3?= =?utf-8?B?UFVhUU9SNU5lbVBJZU5ydVBwUGdxSXlVNHpELy9uUlE0eklRNDk5K1RUWHFm?= =?utf-8?Q?DYFvsDS9xzEQvBCSDZ00K84NFt96ccZk0oSEI38?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: wdc.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CO6PR04MB7812.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 96206912-0038-4d86-e3ae-08d92965b3b3 X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Jun 2021 03:38:23.1040 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: b61c8803-16f3-4c35-9b17-6f65f441df86 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: oAtcBDrf8sJK6U/Yq7cv5Y+rsaZ9VbFR+Y5ETei3tU02XHwKZeh76PPurjwrwf7v26l7rDqghHY5rOg4J/Fuqg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR04MB7780 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210606_203827_759833_F39D1352 X-CRM114-Status: GOOD ( 43.45 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org > -----Original Message----- > From: Guo Ren > Sent: 06 June 2021 22:42 > To: Anup Patel ; Atish Patra > Cc: Palmer Dabbelt ; anup@brainfault.org; > drew@beagleboard.org; Christoph Hellwig ; wefu@redhat.com; > lazyparser@gmail.com; linux-riscv@lists.infradead.org; linux- > kernel@vger.kernel.org; linux-arch@vger.kernel.org; linux- > sunxi@lists.linux.dev; guoren@linux.alibaba.com; Paul Walmsley > > Subject: Re: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support > > Hi Anup and Atish, > > On Thu, Jun 3, 2021 at 2:00 PM Anup Patel wrote: > > > > > > > > > -----Original Message----- > > > From: Palmer Dabbelt > > > Sent: 03 June 2021 09:43 > > > To: guoren@kernel.org > > > Cc: anup@brainfault.org; drew@beagleboard.org; Christoph Hellwig > > > ; Anup Patel ; wefu@redhat.com; > > > lazyparser@gmail.com; linux-riscv@lists.infradead.org; linux- > > > kernel@vger.kernel.org; linux-arch@vger.kernel.org; linux- > > > sunxi@lists.linux.dev; guoren@linux.alibaba.com; Paul Walmsley > > > > > > Subject: Re: [PATCH RFC 0/3] riscv: Add DMA_COHERENT support > > > > > > On Sat, 29 May 2021 17:30:18 PDT (-0700), Palmer Dabbelt wrote: > > > > On Fri, 21 May 2021 17:36:08 PDT (-0700), guoren@kernel.org wrote: > > > >> On Wed, May 19, 2021 at 3:15 PM Anup Patel > > > wrote: > > > >>> > > > >>> On Wed, May 19, 2021 at 12:24 PM Drew Fustini > > > wrote: > > > >>> > > > > >>> > On Wed, May 19, 2021 at 08:06:17AM +0200, Christoph Hellwig > > > wrote: > > > >>> > > On Wed, May 19, 2021 at 02:05:00PM +0800, Guo Ren wrote: > > > >>> > > > Since the existing RISC-V ISA cannot solve this problem, > > > >>> > > > it is better to provide some configuration for the SOC > > > >>> > > > vendor to > > > customize. > > > >>> > > > > > >>> > > We've been talking about this problem for close to five years. > > > >>> > > So no, if you don't manage to get the feature into the ISA > > > >>> > > it can't be supported. > > > >>> > > > > >>> > Isn't it a good goal for Linux to support the capabilities > > > >>> > present in the SoC that a currently being fab'd? > > > >>> > > > > >>> > I believe the CMO group only started last year [1] so the > > > >>> > RV64GC SoCs that are going into mass production this year > > > >>> > would not have had the opporuntiy of utilizing any RISC-V ISA > > > >>> > extension for handling cache management. > > > >>> > > > >>> The current Linux RISC-V policy is to only accept patches for > > > >>> frozen or ratified ISA specs. > > > >>> (Refer, Documentation/riscv/patch-acceptance.rst) > > > >>> > > > >>> This means even if emulate CMO instructions in OpenSBI, the > > > >>> Linux patches won't be taken by Palmer because CMO specification > > > >>> is still in draft stage. > > > >> Before CMO specification release, could we use a sbi_ecall to > > > >> solve the current problem? This is not against the specification, > > > >> when CMO is ready we could let users choose to use the new CMO in > Linux. > > > >> > > > >> From a tech view, CMO trap emulation is the same as sbi_ecall. > > > >> > > > >>> > > > >>> Also, we all know how much time it takes for RISCV international > > > >>> to freeze some spec. Judging by that we are looking at another > > > >>> 3-4 years at minimum. > > > > > > > > Sorry for being slow here, this thread got buried. > > > > > > > > I've been trying to work with a handful of folks at the RISC-V > > > > foundation to try and get a subset of the various in-development > > > > specifications (some simple CMOs, something about non-caching in > > > > the page tables, and some way to prevent speculative accesse from > > > > generating coherence traffic that will break non-coherent systems). > > > > I'm not sure we can get this together quickly, but I'd prefer to > > > > at least try before we jump to taking vendor-specificed behavior here. > > > > It's obviously an up-hill battle to try and get specifications > > > > through the process and I'm certainly not going to promise it will > > > > work, but I'm hoping that the impending need to avoid forking the > > > > ISA will be sufficient to get people behind producing some > > > > specifications in a timely > > > fashion. > > > > > > > > I wasn't aware than this chip had non-coherent devices until I saw > > > > this thread, so we'd been mostly focused on the Beagle V chip. > > > > That was in a sense an easier problem because the SiFive IP in it > > > > was never designed to have non-coherent devices so we'd have to > > > > make anything work via a series of slow workarounds, which would > > > > make emulating the eventually standardized behavior reasonable in > > > > terms of performance (ie, everything would be super slow so who really > cares). > > > > > > > > I don't think relying on some sort of SBI call for the CMOs whould > > > > be such a performance hit that it would prevent these systems from > > > > being viable, but assuming you have reasonable performance on your > > > > non-cached accesses then that's probably not going to be viable to > > > > trap and emulate. At that point it really just becomes silly to > > > > pretend that we're still making things work by emulating the > > > > eventually ratified behavior, as anyone who actually tries to use > > > > this thing to do IO would need out of tree patches. I'm not sure > > > > exactly what the plan is for the page table bits in the > > > > specification right now, but if you can give me a pointer to some > > > > documentation then I'm happy to try and push for something > compatible. > > > > > > > > If we can't make the process work at the foundation then I'd be > > > > strongly in favor of just biting the bullet and starting to take > > > > vendor-specific code that's been implemented in hardware and is > > > > necessarry to make things work acceptably. That's obviously a > > > > sub-optimal solution as it'll lead to a bunch of ISA > > > > fragmentation, but at least we'll be able to keep the software stack > together. > > > > > > > > Can you tell us when these will be in the hands of users? That's > > > > pretty important here, as I don't want to be blocking real users > > > > from having their hardware work. IIRC there were some plans to > > > > distribute early boards, but it looks like the foundation got > > > > involved and I guess I lost the thread at that point. > > > > > > > > Sorry this is all such a headache, but hopefully we can get things > > > > sorted out. > > > > > > I talked with some of the RISC-V foundation folks, we're not going > > > to have an ISA specification for the non-coherent stuff any time > > > soon. I took a look at this code and I definately don't want to > > > take it as is, but I'm not opposed to taking something that makes the > hardware work as long as it's a lot cleaner. > > > We've already got two of these non-coherent chips, I'm sure more > > > will come, and I'd rather have the extra headaches than make > > > everyone fork the software stack. > > > > Thanks for confirming. The CMO extension is still in early stages so > > it will certainly take more time for them. After CMO extension is > > finalized, it will take some more time to have actual RISC-V platforms with > CMO implemented. > > > > > > > > After talking to Atish it looks like there's likely to be an SBI > > > extension to handle the CMOs, which should let us avoid the bulk of > > > the vendor-specific behavior in the kernel. I know some people are > > > worried about adding to the SBI surface. I'm worried about that > > > too, but that's way better than sticking a bunch of vendor-specific > > > instructions into the kernel. The SBI extension should make for a > > > straight-forward cache flush implementation in Linux, so let's just plan on > that getting through quickly (as has been done before). > > > > Yes, I agree. We can have just a single SBI call which is meant for > > DMA sync purpose only which means it will flush/invalidate pages from > > all cache levels irrespective of the cache hierarchy (i.e. > > flush/invalidate to RAM). The CMO extension might more generic cache > > operations which can target any cache level. > > > > I am already preparing a write-up for SBI DMA sync call in SBI spec. I > > will share it with you separately as well. > > > > > > > > Unfortunately we've yet to come up with a way to handle the > > > non-cacheable mappings without introducing a degree of > > > vendor-specific behavior or seriously impacting performance (mark > > > them as not valid and deal with them in the trap handler). I'm not > > > really sure it counts as supporting the hardware if it's massively > > > slow, so that really leaves us with vendor-specific mappings as the only > option to make these chips work. > > > > A RISC-V platform can have non-cacheable mappings is following > > possible > > ways: > > 1) Fixed physical address range as non-cacheable using PMAs > > 2) Custom page table attributes > > 3) Svpmbt extension being defined by RVI > > > > Atish and me both think it is possible to have RISC-V specific DMA ops > > implementation which can handle all above case. Atish is already > > working on DMA ops implementation for RISC-V. > Not only DMA ops, but also icache_sync & __vdso_icache_sync. Please have a > look at: > https://lore.kernel.org/linux-riscv/1622970249-50770-12-git-send-email- > guoren@kernel.org/T/#u The icache_sync and __vdso_icache_sync will have to be addressed differently. The SBI DMA sync extension cannot address this. It seems Allwinner D1 have more non-standard stuff: 1) Custom PTE bits for IO-coherent access 2) Custom data cache flush/invalidate for DMA sync 3) Custom icache flush/invalidate Other hand, BeagleV has only two problems: 1) Custom physical address range for IO-coherent access 2) Custom L2 cache flush/invalidate for DMA sync >From above #2, can be solved by SBI DMA sync call and Linux DMA ops for both BeagleV and Allwinner D1 On BeagleV, issue #1 can be solved using "dma-ranges". On Allwinner D1, issues #1 and #3 need to be addressed separately. I think supporting BeagleV in upstream Linux is relatively easy compared to Allwinner D1. @Guo, please check if you can reserve dedicated physical address range for IO-coherent access (just like BeagleV). If yes, then we can tackle issue #1 for Allwinner D1 using "dma-ranges" DT property. Regards, Anup > > > > > > > > > > This implementation, which adds some Kconfig entries that control > > > page table bits, definately isn't suitable for upstream. Allowing > > > users to set arbitrary page table bits will eventually conflict with > > > the standard, and is just going to be a mess. It'll also lead to > > > kernels that are only compatible with specific designs, which we're > > > trying very hard to avoid. At a bare minimum we'll need some way to > > > detect systems with these page table bits before setting them, and > > > some description of what the bits actually do so we can reason about > them. > > > > Yes, vendor specific Kconfig options are strict NO NO. We can't > > give-up the goal of unified kernel image for all platforms. > > > > Regards, > > Anup > > > > -- > Best Regards > Guo Ren > > ML: https://lore.kernel.org/linux-csky/ _______________________________________________ linux-riscv mailing list linux-riscv@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-riscv