From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ariel Rodriguez Subject: Re: 4 Traffic classes per Pipe limitation Date: Fri, 29 Nov 2013 17:50:34 -0200 Message-ID: References: <3EB4FA525960D640B5BDFFD6A3D891261A5D21F4@IRSMSX102.ger.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Cc: "dev-VfR2kkLFssw@public.gmane.org" To: "Dumitrescu, Cristian" Return-path: In-Reply-To: <3EB4FA525960D640B5BDFFD6A3D891261A5D21F4-kPTMFJFq+rFP9JyJpTNKArfspsVTdybXVpNB7YpNyf8@public.gmane.org> List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces-VfR2kkLFssw@public.gmane.org Sender: "dev" Thanks for the answer, your explanation was perfect. Unfortunally , the client requirements are those, we need at traffic control level around 64 traffic metering controlers (traffic classes) at subscriber level. Each subscriber have a global plan rate (each pipe have the same token bucket configuration), inside that plan there are different rules for the traffic (traffic classes). For Example, facebook traffic, twitter traffic, whatsapp traffic have different plan rates lower than the plan global rate but different than the others protocols. We could group those in one traffic class, but still the 4 traffic classes is a strong limitation for us, beacause each protocol mapped to a traffic class share the same configuration (facebook traffic, twitter traffic have had the same rate and more, they compete for the same traffic class rate). We have to compete against cisco bandwith control solution and at least we need to offer the same features. The cisco solution its a DPI but also a traffic control solution, its permit priorization of traffic and manage the congestion inside the network per subscriber and per application service. So apperently the dpdk qos scheduller doesnt fit for our needs. Anyway, i still doesnt understand the traffic classes limitation. Inside the dpdk code of the qos scheduler i saw this: /** Number of queues per pipe traffic class. Cannot be changed. */ #define RTE_SCHED_QUEUES_PER_TRAFFIC_CLASS 4 I follow where the code use that define and except for the struct rte_sched_port_hierarchy where its mandatory a bitwise field of two (0...3) , i dont see where is the limitation here (except for performance). Its worth to change the code to support more than 4 traffic classes, well i could try to change the code more precisely jejeje. I just want to know if there are another limitation than a design desicion of that number. I dont want to make the effort for nothing maybe you guys can help me to understand why the limitation. I strongly use the dpdk solution for feed our dpi solution, i wont change that because work greats!!! but its difficult to develop a traffic control managment from scratch and integrated with the dpdk in a clean way without touching the dpdk api, you guys just done that with the qos scheduler, i dont want to reinvent the wheel. Again thank you for the patience, and for your expertise. Regards, Ariel Horacio Rodriguez. Callis Technologies. On Fri, Nov 29, 2013 at 3:45 PM, Dumitrescu, Cristian < cristian.dumitrescu-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org> wrote: > Hi Ariel, some comments inlined below. Regards, Cristian > > -----Original Message----- > From: dev [mailto:dev-bounces-VfR2kkLFssw@public.gmane.org] On Behalf Of Ariel Rodriguez > Sent: Thursday, November 28, 2013 8:53 PM > To: dev-VfR2kkLFssw@public.gmane.org > Subject: [dpdk-dev] 4 Traffic classes per Pipe limitation > > Hi, im working with the qos scheduler framework and i have a few > questions. Why the 4 traffic classes per pipe limitation? . > > [Cristian] The DPDK hierarchical scheduler allows for 4 traffic classes > with 4 packet queues per traffic class for each pipe (user). Traffic > classes and scheduled in strict priority, while queues within a pipe > traffic class are scheduled using byte-level Weighted Round Robin (WRR) > with configured weights. Since we have 16 packet queues per pipe (user), we > could argue that actually 16 (sub)traffic classes are supported. When the > weight ratio between different queues of the same traffic class is high > (e.g. 4:1, 8:1, 16:1, etc), then WRR starts behaving like strict priority. > If your mapping to traffic classes is done using DSCP, you can simply map > some DSCP values to different queues within same traffic class as well. > > Im developing a deep packet inspection solution for a telecom company and i > we need more than just 4 traffic classes per pipe. Im able to recognise > almost all layer 7 applications, such as youtube, p2p , netflix , > google-ads , etc, etc and i really need to map this type of flows in > differents traffic classes. > > [Cristian] Not sure I completely agree with you here. > The traffic classes are there for the reason of providing different levels > of delay (latency), delay variation (jitter), packet loss rate, etc. So, > for example, one possible mapping of traffic types to the 4 traffic classes > might be: voice = TC0 (highest priority), interactive video = TC1, > non-interactive/cached video = TC2, best effort traffic (file downloads, > web browsing, email, etc) = TC3 (lowest priority). In my opinion, youtube > and netflix could be considered as being part of the same traffic class > (e.g. TC2), as they have very similar (if not identical) requirements, > probably same for p2p and google-ads, email, web browsing, etc (where best > effort traffic class is probably applicable). If really needed, youtube and > netflix could be mapped to different queues of TC2. > If different service / actions need to be applied to different > applications that have the same scheduling requirements (and part of the > same traffic class), then this would probably have to be decided earlier > during the classification phase and e.g. rate limit youtube traffic per > user using traffic metering algorithms, block p2p traffic if you are a > firewall, etc; these are probably actions that could be enforced outside of > scheduling/traffic management. > > The idea is mark each flow depending on the provisioning > information and assign that flows to different subport depending on the > information given and assign a pipe with the subscriber contract rate, but > we really need to have more than 4 traffic clases, because we want to > control the bandwidth of different layer 7 protocols flows. At most we > need 32 or 64 traffic classes per subscriber. > > [Cristian] Bandwidth control could be done on both ingress side as well as > egress side. > On ingress, the amount of incoming traffic for a specific user > (flow/connection/application) could be limited to predefined values, with > potentially different levels for different classes of users (e.g. regular / > premium / company / etc). > On egress, several pipe profiles can be defined using the DPDK > hierarchical scheduler, which would allow setting up a different rate limit > for each traffic class for each user. Likewise, traffic classes can be rate > limited at the subport level (group of users). > > I understand that in a given interval of time a subscriber dont > use more than 4 protocols simultaneously , generally speaking , or 4 > traffic classes in dpdk qos terminology, but the framework doesnt allow us > to configure more traffic classes. > > Im looking the code of qos scheduler and im not seeing why this > restriction. Is a performance problem, or a waste of resource problem? , > maybe when the port grinder search for the active queues for each traffic > class the delay of iterating over all pipes and each traffic class is too > high. > Cisco have a bandwidth managment solution that claims to control a > million of subscribers simoultaneosly with 64 traffic classes per > subscriber (pipes) and 4 queues per traffic classes (Cisco solution calls > traffic clases as "Bandwith controller per service or BWC , a subscriber > can have 64 BWC simoultaneasly). Its this posible? maybe this guys > implements the bandwidth managment in hardware?. > Anyway i really need this feature , but if the qos scheduller > cannot scale to more than 4 traffic classes per pipe i would have to > implement a custom packet scheduler from scratch and i really dont want to > do that. > > Thanks for the patience, and sorry for my rusty english, im from > Argentina. > > Best Regards. > > > Ariel Horacio Rodriguez, Callis Technologies. > -------------------------------------------------------------- > Intel Shannon Limited > Registered in Ireland > Registered Office: Collinstown Industrial Park, Leixlip, County Kildare > Registered Number: 308263 > Business address: Dromore House, East Park, Shannon, Co. Clare > > This e-mail and any attachments may contain confidential material for the > sole use of the intended recipient(s). Any review or distribution by others > is strictly prohibited. If you are not the intended recipient, please > contact the sender and delete all copies. > > >