All the mail mirrored from lore.kernel.org
 help / color / mirror / Atom feed
* Block storage performance test tool - would like to merge into cbt
@ 2015-07-11  8:02 Konstantin Danilov
  2015-07-13 15:16 ` Mark Nelson
  0 siblings, 1 reply; 5+ messages in thread
From: Konstantin Danilov @ 2015-07-11  8:02 UTC (permalink / raw)
  To: ceph-devel

Hi all,

We(Mirantis ceph team) have a tool for block storage performance test,
called 'wally' -
https://github.com/Mirantis/disk_perf_test_tool.

It has some nice features, like:

* Openstack and FUEL integration (can spawn VM for tests, gather HW info, etc)
* Set of tests, joined into suit, which measures different performnce
aspects and
creates joined report, as example -
http://koder-ua.github.io/6.1GA/cinder_volume_iscsi.html,
VM running on ceph drives report example -
http://koder-ua.github.io/random/ceph_example.html
* Data postrocessing - confidence intervals, etc

We would like to merge our code into cbt. Do you interesting in it?
Can we discuss a way to merge?

Thanks

-- 
Kostiantyn Danilov aka koder.ua
Principal software engineer, Mirantis

skype:koder.ua
http://koder-ua.blogspot.com/
http://mirantis.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Block storage performance test tool - would like to merge into cbt
  2015-07-11  8:02 Block storage performance test tool - would like to merge into cbt Konstantin Danilov
@ 2015-07-13 15:16 ` Mark Nelson
  2015-07-14  8:11   ` Konstantin Danilov
  0 siblings, 1 reply; 5+ messages in thread
From: Mark Nelson @ 2015-07-13 15:16 UTC (permalink / raw)
  To: Konstantin Danilov, ceph-devel
  Cc: Ben England, Ben Turner, Kyle Bader, tyler Brekke, cbt

Hi Konstantin,

I'm definitely interested in looking at your tools and seeing if we can 
merge them into cbt!  One of the things we lack right now in cbt is any 
kind of real openstack integration.  Right now CBT basically just 
assumes you've already launched VMs and specified them as clients in the 
yaml, so being able to spin up VMs in a standard way would be very 
useful.  It might be worth exploring if we can use your tool to make the 
cluster base class "openstack aware" so that any of the eventual cluster 
classes (ceph, and maybe some day gluster, swift, etc) can use it to 
launch VMs or do other things.  I'd really love to be able to create a 
cbt yaml config file and iterate through parametric configuration 
parameters building multiple different clusters and running tests 
against them with system monitoring and data post processing happening 
automatically.

The data post processing is also something that will be very useful.  We 
have a couple of folks really interested in this area as well.

Mark



On 07/11/2015 03:02 AM, Konstantin Danilov wrote:
> Hi all,
>
> We(Mirantis ceph team) have a tool for block storage performance test,
> called 'wally' -
> https://github.com/Mirantis/disk_perf_test_tool.
>
> It has some nice features, like:
>
> * Openstack and FUEL integration (can spawn VM for tests, gather HW info, etc)
> * Set of tests, joined into suit, which measures different performnce
> aspects and
> creates joined report, as example -
> http://koder-ua.github.io/6.1GA/cinder_volume_iscsi.html,
> VM running on ceph drives report example -
> http://koder-ua.github.io/random/ceph_example.html
> * Data postrocessing - confidence intervals, etc
>
> We would like to merge our code into cbt. Do you interesting in it?
> Can we discuss a way to merge?
>
> Thanks
>

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Block storage performance test tool - would like to merge into cbt
  2015-07-13 15:16 ` Mark Nelson
@ 2015-07-14  8:11   ` Konstantin Danilov
  2015-07-14 11:22     ` Mark Nelson
  0 siblings, 1 reply; 5+ messages in thread
From: Konstantin Danilov @ 2015-07-14  8:11 UTC (permalink / raw)
  To: Mark Nelson
  Cc: ceph-devel, Ben England, Ben Turner, Kyle Bader, tyler Brekke,
	cbt

Mark,

does Wednesday performance meeting is a good place for discussion, or
we need a separated one?

On Mon, Jul 13, 2015 at 6:16 PM, Mark Nelson <mnelson@redhat.com> wrote:
> Hi Konstantin,
>
> I'm definitely interested in looking at your tools and seeing if we can
> merge them into cbt!  One of the things we lack right now in cbt is any kind
> of real openstack integration.  Right now CBT basically just assumes you've
> already launched VMs and specified them as clients in the yaml, so being
> able to spin up VMs in a standard way would be very useful.  It might be
> worth exploring if we can use your tool to make the cluster base class
> "openstack aware" so that any of the eventual cluster classes (ceph, and
> maybe some day gluster, swift, etc) can use it to launch VMs or do other
> things.  I'd really love to be able to create a cbt yaml config file and
> iterate through parametric configuration parameters building multiple
> different clusters and running tests against them with system monitoring and
> data post processing happening automatically.
>
> The data post processing is also something that will be very useful.  We
> have a couple of folks really interested in this area as well.
>
> Mark
>
>
>
>
> On 07/11/2015 03:02 AM, Konstantin Danilov wrote:
>>
>> Hi all,
>>
>> We(Mirantis ceph team) have a tool for block storage performance test,
>> called 'wally' -
>> https://github.com/Mirantis/disk_perf_test_tool.
>>
>> It has some nice features, like:
>>
>> * Openstack and FUEL integration (can spawn VM for tests, gather HW info,
>> etc)
>> * Set of tests, joined into suit, which measures different performnce
>> aspects and
>> creates joined report, as example -
>> http://koder-ua.github.io/6.1GA/cinder_volume_iscsi.html,
>> VM running on ceph drives report example -
>> http://koder-ua.github.io/random/ceph_example.html
>> * Data postrocessing - confidence intervals, etc
>>
>> We would like to merge our code into cbt. Do you interesting in it?
>> Can we discuss a way to merge?
>>
>> Thanks
>>
>



-- 
Kostiantyn Danilov aka koder.ua
Principal software engineer, Mirantis

skype:koder.ua
http://koder-ua.blogspot.com/
http://mirantis.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Block storage performance test tool - would like to merge into cbt
  2015-07-14  8:11   ` Konstantin Danilov
@ 2015-07-14 11:22     ` Mark Nelson
  2015-07-14 12:54       ` Konstantin Danilov
  0 siblings, 1 reply; 5+ messages in thread
From: Mark Nelson @ 2015-07-14 11:22 UTC (permalink / raw)
  To: Konstantin Danilov
  Cc: ceph-devel, Ben England, Ben Turner, Kyle Bader, tyler Brekke,
	cbt

Probably depends how much time it will take.  I'd say if we think it 
might be more than 15 minutes of discussion we should wait until the end 
of the performance meeting and then talk about it.  If it's fairly quick 
though we could probably add it to the perf meeting itself.

Mark

On 07/14/2015 03:11 AM, Konstantin Danilov wrote:
> Mark,
>
> does Wednesday performance meeting is a good place for discussion, or
> we need a separated one?
>
> On Mon, Jul 13, 2015 at 6:16 PM, Mark Nelson <mnelson@redhat.com> wrote:
>> Hi Konstantin,
>>
>> I'm definitely interested in looking at your tools and seeing if we can
>> merge them into cbt!  One of the things we lack right now in cbt is any kind
>> of real openstack integration.  Right now CBT basically just assumes you've
>> already launched VMs and specified them as clients in the yaml, so being
>> able to spin up VMs in a standard way would be very useful.  It might be
>> worth exploring if we can use your tool to make the cluster base class
>> "openstack aware" so that any of the eventual cluster classes (ceph, and
>> maybe some day gluster, swift, etc) can use it to launch VMs or do other
>> things.  I'd really love to be able to create a cbt yaml config file and
>> iterate through parametric configuration parameters building multiple
>> different clusters and running tests against them with system monitoring and
>> data post processing happening automatically.
>>
>> The data post processing is also something that will be very useful.  We
>> have a couple of folks really interested in this area as well.
>>
>> Mark
>>
>>
>>
>>
>> On 07/11/2015 03:02 AM, Konstantin Danilov wrote:
>>>
>>> Hi all,
>>>
>>> We(Mirantis ceph team) have a tool for block storage performance test,
>>> called 'wally' -
>>> https://github.com/Mirantis/disk_perf_test_tool.
>>>
>>> It has some nice features, like:
>>>
>>> * Openstack and FUEL integration (can spawn VM for tests, gather HW info,
>>> etc)
>>> * Set of tests, joined into suit, which measures different performnce
>>> aspects and
>>> creates joined report, as example -
>>> http://koder-ua.github.io/6.1GA/cinder_volume_iscsi.html,
>>> VM running on ceph drives report example -
>>> http://koder-ua.github.io/random/ceph_example.html
>>> * Data postrocessing - confidence intervals, etc
>>>
>>> We would like to merge our code into cbt. Do you interesting in it?
>>> Can we discuss a way to merge?
>>>
>>> Thanks
>>>
>>
>
>
>

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Block storage performance test tool - would like to merge into cbt
  2015-07-14 11:22     ` Mark Nelson
@ 2015-07-14 12:54       ` Konstantin Danilov
  0 siblings, 0 replies; 5+ messages in thread
From: Konstantin Danilov @ 2015-07-14 12:54 UTC (permalink / raw)
  To: Mark Nelson
  Cc: ceph-devel, Ben England, Ben Turner, Kyle Bader, tyler Brekke,
	cbt

I think better to discuss after the meeting

On Tue, Jul 14, 2015 at 2:22 PM, Mark Nelson <mnelson@redhat.com> wrote:
> Probably depends how much time it will take.  I'd say if we think it might
> be more than 15 minutes of discussion we should wait until the end of the
> performance meeting and then talk about it.  If it's fairly quick though we
> could probably add it to the perf meeting itself.
>
> Mark
>
>
> On 07/14/2015 03:11 AM, Konstantin Danilov wrote:
>>
>> Mark,
>>
>> does Wednesday performance meeting is a good place for discussion, or
>> we need a separated one?
>>
>> On Mon, Jul 13, 2015 at 6:16 PM, Mark Nelson <mnelson@redhat.com> wrote:
>>>
>>> Hi Konstantin,
>>>
>>> I'm definitely interested in looking at your tools and seeing if we can
>>> merge them into cbt!  One of the things we lack right now in cbt is any
>>> kind
>>> of real openstack integration.  Right now CBT basically just assumes
>>> you've
>>> already launched VMs and specified them as clients in the yaml, so being
>>> able to spin up VMs in a standard way would be very useful.  It might be
>>> worth exploring if we can use your tool to make the cluster base class
>>> "openstack aware" so that any of the eventual cluster classes (ceph, and
>>> maybe some day gluster, swift, etc) can use it to launch VMs or do other
>>> things.  I'd really love to be able to create a cbt yaml config file and
>>> iterate through parametric configuration parameters building multiple
>>> different clusters and running tests against them with system monitoring
>>> and
>>> data post processing happening automatically.
>>>
>>> The data post processing is also something that will be very useful.  We
>>> have a couple of folks really interested in this area as well.
>>>
>>> Mark
>>>
>>>
>>>
>>>
>>> On 07/11/2015 03:02 AM, Konstantin Danilov wrote:
>>>>
>>>>
>>>> Hi all,
>>>>
>>>> We(Mirantis ceph team) have a tool for block storage performance test,
>>>> called 'wally' -
>>>> https://github.com/Mirantis/disk_perf_test_tool.
>>>>
>>>> It has some nice features, like:
>>>>
>>>> * Openstack and FUEL integration (can spawn VM for tests, gather HW
>>>> info,
>>>> etc)
>>>> * Set of tests, joined into suit, which measures different performnce
>>>> aspects and
>>>> creates joined report, as example -
>>>> http://koder-ua.github.io/6.1GA/cinder_volume_iscsi.html,
>>>> VM running on ceph drives report example -
>>>> http://koder-ua.github.io/random/ceph_example.html
>>>> * Data postrocessing - confidence intervals, etc
>>>>
>>>> We would like to merge our code into cbt. Do you interesting in it?
>>>> Can we discuss a way to merge?
>>>>
>>>> Thanks
>>>>
>>>
>>
>>
>>
>



-- 
Kostiantyn Danilov aka koder.ua
Principal software engineer, Mirantis

skype:koder.ua
http://koder-ua.blogspot.com/
http://mirantis.com

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2015-07-14 12:54 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-07-11  8:02 Block storage performance test tool - would like to merge into cbt Konstantin Danilov
2015-07-13 15:16 ` Mark Nelson
2015-07-14  8:11   ` Konstantin Danilov
2015-07-14 11:22     ` Mark Nelson
2015-07-14 12:54       ` Konstantin Danilov

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.