Git Mailing List Archive mirror
 help / color / mirror / Atom feed
From: Rutger Nijlunsing <rutger@nospam.com>
To: Christopher Faylor <me@cgf.cx>
Cc: git@vger.kernel.org
Subject: Re: NT directory traversal speed on 25K files on Cygwin
Date: Mon, 27 Feb 2006 19:30:49 +0100	[thread overview]
Message-ID: <20060227183049.GA13195@nospam.com> (raw)
In-Reply-To: <20060227011801.GB9264@trixie.casa.cgf.cx>

On Sun, Feb 26, 2006 at 08:18:01PM -0500, Christopher Faylor wrote:
> On Mon, Feb 27, 2006 at 12:17:01AM +0100, Rutger Nijlunsing wrote:
> >On Sun, Feb 26, 2006 at 02:55:52PM -0500, Christopher Faylor wrote:
> >>On Thu, Feb 23, 2006 at 03:07:07PM +0100, Alex Riesen wrote:
> >>>filesystem is slow and locked down, and exec-attribute is NOT really
> >>>useful even on NTFS (it is somehow related to execute permission and
> >>>open files.  I still cannot figure out how exactly are they related).
> >>
> >>Again, it's not clear if you're talking about Windows or Cygwin but
> >>under Cygwin, in the default configuration, the exec attribute means
> >>the same thing to cygwin as it does to linux.
> >
> >I don't know about native Windows speed, but comparing NutCracker with
> >Cygwin on a simple 'find .  | wc -l' already gives a clue that looking
> >at Cygwin to benchmark NT file inspection IO will give a skewed
> >picture:
> >
> >##### NutCracker $ time find .  | wc -l
> >
> >real    0m 1.44s
> >user    0m 0.45s
> >sys     0m 0.98s
> >25794
> >
> >##### Cygwin $ time c:\\cygwin\\bin\\find .  | wc -l
> >
> >real    0m 6.72s
> >user    0m 1.09s
> >sys     0m 5.59s
> >25794
> >
> >##### CMD.EXE + DIR /S C:\PROJECT> c:\cygwin\bin\time cmd /c dir /s
> >>NUL 0.01user 0.01system 0:05.70elapsed 0%CPU (0avgtext+0avgdata
> >6320maxresident)k 0inputs+0outputs (395major+0minor)pagefaults 0swaps
> >
> >##### Cygwin 'find -ls' (NutCracker doesn't have a '-ls') C:\PROJECT>
> >c:\cygwin\bin\time c:\cygwin\bin\find -ls | wc -l 2.79user 7.81system
> >0:10.60elapsed 100%CPU (0avgtext+0avgdata 14480maxresident)k 25794
> 
> I'm lost.  What does this have to do with the exec attribute?
> 
> Or, were you just climbing aboard the "Cygwin sure is slow" bandwagon?

I tried to get on the bandwagon 'NT file IO magnitudes slower => git
magnitudes slower', but missed the parade a week ago. Then another
parade showed up, but I managed to delete most of it with a
misfortunate shift-something in mutt... And then even messed up in
keeping the wrong paragraph... *hmpf*

However, the point I was trying to make was that git might be sped up
by a magnitude (although not all of the magnitudes in comparison to
Linux) by looking at why the file IO is this slow: Windows' file IO is
_not_ the only reason. Using a different/new/better fitted interface
to Cygwin or Win32 for a specific git task might help, although I have
no clue what or how.

-- 
Rutger Nijlunsing ---------------------------------- eludias ed dse.nl
never attribute to a conspiracy which can be explained by incompetence
----------------------------------------------------------------------

  reply	other threads:[~2006-02-27 18:31 UTC|newest]

Thread overview: 68+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2006-02-20 18:37 Should we support Perl 5.6? Johannes Schindelin
2006-02-20 19:10 ` Eric Wong
2006-02-20 21:01   ` Andreas Ericsson
2006-02-20 21:15     ` Junio C Hamano
2006-02-20 22:05   ` [PATCH] fmt-merge-msg: avoid open "-|" list form for Perl 5.6 Junio C Hamano
2006-02-20 22:12     ` [PATCH] rerere: " Junio C Hamano
2006-02-20 22:12     ` [PATCH] send-email: " Junio C Hamano
2006-02-20 22:12     ` [PATCH] svmimport: " Junio C Hamano
2006-02-20 22:19     ` [PATCH] cvsimport: " Junio C Hamano
2006-02-21 17:30     ` [PATCH] fmt-merge-msg: " Alex Riesen
2006-02-21 20:36       ` Sam Vilain
2006-02-21 21:57         ` Alex Riesen
2006-02-21 22:19           ` Johannes Schindelin
2006-02-21 22:35             ` Eric Wong
2006-02-21 22:38             ` Shawn Pearce
2006-02-21 23:00             ` Martin Langhoff
2006-02-21 22:38           ` Sam Vilain
2006-02-22 16:35             ` Alex Riesen
2006-02-22 19:44               ` Johannes Schindelin
2006-02-22 19:51               ` Sam Vilain
2006-02-22 19:54                 ` Junio C Hamano
2006-02-22 22:00               ` Johannes Schindelin
2006-02-22 22:25                 ` Junio C Hamano
2006-02-23  8:00                 ` Alex Riesen
2006-02-23  8:45                   ` Junio C Hamano
2006-02-23  9:35                     ` Alex Riesen
2006-02-23  9:41                       ` Alex Riesen
2006-02-23  9:48                         ` Andreas Ericsson
2006-02-23 10:10                           ` Alex Riesen
2006-02-23 13:29                             ` Andreas Ericsson
2006-02-23 14:07                               ` Alex Riesen
2006-02-23 14:22                                 ` Andreas Ericsson
2006-02-23 17:13                                 ` Linus Torvalds
2006-02-23 19:32                                   ` Junio C Hamano
2006-02-23 19:38                                     ` Johannes Schindelin
2006-02-23 19:54                                       ` Linus Torvalds
2006-02-23 20:19                                         ` Johannes Schindelin
2006-02-23 19:51                                     ` Linus Torvalds
2006-02-23 20:31                                       ` Sam Vilain
2006-02-24  6:43                                         ` Linus Torvalds
2006-02-23 21:43                                   ` Alex Riesen
2006-02-26 19:55                                 ` Christopher Faylor
2006-02-26 20:18                                   ` Linus Torvalds
2006-02-26 20:40                                     ` Christopher Faylor
2006-03-02 14:18                                       ` Alex Riesen
2006-03-02 15:18                                         ` Mark Wooding
2006-03-02 16:11                                           ` Alex Riesen
2006-03-02 15:22                                         ` Christopher Faylor
2006-03-02 16:20                                           ` Alex Riesen
2006-02-26 23:17                                   ` NT directory traversal speed on 25K files on Cygwin Rutger Nijlunsing
2006-02-27  1:18                                     ` Christopher Faylor
2006-02-27 18:30                                       ` Rutger Nijlunsing [this message]
2006-02-27 18:34                                         ` Christopher Faylor
2006-02-27  9:19                                     ` Andreas Ericsson
2006-02-27 18:45                                       ` Rutger Nijlunsing
2006-03-02 13:40                                         ` Alex Riesen
2006-03-02 14:10                                   ` [PATCH] fmt-merge-msg: avoid open "-|" list form for Perl 5.6 Alex Riesen
2006-03-02 15:00                                     ` Christopher Faylor
2006-03-02 16:10                                       ` Alex Riesen
2006-03-02 17:39                                         ` Andreas Ericsson
2006-03-02 22:01                                           ` Alex Riesen
2006-02-26 20:33                               ` Christopher Faylor
2006-02-24 12:02               ` Eric Wong
2006-02-24 13:44                 ` Johannes Schindelin
2006-02-24 16:14                   ` Linus Torvalds
2006-02-21 20:56       ` Eric Wong
2006-02-21 22:04         ` Alex Riesen
     [not found]           ` <1cf1c57a0602211412r1988b14ao435edd29207dc0d0@mail.gmail.com>
2006-02-21 22:13             ` Ron Parker

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20060227183049.GA13195@nospam.com \
    --to=rutger@nospam.com \
    --cc=git@vger.kernel.org \
    --cc=git@wingding.demon.nl \
    --cc=me@cgf.cx \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).