From: ghazel@gmail.com
To: unicorn list <mongrel-unicorn@rubyforge.org>
Subject: Re: Unicorn 3.3.1 "Too many open files" error in kgio_tryaccept
Date: Thu, 13 Jan 2011 18:17:41 -0800 [thread overview]
Message-ID: <AANLkTi=xs0CmL58e2SdtzVYQeo8n8YMhLCuc+bf-27nk@mail.gmail.com> (raw)
In-Reply-To: <20110113230609.GA1519@dcvr.yhbt.net>
On Thu, Jan 13, 2011 at 3:06 PM, Eric Wong <normalperson@yhbt.net> wrote:
> ghazel@gmail.com wrote:
>> Strange error which took down my server today:
>>
>> Unhandled listen loop exception #<Errno::EMFILE: Too many open files - accept>.
>> ...
>>
>> My unicorn.stderr.log is 7.6GB, and I rotate it every day...
>>
>> Before all that started I got:
>>
>> Read error: #<IOError: closed stream>
>> /usr/local/ruby-enterprise-1.8.7-2010.01/lib/ruby/gems/1.8/gems/unicorn-3.3.1/lib/unicorn/http_response.rb:37:in
>>
>> But the servers seemed to be basically operating at that point.
>
> Weird. I have many questions:
>
> Are you processing uploads at all?
Yes, but I have been processing uploads on Unicorn since 0.99.something
> Is nginx in front of Unicorn?
Yes.
> Do you open a lot of files in your application and never close them?[1]
I don't believe so, and certain nothing has changed there in quite awhile.
> How does lsof output look for your workers?
Hm. The workers seem to be at 80-90 file descriptors each. I did catch
one at 787 (!) with mostly handles to a geoip database from the geoip
gem, but they got collected pretty quickly. Perhaps that's the cause!
> Can you check any exception capturing/logging middleware you have
> for any other errors that may be swallowed? (especially
> while reading env["rack.input"])
I don't have any non-standard Rails 2.3.10 middleware which reads rack.input.
> I changed the socket close ordering for 3.3.1 to workaround an esoteric
> "bug", but I don't see how this could happen right now...
>
> Does this happen with 3.3.0?
I've only seen it once. If I manage to reproduce it I'll try with 3.3.0.
-Greg
_______________________________________________
Unicorn mailing list - mongrel-unicorn@rubyforge.org
http://rubyforge.org/mailman/listinfo/mongrel-unicorn
Do not quote signatures (like this one) or top post when replying
next prev parent reply other threads:[~2011-01-14 2:37 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-01-13 21:20 Unicorn 3.3.1 "Too many open files" error in kgio_tryaccept ghazel
2011-01-13 23:06 ` Eric Wong
2011-01-14 2:17 ` ghazel [this message]
2011-01-14 2:47 ` Eric Wong
2011-01-14 4:20 ` ghazel
2011-01-14 9:17 ` Eric Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
List information: https://yhbt.net/unicorn/
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='AANLkTi=xs0CmL58e2SdtzVYQeo8n8YMhLCuc+bf-27nk@mail.gmail.com' \
--to=ghazel@gmail.com \
--cc=mongrel-unicorn@rubyforge.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
Code repositories for project(s) associated with this public inbox
https://yhbt.net/unicorn.git/
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).