Where's my web server bottleneck?
McLeod, Peter (Yuetsu)
yellowdog-general@lists.terrasoftsolutions.com
Wed Nov 20 15:39:01 2002
How many users are we talking here on average?
-----Original Message-----
From: yellowdog-general-request@lists.terrasoftsolutions.com
[mailto:yellowdog-general-request@lists.terrasoftsolutions.com]
Sent: Thursday, 21 November 2002 9:29 AM
To: yellowdog-general@lists.terrasoftsolutions.com
Subject: yellowdog-general digest, Vol 1 #530 - 10 msgs
Send yellowdog-general mailing list submissions to
yellowdog-general@lists.terrasoftsolutions.com
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.terrasoftsolutions.com/mailman/listinfo/yellowdog-general
or, via email, send a message with subject or body 'help' to
yellowdog-general-request@lists.terrasoftsolutions.com
You can reach the person managing the list at
yellowdog-general-admin@lists.terrasoftsolutions.com
When replying, please edit your Subject line so it is more specific
than "Re: Contents of yellowdog-general digest..."
Today's Topics:
1. processes (Daniel Danu)
2. new ibook 2002 install success (Stefan Jeglinski)
3. Re: Remote Telnetting? (Pete Prodoehl)
4. Where's my web server bottleneck? (bronto)
5. Re: Remote Telnetting? (Michael Tucker)
6. Re: Remote Telnetting? (nathan r. hruby)
7. Re: GUI Editor? (Pete Prodoehl)
8. Re: Where's my web server bottleneck? (Owen Stampflee)
9. Re: GUI Editor? (Riley Berton)
10. Re: Where's my web server bottleneck? (nathan r. hruby)
--__--__--
Message: 1
Date: Wed, 20 Nov 2002 14:07:12 -0500
From: Daniel Danu <ddanu@array.ca>
Organization: Array Systems Computing Inc.
To: Linux yellowdog <yellowdog-general@lists.terrasoftsolutions.com>
Subject: processes
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
Hi,
If I run a script and inside I start in background another process from
that script, (say 'sleep 60 &'), after I kill the main script process
(while the timer still running), will the timer be killed also or should
I use other mechanism? Can you suggest some good documents on processes
(layers, priorities, etc)?
Thanks,
Dan
--__--__--
Message: 2
Date: Wed, 20 Nov 2002 15:15:56 -0500
To: yellowdog-general@lists.terrasoftsolutions.com
From: Stefan Jeglinski <jeglin@4pi.com>
Subject: new ibook 2002 install success
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
Christopher Murtagh waxed eloquently:
>Ahh, hold on right there. This is likely the cause of your problems.
>Before you complain about the quality of the OS/installer, do yourself a
>favor and follow these instructions:
>
>http://www.yellowdoglinux.com/support/installation/guide.shtml
>
>You should create the ext2, boot and swap partitions while installing YDL,
>*NOT* with OS X's utility. I'm actually surprised you got as far as you
>did without partitioning.
I just love having my head handed to me on a plate :-) 'nuff said.
OK, I can boot into RL3 by selecting the linux-novideo option in
yaboot (it is correct to say I'm in yaboot at that point? Or am I in
ybin? Or open firmware? This is my first Linux on new-world
experience). Booting using the linux option won't go (screen goes
black) because clearly I can't run accelerated (no surprise there).
I have fbdev set in X, but I'm getting an "AddScreen/ScreenInit
failed for driver 0" error as a result of startx. Not sure if that's
a killer or if the X config step in the installer wrote a file that
needs culling. Working on it now.
Stefan Jeglinski
--__--__--
Message: 3
Date: Wed, 20 Nov 2002 15:45:24 -0600
From: "Pete Prodoehl" <pete.prodoehl@cygnusinteractive.com>
To: <yellowdog-general@lists.terrasoftsolutions.com>
Subject: Re: Remote Telnetting?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
When I try to install openssh-server-3.1p1-2.ppc.rpm
it tells me that openssh-3.1p1-2 is needed.
When I try to install openssh-3.1p1-2.ppc.rpm
it tells me it conflicts with openssh-3.1p1-2.2a
round and round we go...
Pete
Stefan Bruda wrote:
> At 20:27 -0800 on 2002-11-19 Brian Young wrote:
> >
> > I'm running YDL 2.3 with the Home/Office install, and I'd like to
know
> > how one goes about setting up their machine to be Telnetted into for
remote
> > command line access. Preferably some sort of secure solution, I think
I saw
> > some mention of SSH for this once, but any Telnet method will do in the
end.
>
> Install sshd, i.e., the openssh and openssh-server RPMs from the YDL
> CDs (don't quite remember on which CD they actually are). I believe
> that installing the RPMS also activates the SSH daemon, but make sure
> it is up and running anyway.
>
> Then you could securely log into your machine using ssh (from a Unix
> box, see man ssh) or any other SSH client (such as putty for Windows).
>
> Stefan
>
--__--__--
Message: 4
Date: Wed, 20 Nov 2002 13:47:05 -0800
To: yellowdog-general@lists.yellowdoglinux.com
From: bronto <bronto@csd-bes.net>
Subject: Where's my web server bottleneck?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
I have a web server running YDL 2.1. Performance is acceptable for
development purposes, but soon one of my sites will start getting
some heavier traffic. Already I get an occasional complaint, mostly
from visitors who have really high speed connections. I know that
this isn't a terribly brawny configuration, but it's been great until
now, and am prepared to upgrade whatever makes sense. I have
suspicions about what needs to be done, want a more thorough
understanding of what the issues are and what will be the *next*
bottleneck once I take action. Here's my specs:
YDL 2.1
Beige G3 tower 233
768 MB RAM (which I believe it the capacity)
Data is stored on 60 gig 7200 RPM IBM IDE drive
Most of Linux is stored on the original 4gig IDE drive
MacOS booted from an old 500 (or so) Mb SCSI drive
original equipment network adaptor (presumably 10 megabit)
connected to internet via bronze DSL (which means 256k up, 768 down) :')
Web applications are Apache, MySQL, Postfix, Courier-imap, and a
PostNuke application (php). The php application is at the moment
uncache because of a lack of cache's for the PPC architecture. I'm
aware of some for PPC, but not the ones I want (zend or php
accelerator).
It's the connection, right? But when I move it to a T1, where's the
next bottleneck, and how soon will I hit it?
FWIW, the latest complaint I got was that the main page (about 100k
in size) took 15 sec. to load.
TIA
Rob
--__--__--
Message: 5
Date: Wed, 20 Nov 2002 16:52:01 -0500 (EST)
From: Michael Tucker <mtucker@eecs.harvard.edu>
To: yellowdog-general@lists.terrasoftsolutions.com
Subject: Re: Remote Telnetting?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
That's actually not a circular dependency.... Have you tried installing
openssh-server-3.1p1-2.2a.ppc.rpm It seems to me that that would be a
better candidate for your system if you already have 2.2a of openssh.
Mike
On Wed, 20 Nov 2002, Pete Prodoehl wrote:
>
> When I try to install openssh-server-3.1p1-2.ppc.rpm
>
> it tells me that openssh-3.1p1-2 is needed.
>
> When I try to install openssh-3.1p1-2.ppc.rpm
>
> it tells me it conflicts with openssh-3.1p1-2.2a
>
> round and round we go...
>
>
> Pete
>
> Stefan Bruda wrote:
> > At 20:27 -0800 on 2002-11-19 Brian Young wrote:
> > >
> > > I'm running YDL 2.3 with the Home/Office install, and I'd like to
know
> > > how one goes about setting up their machine to be Telnetted into for
remote
> > > command line access. Preferably some sort of secure solution, I
think I saw
> > > some mention of SSH for this once, but any Telnet method will do in
the end.
> >
> > Install sshd, i.e., the openssh and openssh-server RPMs from the YDL
> > CDs (don't quite remember on which CD they actually are). I believe
> > that installing the RPMS also activates the SSH daemon, but make sure
> > it is up and running anyway.
> >
> > Then you could securely log into your machine using ssh (from a Unix
> > box, see man ssh) or any other SSH client (such as putty for Windows).
> >
> > Stefan
> >
>
> _______________________________________________
> yellowdog-general mailing list
> yellowdog-general@lists.terrasoftsolutions.com
> http://lists.terrasoftsolutions.com/mailman/listinfo/yellowdog-general
>
--__--__--
Message: 6
Date: Wed, 20 Nov 2002 16:53:05 -0500 (EST)
From: "nathan r. hruby" <nathan@drama.uga.edu>
To: yellowdog-general@lists.terrasoftsolutions.com
Subject: Re: Remote Telnetting?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
On Wed, 20 Nov 2002, Pete Prodoehl wrote:
>
> When I try to install openssh-server-3.1p1-2.ppc.rpm
>
> it tells me that openssh-3.1p1-2 is needed.
>
> When I try to install openssh-3.1p1-2.ppc.rpm
>
> it tells me it conflicts with openssh-3.1p1-2.2a
>
> round and round we go...
>
You already have an older version of ssh installed. Use rpm -U to upgrade
the packages as a whole. assuming you have all the openssh-3.1p1-2.2a
rpm's in a direcroty the command 'rpm -Uvh openssh*3.1p1-2.2a.ppc.rpm'
will upgrade them all.
In ydl 2.2 and 2.3 you can also:
apt-get update ; apt-get upgrade openssh
>
> Pete
>
> Stefan Bruda wrote:
> > At 20:27 -0800 on 2002-11-19 Brian Young wrote:
> > >
> > > I'm running YDL 2.3 with the Home/Office install, and I'd like to
know
> > > how one goes about setting up their machine to be Telnetted into for
remote
> > > command line access. Preferably some sort of secure solution, I
think I saw
> > > some mention of SSH for this once, but any Telnet method will do in
the end.
> >
> > Install sshd, i.e., the openssh and openssh-server RPMs from the YDL
> > CDs (don't quite remember on which CD they actually are). I believe
> > that installing the RPMS also activates the SSH daemon, but make sure
> > it is up and running anyway.
> >
> > Then you could securely log into your machine using ssh (from a Unix
> > box, see man ssh) or any other SSH client (such as putty for Windows).
> >
> > Stefan
> >
>
> _______________________________________________
> yellowdog-general mailing list
> yellowdog-general@lists.terrasoftsolutions.com
> http://lists.terrasoftsolutions.com/mailman/listinfo/yellowdog-general
>
--
----------------------------------------
nathan hruby <nathan@drama.uga.edu>
computer services specialist
uga drama
http://www.drama.uga.edu/support/
----------------------------------------
--__--__--
Message: 7
Date: Wed, 20 Nov 2002 15:57:16 -0600
From: "Pete Prodoehl" <pete.prodoehl@cygnusinteractive.com>
To: <yellowdog-general@lists.terrasoftsolutions.com>,
<riley@mosey.org>
Subject: Re: GUI Editor?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
Nothing like being late ;)
In jEdit <http://jedit.org/> I created the following abbreviation:
Abbreviation: if
Text to insert before caret: if (
Text to insert after caret: ) {
}
The result is that when I type if<space> jEdit inserts
if () {
}
with the cursor between the ()'s
I believe this is what you asked for.
Not that I did not create a macro (though jEdit has those) I just
created an abbreviation that will be expanded upon typing if<space>.
It took me about a minute... much less time than it took to write this
email... ;)
Pete
Riley Berton wrote:
> Editors that run under X are generally very good. However, I have always
had one gripe: the lack of useful macro expansion. On all editors that I
have looked at (and they are numerous) I have yet to see "space bar"
expansion of macros so that the usage of macros is easier than just typing
out the contents of the macro. For instance, if I wanted to produce this:
>
> if ( <cursor should end up here> ) {
>
> }
>
> and wanted to use a macro to do it, I would need to bind that sequence to
some weird (usually unconfigurable) key combination, making it just as much
as a PITA as typing it in the first place.
>
> Ideally, an editor should be able to figure out what I mean based on a few
user preset macros and the "space bar" would expand the macro, so that
typing:
>
> if<space>
>
> would result in my example above. I have been searching for this feature
for quite some time in many editors.
>
> I currently use NEdit and was able to write a macro for that editor that
used the space bar as it's key, however, it ran very slowly and made the
editor less responsive so I had to turn it off.
>
> Does anyone out there know of an 'X' based editor that does what I
outlined?
>
> riley
--__--__--
Message: 8
Date: Wed, 20 Nov 2002 13:57:24 -0800
From: Owen Stampflee <owens@csc.uvic.ca>
To: yellowdog-general@lists.terrasoftsolutions.com
Subject: Re: Where's my web server bottleneck?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
> Web applications are Apache, MySQL, Postfix, Courier-imap, and a
> PostNuke application (php). The php application is at the moment
> uncache because of a lack of cache's for the PPC architecture. I'm
> aware of some for PPC, but not the ones I want (zend or php
> accelerator).
It sounds like PHP is the culprit.
PHP is slower than molassis on a winter day. Not sure how they compare
but Slashcode will be alot quicker (IIRC, alot of pages are written
statically).
You're also doing alot on that box.
> It's the connection, right? But when I move it to a T1, where's the
> next bottleneck, and how soon will I hit it?
A faster connection will help but theres other issues at play if a
100k/pg takes 15sec to download.
More information such as load averages, memory usage, network stats etc
would make finding the culprit easier.
Owen
--__--__--
Message: 9
Date: Wed, 20 Nov 2002 17:16:02 -0500
From: Riley Berton <riley@mosey.org>
To: "Pete Prodoehl" <pete.prodoehl@cygnusinteractive.com>
Cc: yellowdog-general@lists.terrasoftsolutions.com
Subject: Re: GUI Editor?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
Thanks for the info. If Java support on PowerPC linux was up to snuff I
would
definitely check that out. I have tried jEdit in the past but was
frustrated
with the performance of java apps on PPC Linux due to the lack of a JIT
compiler. Maybe with IBM's new 1.3.1SR3 it will be bearable.
riley
On Wed, 20 Nov 2002 15:57:16 -0600
"Pete Prodoehl" <pete.prodoehl@cygnusinteractive.com> wrote:
>
> Nothing like being late ;)
>
> In jEdit <http://jedit.org/> I created the following abbreviation:
>
> Abbreviation: if
>
> Text to insert before caret: if (
>
> Text to insert after caret: ) {
>
> }
>
> The result is that when I type if<space> jEdit inserts
>
> if () {
>
> }
>
> with the cursor between the ()'s
>
> I believe this is what you asked for.
>
> Not that I did not create a macro (though jEdit has those) I just
> created an abbreviation that will be expanded upon typing if<space>.
>
> It took me about a minute... much less time than it took to write this
> email... ;)
>
>
> Pete
>
>
> Riley Berton wrote:
> > Editors that run under X are generally very good. However, I have
always
> > had one gripe: the lack of useful macro expansion. On all editors that
I
> > have looked at (and they are numerous) I have yet to see "space bar"
> > expansion of macros so that the usage of macros is easier than just
typing
> > out the contents of the macro. For instance, if I wanted to produce
this:
> >
> > if ( <cursor should end up here> ) {
> >
> > }
> >
> > and wanted to use a macro to do it, I would need to bind that sequence
to
> > some weird (usually unconfigurable) key combination, making it just as
much
> > as a PITA as typing it in the first place.
> >
> > Ideally, an editor should be able to figure out what I mean based on a
few
> > user preset macros and the "space bar" would expand the macro, so that
> > typing:
> >
> > if<space>
> >
> > would result in my example above. I have been searching for this
feature
> > for quite some time in many editors.
> >
> > I currently use NEdit and was able to write a macro for that editor that
> > used the space bar as it's key, however, it ran very slowly and made the
> > editor less responsive so I had to turn it off.
> >
> > Does anyone out there know of an 'X' based editor that does what I
outlined?
> >
> > riley
>
>
--__--__--
Message: 10
Date: Wed, 20 Nov 2002 17:28:56 -0500 (EST)
From: "nathan r. hruby" <nathan@drama.uga.edu>
To: yellowdog-general@lists.terrasoftsolutions.com
Subject: Re: Where's my web server bottleneck?
Reply-To: yellowdog-general@lists.terrasoftsolutions.com
On Wed, 20 Nov 2002, bronto wrote:
> YDL 2.1
- Upgrade to 2.3 or make sure you are running a *recent* 2.4 series
kernel.
- If you've migrated to ext3, make sure you're not doing a full journal.
See google for more info
> Beige G3 tower 233
- should be ok-ish
> 768 MB RAM (which I believe it the capacity)
- plenty
> Data is stored on 60 gig 7200 RPM IBM IDE drive
> Most of Linux is stored on the original 4gig IDE drive
> MacOS booted from an old 500 (or so) Mb SCSI drive
Make sure you have swap on the fasest drive (the 60GB one) if not, add it
if possible (if you have an extra 256 MB unallocated on that drive) not
that you're probably swapping that much, but things do swap (like swapd :)
and that could help.. not the biggest performance things in the world, but
it *might* help.
Also, the ATA conroller in the g3's wasn't too fast (ata33 IIRC) you may
want to get an addtional faster ATA controller that will work with your
drive and put the fast drive on that card as the sole and master device
on the channel. The bus speed is still slow on those guys, but it'll be
better than what you got, and better than nothing.
Thirdly, I bet you have a zip drive and a cdrom in that thing as well.
this means the logical place to put the 60Gb drive is into the slave slot
for the onboard ATA controller, this will degrade your drive performance
further, as the master drive (the 4gb) will always get access to the bus
first. you could try flipping the original drive and the 60GB and see
what happens.
also, do note that the original drive is probably nearing it's useful
life, backup early, backup often :)
> original equipment network adaptor (presumably 10 megabit)
Yes, UPG to a decent 10/100 card. 3com cards work nicely in YDL. This
won't help a bandwidth problem, but faster is better, and a stronger card
with better drivers can shave a little time of per request.
> connected to internet via bronze DSL (which means 256k up, 768 down) :')
>
I'm sure you understand the implication of that statement ;)
> Web applications are Apache, MySQL, Postfix, Courier-imap, and a
> PostNuke application (php). The php application is at the moment
> uncache because of a lack of cache's for the PPC architecture. I'm
> aware of some for PPC, but not the ones I want (zend or php
> accelerator).
>
jpcache babby! PostNuke (and all the Nuke's) are not too terriblly speedy
- you need to do something other than wait for Zend/APC. using jpcache
will mean you need to poke at some of the files and edit them. Also, read
up on MySQL performance tuning. Most liekly the MySQL tables are living
on that slow original 5400RPM drive in /var.. you can move the tables
directory to your faster 60GB drive and you should see a small performance
boot. I'm sure there are some tuing tips for postnuke out there
somewhere.. if not, Bug 'em and tell them I sent you :) Caching the
bytecode compiled php doesn't do all that much because you still have to
tear up and down the data structures those cached objects create at every
request (which is a lot and they are big). jpcache slurps the whole
output page as a statis entity depending on a bunch of stuff.
SourceForge uses jpcache to make it not slow. you could also get the Zend
studio or compiler and compile your source site into php bytecode.. that
might make up for the Zend cache not being there.
Above that, there are a bunch of services running on that box, if alot of
them are getting heavy traffic, you'll maybe want to migrate some of them
over to something else (for instance, mail service could move to another
slower box without a lot of hassle).
> It's the connection, right? But when I move it to a T1, where's the
> next bottleneck, and how soon will I hit it?
>
The connection is a serious part of the problem. what you;re also not
seeing is that the DSL network you're on is not a commerically designed
network, so there are probably some things going on that prevent optimal
performace. if you're DSl modem locked at 10Mb/sec? how fast is the
backbone your DSL service is on? Is there a lot of traffic at their
demarcation to the upstream provider? Who are they (and their upstream
provider) peered with?
A 486 with a 10Mb/sec card can saturate a t1 (1.5Mb/sec) all day long with
static pages / images. t1's don;t go as far as your thing, espcially as I
belive you;re just upping your service level, not moving to a co-lo or
having a dedicated t1 + router installed into your home :)
> FWIW, the latest complaint I got was that the main page (about 100k
> in size) took 15 sec. to load.
>
100k is a little big, dontcha think? Is that page static, dynamic, image
heavy? why's it 100k and what being done to generate it.
[nathan@jake www]$ ls -lh *.php
-r--rw-r-- 1 apache www 3.3k Oct 20 17:59 error.php
-rw-r--r-- 1 philb www 4.9k Oct 4 12:45 index2.php
-rw-rw-r-- 1 nathan www 937 Oct 1 11:09 index-old.php
-rw-rw-r-- 1 nathan www 1.0k Oct 1 11:06 index.php
-r--rw-r-- 1 apache www 137 Jun 16 11:14 map.php
-r--rw-r-- 1 apache www 576 Jun 16 11:14 noaccess.php
-r--rw-r-- 1 apache www 6.7k Jun 16 11:15 search.php
Note that the index.php page has two images that top out at about 10k
together and a auto included header that's 4k for a total of about 15k.
the index page is the palce you want to be snappy, as that's what gets hit
the most.
-n
--
----------------------------------------
nathan hruby <nathan@drama.uga.edu>
computer services specialist
uga drama
http://www.drama.uga.edu/support/
----------------------------------------
--__--__--
_______________________________________________
yellowdog-general mailing list
yellowdog-general@lists.terrasoftsolutions.com
http://lists.terrasoftsolutions.com/mailman/listinfo/yellowdog-general
End of yellowdog-general Digest