i finally figured out blamo's speed problem

[Aaron]

It was Yahoo's Slurp service that indexes the site, they think it's appropriate to send 200+ bots onto the site at once. So I banned Yahoo from touching BlamoNet.com and it cut down on the server stress by about 80%. I wrote a robots.txt file to help control the amount their hit the site, but it seems their are ignoring things now, so they get the boot until they can behave. :D

[Osceana]

:yes:

Nice. So no more server errors? That shit is annoying.

Lousy Yahoo!

[Drevpile]

YAY... no more please try again later ?

[Aaron]

Yeah like the server load now is .46, normally it would be 2-4. I can't believe it was Yahoo that was causing the issue. Google indexes the site constantly too, but at least they only use a bot or two at a time, not 100-200.

[Drevpile]

cheers boss :yes:

[rogaine]

good job, aaron! we <3 u..

[ok]

sahhhweeet :D

[SoonIWillDisa?pear]

http://www.romanempire.net/romepage/images/ArtGallery/Toga/party/raise_the_roof.JPG

[Drunkenmaster]

I'm still getting error messages.

[Aaron]

Yeah I'm getting issue still also. This is why I just said fuck it and got a new server. :O

[Drunkenmaster]

Sawwweeeeeeeeeeeeettttttttttttttt.

[kendra]

Although new server will hopefully help, just wanted to add a :wtf: to Yahoo!

[Cheryl K]

I've gotten two server's too busy messages today and it seems like every time I go to post something Firefox gives me an error and tells me that the page was taking too long to load. D:

EDIT: The Firefox errors specifically say "server not found".

[Daysleeper]

I still got loads of 'busy' messages yesterday and a few this evening too.

[Noshus Klam]

I seem to always get them when I notice I typed something wrong and need to edit my post.

[Aaron]

Seems like we are also being spammed a lot via e-mail, so set an hourly cron job to clear out my mail queues of bounced e-mail, this reduces the server load a lot... let me know if you guys still experience issues.