SiD3WiNDR Gears  Hacker Emblem  
Thinking before you configure
Date: May 9th, 2009 by SiD3WiNDR
Categories: Computing, Software, Stupid

For a long while one of my servers “crashed” weekly. Every saturday at 3am the load would just spiral up and everything would become unresponsive (still working but slow) – everything was waiting on disk I/O. I kept putting off checking why this happened, and just rebooted the machine manually every saturday (lazy lazy). After a while I found out it was at 3am, so it had to be a cron job. I then noticed that one of my other servers also had a high load at 3am, but less high and it recovered.

Today I did some thinking and checking, and to blame was.. me! I had configured smartmontools to do a weekly long selfcheck at 3am on all 4 disks in the software RAID5 at the same time. This apparently took so much speed away from the disks that the machine didn’t cope.. Woopsie.

Note: hobby environment of course, real production I would have spent more time figuring it out 🙂


Incoming Links (via Technorati):
Nothing Reported

Comments are closed.

Weblog Calendar
October 2021
M T W T F S S
« Aug    
 123
45678910
11121314151617
18192021222324
25262728293031
Sales
Pages
Archives
Categories
Links
Meta
© 2002-2021, SiD3WiNDR - Proudly powered by WordPress - XHTML Compliant - RSS (Entries) - RSS (Comments)