Linode Forum

Sarteck · Joined: 20 Sep 2009 Posts: 8

I have a Linode that I'm running a vBulletin forum on with Sphinx Search installed.

When I turned the Sphinx back on, I started getting high IO, but it didn't appear to be negatively affecting my site. Still, I wanted to find the cause and see what I could do to lower it.

(The Swap spikes are during site backup and stuff, so that's fine.)

However, top and iotop show minimal usage of the server:

Is it something I should concern myself with, or should I just bump up my Notification Threshold?

EDIT:

It seems that when I took the screenshot, iotop DID start showing some activity... ^^; Before, it was all 0%. My bad, there.

Um, I guess... useless thread? Though I do want to know if I have to worry about high IO, as long as it's not going to swap.

hoopycat · Posted: Wed Jan 18, 2012 7:23 am Post subject:

I wouldn't worry too much about it, although that is rather high for a search thingy. Does it do that on each search, or just when it needs to update/rebuild its index? ("vmstat 1" will give you a quick one-line summary of everything each second, so you can have that up in a window while you prod things.)

Also, does this mean your vBulletin doesn't require MyISAM's blasted fulltext index? If so, I might have to look into that...

Sarteck · Joined: 20 Sep 2009 Posts: 8

Yes, I believe that Sphinx does NOT use the FULLTEXT. The re-indexing takes place daily, but there's also some "delta" bit that gets run every ten minutes that has to do with it--that's where I assumed the IO was coming from, since it's steady throughout the day.

Sphinx is great for us--we've got about 5 million posts, and using the default Search with vBulletin gave us a lot of timeouts, rendered it almost useless. Most guides I read say that if you have such a large amount of posts, using Sphinx would probably be beneficial.

And thanks for the vmstat info--I will definitely use it while prodding.

Guspaz · Joined: 26 May 2009 Posts: 1150 Location: Montreal, QC

Sphinx appears to be transparently scalable, and there seem to be vBulletin search modules that enable to to at least offload Sphinx onto a different machine than your application server pretty easily. So in the worst case, you can always spin off Sphinx onto a separate box.

IO "Problem"?