We have a heavy traffic content rich website.

We want to show related articles for each article.

Technically it is a hefty task of content indexing. We want to outsource it if possible, so another server / company / service crawl through our content on regular basis and simply serve the related articles.

Generally I believe its called content indexing engine.

I have searched the internet much for it but nothing comes up positively.

My question is; has anybody came across with this situation ? If so, can you please point us to any service or company which do the same ? Any ready to go systems ? server software ? I just want to be pointed in right direction.

Thank you much for any input. Would really appreciate it.

I've used Solr, which is really good at this task. It's somewhat hefty due to being Java-based, but it's worth it. If you're using Django, Haystack interfaces with it very nicely.

_________________

/* TODO: need to add signature to posts */