We've released the searchengine today, which is rewritten in c++. Now that's nice as it's much more scalable, and it should lead to a higher availability and speed.
The spiders are also updated, they're able to run more frequently.
Posted on February 9, 2006 09:07 (GMT +01:00) by Robin | Permanent link | 5 Comments
Tags: update, spiders
harry commented, on February 24, 2006 at 18:17 (GMT +01:00):
You could do a search on 'psychology', there seem to be quite a bit available...
russ commented, on March 21, 2006 at 10:41 (GMT +01:00):
Not sure if you need to tighten up on your parsing to ensure there ARE enclosures in the RSS feed - if you search for 'gtd' you seem to get allot of results which aren't actually podcasts, just rss feeds from blogs.
Robin commented, on March 26, 2006 at 19:52 (GMT +01:00):
Russ: the spiders do actually check on enclosures in the feeds. However, if people add a feed manually, then it's not checked.
russ commented, on April 24, 2006 at 16:39 (GMT +01:00):
Hi Robin, maybe it's worth changing that policy? otherwise your database will slowly fill up with incorrect feeds...



patriciay commented, on February 24, 2006 at 16:59 (GMT +01:00):
I am looking at websites that have anything to do with psychology. I am not sure what this one does, but I am very
interested in finding out. We are supposed to look-up sites
on the web. At least 10 and write a paragragh on each. But I
am not sure what I would write about this one and how it can
help others. Can you please explain to me, what this web site
is all about. Thankyou.