Links of Interest
I've been researching a bit about domain specific search etc.
Here are a few notes and links.
http://www.inferlink.com/
http://www.giantoak.com/
http://www.cytenna.com/
http://qiita.com/HirofumiYashima/items/e82f4891e3fd33c09aa5
It seems like it is a good idea to implement something like memex, but in my case to make a platform for searching in depth. I think I will be updating my crawler soon and make it open source, as I have many ideas I would like to implement on my own or hire a coder to make it.