Any one here with search engine programming knowledge?

Question

I am working on search engine programming and trying to make one search engine limited to some set of sites, for that I want to go through basics of search engine programming. Any kind of knowledge sharing is appropriated.

Thanks
Dhanesh Mane
www.dhaneshmane.com

Answer 1

hmm... I dont know but I bet there is a code snippet that can index pages of other sites. If you can do that, just query the result and display it.



try this link





http://vision-media.ca/resources/php/create-a-php-web-crawler-or-scraper-5-minutes

Answer 2

I assume you would like to use PHP, then how about trying Zend Framework Lucene Search?



http://framework.zend.com/manual/en/zend.search.lucene.html



Or if you have built a web site which connects to a database, then modern databases provide full-text index & search.

So if you can insert your contents (string) into a column which uses full-text index, then you can search the text easily.



eg. Mysql

http://dev.mysql.com/doc/refman/5.1/en/fulltext-search.html



The easiest crawler i would think of is using PHP's file_get_contents, then using regular expression to get all anchor tags, then call file_get_contents again....

Answer 3

For google and if you want to search for, Wii on NGPriest.com

Type this in: site:ngpriest.com Wii

And it'll find you everything Wii related on NGPriest.com

(And i don't know why Wii came to my mind...)