Peter J. Nielsen
09-25-2001, 10:12 AM
Hi again.
Well, here I am again, with another question.
For a long time now, I've wondered how searchengines find new sites and if it were possible to index certain part of the internet, f.ex. a domain, say .dk and perhaps look for keywords in websites and the have a program make an index of all these sites so that i can look at them later.
So, basically what I'm looking for is a spider or similar with the possibility of being tuned to search certain domains for one or multiple keywords.
Can Linux do that or am I merely fantasizing ?
I'd very much appriciate your help.
Sincerely
Peter
(eternal newbie)
Well, here I am again, with another question.
For a long time now, I've wondered how searchengines find new sites and if it were possible to index certain part of the internet, f.ex. a domain, say .dk and perhaps look for keywords in websites and the have a program make an index of all these sites so that i can look at them later.
So, basically what I'm looking for is a spider or similar with the possibility of being tuned to search certain domains for one or multiple keywords.
Can Linux do that or am I merely fantasizing ?
I'd very much appriciate your help.
Sincerely
Peter
(eternal newbie)