I'm doing some research where i have to serach for a lot of bbs-posts (forum posts) from different forums, and "compile" them to a single text file.
In other words I need at webcrawler that can search the web for keywords, copy the text on the approapiate page, put it into a single file / database.
My worst problem is not finding some programs that can do that, but those i have found, require some network-programming skills, to setup and activate...
-any help would be deepy appriciated.
-Hans von Knut