Can I programmatically open, search and return results in a browser from multiple websites?
I currently have a list of bookmarked sites that I am looking for content and open them in a new window, in Bookmarks and find the line I want to search for.
Is there a way to do this programmatically, ending up with a browser window containing results pages on sites? There are about 20 of them.
I am running Safari 3 on Mac OS X Leopard. I have experience using PHP, but even something as simple as using AppleScript would be fine too. I just want to speed up the workflow. :-)
Well if you know ruby there is ScRUBYt!
http://www.softwaredeveloper.com/features/scrubyt-ruby-web-scraping-tool-051007/
http://scrubyt.org/
Here are some articles on writing a web crawler in perl:
- http://www.linuxjournal.com/article/2200
- http://www.devshed.com/c/a/Perl/Web-Mining-with-Perl/
Not really programming-related, but you can create something like this using Google's Custom Search System (assuming all sites you plan to search are publicly available).
You can then paste the provided snippets into the HTML file of your choice and even set it as the "home page" in Firefox.
You will need to specify which browser you are using because I am sure each has different automation capabilities.
Try Yahoo Pipes , maybe there is one that is alredy halfway where you want it.
I searched for it for "search" and there is news here.
http://pipes.yahoo.com/pipes/search?q=search&x=0&y=0