Snipplr - noah

(Bash) WGet entire site with wget -pkr

Sat, 16 Feb 2008 21:42:46 GMT

Download and archive an entire Web site, starting with the given page and recursing down 1 level. Adjust how many levels deep by changing the numeric argument given after -l Won't follow @import links in CSS.

(Perl) Generate XHTML on the command line with XML::API::XHTML

Sun, 10 Feb 2008 02:21:23 GMT

Build a simple XHTML document, format it with Tidy and print the result to "temp.html."

(Perl) Automated UI test with Selenium-RC, WWW::Selenium and Test::More

Sat, 15 Sep 2007 10:49:16 GMT

In order for this to work, the Selenium-RC server must be running. See also the tutorial at http://search.cpan.org/~mschwern/Test-Simple-0.71/lib/Test/Tutorial.pod

(Bash) save a remote file with Lynx

Sun, 08 Jul 2007 19:41:56 GMT

(Perl) submit a POST query with parameters

Tue, 03 Jul 2007 22:57:13 GMT

from The Perl Black Book, Holzner, p. 1247

(Perl) Grab linked files from a list of web pages

Tue, 03 Jul 2007 22:31:30 GMT

Expects as argument the name of a file containing a newline-delimited list of URLs. When invoked, launches an interactive shell that asks what type of file should be downloaded. Then downloads all the files that are linked from each of the listed Web pages.

(Perl) Remove duplicate lines from a text file

Tue, 03 Jul 2007 22:06:34 GMT

Sometimes I get a big list of things, and some of the things occur multiple times in the same list. A good example is a newline-delimited list of files: the same file path might be listed 4 or 5 times. So this script removes those kinds of duplicate lines. Found at Google Answers.

(Bash) wget with username and password

Tue, 22 May 2007 11:08:00 GMT

This is how to connect to a secure site with wget. The Cygwin manpage is quite confusing on this issue.