Snipplr - webonomic

(SAS) Co Word Analysis with SAS

Sun, 02 Dec 2012 07:43:07 GMT

Text Miner uses a compressed representation of the term-by-doc frequency matrix. You will find an OUT data set in the project data directory of your text miner run. Its label will include the string "OUT" in it. Since a 30,000 document collection will have as many as 500,000 to a million distinct terms, be sure to restrict your terms of interest with a start list. I give an example of creating the cooccurrence matrix with the following code which expands the compressed version to an uncompressed version and then computes the co-occurrence count with proc corr and the sscp option.

(SAS) Using Alternating Background Color with PROC REPORT

Fri, 02 Nov 2012 02:33:20 GMT

Adding alternating row of color to make proc report output easier to read.

(SAS) Specify colors in SAS statistical graphics procedures

Wed, 24 Oct 2012 06:53:06 GMT

If you want to see some of the color names that SAS recognizes, run the following statements, which will print a list of colors to the SAS log:

(SAS) Default Macro Values

Sat, 13 Oct 2012 00:28:05 GMT

Quite often it is necessary to set a default value for a macro parameter that is passed to a program. If the program is a macro, the %IF statement can be used to check if the value is provided and provide a default value if not. Since %IF statements are not allowed outside of macros, that technique won't work for a non-macro program (e.g., a file/program that is %INCLUDEd). The following code snippet demonstrates the use of the COALESCEC function to assign a default value. since macro is a text manipulation facility, the coalesceC function is used regardless of whether the expected value for the parameter is numeric (i.e., everything in macro is interpretted as a character string).

(SAS) Creating a report of Twitter hashtag activity

Fri, 13 Apr 2012 01:02:52 GMT

The program uses the XML LIBNAME engine, FILENAME URL, SGPLOT procedure, and a simple PROC PRINT to create a report of recent Twitter activity around a specified hashtag.

(DOS Batch) Combine/append ASCII files using DOS

Fri, 13 Apr 2012 00:53:33 GMT

Quickly combine/append ascii type files such as txt or csv.

(SAS) Selecting a Random Sample of Observations

Thu, 16 Feb 2012 02:08:13 GMT

You can use the POINT option of the SET statement to efficiently select a random sample of observations from a SAS data set. In addiiton to any statistical reasons for drawing a random sample, the technique is also useful to create test data from a large file. The program shown here efficiently samples a large data set. It reads only the observations that have been selected using the POINT option. You assign a variable that is the desired sample size. The example here selects a 10% sample. You can also assign a fixed value (e.g., 100). The DO loop is iterated for each observation The uniform function is compared to the percent of observations still to be selected If the observation is selected, it is read and output and the number needed is decremented by 1 Regardless the number of observations left is reduced by 1 The STOP statement is very important as without it, the DATA step will enter an infinite loop. This technique works by modifying the threshold as observations are read and selected. Every observation has the same probability of being selected so the technique is statistically valid (If you are a statistician, you probably know this. If not, the analogy of drawing straws is the logic behind this.)

(SAS) Convert SAS dataset to Text file

Tue, 15 Nov 2011 14:20:12 GMT

This SAS macro will convert a dataset to a text file

(SAS) Exporting Multiple Data Sets to One Spreadsheet

Sat, 19 Mar 2011 07:32:29 GMT

It's easy to export several data sets to one Excel spreadsheet with each data set in a separate worksheet.This example exports three SAS data sets (work.region, work.county and work.district) to the same spreadsheet (results.xls).

(SAS) Store a zero value in place of missing when reporting numeric values

Sat, 22 Jan 2011 10:20:23 GMT

(Ruby) Strip characters from between two delimiters

Tue, 26 Oct 2010 04:00:58 GMT

This regular expression used in Ruby will extract the characters between single or multi-character delimiters. It helps when you have strange delimiters such as \":delimeter1: text I want to grab goes here :delimiter2:\"

(SAS) Create a new variable based on the first non missing value from a list of variables

Wed, 29 Sep 2010 02:55:10 GMT

(SAS) Retrieve the physical location of a dynamic dataset, file or folder in SAS

Fri, 26 Feb 2010 16:04:44 GMT

The PATHNAME function can be used to retrieve the physical location of a file or directory. This can be especially useful when reassigning engines for a libref using the Macro Language. Here we want to write a Version 6 copy of the data set CLASS to the same location as the MYDATA library, however in order to issue a new LIBNAME statement we need to know the location of the MYDATA library. The PATHNAME function returns this location and the new libref (MYDAT6) can be created.

(Bash) Create ISO files in Linux

Sun, 17 Jan 2010 16:22:30 GMT

(Ruby) Ruby vcard maker

Sun, 10 Jan 2010 13:27:32 GMT

Requires vPim package.

(Ruby) Ruby script to save a string to a file.

Sun, 10 Jan 2010 13:23:39 GMT

(Bash) Send email using mail command on linux

Thu, 03 Dec 2009 23:56:13 GMT

This command will email the contents of emailbody.txt to somebody@domain.com with the subject My subject line.

(Bash) Loop through Array in Bash

Thu, 03 Dec 2009 20:45:39 GMT

This creates an array of various linux shell names, loops through the array and ouputs a file called shell_locations.txt showing where the shells are located on the linux system.

(SAS) Show all possible values in table regardless of whether or not the value exists

Tue, 25 Aug 2009 13:19:46 GMT

Here are two solutions when creating a table to show responses to a questionnaire where respondents rate items in various categories. In this case, the responses range from 0 to 5 (N/A, Very Poor, Poor, Average, Good, Very Good).

(Bash) Backup your MBR on Linux

Tue, 17 Mar 2009 00:11:55 GMT

About the dd command: dd if= of= bs=("USUALLY" some power of 2, not less than 512 bytes(ie, 512, 1024, 2048, 4096, 8192, 16384[/b], but can be ANY reasonable number.) skip= seek= conv=. Source is the data being read. Target is where the data gets written. Warning!! If you reverse the source and target, you can wipe out a lot of data. This feature has inspired the nickname "dd" Data Destroyer. Warning!! Caution should be observed when using dd to duplicate encrypted partitions.