Stanford University School of Earth Science
 
Home
News
New Users
Policies
Network File Server
Web Server
Get Help
Net Connections
Your Macintosh
Your Windows PC
Your Unix/Linux System
Other School Resources
Using Unix
   Overview
   Documentation
   Accounts
   Using the Shell
   Using X-Windows
   File Manipulation
   Net Commands
   Editing Text
   Formatting Text
   Printing
   Filters & Utilities
   Programming

Filters and data utilities

Last revision July 20, 2004

Table of Contents:

  1. Repeated execution with find
  2. Data compression programs
  3. Backing up files into archives and recovering them with tar
  4. Reading and writing raw data files with dd
  5. Emailing program output automatically with mailx
 

UNIX data analysis utilities

Much of the power of UNIX comes from utilities that operate on files in a non-interactive mode to manipulate or edit text or data. These utilities are generally known as "filters" that read from standard input and write to standard output, so they can be used in combinations in pipes. Unless noted, these utilities will also accept input file names on the command line.

This section describes miscellaneous useful Unix utlities as shown in the table of contents. Useful utilities that have been described in other sections are linked below.

grep Select records containing a desired string in any field.
sed Edit or add/delete records.
awk Access, select, and manipulate fields according to your own program.
tr Translate characters - allows manipulation of the characters of a file.
sort Sort by fields.
wc A "word count" program that simply counts the number of lines, words, and characters in a file, giving one line of output with those three numbers (no header).

 


Comments?

Stanford University    |