R Script: Determine whether the script is run in the GUI or from command line

Perhaps you are looking for interactive()?

In C, you would use the isatty function. If you could find an equivalent function in R (probably in a UNIX or file system library), that should help.