PBS get job history

Users can get complex information about their current or historical (several months) batch jobs. Utility pbs-get-job-history, which is available on all frontends and compute nodes and extracts the following information:

• Complete batch job (submitted shell script)
• Standard output and standard error files
• Various technical logs

Basic usage is:

pbs-get-job-history <job_id>

Both short or full <job_id> can be supplied, however full jobid should be needed only in case of duplicate jobids on more servers (unlikely). Common usecases are:

• check all PBS servers → e.g. pbs-get-job-history 123456
• meta-pbs.metacentrum.cz → e.g. pbs-get-job-history 123456.meta-pbs.metacentrum.cz
• elixir-pbs.elixir-czech.cz → e.g. pbs-get-job-history 123456.elixir-pbs.elixir-czech.cz
• cerit-pbs.cerit-sc.cz → e.g. pbs-get-job-history 123456.cerit-pbs.cerit-sc.cz

When the job history is found, individual files are stored in one folder named by its jobid.

vorel@elmo:~$ pbs-get-job-history 11808203.meta-pbs.metacentrum.cz

11808203.meta-pbs.metacentrum.cz  Job found

Storing job data in ./11808203.meta-pbs.metacentrum.cz

11808203.meta-pbs.metacentrum.cz_afslog_00000001.pid  # Process identification number (PID)
11808203.meta-pbs.metacentrum.cz.ER                   # Standard error
11808203.meta-pbs.metacentrum.cz.JB                   # PBS parameters in binary format, not human readable
11808203.meta-pbs.metacentrum.cz.JB.TXT               # PBS parameters in text format, readable
11808203.meta-pbs.metacentrum.cz.MOM_LOGS             # PBS logs
11808203.meta-pbs.metacentrum.cz.OU                   # Standard output
11808203.meta-pbs.metacentrum.cz.SC                   # Original user's shell script
11808203.meta-pbs.metacentrum.cz.SYSLOG               # System logs from the computing node

Note: The pbs-get-job-history utility does not retrieve input data and job results (they are not stored anywhere centrally).

Note: Output for interactive jobs does not contain .ER, .OU and .SC files