Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1 | :mod:`resource` --- Resource usage information |
| 2 | ============================================== |
| 3 | |
| 4 | .. module:: resource |
| 5 | :platform: Unix |
| 6 | :synopsis: An interface to provide resource usage information on the current process. |
| 7 | .. moduleauthor:: Jeremy Hylton <jeremy@alum.mit.edu> |
| 8 | .. sectionauthor:: Jeremy Hylton <jeremy@alum.mit.edu> |
| 9 | |
| 10 | |
| 11 | This module provides basic mechanisms for measuring and controlling system |
| 12 | resources utilized by a program. |
| 13 | |
| 14 | Symbolic constants are used to specify particular system resources and to |
| 15 | request usage information about either the current process or its children. |
| 16 | |
| 17 | A single exception is defined for errors: |
| 18 | |
| 19 | |
| 20 | .. exception:: error |
| 21 | |
| 22 | The functions described below may raise this error if the underlying system call |
| 23 | failures unexpectedly. |
| 24 | |
| 25 | |
| 26 | Resource Limits |
| 27 | --------------- |
| 28 | |
| 29 | Resources usage can be limited using the :func:`setrlimit` function described |
| 30 | below. Each resource is controlled by a pair of limits: a soft limit and a hard |
| 31 | limit. The soft limit is the current limit, and may be lowered or raised by a |
| 32 | process over time. The soft limit can never exceed the hard limit. The hard |
| 33 | limit can be lowered to any value greater than the soft limit, but not raised. |
| 34 | (Only processes with the effective UID of the super-user can raise a hard |
| 35 | limit.) |
| 36 | |
| 37 | The specific resources that can be limited are system dependent. They are |
| 38 | described in the :manpage:`getrlimit(2)` man page. The resources listed below |
| 39 | are supported when the underlying operating system supports them; resources |
| 40 | which cannot be checked or controlled by the operating system are not defined in |
| 41 | this module for those platforms. |
| 42 | |
| 43 | |
| 44 | .. function:: getrlimit(resource) |
| 45 | |
| 46 | Returns a tuple ``(soft, hard)`` with the current soft and hard limits of |
| 47 | *resource*. Raises :exc:`ValueError` if an invalid resource is specified, or |
| 48 | :exc:`error` if the underlying system call fails unexpectedly. |
| 49 | |
| 50 | |
| 51 | .. function:: setrlimit(resource, limits) |
| 52 | |
| 53 | Sets new limits of consumption of *resource*. The *limits* argument must be a |
| 54 | tuple ``(soft, hard)`` of two integers describing the new limits. A value of |
| 55 | ``-1`` can be used to specify the maximum possible upper limit. |
| 56 | |
| 57 | Raises :exc:`ValueError` if an invalid resource is specified, if the new soft |
| 58 | limit exceeds the hard limit, or if a process tries to raise its hard limit |
| 59 | (unless the process has an effective UID of super-user). Can also raise |
| 60 | :exc:`error` if the underlying system call fails. |
| 61 | |
| 62 | These symbols define resources whose consumption can be controlled using the |
| 63 | :func:`setrlimit` and :func:`getrlimit` functions described below. The values of |
| 64 | these symbols are exactly the constants used by C programs. |
| 65 | |
| 66 | The Unix man page for :manpage:`getrlimit(2)` lists the available resources. |
| 67 | Note that not all systems use the same symbol or same value to denote the same |
| 68 | resource. This module does not attempt to mask platform differences --- symbols |
| 69 | not defined for a platform will not be available from this module on that |
| 70 | platform. |
| 71 | |
| 72 | |
| 73 | .. data:: RLIMIT_CORE |
| 74 | |
| 75 | The maximum size (in bytes) of a core file that the current process can create. |
| 76 | This may result in the creation of a partial core file if a larger core would be |
| 77 | required to contain the entire process image. |
| 78 | |
| 79 | |
| 80 | .. data:: RLIMIT_CPU |
| 81 | |
| 82 | The maximum amount of processor time (in seconds) that a process can use. If |
| 83 | this limit is exceeded, a :const:`SIGXCPU` signal is sent to the process. (See |
| 84 | the :mod:`signal` module documentation for information about how to catch this |
| 85 | signal and do something useful, e.g. flush open files to disk.) |
| 86 | |
| 87 | |
| 88 | .. data:: RLIMIT_FSIZE |
| 89 | |
| 90 | The maximum size of a file which the process may create. This only affects the |
| 91 | stack of the main thread in a multi-threaded process. |
| 92 | |
| 93 | |
| 94 | .. data:: RLIMIT_DATA |
| 95 | |
| 96 | The maximum size (in bytes) of the process's heap. |
| 97 | |
| 98 | |
| 99 | .. data:: RLIMIT_STACK |
| 100 | |
| 101 | The maximum size (in bytes) of the call stack for the current process. |
| 102 | |
| 103 | |
| 104 | .. data:: RLIMIT_RSS |
| 105 | |
| 106 | The maximum resident set size that should be made available to the process. |
| 107 | |
| 108 | |
| 109 | .. data:: RLIMIT_NPROC |
| 110 | |
| 111 | The maximum number of processes the current process may create. |
| 112 | |
| 113 | |
| 114 | .. data:: RLIMIT_NOFILE |
| 115 | |
| 116 | The maximum number of open file descriptors for the current process. |
| 117 | |
| 118 | |
| 119 | .. data:: RLIMIT_OFILE |
| 120 | |
| 121 | The BSD name for :const:`RLIMIT_NOFILE`. |
| 122 | |
| 123 | |
| 124 | .. data:: RLIMIT_MEMLOCK |
| 125 | |
| 126 | The maximum address space which may be locked in memory. |
| 127 | |
| 128 | |
| 129 | .. data:: RLIMIT_VMEM |
| 130 | |
| 131 | The largest area of mapped memory which the process may occupy. |
| 132 | |
| 133 | |
| 134 | .. data:: RLIMIT_AS |
| 135 | |
| 136 | The maximum area (in bytes) of address space which may be taken by the process. |
| 137 | |
| 138 | |
| 139 | Resource Usage |
| 140 | -------------- |
| 141 | |
| 142 | These functions are used to retrieve resource usage information: |
| 143 | |
| 144 | |
| 145 | .. function:: getrusage(who) |
| 146 | |
| 147 | This function returns an object that describes the resources consumed by either |
| 148 | the current process or its children, as specified by the *who* parameter. The |
| 149 | *who* parameter should be specified using one of the :const:`RUSAGE_\*` |
| 150 | constants described below. |
| 151 | |
| 152 | The fields of the return value each describe how a particular system resource |
| 153 | has been used, e.g. amount of time spent running is user mode or number of times |
| 154 | the process was swapped out of main memory. Some values are dependent on the |
| 155 | clock tick internal, e.g. the amount of memory the process is using. |
| 156 | |
| 157 | For backward compatibility, the return value is also accessible as a tuple of 16 |
| 158 | elements. |
| 159 | |
| 160 | The fields :attr:`ru_utime` and :attr:`ru_stime` of the return value are |
| 161 | floating point values representing the amount of time spent executing in user |
| 162 | mode and the amount of time spent executing in system mode, respectively. The |
| 163 | remaining values are integers. Consult the :manpage:`getrusage(2)` man page for |
| 164 | detailed information about these values. A brief summary is presented here: |
| 165 | |
| 166 | +--------+---------------------+-------------------------------+ |
| 167 | | Index | Field | Resource | |
| 168 | +========+=====================+===============================+ |
| 169 | | ``0`` | :attr:`ru_utime` | time in user mode (float) | |
| 170 | +--------+---------------------+-------------------------------+ |
| 171 | | ``1`` | :attr:`ru_stime` | time in system mode (float) | |
| 172 | +--------+---------------------+-------------------------------+ |
| 173 | | ``2`` | :attr:`ru_maxrss` | maximum resident set size | |
| 174 | +--------+---------------------+-------------------------------+ |
| 175 | | ``3`` | :attr:`ru_ixrss` | shared memory size | |
| 176 | +--------+---------------------+-------------------------------+ |
| 177 | | ``4`` | :attr:`ru_idrss` | unshared memory size | |
| 178 | +--------+---------------------+-------------------------------+ |
| 179 | | ``5`` | :attr:`ru_isrss` | unshared stack size | |
| 180 | +--------+---------------------+-------------------------------+ |
| 181 | | ``6`` | :attr:`ru_minflt` | page faults not requiring I/O | |
| 182 | +--------+---------------------+-------------------------------+ |
| 183 | | ``7`` | :attr:`ru_majflt` | page faults requiring I/O | |
| 184 | +--------+---------------------+-------------------------------+ |
| 185 | | ``8`` | :attr:`ru_nswap` | number of swap outs | |
| 186 | +--------+---------------------+-------------------------------+ |
| 187 | | ``9`` | :attr:`ru_inblock` | block input operations | |
| 188 | +--------+---------------------+-------------------------------+ |
| 189 | | ``10`` | :attr:`ru_oublock` | block output operations | |
| 190 | +--------+---------------------+-------------------------------+ |
| 191 | | ``11`` | :attr:`ru_msgsnd` | messages sent | |
| 192 | +--------+---------------------+-------------------------------+ |
| 193 | | ``12`` | :attr:`ru_msgrcv` | messages received | |
| 194 | +--------+---------------------+-------------------------------+ |
| 195 | | ``13`` | :attr:`ru_nsignals` | signals received | |
| 196 | +--------+---------------------+-------------------------------+ |
| 197 | | ``14`` | :attr:`ru_nvcsw` | voluntary context switches | |
| 198 | +--------+---------------------+-------------------------------+ |
| 199 | | ``15`` | :attr:`ru_nivcsw` | involuntary context switches | |
| 200 | +--------+---------------------+-------------------------------+ |
| 201 | |
| 202 | This function will raise a :exc:`ValueError` if an invalid *who* parameter is |
| 203 | specified. It may also raise :exc:`error` exception in unusual circumstances. |
| 204 | |
Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 205 | |
| 206 | .. function:: getpagesize() |
| 207 | |
| 208 | Returns the number of bytes in a system page. (This need not be the same as the |
| 209 | hardware page size.) This function is useful for determining the number of bytes |
| 210 | of memory a process is using. The third element of the tuple returned by |
| 211 | :func:`getrusage` describes memory usage in pages; multiplying by page size |
| 212 | produces number of bytes. |
| 213 | |
| 214 | The following :const:`RUSAGE_\*` symbols are passed to the :func:`getrusage` |
| 215 | function to specify which processes information should be provided for. |
| 216 | |
| 217 | |
| 218 | .. data:: RUSAGE_SELF |
| 219 | |
| 220 | :const:`RUSAGE_SELF` should be used to request information pertaining only to |
| 221 | the process itself. |
| 222 | |
| 223 | |
| 224 | .. data:: RUSAGE_CHILDREN |
| 225 | |
| 226 | Pass to :func:`getrusage` to request resource information for child processes of |
| 227 | the calling process. |
| 228 | |
| 229 | |
| 230 | .. data:: RUSAGE_BOTH |
| 231 | |
| 232 | Pass to :func:`getrusage` to request resources consumed by both the current |
| 233 | process and child processes. May not be available on all systems. |
| 234 | |