blob: c16b01301eb18a22f299941d4841f992992c3377 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`resource` --- Resource usage information
2==============================================
3
4.. module:: resource
5 :platform: Unix
6 :synopsis: An interface to provide resource usage information on the current process.
7.. moduleauthor:: Jeremy Hylton <jeremy@alum.mit.edu>
8.. sectionauthor:: Jeremy Hylton <jeremy@alum.mit.edu>
9
10
11This module provides basic mechanisms for measuring and controlling system
12resources utilized by a program.
13
14Symbolic constants are used to specify particular system resources and to
15request usage information about either the current process or its children.
16
17A single exception is defined for errors:
18
19
20.. exception:: error
21
22 The functions described below may raise this error if the underlying system call
23 failures unexpectedly.
24
25
26Resource Limits
27---------------
28
29Resources usage can be limited using the :func:`setrlimit` function described
30below. Each resource is controlled by a pair of limits: a soft limit and a hard
31limit. The soft limit is the current limit, and may be lowered or raised by a
32process over time. The soft limit can never exceed the hard limit. The hard
33limit can be lowered to any value greater than the soft limit, but not raised.
34(Only processes with the effective UID of the super-user can raise a hard
35limit.)
36
37The specific resources that can be limited are system dependent. They are
38described in the :manpage:`getrlimit(2)` man page. The resources listed below
39are supported when the underlying operating system supports them; resources
40which cannot be checked or controlled by the operating system are not defined in
41this module for those platforms.
42
43
44.. function:: getrlimit(resource)
45
46 Returns a tuple ``(soft, hard)`` with the current soft and hard limits of
47 *resource*. Raises :exc:`ValueError` if an invalid resource is specified, or
48 :exc:`error` if the underlying system call fails unexpectedly.
49
50
51.. function:: setrlimit(resource, limits)
52
53 Sets new limits of consumption of *resource*. The *limits* argument must be a
54 tuple ``(soft, hard)`` of two integers describing the new limits. A value of
55 ``-1`` can be used to specify the maximum possible upper limit.
56
57 Raises :exc:`ValueError` if an invalid resource is specified, if the new soft
58 limit exceeds the hard limit, or if a process tries to raise its hard limit
59 (unless the process has an effective UID of super-user). Can also raise
60 :exc:`error` if the underlying system call fails.
61
62These symbols define resources whose consumption can be controlled using the
63:func:`setrlimit` and :func:`getrlimit` functions described below. The values of
64these symbols are exactly the constants used by C programs.
65
66The Unix man page for :manpage:`getrlimit(2)` lists the available resources.
67Note that not all systems use the same symbol or same value to denote the same
68resource. This module does not attempt to mask platform differences --- symbols
69not defined for a platform will not be available from this module on that
70platform.
71
72
73.. data:: RLIMIT_CORE
74
75 The maximum size (in bytes) of a core file that the current process can create.
76 This may result in the creation of a partial core file if a larger core would be
77 required to contain the entire process image.
78
79
80.. data:: RLIMIT_CPU
81
82 The maximum amount of processor time (in seconds) that a process can use. If
83 this limit is exceeded, a :const:`SIGXCPU` signal is sent to the process. (See
84 the :mod:`signal` module documentation for information about how to catch this
85 signal and do something useful, e.g. flush open files to disk.)
86
87
88.. data:: RLIMIT_FSIZE
89
90 The maximum size of a file which the process may create. This only affects the
91 stack of the main thread in a multi-threaded process.
92
93
94.. data:: RLIMIT_DATA
95
96 The maximum size (in bytes) of the process's heap.
97
98
99.. data:: RLIMIT_STACK
100
101 The maximum size (in bytes) of the call stack for the current process.
102
103
104.. data:: RLIMIT_RSS
105
106 The maximum resident set size that should be made available to the process.
107
108
109.. data:: RLIMIT_NPROC
110
111 The maximum number of processes the current process may create.
112
113
114.. data:: RLIMIT_NOFILE
115
116 The maximum number of open file descriptors for the current process.
117
118
119.. data:: RLIMIT_OFILE
120
121 The BSD name for :const:`RLIMIT_NOFILE`.
122
123
124.. data:: RLIMIT_MEMLOCK
125
126 The maximum address space which may be locked in memory.
127
128
129.. data:: RLIMIT_VMEM
130
131 The largest area of mapped memory which the process may occupy.
132
133
134.. data:: RLIMIT_AS
135
136 The maximum area (in bytes) of address space which may be taken by the process.
137
138
139Resource Usage
140--------------
141
142These functions are used to retrieve resource usage information:
143
144
145.. function:: getrusage(who)
146
147 This function returns an object that describes the resources consumed by either
148 the current process or its children, as specified by the *who* parameter. The
149 *who* parameter should be specified using one of the :const:`RUSAGE_\*`
150 constants described below.
151
152 The fields of the return value each describe how a particular system resource
153 has been used, e.g. amount of time spent running is user mode or number of times
154 the process was swapped out of main memory. Some values are dependent on the
155 clock tick internal, e.g. the amount of memory the process is using.
156
157 For backward compatibility, the return value is also accessible as a tuple of 16
158 elements.
159
160 The fields :attr:`ru_utime` and :attr:`ru_stime` of the return value are
161 floating point values representing the amount of time spent executing in user
162 mode and the amount of time spent executing in system mode, respectively. The
163 remaining values are integers. Consult the :manpage:`getrusage(2)` man page for
164 detailed information about these values. A brief summary is presented here:
165
166 +--------+---------------------+-------------------------------+
167 | Index | Field | Resource |
168 +========+=====================+===============================+
169 | ``0`` | :attr:`ru_utime` | time in user mode (float) |
170 +--------+---------------------+-------------------------------+
171 | ``1`` | :attr:`ru_stime` | time in system mode (float) |
172 +--------+---------------------+-------------------------------+
173 | ``2`` | :attr:`ru_maxrss` | maximum resident set size |
174 +--------+---------------------+-------------------------------+
175 | ``3`` | :attr:`ru_ixrss` | shared memory size |
176 +--------+---------------------+-------------------------------+
177 | ``4`` | :attr:`ru_idrss` | unshared memory size |
178 +--------+---------------------+-------------------------------+
179 | ``5`` | :attr:`ru_isrss` | unshared stack size |
180 +--------+---------------------+-------------------------------+
181 | ``6`` | :attr:`ru_minflt` | page faults not requiring I/O |
182 +--------+---------------------+-------------------------------+
183 | ``7`` | :attr:`ru_majflt` | page faults requiring I/O |
184 +--------+---------------------+-------------------------------+
185 | ``8`` | :attr:`ru_nswap` | number of swap outs |
186 +--------+---------------------+-------------------------------+
187 | ``9`` | :attr:`ru_inblock` | block input operations |
188 +--------+---------------------+-------------------------------+
189 | ``10`` | :attr:`ru_oublock` | block output operations |
190 +--------+---------------------+-------------------------------+
191 | ``11`` | :attr:`ru_msgsnd` | messages sent |
192 +--------+---------------------+-------------------------------+
193 | ``12`` | :attr:`ru_msgrcv` | messages received |
194 +--------+---------------------+-------------------------------+
195 | ``13`` | :attr:`ru_nsignals` | signals received |
196 +--------+---------------------+-------------------------------+
197 | ``14`` | :attr:`ru_nvcsw` | voluntary context switches |
198 +--------+---------------------+-------------------------------+
199 | ``15`` | :attr:`ru_nivcsw` | involuntary context switches |
200 +--------+---------------------+-------------------------------+
201
202 This function will raise a :exc:`ValueError` if an invalid *who* parameter is
203 specified. It may also raise :exc:`error` exception in unusual circumstances.
204
Georg Brandl116aa622007-08-15 14:28:22 +0000205
206.. function:: getpagesize()
207
208 Returns the number of bytes in a system page. (This need not be the same as the
209 hardware page size.) This function is useful for determining the number of bytes
210 of memory a process is using. The third element of the tuple returned by
211 :func:`getrusage` describes memory usage in pages; multiplying by page size
212 produces number of bytes.
213
214The following :const:`RUSAGE_\*` symbols are passed to the :func:`getrusage`
215function to specify which processes information should be provided for.
216
217
218.. data:: RUSAGE_SELF
219
Antoine Pitroub6d4ee52010-11-17 16:19:35 +0000220 Pass to :func:`getrusage` to request resources consumed by the calling
221 process, which is the sum of resources used by all threads in the process.
Georg Brandl116aa622007-08-15 14:28:22 +0000222
223
224.. data:: RUSAGE_CHILDREN
225
Antoine Pitroub6d4ee52010-11-17 16:19:35 +0000226 Pass to :func:`getrusage` to request resources consumed by child processes
227 of the calling process which have been terminated and waited for.
Georg Brandl116aa622007-08-15 14:28:22 +0000228
229
230.. data:: RUSAGE_BOTH
231
232 Pass to :func:`getrusage` to request resources consumed by both the current
233 process and child processes. May not be available on all systems.
234
Antoine Pitroub6d4ee52010-11-17 16:19:35 +0000235
236.. data:: RUSAGE_THREAD
237
238 Pass to :func:`getrusage` to request resources consumed by the current
239 thread. May not be available on all systems.
240
241 .. versionadded:: 3.2