blob: 51879a03832f0e32c567c7ac4dde78a5b3985cef [file] [log] [blame]
Georg Brandl8ec7f652007-08-15 14:28:01 +00001:mod:`threading` --- Higher-level threading interface
2=====================================================
3
4.. module:: threading
5 :synopsis: Higher-level threading interface.
6
7
8This module constructs higher-level threading interfaces on top of the lower
9level :mod:`thread` module.
Georg Brandla6168f92008-05-25 07:20:14 +000010See also the :mod:`mutex` and :mod:`Queue` modules.
Georg Brandl8ec7f652007-08-15 14:28:01 +000011
12The :mod:`dummy_threading` module is provided for situations where
13:mod:`threading` cannot be used because :mod:`thread` is missing.
14
Benjamin Petersonf4395602008-06-11 17:50:00 +000015.. note::
16
Benjamin Peterson973e6c22008-09-01 23:12:58 +000017 Starting with Python 2.6, this module provides PEP 8 compliant aliases and
18 properties to replace the ``camelCase`` names that were inspired by Java's
19 threading API. This updated API is compatible with that of the
20 :mod:`multiprocessing` module. However, no schedule has been set for the
21 deprecation of the ``camelCase`` names and they remain fully supported in
22 both Python 2.x and 3.x.
Benjamin Petersonf4395602008-06-11 17:50:00 +000023
Georg Brandl40e15ed2009-04-05 21:48:06 +000024.. note::
Georg Brandl8ec7f652007-08-15 14:28:01 +000025
Georg Brandl40e15ed2009-04-05 21:48:06 +000026 Starting with Python 2.5, several Thread methods raise :exc:`RuntimeError`
27 instead of :exc:`AssertionError` if called erroneously.
28
29
30This module defines the following functions and objects:
Georg Brandl8ec7f652007-08-15 14:28:01 +000031
Benjamin Peterson0fbcf692008-06-11 17:27:50 +000032.. function:: active_count()
Benjamin Petersonf4395602008-06-11 17:50:00 +000033 activeCount()
Georg Brandl8ec7f652007-08-15 14:28:01 +000034
35 Return the number of :class:`Thread` objects currently alive. The returned
36 count is equal to the length of the list returned by :func:`enumerate`.
37
38
39.. function:: Condition()
40 :noindex:
41
42 A factory function that returns a new condition variable object. A condition
43 variable allows one or more threads to wait until they are notified by another
44 thread.
45
46
Benjamin Peterson0fbcf692008-06-11 17:27:50 +000047.. function:: current_thread()
Benjamin Petersonf4395602008-06-11 17:50:00 +000048 currentThread()
Georg Brandl8ec7f652007-08-15 14:28:01 +000049
50 Return the current :class:`Thread` object, corresponding to the caller's thread
51 of control. If the caller's thread of control was not created through the
52 :mod:`threading` module, a dummy thread object with limited functionality is
53 returned.
54
55
56.. function:: enumerate()
57
Benjamin Peterson0fbcf692008-06-11 17:27:50 +000058 Return a list of all :class:`Thread` objects currently alive. The list
59 includes daemonic threads, dummy thread objects created by
60 :func:`current_thread`, and the main thread. It excludes terminated threads
61 and threads that have not yet been started.
Georg Brandl8ec7f652007-08-15 14:28:01 +000062
63
64.. function:: Event()
65 :noindex:
66
67 A factory function that returns a new event object. An event manages a flag
Georg Brandl0dfdf002009-10-27 14:36:50 +000068 that can be set to true with the :meth:`~Event.set` method and reset to false
69 with the :meth:`clear` method. The :meth:`wait` method blocks until the flag
70 is true.
Georg Brandl8ec7f652007-08-15 14:28:01 +000071
72
73.. class:: local
74
75 A class that represents thread-local data. Thread-local data are data whose
76 values are thread specific. To manage thread-local data, just create an
77 instance of :class:`local` (or a subclass) and store attributes on it::
78
79 mydata = threading.local()
80 mydata.x = 1
81
82 The instance's values will be different for separate threads.
83
84 For more details and extensive examples, see the documentation string of the
85 :mod:`_threading_local` module.
86
87 .. versionadded:: 2.4
88
89
90.. function:: Lock()
91
92 A factory function that returns a new primitive lock object. Once a thread has
93 acquired it, subsequent attempts to acquire it block, until it is released; any
94 thread may release it.
95
96
97.. function:: RLock()
98
99 A factory function that returns a new reentrant lock object. A reentrant lock
100 must be released by the thread that acquired it. Once a thread has acquired a
101 reentrant lock, the same thread may acquire it again without blocking; the
102 thread must release it once for each time it has acquired it.
103
104
105.. function:: Semaphore([value])
106 :noindex:
107
108 A factory function that returns a new semaphore object. A semaphore manages a
109 counter representing the number of :meth:`release` calls minus the number of
110 :meth:`acquire` calls, plus an initial value. The :meth:`acquire` method blocks
111 if necessary until it can return without making the counter negative. If not
112 given, *value* defaults to 1.
113
114
115.. function:: BoundedSemaphore([value])
116
117 A factory function that returns a new bounded semaphore object. A bounded
118 semaphore checks to make sure its current value doesn't exceed its initial
119 value. If it does, :exc:`ValueError` is raised. In most situations semaphores
120 are used to guard resources with limited capacity. If the semaphore is released
121 too many times it's a sign of a bug. If not given, *value* defaults to 1.
122
123
124.. class:: Thread
125
126 A class that represents a thread of control. This class can be safely
127 subclassed in a limited fashion.
128
129
130.. class:: Timer
131
132 A thread that executes a function after a specified interval has passed.
133
134
135.. function:: settrace(func)
136
137 .. index:: single: trace function
138
139 Set a trace function for all threads started from the :mod:`threading` module.
140 The *func* will be passed to :func:`sys.settrace` for each thread, before its
141 :meth:`run` method is called.
142
143 .. versionadded:: 2.3
144
145
146.. function:: setprofile(func)
147
148 .. index:: single: profile function
149
150 Set a profile function for all threads started from the :mod:`threading` module.
151 The *func* will be passed to :func:`sys.setprofile` for each thread, before its
152 :meth:`run` method is called.
153
154 .. versionadded:: 2.3
155
156
157.. function:: stack_size([size])
158
159 Return the thread stack size used when creating new threads. The optional
160 *size* argument specifies the stack size to be used for subsequently created
161 threads, and must be 0 (use platform or configured default) or a positive
162 integer value of at least 32,768 (32kB). If changing the thread stack size is
163 unsupported, a :exc:`ThreadError` is raised. If the specified stack size is
164 invalid, a :exc:`ValueError` is raised and the stack size is unmodified. 32kB
165 is currently the minimum supported stack size value to guarantee sufficient
166 stack space for the interpreter itself. Note that some platforms may have
167 particular restrictions on values for the stack size, such as requiring a
168 minimum stack size > 32kB or requiring allocation in multiples of the system
169 memory page size - platform documentation should be referred to for more
170 information (4kB pages are common; using multiples of 4096 for the stack size is
171 the suggested approach in the absence of more specific information).
172 Availability: Windows, systems with POSIX threads.
173
174 .. versionadded:: 2.5
175
176Detailed interfaces for the objects are documented below.
177
178The design of this module is loosely based on Java's threading model. However,
179where Java makes locks and condition variables basic behavior of every object,
180they are separate objects in Python. Python's :class:`Thread` class supports a
181subset of the behavior of Java's Thread class; currently, there are no
182priorities, no thread groups, and threads cannot be destroyed, stopped,
183suspended, resumed, or interrupted. The static methods of Java's Thread class,
184when implemented, are mapped to module-level functions.
185
186All of the methods described below are executed atomically.
187
188
Georg Brandl4aef7032008-11-07 08:56:27 +0000189.. _thread-objects:
190
191Thread Objects
192--------------
193
194This class represents an activity that is run in a separate thread of control.
195There are two ways to specify the activity: by passing a callable object to the
196constructor, or by overriding the :meth:`run` method in a subclass. No other
197methods (except for the constructor) should be overridden in a subclass. In
198other words, *only* override the :meth:`__init__` and :meth:`run` methods of
199this class.
200
201Once a thread object is created, its activity must be started by calling the
202thread's :meth:`start` method. This invokes the :meth:`run` method in a
203separate thread of control.
204
205Once the thread's activity is started, the thread is considered 'alive'. It
206stops being alive when its :meth:`run` method terminates -- either normally, or
207by raising an unhandled exception. The :meth:`is_alive` method tests whether the
208thread is alive.
209
210Other threads can call a thread's :meth:`join` method. This blocks the calling
211thread until the thread whose :meth:`join` method is called is terminated.
212
213A thread has a name. The name can be passed to the constructor, and read or
214changed through the :attr:`name` attribute.
215
216A thread can be flagged as a "daemon thread". The significance of this flag is
217that the entire Python program exits when only daemon threads are left. The
218initial value is inherited from the creating thread. The flag can be set
Georg Brandlec7d3902009-02-23 10:41:11 +0000219through the :attr:`daemon` property.
Georg Brandl4aef7032008-11-07 08:56:27 +0000220
221There is a "main thread" object; this corresponds to the initial thread of
222control in the Python program. It is not a daemon thread.
223
224There is the possibility that "dummy thread objects" are created. These are
225thread objects corresponding to "alien threads", which are threads of control
226started outside the threading module, such as directly from C code. Dummy
227thread objects have limited functionality; they are always considered alive and
228daemonic, and cannot be :meth:`join`\ ed. They are never deleted, since it is
229impossible to detect the termination of alien threads.
230
231
232.. class:: Thread(group=None, target=None, name=None, args=(), kwargs={})
233
234 This constructor should always be called with keyword arguments. Arguments are:
235
236 *group* should be ``None``; reserved for future extension when a
237 :class:`ThreadGroup` class is implemented.
238
239 *target* is the callable object to be invoked by the :meth:`run` method.
240 Defaults to ``None``, meaning nothing is called.
241
242 *name* is the thread name. By default, a unique name is constructed of the form
243 "Thread-*N*" where *N* is a small decimal number.
244
245 *args* is the argument tuple for the target invocation. Defaults to ``()``.
246
247 *kwargs* is a dictionary of keyword arguments for the target invocation.
248 Defaults to ``{}``.
249
250 If the subclass overrides the constructor, it must make sure to invoke the base
251 class constructor (``Thread.__init__()``) before doing anything else to the
252 thread.
253
254
255.. method:: Thread.start()
256
257 Start the thread's activity.
258
259 It must be called at most once per thread object. It arranges for the object's
260 :meth:`run` method to be invoked in a separate thread of control.
261
262 This method will raise a :exc:`RuntimeException` if called more than once on the
263 same thread object.
264
265
266.. method:: Thread.run()
267
268 Method representing the thread's activity.
269
270 You may override this method in a subclass. The standard :meth:`run` method
271 invokes the callable object passed to the object's constructor as the *target*
272 argument, if any, with sequential and keyword arguments taken from the *args*
273 and *kwargs* arguments, respectively.
274
275
276.. method:: Thread.join([timeout])
277
278 Wait until the thread terminates. This blocks the calling thread until the
279 thread whose :meth:`join` method is called terminates -- either normally or
280 through an unhandled exception -- or until the optional timeout occurs.
281
282 When the *timeout* argument is present and not ``None``, it should be a floating
283 point number specifying a timeout for the operation in seconds (or fractions
284 thereof). As :meth:`join` always returns ``None``, you must call :meth:`isAlive`
285 after :meth:`join` to decide whether a timeout happened -- if the thread is
286 still alive, the :meth:`join` call timed out.
287
288 When the *timeout* argument is not present or ``None``, the operation will block
289 until the thread terminates.
290
291 A thread can be :meth:`join`\ ed many times.
292
293 :meth:`join` raises a :exc:`RuntimeError` if an attempt is made to join
294 the current thread as that would cause a deadlock. It is also an error to
295 :meth:`join` a thread before it has been started and attempts to do so
296 raises the same exception.
297
298
299.. method:: Thread.getName()
300 Thread.setName()
301
302 Old API for :attr:`~Thread.name`.
303
304
305.. attribute:: Thread.name
306
307 A string used for identification purposes only. It has no semantics.
308 Multiple threads may be given the same name. The initial name is set by the
309 constructor.
310
311
312.. attribute:: Thread.ident
313
314 The 'thread identifier' of this thread or ``None`` if the thread has not been
315 started. This is a nonzero integer. See the :func:`thread.get_ident()`
316 function. Thread identifiers may be recycled when a thread exits and another
317 thread is created. The identifier is available even after the thread has
318 exited.
319
320 .. versionadded:: 2.6
321
322
323.. method:: Thread.is_alive()
324 Thread.isAlive()
325
326 Return whether the thread is alive.
327
328 Roughly, a thread is alive from the moment the :meth:`start` method returns
329 until its :meth:`run` method terminates. The module function :func:`enumerate`
330 returns a list of all alive threads.
331
332
333.. method:: Thread.isDaemon()
334 Thread.setDaemon()
335
336 Old API for :attr:`~Thread.daemon`.
337
338
339.. attribute:: Thread.daemon
340
Georg Brandlec7d3902009-02-23 10:41:11 +0000341 A boolean value indicating whether this thread is a daemon thread (True) or
342 not (False). This must be set before :meth:`start` is called, otherwise
343 :exc:`RuntimeError` is raised. Its initial value is inherited from the
344 creating thread; the main thread is not a daemon thread and therefore all
345 threads created in the main thread default to :attr:`daemon` = ``False``.
Georg Brandl4aef7032008-11-07 08:56:27 +0000346
347 The entire Python program exits when no alive non-daemon threads are left.
348
349
Georg Brandl8ec7f652007-08-15 14:28:01 +0000350.. _lock-objects:
351
352Lock Objects
353------------
354
355A primitive lock is a synchronization primitive that is not owned by a
356particular thread when locked. In Python, it is currently the lowest level
357synchronization primitive available, implemented directly by the :mod:`thread`
358extension module.
359
360A primitive lock is in one of two states, "locked" or "unlocked". It is created
361in the unlocked state. It has two basic methods, :meth:`acquire` and
362:meth:`release`. When the state is unlocked, :meth:`acquire` changes the state
363to locked and returns immediately. When the state is locked, :meth:`acquire`
364blocks until a call to :meth:`release` in another thread changes it to unlocked,
365then the :meth:`acquire` call resets it to locked and returns. The
366:meth:`release` method should only be called in the locked state; it changes the
367state to unlocked and returns immediately. If an attempt is made to release an
368unlocked lock, a :exc:`RuntimeError` will be raised.
369
370When more than one thread is blocked in :meth:`acquire` waiting for the state to
371turn to unlocked, only one thread proceeds when a :meth:`release` call resets
372the state to unlocked; which one of the waiting threads proceeds is not defined,
373and may vary across implementations.
374
375All methods are executed atomically.
376
377
378.. method:: Lock.acquire([blocking=1])
379
380 Acquire a lock, blocking or non-blocking.
381
382 When invoked without arguments, block until the lock is unlocked, then set it to
383 locked, and return true.
384
385 When invoked with the *blocking* argument set to true, do the same thing as when
386 called without arguments, and return true.
387
388 When invoked with the *blocking* argument set to false, do not block. If a call
389 without an argument would block, return false immediately; otherwise, do the
390 same thing as when called without arguments, and return true.
391
392
393.. method:: Lock.release()
394
395 Release a lock.
396
397 When the lock is locked, reset it to unlocked, and return. If any other threads
398 are blocked waiting for the lock to become unlocked, allow exactly one of them
399 to proceed.
400
401 Do not call this method when the lock is unlocked.
402
403 There is no return value.
404
405
406.. _rlock-objects:
407
408RLock Objects
409-------------
410
411A reentrant lock is a synchronization primitive that may be acquired multiple
412times by the same thread. Internally, it uses the concepts of "owning thread"
413and "recursion level" in addition to the locked/unlocked state used by primitive
414locks. In the locked state, some thread owns the lock; in the unlocked state,
415no thread owns it.
416
417To lock the lock, a thread calls its :meth:`acquire` method; this returns once
418the thread owns the lock. To unlock the lock, a thread calls its
419:meth:`release` method. :meth:`acquire`/:meth:`release` call pairs may be
420nested; only the final :meth:`release` (the :meth:`release` of the outermost
421pair) resets the lock to unlocked and allows another thread blocked in
422:meth:`acquire` to proceed.
423
424
425.. method:: RLock.acquire([blocking=1])
426
427 Acquire a lock, blocking or non-blocking.
428
429 When invoked without arguments: if this thread already owns the lock, increment
430 the recursion level by one, and return immediately. Otherwise, if another
431 thread owns the lock, block until the lock is unlocked. Once the lock is
432 unlocked (not owned by any thread), then grab ownership, set the recursion level
433 to one, and return. If more than one thread is blocked waiting until the lock
434 is unlocked, only one at a time will be able to grab ownership of the lock.
435 There is no return value in this case.
436
437 When invoked with the *blocking* argument set to true, do the same thing as when
438 called without arguments, and return true.
439
440 When invoked with the *blocking* argument set to false, do not block. If a call
441 without an argument would block, return false immediately; otherwise, do the
442 same thing as when called without arguments, and return true.
443
444
445.. method:: RLock.release()
446
447 Release a lock, decrementing the recursion level. If after the decrement it is
448 zero, reset the lock to unlocked (not owned by any thread), and if any other
449 threads are blocked waiting for the lock to become unlocked, allow exactly one
450 of them to proceed. If after the decrement the recursion level is still
451 nonzero, the lock remains locked and owned by the calling thread.
452
453 Only call this method when the calling thread owns the lock. A
454 :exc:`RuntimeError` is raised if this method is called when the lock is
455 unlocked.
456
457 There is no return value.
458
459
460.. _condition-objects:
461
462Condition Objects
463-----------------
464
465A condition variable is always associated with some kind of lock; this can be
466passed in or one will be created by default. (Passing one in is useful when
467several condition variables must share the same lock.)
468
469A condition variable has :meth:`acquire` and :meth:`release` methods that call
470the corresponding methods of the associated lock. It also has a :meth:`wait`
471method, and :meth:`notify` and :meth:`notifyAll` methods. These three must only
472be called when the calling thread has acquired the lock, otherwise a
473:exc:`RuntimeError` is raised.
474
475The :meth:`wait` method releases the lock, and then blocks until it is awakened
476by a :meth:`notify` or :meth:`notifyAll` call for the same condition variable in
477another thread. Once awakened, it re-acquires the lock and returns. It is also
478possible to specify a timeout.
479
480The :meth:`notify` method wakes up one of the threads waiting for the condition
481variable, if any are waiting. The :meth:`notifyAll` method wakes up all threads
482waiting for the condition variable.
483
484Note: the :meth:`notify` and :meth:`notifyAll` methods don't release the lock;
485this means that the thread or threads awakened will not return from their
486:meth:`wait` call immediately, but only when the thread that called
487:meth:`notify` or :meth:`notifyAll` finally relinquishes ownership of the lock.
488
489Tip: the typical programming style using condition variables uses the lock to
490synchronize access to some shared state; threads that are interested in a
491particular change of state call :meth:`wait` repeatedly until they see the
492desired state, while threads that modify the state call :meth:`notify` or
493:meth:`notifyAll` when they change the state in such a way that it could
494possibly be a desired state for one of the waiters. For example, the following
495code is a generic producer-consumer situation with unlimited buffer capacity::
496
497 # Consume one item
498 cv.acquire()
499 while not an_item_is_available():
500 cv.wait()
501 get_an_available_item()
502 cv.release()
503
504 # Produce one item
505 cv.acquire()
506 make_an_item_available()
507 cv.notify()
508 cv.release()
509
510To choose between :meth:`notify` and :meth:`notifyAll`, consider whether one
511state change can be interesting for only one or several waiting threads. E.g.
512in a typical producer-consumer situation, adding one item to the buffer only
513needs to wake up one consumer thread.
514
515
516.. class:: Condition([lock])
517
518 If the *lock* argument is given and not ``None``, it must be a :class:`Lock` or
519 :class:`RLock` object, and it is used as the underlying lock. Otherwise, a new
520 :class:`RLock` object is created and used as the underlying lock.
521
522
523.. method:: Condition.acquire(*args)
524
525 Acquire the underlying lock. This method calls the corresponding method on the
526 underlying lock; the return value is whatever that method returns.
527
528
529.. method:: Condition.release()
530
531 Release the underlying lock. This method calls the corresponding method on the
532 underlying lock; there is no return value.
533
534
535.. method:: Condition.wait([timeout])
536
537 Wait until notified or until a timeout occurs. If the calling thread has not
538 acquired the lock when this method is called, a :exc:`RuntimeError` is raised.
539
540 This method releases the underlying lock, and then blocks until it is awakened
541 by a :meth:`notify` or :meth:`notifyAll` call for the same condition variable in
542 another thread, or until the optional timeout occurs. Once awakened or timed
543 out, it re-acquires the lock and returns.
544
545 When the *timeout* argument is present and not ``None``, it should be a floating
546 point number specifying a timeout for the operation in seconds (or fractions
547 thereof).
548
549 When the underlying lock is an :class:`RLock`, it is not released using its
550 :meth:`release` method, since this may not actually unlock the lock when it was
551 acquired multiple times recursively. Instead, an internal interface of the
552 :class:`RLock` class is used, which really unlocks it even when it has been
553 recursively acquired several times. Another internal interface is then used to
554 restore the recursion level when the lock is reacquired.
555
556
557.. method:: Condition.notify()
558
Georg Brandl91e3f772009-04-28 18:18:53 +0000559 Wake up a thread waiting on this condition, if any. If the calling thread
560 has not acquired the lock when this method is called, a :exc:`RuntimeError`
561 is raised.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000562
Georg Brandl91e3f772009-04-28 18:18:53 +0000563 This method wakes up one of the threads waiting for the condition variable,
564 if any are waiting; it is a no-op if no threads are waiting.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000565
566 The current implementation wakes up exactly one thread, if any are waiting.
567 However, it's not safe to rely on this behavior. A future, optimized
568 implementation may occasionally wake up more than one thread.
569
570 Note: the awakened thread does not actually return from its :meth:`wait` call
571 until it can reacquire the lock. Since :meth:`notify` does not release the
572 lock, its caller should.
573
574
Benjamin Peterson0fbcf692008-06-11 17:27:50 +0000575.. method:: Condition.notify_all()
Benjamin Petersonf4395602008-06-11 17:50:00 +0000576 Condition.notifyAll()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000577
578 Wake up all threads waiting on this condition. This method acts like
579 :meth:`notify`, but wakes up all waiting threads instead of one. If the calling
580 thread has not acquired the lock when this method is called, a
581 :exc:`RuntimeError` is raised.
582
583
584.. _semaphore-objects:
585
586Semaphore Objects
587-----------------
588
589This is one of the oldest synchronization primitives in the history of computer
590science, invented by the early Dutch computer scientist Edsger W. Dijkstra (he
591used :meth:`P` and :meth:`V` instead of :meth:`acquire` and :meth:`release`).
592
593A semaphore manages an internal counter which is decremented by each
594:meth:`acquire` call and incremented by each :meth:`release` call. The counter
595can never go below zero; when :meth:`acquire` finds that it is zero, it blocks,
596waiting until some other thread calls :meth:`release`.
597
598
599.. class:: Semaphore([value])
600
601 The optional argument gives the initial *value* for the internal counter; it
602 defaults to ``1``. If the *value* given is less than 0, :exc:`ValueError` is
603 raised.
604
605
606.. method:: Semaphore.acquire([blocking])
607
608 Acquire a semaphore.
609
610 When invoked without arguments: if the internal counter is larger than zero on
611 entry, decrement it by one and return immediately. If it is zero on entry,
612 block, waiting until some other thread has called :meth:`release` to make it
613 larger than zero. This is done with proper interlocking so that if multiple
614 :meth:`acquire` calls are blocked, :meth:`release` will wake exactly one of them
615 up. The implementation may pick one at random, so the order in which blocked
616 threads are awakened should not be relied on. There is no return value in this
617 case.
618
619 When invoked with *blocking* set to true, do the same thing as when called
620 without arguments, and return true.
621
622 When invoked with *blocking* set to false, do not block. If a call without an
623 argument would block, return false immediately; otherwise, do the same thing as
624 when called without arguments, and return true.
625
626
627.. method:: Semaphore.release()
628
629 Release a semaphore, incrementing the internal counter by one. When it was zero
630 on entry and another thread is waiting for it to become larger than zero again,
631 wake up that thread.
632
633
634.. _semaphore-examples:
635
636:class:`Semaphore` Example
637^^^^^^^^^^^^^^^^^^^^^^^^^^
638
639Semaphores are often used to guard resources with limited capacity, for example,
640a database server. In any situation where the size of the resource size is
641fixed, you should use a bounded semaphore. Before spawning any worker threads,
642your main thread would initialize the semaphore::
643
644 maxconnections = 5
645 ...
646 pool_sema = BoundedSemaphore(value=maxconnections)
647
648Once spawned, worker threads call the semaphore's acquire and release methods
649when they need to connect to the server::
650
651 pool_sema.acquire()
652 conn = connectdb()
653 ... use connection ...
654 conn.close()
655 pool_sema.release()
656
657The use of a bounded semaphore reduces the chance that a programming error which
658causes the semaphore to be released more than it's acquired will go undetected.
659
660
661.. _event-objects:
662
663Event Objects
664-------------
665
666This is one of the simplest mechanisms for communication between threads: one
667thread signals an event and other threads wait for it.
668
669An event object manages an internal flag that can be set to true with the
Georg Brandl0dfdf002009-10-27 14:36:50 +0000670:meth:`~Event.set` method and reset to false with the :meth:`clear` method. The
Georg Brandl8ec7f652007-08-15 14:28:01 +0000671:meth:`wait` method blocks until the flag is true.
672
673
674.. class:: Event()
675
676 The internal flag is initially false.
677
678
Benjamin Petersonf4395602008-06-11 17:50:00 +0000679.. method:: Event.is_set()
680 Event.isSet()
Georg Brandl8ec7f652007-08-15 14:28:01 +0000681
682 Return true if and only if the internal flag is true.
683
684
685.. method:: Event.set()
686
687 Set the internal flag to true. All threads waiting for it to become true are
688 awakened. Threads that call :meth:`wait` once the flag is true will not block at
689 all.
690
691
692.. method:: Event.clear()
693
694 Reset the internal flag to false. Subsequently, threads calling :meth:`wait`
Georg Brandl0dfdf002009-10-27 14:36:50 +0000695 will block until :meth:`.set` is called to set the internal flag to true
696 again.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000697
698
699.. method:: Event.wait([timeout])
700
Georg Brandl0dfdf002009-10-27 14:36:50 +0000701 Block until the internal flag is true. If the internal flag is true on
702 entry, return immediately. Otherwise, block until another thread calls
703 :meth:`.set` to set the flag to true, or until the optional timeout occurs.
Georg Brandl8ec7f652007-08-15 14:28:01 +0000704
705 When the timeout argument is present and not ``None``, it should be a floating
706 point number specifying a timeout for the operation in seconds (or fractions
707 thereof).
708
709
Georg Brandl8ec7f652007-08-15 14:28:01 +0000710.. _timer-objects:
711
712Timer Objects
713-------------
714
715This class represents an action that should be run only after a certain amount
716of time has passed --- a timer. :class:`Timer` is a subclass of :class:`Thread`
717and as such also functions as an example of creating custom threads.
718
719Timers are started, as with threads, by calling their :meth:`start` method. The
720timer can be stopped (before its action has begun) by calling the :meth:`cancel`
721method. The interval the timer will wait before executing its action may not be
722exactly the same as the interval specified by the user.
723
724For example::
725
726 def hello():
727 print "hello, world"
728
729 t = Timer(30.0, hello)
730 t.start() # after 30 seconds, "hello, world" will be printed
731
732
733.. class:: Timer(interval, function, args=[], kwargs={})
734
735 Create a timer that will run *function* with arguments *args* and keyword
736 arguments *kwargs*, after *interval* seconds have passed.
737
738
739.. method:: Timer.cancel()
740
741 Stop the timer, and cancel the execution of the timer's action. This will only
742 work if the timer is still in its waiting stage.
743
744
745.. _with-locks:
746
747Using locks, conditions, and semaphores in the :keyword:`with` statement
748------------------------------------------------------------------------
749
750All of the objects provided by this module that have :meth:`acquire` and
751:meth:`release` methods can be used as context managers for a :keyword:`with`
752statement. The :meth:`acquire` method will be called when the block is entered,
753and :meth:`release` will be called when the block is exited.
754
755Currently, :class:`Lock`, :class:`RLock`, :class:`Condition`,
756:class:`Semaphore`, and :class:`BoundedSemaphore` objects may be used as
757:keyword:`with` statement context managers. For example::
758
Georg Brandl8ec7f652007-08-15 14:28:01 +0000759 import threading
760
761 some_rlock = threading.RLock()
762
763 with some_rlock:
764 print "some_rlock is locked while this executes"
765
Georg Brandl2e255512008-03-13 07:21:41 +0000766
767.. _threaded-imports:
768
769Importing in threaded code
770--------------------------
771
772While the import machinery is thread safe, there are two key
773restrictions on threaded imports due to inherent limitations in the way
774that thread safety is provided:
775
776* Firstly, other than in the main module, an import should not have the
777 side effect of spawning a new thread and then waiting for that thread in
778 any way. Failing to abide by this restriction can lead to a deadlock if
779 the spawned thread directly or indirectly attempts to import a module.
780* Secondly, all import attempts must be completed before the interpreter
781 starts shutting itself down. This can be most easily achieved by only
782 performing imports from non-daemon threads created through the threading
783 module. Daemon threads and threads created directly with the thread
784 module will require some other form of synchronization to ensure they do
785 not attempt imports after system shutdown has commenced. Failure to
786 abide by this restriction will lead to intermittent exceptions and
787 crashes during interpreter shutdown (as the late imports attempt to
788 access machinery which is no longer in a valid state).