blob: 6515cdbc8d32978bfc8868cdc207de34821f726c [file] [log] [blame]
Serhiy Storchaka2b57c432018-12-19 08:09:46 +02001:mod:`!importlib` --- The implementation of :keyword:`!import`
2==============================================================
Brett Cannonafccd632009-01-20 02:21:27 +00003
4.. module:: importlib
Brett Cannon07fbd782014-02-06 09:46:08 -05005 :synopsis: The implementation of the import machinery.
Brett Cannonafccd632009-01-20 02:21:27 +00006
7.. moduleauthor:: Brett Cannon <brett@python.org>
8.. sectionauthor:: Brett Cannon <brett@python.org>
9
10.. versionadded:: 3.1
11
Terry Jan Reedyfa089b92016-06-11 15:02:54 -040012**Source code:** :source:`Lib/importlib/__init__.py`
13
14--------------
Brett Cannonafccd632009-01-20 02:21:27 +000015
16Introduction
17------------
18
Brett Cannon07fbd782014-02-06 09:46:08 -050019The purpose of the :mod:`importlib` package is two-fold. One is to provide the
Brett Cannonafccd632009-01-20 02:21:27 +000020implementation of the :keyword:`import` statement (and thus, by extension, the
21:func:`__import__` function) in Python source code. This provides an
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020022implementation of :keyword:`!import` which is portable to any Python
Brett Cannon07fbd782014-02-06 09:46:08 -050023interpreter. This also provides an implementation which is easier to
Brett Cannonf23e3742010-06-27 23:57:46 +000024comprehend than one implemented in a programming language other than Python.
Brett Cannonafccd632009-01-20 02:21:27 +000025
Brett Cannonf23e3742010-06-27 23:57:46 +000026Two, the components to implement :keyword:`import` are exposed in this
Brett Cannonafccd632009-01-20 02:21:27 +000027package, making it easier for users to create their own custom objects (known
Brett Cannondebb98d2009-02-16 04:18:01 +000028generically as an :term:`importer`) to participate in the import process.
Brett Cannonafccd632009-01-20 02:21:27 +000029
30.. seealso::
31
32 :ref:`import`
33 The language reference for the :keyword:`import` statement.
34
Benjamin Peterson60dbed12017-09-05 16:24:39 -070035 `Packages specification <https://www.python.org/doc/essays/packages/>`__
Brett Cannonafccd632009-01-20 02:21:27 +000036 Original specification of packages. Some semantics have changed since
Georg Brandl375aec22011-01-15 17:03:02 +000037 the writing of this document (e.g. redirecting based on ``None``
Brett Cannonafccd632009-01-20 02:21:27 +000038 in :data:`sys.modules`).
39
40 The :func:`.__import__` function
Brett Cannon0e13c942010-06-29 18:26:11 +000041 The :keyword:`import` statement is syntactic sugar for this function.
Brett Cannonafccd632009-01-20 02:21:27 +000042
43 :pep:`235`
44 Import on Case-Insensitive Platforms
45
46 :pep:`263`
47 Defining Python Source Code Encodings
48
49 :pep:`302`
Brett Cannonf23e3742010-06-27 23:57:46 +000050 New Import Hooks
Brett Cannonafccd632009-01-20 02:21:27 +000051
52 :pep:`328`
53 Imports: Multi-Line and Absolute/Relative
54
55 :pep:`366`
56 Main module explicit relative imports
57
Eric Snow338502b2016-05-28 11:56:53 -060058 :pep:`420`
59 Implicit namespace packages
60
Brett Cannon07fbd782014-02-06 09:46:08 -050061 :pep:`451`
62 A ModuleSpec Type for the Import System
63
Nick Coghland5cacbb2015-05-23 22:24:10 +100064 :pep:`488`
65 Elimination of PYO files
66
67 :pep:`489`
68 Multi-phase extension module initialization
69
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080070 :pep:`552`
71 Deterministic pycs
72
Brett Cannon8917d5e2010-01-13 19:21:00 +000073 :pep:`3120`
Brett Cannonafccd632009-01-20 02:21:27 +000074 Using UTF-8 as the Default Source Encoding
75
Brett Cannon30b7a902010-06-27 21:49:22 +000076 :pep:`3147`
77 PYC Repository Directories
78
Brett Cannonafccd632009-01-20 02:21:27 +000079
80Functions
81---------
82
Brett Cannoncb4996a2012-08-06 16:34:44 -040083.. function:: __import__(name, globals=None, locals=None, fromlist=(), level=0)
Brett Cannonafccd632009-01-20 02:21:27 +000084
Brett Cannonf23e3742010-06-27 23:57:46 +000085 An implementation of the built-in :func:`__import__` function.
Brett Cannonafccd632009-01-20 02:21:27 +000086
Brett Cannon3fa84222015-02-20 10:34:20 -050087 .. note::
88 Programmatic importing of modules should use :func:`import_module`
89 instead of this function.
90
Brett Cannonafccd632009-01-20 02:21:27 +000091.. function:: import_module(name, package=None)
92
Brett Cannon33418c82009-01-22 18:37:20 +000093 Import a module. The *name* argument specifies what module to
Brett Cannonafccd632009-01-20 02:21:27 +000094 import in absolute or relative terms
95 (e.g. either ``pkg.mod`` or ``..mod``). If the name is
Guido van Rossum09613542009-03-30 20:34:57 +000096 specified in relative terms, then the *package* argument must be set to
97 the name of the package which is to act as the anchor for resolving the
Brett Cannonafccd632009-01-20 02:21:27 +000098 package name (e.g. ``import_module('..mod', 'pkg.subpkg')`` will import
Brett Cannon2c318a12009-02-07 01:15:27 +000099 ``pkg.mod``).
Brett Cannon78246b62009-01-25 04:56:30 +0000100
Brett Cannon2c318a12009-02-07 01:15:27 +0000101 The :func:`import_module` function acts as a simplifying wrapper around
Brett Cannon9f4cb1c2009-04-01 23:26:47 +0000102 :func:`importlib.__import__`. This means all semantics of the function are
Brett Cannon3fa84222015-02-20 10:34:20 -0500103 derived from :func:`importlib.__import__`. The most important difference
104 between these two functions is that :func:`import_module` returns the
105 specified package or module (e.g. ``pkg.mod``), while :func:`__import__`
106 returns the top-level package or module (e.g. ``pkg``).
107
108 If you are dynamically importing a module that was created since the
109 interpreter began execution (e.g., created a Python source file), you may
110 need to call :func:`invalidate_caches` in order for the new module to be
111 noticed by the import system.
Guido van Rossum09613542009-03-30 20:34:57 +0000112
Brett Cannon98620d82013-12-13 13:57:41 -0500113 .. versionchanged:: 3.3
114 Parent packages are automatically imported.
115
Brett Cannonee78a2b2012-05-12 17:43:17 -0400116.. function:: find_loader(name, path=None)
117
118 Find the loader for a module, optionally within the specified *path*. If the
119 module is in :attr:`sys.modules`, then ``sys.modules[name].__loader__`` is
Brett Cannon32799232013-03-13 11:09:08 -0700120 returned (unless the loader would be ``None`` or is not set, in which case
Brett Cannonee78a2b2012-05-12 17:43:17 -0400121 :exc:`ValueError` is raised). Otherwise a search using :attr:`sys.meta_path`
122 is done. ``None`` is returned if no loader is found.
123
Benjamin Petersonf7e2ea22016-09-05 14:02:59 -0700124 A dotted name does not have its parents implicitly imported as that requires
Brett Cannon56b4ca72012-11-17 09:30:55 -0500125 loading them and that may not be desired. To properly import a submodule you
126 will need to import all parent packages of the submodule and use the correct
127 argument to *path*.
Brett Cannonee78a2b2012-05-12 17:43:17 -0400128
Brett Cannon32799232013-03-13 11:09:08 -0700129 .. versionadded:: 3.3
130
131 .. versionchanged:: 3.4
132 If ``__loader__`` is not set, raise :exc:`ValueError`, just like when the
133 attribute is set to ``None``.
134
Eric Snowca2d8542013-12-16 23:06:52 -0700135 .. deprecated:: 3.4
Eric Snow6029e082014-01-25 15:32:46 -0700136 Use :func:`importlib.util.find_spec` instead.
Eric Snowca2d8542013-12-16 23:06:52 -0700137
Antoine Pitrouc541f8e2012-02-20 01:48:16 +0100138.. function:: invalidate_caches()
139
Brett Cannonf4dc9202012-08-10 12:21:12 -0400140 Invalidate the internal caches of finders stored at
141 :data:`sys.meta_path`. If a finder implements ``invalidate_caches()`` then it
Brett Cannon4067aa22013-04-27 23:20:32 -0400142 will be called to perform the invalidation. This function should be called
143 if any modules are created/installed while your program is running to
144 guarantee all finders will notice the new module's existence.
Antoine Pitrouc541f8e2012-02-20 01:48:16 +0100145
146 .. versionadded:: 3.3
147
Brett Cannon3fe35e62013-06-14 15:04:26 -0400148.. function:: reload(module)
149
150 Reload a previously imported *module*. The argument must be a module object,
151 so it must have been successfully imported before. This is useful if you
152 have edited the module source file using an external editor and want to try
153 out the new version without leaving the Python interpreter. The return value
Brett Cannon8ad37862013-10-25 13:52:46 -0400154 is the module object (which can be different if re-importing causes a
155 different object to be placed in :data:`sys.modules`).
Brett Cannon3fe35e62013-06-14 15:04:26 -0400156
Brett Cannon8ad37862013-10-25 13:52:46 -0400157 When :func:`reload` is executed:
Brett Cannon3fe35e62013-06-14 15:04:26 -0400158
Larry Hastings3732ed22014-03-15 21:13:56 -0700159 * Python module's code is recompiled and the module-level code re-executed,
Brett Cannon3fe35e62013-06-14 15:04:26 -0400160 defining a new set of objects which are bound to names in the module's
161 dictionary by reusing the :term:`loader` which originally loaded the
162 module. The ``init`` function of extension modules is not called a second
163 time.
164
165 * As with all other objects in Python the old objects are only reclaimed
166 after their reference counts drop to zero.
167
168 * The names in the module namespace are updated to point to any new or
169 changed objects.
170
171 * Other references to the old objects (such as names external to the module) are
172 not rebound to refer to the new objects and must be updated in each namespace
173 where they occur if that is desired.
174
175 There are a number of other caveats:
176
Brett Cannon3fe35e62013-06-14 15:04:26 -0400177 When a module is reloaded, its dictionary (containing the module's global
178 variables) is retained. Redefinitions of names will override the old
179 definitions, so this is generally not a problem. If the new version of a
180 module does not define a name that was defined by the old version, the old
181 definition remains. This feature can be used to the module's advantage if it
182 maintains a global table or cache of objects --- with a :keyword:`try`
183 statement it can test for the table's presence and skip its initialization if
184 desired::
185
186 try:
187 cache
188 except NameError:
189 cache = {}
190
Robert Collins1ae28d22015-08-05 08:20:53 +1200191 It is generally not very useful to reload built-in or dynamically loaded
192 modules. Reloading :mod:`sys`, :mod:`__main__`, :mod:`builtins` and other
193 key modules is not recommended. In many cases extension modules are not
194 designed to be initialized more than once, and may fail in arbitrary ways
195 when reloaded.
Brett Cannon3fe35e62013-06-14 15:04:26 -0400196
197 If a module imports objects from another module using :keyword:`from` ...
198 :keyword:`import` ..., calling :func:`reload` for the other module does not
199 redefine the objects imported from it --- one way around this is to
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200200 re-execute the :keyword:`!from` statement, another is to use :keyword:`!import`
Brett Cannon3fe35e62013-06-14 15:04:26 -0400201 and qualified names (*module.name*) instead.
202
203 If a module instantiates instances of a class, reloading the module that
204 defines the class does not affect the method definitions of the instances ---
205 they continue to use the old class definition. The same is true for derived
206 classes.
207
208 .. versionadded:: 3.4
Garvit Khatri94987822017-05-25 03:49:50 +0530209 .. versionchanged:: 3.7
210 :exc:`ModuleNotFoundError` is raised when the module being reloaded lacks
Brett Cannon9cb31d62021-03-24 08:26:56 -0700211 a :class:`~importlib.machinery.ModuleSpec`.
Brett Cannon3fe35e62013-06-14 15:04:26 -0400212
Brett Cannon78246b62009-01-25 04:56:30 +0000213
Brett Cannon2a922ed2009-03-09 03:35:50 +0000214:mod:`importlib.abc` -- Abstract base classes related to import
215---------------------------------------------------------------
216
217.. module:: importlib.abc
218 :synopsis: Abstract base classes related to import
219
Terry Jan Reedydcb6c882016-06-22 22:46:34 -0400220**Source code:** :source:`Lib/importlib/abc.py`
221
222--------------
223
224
Brett Cannon2a922ed2009-03-09 03:35:50 +0000225The :mod:`importlib.abc` module contains all of the core abstract base classes
226used by :keyword:`import`. Some subclasses of the core abstract base classes
227are also provided to help in implementing the core ABCs.
228
Andrew Svetlova8656542012-08-13 22:19:01 +0300229ABC hierarchy::
230
231 object
Brett Cannon1b799182012-08-17 14:08:24 -0400232 +-- Finder (deprecated)
Andrew Svetlova8656542012-08-13 22:19:01 +0300233 | +-- MetaPathFinder
234 | +-- PathEntryFinder
235 +-- Loader
236 +-- ResourceLoader --------+
237 +-- InspectLoader |
238 +-- ExecutionLoader --+
239 +-- FileLoader
240 +-- SourceLoader
Andrew Svetlova8656542012-08-13 22:19:01 +0300241
Brett Cannon2a922ed2009-03-09 03:35:50 +0000242
243.. class:: Finder
244
Brett Cannon1b799182012-08-17 14:08:24 -0400245 An abstract base class representing a :term:`finder`.
246
247 .. deprecated:: 3.3
248 Use :class:`MetaPathFinder` or :class:`PathEntryFinder` instead.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000249
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200250 .. abstractmethod:: find_module(fullname, path=None)
Brett Cannonb46a1792012-02-27 18:15:42 -0500251
Xtreakc151f782018-06-16 10:38:31 +0530252 An abstract method for finding a :term:`loader` for the specified
Brett Cannonf4dc9202012-08-10 12:21:12 -0400253 module. Originally specified in :pep:`302`, this method was meant
254 for use in :data:`sys.meta_path` and in the path-based import subsystem.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000255
Brett Cannon100883f2013-04-09 16:59:39 -0400256 .. versionchanged:: 3.4
257 Returns ``None`` when called instead of raising
258 :exc:`NotImplementedError`.
259
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000260
Brett Cannon077ef452012-08-02 17:50:06 -0400261.. class:: MetaPathFinder
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000262
Brett Cannonf4dc9202012-08-10 12:21:12 -0400263 An abstract base class representing a :term:`meta path finder`. For
264 compatibility, this is a subclass of :class:`Finder`.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000265
266 .. versionadded:: 3.3
267
Eric Snowca2d8542013-12-16 23:06:52 -0700268 .. method:: find_spec(fullname, path, target=None)
269
270 An abstract method for finding a :term:`spec <module spec>` for
271 the specified module. If this is a top-level import, *path* will
272 be ``None``. Otherwise, this is a search for a subpackage or
273 module and *path* will be the value of :attr:`__path__` from the
274 parent package. If a spec cannot be found, ``None`` is returned.
275 When passed in, ``target`` is a module object that the finder may
Brett Cannona85e9272016-01-08 14:33:09 -0800276 use to make a more educated guess about what spec to return.
jdkandersson9cbb97b2019-09-11 02:06:22 +1000277 :func:`importlib.util.spec_from_loader` may be useful for implementing
278 concrete ``MetaPathFinders``.
Eric Snowca2d8542013-12-16 23:06:52 -0700279
280 .. versionadded:: 3.4
281
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000282 .. method:: find_module(fullname, path)
283
Eric Snowca2d8542013-12-16 23:06:52 -0700284 A legacy method for finding a :term:`loader` for the specified
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000285 module. If this is a top-level import, *path* will be ``None``.
Ezio Melotti1f67e802012-10-21 07:24:13 +0300286 Otherwise, this is a search for a subpackage or module and *path*
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000287 will be the value of :attr:`__path__` from the parent
288 package. If a loader cannot be found, ``None`` is returned.
289
Brett Cannon8d942292014-01-07 15:52:42 -0500290 If :meth:`find_spec` is defined, backwards-compatible functionality is
291 provided.
292
Brett Cannon100883f2013-04-09 16:59:39 -0400293 .. versionchanged:: 3.4
294 Returns ``None`` when called instead of raising
Brett Cannon8d942292014-01-07 15:52:42 -0500295 :exc:`NotImplementedError`. Can use :meth:`find_spec` to provide
296 functionality.
Brett Cannon100883f2013-04-09 16:59:39 -0400297
Eric Snowca2d8542013-12-16 23:06:52 -0700298 .. deprecated:: 3.4
299 Use :meth:`find_spec` instead.
300
Brett Cannonf4dc9202012-08-10 12:21:12 -0400301 .. method:: invalidate_caches()
302
303 An optional method which, when called, should invalidate any internal
Brett Cannona6e85812012-08-11 19:41:27 -0400304 cache used by the finder. Used by :func:`importlib.invalidate_caches`
305 when invalidating the caches of all finders on :data:`sys.meta_path`.
Brett Cannonf4dc9202012-08-10 12:21:12 -0400306
Brett Cannon100883f2013-04-09 16:59:39 -0400307 .. versionchanged:: 3.4
308 Returns ``None`` when called instead of ``NotImplemented``.
309
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000310
Brett Cannon077ef452012-08-02 17:50:06 -0400311.. class:: PathEntryFinder
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000312
Brett Cannonf4dc9202012-08-10 12:21:12 -0400313 An abstract base class representing a :term:`path entry finder`. Though
314 it bears some similarities to :class:`MetaPathFinder`, ``PathEntryFinder``
315 is meant for use only within the path-based import subsystem provided
316 by :class:`PathFinder`. This ABC is a subclass of :class:`Finder` for
Brett Cannon100883f2013-04-09 16:59:39 -0400317 compatibility reasons only.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000318
319 .. versionadded:: 3.3
320
Eric Snowca2d8542013-12-16 23:06:52 -0700321 .. method:: find_spec(fullname, target=None)
322
323 An abstract method for finding a :term:`spec <module spec>` for
324 the specified module. The finder will search for the module only
325 within the :term:`path entry` to which it is assigned. If a spec
326 cannot be found, ``None`` is returned. When passed in, ``target``
327 is a module object that the finder may use to make a more educated
jdkandersson9cbb97b2019-09-11 02:06:22 +1000328 guess about what spec to return. :func:`importlib.util.spec_from_loader`
329 may be useful for implementing concrete ``PathEntryFinders``.
Eric Snowca2d8542013-12-16 23:06:52 -0700330
331 .. versionadded:: 3.4
332
Brett Cannon4067aa22013-04-27 23:20:32 -0400333 .. method:: find_loader(fullname)
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000334
Eric Snowca2d8542013-12-16 23:06:52 -0700335 A legacy method for finding a :term:`loader` for the specified
Brett Cannonf4dc9202012-08-10 12:21:12 -0400336 module. Returns a 2-tuple of ``(loader, portion)`` where ``portion``
337 is a sequence of file system locations contributing to part of a namespace
338 package. The loader may be ``None`` while specifying ``portion`` to
339 signify the contribution of the file system locations to a namespace
340 package. An empty list can be used for ``portion`` to signify the loader
Brett Cannon100883f2013-04-09 16:59:39 -0400341 is not part of a namespace package. If ``loader`` is ``None`` and
342 ``portion`` is the empty list then no loader or location for a namespace
343 package were found (i.e. failure to find anything for the module).
344
Brett Cannon8d942292014-01-07 15:52:42 -0500345 If :meth:`find_spec` is defined then backwards-compatible functionality is
346 provided.
347
Brett Cannon100883f2013-04-09 16:59:39 -0400348 .. versionchanged:: 3.4
349 Returns ``(None, [])`` instead of raising :exc:`NotImplementedError`.
Brett Cannon8d942292014-01-07 15:52:42 -0500350 Uses :meth:`find_spec` when available to provide functionality.
Brett Cannonf4dc9202012-08-10 12:21:12 -0400351
Eric Snowca2d8542013-12-16 23:06:52 -0700352 .. deprecated:: 3.4
353 Use :meth:`find_spec` instead.
354
Brett Cannon4067aa22013-04-27 23:20:32 -0400355 .. method:: find_module(fullname)
Brett Cannonf4dc9202012-08-10 12:21:12 -0400356
357 A concrete implementation of :meth:`Finder.find_module` which is
358 equivalent to ``self.find_loader(fullname)[0]``.
359
Eric Snowca2d8542013-12-16 23:06:52 -0700360 .. deprecated:: 3.4
361 Use :meth:`find_spec` instead.
362
Brett Cannonf4dc9202012-08-10 12:21:12 -0400363 .. method:: invalidate_caches()
364
365 An optional method which, when called, should invalidate any internal
Brett Cannona6e85812012-08-11 19:41:27 -0400366 cache used by the finder. Used by :meth:`PathFinder.invalidate_caches`
Brett Cannonf4dc9202012-08-10 12:21:12 -0400367 when invalidating the caches of all cached finders.
Brett Cannonb46a1792012-02-27 18:15:42 -0500368
Brett Cannon2a922ed2009-03-09 03:35:50 +0000369
370.. class:: Loader
371
372 An abstract base class for a :term:`loader`.
Guido van Rossum09613542009-03-30 20:34:57 +0000373 See :pep:`302` for the exact definition for a loader.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000374
Barry Warsaw997b8c12018-02-16 10:45:39 -0500375 Loaders that wish to support resource reading should implement a
376 ``get_resource_reader(fullname)`` method as specified by
377 :class:`importlib.abc.ResourceReader`.
Brett Cannonbca42182018-01-12 15:08:59 -0800378
379 .. versionchanged:: 3.7
380 Introduced the optional ``get_resource_reader()`` method.
381
Eric Snowca2d8542013-12-16 23:06:52 -0700382 .. method:: create_module(spec)
383
Brett Cannon02d84542015-01-09 11:39:21 -0500384 A method that returns the module object to use when
385 importing a module. This method may return ``None``,
386 indicating that default module creation semantics should take place.
Eric Snowca2d8542013-12-16 23:06:52 -0700387
388 .. versionadded:: 3.4
389
Brett Cannon02d84542015-01-09 11:39:21 -0500390 .. versionchanged:: 3.5
391 Starting in Python 3.6, this method will not be optional when
392 :meth:`exec_module` is defined.
393
Eric Snowca2d8542013-12-16 23:06:52 -0700394 .. method:: exec_module(module)
395
396 An abstract method that executes the module in its own namespace
397 when a module is imported or reloaded. The module should already
Brett Cannon696c35e2016-06-25 10:58:17 -0700398 be initialized when ``exec_module()`` is called. When this method exists,
399 :meth:`~importlib.abc.Loader.create_module` must be defined.
Eric Snowca2d8542013-12-16 23:06:52 -0700400
401 .. versionadded:: 3.4
402
Brett Cannon696c35e2016-06-25 10:58:17 -0700403 .. versionchanged:: 3.6
404 :meth:`~importlib.abc.Loader.create_module` must also be defined.
405
Brett Cannon9c751b72009-03-09 16:28:16 +0000406 .. method:: load_module(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000407
Eric Snowca2d8542013-12-16 23:06:52 -0700408 A legacy method for loading a module. If the module cannot be
Brett Cannon2a922ed2009-03-09 03:35:50 +0000409 loaded, :exc:`ImportError` is raised, otherwise the loaded module is
410 returned.
411
Guido van Rossum09613542009-03-30 20:34:57 +0000412 If the requested module already exists in :data:`sys.modules`, that
Brett Cannon2a922ed2009-03-09 03:35:50 +0000413 module should be used and reloaded.
Guido van Rossum09613542009-03-30 20:34:57 +0000414 Otherwise the loader should create a new module and insert it into
415 :data:`sys.modules` before any loading begins, to prevent recursion
416 from the import. If the loader inserted a module and the load fails, it
Brett Cannon2a922ed2009-03-09 03:35:50 +0000417 must be removed by the loader from :data:`sys.modules`; modules already
418 in :data:`sys.modules` before the loader began execution should be left
Eric Snowb523f842013-11-22 09:05:39 -0700419 alone (see :func:`importlib.util.module_for_loader`).
Brett Cannon2a922ed2009-03-09 03:35:50 +0000420
Guido van Rossum09613542009-03-30 20:34:57 +0000421 The loader should set several attributes on the module.
422 (Note that some of these attributes can change when a module is
Eric Snowb523f842013-11-22 09:05:39 -0700423 reloaded):
Brett Cannon2a922ed2009-03-09 03:35:50 +0000424
425 - :attr:`__name__`
426 The name of the module.
427
428 - :attr:`__file__`
429 The path to where the module data is stored (not set for built-in
430 modules).
431
Brett Cannon2cefb3c2013-05-25 11:26:11 -0400432 - :attr:`__cached__`
433 The path to where a compiled version of the module is/should be
434 stored (not set when the attribute would be inappropriate).
435
Brett Cannon2a922ed2009-03-09 03:35:50 +0000436 - :attr:`__path__`
Guido van Rossum09613542009-03-30 20:34:57 +0000437 A list of strings specifying the search path within a
Brett Cannon2a922ed2009-03-09 03:35:50 +0000438 package. This attribute is not set on modules.
439
440 - :attr:`__package__`
Géry Ogam27f1bd82020-10-21 23:17:35 +0200441 The fully-qualified name of the package under which the module was
442 loaded as a submodule (or the empty string for top-level modules).
443 For packages, it is the same as :attr:`__name__`. The
Brett Cannon100883f2013-04-09 16:59:39 -0400444 :func:`importlib.util.module_for_loader` decorator can handle the
445 details for :attr:`__package__`.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000446
447 - :attr:`__loader__`
Brett Cannon100883f2013-04-09 16:59:39 -0400448 The loader used to load the module. The
449 :func:`importlib.util.module_for_loader` decorator can handle the
450 details for :attr:`__package__`.
451
Brett Cannon8d942292014-01-07 15:52:42 -0500452 When :meth:`exec_module` is available then backwards-compatible
453 functionality is provided.
454
Brett Cannon100883f2013-04-09 16:59:39 -0400455 .. versionchanged:: 3.4
456 Raise :exc:`ImportError` when called instead of
Brett Cannon8d942292014-01-07 15:52:42 -0500457 :exc:`NotImplementedError`. Functionality provided when
458 :meth:`exec_module` is available.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000459
Eric Snowca2d8542013-12-16 23:06:52 -0700460 .. deprecated:: 3.4
461 The recommended API for loading a module is :meth:`exec_module`
Brett Cannon02d84542015-01-09 11:39:21 -0500462 (and :meth:`create_module`). Loaders should implement
Eric Snowca2d8542013-12-16 23:06:52 -0700463 it instead of load_module(). The import machinery takes care of
464 all the other responsibilities of load_module() when exec_module()
465 is implemented.
466
Barry Warsawd7d21942012-07-29 16:36:17 -0400467 .. method:: module_repr(module)
468
Eric Snowca2d8542013-12-16 23:06:52 -0700469 A legacy method which when implemented calculates and returns the
Brett Cannon100883f2013-04-09 16:59:39 -0400470 given module's repr, as a string. The module type's default repr() will
471 use the result of this method as appropriate.
Barry Warsawd7d21942012-07-29 16:36:17 -0400472
Georg Brandl526575d2013-04-11 16:10:13 +0200473 .. versionadded:: 3.3
Barry Warsawd7d21942012-07-29 16:36:17 -0400474
Brett Cannon100883f2013-04-09 16:59:39 -0400475 .. versionchanged:: 3.4
Georg Brandl526575d2013-04-11 16:10:13 +0200476 Made optional instead of an abstractmethod.
Brett Cannon100883f2013-04-09 16:59:39 -0400477
Eric Snowca2d8542013-12-16 23:06:52 -0700478 .. deprecated:: 3.4
479 The import machinery now takes care of this automatically.
480
Brett Cannon2a922ed2009-03-09 03:35:50 +0000481
Brett Cannon4ac51502017-12-15 16:29:35 -0800482.. class:: ResourceReader
483
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400484 *Superseded by TraversableReader*
485
Brett Cannonbca42182018-01-12 15:08:59 -0800486 An :term:`abstract base class` to provide the ability to read
Brett Cannon4ac51502017-12-15 16:29:35 -0800487 *resources*.
488
489 From the perspective of this ABC, a *resource* is a binary
490 artifact that is shipped within a package. Typically this is
491 something like a data file that lives next to the ``__init__.py``
492 file of the package. The purpose of this class is to help abstract
493 out the accessing of such data files so that it does not matter if
494 the package and its data file(s) are stored in a e.g. zip file
495 versus on the file system.
496
497 For any of methods of this class, a *resource* argument is
Barry Warsawdeae6b42017-12-30 15:18:06 -0500498 expected to be a :term:`path-like object` which represents
Brett Cannon4ac51502017-12-15 16:29:35 -0800499 conceptually just a file name. This means that no subdirectory
500 paths should be included in the *resource* argument. This is
Brett Cannonbca42182018-01-12 15:08:59 -0800501 because the location of the package the reader is for, acts as the
502 "directory". Hence the metaphor for directories and file
Brett Cannon4ac51502017-12-15 16:29:35 -0800503 names is packages and resources, respectively. This is also why
504 instances of this class are expected to directly correlate to
505 a specific package (instead of potentially representing multiple
506 packages or a module).
507
Brett Cannonbca42182018-01-12 15:08:59 -0800508 Loaders that wish to support resource reading are expected to
aldwinaldwinb607d992019-07-04 08:58:45 +0800509 provide a method called ``get_resource_reader(fullname)`` which
Brett Cannonbca42182018-01-12 15:08:59 -0800510 returns an object implementing this ABC's interface. If the module
511 specified by fullname is not a package, this method should return
512 :const:`None`. An object compatible with this ABC should only be
513 returned when the specified module is a package.
514
Brett Cannon4ac51502017-12-15 16:29:35 -0800515 .. versionadded:: 3.7
516
517 .. abstractmethod:: open_resource(resource)
518
519 Returns an opened, :term:`file-like object` for binary reading
520 of the *resource*.
521
522 If the resource cannot be found, :exc:`FileNotFoundError` is
523 raised.
524
525 .. abstractmethod:: resource_path(resource)
526
527 Returns the file system path to the *resource*.
528
529 If the resource does not concretely exist on the file system,
530 raise :exc:`FileNotFoundError`.
531
532 .. abstractmethod:: is_resource(name)
533
534 Returns ``True`` if the named *name* is considered a resource.
535 :exc:`FileNotFoundError` is raised if *name* does not exist.
536
537 .. abstractmethod:: contents()
538
Brett Cannon3ab93652018-04-30 11:31:45 -0700539 Returns an :term:`iterable` of strings over the contents of
Brett Cannon4ac51502017-12-15 16:29:35 -0800540 the package. Do note that it is not required that all names
541 returned by the iterator be actual resources, e.g. it is
542 acceptable to return names for which :meth:`is_resource` would
543 be false.
544
545 Allowing non-resource names to be returned is to allow for
546 situations where how a package and its resources are stored
547 are known a priori and the non-resource names would be useful.
548 For instance, returning subdirectory names is allowed so that
549 when it is known that the package and resources are stored on
Brett Cannonbca42182018-01-12 15:08:59 -0800550 the file system then those subdirectory names can be used
551 directly.
Brett Cannon4ac51502017-12-15 16:29:35 -0800552
Brett Cannon3ab93652018-04-30 11:31:45 -0700553 The abstract method returns an iterable of no items.
Brett Cannon4ac51502017-12-15 16:29:35 -0800554
555
Brett Cannon2a922ed2009-03-09 03:35:50 +0000556.. class:: ResourceLoader
557
558 An abstract base class for a :term:`loader` which implements the optional
559 :pep:`302` protocol for loading arbitrary resources from the storage
560 back-end.
561
Brett Cannonbca42182018-01-12 15:08:59 -0800562 .. deprecated:: 3.7
563 This ABC is deprecated in favour of supporting resource loading
564 through :class:`importlib.abc.ResourceReader`.
565
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200566 .. abstractmethod:: get_data(path)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000567
568 An abstract method to return the bytes for the data located at *path*.
Guido van Rossum09613542009-03-30 20:34:57 +0000569 Loaders that have a file-like storage back-end
Brett Cannon16248a42009-04-01 20:47:14 +0000570 that allows storing arbitrary data
Guido van Rossum09613542009-03-30 20:34:57 +0000571 can implement this abstract method to give direct access
Andrew Svetlov08af0002014-04-01 01:13:30 +0300572 to the data stored. :exc:`OSError` is to be raised if the *path* cannot
Brett Cannon2a922ed2009-03-09 03:35:50 +0000573 be found. The *path* is expected to be constructed using a module's
Brett Cannon16248a42009-04-01 20:47:14 +0000574 :attr:`__file__` attribute or an item from a package's :attr:`__path__`.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000575
Brett Cannon100883f2013-04-09 16:59:39 -0400576 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300577 Raises :exc:`OSError` instead of :exc:`NotImplementedError`.
Brett Cannon100883f2013-04-09 16:59:39 -0400578
Brett Cannon2a922ed2009-03-09 03:35:50 +0000579
580.. class:: InspectLoader
581
582 An abstract base class for a :term:`loader` which implements the optional
Guido van Rossum09613542009-03-30 20:34:57 +0000583 :pep:`302` protocol for loaders that inspect modules.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000584
Brett Cannona113ac52009-03-15 01:41:33 +0000585 .. method:: get_code(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000586
R David Murray0ae7ae12014-01-08 18:16:02 -0500587 Return the code object for a module, or ``None`` if the module does not
588 have a code object (as would be the case, for example, for a built-in
589 module). Raise an :exc:`ImportError` if loader cannot find the
590 requested module.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000591
Brett Cannon3b62ca82013-05-27 21:11:04 -0400592 .. note::
593 While the method has a default implementation, it is suggested that
594 it be overridden if possible for performance.
595
R David Murray1b00f252012-08-15 10:43:58 -0400596 .. index::
597 single: universal newlines; importlib.abc.InspectLoader.get_source method
598
Brett Cannon100883f2013-04-09 16:59:39 -0400599 .. versionchanged:: 3.4
Brett Cannon3b62ca82013-05-27 21:11:04 -0400600 No longer abstract and a concrete implementation is provided.
Brett Cannon100883f2013-04-09 16:59:39 -0400601
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200602 .. abstractmethod:: get_source(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000603
604 An abstract method to return the source of a module. It is returned as
R David Murray1b00f252012-08-15 10:43:58 -0400605 a text string using :term:`universal newlines`, translating all
R David Murrayee0a9452012-08-15 11:05:36 -0400606 recognized line separators into ``'\n'`` characters. Returns ``None``
607 if no source is available (e.g. a built-in module). Raises
608 :exc:`ImportError` if the loader cannot find the module specified.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000609
Brett Cannon100883f2013-04-09 16:59:39 -0400610 .. versionchanged:: 3.4
611 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
612
Brett Cannona113ac52009-03-15 01:41:33 +0000613 .. method:: is_package(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000614
Brett Cannona113ac52009-03-15 01:41:33 +0000615 An abstract method to return a true value if the module is a package, a
616 false value otherwise. :exc:`ImportError` is raised if the
617 :term:`loader` cannot find the module.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000618
Brett Cannon100883f2013-04-09 16:59:39 -0400619 .. versionchanged:: 3.4
620 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
621
Brett Cannon6eaac132014-05-09 12:28:22 -0400622 .. staticmethod:: source_to_code(data, path='<string>')
Brett Cannon9ffe85e2013-05-26 16:45:10 -0400623
624 Create a code object from Python source.
625
626 The *data* argument can be whatever the :func:`compile` function
627 supports (i.e. string or bytes). The *path* argument should be
628 the "path" to where the source code originated from, which can be an
629 abstract concept (e.g. location in a zip file).
630
Brett Cannon6eaac132014-05-09 12:28:22 -0400631 With the subsequent code object one can execute it in a module by
632 running ``exec(code, module.__dict__)``.
633
Brett Cannon9ffe85e2013-05-26 16:45:10 -0400634 .. versionadded:: 3.4
635
Brett Cannon6eaac132014-05-09 12:28:22 -0400636 .. versionchanged:: 3.5
637 Made the method static.
638
Eric Snowca2d8542013-12-16 23:06:52 -0700639 .. method:: exec_module(module)
640
641 Implementation of :meth:`Loader.exec_module`.
642
643 .. versionadded:: 3.4
644
Brett Cannon0dbb4c72013-05-31 18:56:47 -0400645 .. method:: load_module(fullname)
646
Eric Snowca2d8542013-12-16 23:06:52 -0700647 Implementation of :meth:`Loader.load_module`.
648
649 .. deprecated:: 3.4
650 use :meth:`exec_module` instead.
Brett Cannon0dbb4c72013-05-31 18:56:47 -0400651
Brett Cannon2a922ed2009-03-09 03:35:50 +0000652
Brett Cannon69194272009-07-20 04:23:48 +0000653.. class:: ExecutionLoader
654
655 An abstract base class which inherits from :class:`InspectLoader` that,
Brett Cannon23460292009-07-20 22:59:00 +0000656 when implemented, helps a module to be executed as a script. The ABC
Brett Cannon69194272009-07-20 04:23:48 +0000657 represents an optional :pep:`302` protocol.
658
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200659 .. abstractmethod:: get_filename(fullname)
Brett Cannon69194272009-07-20 04:23:48 +0000660
Brett Cannonf23e3742010-06-27 23:57:46 +0000661 An abstract method that is to return the value of :attr:`__file__` for
Brett Cannon69194272009-07-20 04:23:48 +0000662 the specified module. If no path is available, :exc:`ImportError` is
663 raised.
664
Brett Cannonf23e3742010-06-27 23:57:46 +0000665 If source code is available, then the method should return the path to
666 the source file, regardless of whether a bytecode was used to load the
667 module.
668
Brett Cannon100883f2013-04-09 16:59:39 -0400669 .. versionchanged:: 3.4
670 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
671
Brett Cannonf23e3742010-06-27 23:57:46 +0000672
Brett Cannon938d44d2012-04-22 19:58:33 -0400673.. class:: FileLoader(fullname, path)
674
675 An abstract base class which inherits from :class:`ResourceLoader` and
Andrew Svetlova60de4f2013-02-17 16:55:58 +0200676 :class:`ExecutionLoader`, providing concrete implementations of
Brett Cannon938d44d2012-04-22 19:58:33 -0400677 :meth:`ResourceLoader.get_data` and :meth:`ExecutionLoader.get_filename`.
678
679 The *fullname* argument is a fully resolved name of the module the loader is
680 to handle. The *path* argument is the path to the file for the module.
681
682 .. versionadded:: 3.3
683
684 .. attribute:: name
685
686 The name of the module the loader can handle.
687
688 .. attribute:: path
689
690 Path to the file of the module.
691
Barry Warsawd7d21942012-07-29 16:36:17 -0400692 .. method:: load_module(fullname)
Brett Cannonc0499522012-05-11 14:48:41 -0400693
Barry Warsawd7d21942012-07-29 16:36:17 -0400694 Calls super's ``load_module()``.
Brett Cannonc0499522012-05-11 14:48:41 -0400695
Eric Snowca2d8542013-12-16 23:06:52 -0700696 .. deprecated:: 3.4
697 Use :meth:`Loader.exec_module` instead.
698
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200699 .. abstractmethod:: get_filename(fullname)
Brett Cannon938d44d2012-04-22 19:58:33 -0400700
Barry Warsawd7d21942012-07-29 16:36:17 -0400701 Returns :attr:`path`.
Brett Cannon938d44d2012-04-22 19:58:33 -0400702
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200703 .. abstractmethod:: get_data(path)
Brett Cannon938d44d2012-04-22 19:58:33 -0400704
Brett Cannon3b62ca82013-05-27 21:11:04 -0400705 Reads *path* as a binary file and returns the bytes from it.
Brett Cannon938d44d2012-04-22 19:58:33 -0400706
707
Brett Cannonf23e3742010-06-27 23:57:46 +0000708.. class:: SourceLoader
709
710 An abstract base class for implementing source (and optionally bytecode)
711 file loading. The class inherits from both :class:`ResourceLoader` and
712 :class:`ExecutionLoader`, requiring the implementation of:
713
714 * :meth:`ResourceLoader.get_data`
715 * :meth:`ExecutionLoader.get_filename`
Brett Cannon6dfbff32010-07-21 09:48:31 +0000716 Should only return the path to the source file; sourceless
Brett Cannona81d5272013-06-16 19:17:12 -0400717 loading is not supported.
Brett Cannonf23e3742010-06-27 23:57:46 +0000718
719 The abstract methods defined by this class are to add optional bytecode
Brett Cannon5650e4f2012-11-18 10:03:31 -0500720 file support. Not implementing these optional methods (or causing them to
721 raise :exc:`NotImplementedError`) causes the loader to
Brett Cannonf23e3742010-06-27 23:57:46 +0000722 only work with source code. Implementing the methods allows the loader to
723 work with source *and* bytecode files; it does not allow for *sourceless*
724 loading where only bytecode is provided. Bytecode files are an
725 optimization to speed up loading by removing the parsing step of Python's
726 compiler, and so no bytecode-specific API is exposed.
727
Brett Cannon773468f2012-08-02 17:35:34 -0400728 .. method:: path_stats(path)
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100729
730 Optional abstract method which returns a :class:`dict` containing
Martin Pantereb995702016-07-28 01:11:04 +0000731 metadata about the specified path. Supported dictionary keys are:
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100732
733 - ``'mtime'`` (mandatory): an integer or floating-point number
734 representing the modification time of the source code;
735 - ``'size'`` (optional): the size in bytes of the source code.
736
737 Any other keys in the dictionary are ignored, to allow for future
Andrew Svetlov08af0002014-04-01 01:13:30 +0300738 extensions. If the path cannot be handled, :exc:`OSError` is raised.
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100739
740 .. versionadded:: 3.3
741
Brett Cannon100883f2013-04-09 16:59:39 -0400742 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300743 Raise :exc:`OSError` instead of :exc:`NotImplementedError`.
Brett Cannon100883f2013-04-09 16:59:39 -0400744
Brett Cannon773468f2012-08-02 17:35:34 -0400745 .. method:: path_mtime(path)
Brett Cannonf23e3742010-06-27 23:57:46 +0000746
747 Optional abstract method which returns the modification time for the
748 specified path.
749
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100750 .. deprecated:: 3.3
751 This method is deprecated in favour of :meth:`path_stats`. You don't
752 have to implement it, but it is still available for compatibility
Andrew Svetlov08af0002014-04-01 01:13:30 +0300753 purposes. Raise :exc:`OSError` if the path cannot be handled.
Brett Cannon100883f2013-04-09 16:59:39 -0400754
Georg Brandldf48b972014-03-24 09:06:18 +0100755 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300756 Raise :exc:`OSError` instead of :exc:`NotImplementedError`.
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100757
Brett Cannon773468f2012-08-02 17:35:34 -0400758 .. method:: set_data(path, data)
Brett Cannonf23e3742010-06-27 23:57:46 +0000759
760 Optional abstract method which writes the specified bytes to a file
Brett Cannon61b14252010-07-03 21:48:25 +0000761 path. Any intermediate directories which do not exist are to be created
762 automatically.
763
764 When writing to the path fails because the path is read-only
Brett Cannon2cefb3c2013-05-25 11:26:11 -0400765 (:attr:`errno.EACCES`/:exc:`PermissionError`), do not propagate the
766 exception.
Brett Cannonf23e3742010-06-27 23:57:46 +0000767
Brett Cannon100883f2013-04-09 16:59:39 -0400768 .. versionchanged:: 3.4
769 No longer raises :exc:`NotImplementedError` when called.
770
Brett Cannon773468f2012-08-02 17:35:34 -0400771 .. method:: get_code(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000772
773 Concrete implementation of :meth:`InspectLoader.get_code`.
774
Eric Snowca2d8542013-12-16 23:06:52 -0700775 .. method:: exec_module(module)
776
777 Concrete implementation of :meth:`Loader.exec_module`.
778
Andrés Delfino65b5ef02018-08-12 03:50:46 -0300779 .. versionadded:: 3.4
Eric Snowca2d8542013-12-16 23:06:52 -0700780
Brett Cannon773468f2012-08-02 17:35:34 -0400781 .. method:: load_module(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000782
Eric Snowca2d8542013-12-16 23:06:52 -0700783 Concrete implementation of :meth:`Loader.load_module`.
784
785 .. deprecated:: 3.4
786 Use :meth:`exec_module` instead.
Brett Cannonf23e3742010-06-27 23:57:46 +0000787
Brett Cannon773468f2012-08-02 17:35:34 -0400788 .. method:: get_source(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000789
790 Concrete implementation of :meth:`InspectLoader.get_source`.
791
Brett Cannon773468f2012-08-02 17:35:34 -0400792 .. method:: is_package(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000793
794 Concrete implementation of :meth:`InspectLoader.is_package`. A module
Brett Cannonea0b8232012-06-15 20:00:53 -0400795 is determined to be a package if its file path (as provided by
796 :meth:`ExecutionLoader.get_filename`) is a file named
797 ``__init__`` when the file extension is removed **and** the module name
798 itself does not end in ``__init__``.
Brett Cannonf23e3742010-06-27 23:57:46 +0000799
Brett Cannon69194272009-07-20 04:23:48 +0000800
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400801.. class:: Traversable
802
803 An object with a subset of pathlib.Path methods suitable for
804 traversing directories and opening files.
805
806 .. versionadded:: 3.9
807
808
809.. class:: TraversableReader
810
811 An abstract base class for resource readers capable of serving
812 the ``files`` interface. Subclasses ResourceReader and provides
813 concrete implementations of the ResourceReader's abstract
814 methods. Therefore, any loader supplying TraversableReader
815 also supplies ResourceReader.
816
817 Loaders that wish to support resource reading are expected to
818 implement this interface.
819
820 .. versionadded:: 3.9
821
822
Barry Warsawdeae6b42017-12-30 15:18:06 -0500823:mod:`importlib.resources` -- Resources
824---------------------------------------
825
826.. module:: importlib.resources
827 :synopsis: Package resource reading, opening, and access
828
829**Source code:** :source:`Lib/importlib/resources.py`
830
831--------------
832
833.. versionadded:: 3.7
834
835This module leverages Python's import system to provide access to *resources*
836within *packages*. If you can import a package, you can access resources
837within that package. Resources can be opened or read, in either binary or
838text mode.
839
840Resources are roughly akin to files inside directories, though it's important
841to keep in mind that this is just a metaphor. Resources and packages **do
842not** have to exist as physical files and directories on the file system.
843
Barry Warsaw997b8c12018-02-16 10:45:39 -0500844.. note::
845
846 This module provides functionality similar to `pkg_resources
847 <https://setuptools.readthedocs.io/en/latest/pkg_resources.html>`_ `Basic
848 Resource Access
849 <http://setuptools.readthedocs.io/en/latest/pkg_resources.html#basic-resource-access>`_
850 without the performance overhead of that package. This makes reading
851 resources included in packages easier, with more stable and consistent
852 semantics.
853
854 The standalone backport of this module provides more information
855 on `using importlib.resources
856 <http://importlib-resources.readthedocs.io/en/latest/using.html>`_ and
857 `migrating from pkg_resources to importlib.resources
858 <http://importlib-resources.readthedocs.io/en/latest/migration.html>`_.
859
860Loaders that wish to support resource reading should implement a
861``get_resource_reader(fullname)`` method as specified by
862:class:`importlib.abc.ResourceReader`.
Barry Warsawdeae6b42017-12-30 15:18:06 -0500863
864The following types are defined.
865
866.. data:: Package
867
868 The ``Package`` type is defined as ``Union[str, ModuleType]``. This means
869 that where the function describes accepting a ``Package``, you can pass in
870 either a string or a module. Module objects must have a resolvable
871 ``__spec__.submodule_search_locations`` that is not ``None``.
872
873.. data:: Resource
874
875 This type describes the resource names passed into the various functions
876 in this package. This is defined as ``Union[str, os.PathLike]``.
877
878
879The following functions are available.
880
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400881
882.. function:: files(package)
883
884 Returns an :class:`importlib.resources.abc.Traversable` object
885 representing the resource container for the package (think directory)
886 and its resources (think files). A Traversable may contain other
887 containers (think subdirectories).
888
889 *package* is either a name or a module object which conforms to the
890 ``Package`` requirements.
891
892 .. versionadded:: 3.9
893
Jason R. Coombsaf50c842021-03-27 20:25:53 -0400894.. function:: as_file(traversable)
895
896 Given a :class:`importlib.resources.abc.Traversable` object representing
897 a file, typically from :func:`importlib.resources.files`, return
898 a context manager for use in a :keyword:`with` statement.
899 The context manager provides a :class:`pathlib.Path` object.
900
901 Exiting the context manager cleans up any temporary file created when the
902 resource was extracted from e.g. a zip file.
903
904 Use ``as_file`` when the Traversable methods
905 (``read_text``, etc) are insufficient and an actual file on
906 the file system is required.
907
908 .. versionadded:: 3.9
909
Barry Warsawdeae6b42017-12-30 15:18:06 -0500910.. function:: open_binary(package, resource)
911
912 Open for binary reading the *resource* within *package*.
913
914 *package* is either a name or a module object which conforms to the
915 ``Package`` requirements. *resource* is the name of the resource to open
916 within *package*; it may not contain path separators and it may not have
917 sub-resources (i.e. it cannot be a directory). This function returns a
918 ``typing.BinaryIO`` instance, a binary I/O stream open for reading.
919
920
921.. function:: open_text(package, resource, encoding='utf-8', errors='strict')
922
923 Open for text reading the *resource* within *package*. By default, the
924 resource is opened for reading as UTF-8.
925
926 *package* is either a name or a module object which conforms to the
927 ``Package`` requirements. *resource* is the name of the resource to open
928 within *package*; it may not contain path separators and it may not have
929 sub-resources (i.e. it cannot be a directory). *encoding* and *errors*
930 have the same meaning as with built-in :func:`open`.
931
932 This function returns a ``typing.TextIO`` instance, a text I/O stream open
933 for reading.
934
935
936.. function:: read_binary(package, resource)
937
938 Read and return the contents of the *resource* within *package* as
939 ``bytes``.
940
941 *package* is either a name or a module object which conforms to the
942 ``Package`` requirements. *resource* is the name of the resource to open
943 within *package*; it may not contain path separators and it may not have
944 sub-resources (i.e. it cannot be a directory). This function returns the
945 contents of the resource as :class:`bytes`.
946
947
948.. function:: read_text(package, resource, encoding='utf-8', errors='strict')
949
950 Read and return the contents of *resource* within *package* as a ``str``.
951 By default, the contents are read as strict UTF-8.
952
953 *package* is either a name or a module object which conforms to the
954 ``Package`` requirements. *resource* is the name of the resource to open
955 within *package*; it may not contain path separators and it may not have
956 sub-resources (i.e. it cannot be a directory). *encoding* and *errors*
957 have the same meaning as with built-in :func:`open`. This function
958 returns the contents of the resource as :class:`str`.
959
960
961.. function:: path(package, resource)
962
963 Return the path to the *resource* as an actual file system path. This
964 function returns a context manager for use in a :keyword:`with` statement.
965 The context manager provides a :class:`pathlib.Path` object.
966
967 Exiting the context manager cleans up any temporary file created when the
968 resource needs to be extracted from e.g. a zip file.
969
970 *package* is either a name or a module object which conforms to the
971 ``Package`` requirements. *resource* is the name of the resource to open
972 within *package*; it may not contain path separators and it may not have
973 sub-resources (i.e. it cannot be a directory).
974
975
976.. function:: is_resource(package, name)
977
978 Return ``True`` if there is a resource named *name* in the package,
979 otherwise ``False``. Remember that directories are *not* resources!
980 *package* is either a name or a module object which conforms to the
981 ``Package`` requirements.
982
983
984.. function:: contents(package)
985
Brett Cannon3ab93652018-04-30 11:31:45 -0700986 Return an iterable over the named items within the package. The iterable
Barry Warsawdeae6b42017-12-30 15:18:06 -0500987 returns :class:`str` resources (e.g. files) and non-resources
Brett Cannon3ab93652018-04-30 11:31:45 -0700988 (e.g. directories). The iterable does not recurse into subdirectories.
Barry Warsawdeae6b42017-12-30 15:18:06 -0500989
990 *package* is either a name or a module object which conforms to the
991 ``Package`` requirements.
992
993
Brett Cannon78246b62009-01-25 04:56:30 +0000994:mod:`importlib.machinery` -- Importers and path hooks
995------------------------------------------------------
996
997.. module:: importlib.machinery
998 :synopsis: Importers and path hooks
999
Terry Jan Reedydcb6c882016-06-22 22:46:34 -04001000**Source code:** :source:`Lib/importlib/machinery.py`
1001
1002--------------
1003
Brett Cannon78246b62009-01-25 04:56:30 +00001004This module contains the various objects that help :keyword:`import`
1005find and load modules.
1006
Brett Cannoncb66eb02012-05-11 12:58:42 -04001007.. attribute:: SOURCE_SUFFIXES
1008
1009 A list of strings representing the recognized file suffixes for source
1010 modules.
1011
1012 .. versionadded:: 3.3
1013
1014.. attribute:: DEBUG_BYTECODE_SUFFIXES
1015
1016 A list of strings representing the file suffixes for non-optimized bytecode
1017 modules.
1018
1019 .. versionadded:: 3.3
1020
Brett Cannonf299abd2015-04-13 14:21:02 -04001021 .. deprecated:: 3.5
1022 Use :attr:`BYTECODE_SUFFIXES` instead.
1023
Brett Cannoncb66eb02012-05-11 12:58:42 -04001024.. attribute:: OPTIMIZED_BYTECODE_SUFFIXES
1025
1026 A list of strings representing the file suffixes for optimized bytecode
1027 modules.
1028
1029 .. versionadded:: 3.3
1030
Brett Cannonf299abd2015-04-13 14:21:02 -04001031 .. deprecated:: 3.5
1032 Use :attr:`BYTECODE_SUFFIXES` instead.
1033
Brett Cannoncb66eb02012-05-11 12:58:42 -04001034.. attribute:: BYTECODE_SUFFIXES
1035
1036 A list of strings representing the recognized file suffixes for bytecode
Brett Cannonf299abd2015-04-13 14:21:02 -04001037 modules (including the leading dot).
Brett Cannoncb66eb02012-05-11 12:58:42 -04001038
1039 .. versionadded:: 3.3
1040
Brett Cannonf299abd2015-04-13 14:21:02 -04001041 .. versionchanged:: 3.5
1042 The value is no longer dependent on ``__debug__``.
1043
Brett Cannoncb66eb02012-05-11 12:58:42 -04001044.. attribute:: EXTENSION_SUFFIXES
1045
Nick Coghlan76e07702012-07-18 23:14:57 +10001046 A list of strings representing the recognized file suffixes for
Brett Cannoncb66eb02012-05-11 12:58:42 -04001047 extension modules.
1048
1049 .. versionadded:: 3.3
1050
Nick Coghlanc5afd422012-07-18 23:59:08 +10001051.. function:: all_suffixes()
Nick Coghlan76e07702012-07-18 23:14:57 +10001052
1053 Returns a combined list of strings representing all file suffixes for
Nick Coghlanc5afd422012-07-18 23:59:08 +10001054 modules recognized by the standard import machinery. This is a
Nick Coghlan76e07702012-07-18 23:14:57 +10001055 helper for code which simply needs to know if a filesystem path
Nick Coghlanc5afd422012-07-18 23:59:08 +10001056 potentially refers to a module without needing any details on the kind
Martin Panterd21e0b52015-10-10 10:36:22 +00001057 of module (for example, :func:`inspect.getmodulename`).
Nick Coghlan76e07702012-07-18 23:14:57 +10001058
1059 .. versionadded:: 3.3
1060
1061
Brett Cannon78246b62009-01-25 04:56:30 +00001062.. class:: BuiltinImporter
1063
Brett Cannon2a922ed2009-03-09 03:35:50 +00001064 An :term:`importer` for built-in modules. All known built-in modules are
1065 listed in :data:`sys.builtin_module_names`. This class implements the
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001066 :class:`importlib.abc.MetaPathFinder` and
1067 :class:`importlib.abc.InspectLoader` ABCs.
Brett Cannon78246b62009-01-25 04:56:30 +00001068
1069 Only class methods are defined by this class to alleviate the need for
1070 instantiation.
1071
Nick Coghland5cacbb2015-05-23 22:24:10 +10001072 .. versionchanged:: 3.5
1073 As part of :pep:`489`, the builtin importer now implements
1074 :meth:`Loader.create_module` and :meth:`Loader.exec_module`
Eric Snowca2d8542013-12-16 23:06:52 -07001075
Brett Cannon78246b62009-01-25 04:56:30 +00001076
1077.. class:: FrozenImporter
1078
Brett Cannon2a922ed2009-03-09 03:35:50 +00001079 An :term:`importer` for frozen modules. This class implements the
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001080 :class:`importlib.abc.MetaPathFinder` and
1081 :class:`importlib.abc.InspectLoader` ABCs.
Brett Cannon78246b62009-01-25 04:56:30 +00001082
1083 Only class methods are defined by this class to alleviate the need for
1084 instantiation.
1085
Brett Cannon302e5a82020-03-25 11:57:47 -07001086 .. versionchanged:: 3.4
1087 Gained :meth:`~Loader.create_module` and :meth:`~Loader.exec_module`
1088 methods.
1089
Brett Cannondebb98d2009-02-16 04:18:01 +00001090
Nick Coghlanff794862012-08-02 21:45:24 +10001091.. class:: WindowsRegistryFinder
1092
Victor Stinnerbb0b0852020-08-14 12:20:05 +02001093 :term:`Finder <finder>` for modules declared in the Windows registry. This class
Himanshu Lakhara5cbb8412018-03-24 02:56:35 +05301094 implements the :class:`importlib.abc.MetaPathFinder` ABC.
Nick Coghlanff794862012-08-02 21:45:24 +10001095
1096 Only class methods are defined by this class to alleviate the need for
1097 instantiation.
1098
1099 .. versionadded:: 3.3
1100
Steve Dower20367422016-12-07 13:02:27 -08001101 .. deprecated:: 3.6
1102 Use :mod:`site` configuration instead. Future versions of Python may
1103 not enable this finder by default.
1104
Nick Coghlanff794862012-08-02 21:45:24 +10001105
Brett Cannondebb98d2009-02-16 04:18:01 +00001106.. class:: PathFinder
1107
Victor Stinnerbb0b0852020-08-14 12:20:05 +02001108 A :term:`Finder <finder>` for :data:`sys.path` and package ``__path__`` attributes.
Brett Cannon1b799182012-08-17 14:08:24 -04001109 This class implements the :class:`importlib.abc.MetaPathFinder` ABC.
Brett Cannondebb98d2009-02-16 04:18:01 +00001110
Brett Cannon1b799182012-08-17 14:08:24 -04001111 Only class methods are defined by this class to alleviate the need for
1112 instantiation.
Brett Cannondebb98d2009-02-16 04:18:01 +00001113
Eric Snowca2d8542013-12-16 23:06:52 -07001114 .. classmethod:: find_spec(fullname, path=None, target=None)
1115
1116 Class method that attempts to find a :term:`spec <module spec>`
1117 for the module specified by *fullname* on :data:`sys.path` or, if
1118 defined, on *path*. For each path entry that is searched,
1119 :data:`sys.path_importer_cache` is checked. If a non-false object
1120 is found then it is used as the :term:`path entry finder` to look
1121 for the module being searched for. If no entry is found in
1122 :data:`sys.path_importer_cache`, then :data:`sys.path_hooks` is
1123 searched for a finder for the path entry and, if found, is stored
1124 in :data:`sys.path_importer_cache` along with being queried about
1125 the module. If no finder is ever found then ``None`` is both
1126 stored in the cache and returned.
1127
1128 .. versionadded:: 3.4
1129
Brett Cannonb6e25562014-11-21 12:19:28 -05001130 .. versionchanged:: 3.5
1131 If the current working directory -- represented by an empty string --
1132 is no longer valid then ``None`` is returned but no value is cached
1133 in :data:`sys.path_importer_cache`.
1134
Brett Cannon1b799182012-08-17 14:08:24 -04001135 .. classmethod:: find_module(fullname, path=None)
Brett Cannondebb98d2009-02-16 04:18:01 +00001136
Eric Snowca2d8542013-12-16 23:06:52 -07001137 A legacy wrapper around :meth:`find_spec`.
1138
1139 .. deprecated:: 3.4
1140 Use :meth:`find_spec` instead.
Brett Cannond2e7b332009-02-17 02:45:03 +00001141
Brett Cannonf4dc9202012-08-10 12:21:12 -04001142 .. classmethod:: invalidate_caches()
1143
Eric Snowca2d8542013-12-16 23:06:52 -07001144 Calls :meth:`importlib.abc.PathEntryFinder.invalidate_caches` on all
Brett Cannon9e2be602018-04-06 16:10:18 -07001145 finders stored in :data:`sys.path_importer_cache` that define the method.
1146 Otherwise entries in :data:`sys.path_importer_cache` set to ``None`` are
1147 deleted.
1148
1149 .. versionchanged:: 3.7
1150 Entries of ``None`` in :data:`sys.path_importer_cache` are deleted.
Brett Cannonf4dc9202012-08-10 12:21:12 -04001151
Eric Snowca2d8542013-12-16 23:06:52 -07001152 .. versionchanged:: 3.4
1153 Calls objects in :data:`sys.path_hooks` with the current working
1154 directory for ``''`` (i.e. the empty string).
Brett Cannon27e27f72013-10-18 11:39:04 -04001155
Brett Cannond2e7b332009-02-17 02:45:03 +00001156
Andre Delfinodcc997c2020-12-16 22:37:28 -03001157.. class:: FileFinder(path, *loader_details)
Brett Cannon938d44d2012-04-22 19:58:33 -04001158
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001159 A concrete implementation of :class:`importlib.abc.PathEntryFinder` which
1160 caches results from the file system.
Brett Cannon938d44d2012-04-22 19:58:33 -04001161
1162 The *path* argument is the directory for which the finder is in charge of
1163 searching.
1164
Brett Cannonac9f2f32012-08-10 13:47:54 -04001165 The *loader_details* argument is a variable number of 2-item tuples each
1166 containing a loader and a sequence of file suffixes the loader recognizes.
Brett Cannon29b2f172013-06-21 18:31:55 -04001167 The loaders are expected to be callables which accept two arguments of
1168 the module's name and the path to the file found.
Brett Cannon938d44d2012-04-22 19:58:33 -04001169
1170 The finder will cache the directory contents as necessary, making stat calls
1171 for each module search to verify the cache is not outdated. Because cache
1172 staleness relies upon the granularity of the operating system's state
1173 information of the file system, there is a potential race condition of
1174 searching for a module, creating a new file, and then searching for the
1175 module the new file represents. If the operations happen fast enough to fit
1176 within the granularity of stat calls, then the module search will fail. To
1177 prevent this from happening, when you create a module dynamically, make sure
1178 to call :func:`importlib.invalidate_caches`.
1179
1180 .. versionadded:: 3.3
1181
1182 .. attribute:: path
1183
1184 The path the finder will search in.
1185
Eric Snowca2d8542013-12-16 23:06:52 -07001186 .. method:: find_spec(fullname, target=None)
1187
1188 Attempt to find the spec to handle *fullname* within :attr:`path`.
1189
1190 .. versionadded:: 3.4
1191
Brett Cannon1d753822013-06-16 19:06:55 -04001192 .. method:: find_loader(fullname)
Brett Cannon938d44d2012-04-22 19:58:33 -04001193
1194 Attempt to find the loader to handle *fullname* within :attr:`path`.
1195
1196 .. method:: invalidate_caches()
1197
1198 Clear out the internal cache.
1199
Andre Delfinodcc997c2020-12-16 22:37:28 -03001200 .. classmethod:: path_hook(*loader_details)
Brett Cannon938d44d2012-04-22 19:58:33 -04001201
1202 A class method which returns a closure for use on :attr:`sys.path_hooks`.
1203 An instance of :class:`FileFinder` is returned by the closure using the
1204 path argument given to the closure directly and *loader_details*
1205 indirectly.
1206
1207 If the argument to the closure is not an existing directory,
1208 :exc:`ImportError` is raised.
1209
1210
1211.. class:: SourceFileLoader(fullname, path)
1212
1213 A concrete implementation of :class:`importlib.abc.SourceLoader` by
1214 subclassing :class:`importlib.abc.FileLoader` and providing some concrete
1215 implementations of other methods.
1216
1217 .. versionadded:: 3.3
1218
1219 .. attribute:: name
1220
1221 The name of the module that this loader will handle.
1222
1223 .. attribute:: path
1224
1225 The path to the source file.
1226
1227 .. method:: is_package(fullname)
1228
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +02001229 Return ``True`` if :attr:`path` appears to be for a package.
Brett Cannon938d44d2012-04-22 19:58:33 -04001230
1231 .. method:: path_stats(path)
1232
1233 Concrete implementation of :meth:`importlib.abc.SourceLoader.path_stats`.
1234
1235 .. method:: set_data(path, data)
1236
1237 Concrete implementation of :meth:`importlib.abc.SourceLoader.set_data`.
1238
Brett Cannon062fcac2014-05-09 11:55:49 -04001239 .. method:: load_module(name=None)
1240
1241 Concrete implementation of :meth:`importlib.abc.Loader.load_module` where
1242 specifying the name of the module to load is optional.
1243
Brett Cannoneae30792015-12-28 17:55:27 -08001244 .. deprecated:: 3.6
1245
1246 Use :meth:`importlib.abc.Loader.exec_module` instead.
1247
Brett Cannon938d44d2012-04-22 19:58:33 -04001248
Marc-Andre Lemburg4fe29c92012-04-25 02:31:37 +02001249.. class:: SourcelessFileLoader(fullname, path)
Brett Cannon938d44d2012-04-22 19:58:33 -04001250
1251 A concrete implementation of :class:`importlib.abc.FileLoader` which can
1252 import bytecode files (i.e. no source code files exist).
1253
Marc-Andre Lemburg4fe29c92012-04-25 02:31:37 +02001254 Please note that direct use of bytecode files (and thus not source code
1255 files) inhibits your modules from being usable by all Python
1256 implementations or new versions of Python which change the bytecode
1257 format.
Brett Cannon938d44d2012-04-22 19:58:33 -04001258
1259 .. versionadded:: 3.3
1260
1261 .. attribute:: name
1262
1263 The name of the module the loader will handle.
1264
1265 .. attribute:: path
1266
1267 The path to the bytecode file.
1268
1269 .. method:: is_package(fullname)
1270
1271 Determines if the module is a package based on :attr:`path`.
1272
1273 .. method:: get_code(fullname)
1274
1275 Returns the code object for :attr:`name` created from :attr:`path`.
1276
1277 .. method:: get_source(fullname)
1278
1279 Returns ``None`` as bytecode files have no source when this loader is
1280 used.
1281
Brett Cannon062fcac2014-05-09 11:55:49 -04001282 .. method:: load_module(name=None)
1283
1284 Concrete implementation of :meth:`importlib.abc.Loader.load_module` where
1285 specifying the name of the module to load is optional.
1286
Brett Cannoneae30792015-12-28 17:55:27 -08001287 .. deprecated:: 3.6
1288
1289 Use :meth:`importlib.abc.Loader.exec_module` instead.
1290
Brett Cannon938d44d2012-04-22 19:58:33 -04001291
1292.. class:: ExtensionFileLoader(fullname, path)
1293
Eric Snow51794452013-10-03 12:08:55 -06001294 A concrete implementation of :class:`importlib.abc.ExecutionLoader` for
Brett Cannon938d44d2012-04-22 19:58:33 -04001295 extension modules.
1296
1297 The *fullname* argument specifies the name of the module the loader is to
1298 support. The *path* argument is the path to the extension module's file.
1299
1300 .. versionadded:: 3.3
1301
1302 .. attribute:: name
1303
1304 Name of the module the loader supports.
1305
1306 .. attribute:: path
1307
1308 Path to the extension module.
1309
Nick Coghland5cacbb2015-05-23 22:24:10 +10001310 .. method:: create_module(spec)
Brett Cannon938d44d2012-04-22 19:58:33 -04001311
Nick Coghland5cacbb2015-05-23 22:24:10 +10001312 Creates the module object from the given specification in accordance
1313 with :pep:`489`.
Brett Cannon938d44d2012-04-22 19:58:33 -04001314
Nick Coghland5cacbb2015-05-23 22:24:10 +10001315 .. versionadded:: 3.5
1316
1317 .. method:: exec_module(module)
1318
1319 Initializes the given module object in accordance with :pep:`489`.
1320
1321 .. versionadded:: 3.5
Eric Snowca2d8542013-12-16 23:06:52 -07001322
Brett Cannon938d44d2012-04-22 19:58:33 -04001323 .. method:: is_package(fullname)
1324
Brett Cannonac9f2f32012-08-10 13:47:54 -04001325 Returns ``True`` if the file path points to a package's ``__init__``
1326 module based on :attr:`EXTENSION_SUFFIXES`.
Brett Cannon938d44d2012-04-22 19:58:33 -04001327
1328 .. method:: get_code(fullname)
1329
1330 Returns ``None`` as extension modules lack a code object.
1331
1332 .. method:: get_source(fullname)
1333
1334 Returns ``None`` as extension modules do not have source code.
1335
Eric Snow51794452013-10-03 12:08:55 -06001336 .. method:: get_filename(fullname)
1337
1338 Returns :attr:`path`.
1339
Eric Snowdcd01b42013-10-04 20:35:34 -06001340 .. versionadded:: 3.4
1341
Brett Cannon938d44d2012-04-22 19:58:33 -04001342
Eric Snowb523f842013-11-22 09:05:39 -07001343.. class:: ModuleSpec(name, loader, *, origin=None, loader_state=None, is_package=None)
1344
Barry Warsaw191e3132017-10-17 15:52:38 -04001345 A specification for a module's import-system-related state. This is
1346 typically exposed as the module's ``__spec__`` attribute. In the
1347 descriptions below, the names in parentheses give the corresponding
1348 attribute available directly on the module object.
1349 E.g. ``module.__spec__.origin == module.__file__``. Note however that
1350 while the *values* are usually equivalent, they can differ since there is
1351 no synchronization between the two objects. Thus it is possible to update
1352 the module's ``__path__`` at runtime, and this will not be automatically
1353 reflected in ``__spec__.submodule_search_locations``.
Eric Snowb523f842013-11-22 09:05:39 -07001354
1355 .. versionadded:: 3.4
1356
1357 .. attribute:: name
1358
1359 (``__name__``)
1360
1361 A string for the fully-qualified name of the module.
1362
1363 .. attribute:: loader
1364
1365 (``__loader__``)
1366
Géry Ogam27f1bd82020-10-21 23:17:35 +02001367 The :term:`Loader <loader>` that should be used when loading
1368 the module. :term:`Finders <finder>` should always set this.
Eric Snowb523f842013-11-22 09:05:39 -07001369
1370 .. attribute:: origin
1371
1372 (``__file__``)
1373
1374 Name of the place from which the module is loaded, e.g. "builtin" for
1375 built-in modules and the filename for modules loaded from source.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001376 Normally "origin" should be set, but it may be ``None`` (the default)
Barry Warsawbbbcf862018-02-02 15:15:58 -05001377 which indicates it is unspecified (e.g. for namespace packages).
Eric Snowb523f842013-11-22 09:05:39 -07001378
1379 .. attribute:: submodule_search_locations
1380
1381 (``__path__``)
1382
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001383 List of strings for where to find submodules, if a package (``None``
Eric Snowb523f842013-11-22 09:05:39 -07001384 otherwise).
1385
1386 .. attribute:: loader_state
1387
1388 Container of extra module-specific data for use during loading (or
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001389 ``None``).
Eric Snowb523f842013-11-22 09:05:39 -07001390
1391 .. attribute:: cached
1392
1393 (``__cached__``)
1394
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001395 String for where the compiled module should be stored (or ``None``).
Eric Snowb523f842013-11-22 09:05:39 -07001396
1397 .. attribute:: parent
1398
1399 (``__package__``)
1400
Géry Ogam27f1bd82020-10-21 23:17:35 +02001401 (Read-only) The fully-qualified name of the package under which the module
1402 should be loaded as a submodule (or the empty string for top-level modules).
1403 For packages, it is the same as :attr:`__name__`.
Eric Snowb523f842013-11-22 09:05:39 -07001404
1405 .. attribute:: has_location
1406
Eric Snowb282b3d2013-12-10 22:16:41 -07001407 Boolean indicating whether or not the module's "origin"
Eric Snowb523f842013-11-22 09:05:39 -07001408 attribute refers to a loadable location.
1409
Brett Cannond2e7b332009-02-17 02:45:03 +00001410:mod:`importlib.util` -- Utility code for importers
1411---------------------------------------------------
1412
1413.. module:: importlib.util
Brett Cannon75321e82012-03-02 11:58:25 -05001414 :synopsis: Utility code for importers
Brett Cannond2e7b332009-02-17 02:45:03 +00001415
Terry Jan Reedydcb6c882016-06-22 22:46:34 -04001416
1417**Source code:** :source:`Lib/importlib/util.py`
1418
1419--------------
1420
Brett Cannond2e7b332009-02-17 02:45:03 +00001421This module contains the various objects that help in the construction of
1422an :term:`importer`.
1423
Brett Cannon05a647d2013-06-14 19:02:34 -04001424.. attribute:: MAGIC_NUMBER
1425
1426 The bytes which represent the bytecode version number. If you need help with
1427 loading/writing bytecode then consider :class:`importlib.abc.SourceLoader`.
1428
1429 .. versionadded:: 3.4
1430
Brett Cannonf299abd2015-04-13 14:21:02 -04001431.. function:: cache_from_source(path, debug_override=None, *, optimization=None)
Brett Cannona3c96152013-06-14 22:26:30 -04001432
Brett Cannonf299abd2015-04-13 14:21:02 -04001433 Return the :pep:`3147`/:pep:`488` path to the byte-compiled file associated
1434 with the source *path*. For example, if *path* is ``/foo/bar/baz.py`` the return
Brett Cannona3c96152013-06-14 22:26:30 -04001435 value would be ``/foo/bar/__pycache__/baz.cpython-32.pyc`` for Python 3.2.
1436 The ``cpython-32`` string comes from the current magic tag (see
1437 :func:`get_tag`; if :attr:`sys.implementation.cache_tag` is not defined then
Brett Cannonf299abd2015-04-13 14:21:02 -04001438 :exc:`NotImplementedError` will be raised).
Brett Cannona3c96152013-06-14 22:26:30 -04001439
Brett Cannonf299abd2015-04-13 14:21:02 -04001440 The *optimization* parameter is used to specify the optimization level of the
1441 bytecode file. An empty string represents no optimization, so
1442 ``/foo/bar/baz.py`` with an *optimization* of ``''`` will result in a
1443 bytecode path of ``/foo/bar/__pycache__/baz.cpython-32.pyc``. ``None`` causes
Min ho Kim39d87b52019-08-31 06:21:19 +10001444 the interpreter's optimization level to be used. Any other value's string
1445 representation is used, so ``/foo/bar/baz.py`` with an *optimization* of
Brett Cannonf299abd2015-04-13 14:21:02 -04001446 ``2`` will lead to the bytecode path of
1447 ``/foo/bar/__pycache__/baz.cpython-32.opt-2.pyc``. The string representation
1448 of *optimization* can only be alphanumeric, else :exc:`ValueError` is raised.
1449
1450 The *debug_override* parameter is deprecated and can be used to override
1451 the system's value for ``__debug__``. A ``True`` value is the equivalent of
1452 setting *optimization* to the empty string. A ``False`` value is the same as
1453 setting *optimization* to ``1``. If both *debug_override* an *optimization*
1454 are not ``None`` then :exc:`TypeError` is raised.
Brett Cannona3c96152013-06-14 22:26:30 -04001455
1456 .. versionadded:: 3.4
1457
Berker Peksagfe5f6142016-01-30 19:30:06 +02001458 .. versionchanged:: 3.5
Brett Cannonf299abd2015-04-13 14:21:02 -04001459 The *optimization* parameter was added and the *debug_override* parameter
1460 was deprecated.
1461
Brett Cannon035a1002016-09-07 18:39:18 -07001462 .. versionchanged:: 3.6
1463 Accepts a :term:`path-like object`.
1464
Brett Cannona3c96152013-06-14 22:26:30 -04001465
1466.. function:: source_from_cache(path)
1467
1468 Given the *path* to a :pep:`3147` file name, return the associated source code
1469 file path. For example, if *path* is
1470 ``/foo/bar/__pycache__/baz.cpython-32.pyc`` the returned path would be
1471 ``/foo/bar/baz.py``. *path* need not exist, however if it does not conform
Stéphane Wirtele483f022018-10-26 12:52:11 +02001472 to :pep:`3147` or :pep:`488` format, a :exc:`ValueError` is raised. If
Brett Cannona3c96152013-06-14 22:26:30 -04001473 :attr:`sys.implementation.cache_tag` is not defined,
1474 :exc:`NotImplementedError` is raised.
1475
1476 .. versionadded:: 3.4
1477
Brett Cannon035a1002016-09-07 18:39:18 -07001478 .. versionchanged:: 3.6
1479 Accepts a :term:`path-like object`.
1480
Brett Cannonf24fecd2013-06-16 18:37:53 -04001481.. function:: decode_source(source_bytes)
1482
1483 Decode the given bytes representing source code and return it as a string
1484 with universal newlines (as required by
1485 :meth:`importlib.abc.InspectLoader.get_source`).
1486
1487 .. versionadded:: 3.4
1488
Brett Cannond200bf52012-05-13 13:45:09 -04001489.. function:: resolve_name(name, package)
1490
1491 Resolve a relative module name to an absolute one.
1492
1493 If **name** has no leading dots, then **name** is simply returned. This
1494 allows for usage such as
Yair Fridff8458b2021-01-06 19:42:10 +02001495 ``importlib.util.resolve_name('sys', __spec__.parent)`` without doing a
Brett Cannond200bf52012-05-13 13:45:09 -04001496 check to see if the **package** argument is needed.
1497
Ngalim Siregarc5fa4492019-08-03 12:46:02 +07001498 :exc:`ImportError` is raised if **name** is a relative module name but
1499 **package** is a false value (e.g. ``None`` or the empty string).
1500 :exc:`ImportError` is also raised a relative name would escape its containing
Brett Cannond200bf52012-05-13 13:45:09 -04001501 package (e.g. requesting ``..bacon`` from within the ``spam`` package).
1502
1503 .. versionadded:: 3.3
1504
Ngalim Siregarc5fa4492019-08-03 12:46:02 +07001505 .. versionchanged:: 3.9
1506 To improve consistency with import statements, raise
1507 :exc:`ImportError` instead of :exc:`ValueError` for invalid relative
1508 import attempts.
1509
Eric Snow6029e082014-01-25 15:32:46 -07001510.. function:: find_spec(name, package=None)
1511
1512 Find the :term:`spec <module spec>` for a module, optionally relative to
1513 the specified **package** name. If the module is in :attr:`sys.modules`,
1514 then ``sys.modules[name].__spec__`` is returned (unless the spec would be
1515 ``None`` or is not set, in which case :exc:`ValueError` is raised).
1516 Otherwise a search using :attr:`sys.meta_path` is done. ``None`` is
1517 returned if no spec is found.
1518
1519 If **name** is for a submodule (contains a dot), the parent module is
1520 automatically imported.
1521
1522 **name** and **package** work the same as for :func:`import_module`.
1523
1524 .. versionadded:: 3.4
1525
Milan Oberkirch8c3f05e2017-06-15 07:34:50 +10001526 .. versionchanged:: 3.7
1527 Raises :exc:`ModuleNotFoundError` instead of :exc:`AttributeError` if
1528 **package** is in fact not a package (i.e. lacks a :attr:`__path__`
1529 attribute).
1530
Brett Cannon2a17bde2014-05-30 14:55:29 -04001531.. function:: module_from_spec(spec)
1532
Brett Cannon696c35e2016-06-25 10:58:17 -07001533 Create a new module based on **spec** and
1534 :meth:`spec.loader.create_module <importlib.abc.Loader.create_module>`.
Brett Cannon2a17bde2014-05-30 14:55:29 -04001535
Brett Cannon696c35e2016-06-25 10:58:17 -07001536 If :meth:`spec.loader.create_module <importlib.abc.Loader.create_module>`
1537 does not return ``None``, then any pre-existing attributes will not be reset.
1538 Also, no :exc:`AttributeError` will be raised if triggered while accessing
1539 **spec** or setting an attribute on the module.
Brett Cannon2a17bde2014-05-30 14:55:29 -04001540
1541 This function is preferred over using :class:`types.ModuleType` to create a
1542 new module as **spec** is used to set as many import-controlled attributes on
1543 the module as possible.
1544
1545 .. versionadded:: 3.5
1546
Georg Brandl8a1caa22010-07-29 16:01:11 +00001547.. decorator:: module_for_loader
Brett Cannond2e7b332009-02-17 02:45:03 +00001548
Brett Cannona22faca2013-05-28 17:50:14 -04001549 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module`
Guido van Rossum09613542009-03-30 20:34:57 +00001550 to handle selecting the proper
Brett Cannond2e7b332009-02-17 02:45:03 +00001551 module object to load with. The decorated method is expected to have a call
Brett Cannon2a922ed2009-03-09 03:35:50 +00001552 signature taking two positional arguments
1553 (e.g. ``load_module(self, module)``) for which the second argument
Guido van Rossum09613542009-03-30 20:34:57 +00001554 will be the module **object** to be used by the loader.
Brett Cannonefad00d2012-04-27 17:27:14 -04001555 Note that the decorator will not work on static methods because of the
1556 assumption of two arguments.
Brett Cannond2e7b332009-02-17 02:45:03 +00001557
Guido van Rossum09613542009-03-30 20:34:57 +00001558 The decorated method will take in the **name** of the module to be loaded
1559 as expected for a :term:`loader`. If the module is not found in
Brett Cannon3dc48d62013-05-28 18:35:54 -04001560 :data:`sys.modules` then a new one is constructed. Regardless of where the
1561 module came from, :attr:`__loader__` set to **self** and :attr:`__package__`
1562 is set based on what :meth:`importlib.abc.InspectLoader.is_package` returns
1563 (if available). These attributes are set unconditionally to support
1564 reloading.
Brett Cannonefad00d2012-04-27 17:27:14 -04001565
1566 If an exception is raised by the decorated method and a module was added to
Brett Cannona87e31c2013-09-13 16:52:19 -04001567 :data:`sys.modules`, then the module will be removed to prevent a partially
1568 initialized module from being in left in :data:`sys.modules`. If the module
1569 was already in :data:`sys.modules` then it is left alone.
Brett Cannond2e7b332009-02-17 02:45:03 +00001570
Brett Cannonefad00d2012-04-27 17:27:14 -04001571 .. versionchanged:: 3.3
Georg Brandl61063cc2012-06-24 22:48:30 +02001572 :attr:`__loader__` and :attr:`__package__` are automatically set
1573 (when possible).
Brett Cannon57b46f52009-03-02 14:38:26 +00001574
Brett Cannon3dc48d62013-05-28 18:35:54 -04001575 .. versionchanged:: 3.4
Brett Cannon0dbb4c72013-05-31 18:56:47 -04001576 Set :attr:`__name__`, :attr:`__loader__` :attr:`__package__`
1577 unconditionally to support reloading.
1578
1579 .. deprecated:: 3.4
Eric Snowb523f842013-11-22 09:05:39 -07001580 The import machinery now directly performs all the functionality
1581 provided by this function.
Brett Cannon3dc48d62013-05-28 18:35:54 -04001582
Georg Brandl8a1caa22010-07-29 16:01:11 +00001583.. decorator:: set_loader
Brett Cannon2cf03a82009-03-10 05:17:37 +00001584
Brett Cannona22faca2013-05-28 17:50:14 -04001585 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module`
1586 to set the :attr:`__loader__`
1587 attribute on the returned module. If the attribute is already set the
1588 decorator does nothing. It is assumed that the first positional argument to
1589 the wrapped method (i.e. ``self``) is what :attr:`__loader__` should be set
1590 to.
Brett Cannon2cf03a82009-03-10 05:17:37 +00001591
Brett Cannon4802bec2013-03-13 10:41:36 -07001592 .. versionchanged:: 3.4
Brett Cannon4c14b5d2013-05-04 13:56:58 -04001593 Set ``__loader__`` if set to ``None``, as if the attribute does not
Brett Cannon4802bec2013-03-13 10:41:36 -07001594 exist.
1595
Eric Snowca2d8542013-12-16 23:06:52 -07001596 .. deprecated:: 3.4
1597 The import machinery takes care of this automatically.
1598
Georg Brandl8a1caa22010-07-29 16:01:11 +00001599.. decorator:: set_package
Brett Cannon57b46f52009-03-02 14:38:26 +00001600
Brett Cannon696c35e2016-06-25 10:58:17 -07001601 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module` to set the
1602 :attr:`__package__` attribute on the returned module. If :attr:`__package__`
Brett Cannona22faca2013-05-28 17:50:14 -04001603 is set and has a value other than ``None`` it will not be changed.
Brett Cannon16248a42009-04-01 20:47:14 +00001604
Eric Snowca2d8542013-12-16 23:06:52 -07001605 .. deprecated:: 3.4
1606 The import machinery takes care of this automatically.
1607
Eric Snowb523f842013-11-22 09:05:39 -07001608.. function:: spec_from_loader(name, loader, *, origin=None, is_package=None)
1609
Brett Cannon9cb31d62021-03-24 08:26:56 -07001610 A factory function for creating a :class:`~importlib.machinery.ModuleSpec`
1611 instance based on a loader. The parameters have the same meaning as they do
1612 for ModuleSpec. The function uses available :term:`loader` APIs, such as
Eric Snowb523f842013-11-22 09:05:39 -07001613 :meth:`InspectLoader.is_package`, to fill in any missing
1614 information on the spec.
1615
1616 .. versionadded:: 3.4
1617
1618.. function:: spec_from_file_location(name, location, *, loader=None, submodule_search_locations=None)
1619
Brett Cannon9cb31d62021-03-24 08:26:56 -07001620 A factory function for creating a :class:`~importlib.machinery.ModuleSpec`
1621 instance based on the path to a file. Missing information will be filled in
1622 on the spec by making use of loader APIs and by the implication that the
Eric Snowb523f842013-11-22 09:05:39 -07001623 module will be file-based.
1624
1625 .. versionadded:: 3.4
Brett Cannona04dbe42014-04-04 13:53:38 -04001626
Brett Cannon035a1002016-09-07 18:39:18 -07001627 .. versionchanged:: 3.6
1628 Accepts a :term:`path-like object`.
1629
Benjamin Peterson42aa93b2017-12-09 10:26:52 -08001630.. function:: source_hash(source_bytes)
1631
1632 Return the hash of *source_bytes* as bytes. A hash-based ``.pyc`` file embeds
1633 the :func:`source_hash` of the corresponding source file's contents in its
1634 header.
1635
1636 .. versionadded:: 3.7
1637
Brett Cannona04dbe42014-04-04 13:53:38 -04001638.. class:: LazyLoader(loader)
1639
1640 A class which postpones the execution of the loader of a module until the
1641 module has an attribute accessed.
1642
1643 This class **only** works with loaders that define
Brett Cannon02d84542015-01-09 11:39:21 -05001644 :meth:`~importlib.abc.Loader.exec_module` as control over what module type
1645 is used for the module is required. For those same reasons, the loader's
Brett Cannon696c35e2016-06-25 10:58:17 -07001646 :meth:`~importlib.abc.Loader.create_module` method must return ``None`` or a
1647 type for which its ``__class__`` attribute can be mutated along with not
1648 using :term:`slots <__slots__>`. Finally, modules which substitute the object
1649 placed into :attr:`sys.modules` will not work as there is no way to properly
1650 replace the module references throughout the interpreter safely;
1651 :exc:`ValueError` is raised if such a substitution is detected.
Brett Cannona04dbe42014-04-04 13:53:38 -04001652
1653 .. note::
1654 For projects where startup time is critical, this class allows for
1655 potentially minimizing the cost of loading a module if it is never used.
1656 For projects where startup time is not essential then use of this class is
1657 **heavily** discouraged due to error messages created during loading being
1658 postponed and thus occurring out of context.
1659
1660 .. versionadded:: 3.5
1661
Brett Cannon696c35e2016-06-25 10:58:17 -07001662 .. versionchanged:: 3.6
1663 Began calling :meth:`~importlib.abc.Loader.create_module`, removing the
1664 compatibility warning for :class:`importlib.machinery.BuiltinImporter` and
1665 :class:`importlib.machinery.ExtensionFileLoader`.
1666
Brett Cannona04dbe42014-04-04 13:53:38 -04001667 .. classmethod:: factory(loader)
1668
1669 A static method which returns a callable that creates a lazy loader. This
1670 is meant to be used in situations where the loader is passed by class
1671 instead of by instance.
1672 ::
1673
1674 suffixes = importlib.machinery.SOURCE_SUFFIXES
1675 loader = importlib.machinery.SourceFileLoader
1676 lazy_loader = importlib.util.LazyLoader.factory(loader)
Brett Cannon3bf1d872016-01-22 14:03:27 -08001677 finder = importlib.machinery.FileFinder(path, (lazy_loader, suffixes))
Brett Cannona85e9272016-01-08 14:33:09 -08001678
1679.. _importlib-examples:
1680
1681Examples
1682--------
1683
Brett Cannon23763162016-09-08 10:12:47 -07001684Importing programmatically
1685''''''''''''''''''''''''''
1686
Brett Cannona85e9272016-01-08 14:33:09 -08001687To programmatically import a module, use :func:`importlib.import_module`.
1688::
1689
1690 import importlib
1691
1692 itertools = importlib.import_module('itertools')
1693
Brett Cannon23763162016-09-08 10:12:47 -07001694
1695Checking if a module can be imported
1696''''''''''''''''''''''''''''''''''''
1697
Brett Cannona85e9272016-01-08 14:33:09 -08001698If you need to find out if a module can be imported without actually doing the
1699import, then you should use :func:`importlib.util.find_spec`.
1700::
1701
1702 import importlib.util
1703 import sys
1704
1705 # For illustrative purposes.
1706 name = 'itertools'
1707
Brett Cannon08270642019-07-12 15:35:34 -07001708 if name in sys.modules:
1709 print(f"{name!r} already in sys.modules")
Tzu-ping Chung544fa152019-07-26 01:20:33 +08001710 elif (spec := importlib.util.find_spec(name)) is not None:
Brett Cannon59363132016-03-18 11:54:22 -07001711 # If you chose to perform the actual import ...
Brett Cannona85e9272016-01-08 14:33:09 -08001712 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001713 sys.modules[name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001714 spec.loader.exec_module(module)
1715 print(f"{name!r} has been imported")
Tzu-ping Chung544fa152019-07-26 01:20:33 +08001716 else:
1717 print(f"can't find the {name!r} module")
Brett Cannona85e9272016-01-08 14:33:09 -08001718
Brett Cannon23763162016-09-08 10:12:47 -07001719
1720Importing a source file directly
1721''''''''''''''''''''''''''''''''
1722
Brett Cannona85e9272016-01-08 14:33:09 -08001723To import a Python source file directly, use the following recipe
E Kawashima16c8a532018-11-06 07:41:17 +09001724(Python 3.5 and newer only)::
Brett Cannona85e9272016-01-08 14:33:09 -08001725
1726 import importlib.util
1727 import sys
1728
1729 # For illustrative purposes.
1730 import tokenize
1731 file_path = tokenize.__file__
1732 module_name = tokenize.__name__
1733
1734 spec = importlib.util.spec_from_file_location(module_name, file_path)
1735 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001736 sys.modules[module_name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001737 spec.loader.exec_module(module)
1738
Brett Cannona85e9272016-01-08 14:33:09 -08001739
Joannah Nanjekye8dd32fe2020-07-13 18:31:02 -03001740Implementing lazy imports
1741'''''''''''''''''''''''''
1742
1743The example below shows how to implement lazy imports::
1744
1745 >>> import importlib.util
1746 >>> import sys
1747 >>> def lazy_import(name):
1748 ... spec = importlib.util.find_spec(name)
1749 ... loader = importlib.util.LazyLoader(spec.loader)
1750 ... spec.loader = loader
1751 ... module = importlib.util.module_from_spec(spec)
1752 ... sys.modules[name] = module
1753 ... loader.exec_module(module)
1754 ... return module
1755 ...
1756 >>> lazy_typing = lazy_import("typing")
1757 >>> #lazy_typing is a real module object,
1758 >>> #but it is not loaded in memory yet.
1759 >>> lazy_typing.TYPE_CHECKING
1760 False
1761
1762
Brett Cannon23763162016-09-08 10:12:47 -07001763
1764Setting up an importer
1765''''''''''''''''''''''
1766
Brett Cannon59363132016-03-18 11:54:22 -07001767For deep customizations of import, you typically want to implement an
1768:term:`importer`. This means managing both the :term:`finder` and :term:`loader`
1769side of things. For finders there are two flavours to choose from depending on
1770your needs: a :term:`meta path finder` or a :term:`path entry finder`. The
1771former is what you would put on :attr:`sys.meta_path` while the latter is what
1772you create using a :term:`path entry hook` on :attr:`sys.path_hooks` which works
1773with :attr:`sys.path` entries to potentially create a finder. This example will
1774show you how to register your own importers so that import will use them (for
1775creating an importer for yourself, read the documentation for the appropriate
1776classes defined within this package)::
1777
1778 import importlib.machinery
1779 import sys
1780
1781 # For illustrative purposes only.
1782 SpamMetaPathFinder = importlib.machinery.PathFinder
1783 SpamPathEntryFinder = importlib.machinery.FileFinder
1784 loader_details = (importlib.machinery.SourceFileLoader,
1785 importlib.machinery.SOURCE_SUFFIXES)
1786
1787 # Setting up a meta path finder.
1788 # Make sure to put the finder in the proper location in the list in terms of
1789 # priority.
1790 sys.meta_path.append(SpamMetaPathFinder)
1791
1792 # Setting up a path entry finder.
1793 # Make sure to put the path hook in the proper location in the list in terms
1794 # of priority.
1795 sys.path_hooks.append(SpamPathEntryFinder.path_hook(loader_details))
1796
Brett Cannon23763162016-09-08 10:12:47 -07001797
1798Approximating :func:`importlib.import_module`
1799'''''''''''''''''''''''''''''''''''''''''''''
1800
Brett Cannona85e9272016-01-08 14:33:09 -08001801Import itself is implemented in Python code, making it possible to
1802expose most of the import machinery through importlib. The following
1803helps illustrate the various APIs that importlib exposes by providing an
1804approximate implementation of
Brett Cannon59363132016-03-18 11:54:22 -07001805:func:`importlib.import_module` (Python 3.4 and newer for the importlib usage,
Brett Cannona85e9272016-01-08 14:33:09 -08001806Python 3.6 and newer for other parts of the code).
1807::
1808
1809 import importlib.util
1810 import sys
1811
1812 def import_module(name, package=None):
1813 """An approximate implementation of import."""
1814 absolute_name = importlib.util.resolve_name(name, package)
1815 try:
1816 return sys.modules[absolute_name]
1817 except KeyError:
1818 pass
1819
1820 path = None
1821 if '.' in absolute_name:
1822 parent_name, _, child_name = absolute_name.rpartition('.')
1823 parent_module = import_module(parent_name)
orlnub12378401f72018-10-25 02:32:26 +03001824 path = parent_module.__spec__.submodule_search_locations
Brett Cannona85e9272016-01-08 14:33:09 -08001825 for finder in sys.meta_path:
1826 spec = finder.find_spec(absolute_name, path)
1827 if spec is not None:
1828 break
1829 else:
Nick Coghlancee29b42019-01-17 20:41:29 +10001830 msg = f'No module named {absolute_name!r}'
1831 raise ModuleNotFoundError(msg, name=absolute_name)
Brett Cannon86a8be02016-02-20 18:47:09 -08001832 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001833 sys.modules[absolute_name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001834 spec.loader.exec_module(module)
Brett Cannona85e9272016-01-08 14:33:09 -08001835 if path is not None:
1836 setattr(parent_module, child_name, module)
1837 return module