blob: 45b62aec9ef537616881e23427500d83258855aa [file] [log] [blame]
Serhiy Storchaka2b57c432018-12-19 08:09:46 +02001:mod:`!importlib` --- The implementation of :keyword:`!import`
2==============================================================
Brett Cannonafccd632009-01-20 02:21:27 +00003
4.. module:: importlib
Brett Cannon07fbd782014-02-06 09:46:08 -05005 :synopsis: The implementation of the import machinery.
Brett Cannonafccd632009-01-20 02:21:27 +00006
7.. moduleauthor:: Brett Cannon <brett@python.org>
8.. sectionauthor:: Brett Cannon <brett@python.org>
9
10.. versionadded:: 3.1
11
Terry Jan Reedyfa089b92016-06-11 15:02:54 -040012**Source code:** :source:`Lib/importlib/__init__.py`
13
14--------------
Brett Cannonafccd632009-01-20 02:21:27 +000015
16Introduction
17------------
18
Brett Cannon07fbd782014-02-06 09:46:08 -050019The purpose of the :mod:`importlib` package is two-fold. One is to provide the
Brett Cannonafccd632009-01-20 02:21:27 +000020implementation of the :keyword:`import` statement (and thus, by extension, the
21:func:`__import__` function) in Python source code. This provides an
Serhiy Storchaka2b57c432018-12-19 08:09:46 +020022implementation of :keyword:`!import` which is portable to any Python
Brett Cannon07fbd782014-02-06 09:46:08 -050023interpreter. This also provides an implementation which is easier to
Brett Cannonf23e3742010-06-27 23:57:46 +000024comprehend than one implemented in a programming language other than Python.
Brett Cannonafccd632009-01-20 02:21:27 +000025
Brett Cannonf23e3742010-06-27 23:57:46 +000026Two, the components to implement :keyword:`import` are exposed in this
Brett Cannonafccd632009-01-20 02:21:27 +000027package, making it easier for users to create their own custom objects (known
Brett Cannondebb98d2009-02-16 04:18:01 +000028generically as an :term:`importer`) to participate in the import process.
Brett Cannonafccd632009-01-20 02:21:27 +000029
30.. seealso::
31
32 :ref:`import`
33 The language reference for the :keyword:`import` statement.
34
Benjamin Peterson60dbed12017-09-05 16:24:39 -070035 `Packages specification <https://www.python.org/doc/essays/packages/>`__
Brett Cannonafccd632009-01-20 02:21:27 +000036 Original specification of packages. Some semantics have changed since
Georg Brandl375aec22011-01-15 17:03:02 +000037 the writing of this document (e.g. redirecting based on ``None``
Brett Cannonafccd632009-01-20 02:21:27 +000038 in :data:`sys.modules`).
39
40 The :func:`.__import__` function
Brett Cannon0e13c942010-06-29 18:26:11 +000041 The :keyword:`import` statement is syntactic sugar for this function.
Brett Cannonafccd632009-01-20 02:21:27 +000042
43 :pep:`235`
44 Import on Case-Insensitive Platforms
45
46 :pep:`263`
47 Defining Python Source Code Encodings
48
49 :pep:`302`
Brett Cannonf23e3742010-06-27 23:57:46 +000050 New Import Hooks
Brett Cannonafccd632009-01-20 02:21:27 +000051
52 :pep:`328`
53 Imports: Multi-Line and Absolute/Relative
54
55 :pep:`366`
56 Main module explicit relative imports
57
Eric Snow338502b2016-05-28 11:56:53 -060058 :pep:`420`
59 Implicit namespace packages
60
Brett Cannon07fbd782014-02-06 09:46:08 -050061 :pep:`451`
62 A ModuleSpec Type for the Import System
63
Nick Coghland5cacbb2015-05-23 22:24:10 +100064 :pep:`488`
65 Elimination of PYO files
66
67 :pep:`489`
68 Multi-phase extension module initialization
69
Benjamin Peterson42aa93b2017-12-09 10:26:52 -080070 :pep:`552`
71 Deterministic pycs
72
Brett Cannon8917d5e2010-01-13 19:21:00 +000073 :pep:`3120`
Brett Cannonafccd632009-01-20 02:21:27 +000074 Using UTF-8 as the Default Source Encoding
75
Brett Cannon30b7a902010-06-27 21:49:22 +000076 :pep:`3147`
77 PYC Repository Directories
78
Brett Cannonafccd632009-01-20 02:21:27 +000079
80Functions
81---------
82
Brett Cannoncb4996a2012-08-06 16:34:44 -040083.. function:: __import__(name, globals=None, locals=None, fromlist=(), level=0)
Brett Cannonafccd632009-01-20 02:21:27 +000084
Brett Cannonf23e3742010-06-27 23:57:46 +000085 An implementation of the built-in :func:`__import__` function.
Brett Cannonafccd632009-01-20 02:21:27 +000086
Brett Cannon3fa84222015-02-20 10:34:20 -050087 .. note::
88 Programmatic importing of modules should use :func:`import_module`
89 instead of this function.
90
Brett Cannonafccd632009-01-20 02:21:27 +000091.. function:: import_module(name, package=None)
92
Brett Cannon33418c82009-01-22 18:37:20 +000093 Import a module. The *name* argument specifies what module to
Brett Cannonafccd632009-01-20 02:21:27 +000094 import in absolute or relative terms
95 (e.g. either ``pkg.mod`` or ``..mod``). If the name is
Guido van Rossum09613542009-03-30 20:34:57 +000096 specified in relative terms, then the *package* argument must be set to
97 the name of the package which is to act as the anchor for resolving the
Brett Cannonafccd632009-01-20 02:21:27 +000098 package name (e.g. ``import_module('..mod', 'pkg.subpkg')`` will import
Brett Cannon2c318a12009-02-07 01:15:27 +000099 ``pkg.mod``).
Brett Cannon78246b62009-01-25 04:56:30 +0000100
Brett Cannon2c318a12009-02-07 01:15:27 +0000101 The :func:`import_module` function acts as a simplifying wrapper around
Brett Cannon9f4cb1c2009-04-01 23:26:47 +0000102 :func:`importlib.__import__`. This means all semantics of the function are
Brett Cannon3fa84222015-02-20 10:34:20 -0500103 derived from :func:`importlib.__import__`. The most important difference
104 between these two functions is that :func:`import_module` returns the
105 specified package or module (e.g. ``pkg.mod``), while :func:`__import__`
106 returns the top-level package or module (e.g. ``pkg``).
107
108 If you are dynamically importing a module that was created since the
109 interpreter began execution (e.g., created a Python source file), you may
110 need to call :func:`invalidate_caches` in order for the new module to be
111 noticed by the import system.
Guido van Rossum09613542009-03-30 20:34:57 +0000112
Brett Cannon98620d82013-12-13 13:57:41 -0500113 .. versionchanged:: 3.3
114 Parent packages are automatically imported.
115
Brett Cannonee78a2b2012-05-12 17:43:17 -0400116.. function:: find_loader(name, path=None)
117
118 Find the loader for a module, optionally within the specified *path*. If the
119 module is in :attr:`sys.modules`, then ``sys.modules[name].__loader__`` is
Brett Cannon32799232013-03-13 11:09:08 -0700120 returned (unless the loader would be ``None`` or is not set, in which case
Brett Cannonee78a2b2012-05-12 17:43:17 -0400121 :exc:`ValueError` is raised). Otherwise a search using :attr:`sys.meta_path`
122 is done. ``None`` is returned if no loader is found.
123
Benjamin Petersonf7e2ea22016-09-05 14:02:59 -0700124 A dotted name does not have its parents implicitly imported as that requires
Brett Cannon56b4ca72012-11-17 09:30:55 -0500125 loading them and that may not be desired. To properly import a submodule you
126 will need to import all parent packages of the submodule and use the correct
127 argument to *path*.
Brett Cannonee78a2b2012-05-12 17:43:17 -0400128
Brett Cannon32799232013-03-13 11:09:08 -0700129 .. versionadded:: 3.3
130
131 .. versionchanged:: 3.4
132 If ``__loader__`` is not set, raise :exc:`ValueError`, just like when the
133 attribute is set to ``None``.
134
Eric Snowca2d8542013-12-16 23:06:52 -0700135 .. deprecated:: 3.4
Eric Snow6029e082014-01-25 15:32:46 -0700136 Use :func:`importlib.util.find_spec` instead.
Eric Snowca2d8542013-12-16 23:06:52 -0700137
Antoine Pitrouc541f8e2012-02-20 01:48:16 +0100138.. function:: invalidate_caches()
139
Brett Cannonf4dc9202012-08-10 12:21:12 -0400140 Invalidate the internal caches of finders stored at
141 :data:`sys.meta_path`. If a finder implements ``invalidate_caches()`` then it
Brett Cannon4067aa22013-04-27 23:20:32 -0400142 will be called to perform the invalidation. This function should be called
143 if any modules are created/installed while your program is running to
144 guarantee all finders will notice the new module's existence.
Antoine Pitrouc541f8e2012-02-20 01:48:16 +0100145
146 .. versionadded:: 3.3
147
Brett Cannon3fe35e62013-06-14 15:04:26 -0400148.. function:: reload(module)
149
150 Reload a previously imported *module*. The argument must be a module object,
151 so it must have been successfully imported before. This is useful if you
152 have edited the module source file using an external editor and want to try
153 out the new version without leaving the Python interpreter. The return value
Brett Cannon8ad37862013-10-25 13:52:46 -0400154 is the module object (which can be different if re-importing causes a
155 different object to be placed in :data:`sys.modules`).
Brett Cannon3fe35e62013-06-14 15:04:26 -0400156
Brett Cannon8ad37862013-10-25 13:52:46 -0400157 When :func:`reload` is executed:
Brett Cannon3fe35e62013-06-14 15:04:26 -0400158
Larry Hastings3732ed22014-03-15 21:13:56 -0700159 * Python module's code is recompiled and the module-level code re-executed,
Brett Cannon3fe35e62013-06-14 15:04:26 -0400160 defining a new set of objects which are bound to names in the module's
161 dictionary by reusing the :term:`loader` which originally loaded the
162 module. The ``init`` function of extension modules is not called a second
163 time.
164
165 * As with all other objects in Python the old objects are only reclaimed
166 after their reference counts drop to zero.
167
168 * The names in the module namespace are updated to point to any new or
169 changed objects.
170
171 * Other references to the old objects (such as names external to the module) are
172 not rebound to refer to the new objects and must be updated in each namespace
173 where they occur if that is desired.
174
175 There are a number of other caveats:
176
Brett Cannon3fe35e62013-06-14 15:04:26 -0400177 When a module is reloaded, its dictionary (containing the module's global
178 variables) is retained. Redefinitions of names will override the old
179 definitions, so this is generally not a problem. If the new version of a
180 module does not define a name that was defined by the old version, the old
181 definition remains. This feature can be used to the module's advantage if it
182 maintains a global table or cache of objects --- with a :keyword:`try`
183 statement it can test for the table's presence and skip its initialization if
184 desired::
185
186 try:
187 cache
188 except NameError:
189 cache = {}
190
Robert Collins1ae28d22015-08-05 08:20:53 +1200191 It is generally not very useful to reload built-in or dynamically loaded
192 modules. Reloading :mod:`sys`, :mod:`__main__`, :mod:`builtins` and other
193 key modules is not recommended. In many cases extension modules are not
194 designed to be initialized more than once, and may fail in arbitrary ways
195 when reloaded.
Brett Cannon3fe35e62013-06-14 15:04:26 -0400196
197 If a module imports objects from another module using :keyword:`from` ...
198 :keyword:`import` ..., calling :func:`reload` for the other module does not
199 redefine the objects imported from it --- one way around this is to
Serhiy Storchaka2b57c432018-12-19 08:09:46 +0200200 re-execute the :keyword:`!from` statement, another is to use :keyword:`!import`
Brett Cannon3fe35e62013-06-14 15:04:26 -0400201 and qualified names (*module.name*) instead.
202
203 If a module instantiates instances of a class, reloading the module that
204 defines the class does not affect the method definitions of the instances ---
205 they continue to use the old class definition. The same is true for derived
206 classes.
207
208 .. versionadded:: 3.4
Garvit Khatri94987822017-05-25 03:49:50 +0530209 .. versionchanged:: 3.7
210 :exc:`ModuleNotFoundError` is raised when the module being reloaded lacks
211 a :class:`ModuleSpec`.
Brett Cannon3fe35e62013-06-14 15:04:26 -0400212
Brett Cannon78246b62009-01-25 04:56:30 +0000213
Brett Cannon2a922ed2009-03-09 03:35:50 +0000214:mod:`importlib.abc` -- Abstract base classes related to import
215---------------------------------------------------------------
216
217.. module:: importlib.abc
218 :synopsis: Abstract base classes related to import
219
Terry Jan Reedydcb6c882016-06-22 22:46:34 -0400220**Source code:** :source:`Lib/importlib/abc.py`
221
222--------------
223
224
Brett Cannon2a922ed2009-03-09 03:35:50 +0000225The :mod:`importlib.abc` module contains all of the core abstract base classes
226used by :keyword:`import`. Some subclasses of the core abstract base classes
227are also provided to help in implementing the core ABCs.
228
Andrew Svetlova8656542012-08-13 22:19:01 +0300229ABC hierarchy::
230
231 object
Brett Cannon1b799182012-08-17 14:08:24 -0400232 +-- Finder (deprecated)
Andrew Svetlova8656542012-08-13 22:19:01 +0300233 | +-- MetaPathFinder
234 | +-- PathEntryFinder
235 +-- Loader
236 +-- ResourceLoader --------+
237 +-- InspectLoader |
238 +-- ExecutionLoader --+
239 +-- FileLoader
240 +-- SourceLoader
Andrew Svetlova8656542012-08-13 22:19:01 +0300241
Brett Cannon2a922ed2009-03-09 03:35:50 +0000242
243.. class:: Finder
244
Brett Cannon1b799182012-08-17 14:08:24 -0400245 An abstract base class representing a :term:`finder`.
246
247 .. deprecated:: 3.3
248 Use :class:`MetaPathFinder` or :class:`PathEntryFinder` instead.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000249
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200250 .. abstractmethod:: find_module(fullname, path=None)
Brett Cannonb46a1792012-02-27 18:15:42 -0500251
Xtreakc151f782018-06-16 10:38:31 +0530252 An abstract method for finding a :term:`loader` for the specified
Brett Cannonf4dc9202012-08-10 12:21:12 -0400253 module. Originally specified in :pep:`302`, this method was meant
254 for use in :data:`sys.meta_path` and in the path-based import subsystem.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000255
Brett Cannon100883f2013-04-09 16:59:39 -0400256 .. versionchanged:: 3.4
257 Returns ``None`` when called instead of raising
258 :exc:`NotImplementedError`.
259
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000260
Brett Cannon077ef452012-08-02 17:50:06 -0400261.. class:: MetaPathFinder
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000262
Brett Cannonf4dc9202012-08-10 12:21:12 -0400263 An abstract base class representing a :term:`meta path finder`. For
264 compatibility, this is a subclass of :class:`Finder`.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000265
266 .. versionadded:: 3.3
267
Eric Snowca2d8542013-12-16 23:06:52 -0700268 .. method:: find_spec(fullname, path, target=None)
269
270 An abstract method for finding a :term:`spec <module spec>` for
271 the specified module. If this is a top-level import, *path* will
272 be ``None``. Otherwise, this is a search for a subpackage or
273 module and *path* will be the value of :attr:`__path__` from the
274 parent package. If a spec cannot be found, ``None`` is returned.
275 When passed in, ``target`` is a module object that the finder may
Brett Cannona85e9272016-01-08 14:33:09 -0800276 use to make a more educated guess about what spec to return.
jdkandersson9cbb97b2019-09-11 02:06:22 +1000277 :func:`importlib.util.spec_from_loader` may be useful for implementing
278 concrete ``MetaPathFinders``.
Eric Snowca2d8542013-12-16 23:06:52 -0700279
280 .. versionadded:: 3.4
281
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000282 .. method:: find_module(fullname, path)
283
Eric Snowca2d8542013-12-16 23:06:52 -0700284 A legacy method for finding a :term:`loader` for the specified
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000285 module. If this is a top-level import, *path* will be ``None``.
Ezio Melotti1f67e802012-10-21 07:24:13 +0300286 Otherwise, this is a search for a subpackage or module and *path*
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000287 will be the value of :attr:`__path__` from the parent
288 package. If a loader cannot be found, ``None`` is returned.
289
Brett Cannon8d942292014-01-07 15:52:42 -0500290 If :meth:`find_spec` is defined, backwards-compatible functionality is
291 provided.
292
Brett Cannon100883f2013-04-09 16:59:39 -0400293 .. versionchanged:: 3.4
294 Returns ``None`` when called instead of raising
Brett Cannon8d942292014-01-07 15:52:42 -0500295 :exc:`NotImplementedError`. Can use :meth:`find_spec` to provide
296 functionality.
Brett Cannon100883f2013-04-09 16:59:39 -0400297
Eric Snowca2d8542013-12-16 23:06:52 -0700298 .. deprecated:: 3.4
299 Use :meth:`find_spec` instead.
300
Brett Cannonf4dc9202012-08-10 12:21:12 -0400301 .. method:: invalidate_caches()
302
303 An optional method which, when called, should invalidate any internal
Brett Cannona6e85812012-08-11 19:41:27 -0400304 cache used by the finder. Used by :func:`importlib.invalidate_caches`
305 when invalidating the caches of all finders on :data:`sys.meta_path`.
Brett Cannonf4dc9202012-08-10 12:21:12 -0400306
Brett Cannon100883f2013-04-09 16:59:39 -0400307 .. versionchanged:: 3.4
308 Returns ``None`` when called instead of ``NotImplemented``.
309
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000310
Brett Cannon077ef452012-08-02 17:50:06 -0400311.. class:: PathEntryFinder
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000312
Brett Cannonf4dc9202012-08-10 12:21:12 -0400313 An abstract base class representing a :term:`path entry finder`. Though
314 it bears some similarities to :class:`MetaPathFinder`, ``PathEntryFinder``
315 is meant for use only within the path-based import subsystem provided
316 by :class:`PathFinder`. This ABC is a subclass of :class:`Finder` for
Brett Cannon100883f2013-04-09 16:59:39 -0400317 compatibility reasons only.
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000318
319 .. versionadded:: 3.3
320
Eric Snowca2d8542013-12-16 23:06:52 -0700321 .. method:: find_spec(fullname, target=None)
322
323 An abstract method for finding a :term:`spec <module spec>` for
324 the specified module. The finder will search for the module only
325 within the :term:`path entry` to which it is assigned. If a spec
326 cannot be found, ``None`` is returned. When passed in, ``target``
327 is a module object that the finder may use to make a more educated
jdkandersson9cbb97b2019-09-11 02:06:22 +1000328 guess about what spec to return. :func:`importlib.util.spec_from_loader`
329 may be useful for implementing concrete ``PathEntryFinders``.
Eric Snowca2d8542013-12-16 23:06:52 -0700330
331 .. versionadded:: 3.4
332
Brett Cannon4067aa22013-04-27 23:20:32 -0400333 .. method:: find_loader(fullname)
Nick Coghlan8a9080f2012-08-02 21:26:03 +1000334
Eric Snowca2d8542013-12-16 23:06:52 -0700335 A legacy method for finding a :term:`loader` for the specified
Brett Cannonf4dc9202012-08-10 12:21:12 -0400336 module. Returns a 2-tuple of ``(loader, portion)`` where ``portion``
337 is a sequence of file system locations contributing to part of a namespace
338 package. The loader may be ``None`` while specifying ``portion`` to
339 signify the contribution of the file system locations to a namespace
340 package. An empty list can be used for ``portion`` to signify the loader
Brett Cannon100883f2013-04-09 16:59:39 -0400341 is not part of a namespace package. If ``loader`` is ``None`` and
342 ``portion`` is the empty list then no loader or location for a namespace
343 package were found (i.e. failure to find anything for the module).
344
Brett Cannon8d942292014-01-07 15:52:42 -0500345 If :meth:`find_spec` is defined then backwards-compatible functionality is
346 provided.
347
Brett Cannon100883f2013-04-09 16:59:39 -0400348 .. versionchanged:: 3.4
349 Returns ``(None, [])`` instead of raising :exc:`NotImplementedError`.
Brett Cannon8d942292014-01-07 15:52:42 -0500350 Uses :meth:`find_spec` when available to provide functionality.
Brett Cannonf4dc9202012-08-10 12:21:12 -0400351
Eric Snowca2d8542013-12-16 23:06:52 -0700352 .. deprecated:: 3.4
353 Use :meth:`find_spec` instead.
354
Brett Cannon4067aa22013-04-27 23:20:32 -0400355 .. method:: find_module(fullname)
Brett Cannonf4dc9202012-08-10 12:21:12 -0400356
357 A concrete implementation of :meth:`Finder.find_module` which is
358 equivalent to ``self.find_loader(fullname)[0]``.
359
Eric Snowca2d8542013-12-16 23:06:52 -0700360 .. deprecated:: 3.4
361 Use :meth:`find_spec` instead.
362
Brett Cannonf4dc9202012-08-10 12:21:12 -0400363 .. method:: invalidate_caches()
364
365 An optional method which, when called, should invalidate any internal
Brett Cannona6e85812012-08-11 19:41:27 -0400366 cache used by the finder. Used by :meth:`PathFinder.invalidate_caches`
Brett Cannonf4dc9202012-08-10 12:21:12 -0400367 when invalidating the caches of all cached finders.
Brett Cannonb46a1792012-02-27 18:15:42 -0500368
Brett Cannon2a922ed2009-03-09 03:35:50 +0000369
370.. class:: Loader
371
372 An abstract base class for a :term:`loader`.
Guido van Rossum09613542009-03-30 20:34:57 +0000373 See :pep:`302` for the exact definition for a loader.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000374
Barry Warsaw997b8c12018-02-16 10:45:39 -0500375 Loaders that wish to support resource reading should implement a
376 ``get_resource_reader(fullname)`` method as specified by
377 :class:`importlib.abc.ResourceReader`.
Brett Cannonbca42182018-01-12 15:08:59 -0800378
379 .. versionchanged:: 3.7
380 Introduced the optional ``get_resource_reader()`` method.
381
Eric Snowca2d8542013-12-16 23:06:52 -0700382 .. method:: create_module(spec)
383
Brett Cannon02d84542015-01-09 11:39:21 -0500384 A method that returns the module object to use when
385 importing a module. This method may return ``None``,
386 indicating that default module creation semantics should take place.
Eric Snowca2d8542013-12-16 23:06:52 -0700387
388 .. versionadded:: 3.4
389
Brett Cannon02d84542015-01-09 11:39:21 -0500390 .. versionchanged:: 3.5
391 Starting in Python 3.6, this method will not be optional when
392 :meth:`exec_module` is defined.
393
Eric Snowca2d8542013-12-16 23:06:52 -0700394 .. method:: exec_module(module)
395
396 An abstract method that executes the module in its own namespace
397 when a module is imported or reloaded. The module should already
Brett Cannon696c35e2016-06-25 10:58:17 -0700398 be initialized when ``exec_module()`` is called. When this method exists,
399 :meth:`~importlib.abc.Loader.create_module` must be defined.
Eric Snowca2d8542013-12-16 23:06:52 -0700400
401 .. versionadded:: 3.4
402
Brett Cannon696c35e2016-06-25 10:58:17 -0700403 .. versionchanged:: 3.6
404 :meth:`~importlib.abc.Loader.create_module` must also be defined.
405
Brett Cannon9c751b72009-03-09 16:28:16 +0000406 .. method:: load_module(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000407
Eric Snowca2d8542013-12-16 23:06:52 -0700408 A legacy method for loading a module. If the module cannot be
Brett Cannon2a922ed2009-03-09 03:35:50 +0000409 loaded, :exc:`ImportError` is raised, otherwise the loaded module is
410 returned.
411
Guido van Rossum09613542009-03-30 20:34:57 +0000412 If the requested module already exists in :data:`sys.modules`, that
Brett Cannon2a922ed2009-03-09 03:35:50 +0000413 module should be used and reloaded.
Guido van Rossum09613542009-03-30 20:34:57 +0000414 Otherwise the loader should create a new module and insert it into
415 :data:`sys.modules` before any loading begins, to prevent recursion
416 from the import. If the loader inserted a module and the load fails, it
Brett Cannon2a922ed2009-03-09 03:35:50 +0000417 must be removed by the loader from :data:`sys.modules`; modules already
418 in :data:`sys.modules` before the loader began execution should be left
Eric Snowb523f842013-11-22 09:05:39 -0700419 alone (see :func:`importlib.util.module_for_loader`).
Brett Cannon2a922ed2009-03-09 03:35:50 +0000420
Guido van Rossum09613542009-03-30 20:34:57 +0000421 The loader should set several attributes on the module.
422 (Note that some of these attributes can change when a module is
Eric Snowb523f842013-11-22 09:05:39 -0700423 reloaded):
Brett Cannon2a922ed2009-03-09 03:35:50 +0000424
425 - :attr:`__name__`
426 The name of the module.
427
428 - :attr:`__file__`
429 The path to where the module data is stored (not set for built-in
430 modules).
431
Brett Cannon2cefb3c2013-05-25 11:26:11 -0400432 - :attr:`__cached__`
433 The path to where a compiled version of the module is/should be
434 stored (not set when the attribute would be inappropriate).
435
Brett Cannon2a922ed2009-03-09 03:35:50 +0000436 - :attr:`__path__`
Guido van Rossum09613542009-03-30 20:34:57 +0000437 A list of strings specifying the search path within a
Brett Cannon2a922ed2009-03-09 03:35:50 +0000438 package. This attribute is not set on modules.
439
440 - :attr:`__package__`
Géry Ogam27f1bd82020-10-21 23:17:35 +0200441 The fully-qualified name of the package under which the module was
442 loaded as a submodule (or the empty string for top-level modules).
443 For packages, it is the same as :attr:`__name__`. The
Brett Cannon100883f2013-04-09 16:59:39 -0400444 :func:`importlib.util.module_for_loader` decorator can handle the
445 details for :attr:`__package__`.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000446
447 - :attr:`__loader__`
Brett Cannon100883f2013-04-09 16:59:39 -0400448 The loader used to load the module. The
449 :func:`importlib.util.module_for_loader` decorator can handle the
450 details for :attr:`__package__`.
451
Brett Cannon8d942292014-01-07 15:52:42 -0500452 When :meth:`exec_module` is available then backwards-compatible
453 functionality is provided.
454
Brett Cannon100883f2013-04-09 16:59:39 -0400455 .. versionchanged:: 3.4
456 Raise :exc:`ImportError` when called instead of
Brett Cannon8d942292014-01-07 15:52:42 -0500457 :exc:`NotImplementedError`. Functionality provided when
458 :meth:`exec_module` is available.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000459
Eric Snowca2d8542013-12-16 23:06:52 -0700460 .. deprecated:: 3.4
461 The recommended API for loading a module is :meth:`exec_module`
Brett Cannon02d84542015-01-09 11:39:21 -0500462 (and :meth:`create_module`). Loaders should implement
Eric Snowca2d8542013-12-16 23:06:52 -0700463 it instead of load_module(). The import machinery takes care of
464 all the other responsibilities of load_module() when exec_module()
465 is implemented.
466
Barry Warsawd7d21942012-07-29 16:36:17 -0400467 .. method:: module_repr(module)
468
Eric Snowca2d8542013-12-16 23:06:52 -0700469 A legacy method which when implemented calculates and returns the
Brett Cannon100883f2013-04-09 16:59:39 -0400470 given module's repr, as a string. The module type's default repr() will
471 use the result of this method as appropriate.
Barry Warsawd7d21942012-07-29 16:36:17 -0400472
Georg Brandl526575d2013-04-11 16:10:13 +0200473 .. versionadded:: 3.3
Barry Warsawd7d21942012-07-29 16:36:17 -0400474
Brett Cannon100883f2013-04-09 16:59:39 -0400475 .. versionchanged:: 3.4
Georg Brandl526575d2013-04-11 16:10:13 +0200476 Made optional instead of an abstractmethod.
Brett Cannon100883f2013-04-09 16:59:39 -0400477
Eric Snowca2d8542013-12-16 23:06:52 -0700478 .. deprecated:: 3.4
479 The import machinery now takes care of this automatically.
480
Brett Cannon2a922ed2009-03-09 03:35:50 +0000481
Brett Cannon4ac51502017-12-15 16:29:35 -0800482.. class:: ResourceReader
483
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400484 *Superseded by TraversableReader*
485
Brett Cannonbca42182018-01-12 15:08:59 -0800486 An :term:`abstract base class` to provide the ability to read
Brett Cannon4ac51502017-12-15 16:29:35 -0800487 *resources*.
488
489 From the perspective of this ABC, a *resource* is a binary
490 artifact that is shipped within a package. Typically this is
491 something like a data file that lives next to the ``__init__.py``
492 file of the package. The purpose of this class is to help abstract
493 out the accessing of such data files so that it does not matter if
494 the package and its data file(s) are stored in a e.g. zip file
495 versus on the file system.
496
497 For any of methods of this class, a *resource* argument is
Barry Warsawdeae6b42017-12-30 15:18:06 -0500498 expected to be a :term:`path-like object` which represents
Brett Cannon4ac51502017-12-15 16:29:35 -0800499 conceptually just a file name. This means that no subdirectory
500 paths should be included in the *resource* argument. This is
Brett Cannonbca42182018-01-12 15:08:59 -0800501 because the location of the package the reader is for, acts as the
502 "directory". Hence the metaphor for directories and file
Brett Cannon4ac51502017-12-15 16:29:35 -0800503 names is packages and resources, respectively. This is also why
504 instances of this class are expected to directly correlate to
505 a specific package (instead of potentially representing multiple
506 packages or a module).
507
Brett Cannonbca42182018-01-12 15:08:59 -0800508 Loaders that wish to support resource reading are expected to
aldwinaldwinb607d992019-07-04 08:58:45 +0800509 provide a method called ``get_resource_reader(fullname)`` which
Brett Cannonbca42182018-01-12 15:08:59 -0800510 returns an object implementing this ABC's interface. If the module
511 specified by fullname is not a package, this method should return
512 :const:`None`. An object compatible with this ABC should only be
513 returned when the specified module is a package.
514
Brett Cannon4ac51502017-12-15 16:29:35 -0800515 .. versionadded:: 3.7
516
517 .. abstractmethod:: open_resource(resource)
518
519 Returns an opened, :term:`file-like object` for binary reading
520 of the *resource*.
521
522 If the resource cannot be found, :exc:`FileNotFoundError` is
523 raised.
524
525 .. abstractmethod:: resource_path(resource)
526
527 Returns the file system path to the *resource*.
528
529 If the resource does not concretely exist on the file system,
530 raise :exc:`FileNotFoundError`.
531
532 .. abstractmethod:: is_resource(name)
533
534 Returns ``True`` if the named *name* is considered a resource.
535 :exc:`FileNotFoundError` is raised if *name* does not exist.
536
537 .. abstractmethod:: contents()
538
Brett Cannon3ab93652018-04-30 11:31:45 -0700539 Returns an :term:`iterable` of strings over the contents of
Brett Cannon4ac51502017-12-15 16:29:35 -0800540 the package. Do note that it is not required that all names
541 returned by the iterator be actual resources, e.g. it is
542 acceptable to return names for which :meth:`is_resource` would
543 be false.
544
545 Allowing non-resource names to be returned is to allow for
546 situations where how a package and its resources are stored
547 are known a priori and the non-resource names would be useful.
548 For instance, returning subdirectory names is allowed so that
549 when it is known that the package and resources are stored on
Brett Cannonbca42182018-01-12 15:08:59 -0800550 the file system then those subdirectory names can be used
551 directly.
Brett Cannon4ac51502017-12-15 16:29:35 -0800552
Brett Cannon3ab93652018-04-30 11:31:45 -0700553 The abstract method returns an iterable of no items.
Brett Cannon4ac51502017-12-15 16:29:35 -0800554
555
Brett Cannon2a922ed2009-03-09 03:35:50 +0000556.. class:: ResourceLoader
557
558 An abstract base class for a :term:`loader` which implements the optional
559 :pep:`302` protocol for loading arbitrary resources from the storage
560 back-end.
561
Brett Cannonbca42182018-01-12 15:08:59 -0800562 .. deprecated:: 3.7
563 This ABC is deprecated in favour of supporting resource loading
564 through :class:`importlib.abc.ResourceReader`.
565
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200566 .. abstractmethod:: get_data(path)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000567
568 An abstract method to return the bytes for the data located at *path*.
Guido van Rossum09613542009-03-30 20:34:57 +0000569 Loaders that have a file-like storage back-end
Brett Cannon16248a42009-04-01 20:47:14 +0000570 that allows storing arbitrary data
Guido van Rossum09613542009-03-30 20:34:57 +0000571 can implement this abstract method to give direct access
Andrew Svetlov08af0002014-04-01 01:13:30 +0300572 to the data stored. :exc:`OSError` is to be raised if the *path* cannot
Brett Cannon2a922ed2009-03-09 03:35:50 +0000573 be found. The *path* is expected to be constructed using a module's
Brett Cannon16248a42009-04-01 20:47:14 +0000574 :attr:`__file__` attribute or an item from a package's :attr:`__path__`.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000575
Brett Cannon100883f2013-04-09 16:59:39 -0400576 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300577 Raises :exc:`OSError` instead of :exc:`NotImplementedError`.
Brett Cannon100883f2013-04-09 16:59:39 -0400578
Brett Cannon2a922ed2009-03-09 03:35:50 +0000579
580.. class:: InspectLoader
581
582 An abstract base class for a :term:`loader` which implements the optional
Guido van Rossum09613542009-03-30 20:34:57 +0000583 :pep:`302` protocol for loaders that inspect modules.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000584
Brett Cannona113ac52009-03-15 01:41:33 +0000585 .. method:: get_code(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000586
R David Murray0ae7ae12014-01-08 18:16:02 -0500587 Return the code object for a module, or ``None`` if the module does not
588 have a code object (as would be the case, for example, for a built-in
589 module). Raise an :exc:`ImportError` if loader cannot find the
590 requested module.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000591
Brett Cannon3b62ca82013-05-27 21:11:04 -0400592 .. note::
593 While the method has a default implementation, it is suggested that
594 it be overridden if possible for performance.
595
R David Murray1b00f252012-08-15 10:43:58 -0400596 .. index::
597 single: universal newlines; importlib.abc.InspectLoader.get_source method
598
Brett Cannon100883f2013-04-09 16:59:39 -0400599 .. versionchanged:: 3.4
Brett Cannon3b62ca82013-05-27 21:11:04 -0400600 No longer abstract and a concrete implementation is provided.
Brett Cannon100883f2013-04-09 16:59:39 -0400601
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200602 .. abstractmethod:: get_source(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000603
604 An abstract method to return the source of a module. It is returned as
R David Murray1b00f252012-08-15 10:43:58 -0400605 a text string using :term:`universal newlines`, translating all
R David Murrayee0a9452012-08-15 11:05:36 -0400606 recognized line separators into ``'\n'`` characters. Returns ``None``
607 if no source is available (e.g. a built-in module). Raises
608 :exc:`ImportError` if the loader cannot find the module specified.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000609
Brett Cannon100883f2013-04-09 16:59:39 -0400610 .. versionchanged:: 3.4
611 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
612
Brett Cannona113ac52009-03-15 01:41:33 +0000613 .. method:: is_package(fullname)
Brett Cannon2a922ed2009-03-09 03:35:50 +0000614
Brett Cannona113ac52009-03-15 01:41:33 +0000615 An abstract method to return a true value if the module is a package, a
616 false value otherwise. :exc:`ImportError` is raised if the
617 :term:`loader` cannot find the module.
Brett Cannon2a922ed2009-03-09 03:35:50 +0000618
Brett Cannon100883f2013-04-09 16:59:39 -0400619 .. versionchanged:: 3.4
620 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
621
Brett Cannon6eaac132014-05-09 12:28:22 -0400622 .. staticmethod:: source_to_code(data, path='<string>')
Brett Cannon9ffe85e2013-05-26 16:45:10 -0400623
624 Create a code object from Python source.
625
626 The *data* argument can be whatever the :func:`compile` function
627 supports (i.e. string or bytes). The *path* argument should be
628 the "path" to where the source code originated from, which can be an
629 abstract concept (e.g. location in a zip file).
630
Brett Cannon6eaac132014-05-09 12:28:22 -0400631 With the subsequent code object one can execute it in a module by
632 running ``exec(code, module.__dict__)``.
633
Brett Cannon9ffe85e2013-05-26 16:45:10 -0400634 .. versionadded:: 3.4
635
Brett Cannon6eaac132014-05-09 12:28:22 -0400636 .. versionchanged:: 3.5
637 Made the method static.
638
Eric Snowca2d8542013-12-16 23:06:52 -0700639 .. method:: exec_module(module)
640
641 Implementation of :meth:`Loader.exec_module`.
642
643 .. versionadded:: 3.4
644
Brett Cannon0dbb4c72013-05-31 18:56:47 -0400645 .. method:: load_module(fullname)
646
Eric Snowca2d8542013-12-16 23:06:52 -0700647 Implementation of :meth:`Loader.load_module`.
648
649 .. deprecated:: 3.4
650 use :meth:`exec_module` instead.
Brett Cannon0dbb4c72013-05-31 18:56:47 -0400651
Brett Cannon2a922ed2009-03-09 03:35:50 +0000652
Brett Cannon69194272009-07-20 04:23:48 +0000653.. class:: ExecutionLoader
654
655 An abstract base class which inherits from :class:`InspectLoader` that,
Brett Cannon23460292009-07-20 22:59:00 +0000656 when implemented, helps a module to be executed as a script. The ABC
Brett Cannon69194272009-07-20 04:23:48 +0000657 represents an optional :pep:`302` protocol.
658
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200659 .. abstractmethod:: get_filename(fullname)
Brett Cannon69194272009-07-20 04:23:48 +0000660
Brett Cannonf23e3742010-06-27 23:57:46 +0000661 An abstract method that is to return the value of :attr:`__file__` for
Brett Cannon69194272009-07-20 04:23:48 +0000662 the specified module. If no path is available, :exc:`ImportError` is
663 raised.
664
Brett Cannonf23e3742010-06-27 23:57:46 +0000665 If source code is available, then the method should return the path to
666 the source file, regardless of whether a bytecode was used to load the
667 module.
668
Brett Cannon100883f2013-04-09 16:59:39 -0400669 .. versionchanged:: 3.4
670 Raises :exc:`ImportError` instead of :exc:`NotImplementedError`.
671
Brett Cannonf23e3742010-06-27 23:57:46 +0000672
Brett Cannon938d44d2012-04-22 19:58:33 -0400673.. class:: FileLoader(fullname, path)
674
675 An abstract base class which inherits from :class:`ResourceLoader` and
Andrew Svetlova60de4f2013-02-17 16:55:58 +0200676 :class:`ExecutionLoader`, providing concrete implementations of
Brett Cannon938d44d2012-04-22 19:58:33 -0400677 :meth:`ResourceLoader.get_data` and :meth:`ExecutionLoader.get_filename`.
678
679 The *fullname* argument is a fully resolved name of the module the loader is
680 to handle. The *path* argument is the path to the file for the module.
681
682 .. versionadded:: 3.3
683
684 .. attribute:: name
685
686 The name of the module the loader can handle.
687
688 .. attribute:: path
689
690 Path to the file of the module.
691
Barry Warsawd7d21942012-07-29 16:36:17 -0400692 .. method:: load_module(fullname)
Brett Cannonc0499522012-05-11 14:48:41 -0400693
Barry Warsawd7d21942012-07-29 16:36:17 -0400694 Calls super's ``load_module()``.
Brett Cannonc0499522012-05-11 14:48:41 -0400695
Eric Snowca2d8542013-12-16 23:06:52 -0700696 .. deprecated:: 3.4
697 Use :meth:`Loader.exec_module` instead.
698
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200699 .. abstractmethod:: get_filename(fullname)
Brett Cannon938d44d2012-04-22 19:58:33 -0400700
Barry Warsawd7d21942012-07-29 16:36:17 -0400701 Returns :attr:`path`.
Brett Cannon938d44d2012-04-22 19:58:33 -0400702
Berker Peksag6e9d2e62015-12-08 12:14:50 +0200703 .. abstractmethod:: get_data(path)
Brett Cannon938d44d2012-04-22 19:58:33 -0400704
Brett Cannon3b62ca82013-05-27 21:11:04 -0400705 Reads *path* as a binary file and returns the bytes from it.
Brett Cannon938d44d2012-04-22 19:58:33 -0400706
707
Brett Cannonf23e3742010-06-27 23:57:46 +0000708.. class:: SourceLoader
709
710 An abstract base class for implementing source (and optionally bytecode)
711 file loading. The class inherits from both :class:`ResourceLoader` and
712 :class:`ExecutionLoader`, requiring the implementation of:
713
714 * :meth:`ResourceLoader.get_data`
715 * :meth:`ExecutionLoader.get_filename`
Brett Cannon6dfbff32010-07-21 09:48:31 +0000716 Should only return the path to the source file; sourceless
Brett Cannona81d5272013-06-16 19:17:12 -0400717 loading is not supported.
Brett Cannonf23e3742010-06-27 23:57:46 +0000718
719 The abstract methods defined by this class are to add optional bytecode
Brett Cannon5650e4f2012-11-18 10:03:31 -0500720 file support. Not implementing these optional methods (or causing them to
721 raise :exc:`NotImplementedError`) causes the loader to
Brett Cannonf23e3742010-06-27 23:57:46 +0000722 only work with source code. Implementing the methods allows the loader to
723 work with source *and* bytecode files; it does not allow for *sourceless*
724 loading where only bytecode is provided. Bytecode files are an
725 optimization to speed up loading by removing the parsing step of Python's
726 compiler, and so no bytecode-specific API is exposed.
727
Brett Cannon773468f2012-08-02 17:35:34 -0400728 .. method:: path_stats(path)
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100729
730 Optional abstract method which returns a :class:`dict` containing
Martin Pantereb995702016-07-28 01:11:04 +0000731 metadata about the specified path. Supported dictionary keys are:
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100732
733 - ``'mtime'`` (mandatory): an integer or floating-point number
734 representing the modification time of the source code;
735 - ``'size'`` (optional): the size in bytes of the source code.
736
737 Any other keys in the dictionary are ignored, to allow for future
Andrew Svetlov08af0002014-04-01 01:13:30 +0300738 extensions. If the path cannot be handled, :exc:`OSError` is raised.
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100739
740 .. versionadded:: 3.3
741
Brett Cannon100883f2013-04-09 16:59:39 -0400742 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300743 Raise :exc:`OSError` instead of :exc:`NotImplementedError`.
Brett Cannon100883f2013-04-09 16:59:39 -0400744
Brett Cannon773468f2012-08-02 17:35:34 -0400745 .. method:: path_mtime(path)
Brett Cannonf23e3742010-06-27 23:57:46 +0000746
747 Optional abstract method which returns the modification time for the
748 specified path.
749
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100750 .. deprecated:: 3.3
751 This method is deprecated in favour of :meth:`path_stats`. You don't
752 have to implement it, but it is still available for compatibility
Andrew Svetlov08af0002014-04-01 01:13:30 +0300753 purposes. Raise :exc:`OSError` if the path cannot be handled.
Brett Cannon100883f2013-04-09 16:59:39 -0400754
Georg Brandldf48b972014-03-24 09:06:18 +0100755 .. versionchanged:: 3.4
Andrew Svetlov08af0002014-04-01 01:13:30 +0300756 Raise :exc:`OSError` instead of :exc:`NotImplementedError`.
Antoine Pitrou5136ac02012-01-13 18:52:16 +0100757
Brett Cannon773468f2012-08-02 17:35:34 -0400758 .. method:: set_data(path, data)
Brett Cannonf23e3742010-06-27 23:57:46 +0000759
760 Optional abstract method which writes the specified bytes to a file
Brett Cannon61b14252010-07-03 21:48:25 +0000761 path. Any intermediate directories which do not exist are to be created
762 automatically.
763
764 When writing to the path fails because the path is read-only
Brett Cannon2cefb3c2013-05-25 11:26:11 -0400765 (:attr:`errno.EACCES`/:exc:`PermissionError`), do not propagate the
766 exception.
Brett Cannonf23e3742010-06-27 23:57:46 +0000767
Brett Cannon100883f2013-04-09 16:59:39 -0400768 .. versionchanged:: 3.4
769 No longer raises :exc:`NotImplementedError` when called.
770
Brett Cannon773468f2012-08-02 17:35:34 -0400771 .. method:: get_code(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000772
773 Concrete implementation of :meth:`InspectLoader.get_code`.
774
Eric Snowca2d8542013-12-16 23:06:52 -0700775 .. method:: exec_module(module)
776
777 Concrete implementation of :meth:`Loader.exec_module`.
778
Andrés Delfino65b5ef02018-08-12 03:50:46 -0300779 .. versionadded:: 3.4
Eric Snowca2d8542013-12-16 23:06:52 -0700780
Brett Cannon773468f2012-08-02 17:35:34 -0400781 .. method:: load_module(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000782
Eric Snowca2d8542013-12-16 23:06:52 -0700783 Concrete implementation of :meth:`Loader.load_module`.
784
785 .. deprecated:: 3.4
786 Use :meth:`exec_module` instead.
Brett Cannonf23e3742010-06-27 23:57:46 +0000787
Brett Cannon773468f2012-08-02 17:35:34 -0400788 .. method:: get_source(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000789
790 Concrete implementation of :meth:`InspectLoader.get_source`.
791
Brett Cannon773468f2012-08-02 17:35:34 -0400792 .. method:: is_package(fullname)
Brett Cannonf23e3742010-06-27 23:57:46 +0000793
794 Concrete implementation of :meth:`InspectLoader.is_package`. A module
Brett Cannonea0b8232012-06-15 20:00:53 -0400795 is determined to be a package if its file path (as provided by
796 :meth:`ExecutionLoader.get_filename`) is a file named
797 ``__init__`` when the file extension is removed **and** the module name
798 itself does not end in ``__init__``.
Brett Cannonf23e3742010-06-27 23:57:46 +0000799
Brett Cannon69194272009-07-20 04:23:48 +0000800
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400801.. class:: Traversable
802
803 An object with a subset of pathlib.Path methods suitable for
804 traversing directories and opening files.
805
806 .. versionadded:: 3.9
807
808
809.. class:: TraversableReader
810
811 An abstract base class for resource readers capable of serving
812 the ``files`` interface. Subclasses ResourceReader and provides
813 concrete implementations of the ResourceReader's abstract
814 methods. Therefore, any loader supplying TraversableReader
815 also supplies ResourceReader.
816
817 Loaders that wish to support resource reading are expected to
818 implement this interface.
819
820 .. versionadded:: 3.9
821
822
Barry Warsawdeae6b42017-12-30 15:18:06 -0500823:mod:`importlib.resources` -- Resources
824---------------------------------------
825
826.. module:: importlib.resources
827 :synopsis: Package resource reading, opening, and access
828
829**Source code:** :source:`Lib/importlib/resources.py`
830
831--------------
832
833.. versionadded:: 3.7
834
835This module leverages Python's import system to provide access to *resources*
836within *packages*. If you can import a package, you can access resources
837within that package. Resources can be opened or read, in either binary or
838text mode.
839
840Resources are roughly akin to files inside directories, though it's important
841to keep in mind that this is just a metaphor. Resources and packages **do
842not** have to exist as physical files and directories on the file system.
843
Barry Warsaw997b8c12018-02-16 10:45:39 -0500844.. note::
845
846 This module provides functionality similar to `pkg_resources
847 <https://setuptools.readthedocs.io/en/latest/pkg_resources.html>`_ `Basic
848 Resource Access
849 <http://setuptools.readthedocs.io/en/latest/pkg_resources.html#basic-resource-access>`_
850 without the performance overhead of that package. This makes reading
851 resources included in packages easier, with more stable and consistent
852 semantics.
853
854 The standalone backport of this module provides more information
855 on `using importlib.resources
856 <http://importlib-resources.readthedocs.io/en/latest/using.html>`_ and
857 `migrating from pkg_resources to importlib.resources
858 <http://importlib-resources.readthedocs.io/en/latest/migration.html>`_.
859
860Loaders that wish to support resource reading should implement a
861``get_resource_reader(fullname)`` method as specified by
862:class:`importlib.abc.ResourceReader`.
Barry Warsawdeae6b42017-12-30 15:18:06 -0500863
864The following types are defined.
865
866.. data:: Package
867
868 The ``Package`` type is defined as ``Union[str, ModuleType]``. This means
869 that where the function describes accepting a ``Package``, you can pass in
870 either a string or a module. Module objects must have a resolvable
871 ``__spec__.submodule_search_locations`` that is not ``None``.
872
873.. data:: Resource
874
875 This type describes the resource names passed into the various functions
876 in this package. This is defined as ``Union[str, os.PathLike]``.
877
878
879The following functions are available.
880
Jason R. Coombs7f7e7062020-05-08 19:20:26 -0400881
882.. function:: files(package)
883
884 Returns an :class:`importlib.resources.abc.Traversable` object
885 representing the resource container for the package (think directory)
886 and its resources (think files). A Traversable may contain other
887 containers (think subdirectories).
888
889 *package* is either a name or a module object which conforms to the
890 ``Package`` requirements.
891
892 .. versionadded:: 3.9
893
Barry Warsawdeae6b42017-12-30 15:18:06 -0500894.. function:: open_binary(package, resource)
895
896 Open for binary reading the *resource* within *package*.
897
898 *package* is either a name or a module object which conforms to the
899 ``Package`` requirements. *resource* is the name of the resource to open
900 within *package*; it may not contain path separators and it may not have
901 sub-resources (i.e. it cannot be a directory). This function returns a
902 ``typing.BinaryIO`` instance, a binary I/O stream open for reading.
903
904
905.. function:: open_text(package, resource, encoding='utf-8', errors='strict')
906
907 Open for text reading the *resource* within *package*. By default, the
908 resource is opened for reading as UTF-8.
909
910 *package* is either a name or a module object which conforms to the
911 ``Package`` requirements. *resource* is the name of the resource to open
912 within *package*; it may not contain path separators and it may not have
913 sub-resources (i.e. it cannot be a directory). *encoding* and *errors*
914 have the same meaning as with built-in :func:`open`.
915
916 This function returns a ``typing.TextIO`` instance, a text I/O stream open
917 for reading.
918
919
920.. function:: read_binary(package, resource)
921
922 Read and return the contents of the *resource* within *package* as
923 ``bytes``.
924
925 *package* is either a name or a module object which conforms to the
926 ``Package`` requirements. *resource* is the name of the resource to open
927 within *package*; it may not contain path separators and it may not have
928 sub-resources (i.e. it cannot be a directory). This function returns the
929 contents of the resource as :class:`bytes`.
930
931
932.. function:: read_text(package, resource, encoding='utf-8', errors='strict')
933
934 Read and return the contents of *resource* within *package* as a ``str``.
935 By default, the contents are read as strict UTF-8.
936
937 *package* is either a name or a module object which conforms to the
938 ``Package`` requirements. *resource* is the name of the resource to open
939 within *package*; it may not contain path separators and it may not have
940 sub-resources (i.e. it cannot be a directory). *encoding* and *errors*
941 have the same meaning as with built-in :func:`open`. This function
942 returns the contents of the resource as :class:`str`.
943
944
945.. function:: path(package, resource)
946
947 Return the path to the *resource* as an actual file system path. This
948 function returns a context manager for use in a :keyword:`with` statement.
949 The context manager provides a :class:`pathlib.Path` object.
950
951 Exiting the context manager cleans up any temporary file created when the
952 resource needs to be extracted from e.g. a zip file.
953
954 *package* is either a name or a module object which conforms to the
955 ``Package`` requirements. *resource* is the name of the resource to open
956 within *package*; it may not contain path separators and it may not have
957 sub-resources (i.e. it cannot be a directory).
958
959
960.. function:: is_resource(package, name)
961
962 Return ``True`` if there is a resource named *name* in the package,
963 otherwise ``False``. Remember that directories are *not* resources!
964 *package* is either a name or a module object which conforms to the
965 ``Package`` requirements.
966
967
968.. function:: contents(package)
969
Brett Cannon3ab93652018-04-30 11:31:45 -0700970 Return an iterable over the named items within the package. The iterable
Barry Warsawdeae6b42017-12-30 15:18:06 -0500971 returns :class:`str` resources (e.g. files) and non-resources
Brett Cannon3ab93652018-04-30 11:31:45 -0700972 (e.g. directories). The iterable does not recurse into subdirectories.
Barry Warsawdeae6b42017-12-30 15:18:06 -0500973
974 *package* is either a name or a module object which conforms to the
975 ``Package`` requirements.
976
977
Brett Cannon78246b62009-01-25 04:56:30 +0000978:mod:`importlib.machinery` -- Importers and path hooks
979------------------------------------------------------
980
981.. module:: importlib.machinery
982 :synopsis: Importers and path hooks
983
Terry Jan Reedydcb6c882016-06-22 22:46:34 -0400984**Source code:** :source:`Lib/importlib/machinery.py`
985
986--------------
987
Brett Cannon78246b62009-01-25 04:56:30 +0000988This module contains the various objects that help :keyword:`import`
989find and load modules.
990
Brett Cannoncb66eb02012-05-11 12:58:42 -0400991.. attribute:: SOURCE_SUFFIXES
992
993 A list of strings representing the recognized file suffixes for source
994 modules.
995
996 .. versionadded:: 3.3
997
998.. attribute:: DEBUG_BYTECODE_SUFFIXES
999
1000 A list of strings representing the file suffixes for non-optimized bytecode
1001 modules.
1002
1003 .. versionadded:: 3.3
1004
Brett Cannonf299abd2015-04-13 14:21:02 -04001005 .. deprecated:: 3.5
1006 Use :attr:`BYTECODE_SUFFIXES` instead.
1007
Brett Cannoncb66eb02012-05-11 12:58:42 -04001008.. attribute:: OPTIMIZED_BYTECODE_SUFFIXES
1009
1010 A list of strings representing the file suffixes for optimized bytecode
1011 modules.
1012
1013 .. versionadded:: 3.3
1014
Brett Cannonf299abd2015-04-13 14:21:02 -04001015 .. deprecated:: 3.5
1016 Use :attr:`BYTECODE_SUFFIXES` instead.
1017
Brett Cannoncb66eb02012-05-11 12:58:42 -04001018.. attribute:: BYTECODE_SUFFIXES
1019
1020 A list of strings representing the recognized file suffixes for bytecode
Brett Cannonf299abd2015-04-13 14:21:02 -04001021 modules (including the leading dot).
Brett Cannoncb66eb02012-05-11 12:58:42 -04001022
1023 .. versionadded:: 3.3
1024
Brett Cannonf299abd2015-04-13 14:21:02 -04001025 .. versionchanged:: 3.5
1026 The value is no longer dependent on ``__debug__``.
1027
Brett Cannoncb66eb02012-05-11 12:58:42 -04001028.. attribute:: EXTENSION_SUFFIXES
1029
Nick Coghlan76e07702012-07-18 23:14:57 +10001030 A list of strings representing the recognized file suffixes for
Brett Cannoncb66eb02012-05-11 12:58:42 -04001031 extension modules.
1032
1033 .. versionadded:: 3.3
1034
Nick Coghlanc5afd422012-07-18 23:59:08 +10001035.. function:: all_suffixes()
Nick Coghlan76e07702012-07-18 23:14:57 +10001036
1037 Returns a combined list of strings representing all file suffixes for
Nick Coghlanc5afd422012-07-18 23:59:08 +10001038 modules recognized by the standard import machinery. This is a
Nick Coghlan76e07702012-07-18 23:14:57 +10001039 helper for code which simply needs to know if a filesystem path
Nick Coghlanc5afd422012-07-18 23:59:08 +10001040 potentially refers to a module without needing any details on the kind
Martin Panterd21e0b52015-10-10 10:36:22 +00001041 of module (for example, :func:`inspect.getmodulename`).
Nick Coghlan76e07702012-07-18 23:14:57 +10001042
1043 .. versionadded:: 3.3
1044
1045
Brett Cannon78246b62009-01-25 04:56:30 +00001046.. class:: BuiltinImporter
1047
Brett Cannon2a922ed2009-03-09 03:35:50 +00001048 An :term:`importer` for built-in modules. All known built-in modules are
1049 listed in :data:`sys.builtin_module_names`. This class implements the
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001050 :class:`importlib.abc.MetaPathFinder` and
1051 :class:`importlib.abc.InspectLoader` ABCs.
Brett Cannon78246b62009-01-25 04:56:30 +00001052
1053 Only class methods are defined by this class to alleviate the need for
1054 instantiation.
1055
Nick Coghland5cacbb2015-05-23 22:24:10 +10001056 .. versionchanged:: 3.5
1057 As part of :pep:`489`, the builtin importer now implements
1058 :meth:`Loader.create_module` and :meth:`Loader.exec_module`
Eric Snowca2d8542013-12-16 23:06:52 -07001059
Brett Cannon78246b62009-01-25 04:56:30 +00001060
1061.. class:: FrozenImporter
1062
Brett Cannon2a922ed2009-03-09 03:35:50 +00001063 An :term:`importer` for frozen modules. This class implements the
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001064 :class:`importlib.abc.MetaPathFinder` and
1065 :class:`importlib.abc.InspectLoader` ABCs.
Brett Cannon78246b62009-01-25 04:56:30 +00001066
1067 Only class methods are defined by this class to alleviate the need for
1068 instantiation.
1069
Brett Cannon302e5a82020-03-25 11:57:47 -07001070 .. versionchanged:: 3.4
1071 Gained :meth:`~Loader.create_module` and :meth:`~Loader.exec_module`
1072 methods.
1073
Brett Cannondebb98d2009-02-16 04:18:01 +00001074
Nick Coghlanff794862012-08-02 21:45:24 +10001075.. class:: WindowsRegistryFinder
1076
Victor Stinnerbb0b0852020-08-14 12:20:05 +02001077 :term:`Finder <finder>` for modules declared in the Windows registry. This class
Himanshu Lakhara5cbb8412018-03-24 02:56:35 +05301078 implements the :class:`importlib.abc.MetaPathFinder` ABC.
Nick Coghlanff794862012-08-02 21:45:24 +10001079
1080 Only class methods are defined by this class to alleviate the need for
1081 instantiation.
1082
1083 .. versionadded:: 3.3
1084
Steve Dower20367422016-12-07 13:02:27 -08001085 .. deprecated:: 3.6
1086 Use :mod:`site` configuration instead. Future versions of Python may
1087 not enable this finder by default.
1088
Nick Coghlanff794862012-08-02 21:45:24 +10001089
Brett Cannondebb98d2009-02-16 04:18:01 +00001090.. class:: PathFinder
1091
Victor Stinnerbb0b0852020-08-14 12:20:05 +02001092 A :term:`Finder <finder>` for :data:`sys.path` and package ``__path__`` attributes.
Brett Cannon1b799182012-08-17 14:08:24 -04001093 This class implements the :class:`importlib.abc.MetaPathFinder` ABC.
Brett Cannondebb98d2009-02-16 04:18:01 +00001094
Brett Cannon1b799182012-08-17 14:08:24 -04001095 Only class methods are defined by this class to alleviate the need for
1096 instantiation.
Brett Cannondebb98d2009-02-16 04:18:01 +00001097
Eric Snowca2d8542013-12-16 23:06:52 -07001098 .. classmethod:: find_spec(fullname, path=None, target=None)
1099
1100 Class method that attempts to find a :term:`spec <module spec>`
1101 for the module specified by *fullname* on :data:`sys.path` or, if
1102 defined, on *path*. For each path entry that is searched,
1103 :data:`sys.path_importer_cache` is checked. If a non-false object
1104 is found then it is used as the :term:`path entry finder` to look
1105 for the module being searched for. If no entry is found in
1106 :data:`sys.path_importer_cache`, then :data:`sys.path_hooks` is
1107 searched for a finder for the path entry and, if found, is stored
1108 in :data:`sys.path_importer_cache` along with being queried about
1109 the module. If no finder is ever found then ``None`` is both
1110 stored in the cache and returned.
1111
1112 .. versionadded:: 3.4
1113
Brett Cannonb6e25562014-11-21 12:19:28 -05001114 .. versionchanged:: 3.5
1115 If the current working directory -- represented by an empty string --
1116 is no longer valid then ``None`` is returned but no value is cached
1117 in :data:`sys.path_importer_cache`.
1118
Brett Cannon1b799182012-08-17 14:08:24 -04001119 .. classmethod:: find_module(fullname, path=None)
Brett Cannondebb98d2009-02-16 04:18:01 +00001120
Eric Snowca2d8542013-12-16 23:06:52 -07001121 A legacy wrapper around :meth:`find_spec`.
1122
1123 .. deprecated:: 3.4
1124 Use :meth:`find_spec` instead.
Brett Cannond2e7b332009-02-17 02:45:03 +00001125
Brett Cannonf4dc9202012-08-10 12:21:12 -04001126 .. classmethod:: invalidate_caches()
1127
Eric Snowca2d8542013-12-16 23:06:52 -07001128 Calls :meth:`importlib.abc.PathEntryFinder.invalidate_caches` on all
Brett Cannon9e2be602018-04-06 16:10:18 -07001129 finders stored in :data:`sys.path_importer_cache` that define the method.
1130 Otherwise entries in :data:`sys.path_importer_cache` set to ``None`` are
1131 deleted.
1132
1133 .. versionchanged:: 3.7
1134 Entries of ``None`` in :data:`sys.path_importer_cache` are deleted.
Brett Cannonf4dc9202012-08-10 12:21:12 -04001135
Eric Snowca2d8542013-12-16 23:06:52 -07001136 .. versionchanged:: 3.4
1137 Calls objects in :data:`sys.path_hooks` with the current working
1138 directory for ``''`` (i.e. the empty string).
Brett Cannon27e27f72013-10-18 11:39:04 -04001139
Brett Cannond2e7b332009-02-17 02:45:03 +00001140
Brett Cannon938d44d2012-04-22 19:58:33 -04001141.. class:: FileFinder(path, \*loader_details)
1142
Nick Coghlan8a9080f2012-08-02 21:26:03 +10001143 A concrete implementation of :class:`importlib.abc.PathEntryFinder` which
1144 caches results from the file system.
Brett Cannon938d44d2012-04-22 19:58:33 -04001145
1146 The *path* argument is the directory for which the finder is in charge of
1147 searching.
1148
Brett Cannonac9f2f32012-08-10 13:47:54 -04001149 The *loader_details* argument is a variable number of 2-item tuples each
1150 containing a loader and a sequence of file suffixes the loader recognizes.
Brett Cannon29b2f172013-06-21 18:31:55 -04001151 The loaders are expected to be callables which accept two arguments of
1152 the module's name and the path to the file found.
Brett Cannon938d44d2012-04-22 19:58:33 -04001153
1154 The finder will cache the directory contents as necessary, making stat calls
1155 for each module search to verify the cache is not outdated. Because cache
1156 staleness relies upon the granularity of the operating system's state
1157 information of the file system, there is a potential race condition of
1158 searching for a module, creating a new file, and then searching for the
1159 module the new file represents. If the operations happen fast enough to fit
1160 within the granularity of stat calls, then the module search will fail. To
1161 prevent this from happening, when you create a module dynamically, make sure
1162 to call :func:`importlib.invalidate_caches`.
1163
1164 .. versionadded:: 3.3
1165
1166 .. attribute:: path
1167
1168 The path the finder will search in.
1169
Eric Snowca2d8542013-12-16 23:06:52 -07001170 .. method:: find_spec(fullname, target=None)
1171
1172 Attempt to find the spec to handle *fullname* within :attr:`path`.
1173
1174 .. versionadded:: 3.4
1175
Brett Cannon1d753822013-06-16 19:06:55 -04001176 .. method:: find_loader(fullname)
Brett Cannon938d44d2012-04-22 19:58:33 -04001177
1178 Attempt to find the loader to handle *fullname* within :attr:`path`.
1179
1180 .. method:: invalidate_caches()
1181
1182 Clear out the internal cache.
1183
1184 .. classmethod:: path_hook(\*loader_details)
1185
1186 A class method which returns a closure for use on :attr:`sys.path_hooks`.
1187 An instance of :class:`FileFinder` is returned by the closure using the
1188 path argument given to the closure directly and *loader_details*
1189 indirectly.
1190
1191 If the argument to the closure is not an existing directory,
1192 :exc:`ImportError` is raised.
1193
1194
1195.. class:: SourceFileLoader(fullname, path)
1196
1197 A concrete implementation of :class:`importlib.abc.SourceLoader` by
1198 subclassing :class:`importlib.abc.FileLoader` and providing some concrete
1199 implementations of other methods.
1200
1201 .. versionadded:: 3.3
1202
1203 .. attribute:: name
1204
1205 The name of the module that this loader will handle.
1206
1207 .. attribute:: path
1208
1209 The path to the source file.
1210
1211 .. method:: is_package(fullname)
1212
Serhiy Storchaka138ccbb2019-11-12 16:57:03 +02001213 Return ``True`` if :attr:`path` appears to be for a package.
Brett Cannon938d44d2012-04-22 19:58:33 -04001214
1215 .. method:: path_stats(path)
1216
1217 Concrete implementation of :meth:`importlib.abc.SourceLoader.path_stats`.
1218
1219 .. method:: set_data(path, data)
1220
1221 Concrete implementation of :meth:`importlib.abc.SourceLoader.set_data`.
1222
Brett Cannon062fcac2014-05-09 11:55:49 -04001223 .. method:: load_module(name=None)
1224
1225 Concrete implementation of :meth:`importlib.abc.Loader.load_module` where
1226 specifying the name of the module to load is optional.
1227
Brett Cannoneae30792015-12-28 17:55:27 -08001228 .. deprecated:: 3.6
1229
1230 Use :meth:`importlib.abc.Loader.exec_module` instead.
1231
Brett Cannon938d44d2012-04-22 19:58:33 -04001232
Marc-Andre Lemburg4fe29c92012-04-25 02:31:37 +02001233.. class:: SourcelessFileLoader(fullname, path)
Brett Cannon938d44d2012-04-22 19:58:33 -04001234
1235 A concrete implementation of :class:`importlib.abc.FileLoader` which can
1236 import bytecode files (i.e. no source code files exist).
1237
Marc-Andre Lemburg4fe29c92012-04-25 02:31:37 +02001238 Please note that direct use of bytecode files (and thus not source code
1239 files) inhibits your modules from being usable by all Python
1240 implementations or new versions of Python which change the bytecode
1241 format.
Brett Cannon938d44d2012-04-22 19:58:33 -04001242
1243 .. versionadded:: 3.3
1244
1245 .. attribute:: name
1246
1247 The name of the module the loader will handle.
1248
1249 .. attribute:: path
1250
1251 The path to the bytecode file.
1252
1253 .. method:: is_package(fullname)
1254
1255 Determines if the module is a package based on :attr:`path`.
1256
1257 .. method:: get_code(fullname)
1258
1259 Returns the code object for :attr:`name` created from :attr:`path`.
1260
1261 .. method:: get_source(fullname)
1262
1263 Returns ``None`` as bytecode files have no source when this loader is
1264 used.
1265
Brett Cannon062fcac2014-05-09 11:55:49 -04001266 .. method:: load_module(name=None)
1267
1268 Concrete implementation of :meth:`importlib.abc.Loader.load_module` where
1269 specifying the name of the module to load is optional.
1270
Brett Cannoneae30792015-12-28 17:55:27 -08001271 .. deprecated:: 3.6
1272
1273 Use :meth:`importlib.abc.Loader.exec_module` instead.
1274
Brett Cannon938d44d2012-04-22 19:58:33 -04001275
1276.. class:: ExtensionFileLoader(fullname, path)
1277
Eric Snow51794452013-10-03 12:08:55 -06001278 A concrete implementation of :class:`importlib.abc.ExecutionLoader` for
Brett Cannon938d44d2012-04-22 19:58:33 -04001279 extension modules.
1280
1281 The *fullname* argument specifies the name of the module the loader is to
1282 support. The *path* argument is the path to the extension module's file.
1283
1284 .. versionadded:: 3.3
1285
1286 .. attribute:: name
1287
1288 Name of the module the loader supports.
1289
1290 .. attribute:: path
1291
1292 Path to the extension module.
1293
Nick Coghland5cacbb2015-05-23 22:24:10 +10001294 .. method:: create_module(spec)
Brett Cannon938d44d2012-04-22 19:58:33 -04001295
Nick Coghland5cacbb2015-05-23 22:24:10 +10001296 Creates the module object from the given specification in accordance
1297 with :pep:`489`.
Brett Cannon938d44d2012-04-22 19:58:33 -04001298
Nick Coghland5cacbb2015-05-23 22:24:10 +10001299 .. versionadded:: 3.5
1300
1301 .. method:: exec_module(module)
1302
1303 Initializes the given module object in accordance with :pep:`489`.
1304
1305 .. versionadded:: 3.5
Eric Snowca2d8542013-12-16 23:06:52 -07001306
Brett Cannon938d44d2012-04-22 19:58:33 -04001307 .. method:: is_package(fullname)
1308
Brett Cannonac9f2f32012-08-10 13:47:54 -04001309 Returns ``True`` if the file path points to a package's ``__init__``
1310 module based on :attr:`EXTENSION_SUFFIXES`.
Brett Cannon938d44d2012-04-22 19:58:33 -04001311
1312 .. method:: get_code(fullname)
1313
1314 Returns ``None`` as extension modules lack a code object.
1315
1316 .. method:: get_source(fullname)
1317
1318 Returns ``None`` as extension modules do not have source code.
1319
Eric Snow51794452013-10-03 12:08:55 -06001320 .. method:: get_filename(fullname)
1321
1322 Returns :attr:`path`.
1323
Eric Snowdcd01b42013-10-04 20:35:34 -06001324 .. versionadded:: 3.4
1325
Brett Cannon938d44d2012-04-22 19:58:33 -04001326
Eric Snowb523f842013-11-22 09:05:39 -07001327.. class:: ModuleSpec(name, loader, *, origin=None, loader_state=None, is_package=None)
1328
Barry Warsaw191e3132017-10-17 15:52:38 -04001329 A specification for a module's import-system-related state. This is
1330 typically exposed as the module's ``__spec__`` attribute. In the
1331 descriptions below, the names in parentheses give the corresponding
1332 attribute available directly on the module object.
1333 E.g. ``module.__spec__.origin == module.__file__``. Note however that
1334 while the *values* are usually equivalent, they can differ since there is
1335 no synchronization between the two objects. Thus it is possible to update
1336 the module's ``__path__`` at runtime, and this will not be automatically
1337 reflected in ``__spec__.submodule_search_locations``.
Eric Snowb523f842013-11-22 09:05:39 -07001338
1339 .. versionadded:: 3.4
1340
1341 .. attribute:: name
1342
1343 (``__name__``)
1344
1345 A string for the fully-qualified name of the module.
1346
1347 .. attribute:: loader
1348
1349 (``__loader__``)
1350
Géry Ogam27f1bd82020-10-21 23:17:35 +02001351 The :term:`Loader <loader>` that should be used when loading
1352 the module. :term:`Finders <finder>` should always set this.
Eric Snowb523f842013-11-22 09:05:39 -07001353
1354 .. attribute:: origin
1355
1356 (``__file__``)
1357
1358 Name of the place from which the module is loaded, e.g. "builtin" for
1359 built-in modules and the filename for modules loaded from source.
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001360 Normally "origin" should be set, but it may be ``None`` (the default)
Barry Warsawbbbcf862018-02-02 15:15:58 -05001361 which indicates it is unspecified (e.g. for namespace packages).
Eric Snowb523f842013-11-22 09:05:39 -07001362
1363 .. attribute:: submodule_search_locations
1364
1365 (``__path__``)
1366
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001367 List of strings for where to find submodules, if a package (``None``
Eric Snowb523f842013-11-22 09:05:39 -07001368 otherwise).
1369
1370 .. attribute:: loader_state
1371
1372 Container of extra module-specific data for use during loading (or
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001373 ``None``).
Eric Snowb523f842013-11-22 09:05:39 -07001374
1375 .. attribute:: cached
1376
1377 (``__cached__``)
1378
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001379 String for where the compiled module should be stored (or ``None``).
Eric Snowb523f842013-11-22 09:05:39 -07001380
1381 .. attribute:: parent
1382
1383 (``__package__``)
1384
Géry Ogam27f1bd82020-10-21 23:17:35 +02001385 (Read-only) The fully-qualified name of the package under which the module
1386 should be loaded as a submodule (or the empty string for top-level modules).
1387 For packages, it is the same as :attr:`__name__`.
Eric Snowb523f842013-11-22 09:05:39 -07001388
1389 .. attribute:: has_location
1390
Eric Snowb282b3d2013-12-10 22:16:41 -07001391 Boolean indicating whether or not the module's "origin"
Eric Snowb523f842013-11-22 09:05:39 -07001392 attribute refers to a loadable location.
1393
Brett Cannond2e7b332009-02-17 02:45:03 +00001394:mod:`importlib.util` -- Utility code for importers
1395---------------------------------------------------
1396
1397.. module:: importlib.util
Brett Cannon75321e82012-03-02 11:58:25 -05001398 :synopsis: Utility code for importers
Brett Cannond2e7b332009-02-17 02:45:03 +00001399
Terry Jan Reedydcb6c882016-06-22 22:46:34 -04001400
1401**Source code:** :source:`Lib/importlib/util.py`
1402
1403--------------
1404
Brett Cannond2e7b332009-02-17 02:45:03 +00001405This module contains the various objects that help in the construction of
1406an :term:`importer`.
1407
Brett Cannon05a647d2013-06-14 19:02:34 -04001408.. attribute:: MAGIC_NUMBER
1409
1410 The bytes which represent the bytecode version number. If you need help with
1411 loading/writing bytecode then consider :class:`importlib.abc.SourceLoader`.
1412
1413 .. versionadded:: 3.4
1414
Brett Cannonf299abd2015-04-13 14:21:02 -04001415.. function:: cache_from_source(path, debug_override=None, *, optimization=None)
Brett Cannona3c96152013-06-14 22:26:30 -04001416
Brett Cannonf299abd2015-04-13 14:21:02 -04001417 Return the :pep:`3147`/:pep:`488` path to the byte-compiled file associated
1418 with the source *path*. For example, if *path* is ``/foo/bar/baz.py`` the return
Brett Cannona3c96152013-06-14 22:26:30 -04001419 value would be ``/foo/bar/__pycache__/baz.cpython-32.pyc`` for Python 3.2.
1420 The ``cpython-32`` string comes from the current magic tag (see
1421 :func:`get_tag`; if :attr:`sys.implementation.cache_tag` is not defined then
Brett Cannonf299abd2015-04-13 14:21:02 -04001422 :exc:`NotImplementedError` will be raised).
Brett Cannona3c96152013-06-14 22:26:30 -04001423
Brett Cannonf299abd2015-04-13 14:21:02 -04001424 The *optimization* parameter is used to specify the optimization level of the
1425 bytecode file. An empty string represents no optimization, so
1426 ``/foo/bar/baz.py`` with an *optimization* of ``''`` will result in a
1427 bytecode path of ``/foo/bar/__pycache__/baz.cpython-32.pyc``. ``None`` causes
Min ho Kim39d87b52019-08-31 06:21:19 +10001428 the interpreter's optimization level to be used. Any other value's string
1429 representation is used, so ``/foo/bar/baz.py`` with an *optimization* of
Brett Cannonf299abd2015-04-13 14:21:02 -04001430 ``2`` will lead to the bytecode path of
1431 ``/foo/bar/__pycache__/baz.cpython-32.opt-2.pyc``. The string representation
1432 of *optimization* can only be alphanumeric, else :exc:`ValueError` is raised.
1433
1434 The *debug_override* parameter is deprecated and can be used to override
1435 the system's value for ``__debug__``. A ``True`` value is the equivalent of
1436 setting *optimization* to the empty string. A ``False`` value is the same as
1437 setting *optimization* to ``1``. If both *debug_override* an *optimization*
1438 are not ``None`` then :exc:`TypeError` is raised.
Brett Cannona3c96152013-06-14 22:26:30 -04001439
1440 .. versionadded:: 3.4
1441
Berker Peksagfe5f6142016-01-30 19:30:06 +02001442 .. versionchanged:: 3.5
Brett Cannonf299abd2015-04-13 14:21:02 -04001443 The *optimization* parameter was added and the *debug_override* parameter
1444 was deprecated.
1445
Brett Cannon035a1002016-09-07 18:39:18 -07001446 .. versionchanged:: 3.6
1447 Accepts a :term:`path-like object`.
1448
Brett Cannona3c96152013-06-14 22:26:30 -04001449
1450.. function:: source_from_cache(path)
1451
1452 Given the *path* to a :pep:`3147` file name, return the associated source code
1453 file path. For example, if *path* is
1454 ``/foo/bar/__pycache__/baz.cpython-32.pyc`` the returned path would be
1455 ``/foo/bar/baz.py``. *path* need not exist, however if it does not conform
Stéphane Wirtele483f022018-10-26 12:52:11 +02001456 to :pep:`3147` or :pep:`488` format, a :exc:`ValueError` is raised. If
Brett Cannona3c96152013-06-14 22:26:30 -04001457 :attr:`sys.implementation.cache_tag` is not defined,
1458 :exc:`NotImplementedError` is raised.
1459
1460 .. versionadded:: 3.4
1461
Brett Cannon035a1002016-09-07 18:39:18 -07001462 .. versionchanged:: 3.6
1463 Accepts a :term:`path-like object`.
1464
Brett Cannonf24fecd2013-06-16 18:37:53 -04001465.. function:: decode_source(source_bytes)
1466
1467 Decode the given bytes representing source code and return it as a string
1468 with universal newlines (as required by
1469 :meth:`importlib.abc.InspectLoader.get_source`).
1470
1471 .. versionadded:: 3.4
1472
Brett Cannond200bf52012-05-13 13:45:09 -04001473.. function:: resolve_name(name, package)
1474
1475 Resolve a relative module name to an absolute one.
1476
1477 If **name** has no leading dots, then **name** is simply returned. This
1478 allows for usage such as
1479 ``importlib.util.resolve_name('sys', __package__)`` without doing a
1480 check to see if the **package** argument is needed.
1481
Ngalim Siregarc5fa4492019-08-03 12:46:02 +07001482 :exc:`ImportError` is raised if **name** is a relative module name but
1483 **package** is a false value (e.g. ``None`` or the empty string).
1484 :exc:`ImportError` is also raised a relative name would escape its containing
Brett Cannond200bf52012-05-13 13:45:09 -04001485 package (e.g. requesting ``..bacon`` from within the ``spam`` package).
1486
1487 .. versionadded:: 3.3
1488
Ngalim Siregarc5fa4492019-08-03 12:46:02 +07001489 .. versionchanged:: 3.9
1490 To improve consistency with import statements, raise
1491 :exc:`ImportError` instead of :exc:`ValueError` for invalid relative
1492 import attempts.
1493
Eric Snow6029e082014-01-25 15:32:46 -07001494.. function:: find_spec(name, package=None)
1495
1496 Find the :term:`spec <module spec>` for a module, optionally relative to
1497 the specified **package** name. If the module is in :attr:`sys.modules`,
1498 then ``sys.modules[name].__spec__`` is returned (unless the spec would be
1499 ``None`` or is not set, in which case :exc:`ValueError` is raised).
1500 Otherwise a search using :attr:`sys.meta_path` is done. ``None`` is
1501 returned if no spec is found.
1502
1503 If **name** is for a submodule (contains a dot), the parent module is
1504 automatically imported.
1505
1506 **name** and **package** work the same as for :func:`import_module`.
1507
1508 .. versionadded:: 3.4
1509
Milan Oberkirch8c3f05e2017-06-15 07:34:50 +10001510 .. versionchanged:: 3.7
1511 Raises :exc:`ModuleNotFoundError` instead of :exc:`AttributeError` if
1512 **package** is in fact not a package (i.e. lacks a :attr:`__path__`
1513 attribute).
1514
Brett Cannon2a17bde2014-05-30 14:55:29 -04001515.. function:: module_from_spec(spec)
1516
Brett Cannon696c35e2016-06-25 10:58:17 -07001517 Create a new module based on **spec** and
1518 :meth:`spec.loader.create_module <importlib.abc.Loader.create_module>`.
Brett Cannon2a17bde2014-05-30 14:55:29 -04001519
Brett Cannon696c35e2016-06-25 10:58:17 -07001520 If :meth:`spec.loader.create_module <importlib.abc.Loader.create_module>`
1521 does not return ``None``, then any pre-existing attributes will not be reset.
1522 Also, no :exc:`AttributeError` will be raised if triggered while accessing
1523 **spec** or setting an attribute on the module.
Brett Cannon2a17bde2014-05-30 14:55:29 -04001524
1525 This function is preferred over using :class:`types.ModuleType` to create a
1526 new module as **spec** is used to set as many import-controlled attributes on
1527 the module as possible.
1528
1529 .. versionadded:: 3.5
1530
Georg Brandl8a1caa22010-07-29 16:01:11 +00001531.. decorator:: module_for_loader
Brett Cannond2e7b332009-02-17 02:45:03 +00001532
Brett Cannona22faca2013-05-28 17:50:14 -04001533 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module`
Guido van Rossum09613542009-03-30 20:34:57 +00001534 to handle selecting the proper
Brett Cannond2e7b332009-02-17 02:45:03 +00001535 module object to load with. The decorated method is expected to have a call
Brett Cannon2a922ed2009-03-09 03:35:50 +00001536 signature taking two positional arguments
1537 (e.g. ``load_module(self, module)``) for which the second argument
Guido van Rossum09613542009-03-30 20:34:57 +00001538 will be the module **object** to be used by the loader.
Brett Cannonefad00d2012-04-27 17:27:14 -04001539 Note that the decorator will not work on static methods because of the
1540 assumption of two arguments.
Brett Cannond2e7b332009-02-17 02:45:03 +00001541
Guido van Rossum09613542009-03-30 20:34:57 +00001542 The decorated method will take in the **name** of the module to be loaded
1543 as expected for a :term:`loader`. If the module is not found in
Brett Cannon3dc48d62013-05-28 18:35:54 -04001544 :data:`sys.modules` then a new one is constructed. Regardless of where the
1545 module came from, :attr:`__loader__` set to **self** and :attr:`__package__`
1546 is set based on what :meth:`importlib.abc.InspectLoader.is_package` returns
1547 (if available). These attributes are set unconditionally to support
1548 reloading.
Brett Cannonefad00d2012-04-27 17:27:14 -04001549
1550 If an exception is raised by the decorated method and a module was added to
Brett Cannona87e31c2013-09-13 16:52:19 -04001551 :data:`sys.modules`, then the module will be removed to prevent a partially
1552 initialized module from being in left in :data:`sys.modules`. If the module
1553 was already in :data:`sys.modules` then it is left alone.
Brett Cannond2e7b332009-02-17 02:45:03 +00001554
Brett Cannonefad00d2012-04-27 17:27:14 -04001555 .. versionchanged:: 3.3
Georg Brandl61063cc2012-06-24 22:48:30 +02001556 :attr:`__loader__` and :attr:`__package__` are automatically set
1557 (when possible).
Brett Cannon57b46f52009-03-02 14:38:26 +00001558
Brett Cannon3dc48d62013-05-28 18:35:54 -04001559 .. versionchanged:: 3.4
Brett Cannon0dbb4c72013-05-31 18:56:47 -04001560 Set :attr:`__name__`, :attr:`__loader__` :attr:`__package__`
1561 unconditionally to support reloading.
1562
1563 .. deprecated:: 3.4
Eric Snowb523f842013-11-22 09:05:39 -07001564 The import machinery now directly performs all the functionality
1565 provided by this function.
Brett Cannon3dc48d62013-05-28 18:35:54 -04001566
Georg Brandl8a1caa22010-07-29 16:01:11 +00001567.. decorator:: set_loader
Brett Cannon2cf03a82009-03-10 05:17:37 +00001568
Brett Cannona22faca2013-05-28 17:50:14 -04001569 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module`
1570 to set the :attr:`__loader__`
1571 attribute on the returned module. If the attribute is already set the
1572 decorator does nothing. It is assumed that the first positional argument to
1573 the wrapped method (i.e. ``self``) is what :attr:`__loader__` should be set
1574 to.
Brett Cannon2cf03a82009-03-10 05:17:37 +00001575
Brett Cannon4802bec2013-03-13 10:41:36 -07001576 .. versionchanged:: 3.4
Brett Cannon4c14b5d2013-05-04 13:56:58 -04001577 Set ``__loader__`` if set to ``None``, as if the attribute does not
Brett Cannon4802bec2013-03-13 10:41:36 -07001578 exist.
1579
Eric Snowca2d8542013-12-16 23:06:52 -07001580 .. deprecated:: 3.4
1581 The import machinery takes care of this automatically.
1582
Georg Brandl8a1caa22010-07-29 16:01:11 +00001583.. decorator:: set_package
Brett Cannon57b46f52009-03-02 14:38:26 +00001584
Brett Cannon696c35e2016-06-25 10:58:17 -07001585 A :term:`decorator` for :meth:`importlib.abc.Loader.load_module` to set the
1586 :attr:`__package__` attribute on the returned module. If :attr:`__package__`
Brett Cannona22faca2013-05-28 17:50:14 -04001587 is set and has a value other than ``None`` it will not be changed.
Brett Cannon16248a42009-04-01 20:47:14 +00001588
Eric Snowca2d8542013-12-16 23:06:52 -07001589 .. deprecated:: 3.4
1590 The import machinery takes care of this automatically.
1591
Eric Snowb523f842013-11-22 09:05:39 -07001592.. function:: spec_from_loader(name, loader, *, origin=None, is_package=None)
1593
1594 A factory function for creating a :class:`ModuleSpec` instance based
1595 on a loader. The parameters have the same meaning as they do for
1596 ModuleSpec. The function uses available :term:`loader` APIs, such as
1597 :meth:`InspectLoader.is_package`, to fill in any missing
1598 information on the spec.
1599
1600 .. versionadded:: 3.4
1601
1602.. function:: spec_from_file_location(name, location, *, loader=None, submodule_search_locations=None)
1603
1604 A factory function for creating a :class:`ModuleSpec` instance based
1605 on the path to a file. Missing information will be filled in on the
1606 spec by making use of loader APIs and by the implication that the
1607 module will be file-based.
1608
1609 .. versionadded:: 3.4
Brett Cannona04dbe42014-04-04 13:53:38 -04001610
Brett Cannon035a1002016-09-07 18:39:18 -07001611 .. versionchanged:: 3.6
1612 Accepts a :term:`path-like object`.
1613
Benjamin Peterson42aa93b2017-12-09 10:26:52 -08001614.. function:: source_hash(source_bytes)
1615
1616 Return the hash of *source_bytes* as bytes. A hash-based ``.pyc`` file embeds
1617 the :func:`source_hash` of the corresponding source file's contents in its
1618 header.
1619
1620 .. versionadded:: 3.7
1621
Brett Cannona04dbe42014-04-04 13:53:38 -04001622.. class:: LazyLoader(loader)
1623
1624 A class which postpones the execution of the loader of a module until the
1625 module has an attribute accessed.
1626
1627 This class **only** works with loaders that define
Brett Cannon02d84542015-01-09 11:39:21 -05001628 :meth:`~importlib.abc.Loader.exec_module` as control over what module type
1629 is used for the module is required. For those same reasons, the loader's
Brett Cannon696c35e2016-06-25 10:58:17 -07001630 :meth:`~importlib.abc.Loader.create_module` method must return ``None`` or a
1631 type for which its ``__class__`` attribute can be mutated along with not
1632 using :term:`slots <__slots__>`. Finally, modules which substitute the object
1633 placed into :attr:`sys.modules` will not work as there is no way to properly
1634 replace the module references throughout the interpreter safely;
1635 :exc:`ValueError` is raised if such a substitution is detected.
Brett Cannona04dbe42014-04-04 13:53:38 -04001636
1637 .. note::
1638 For projects where startup time is critical, this class allows for
1639 potentially minimizing the cost of loading a module if it is never used.
1640 For projects where startup time is not essential then use of this class is
1641 **heavily** discouraged due to error messages created during loading being
1642 postponed and thus occurring out of context.
1643
1644 .. versionadded:: 3.5
1645
Brett Cannon696c35e2016-06-25 10:58:17 -07001646 .. versionchanged:: 3.6
1647 Began calling :meth:`~importlib.abc.Loader.create_module`, removing the
1648 compatibility warning for :class:`importlib.machinery.BuiltinImporter` and
1649 :class:`importlib.machinery.ExtensionFileLoader`.
1650
Brett Cannona04dbe42014-04-04 13:53:38 -04001651 .. classmethod:: factory(loader)
1652
1653 A static method which returns a callable that creates a lazy loader. This
1654 is meant to be used in situations where the loader is passed by class
1655 instead of by instance.
1656 ::
1657
1658 suffixes = importlib.machinery.SOURCE_SUFFIXES
1659 loader = importlib.machinery.SourceFileLoader
1660 lazy_loader = importlib.util.LazyLoader.factory(loader)
Brett Cannon3bf1d872016-01-22 14:03:27 -08001661 finder = importlib.machinery.FileFinder(path, (lazy_loader, suffixes))
Brett Cannona85e9272016-01-08 14:33:09 -08001662
1663.. _importlib-examples:
1664
1665Examples
1666--------
1667
Brett Cannon23763162016-09-08 10:12:47 -07001668Importing programmatically
1669''''''''''''''''''''''''''
1670
Brett Cannona85e9272016-01-08 14:33:09 -08001671To programmatically import a module, use :func:`importlib.import_module`.
1672::
1673
1674 import importlib
1675
1676 itertools = importlib.import_module('itertools')
1677
Brett Cannon23763162016-09-08 10:12:47 -07001678
1679Checking if a module can be imported
1680''''''''''''''''''''''''''''''''''''
1681
Brett Cannona85e9272016-01-08 14:33:09 -08001682If you need to find out if a module can be imported without actually doing the
1683import, then you should use :func:`importlib.util.find_spec`.
1684::
1685
1686 import importlib.util
1687 import sys
1688
1689 # For illustrative purposes.
1690 name = 'itertools'
1691
Brett Cannon08270642019-07-12 15:35:34 -07001692 if name in sys.modules:
1693 print(f"{name!r} already in sys.modules")
Tzu-ping Chung544fa152019-07-26 01:20:33 +08001694 elif (spec := importlib.util.find_spec(name)) is not None:
Brett Cannon59363132016-03-18 11:54:22 -07001695 # If you chose to perform the actual import ...
Brett Cannona85e9272016-01-08 14:33:09 -08001696 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001697 sys.modules[name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001698 spec.loader.exec_module(module)
1699 print(f"{name!r} has been imported")
Tzu-ping Chung544fa152019-07-26 01:20:33 +08001700 else:
1701 print(f"can't find the {name!r} module")
Brett Cannona85e9272016-01-08 14:33:09 -08001702
Brett Cannon23763162016-09-08 10:12:47 -07001703
1704Importing a source file directly
1705''''''''''''''''''''''''''''''''
1706
Brett Cannona85e9272016-01-08 14:33:09 -08001707To import a Python source file directly, use the following recipe
E Kawashima16c8a532018-11-06 07:41:17 +09001708(Python 3.5 and newer only)::
Brett Cannona85e9272016-01-08 14:33:09 -08001709
1710 import importlib.util
1711 import sys
1712
1713 # For illustrative purposes.
1714 import tokenize
1715 file_path = tokenize.__file__
1716 module_name = tokenize.__name__
1717
1718 spec = importlib.util.spec_from_file_location(module_name, file_path)
1719 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001720 sys.modules[module_name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001721 spec.loader.exec_module(module)
1722
Brett Cannona85e9272016-01-08 14:33:09 -08001723
Joannah Nanjekye8dd32fe2020-07-13 18:31:02 -03001724Implementing lazy imports
1725'''''''''''''''''''''''''
1726
1727The example below shows how to implement lazy imports::
1728
1729 >>> import importlib.util
1730 >>> import sys
1731 >>> def lazy_import(name):
1732 ... spec = importlib.util.find_spec(name)
1733 ... loader = importlib.util.LazyLoader(spec.loader)
1734 ... spec.loader = loader
1735 ... module = importlib.util.module_from_spec(spec)
1736 ... sys.modules[name] = module
1737 ... loader.exec_module(module)
1738 ... return module
1739 ...
1740 >>> lazy_typing = lazy_import("typing")
1741 >>> #lazy_typing is a real module object,
1742 >>> #but it is not loaded in memory yet.
1743 >>> lazy_typing.TYPE_CHECKING
1744 False
1745
1746
Brett Cannon23763162016-09-08 10:12:47 -07001747
1748Setting up an importer
1749''''''''''''''''''''''
1750
Brett Cannon59363132016-03-18 11:54:22 -07001751For deep customizations of import, you typically want to implement an
1752:term:`importer`. This means managing both the :term:`finder` and :term:`loader`
1753side of things. For finders there are two flavours to choose from depending on
1754your needs: a :term:`meta path finder` or a :term:`path entry finder`. The
1755former is what you would put on :attr:`sys.meta_path` while the latter is what
1756you create using a :term:`path entry hook` on :attr:`sys.path_hooks` which works
1757with :attr:`sys.path` entries to potentially create a finder. This example will
1758show you how to register your own importers so that import will use them (for
1759creating an importer for yourself, read the documentation for the appropriate
1760classes defined within this package)::
1761
1762 import importlib.machinery
1763 import sys
1764
1765 # For illustrative purposes only.
1766 SpamMetaPathFinder = importlib.machinery.PathFinder
1767 SpamPathEntryFinder = importlib.machinery.FileFinder
1768 loader_details = (importlib.machinery.SourceFileLoader,
1769 importlib.machinery.SOURCE_SUFFIXES)
1770
1771 # Setting up a meta path finder.
1772 # Make sure to put the finder in the proper location in the list in terms of
1773 # priority.
1774 sys.meta_path.append(SpamMetaPathFinder)
1775
1776 # Setting up a path entry finder.
1777 # Make sure to put the path hook in the proper location in the list in terms
1778 # of priority.
1779 sys.path_hooks.append(SpamPathEntryFinder.path_hook(loader_details))
1780
Brett Cannon23763162016-09-08 10:12:47 -07001781
1782Approximating :func:`importlib.import_module`
1783'''''''''''''''''''''''''''''''''''''''''''''
1784
Brett Cannona85e9272016-01-08 14:33:09 -08001785Import itself is implemented in Python code, making it possible to
1786expose most of the import machinery through importlib. The following
1787helps illustrate the various APIs that importlib exposes by providing an
1788approximate implementation of
Brett Cannon59363132016-03-18 11:54:22 -07001789:func:`importlib.import_module` (Python 3.4 and newer for the importlib usage,
Brett Cannona85e9272016-01-08 14:33:09 -08001790Python 3.6 and newer for other parts of the code).
1791::
1792
1793 import importlib.util
1794 import sys
1795
1796 def import_module(name, package=None):
1797 """An approximate implementation of import."""
1798 absolute_name = importlib.util.resolve_name(name, package)
1799 try:
1800 return sys.modules[absolute_name]
1801 except KeyError:
1802 pass
1803
1804 path = None
1805 if '.' in absolute_name:
1806 parent_name, _, child_name = absolute_name.rpartition('.')
1807 parent_module = import_module(parent_name)
orlnub12378401f72018-10-25 02:32:26 +03001808 path = parent_module.__spec__.submodule_search_locations
Brett Cannona85e9272016-01-08 14:33:09 -08001809 for finder in sys.meta_path:
1810 spec = finder.find_spec(absolute_name, path)
1811 if spec is not None:
1812 break
1813 else:
Nick Coghlancee29b42019-01-17 20:41:29 +10001814 msg = f'No module named {absolute_name!r}'
1815 raise ModuleNotFoundError(msg, name=absolute_name)
Brett Cannon86a8be02016-02-20 18:47:09 -08001816 module = importlib.util.module_from_spec(spec)
Brett Cannona85e9272016-01-08 14:33:09 -08001817 sys.modules[absolute_name] = module
Brett Cannon08270642019-07-12 15:35:34 -07001818 spec.loader.exec_module(module)
Brett Cannona85e9272016-01-08 14:33:09 -08001819 if path is not None:
1820 setattr(parent_module, child_name, module)
1821 return module