blob: cd38a8c96d551e154327b2834d151045fc44b265 [file] [log] [blame]
Fred Drake295da241998-08-10 19:42:37 +00001\section{\module{marshal} ---
Fred Drakec6004751999-02-19 22:33:51 +00002 Alternate Python object serialization}
Fred Drakeb91e9341998-07-23 17:59:49 +00003
Fred Drakeffbe6871999-04-22 21:23:22 +00004\declaremodule{builtin}{marshal}
Fred Drake295da241998-08-10 19:42:37 +00005\modulesynopsis{Convert Python objects to streams of bytes and back
Fred Drakeffbe6871999-04-22 21:23:22 +00006 (with different constraints).}
Fred Drakeb91e9341998-07-23 17:59:49 +00007
Fred Drake0c2af2b1998-03-08 06:28:00 +00008
Guido van Rossum5fdeeea1994-01-02 01:22:07 +00009This module contains functions that can read and write Python
10values in a binary format. The format is specific to Python, but
11independent of machine architecture issues (e.g., you can write a
Guido van Rossum470be141995-03-17 16:07:09 +000012Python value to a file on a PC, transport the file to a Sun, and read
13it back there). Details of the format are undocumented on purpose;
Fred Drakeea003fc1999-04-05 21:59:15 +000014it may change between Python versions (although it rarely
15does).\footnote{The name of this module stems from a bit of
16 terminology used by the designers of Modula-3 (amongst others), who
17 use the term ``marshalling'' for shipping of data around in a
18 self-contained form. Strictly speaking, ``to marshal'' means to
19 convert some data from internal to external form (in an RPC buffer for
20 instance) and ``unmarshalling'' for the reverse process.}
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000021
Thomas Woutersf8316632000-07-16 19:01:10 +000022This is not a general ``persistence'' module. For general persistence
Guido van Rossum470be141995-03-17 16:07:09 +000023and transfer of Python objects through RPC calls, see the modules
Fred Drakeffbe6871999-04-22 21:23:22 +000024\refmodule{pickle} and \refmodule{shelve}. The \module{marshal} module exists
Guido van Rossum470be141995-03-17 16:07:09 +000025mainly to support reading and writing the ``pseudo-compiled'' code for
Fred Drake75062981998-02-16 20:40:37 +000026Python modules of \file{.pyc} files.
Fred Drake54820dc1997-12-15 21:56:05 +000027\refstmodindex{pickle}
28\refstmodindex{shelve}
Guido van Rossum470be141995-03-17 16:07:09 +000029\obindex{code}
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000030
31Not all Python object types are supported; in general, only objects
32whose value is independent from a particular invocation of Python can
33be written and read by this module. The following types are supported:
34\code{None}, integers, long integers, floating point numbers,
Fred Drake61098f22000-04-06 14:47:20 +000035strings, Unicode objects, tuples, lists, dictionaries, and code
36objects, where it should be understood that tuples, lists and
37dictionaries are only supported as long as the values contained
38therein are themselves supported; and recursive lists and dictionaries
39should not be written (they will cause infinite loops).
Guido van Rossum470be141995-03-17 16:07:09 +000040
Fred Drakeaf8a0151998-01-14 14:51:31 +000041\strong{Caveat:} On machines where C's \code{long int} type has more than
Tim Petersad2dc3f2001-09-14 20:40:13 +00004232 bits (such as the DEC Alpha), it is possible to create plain Python
43integers that are longer than 32 bits.
44If such an integer is marshaled and read back in on a machine where
45C's \code{long int} type has only 32 bits, a Python long integer object
46is returned instead. While of a different type, the numeric value is
47the same. (This behavior is new in Python 2.2. In earlier versions,
48all but the least-significant 32 bits of the value were lost, and a
49warning message was printed.)
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000050
51There are functions that read/write files as well as functions
52operating on strings.
53
54The module defines these functions:
55
Fred Drake0c2af2b1998-03-08 06:28:00 +000056\begin{funcdesc}{dump}{value, file}
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000057 Write the value on the open file. The value must be a supported
58 type. The file must be an open file object such as
Fred Drake75062981998-02-16 20:40:37 +000059 \code{sys.stdout} or returned by \function{open()} or
Fred Drake38e5d272000-04-03 20:13:55 +000060 \function{posix.popen()}. It must be opened in binary mode
61 (\code{'wb'} or \code{'w+b'}).
Fred Drake75062981998-02-16 20:40:37 +000062
Guido van Rossumbbb1e261996-06-26 20:20:57 +000063 If the value has (or contains an object that has) an unsupported type,
Fred Drake0c2af2b1998-03-08 06:28:00 +000064 a \exception{ValueError} exception is raised --- but garbage data
Fred Drake75062981998-02-16 20:40:37 +000065 will also be written to the file. The object will not be properly
66 read back by \function{load()}.
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000067\end{funcdesc}
68
69\begin{funcdesc}{load}{file}
70 Read one value from the open file and return it. If no valid value
Fred Drake75062981998-02-16 20:40:37 +000071 is read, raise \exception{EOFError}, \exception{ValueError} or
Fred Drake38e5d272000-04-03 20:13:55 +000072 \exception{TypeError}. The file must be an open file object opened
73 in binary mode (\code{'rb'} or \code{'r+b'}).
Guido van Rossumbbb1e261996-06-26 20:20:57 +000074
Fred Drake0c2af2b1998-03-08 06:28:00 +000075 \strong{Warning:} If an object containing an unsupported type was
76 marshalled with \function{dump()}, \function{load()} will substitute
Fred Drake75062981998-02-16 20:40:37 +000077 \code{None} for the unmarshallable type.
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000078\end{funcdesc}
79
80\begin{funcdesc}{dumps}{value}
81 Return the string that would be written to a file by
Fred Drake75062981998-02-16 20:40:37 +000082 \code{dump(\var{value}, \var{file})}. The value must be a supported
83 type. Raise a \exception{ValueError} exception if value has (or
84 contains an object that has) an unsupported type.
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000085\end{funcdesc}
86
87\begin{funcdesc}{loads}{string}
88 Convert the string to a value. If no valid value is found, raise
Fred Drake75062981998-02-16 20:40:37 +000089 \exception{EOFError}, \exception{ValueError} or
90 \exception{TypeError}. Extra characters in the string are ignored.
Guido van Rossum5fdeeea1994-01-02 01:22:07 +000091\end{funcdesc}