Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 1 | :mod:`io` --- Core tools for working with streams |
| 2 | ================================================= |
| 3 | |
| 4 | .. module:: io |
| 5 | :synopsis: Core tools for working with streams. |
| 6 | .. moduleauthor:: Guido van Rossum <guido@python.org> |
| 7 | .. moduleauthor:: Mike Verdone <mike.verdone@gmail.com> |
| 8 | .. moduleauthor:: Mark Russell <mark.russell@zen.co.uk> |
Benjamin Peterson | 4fa88fa | 2009-03-04 00:14:51 +0000 | [diff] [blame] | 9 | .. moduleauthor:: Antoine Pitrou <solipsis@pitrou.net> |
| 10 | .. moduleauthor:: Amaury Forgeot d'Arc <amauryfa@gmail.com> |
Benjamin Peterson | ef9f2bd | 2009-05-01 20:45:43 +0000 | [diff] [blame] | 11 | .. moduleauthor:: Benjamin Peterson <benjamin@python.org> |
Benjamin Peterson | 058e31e | 2009-01-16 03:54:08 +0000 | [diff] [blame] | 12 | .. sectionauthor:: Benjamin Peterson <benjamin@python.org> |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 13 | |
| 14 | The :mod:`io` module provides the Python interfaces to stream handling. The |
Georg Brandl | 22b3431 | 2009-07-26 14:54:51 +0000 | [diff] [blame] | 15 | built-in :func:`open` function is defined in this module. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 16 | |
| 17 | At the top of the I/O hierarchy is the abstract base class :class:`IOBase`. It |
| 18 | defines the basic interface to a stream. Note, however, that there is no |
Mark Dickinson | 934896d | 2009-02-21 20:59:32 +0000 | [diff] [blame] | 19 | separation between reading and writing to streams; implementations are allowed |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 20 | to throw an :exc:`IOError` if they do not support a given operation. |
| 21 | |
| 22 | Extending :class:`IOBase` is :class:`RawIOBase` which deals simply with the |
| 23 | reading and writing of raw bytes to a stream. :class:`FileIO` subclasses |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 24 | :class:`RawIOBase` to provide an interface to files in the machine's |
| 25 | file system. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 26 | |
| 27 | :class:`BufferedIOBase` deals with buffering on a raw byte stream |
| 28 | (:class:`RawIOBase`). Its subclasses, :class:`BufferedWriter`, |
| 29 | :class:`BufferedReader`, and :class:`BufferedRWPair` buffer streams that are |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 30 | readable, writable, and both readable and writable. |
| 31 | :class:`BufferedRandom` provides a buffered interface to random access |
| 32 | streams. :class:`BytesIO` is a simple stream of in-memory bytes. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 33 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 34 | Another :class:`IOBase` subclass, :class:`TextIOBase`, deals with |
| 35 | streams whose bytes represent text, and handles encoding and decoding |
| 36 | from and to strings. :class:`TextIOWrapper`, which extends it, is a |
| 37 | buffered text interface to a buffered raw stream |
| 38 | (:class:`BufferedIOBase`). Finally, :class:`StringIO` is an in-memory |
| 39 | stream for text. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 40 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 41 | Argument names are not part of the specification, and only the arguments of |
Georg Brandl | 502d9a5 | 2009-07-26 15:02:41 +0000 | [diff] [blame] | 42 | :func:`.open` are intended to be used as keyword arguments. |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 43 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 44 | |
| 45 | Module Interface |
| 46 | ---------------- |
| 47 | |
| 48 | .. data:: DEFAULT_BUFFER_SIZE |
| 49 | |
| 50 | An int containing the default buffer size used by the module's buffered I/O |
Georg Brandl | 502d9a5 | 2009-07-26 15:02:41 +0000 | [diff] [blame] | 51 | classes. :func:`.open` uses the file's blksize (as obtained by |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 52 | :func:`os.stat`) if possible. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 53 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 54 | .. function:: open(file, mode='r', buffering=None, encoding=None, errors=None, newline=None, closefd=True) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 55 | |
Benjamin Peterson | 52c3bf1 | 2009-03-23 02:44:58 +0000 | [diff] [blame] | 56 | Open *file* and return a corresponding stream. If the file cannot be opened, |
| 57 | an :exc:`IOError` is raised. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 58 | |
Benjamin Peterson | 52c3bf1 | 2009-03-23 02:44:58 +0000 | [diff] [blame] | 59 | *file* is either a string or bytes object giving the name (and the path if |
| 60 | the file isn't in the current working directory) of the file to be opened or |
| 61 | an integer file descriptor of the file to be wrapped. (If a file descriptor |
| 62 | is given, it is closed when the returned I/O object is closed, unless |
| 63 | *closefd* is set to ``False``.) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 64 | |
Benjamin Peterson | dd21912 | 2008-04-11 21:17:32 +0000 | [diff] [blame] | 65 | *mode* is an optional string that specifies the mode in which the file is |
| 66 | opened. It defaults to ``'r'`` which means open for reading in text mode. |
| 67 | Other common values are ``'w'`` for writing (truncating the file if it |
| 68 | already exists), and ``'a'`` for appending (which on *some* Unix systems, |
| 69 | means that *all* writes append to the end of the file regardless of the |
| 70 | current seek position). In text mode, if *encoding* is not specified the |
| 71 | encoding used is platform dependent. (For reading and writing raw bytes use |
| 72 | binary mode and leave *encoding* unspecified.) The available modes are: |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 73 | |
| 74 | ========= =============================================================== |
| 75 | Character Meaning |
| 76 | --------- --------------------------------------------------------------- |
| 77 | ``'r'`` open for reading (default) |
| 78 | ``'w'`` open for writing, truncating the file first |
| 79 | ``'a'`` open for writing, appending to the end of the file if it exists |
| 80 | ``'b'`` binary mode |
| 81 | ``'t'`` text mode (default) |
| 82 | ``'+'`` open a disk file for updating (reading and writing) |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 83 | ``'U'`` universal newline mode (for backwards compatibility; should |
| 84 | not be used in new code) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 85 | ========= =============================================================== |
| 86 | |
| 87 | The default mode is ``'rt'`` (open for reading text). For binary random |
| 88 | access, the mode ``'w+b'`` opens and truncates the file to 0 bytes, while |
| 89 | ``'r+b'`` opens the file without truncation. |
| 90 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 91 | Python distinguishes between files opened in binary and text modes, even when |
| 92 | the underlying operating system doesn't. Files opened in binary mode |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 93 | (including ``'b'`` in the *mode* argument) return contents as ``bytes`` |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 94 | objects without any decoding. In text mode (the default, or when ``'t'`` is |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 95 | included in the *mode* argument), the contents of the file are returned as |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 96 | strings, the bytes having been first decoded using a platform-dependent |
| 97 | encoding or using the specified *encoding* if given. |
Benjamin Peterson | dd21912 | 2008-04-11 21:17:32 +0000 | [diff] [blame] | 98 | |
Antoine Pitrou | d5587bc | 2009-12-19 21:08:31 +0000 | [diff] [blame^] | 99 | *buffering* is an optional integer used to set the buffering policy. |
| 100 | Pass 0 to switch buffering off (only allowed in binary mode), 1 to select |
| 101 | line buffering (only usable in text mode), and an integer > 1 to indicate |
| 102 | the size of a fixed-size chunk buffer. When no *buffering* argument is |
| 103 | given, the default buffering policy works as follows: |
| 104 | |
| 105 | * Binary files are buffered in fixed-size chunks; the size of the buffer |
| 106 | is chosen using a heuristic trying to determine the underlying device's |
| 107 | "block size" and falling back on :attr:`DEFAULT_BUFFER_SIZE`. |
| 108 | On many systems, the buffer will typically be 4096 or 8192 bytes long. |
| 109 | |
| 110 | * "Interactive" text files (files for which :meth:`isatty` returns True) |
| 111 | use line buffering. Other text files use the policy described above |
| 112 | for binary files. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 113 | |
| 114 | *encoding* is the name of the encoding used to decode or encode the file. |
Benjamin Peterson | dd21912 | 2008-04-11 21:17:32 +0000 | [diff] [blame] | 115 | This should only be used in text mode. The default encoding is platform |
Benjamin Peterson | 52c3bf1 | 2009-03-23 02:44:58 +0000 | [diff] [blame] | 116 | dependent (whatever :func:`locale.getpreferredencoding` returns), but any |
| 117 | encoding supported by Python can be used. See the :mod:`codecs` module for |
| 118 | the list of supported encodings. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 119 | |
Benjamin Peterson | b85a584 | 2008-04-13 21:39:58 +0000 | [diff] [blame] | 120 | *errors* is an optional string that specifies how encoding and decoding |
Benjamin Peterson | 52c3bf1 | 2009-03-23 02:44:58 +0000 | [diff] [blame] | 121 | errors are to be handled--this cannot be used in binary mode. Pass |
| 122 | ``'strict'`` to raise a :exc:`ValueError` exception if there is an encoding |
| 123 | error (the default of ``None`` has the same effect), or pass ``'ignore'`` to |
| 124 | ignore errors. (Note that ignoring encoding errors can lead to data loss.) |
| 125 | ``'replace'`` causes a replacement marker (such as ``'?'``) to be inserted |
| 126 | where there is malformed data. When writing, ``'xmlcharrefreplace'`` |
| 127 | (replace with the appropriate XML character reference) or |
| 128 | ``'backslashreplace'`` (replace with backslashed escape sequences) can be |
| 129 | used. Any other error handling name that has been registered with |
| 130 | :func:`codecs.register_error` is also valid. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 131 | |
| 132 | *newline* controls how universal newlines works (it only applies to text |
| 133 | mode). It can be ``None``, ``''``, ``'\n'``, ``'\r'``, and ``'\r\n'``. It |
| 134 | works as follows: |
| 135 | |
| 136 | * On input, if *newline* is ``None``, universal newlines mode is enabled. |
| 137 | Lines in the input can end in ``'\n'``, ``'\r'``, or ``'\r\n'``, and these |
| 138 | are translated into ``'\n'`` before being returned to the caller. If it is |
| 139 | ``''``, universal newline mode is enabled, but line endings are returned to |
| 140 | the caller untranslated. If it has any of the other legal values, input |
| 141 | lines are only terminated by the given string, and the line ending is |
| 142 | returned to the caller untranslated. |
| 143 | |
| 144 | * On output, if *newline* is ``None``, any ``'\n'`` characters written are |
| 145 | translated to the system default line separator, :data:`os.linesep`. If |
| 146 | *newline* is ``''``, no translation takes place. If *newline* is any of |
| 147 | the other legal values, any ``'\n'`` characters written are translated to |
| 148 | the given string. |
| 149 | |
Benjamin Peterson | 8cad9c7 | 2009-03-23 02:38:01 +0000 | [diff] [blame] | 150 | If *closefd* is ``False`` and a file descriptor rather than a filename was |
| 151 | given, the underlying file descriptor will be kept open when the file is |
| 152 | closed. If a filename is given *closefd* has no effect and must be ``True`` |
| 153 | (the default). |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 154 | |
Georg Brandl | 502d9a5 | 2009-07-26 15:02:41 +0000 | [diff] [blame] | 155 | The type of file object returned by the :func:`.open` function depends on the |
| 156 | mode. When :func:`.open` is used to open a file in a text mode (``'w'``, |
Benjamin Peterson | 8cad9c7 | 2009-03-23 02:38:01 +0000 | [diff] [blame] | 157 | ``'r'``, ``'wt'``, ``'rt'``, etc.), it returns a subclass of |
| 158 | :class:`TextIOBase` (specifically :class:`TextIOWrapper`). When used to open |
| 159 | a file in a binary mode with buffering, the returned class is a subclass of |
| 160 | :class:`BufferedIOBase`. The exact class varies: in read binary mode, it |
| 161 | returns a :class:`BufferedReader`; in write binary and append binary modes, |
| 162 | it returns a :class:`BufferedWriter`, and in read/write mode, it returns a |
| 163 | :class:`BufferedRandom`. When buffering is disabled, the raw stream, a |
| 164 | subclass of :class:`RawIOBase`, :class:`FileIO`, is returned. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 165 | |
| 166 | It is also possible to use a string or bytearray as a file for both reading |
Benjamin Peterson | dd21912 | 2008-04-11 21:17:32 +0000 | [diff] [blame] | 167 | and writing. For strings :class:`StringIO` can be used like a file opened in |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 168 | a text mode, and for bytearrays a :class:`BytesIO` can be used like a |
| 169 | file opened in a binary mode. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 170 | |
| 171 | |
| 172 | .. exception:: BlockingIOError |
| 173 | |
| 174 | Error raised when blocking would occur on a non-blocking stream. It inherits |
| 175 | :exc:`IOError`. |
| 176 | |
| 177 | In addition to those of :exc:`IOError`, :exc:`BlockingIOError` has one |
| 178 | attribute: |
| 179 | |
| 180 | .. attribute:: characters_written |
| 181 | |
| 182 | An integer containing the number of characters written to the stream |
| 183 | before it blocked. |
| 184 | |
| 185 | |
| 186 | .. exception:: UnsupportedOperation |
| 187 | |
| 188 | An exception inheriting :exc:`IOError` and :exc:`ValueError` that is raised |
| 189 | when an unsupported operation is called on a stream. |
| 190 | |
| 191 | |
| 192 | I/O Base Classes |
| 193 | ---------------- |
| 194 | |
| 195 | .. class:: IOBase |
| 196 | |
| 197 | The abstract base class for all I/O classes, acting on streams of bytes. |
| 198 | There is no public constructor. |
| 199 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 200 | This class provides empty abstract implementations for many methods |
| 201 | that derived classes can override selectively; the default |
| 202 | implementations represent a file that cannot be read, written or |
| 203 | seeked. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 204 | |
| 205 | Even though :class:`IOBase` does not declare :meth:`read`, :meth:`readinto`, |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 206 | or :meth:`write` because their signatures will vary, implementations and |
| 207 | clients should consider those methods part of the interface. Also, |
| 208 | implementations may raise a :exc:`IOError` when operations they do not |
| 209 | support are called. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 210 | |
| 211 | The basic type used for binary data read from or written to a file is |
| 212 | :class:`bytes`. :class:`bytearray`\s are accepted too, and in some cases |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 213 | (such as :class:`readinto`) required. Text I/O classes work with |
| 214 | :class:`str` data. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 215 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 216 | Note that calling any method (even inquiries) on a closed stream is |
| 217 | undefined. Implementations may raise :exc:`IOError` in this case. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 218 | |
| 219 | IOBase (and its subclasses) support the iterator protocol, meaning that an |
| 220 | :class:`IOBase` object can be iterated over yielding the lines in a stream. |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 221 | Lines are defined slightly differently depending on whether the stream is |
| 222 | a binary stream (yielding bytes), or a text stream (yielding character |
| 223 | strings). See :meth:`readline` below. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 224 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 225 | IOBase is also a context manager and therefore supports the |
| 226 | :keyword:`with` statement. In this example, *file* is closed after the |
| 227 | :keyword:`with` statement's suite is finished---even if an exception occurs:: |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 228 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 229 | with open('spam.txt', 'w') as file: |
| 230 | file.write('Spam and eggs!') |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 231 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 232 | :class:`IOBase` provides these data attributes and methods: |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 233 | |
| 234 | .. method:: close() |
| 235 | |
Christian Heimes | ecc42a2 | 2008-11-05 19:30:32 +0000 | [diff] [blame] | 236 | Flush and close this stream. This method has no effect if the file is |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 237 | already closed. Once the file is closed, any operation on the file |
Christian Heimes | ecc42a2 | 2008-11-05 19:30:32 +0000 | [diff] [blame] | 238 | (e.g. reading or writing) will raise an :exc:`IOError`. The internal |
| 239 | file descriptor isn't closed if *closefd* was False. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 240 | |
| 241 | .. attribute:: closed |
| 242 | |
| 243 | True if the stream is closed. |
| 244 | |
| 245 | .. method:: fileno() |
| 246 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 247 | Return the underlying file descriptor (an integer) of the stream if it |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 248 | exists. An :exc:`IOError` is raised if the IO object does not use a file |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 249 | descriptor. |
| 250 | |
| 251 | .. method:: flush() |
| 252 | |
Benjamin Peterson | b85a584 | 2008-04-13 21:39:58 +0000 | [diff] [blame] | 253 | Flush the write buffers of the stream if applicable. This does nothing |
| 254 | for read-only and non-blocking streams. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 255 | |
| 256 | .. method:: isatty() |
| 257 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 258 | Return ``True`` if the stream is interactive (i.e., connected to |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 259 | a terminal/tty device). |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 260 | |
| 261 | .. method:: readable() |
| 262 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 263 | Return ``True`` if the stream can be read from. If False, :meth:`read` |
| 264 | will raise :exc:`IOError`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 265 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 266 | .. method:: readline(limit=-1) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 267 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 268 | Read and return one line from the stream. If *limit* is specified, at |
| 269 | most *limit* bytes will be read. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 270 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 271 | The line terminator is always ``b'\n'`` for binary files; for text files, |
Georg Brandl | 502d9a5 | 2009-07-26 15:02:41 +0000 | [diff] [blame] | 272 | the *newlines* argument to :func:`.open` can be used to select the line |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 273 | terminator(s) recognized. |
| 274 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 275 | .. method:: readlines(hint=-1) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 276 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 277 | Read and return a list of lines from the stream. *hint* can be specified |
| 278 | to control the number of lines read: no more lines will be read if the |
| 279 | total size (in bytes/characters) of all lines so far exceeds *hint*. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 280 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 281 | .. method:: seek(offset, whence=SEEK_SET) |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 282 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 283 | Change the stream position to the given byte *offset*. *offset* is |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 284 | interpreted relative to the position indicated by *whence*. Values for |
| 285 | *whence* are: |
| 286 | |
Benjamin Peterson | 0e4caf4 | 2009-04-01 21:22:20 +0000 | [diff] [blame] | 287 | * :data:`SEEK_SET` or ``0`` -- start of the stream (the default); |
| 288 | *offset* should be zero or positive |
| 289 | * :data:`SEEK_CUR` or ``1`` -- current stream position; *offset* may |
| 290 | be negative |
| 291 | * :data:`SEEK_END` or ``2`` -- end of the stream; *offset* is usually |
| 292 | negative |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 293 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 294 | Return the new absolute position. |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 295 | |
Raymond Hettinger | 35a8836 | 2009-04-09 00:08:24 +0000 | [diff] [blame] | 296 | .. versionadded:: 3.1 |
Benjamin Peterson | 0e4caf4 | 2009-04-01 21:22:20 +0000 | [diff] [blame] | 297 | The ``SEEK_*`` constants |
| 298 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 299 | .. method:: seekable() |
| 300 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 301 | Return ``True`` if the stream supports random access. If ``False``, |
| 302 | :meth:`seek`, :meth:`tell` and :meth:`truncate` will raise :exc:`IOError`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 303 | |
| 304 | .. method:: tell() |
| 305 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 306 | Return the current stream position. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 307 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 308 | .. method:: truncate(size=None) |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 309 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 310 | Truncate the file to at most *size* bytes. *size* defaults to the current |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 311 | file position, as returned by :meth:`tell`. |
| 312 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 313 | .. method:: writable() |
| 314 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 315 | Return ``True`` if the stream supports writing. If ``False``, |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 316 | :meth:`write` and :meth:`truncate` will raise :exc:`IOError`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 317 | |
| 318 | .. method:: writelines(lines) |
| 319 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 320 | Write a list of lines to the stream. Line separators are not added, so it |
| 321 | is usual for each of the lines provided to have a line separator at the |
| 322 | end. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 323 | |
| 324 | |
| 325 | .. class:: RawIOBase |
| 326 | |
| 327 | Base class for raw binary I/O. It inherits :class:`IOBase`. There is no |
| 328 | public constructor. |
| 329 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 330 | Raw binary I/O typically provides low-level access to an underlying OS |
| 331 | device or API, and does not try to encapsulate it in high-level primitives |
| 332 | (this is left to Buffered I/O and Text I/O, described later in this page). |
| 333 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 334 | In addition to the attributes and methods from :class:`IOBase`, |
| 335 | RawIOBase provides the following methods: |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 336 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 337 | .. method:: read(n=-1) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 338 | |
Antoine Pitrou | 78ddbe6 | 2009-10-01 16:24:45 +0000 | [diff] [blame] | 339 | Read up to *n* bytes from the object and return them. As a convenience, |
| 340 | if *n* is unspecified or -1, :meth:`readall` is called. Otherwise, |
| 341 | only one system call is ever made. Fewer than *n* bytes may be |
| 342 | returned if the operating system call returns fewer than *n* bytes. |
| 343 | |
| 344 | If 0 bytes are returned, and *n* was not 0, this indicates end of file. |
| 345 | If the object is in non-blocking mode and no bytes are available, |
| 346 | ``None`` is returned. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 347 | |
Benjamin Peterson | b47aace | 2008-04-09 21:38:38 +0000 | [diff] [blame] | 348 | .. method:: readall() |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 349 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 350 | Read and return all the bytes from the stream until EOF, using multiple |
| 351 | calls to the stream if necessary. |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 352 | |
| 353 | .. method:: readinto(b) |
| 354 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 355 | Read up to len(b) bytes into bytearray *b* and return the number of bytes |
| 356 | read. |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 357 | |
| 358 | .. method:: write(b) |
| 359 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 360 | Write the given bytes or bytearray object, *b*, to the underlying raw |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 361 | stream and return the number of bytes written. This can be less than |
| 362 | ``len(b)``, depending on specifics of the underlying raw stream, and |
| 363 | especially if it is in non-blocking mode. ``None`` is returned if the |
| 364 | raw stream is set not to block and no single byte could be readily |
| 365 | written to it. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 366 | |
| 367 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 368 | .. class:: BufferedIOBase |
| 369 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 370 | Base class for binary streams that support some kind of buffering. |
| 371 | It inherits :class:`IOBase`. There is no public constructor. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 372 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 373 | The main difference with :class:`RawIOBase` is that methods :meth:`read`, |
| 374 | :meth:`readinto` and :meth:`write` will try (respectively) to read as much |
| 375 | input as requested or to consume all given output, at the expense of |
| 376 | making perhaps more than one system call. |
| 377 | |
| 378 | In addition, those methods can raise :exc:`BlockingIOError` if the |
| 379 | underlying raw stream is in non-blocking mode and cannot take or give |
| 380 | enough data; unlike their :class:`RawIOBase` counterparts, they will |
| 381 | never return ``None``. |
| 382 | |
| 383 | Besides, the :meth:`read` method does not have a default |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 384 | implementation that defers to :meth:`readinto`. |
| 385 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 386 | A typical :class:`BufferedIOBase` implementation should not inherit from a |
| 387 | :class:`RawIOBase` implementation, but wrap one, like |
| 388 | :class:`BufferedWriter` and :class:`BufferedReader` do. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 389 | |
Benjamin Peterson | c609b6b | 2009-06-28 17:32:20 +0000 | [diff] [blame] | 390 | :class:`BufferedIOBase` provides or overrides these members in addition to |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 391 | those from :class:`IOBase`: |
| 392 | |
Benjamin Peterson | c609b6b | 2009-06-28 17:32:20 +0000 | [diff] [blame] | 393 | .. attribute:: raw |
| 394 | |
| 395 | The underlying raw stream (a :class:`RawIOBase` instance) that |
| 396 | :class:`BufferedIOBase` deals with. This is not part of the |
| 397 | :class:`BufferedIOBase` API and may not exist on some implementations. |
| 398 | |
Benjamin Peterson | d2e0c79 | 2009-05-01 20:40:59 +0000 | [diff] [blame] | 399 | .. method:: detach() |
| 400 | |
| 401 | Separate the underlying raw stream from the buffer and return it. |
| 402 | |
| 403 | After the raw stream has been detached, the buffer is in an unusable |
| 404 | state. |
| 405 | |
| 406 | Some buffers, like :class:`BytesIO`, do not have the concept of a single |
| 407 | raw stream to return from this method. They raise |
| 408 | :exc:`UnsupportedOperation`. |
| 409 | |
Benjamin Peterson | edc3647 | 2009-05-01 20:48:14 +0000 | [diff] [blame] | 410 | .. versionadded:: 3.1 |
| 411 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 412 | .. method:: read(n=-1) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 413 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 414 | Read and return up to *n* bytes. If the argument is omitted, ``None``, or |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 415 | negative, data is read and returned until EOF is reached. An empty bytes |
| 416 | object is returned if the stream is already at EOF. |
| 417 | |
| 418 | If the argument is positive, and the underlying raw stream is not |
| 419 | interactive, multiple raw reads may be issued to satisfy the byte count |
| 420 | (unless EOF is reached first). But for interactive raw streams, at most |
| 421 | one raw read will be issued, and a short result does not imply that EOF is |
| 422 | imminent. |
| 423 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 424 | A :exc:`BlockingIOError` is raised if the underlying raw stream is in |
| 425 | non blocking-mode, and has no data available at the moment. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 426 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 427 | .. method:: read1(n=-1) |
Benjamin Peterson | 4fa88fa | 2009-03-04 00:14:51 +0000 | [diff] [blame] | 428 | |
| 429 | Read and return up to *n* bytes, with at most one call to the underlying |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 430 | raw stream's :meth:`~RawIOBase.read` method. This can be useful if you |
| 431 | are implementing your own buffering on top of a :class:`BufferedIOBase` |
| 432 | object. |
Benjamin Peterson | 4fa88fa | 2009-03-04 00:14:51 +0000 | [diff] [blame] | 433 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 434 | .. method:: readinto(b) |
| 435 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 436 | Read up to len(b) bytes into bytearray *b* and return the number of bytes |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 437 | read. |
| 438 | |
| 439 | Like :meth:`read`, multiple reads may be issued to the underlying raw |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 440 | stream, unless the latter is 'interactive'. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 441 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 442 | A :exc:`BlockingIOError` is raised if the underlying raw stream is in |
| 443 | non blocking-mode, and has no data available at the moment. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 444 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 445 | .. method:: write(b) |
| 446 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 447 | Write the given bytes or bytearray object, *b* and return the number |
| 448 | of bytes written (never less than ``len(b)``, since if the write fails |
| 449 | an :exc:`IOError` will be raised). Depending on the actual |
| 450 | implementation, these bytes may be readily written to the underlying |
| 451 | stream, or held in a buffer for performance and latency reasons. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 452 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 453 | When in non-blocking mode, a :exc:`BlockingIOError` is raised if the |
| 454 | data needed to be written to the raw stream but it couldn't accept |
| 455 | all the data without blocking. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 456 | |
| 457 | |
Benjamin Peterson | aa06900 | 2009-01-23 03:26:36 +0000 | [diff] [blame] | 458 | Raw File I/O |
| 459 | ------------ |
| 460 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 461 | .. class:: FileIO(name, mode='r', closefd=True) |
Benjamin Peterson | aa06900 | 2009-01-23 03:26:36 +0000 | [diff] [blame] | 462 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 463 | :class:`FileIO` represents an OS-level file containing bytes data. |
| 464 | It implements the :class:`RawIOBase` interface (and therefore the |
| 465 | :class:`IOBase` interface, too). |
| 466 | |
| 467 | The *name* can be one of two things: |
| 468 | |
| 469 | * a character string or bytes object representing the path to the file |
| 470 | which will be opened; |
| 471 | * an integer representing the number of an existing OS-level file descriptor |
| 472 | to which the resulting :class:`FileIO` object will give access. |
Benjamin Peterson | aa06900 | 2009-01-23 03:26:36 +0000 | [diff] [blame] | 473 | |
| 474 | The *mode* can be ``'r'``, ``'w'`` or ``'a'`` for reading (default), writing, |
| 475 | or appending. The file will be created if it doesn't exist when opened for |
| 476 | writing or appending; it will be truncated when opened for writing. Add a |
| 477 | ``'+'`` to the mode to allow simultaneous reading and writing. |
| 478 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 479 | The :meth:`read` (when called with a positive argument), :meth:`readinto` |
| 480 | and :meth:`write` methods on this class will only make one system call. |
| 481 | |
Benjamin Peterson | aa06900 | 2009-01-23 03:26:36 +0000 | [diff] [blame] | 482 | In addition to the attributes and methods from :class:`IOBase` and |
| 483 | :class:`RawIOBase`, :class:`FileIO` provides the following data |
| 484 | attributes and methods: |
| 485 | |
| 486 | .. attribute:: mode |
| 487 | |
| 488 | The mode as given in the constructor. |
| 489 | |
| 490 | .. attribute:: name |
| 491 | |
| 492 | The file name. This is the file descriptor of the file when no name is |
| 493 | given in the constructor. |
| 494 | |
Benjamin Peterson | aa06900 | 2009-01-23 03:26:36 +0000 | [diff] [blame] | 495 | |
| 496 | Buffered Streams |
| 497 | ---------------- |
| 498 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 499 | In many situations, buffered I/O streams will provide higher performance |
| 500 | (bandwidth and latency) than raw I/O streams. Their API is also more usable. |
| 501 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 502 | .. class:: BytesIO([initial_bytes]) |
| 503 | |
| 504 | A stream implementation using an in-memory bytes buffer. It inherits |
| 505 | :class:`BufferedIOBase`. |
| 506 | |
| 507 | The argument *initial_bytes* is an optional initial bytearray. |
| 508 | |
| 509 | :class:`BytesIO` provides or overrides these methods in addition to those |
| 510 | from :class:`BufferedIOBase` and :class:`IOBase`: |
| 511 | |
| 512 | .. method:: getvalue() |
| 513 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 514 | Return ``bytes`` containing the entire contents of the buffer. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 515 | |
| 516 | .. method:: read1() |
| 517 | |
Benjamin Peterson | 9efcc4b | 2008-04-14 21:30:21 +0000 | [diff] [blame] | 518 | In :class:`BytesIO`, this is the same as :meth:`read`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 519 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 520 | .. method:: truncate([size]) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 521 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 522 | Truncate the buffer to at most *size* bytes. *size* defaults to the |
| 523 | current stream position, as returned by :meth:`tell`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 524 | |
| 525 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 526 | .. class:: BufferedReader(raw, buffer_size=DEFAULT_BUFFER_SIZE) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 527 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 528 | A buffer providing higher-level access to a readable, sequential |
| 529 | :class:`RawIOBase` object. It inherits :class:`BufferedIOBase`. |
| 530 | When reading data from this object, a larger amount of data may be |
| 531 | requested from the underlying raw stream, and kept in an internal buffer. |
| 532 | The buffered data can then be returned directly on subsequent reads. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 533 | |
| 534 | The constructor creates a :class:`BufferedReader` for the given readable |
| 535 | *raw* stream and *buffer_size*. If *buffer_size* is omitted, |
| 536 | :data:`DEFAULT_BUFFER_SIZE` is used. |
| 537 | |
| 538 | :class:`BufferedReader` provides or overrides these methods in addition to |
| 539 | those from :class:`BufferedIOBase` and :class:`IOBase`: |
| 540 | |
| 541 | .. method:: peek([n]) |
| 542 | |
Benjamin Peterson | c43a26d | 2009-06-16 23:09:24 +0000 | [diff] [blame] | 543 | Return bytes from the stream without advancing the position. At most one |
Benjamin Peterson | 2a8b54d | 2009-06-14 14:37:23 +0000 | [diff] [blame] | 544 | single read on the raw stream is done to satisfy the call. The number of |
| 545 | bytes returned may be less or more than requested. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 546 | |
| 547 | .. method:: read([n]) |
| 548 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 549 | Read and return *n* bytes, or if *n* is not given or negative, until EOF |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 550 | or if the read call would block in non-blocking mode. |
| 551 | |
| 552 | .. method:: read1(n) |
| 553 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 554 | Read and return up to *n* bytes with only one call on the raw stream. If |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 555 | at least one byte is buffered, only buffered bytes are returned. |
| 556 | Otherwise, one raw stream read call is made. |
| 557 | |
| 558 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 559 | .. class:: BufferedWriter(raw, buffer_size=DEFAULT_BUFFER_SIZE) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 560 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 561 | A buffer providing higher-level access to a writeable, sequential |
| 562 | :class:`RawIOBase` object. It inherits :class:`BufferedIOBase`. |
| 563 | When writing to this object, data is normally held into an internal |
| 564 | buffer. The buffer will be written out to the underlying :class:`RawIOBase` |
| 565 | object under various conditions, including: |
| 566 | |
| 567 | * when the buffer gets too small for all pending data; |
| 568 | * when :meth:`flush()` is called; |
| 569 | * when a :meth:`seek()` is requested (for :class:`BufferedRandom` objects); |
| 570 | * when the :class:`BufferedWriter` object is closed or destroyed. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 571 | |
| 572 | The constructor creates a :class:`BufferedWriter` for the given writeable |
| 573 | *raw* stream. If the *buffer_size* is not given, it defaults to |
Benjamin Peterson | 394ee00 | 2009-03-05 22:33:59 +0000 | [diff] [blame] | 574 | :data:`DEFAULT_BUFFER_SIZE`. |
| 575 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 576 | A third argument, *max_buffer_size*, is supported, but unused and deprecated. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 577 | |
| 578 | :class:`BufferedWriter` provides or overrides these methods in addition to |
| 579 | those from :class:`BufferedIOBase` and :class:`IOBase`: |
| 580 | |
| 581 | .. method:: flush() |
| 582 | |
| 583 | Force bytes held in the buffer into the raw stream. A |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 584 | :exc:`BlockingIOError` should be raised if the raw stream blocks. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 585 | |
| 586 | .. method:: write(b) |
| 587 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 588 | Write the bytes or bytearray object, *b* and return the number of bytes |
| 589 | written. When in non-blocking mode, a :exc:`BlockingIOError` is raised |
| 590 | if the buffer needs to be written out but the raw stream blocks. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 591 | |
| 592 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 593 | .. class:: BufferedRWPair(reader, writer, buffer_size=DEFAULT_BUFFER_SIZE) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 594 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 595 | A buffered I/O object giving a combined, higher-level access to two |
| 596 | sequential :class:`RawIOBase` objects: one readable, the other writeable. |
| 597 | It is useful for pairs of unidirectional communication channels |
| 598 | (pipes, for instance). It inherits :class:`BufferedIOBase`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 599 | |
| 600 | *reader* and *writer* are :class:`RawIOBase` objects that are readable and |
| 601 | writeable respectively. If the *buffer_size* is omitted it defaults to |
Benjamin Peterson | 394ee00 | 2009-03-05 22:33:59 +0000 | [diff] [blame] | 602 | :data:`DEFAULT_BUFFER_SIZE`. |
| 603 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 604 | A fourth argument, *max_buffer_size*, is supported, but unused and |
| 605 | deprecated. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 606 | |
Benjamin Peterson | d2e0c79 | 2009-05-01 20:40:59 +0000 | [diff] [blame] | 607 | :class:`BufferedRWPair` implements all of :class:`BufferedIOBase`\'s methods |
| 608 | except for :meth:`~BufferedIOBase.detach`, which raises |
| 609 | :exc:`UnsupportedOperation`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 610 | |
| 611 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 612 | .. class:: BufferedRandom(raw, buffer_size=DEFAULT_BUFFER_SIZE) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 613 | |
| 614 | A buffered interface to random access streams. It inherits |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 615 | :class:`BufferedReader` and :class:`BufferedWriter`, and further supports |
| 616 | :meth:`seek` and :meth:`tell` functionality. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 617 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 618 | The constructor creates a reader and writer for a seekable raw stream, given |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 619 | in the first argument. If the *buffer_size* is omitted it defaults to |
Benjamin Peterson | 394ee00 | 2009-03-05 22:33:59 +0000 | [diff] [blame] | 620 | :data:`DEFAULT_BUFFER_SIZE`. |
| 621 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 622 | A third argument, *max_buffer_size*, is supported, but unused and deprecated. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 623 | |
| 624 | :class:`BufferedRandom` is capable of anything :class:`BufferedReader` or |
| 625 | :class:`BufferedWriter` can do. |
| 626 | |
| 627 | |
| 628 | Text I/O |
| 629 | -------- |
| 630 | |
| 631 | .. class:: TextIOBase |
| 632 | |
| 633 | Base class for text streams. This class provides a character and line based |
| 634 | interface to stream I/O. There is no :meth:`readinto` method because |
| 635 | Python's character strings are immutable. It inherits :class:`IOBase`. |
| 636 | There is no public constructor. |
| 637 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 638 | :class:`TextIOBase` provides or overrides these data attributes and |
| 639 | methods in addition to those from :class:`IOBase`: |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 640 | |
| 641 | .. attribute:: encoding |
| 642 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 643 | The name of the encoding used to decode the stream's bytes into |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 644 | strings, and to encode strings into bytes. |
| 645 | |
Benjamin Peterson | 0926ad1 | 2009-06-06 18:02:12 +0000 | [diff] [blame] | 646 | .. attribute:: errors |
| 647 | |
| 648 | The error setting of the decoder or encoder. |
| 649 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 650 | .. attribute:: newlines |
| 651 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 652 | A string, a tuple of strings, or ``None``, indicating the newlines |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 653 | translated so far. Depending on the implementation and the initial |
| 654 | constructor flags, this may not be available. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 655 | |
Benjamin Peterson | c609b6b | 2009-06-28 17:32:20 +0000 | [diff] [blame] | 656 | .. attribute:: buffer |
| 657 | |
| 658 | The underlying binary buffer (a :class:`BufferedIOBase` instance) that |
| 659 | :class:`TextIOBase` deals with. This is not part of the |
| 660 | :class:`TextIOBase` API and may not exist on some implementations. |
| 661 | |
Benjamin Peterson | d2e0c79 | 2009-05-01 20:40:59 +0000 | [diff] [blame] | 662 | .. method:: detach() |
| 663 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 664 | Separate the underlying binary buffer from the :class:`TextIOBase` and |
| 665 | return it. |
Benjamin Peterson | d2e0c79 | 2009-05-01 20:40:59 +0000 | [diff] [blame] | 666 | |
| 667 | After the underlying buffer has been detached, the :class:`TextIOBase` is |
| 668 | in an unusable state. |
| 669 | |
| 670 | Some :class:`TextIOBase` implementations, like :class:`StringIO`, may not |
| 671 | have the concept of an underlying buffer and calling this method will |
| 672 | raise :exc:`UnsupportedOperation`. |
| 673 | |
Benjamin Peterson | edc3647 | 2009-05-01 20:48:14 +0000 | [diff] [blame] | 674 | .. versionadded:: 3.1 |
| 675 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 676 | .. method:: read(n) |
| 677 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 678 | Read and return at most *n* characters from the stream as a single |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 679 | :class:`str`. If *n* is negative or ``None``, reads until EOF. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 680 | |
| 681 | .. method:: readline() |
| 682 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 683 | Read until newline or EOF and return a single ``str``. If the stream is |
| 684 | already at EOF, an empty string is returned. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 685 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 686 | .. method:: write(s) |
| 687 | |
Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 688 | Write the string *s* to the stream and return the number of characters |
| 689 | written. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 690 | |
| 691 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 692 | .. class:: TextIOWrapper(buffer, encoding=None, errors=None, newline=None, line_buffering=False) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 693 | |
Antoine Pitrou | 497a767 | 2009-09-17 17:18:01 +0000 | [diff] [blame] | 694 | A buffered text stream over a :class:`BufferedIOBase` binary stream. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 695 | It inherits :class:`TextIOBase`. |
| 696 | |
| 697 | *encoding* gives the name of the encoding that the stream will be decoded or |
| 698 | encoded with. It defaults to :func:`locale.getpreferredencoding`. |
| 699 | |
Benjamin Peterson | b85a584 | 2008-04-13 21:39:58 +0000 | [diff] [blame] | 700 | *errors* is an optional string that specifies how encoding and decoding |
| 701 | errors are to be handled. Pass ``'strict'`` to raise a :exc:`ValueError` |
| 702 | exception if there is an encoding error (the default of ``None`` has the same |
| 703 | effect), or pass ``'ignore'`` to ignore errors. (Note that ignoring encoding |
| 704 | errors can lead to data loss.) ``'replace'`` causes a replacement marker |
Christian Heimes | a342c01 | 2008-04-20 21:01:16 +0000 | [diff] [blame] | 705 | (such as ``'?'``) to be inserted where there is malformed data. When |
| 706 | writing, ``'xmlcharrefreplace'`` (replace with the appropriate XML character |
| 707 | reference) or ``'backslashreplace'`` (replace with backslashed escape |
| 708 | sequences) can be used. Any other error handling name that has been |
| 709 | registered with :func:`codecs.register_error` is also valid. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 710 | |
| 711 | *newline* can be ``None``, ``''``, ``'\n'``, ``'\r'``, or ``'\r\n'``. It |
| 712 | controls the handling of line endings. If it is ``None``, universal newlines |
| 713 | is enabled. With this enabled, on input, the lines endings ``'\n'``, |
| 714 | ``'\r'``, or ``'\r\n'`` are translated to ``'\n'`` before being returned to |
| 715 | the caller. Conversely, on output, ``'\n'`` is translated to the system |
Mark Dickinson | 934896d | 2009-02-21 20:59:32 +0000 | [diff] [blame] | 716 | default line separator, :data:`os.linesep`. If *newline* is any other of its |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 717 | legal values, that newline becomes the newline when the file is read and it |
| 718 | is returned untranslated. On output, ``'\n'`` is converted to the *newline*. |
| 719 | |
| 720 | If *line_buffering* is ``True``, :meth:`flush` is implied when a call to |
| 721 | write contains a newline character. |
| 722 | |
Benjamin Peterson | 0926ad1 | 2009-06-06 18:02:12 +0000 | [diff] [blame] | 723 | :class:`TextIOWrapper` provides one attribute in addition to those of |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 724 | :class:`TextIOBase` and its parents: |
| 725 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 726 | .. attribute:: line_buffering |
| 727 | |
| 728 | Whether line buffering is enabled. |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 729 | |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 730 | |
Georg Brandl | 3dd3388 | 2009-06-01 17:35:27 +0000 | [diff] [blame] | 731 | .. class:: StringIO(initial_value='', newline=None) |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 732 | |
Georg Brandl | 2932d93 | 2008-05-30 06:27:09 +0000 | [diff] [blame] | 733 | An in-memory stream for text. It inherits :class:`TextIOWrapper`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 734 | |
Benjamin Peterson | aa1c8d8 | 2009-03-09 02:02:23 +0000 | [diff] [blame] | 735 | The initial value of the buffer (an empty string by default) can be set by |
| 736 | providing *initial_value*. The *newline* argument works like that of |
| 737 | :class:`TextIOWrapper`. The default is to do no newline translation. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 738 | |
Mark Summerfield | e6d5f30 | 2008-04-21 10:29:45 +0000 | [diff] [blame] | 739 | :class:`StringIO` provides this method in addition to those from |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 740 | :class:`TextIOWrapper` and its parents: |
| 741 | |
| 742 | .. method:: getvalue() |
| 743 | |
Georg Brandl | 2932d93 | 2008-05-30 06:27:09 +0000 | [diff] [blame] | 744 | Return a ``str`` containing the entire contents of the buffer at any |
| 745 | time before the :class:`StringIO` object's :meth:`close` method is |
| 746 | called. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 747 | |
Georg Brandl | 2932d93 | 2008-05-30 06:27:09 +0000 | [diff] [blame] | 748 | Example usage:: |
| 749 | |
| 750 | import io |
| 751 | |
| 752 | output = io.StringIO() |
| 753 | output.write('First line.\n') |
| 754 | print('Second line.', file=output) |
| 755 | |
| 756 | # Retrieve file contents -- this will be |
| 757 | # 'First line.\nSecond line.\n' |
| 758 | contents = output.getvalue() |
| 759 | |
Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 760 | # Close object and discard memory buffer -- |
Georg Brandl | 2932d93 | 2008-05-30 06:27:09 +0000 | [diff] [blame] | 761 | # .getvalue() will now raise an exception. |
| 762 | output.close() |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 763 | |
| 764 | .. class:: IncrementalNewlineDecoder |
| 765 | |
Benjamin Peterson | 2c5f828 | 2008-04-13 00:27:46 +0000 | [diff] [blame] | 766 | A helper codec that decodes newlines for universal newlines mode. It |
| 767 | inherits :class:`codecs.IncrementalDecoder`. |
Georg Brandl | 014197c | 2008-04-09 18:40:51 +0000 | [diff] [blame] | 768 | |