| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 1 | :mod:`sqlite3` --- DB-API 2.0 interface for SQLite databases | 
|  | 2 | ============================================================ | 
|  | 3 |  | 
|  | 4 | .. module:: sqlite3 | 
|  | 5 | :synopsis: A DB-API 2.0 implementation using SQLite 3.x. | 
|  | 6 | .. sectionauthor:: Gerhard Häring <gh@ghaering.de> | 
|  | 7 |  | 
|  | 8 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 9 | SQLite is a C library that provides a lightweight disk-based database that | 
|  | 10 | doesn't require a separate server process and allows accessing the database | 
|  | 11 | using a nonstandard variant of the SQL query language. Some applications can use | 
|  | 12 | SQLite for internal data storage.  It's also possible to prototype an | 
|  | 13 | application using SQLite and then port the code to a larger database such as | 
|  | 14 | PostgreSQL or Oracle. | 
|  | 15 |  | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 16 | sqlite3 was written by Gerhard Häring and provides a SQL interface compliant | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 17 | with the DB-API 2.0 specification described by :pep:`249`. | 
|  | 18 |  | 
|  | 19 | To use the module, you must first create a :class:`Connection` object that | 
|  | 20 | represents the database.  Here the data will be stored in the | 
|  | 21 | :file:`/tmp/example` file:: | 
|  | 22 |  | 
|  | 23 | conn = sqlite3.connect('/tmp/example') | 
|  | 24 |  | 
|  | 25 | You can also supply the special name ``:memory:`` to create a database in RAM. | 
|  | 26 |  | 
|  | 27 | Once you have a :class:`Connection`, you can create a :class:`Cursor`  object | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 28 | and call its :meth:`~Cursor.execute` method to perform SQL commands:: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 29 |  | 
|  | 30 | c = conn.cursor() | 
|  | 31 |  | 
|  | 32 | # Create table | 
|  | 33 | c.execute('''create table stocks | 
|  | 34 | (date text, trans text, symbol text, | 
|  | 35 | qty real, price real)''') | 
|  | 36 |  | 
|  | 37 | # Insert a row of data | 
|  | 38 | c.execute("""insert into stocks | 
|  | 39 | values ('2006-01-05','BUY','RHAT',100,35.14)""") | 
|  | 40 |  | 
|  | 41 | # Save (commit) the changes | 
|  | 42 | conn.commit() | 
|  | 43 |  | 
|  | 44 | # We can also close the cursor if we are done with it | 
|  | 45 | c.close() | 
|  | 46 |  | 
|  | 47 | Usually your SQL operations will need to use values from Python variables.  You | 
|  | 48 | shouldn't assemble your query using Python's string operations because doing so | 
|  | 49 | is insecure; it makes your program vulnerable to an SQL injection attack. | 
|  | 50 |  | 
|  | 51 | Instead, use the DB-API's parameter substitution.  Put ``?`` as a placeholder | 
|  | 52 | wherever you want to use a value, and then provide a tuple of values as the | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 53 | second argument to the cursor's :meth:`~Cursor.execute` method.  (Other database | 
|  | 54 | modules may use a different placeholder, such as ``%s`` or ``:1``.) For | 
|  | 55 | example:: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 56 |  | 
|  | 57 | # Never do this -- insecure! | 
|  | 58 | symbol = 'IBM' | 
|  | 59 | c.execute("... where symbol = '%s'" % symbol) | 
|  | 60 |  | 
|  | 61 | # Do this instead | 
|  | 62 | t = (symbol,) | 
|  | 63 | c.execute('select * from stocks where symbol=?', t) | 
|  | 64 |  | 
|  | 65 | # Larger example | 
| Georg Brandl | a971c65 | 2008-11-07 09:39:56 +0000 | [diff] [blame] | 66 | for t in [('2006-03-28', 'BUY', 'IBM', 1000, 45.00), | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 67 | ('2006-04-05', 'BUY', 'MSOFT', 1000, 72.00), | 
|  | 68 | ('2006-04-06', 'SELL', 'IBM', 500, 53.00), | 
| Georg Brandl | a971c65 | 2008-11-07 09:39:56 +0000 | [diff] [blame] | 69 | ]: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 70 | c.execute('insert into stocks values (?,?,?,?,?)', t) | 
|  | 71 |  | 
| Georg Brandl | 9afde1c | 2007-11-01 20:32:30 +0000 | [diff] [blame] | 72 | To retrieve data after executing a SELECT statement, you can either treat the | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 73 | cursor as an :term:`iterator`, call the cursor's :meth:`~Cursor.fetchone` method to | 
|  | 74 | retrieve a single matching row, or call :meth:`~Cursor.fetchall` to get a list of the | 
| Georg Brandl | 9afde1c | 2007-11-01 20:32:30 +0000 | [diff] [blame] | 75 | matching rows. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 76 |  | 
|  | 77 | This example uses the iterator form:: | 
|  | 78 |  | 
|  | 79 | >>> c = conn.cursor() | 
|  | 80 | >>> c.execute('select * from stocks order by price') | 
|  | 81 | >>> for row in c: | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 82 | ...     print(row) | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 83 | ... | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 84 | ('2006-01-05', 'BUY', 'RHAT', 100, 35.14) | 
|  | 85 | ('2006-03-28', 'BUY', 'IBM', 1000, 45.0) | 
|  | 86 | ('2006-04-06', 'SELL', 'IBM', 500, 53.0) | 
|  | 87 | ('2006-04-05', 'BUY', 'MSOFT', 1000, 72.0) | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 88 | >>> | 
|  | 89 |  | 
|  | 90 |  | 
|  | 91 | .. seealso:: | 
|  | 92 |  | 
| Benjamin Peterson | 2614cda | 2010-03-21 22:36:19 +0000 | [diff] [blame] | 93 | http://code.google.com/p/pysqlite/ | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 94 | The pysqlite web page -- sqlite3 is developed externally under the name | 
|  | 95 | "pysqlite". | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 96 |  | 
|  | 97 | http://www.sqlite.org | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 98 | The SQLite web page; the documentation describes the syntax and the | 
|  | 99 | available data types for the supported SQL dialect. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 100 |  | 
|  | 101 | :pep:`249` - Database API Specification 2.0 | 
|  | 102 | PEP written by Marc-André Lemburg. | 
|  | 103 |  | 
|  | 104 |  | 
|  | 105 | .. _sqlite3-module-contents: | 
|  | 106 |  | 
|  | 107 | Module functions and constants | 
|  | 108 | ------------------------------ | 
|  | 109 |  | 
|  | 110 |  | 
|  | 111 | .. data:: PARSE_DECLTYPES | 
|  | 112 |  | 
|  | 113 | This constant is meant to be used with the *detect_types* parameter of the | 
|  | 114 | :func:`connect` function. | 
|  | 115 |  | 
|  | 116 | Setting it makes the :mod:`sqlite3` module parse the declared type for each | 
| Christian Heimes | 81ee3ef | 2008-05-04 22:42:01 +0000 | [diff] [blame] | 117 | column it returns.  It will parse out the first word of the declared type, | 
|  | 118 | i. e.  for "integer primary key", it will parse out "integer", or for | 
|  | 119 | "number(10)" it will parse out "number". Then for that column, it will look | 
|  | 120 | into the converters dictionary and use the converter function registered for | 
|  | 121 | that type there. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 122 |  | 
|  | 123 |  | 
|  | 124 | .. data:: PARSE_COLNAMES | 
|  | 125 |  | 
|  | 126 | This constant is meant to be used with the *detect_types* parameter of the | 
|  | 127 | :func:`connect` function. | 
|  | 128 |  | 
|  | 129 | Setting this makes the SQLite interface parse the column name for each column it | 
|  | 130 | returns.  It will look for a string formed [mytype] in there, and then decide | 
|  | 131 | that 'mytype' is the type of the column. It will try to find an entry of | 
|  | 132 | 'mytype' in the converters dictionary and then use the converter function found | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 133 | there to return the value. The column name found in :attr:`Cursor.description` | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 134 | is only the first word of the column name, i.  e. if you use something like | 
|  | 135 | ``'as "x [datetime]"'`` in your SQL, then we will parse out everything until the | 
|  | 136 | first blank for the column name: the column name would simply be "x". | 
|  | 137 |  | 
|  | 138 |  | 
| Georg Brandl | 1c616a5 | 2010-07-10 12:01:34 +0000 | [diff] [blame] | 139 | .. function:: connect(database[, timeout, detect_types, isolation_level, check_same_thread, factory, cached_statements]) | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 140 |  | 
|  | 141 | Opens a connection to the SQLite database file *database*. You can use | 
|  | 142 | ``":memory:"`` to open a database connection to a database that resides in RAM | 
|  | 143 | instead of on disk. | 
|  | 144 |  | 
|  | 145 | When a database is accessed by multiple connections, and one of the processes | 
|  | 146 | modifies the database, the SQLite database is locked until that transaction is | 
|  | 147 | committed. The *timeout* parameter specifies how long the connection should wait | 
|  | 148 | for the lock to go away until raising an exception. The default for the timeout | 
|  | 149 | parameter is 5.0 (five seconds). | 
|  | 150 |  | 
|  | 151 | For the *isolation_level* parameter, please see the | 
|  | 152 | :attr:`Connection.isolation_level` property of :class:`Connection` objects. | 
|  | 153 |  | 
|  | 154 | SQLite natively supports only the types TEXT, INTEGER, FLOAT, BLOB and NULL. If | 
|  | 155 | you want to use other types you must add support for them yourself. The | 
|  | 156 | *detect_types* parameter and the using custom **converters** registered with the | 
|  | 157 | module-level :func:`register_converter` function allow you to easily do that. | 
|  | 158 |  | 
|  | 159 | *detect_types* defaults to 0 (i. e. off, no type detection), you can set it to | 
|  | 160 | any combination of :const:`PARSE_DECLTYPES` and :const:`PARSE_COLNAMES` to turn | 
|  | 161 | type detection on. | 
|  | 162 |  | 
|  | 163 | By default, the :mod:`sqlite3` module uses its :class:`Connection` class for the | 
|  | 164 | connect call.  You can, however, subclass the :class:`Connection` class and make | 
|  | 165 | :func:`connect` use your class instead by providing your class for the *factory* | 
|  | 166 | parameter. | 
|  | 167 |  | 
|  | 168 | Consult the section :ref:`sqlite3-types` of this manual for details. | 
|  | 169 |  | 
|  | 170 | The :mod:`sqlite3` module internally uses a statement cache to avoid SQL parsing | 
|  | 171 | overhead. If you want to explicitly set the number of statements that are cached | 
|  | 172 | for the connection, you can set the *cached_statements* parameter. The currently | 
|  | 173 | implemented default is to cache 100 statements. | 
|  | 174 |  | 
|  | 175 |  | 
|  | 176 | .. function:: register_converter(typename, callable) | 
|  | 177 |  | 
|  | 178 | Registers a callable to convert a bytestring from the database into a custom | 
|  | 179 | Python type. The callable will be invoked for all database values that are of | 
|  | 180 | the type *typename*. Confer the parameter *detect_types* of the :func:`connect` | 
|  | 181 | function for how the type detection works. Note that the case of *typename* and | 
|  | 182 | the name of the type in your query must match! | 
|  | 183 |  | 
|  | 184 |  | 
|  | 185 | .. function:: register_adapter(type, callable) | 
|  | 186 |  | 
|  | 187 | Registers a callable to convert the custom Python type *type* into one of | 
|  | 188 | SQLite's supported types. The callable *callable* accepts as single parameter | 
| Georg Brandl | 5c10664 | 2007-11-29 17:41:05 +0000 | [diff] [blame] | 189 | the Python value, and must return a value of the following types: int, | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 190 | float, str or bytes. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 191 |  | 
|  | 192 |  | 
|  | 193 | .. function:: complete_statement(sql) | 
|  | 194 |  | 
|  | 195 | Returns :const:`True` if the string *sql* contains one or more complete SQL | 
|  | 196 | statements terminated by semicolons. It does not verify that the SQL is | 
|  | 197 | syntactically correct, only that there are no unclosed string literals and the | 
|  | 198 | statement is terminated by a semicolon. | 
|  | 199 |  | 
|  | 200 | This can be used to build a shell for SQLite, as in the following example: | 
|  | 201 |  | 
|  | 202 |  | 
|  | 203 | .. literalinclude:: ../includes/sqlite3/complete_statement.py | 
|  | 204 |  | 
|  | 205 |  | 
|  | 206 | .. function:: enable_callback_tracebacks(flag) | 
|  | 207 |  | 
|  | 208 | By default you will not get any tracebacks in user-defined functions, | 
|  | 209 | aggregates, converters, authorizer callbacks etc. If you want to debug them, you | 
|  | 210 | can call this function with *flag* as True. Afterwards, you will get tracebacks | 
|  | 211 | from callbacks on ``sys.stderr``. Use :const:`False` to disable the feature | 
|  | 212 | again. | 
|  | 213 |  | 
|  | 214 |  | 
|  | 215 | .. _sqlite3-connection-objects: | 
|  | 216 |  | 
|  | 217 | Connection Objects | 
|  | 218 | ------------------ | 
|  | 219 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 220 | .. class:: Connection | 
|  | 221 |  | 
|  | 222 | A SQLite database connection has the following attributes and methods: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 223 |  | 
|  | 224 | .. attribute:: Connection.isolation_level | 
|  | 225 |  | 
| Benjamin Peterson | 4469d0c | 2008-11-30 22:46:23 +0000 | [diff] [blame] | 226 | Get or set the current isolation level. :const:`None` for autocommit mode or | 
|  | 227 | one of "DEFERRED", "IMMEDIATE" or "EXCLUSIVE". See section | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 228 | :ref:`sqlite3-controlling-transactions` for a more detailed explanation. | 
|  | 229 |  | 
| R. David Murray | d35251d | 2010-06-01 01:32:12 +0000 | [diff] [blame] | 230 | .. attribute:: Connection.in_transaction | 
|  | 231 |  | 
| Benjamin Peterson | 5c5eb36 | 2010-06-06 02:40:38 +0000 | [diff] [blame] | 232 | :const:`True` if a transaction is active (there are uncommitted changes), | 
| R. David Murray | d35251d | 2010-06-01 01:32:12 +0000 | [diff] [blame] | 233 | :const:`False` otherwise.  Read-only attribute. | 
|  | 234 |  | 
| Georg Brandl | 67b21b7 | 2010-08-17 15:07:14 +0000 | [diff] [blame] | 235 | .. versionadded:: 3.2 | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 236 |  | 
|  | 237 | .. method:: Connection.cursor([cursorClass]) | 
|  | 238 |  | 
|  | 239 | The cursor method accepts a single optional parameter *cursorClass*. If | 
|  | 240 | supplied, this must be a custom cursor class that extends | 
|  | 241 | :class:`sqlite3.Cursor`. | 
|  | 242 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 243 | .. method:: Connection.commit() | 
|  | 244 |  | 
|  | 245 | This method commits the current transaction. If you don't call this method, | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 246 | anything you did since the last call to ``commit()`` is not visible from from | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 247 | other database connections. If you wonder why you don't see the data you've | 
|  | 248 | written to the database, please check you didn't forget to call this method. | 
|  | 249 |  | 
|  | 250 | .. method:: Connection.rollback() | 
|  | 251 |  | 
|  | 252 | This method rolls back any changes to the database since the last call to | 
|  | 253 | :meth:`commit`. | 
|  | 254 |  | 
|  | 255 | .. method:: Connection.close() | 
|  | 256 |  | 
|  | 257 | This closes the database connection. Note that this does not automatically | 
|  | 258 | call :meth:`commit`. If you just close your database connection without | 
|  | 259 | calling :meth:`commit` first, your changes will be lost! | 
|  | 260 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 261 | .. method:: Connection.execute(sql, [parameters]) | 
|  | 262 |  | 
|  | 263 | This is a nonstandard shortcut that creates an intermediate cursor object by | 
| Ezio Melotti | a10a2e8 | 2010-02-14 02:54:22 +0000 | [diff] [blame] | 264 | calling the cursor method, then calls the cursor's | 
|  | 265 | :meth:`execute<Cursor.execute>` method with the parameters given. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 266 |  | 
|  | 267 |  | 
|  | 268 | .. method:: Connection.executemany(sql, [parameters]) | 
|  | 269 |  | 
|  | 270 | This is a nonstandard shortcut that creates an intermediate cursor object by | 
| Ezio Melotti | a10a2e8 | 2010-02-14 02:54:22 +0000 | [diff] [blame] | 271 | calling the cursor method, then calls the cursor's | 
|  | 272 | :meth:`executemany<Cursor.executemany>` method with the parameters given. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 273 |  | 
|  | 274 |  | 
|  | 275 | .. method:: Connection.executescript(sql_script) | 
|  | 276 |  | 
|  | 277 | This is a nonstandard shortcut that creates an intermediate cursor object by | 
| Ezio Melotti | a10a2e8 | 2010-02-14 02:54:22 +0000 | [diff] [blame] | 278 | calling the cursor method, then calls the cursor's | 
|  | 279 | :meth:`executescript<Cursor.executescript>` method with the parameters | 
|  | 280 | given. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 281 |  | 
|  | 282 |  | 
|  | 283 | .. method:: Connection.create_function(name, num_params, func) | 
|  | 284 |  | 
|  | 285 | Creates a user-defined function that you can later use from within SQL | 
|  | 286 | statements under the function name *name*. *num_params* is the number of | 
|  | 287 | parameters the function accepts, and *func* is a Python callable that is called | 
|  | 288 | as the SQL function. | 
|  | 289 |  | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 290 | The function can return any of the types supported by SQLite: bytes, str, int, | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 291 | float and None. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 292 |  | 
|  | 293 | Example: | 
|  | 294 |  | 
|  | 295 | .. literalinclude:: ../includes/sqlite3/md5func.py | 
|  | 296 |  | 
|  | 297 |  | 
|  | 298 | .. method:: Connection.create_aggregate(name, num_params, aggregate_class) | 
|  | 299 |  | 
|  | 300 | Creates a user-defined aggregate function. | 
|  | 301 |  | 
|  | 302 | The aggregate class must implement a ``step`` method, which accepts the number | 
|  | 303 | of parameters *num_params*, and a ``finalize`` method which will return the | 
|  | 304 | final result of the aggregate. | 
|  | 305 |  | 
|  | 306 | The ``finalize`` method can return any of the types supported by SQLite: | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 307 | bytes, str, int, float and None. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 308 |  | 
|  | 309 | Example: | 
|  | 310 |  | 
|  | 311 | .. literalinclude:: ../includes/sqlite3/mysumaggr.py | 
|  | 312 |  | 
|  | 313 |  | 
|  | 314 | .. method:: Connection.create_collation(name, callable) | 
|  | 315 |  | 
|  | 316 | Creates a collation with the specified *name* and *callable*. The callable will | 
|  | 317 | be passed two string arguments. It should return -1 if the first is ordered | 
|  | 318 | lower than the second, 0 if they are ordered equal and 1 if the first is ordered | 
|  | 319 | higher than the second.  Note that this controls sorting (ORDER BY in SQL) so | 
|  | 320 | your comparisons don't affect other SQL operations. | 
|  | 321 |  | 
|  | 322 | Note that the callable will get its parameters as Python bytestrings, which will | 
|  | 323 | normally be encoded in UTF-8. | 
|  | 324 |  | 
|  | 325 | The following example shows a custom collation that sorts "the wrong way": | 
|  | 326 |  | 
|  | 327 | .. literalinclude:: ../includes/sqlite3/collation_reverse.py | 
|  | 328 |  | 
|  | 329 | To remove a collation, call ``create_collation`` with None as callable:: | 
|  | 330 |  | 
|  | 331 | con.create_collation("reverse", None) | 
|  | 332 |  | 
|  | 333 |  | 
|  | 334 | .. method:: Connection.interrupt() | 
|  | 335 |  | 
|  | 336 | You can call this method from a different thread to abort any queries that might | 
|  | 337 | be executing on the connection. The query will then abort and the caller will | 
|  | 338 | get an exception. | 
|  | 339 |  | 
|  | 340 |  | 
|  | 341 | .. method:: Connection.set_authorizer(authorizer_callback) | 
|  | 342 |  | 
|  | 343 | This routine registers a callback. The callback is invoked for each attempt to | 
|  | 344 | access a column of a table in the database. The callback should return | 
|  | 345 | :const:`SQLITE_OK` if access is allowed, :const:`SQLITE_DENY` if the entire SQL | 
|  | 346 | statement should be aborted with an error and :const:`SQLITE_IGNORE` if the | 
|  | 347 | column should be treated as a NULL value. These constants are available in the | 
|  | 348 | :mod:`sqlite3` module. | 
|  | 349 |  | 
|  | 350 | The first argument to the callback signifies what kind of operation is to be | 
|  | 351 | authorized. The second and third argument will be arguments or :const:`None` | 
|  | 352 | depending on the first argument. The 4th argument is the name of the database | 
|  | 353 | ("main", "temp", etc.) if applicable. The 5th argument is the name of the | 
|  | 354 | inner-most trigger or view that is responsible for the access attempt or | 
|  | 355 | :const:`None` if this access attempt is directly from input SQL code. | 
|  | 356 |  | 
|  | 357 | Please consult the SQLite documentation about the possible values for the first | 
|  | 358 | argument and the meaning of the second and third argument depending on the first | 
|  | 359 | one. All necessary constants are available in the :mod:`sqlite3` module. | 
|  | 360 |  | 
|  | 361 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 362 | .. method:: Connection.set_progress_handler(handler, n) | 
|  | 363 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 364 | This routine registers a callback. The callback is invoked for every *n* | 
|  | 365 | instructions of the SQLite virtual machine. This is useful if you want to | 
|  | 366 | get called from SQLite during long-running operations, for example to update | 
|  | 367 | a GUI. | 
|  | 368 |  | 
|  | 369 | If you want to clear any previously installed progress handler, call the | 
|  | 370 | method with :const:`None` for *handler*. | 
|  | 371 |  | 
|  | 372 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 373 | .. method:: Connection.enable_load_extension(enabled) | 
|  | 374 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 375 | This routine allows/disallows the SQLite engine to load SQLite extensions | 
|  | 376 | from shared libraries.  SQLite extensions can define new functions, | 
|  | 377 | aggregates or whole new virtual table implementations. One well-known | 
|  | 378 | extension is the fulltext-search extension distributed with SQLite. | 
|  | 379 |  | 
| Georg Brandl | 67b21b7 | 2010-08-17 15:07:14 +0000 | [diff] [blame] | 380 | .. versionadded:: 3.2 | 
|  | 381 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 382 | .. literalinclude:: ../includes/sqlite3/load_extension.py | 
|  | 383 |  | 
| Gerhard Häring | e0941c5 | 2010-10-03 21:47:06 +0000 | [diff] [blame^] | 384 | Loadable extensions are disabled by default. See [#f1]_ | 
|  | 385 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 386 | .. method:: Connection.load_extension(path) | 
|  | 387 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 388 | This routine loads a SQLite extension from a shared library. You have to | 
|  | 389 | enable extension loading with ``enable_load_extension`` before you can use | 
|  | 390 | this routine. | 
|  | 391 |  | 
| Georg Brandl | 67b21b7 | 2010-08-17 15:07:14 +0000 | [diff] [blame] | 392 | .. versionadded:: 3.2 | 
|  | 393 |  | 
| Gerhard Häring | e0941c5 | 2010-10-03 21:47:06 +0000 | [diff] [blame^] | 394 | Loadable extensions are disabled by default. See [#f1]_ | 
|  | 395 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 396 | .. attribute:: Connection.row_factory | 
|  | 397 |  | 
|  | 398 | You can change this attribute to a callable that accepts the cursor and the | 
|  | 399 | original row as a tuple and will return the real result row.  This way, you can | 
|  | 400 | implement more advanced ways of returning results, such  as returning an object | 
|  | 401 | that can also access columns by name. | 
|  | 402 |  | 
|  | 403 | Example: | 
|  | 404 |  | 
|  | 405 | .. literalinclude:: ../includes/sqlite3/row_factory.py | 
|  | 406 |  | 
|  | 407 | If returning a tuple doesn't suffice and you want name-based access to | 
|  | 408 | columns, you should consider setting :attr:`row_factory` to the | 
|  | 409 | highly-optimized :class:`sqlite3.Row` type. :class:`Row` provides both | 
|  | 410 | index-based and case-insensitive name-based access to columns with almost no | 
|  | 411 | memory overhead. It will probably be better than your own custom | 
|  | 412 | dictionary-based approach or even a db_row based solution. | 
|  | 413 |  | 
| Christian Heimes | 5b5e81c | 2007-12-31 16:14:33 +0000 | [diff] [blame] | 414 | .. XXX what's a db_row-based solution? | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 415 |  | 
|  | 416 |  | 
|  | 417 | .. attribute:: Connection.text_factory | 
|  | 418 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 419 | Using this attribute you can control what objects are returned for the ``TEXT`` | 
|  | 420 | data type. By default, this attribute is set to :class:`str` and the | 
|  | 421 | :mod:`sqlite3` module will return Unicode objects for ``TEXT``. If you want to | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 422 | return bytestrings instead, you can set it to :class:`bytes`. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 423 |  | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 424 | For efficiency reasons, there's also a way to return :class:`str` objects | 
|  | 425 | only for non-ASCII data, and :class:`bytes` otherwise. To activate it, set | 
|  | 426 | this attribute to :const:`sqlite3.OptimizedUnicode`. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 427 |  | 
|  | 428 | You can also set it to any other callable that accepts a single bytestring | 
|  | 429 | parameter and returns the resulting object. | 
|  | 430 |  | 
|  | 431 | See the following example code for illustration: | 
|  | 432 |  | 
|  | 433 | .. literalinclude:: ../includes/sqlite3/text_factory.py | 
|  | 434 |  | 
|  | 435 |  | 
|  | 436 | .. attribute:: Connection.total_changes | 
|  | 437 |  | 
|  | 438 | Returns the total number of database rows that have been modified, inserted, or | 
|  | 439 | deleted since the database connection was opened. | 
|  | 440 |  | 
|  | 441 |  | 
| Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 442 | .. attribute:: Connection.iterdump | 
|  | 443 |  | 
|  | 444 | Returns an iterator to dump the database in an SQL text format.  Useful when | 
|  | 445 | saving an in-memory database for later restoration.  This function provides | 
|  | 446 | the same capabilities as the :kbd:`.dump` command in the :program:`sqlite3` | 
|  | 447 | shell. | 
|  | 448 |  | 
| Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 449 | Example:: | 
|  | 450 |  | 
|  | 451 | # Convert file existing_db.db to SQL dump file dump.sql | 
|  | 452 | import sqlite3, os | 
|  | 453 |  | 
|  | 454 | con = sqlite3.connect('existing_db.db') | 
| Georg Brandl | a971c65 | 2008-11-07 09:39:56 +0000 | [diff] [blame] | 455 | with open('dump.sql', 'w') as f: | 
|  | 456 | for line in con.iterdump(): | 
|  | 457 | f.write('%s\n' % line) | 
| Christian Heimes | bbe741d | 2008-03-28 10:53:29 +0000 | [diff] [blame] | 458 |  | 
|  | 459 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 460 | .. _sqlite3-cursor-objects: | 
|  | 461 |  | 
|  | 462 | Cursor Objects | 
|  | 463 | -------------- | 
|  | 464 |  | 
| Gerhard Häring | f9cee22 | 2010-03-05 15:20:03 +0000 | [diff] [blame] | 465 | A :class:`Cursor` instance has the following attributes and methods: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 466 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 467 | A SQLite database cursor has the following attributes and methods: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 468 |  | 
|  | 469 | .. method:: Cursor.execute(sql, [parameters]) | 
|  | 470 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 471 | Executes an SQL statement. The SQL statement may be parametrized (i. e. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 472 | placeholders instead of SQL literals). The :mod:`sqlite3` module supports two | 
|  | 473 | kinds of placeholders: question marks (qmark style) and named placeholders | 
|  | 474 | (named style). | 
|  | 475 |  | 
|  | 476 | This example shows how to use parameters with qmark style: | 
|  | 477 |  | 
|  | 478 | .. literalinclude:: ../includes/sqlite3/execute_1.py | 
|  | 479 |  | 
|  | 480 | This example shows how to use the named style: | 
|  | 481 |  | 
|  | 482 | .. literalinclude:: ../includes/sqlite3/execute_2.py | 
|  | 483 |  | 
|  | 484 | :meth:`execute` will only execute a single SQL statement. If you try to execute | 
|  | 485 | more than one statement with it, it will raise a Warning. Use | 
|  | 486 | :meth:`executescript` if you want to execute multiple SQL statements with one | 
|  | 487 | call. | 
|  | 488 |  | 
|  | 489 |  | 
|  | 490 | .. method:: Cursor.executemany(sql, seq_of_parameters) | 
|  | 491 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 492 | Executes an SQL command against all parameter sequences or mappings found in | 
| Georg Brandl | 9afde1c | 2007-11-01 20:32:30 +0000 | [diff] [blame] | 493 | the sequence *sql*.  The :mod:`sqlite3` module also allows using an | 
|  | 494 | :term:`iterator` yielding parameters instead of a sequence. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 495 |  | 
|  | 496 | .. literalinclude:: ../includes/sqlite3/executemany_1.py | 
|  | 497 |  | 
| Georg Brandl | 9afde1c | 2007-11-01 20:32:30 +0000 | [diff] [blame] | 498 | Here's a shorter example using a :term:`generator`: | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 499 |  | 
|  | 500 | .. literalinclude:: ../includes/sqlite3/executemany_2.py | 
|  | 501 |  | 
|  | 502 |  | 
|  | 503 | .. method:: Cursor.executescript(sql_script) | 
|  | 504 |  | 
|  | 505 | This is a nonstandard convenience method for executing multiple SQL statements | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 506 | at once. It issues a ``COMMIT`` statement first, then executes the SQL script it | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 507 | gets as a parameter. | 
|  | 508 |  | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 509 | *sql_script* can be an instance of :class:`str` or :class:`bytes`. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 510 |  | 
|  | 511 | Example: | 
|  | 512 |  | 
|  | 513 | .. literalinclude:: ../includes/sqlite3/executescript.py | 
|  | 514 |  | 
|  | 515 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 516 | .. method:: Cursor.fetchone() | 
|  | 517 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 518 | Fetches the next row of a query result set, returning a single sequence, | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 519 | or :const:`None` when no more data is available. | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 520 |  | 
|  | 521 |  | 
|  | 522 | .. method:: Cursor.fetchmany([size=cursor.arraysize]) | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 523 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 524 | Fetches the next set of rows of a query result, returning a list.  An empty | 
|  | 525 | list is returned when no more rows are available. | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 526 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 527 | The number of rows to fetch per call is specified by the *size* parameter. | 
|  | 528 | If it is not given, the cursor's arraysize determines the number of rows | 
|  | 529 | to be fetched. The method should try to fetch as many rows as indicated by | 
|  | 530 | the size parameter. If this is not possible due to the specified number of | 
|  | 531 | rows not being available, fewer rows may be returned. | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 532 |  | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 533 | Note there are performance considerations involved with the *size* parameter. | 
|  | 534 | For optimal performance, it is usually best to use the arraysize attribute. | 
|  | 535 | If the *size* parameter is used, then it is best for it to retain the same | 
|  | 536 | value from one :meth:`fetchmany` call to the next. | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 537 |  | 
|  | 538 | .. method:: Cursor.fetchall() | 
| Christian Heimes | fdab48e | 2008-01-20 09:06:41 +0000 | [diff] [blame] | 539 |  | 
|  | 540 | Fetches all (remaining) rows of a query result, returning a list.  Note that | 
|  | 541 | the cursor's arraysize attribute can affect the performance of this operation. | 
|  | 542 | An empty list is returned when no rows are available. | 
|  | 543 |  | 
|  | 544 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 545 | .. attribute:: Cursor.rowcount | 
|  | 546 |  | 
|  | 547 | Although the :class:`Cursor` class of the :mod:`sqlite3` module implements this | 
|  | 548 | attribute, the database engine's own support for the determination of "rows | 
|  | 549 | affected"/"rows selected" is quirky. | 
|  | 550 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 551 | For ``DELETE`` statements, SQLite reports :attr:`rowcount` as 0 if you make a | 
|  | 552 | ``DELETE FROM table`` without any condition. | 
|  | 553 |  | 
|  | 554 | For :meth:`executemany` statements, the number of modifications are summed up | 
|  | 555 | into :attr:`rowcount`. | 
|  | 556 |  | 
|  | 557 | As required by the Python DB API Spec, the :attr:`rowcount` attribute "is -1 in | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 558 | case no ``executeXX()`` has been performed on the cursor or the rowcount of the | 
|  | 559 | last operation is not determinable by the interface". | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 560 |  | 
| Guido van Rossum | 04110fb | 2007-08-24 16:32:05 +0000 | [diff] [blame] | 561 | This includes ``SELECT`` statements because we cannot determine the number of | 
|  | 562 | rows a query produced until all rows were fetched. | 
|  | 563 |  | 
| Gerhard Häring | d337279 | 2008-03-29 19:13:55 +0000 | [diff] [blame] | 564 | .. attribute:: Cursor.lastrowid | 
|  | 565 |  | 
|  | 566 | This read-only attribute provides the rowid of the last modified row. It is | 
|  | 567 | only set if you issued a ``INSERT`` statement using the :meth:`execute` | 
|  | 568 | method. For operations other than ``INSERT`` or when :meth:`executemany` is | 
|  | 569 | called, :attr:`lastrowid` is set to :const:`None`. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 570 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 571 | .. attribute:: Cursor.description | 
|  | 572 |  | 
|  | 573 | This read-only attribute provides the column names of the last query. To | 
|  | 574 | remain compatible with the Python DB API, it returns a 7-tuple for each | 
| Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 575 | column where the last six items of each tuple are :const:`None`. | 
|  | 576 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 577 | It is set for ``SELECT`` statements without any matching rows as well. | 
|  | 578 |  | 
|  | 579 | .. _sqlite3-row-objects: | 
|  | 580 |  | 
|  | 581 | Row Objects | 
|  | 582 | ----------- | 
|  | 583 |  | 
|  | 584 | .. class:: Row | 
|  | 585 |  | 
|  | 586 | A :class:`Row` instance serves as a highly optimized | 
| Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 587 | :attr:`~Connection.row_factory` for :class:`Connection` objects. | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 588 | It tries to mimic a tuple in most of its features. | 
|  | 589 |  | 
|  | 590 | It supports mapping access by column name and index, iteration, | 
|  | 591 | representation, equality testing and :func:`len`. | 
|  | 592 |  | 
|  | 593 | If two :class:`Row` objects have exactly the same columns and their | 
|  | 594 | members are equal, they compare equal. | 
| Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 595 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 596 | .. method:: keys | 
|  | 597 |  | 
|  | 598 | This method returns a tuple of column names. Immediately after a query, | 
|  | 599 | it is the first member of each tuple in :attr:`Cursor.description`. | 
|  | 600 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 601 | Let's assume we initialize a table as in the example given above:: | 
|  | 602 |  | 
|  | 603 | conn = sqlite3.connect(":memory:") | 
|  | 604 | c = conn.cursor() | 
|  | 605 | c.execute('''create table stocks | 
|  | 606 | (date text, trans text, symbol text, | 
|  | 607 | qty real, price real)''') | 
|  | 608 | c.execute("""insert into stocks | 
|  | 609 | values ('2006-01-05','BUY','RHAT',100,35.14)""") | 
|  | 610 | conn.commit() | 
|  | 611 | c.close() | 
|  | 612 |  | 
|  | 613 | Now we plug :class:`Row` in:: | 
|  | 614 |  | 
|  | 615 | >>> conn.row_factory = sqlite3.Row | 
|  | 616 | >>> c = conn.cursor() | 
|  | 617 | >>> c.execute('select * from stocks') | 
|  | 618 | <sqlite3.Cursor object at 0x7f4e7dd8fa80> | 
|  | 619 | >>> r = c.fetchone() | 
|  | 620 | >>> type(r) | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 621 | <class 'sqlite3.Row'> | 
|  | 622 | >>> tuple(r) | 
|  | 623 | ('2006-01-05', 'BUY', 'RHAT', 100.0, 35.14) | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 624 | >>> len(r) | 
|  | 625 | 5 | 
|  | 626 | >>> r[2] | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 627 | 'RHAT' | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 628 | >>> r.keys() | 
|  | 629 | ['date', 'trans', 'symbol', 'qty', 'price'] | 
|  | 630 | >>> r['qty'] | 
|  | 631 | 100.0 | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 632 | >>> for member in r: | 
|  | 633 | ...     print(member) | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 634 | ... | 
|  | 635 | 2006-01-05 | 
|  | 636 | BUY | 
|  | 637 | RHAT | 
|  | 638 | 100.0 | 
|  | 639 | 35.14 | 
|  | 640 |  | 
|  | 641 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 642 | .. _sqlite3-types: | 
|  | 643 |  | 
|  | 644 | SQLite and Python types | 
|  | 645 | ----------------------- | 
|  | 646 |  | 
|  | 647 |  | 
|  | 648 | Introduction | 
|  | 649 | ^^^^^^^^^^^^ | 
|  | 650 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 651 | SQLite natively supports the following types: ``NULL``, ``INTEGER``, | 
|  | 652 | ``REAL``, ``TEXT``, ``BLOB``. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 653 |  | 
|  | 654 | The following Python types can thus be sent to SQLite without any problem: | 
|  | 655 |  | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 656 | +-------------------------------+-------------+ | 
|  | 657 | | Python type                   | SQLite type | | 
|  | 658 | +===============================+=============+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 659 | | :const:`None`                 | ``NULL``    | | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 660 | +-------------------------------+-------------+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 661 | | :class:`int`                  | ``INTEGER`` | | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 662 | +-------------------------------+-------------+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 663 | | :class:`float`                | ``REAL``    | | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 664 | +-------------------------------+-------------+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 665 | | :class:`str`                  | ``TEXT``    | | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 666 | +-------------------------------+-------------+ | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 667 | | :class:`bytes`                | ``BLOB``    | | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 668 | +-------------------------------+-------------+ | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 669 |  | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 670 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 671 | This is how SQLite types are converted to Python types by default: | 
|  | 672 |  | 
|  | 673 | +-------------+---------------------------------------------+ | 
|  | 674 | | SQLite type | Python type                                 | | 
|  | 675 | +=============+=============================================+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 676 | | ``NULL``    | :const:`None`                               | | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 677 | +-------------+---------------------------------------------+ | 
| Ezio Melotti | b584505 | 2009-09-13 05:49:25 +0000 | [diff] [blame] | 678 | | ``INTEGER`` | :class:`int`                                | | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 679 | +-------------+---------------------------------------------+ | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 680 | | ``REAL``    | :class:`float`                              | | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 681 | +-------------+---------------------------------------------+ | 
| Georg Brandl | f694518 | 2008-02-01 11:56:49 +0000 | [diff] [blame] | 682 | | ``TEXT``    | depends on text_factory, str by default     | | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 683 | +-------------+---------------------------------------------+ | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 684 | | ``BLOB``    | :class:`bytes`                              | | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 685 | +-------------+---------------------------------------------+ | 
|  | 686 |  | 
|  | 687 | The type system of the :mod:`sqlite3` module is extensible in two ways: you can | 
|  | 688 | store additional Python types in a SQLite database via object adaptation, and | 
|  | 689 | you can let the :mod:`sqlite3` module convert SQLite types to different Python | 
|  | 690 | types via converters. | 
|  | 691 |  | 
|  | 692 |  | 
|  | 693 | Using adapters to store additional Python types in SQLite databases | 
|  | 694 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 695 |  | 
|  | 696 | As described before, SQLite supports only a limited set of types natively. To | 
|  | 697 | use other Python types with SQLite, you must **adapt** them to one of the | 
| Georg Brandl | 5c10664 | 2007-11-29 17:41:05 +0000 | [diff] [blame] | 698 | sqlite3 module's supported types for SQLite: one of NoneType, int, float, | 
| Antoine Pitrou | f06917e | 2010-02-02 23:00:29 +0000 | [diff] [blame] | 699 | str, bytes. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 700 |  | 
|  | 701 | The :mod:`sqlite3` module uses Python object adaptation, as described in | 
|  | 702 | :pep:`246` for this.  The protocol to use is :class:`PrepareProtocol`. | 
|  | 703 |  | 
|  | 704 | There are two ways to enable the :mod:`sqlite3` module to adapt a custom Python | 
|  | 705 | type to one of the supported ones. | 
|  | 706 |  | 
|  | 707 |  | 
|  | 708 | Letting your object adapt itself | 
|  | 709 | """""""""""""""""""""""""""""""" | 
|  | 710 |  | 
|  | 711 | This is a good approach if you write the class yourself. Let's suppose you have | 
|  | 712 | a class like this:: | 
|  | 713 |  | 
|  | 714 | class Point(object): | 
|  | 715 | def __init__(self, x, y): | 
|  | 716 | self.x, self.y = x, y | 
|  | 717 |  | 
|  | 718 | Now you want to store the point in a single SQLite column.  First you'll have to | 
|  | 719 | choose one of the supported types first to be used for representing the point. | 
|  | 720 | Let's just use str and separate the coordinates using a semicolon. Then you need | 
|  | 721 | to give your class a method ``__conform__(self, protocol)`` which must return | 
|  | 722 | the converted value. The parameter *protocol* will be :class:`PrepareProtocol`. | 
|  | 723 |  | 
|  | 724 | .. literalinclude:: ../includes/sqlite3/adapter_point_1.py | 
|  | 725 |  | 
|  | 726 |  | 
|  | 727 | Registering an adapter callable | 
|  | 728 | """"""""""""""""""""""""""""""" | 
|  | 729 |  | 
|  | 730 | The other possibility is to create a function that converts the type to the | 
|  | 731 | string representation and register the function with :meth:`register_adapter`. | 
|  | 732 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 733 | .. literalinclude:: ../includes/sqlite3/adapter_point_2.py | 
|  | 734 |  | 
|  | 735 | The :mod:`sqlite3` module has two default adapters for Python's built-in | 
|  | 736 | :class:`datetime.date` and :class:`datetime.datetime` types.  Now let's suppose | 
|  | 737 | we want to store :class:`datetime.datetime` objects not in ISO representation, | 
|  | 738 | but as a Unix timestamp. | 
|  | 739 |  | 
|  | 740 | .. literalinclude:: ../includes/sqlite3/adapter_datetime.py | 
|  | 741 |  | 
|  | 742 |  | 
|  | 743 | Converting SQLite values to custom Python types | 
|  | 744 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 745 |  | 
|  | 746 | Writing an adapter lets you send custom Python types to SQLite. But to make it | 
|  | 747 | really useful we need to make the Python to SQLite to Python roundtrip work. | 
|  | 748 |  | 
|  | 749 | Enter converters. | 
|  | 750 |  | 
|  | 751 | Let's go back to the :class:`Point` class. We stored the x and y coordinates | 
|  | 752 | separated via semicolons as strings in SQLite. | 
|  | 753 |  | 
|  | 754 | First, we'll define a converter function that accepts the string as a parameter | 
|  | 755 | and constructs a :class:`Point` object from it. | 
|  | 756 |  | 
|  | 757 | .. note:: | 
|  | 758 |  | 
|  | 759 | Converter functions **always** get called with a string, no matter under which | 
|  | 760 | data type you sent the value to SQLite. | 
|  | 761 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 762 | :: | 
|  | 763 |  | 
|  | 764 | def convert_point(s): | 
|  | 765 | x, y = map(float, s.split(";")) | 
|  | 766 | return Point(x, y) | 
|  | 767 |  | 
|  | 768 | Now you need to make the :mod:`sqlite3` module know that what you select from | 
|  | 769 | the database is actually a point. There are two ways of doing this: | 
|  | 770 |  | 
|  | 771 | * Implicitly via the declared type | 
|  | 772 |  | 
|  | 773 | * Explicitly via the column name | 
|  | 774 |  | 
|  | 775 | Both ways are described in section :ref:`sqlite3-module-contents`, in the entries | 
|  | 776 | for the constants :const:`PARSE_DECLTYPES` and :const:`PARSE_COLNAMES`. | 
|  | 777 |  | 
|  | 778 | The following example illustrates both approaches. | 
|  | 779 |  | 
|  | 780 | .. literalinclude:: ../includes/sqlite3/converter_point.py | 
|  | 781 |  | 
|  | 782 |  | 
|  | 783 | Default adapters and converters | 
|  | 784 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 785 |  | 
|  | 786 | There are default adapters for the date and datetime types in the datetime | 
|  | 787 | module. They will be sent as ISO dates/ISO timestamps to SQLite. | 
|  | 788 |  | 
|  | 789 | The default converters are registered under the name "date" for | 
|  | 790 | :class:`datetime.date` and under the name "timestamp" for | 
|  | 791 | :class:`datetime.datetime`. | 
|  | 792 |  | 
|  | 793 | This way, you can use date/timestamps from Python without any additional | 
|  | 794 | fiddling in most cases. The format of the adapters is also compatible with the | 
|  | 795 | experimental SQLite date/time functions. | 
|  | 796 |  | 
|  | 797 | The following example demonstrates this. | 
|  | 798 |  | 
|  | 799 | .. literalinclude:: ../includes/sqlite3/pysqlite_datetime.py | 
|  | 800 |  | 
|  | 801 |  | 
|  | 802 | .. _sqlite3-controlling-transactions: | 
|  | 803 |  | 
|  | 804 | Controlling Transactions | 
|  | 805 | ------------------------ | 
|  | 806 |  | 
|  | 807 | By default, the :mod:`sqlite3` module opens transactions implicitly before a | 
| Georg Brandl | 48310cd | 2009-01-03 21:18:54 +0000 | [diff] [blame] | 808 | Data Modification Language (DML)  statement (i.e. | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 809 | ``INSERT``/``UPDATE``/``DELETE``/``REPLACE``), and commits transactions | 
|  | 810 | implicitly before a non-DML, non-query statement (i. e. | 
|  | 811 | anything other than ``SELECT`` or the aforementioned). | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 812 |  | 
|  | 813 | So if you are within a transaction and issue a command like ``CREATE TABLE | 
|  | 814 | ...``, ``VACUUM``, ``PRAGMA``, the :mod:`sqlite3` module will commit implicitly | 
|  | 815 | before executing that command. There are two reasons for doing that. The first | 
|  | 816 | is that some of these commands don't work within transactions. The other reason | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 817 | is that sqlite3 needs to keep track of the transaction state (if a transaction | 
| R. David Murray | d35251d | 2010-06-01 01:32:12 +0000 | [diff] [blame] | 818 | is active or not).  The current transaction state is exposed through the | 
|  | 819 | :attr:`Connection.in_transaction` attribute of the connection object. | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 820 |  | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 821 | You can control which kind of ``BEGIN`` statements sqlite3 implicitly executes | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 822 | (or none at all) via the *isolation_level* parameter to the :func:`connect` | 
|  | 823 | call, or via the :attr:`isolation_level` property of connections. | 
|  | 824 |  | 
|  | 825 | If you want **autocommit mode**, then set :attr:`isolation_level` to None. | 
|  | 826 |  | 
|  | 827 | Otherwise leave it at its default, which will result in a plain "BEGIN" | 
| Georg Brandl | a971c65 | 2008-11-07 09:39:56 +0000 | [diff] [blame] | 828 | statement, or set it to one of SQLite's supported isolation levels: "DEFERRED", | 
|  | 829 | "IMMEDIATE" or "EXCLUSIVE". | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 830 |  | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 831 |  | 
|  | 832 |  | 
| Georg Brandl | 8a1e4c4 | 2009-05-25 21:13:36 +0000 | [diff] [blame] | 833 | Using :mod:`sqlite3` efficiently | 
|  | 834 | -------------------------------- | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 835 |  | 
|  | 836 |  | 
|  | 837 | Using shortcut methods | 
|  | 838 | ^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 839 |  | 
|  | 840 | Using the nonstandard :meth:`execute`, :meth:`executemany` and | 
|  | 841 | :meth:`executescript` methods of the :class:`Connection` object, your code can | 
|  | 842 | be written more concisely because you don't have to create the (often | 
|  | 843 | superfluous) :class:`Cursor` objects explicitly. Instead, the :class:`Cursor` | 
|  | 844 | objects are created implicitly and these shortcut methods return the cursor | 
| Benjamin Peterson | f10a79a | 2008-10-11 00:49:57 +0000 | [diff] [blame] | 845 | objects. This way, you can execute a ``SELECT`` statement and iterate over it | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 846 | directly using only a single call on the :class:`Connection` object. | 
|  | 847 |  | 
|  | 848 | .. literalinclude:: ../includes/sqlite3/shortcut_methods.py | 
|  | 849 |  | 
|  | 850 |  | 
|  | 851 | Accessing columns by name instead of by index | 
|  | 852 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 853 |  | 
| Georg Brandl | 22b3431 | 2009-07-26 14:54:51 +0000 | [diff] [blame] | 854 | One useful feature of the :mod:`sqlite3` module is the built-in | 
| Georg Brandl | 116aa62 | 2007-08-15 14:28:22 +0000 | [diff] [blame] | 855 | :class:`sqlite3.Row` class designed to be used as a row factory. | 
|  | 856 |  | 
|  | 857 | Rows wrapped with this class can be accessed both by index (like tuples) and | 
|  | 858 | case-insensitively by name: | 
|  | 859 |  | 
|  | 860 | .. literalinclude:: ../includes/sqlite3/rowclass.py | 
|  | 861 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 862 |  | 
|  | 863 | Using the connection as a context manager | 
|  | 864 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | 
|  | 865 |  | 
| Gerhard Häring | 0d7d6cf | 2008-03-29 01:32:44 +0000 | [diff] [blame] | 866 | Connection objects can be used as context managers | 
|  | 867 | that automatically commit or rollback transactions.  In the event of an | 
|  | 868 | exception, the transaction is rolled back; otherwise, the transaction is | 
|  | 869 | committed: | 
|  | 870 |  | 
|  | 871 | .. literalinclude:: ../includes/sqlite3/ctx_manager.py | 
| Gerhard Häring | c34d76c | 2010-08-06 06:12:05 +0000 | [diff] [blame] | 872 |  | 
|  | 873 |  | 
|  | 874 | Common issues | 
|  | 875 | ------------- | 
|  | 876 |  | 
|  | 877 | Multithreading | 
|  | 878 | ^^^^^^^^^^^^^^ | 
|  | 879 |  | 
|  | 880 | Older SQLite versions had issues with sharing connections between threads. | 
|  | 881 | That's why the Python module disallows sharing connections and cursors between | 
|  | 882 | threads. If you still try to do so, you will get an exception at runtime. | 
|  | 883 |  | 
|  | 884 | The only exception is calling the :meth:`~Connection.interrupt` method, which | 
|  | 885 | only makes sense to call from a different thread. | 
|  | 886 |  | 
| Gerhard Häring | e0941c5 | 2010-10-03 21:47:06 +0000 | [diff] [blame^] | 887 | .. rubric:: Footnotes | 
|  | 888 |  | 
|  | 889 | .. [#f1] The sqlite3 module is not built with loadable extension support by | 
|  | 890 | default, because some platforms (notably Mac OS X) have SQLite libraries which | 
|  | 891 | are compiled without this feature. To get loadable extension support, you must | 
|  | 892 | modify setup.py and and remove the line that sets SQLITE_OMIT_LOAD_EXTENSION. | 
|  | 893 |  |