blob: d7eaea638f82cbeace48dbaafbdfa642a068f463 [file] [log] [blame]
Georg Brandl116aa622007-08-15 14:28:22 +00001:mod:`sqlite3` --- DB-API 2.0 interface for SQLite databases
2============================================================
3
4.. module:: sqlite3
5 :synopsis: A DB-API 2.0 implementation using SQLite 3.x.
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04006
Petri Lehtinen4d2bfb52012-03-01 21:18:34 +02007.. sectionauthor:: Gerhard Häring <gh@ghaering.de>
Georg Brandl116aa622007-08-15 14:28:22 +00008
Terry Jan Reedyfa089b92016-06-11 15:02:54 -04009**Source code:** :source:`Lib/sqlite3/`
10
11--------------
Georg Brandl116aa622007-08-15 14:28:22 +000012
Georg Brandl116aa622007-08-15 14:28:22 +000013SQLite is a C library that provides a lightweight disk-based database that
14doesn't require a separate server process and allows accessing the database
15using a nonstandard variant of the SQL query language. Some applications can use
16SQLite for internal data storage. It's also possible to prototype an
17application using SQLite and then port the code to a larger database such as
18PostgreSQL or Oracle.
19
Zachary Ware9d085622014-04-01 12:21:56 -050020The sqlite3 module was written by Gerhard Häring. It provides a SQL interface
21compliant with the DB-API 2.0 specification described by :pep:`249`.
Georg Brandl116aa622007-08-15 14:28:22 +000022
23To use the module, you must first create a :class:`Connection` object that
24represents the database. Here the data will be stored in the
Petri Lehtinen9f74c6c2013-02-23 19:26:56 +010025:file:`example.db` file::
Georg Brandl116aa622007-08-15 14:28:22 +000026
Petri Lehtinen4d2bfb52012-03-01 21:18:34 +020027 import sqlite3
Petri Lehtinen9f74c6c2013-02-23 19:26:56 +010028 conn = sqlite3.connect('example.db')
Georg Brandl116aa622007-08-15 14:28:22 +000029
30You can also supply the special name ``:memory:`` to create a database in RAM.
31
32Once you have a :class:`Connection`, you can create a :class:`Cursor` object
Benjamin Petersonf10a79a2008-10-11 00:49:57 +000033and call its :meth:`~Cursor.execute` method to perform SQL commands::
Georg Brandl116aa622007-08-15 14:28:22 +000034
35 c = conn.cursor()
36
37 # Create table
Zachary Ware9d085622014-04-01 12:21:56 -050038 c.execute('''CREATE TABLE stocks
39 (date text, trans text, symbol text, qty real, price real)''')
Georg Brandl116aa622007-08-15 14:28:22 +000040
41 # Insert a row of data
Zachary Ware9d085622014-04-01 12:21:56 -050042 c.execute("INSERT INTO stocks VALUES ('2006-01-05','BUY','RHAT',100,35.14)")
Georg Brandl116aa622007-08-15 14:28:22 +000043
44 # Save (commit) the changes
45 conn.commit()
46
Zachary Ware9d085622014-04-01 12:21:56 -050047 # We can also close the connection if we are done with it.
48 # Just be sure any changes have been committed or they will be lost.
49 conn.close()
50
51The data you've saved is persistent and is available in subsequent sessions::
52
53 import sqlite3
54 conn = sqlite3.connect('example.db')
55 c = conn.cursor()
Georg Brandl116aa622007-08-15 14:28:22 +000056
57Usually your SQL operations will need to use values from Python variables. You
58shouldn't assemble your query using Python's string operations because doing so
Zachary Ware9d085622014-04-01 12:21:56 -050059is insecure; it makes your program vulnerable to an SQL injection attack
Serhiy Storchaka6dff0202016-05-07 10:49:07 +030060(see https://xkcd.com/327/ for humorous example of what can go wrong).
Georg Brandl116aa622007-08-15 14:28:22 +000061
62Instead, use the DB-API's parameter substitution. Put ``?`` as a placeholder
63wherever you want to use a value, and then provide a tuple of values as the
Georg Brandl8a1e4c42009-05-25 21:13:36 +000064second argument to the cursor's :meth:`~Cursor.execute` method. (Other database
65modules may use a different placeholder, such as ``%s`` or ``:1``.) For
66example::
Georg Brandl116aa622007-08-15 14:28:22 +000067
68 # Never do this -- insecure!
Zachary Ware9d085622014-04-01 12:21:56 -050069 symbol = 'RHAT'
70 c.execute("SELECT * FROM stocks WHERE symbol = '%s'" % symbol)
Georg Brandl116aa622007-08-15 14:28:22 +000071
72 # Do this instead
Zachary Ware9d085622014-04-01 12:21:56 -050073 t = ('RHAT',)
74 c.execute('SELECT * FROM stocks WHERE symbol=?', t)
75 print(c.fetchone())
Georg Brandl116aa622007-08-15 14:28:22 +000076
Zachary Ware9d085622014-04-01 12:21:56 -050077 # Larger example that inserts many records at a time
78 purchases = [('2006-03-28', 'BUY', 'IBM', 1000, 45.00),
79 ('2006-04-05', 'BUY', 'MSFT', 1000, 72.00),
80 ('2006-04-06', 'SELL', 'IBM', 500, 53.00),
81 ]
82 c.executemany('INSERT INTO stocks VALUES (?,?,?,?,?)', purchases)
Georg Brandl116aa622007-08-15 14:28:22 +000083
Georg Brandl9afde1c2007-11-01 20:32:30 +000084To retrieve data after executing a SELECT statement, you can either treat the
Benjamin Petersonf10a79a2008-10-11 00:49:57 +000085cursor as an :term:`iterator`, call the cursor's :meth:`~Cursor.fetchone` method to
86retrieve a single matching row, or call :meth:`~Cursor.fetchall` to get a list of the
Georg Brandl9afde1c2007-11-01 20:32:30 +000087matching rows.
Georg Brandl116aa622007-08-15 14:28:22 +000088
89This example uses the iterator form::
90
Zachary Ware9d085622014-04-01 12:21:56 -050091 >>> for row in c.execute('SELECT * FROM stocks ORDER BY price'):
92 print(row)
93
Ezio Melottib5845052009-09-13 05:49:25 +000094 ('2006-01-05', 'BUY', 'RHAT', 100, 35.14)
95 ('2006-03-28', 'BUY', 'IBM', 1000, 45.0)
96 ('2006-04-06', 'SELL', 'IBM', 500, 53.0)
Zachary Ware9d085622014-04-01 12:21:56 -050097 ('2006-04-05', 'BUY', 'MSFT', 1000, 72.0)
Georg Brandl116aa622007-08-15 14:28:22 +000098
99
100.. seealso::
101
Benjamin Peterson216e47d2014-01-16 09:52:38 -0500102 https://github.com/ghaering/pysqlite
Georg Brandl8a1e4c42009-05-25 21:13:36 +0000103 The pysqlite web page -- sqlite3 is developed externally under the name
104 "pysqlite".
Georg Brandl116aa622007-08-15 14:28:22 +0000105
Serhiy Storchaka6dff0202016-05-07 10:49:07 +0300106 https://www.sqlite.org
Georg Brandl8a1e4c42009-05-25 21:13:36 +0000107 The SQLite web page; the documentation describes the syntax and the
108 available data types for the supported SQL dialect.
Georg Brandl116aa622007-08-15 14:28:22 +0000109
Sanyam Khurana1b4587a2017-12-06 22:09:33 +0530110 https://www.w3schools.com/sql/
Zachary Ware9d085622014-04-01 12:21:56 -0500111 Tutorial, reference and examples for learning SQL syntax.
112
Georg Brandl116aa622007-08-15 14:28:22 +0000113 :pep:`249` - Database API Specification 2.0
114 PEP written by Marc-André Lemburg.
115
116
117.. _sqlite3-module-contents:
118
119Module functions and constants
120------------------------------
121
122
R David Murray3f7beb92013-01-10 20:18:21 -0500123.. data:: version
124
125 The version number of this module, as a string. This is not the version of
126 the SQLite library.
127
128
129.. data:: version_info
130
131 The version number of this module, as a tuple of integers. This is not the
132 version of the SQLite library.
133
134
135.. data:: sqlite_version
136
137 The version number of the run-time SQLite library, as a string.
138
139
140.. data:: sqlite_version_info
141
142 The version number of the run-time SQLite library, as a tuple of integers.
143
144
Georg Brandl116aa622007-08-15 14:28:22 +0000145.. data:: PARSE_DECLTYPES
146
147 This constant is meant to be used with the *detect_types* parameter of the
148 :func:`connect` function.
149
150 Setting it makes the :mod:`sqlite3` module parse the declared type for each
Christian Heimes81ee3ef2008-05-04 22:42:01 +0000151 column it returns. It will parse out the first word of the declared type,
152 i. e. for "integer primary key", it will parse out "integer", or for
153 "number(10)" it will parse out "number". Then for that column, it will look
154 into the converters dictionary and use the converter function registered for
155 that type there.
Georg Brandl116aa622007-08-15 14:28:22 +0000156
157
158.. data:: PARSE_COLNAMES
159
160 This constant is meant to be used with the *detect_types* parameter of the
161 :func:`connect` function.
162
163 Setting this makes the SQLite interface parse the column name for each column it
164 returns. It will look for a string formed [mytype] in there, and then decide
165 that 'mytype' is the type of the column. It will try to find an entry of
166 'mytype' in the converters dictionary and then use the converter function found
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000167 there to return the value. The column name found in :attr:`Cursor.description`
Georg Brandl116aa622007-08-15 14:28:22 +0000168 is only the first word of the column name, i. e. if you use something like
169 ``'as "x [datetime]"'`` in your SQL, then we will parse out everything until the
170 first blank for the column name: the column name would simply be "x".
171
172
Antoine Pitrou902fc8b2013-02-10 00:02:44 +0100173.. function:: connect(database[, timeout, detect_types, isolation_level, check_same_thread, factory, cached_statements, uri])
Georg Brandl116aa622007-08-15 14:28:22 +0000174
Anders Lorentsena22a1272017-11-07 01:47:43 +0100175 Opens a connection to the SQLite database file *database*. By default returns a
176 :class:`Connection` object, unless a custom *factory* is given.
177
178 *database* is a :term:`path-like object` giving the pathname (absolute or
179 relative to the current working directory) of the database file to be opened.
180 You can use ``":memory:"`` to open a database connection to a database that
181 resides in RAM instead of on disk.
Georg Brandl116aa622007-08-15 14:28:22 +0000182
183 When a database is accessed by multiple connections, and one of the processes
184 modifies the database, the SQLite database is locked until that transaction is
185 committed. The *timeout* parameter specifies how long the connection should wait
186 for the lock to go away until raising an exception. The default for the timeout
187 parameter is 5.0 (five seconds).
188
189 For the *isolation_level* parameter, please see the
Berker Peksaga1bc2462016-09-07 04:02:41 +0300190 :attr:`~Connection.isolation_level` property of :class:`Connection` objects.
Georg Brandl116aa622007-08-15 14:28:22 +0000191
Georg Brandl3c127112013-10-06 12:38:44 +0200192 SQLite natively supports only the types TEXT, INTEGER, REAL, BLOB and NULL. If
Georg Brandl116aa622007-08-15 14:28:22 +0000193 you want to use other types you must add support for them yourself. The
194 *detect_types* parameter and the using custom **converters** registered with the
195 module-level :func:`register_converter` function allow you to easily do that.
196
197 *detect_types* defaults to 0 (i. e. off, no type detection), you can set it to
198 any combination of :const:`PARSE_DECLTYPES` and :const:`PARSE_COLNAMES` to turn
199 type detection on.
200
Senthil Kumaran7ee91942016-06-03 00:03:48 -0700201 By default, *check_same_thread* is :const:`True` and only the creating thread may
202 use the connection. If set :const:`False`, the returned connection may be shared
203 across multiple threads. When using multiple threads with the same connection
204 writing operations should be serialized by the user to avoid data corruption.
205
Georg Brandl116aa622007-08-15 14:28:22 +0000206 By default, the :mod:`sqlite3` module uses its :class:`Connection` class for the
207 connect call. You can, however, subclass the :class:`Connection` class and make
208 :func:`connect` use your class instead by providing your class for the *factory*
209 parameter.
210
211 Consult the section :ref:`sqlite3-types` of this manual for details.
212
213 The :mod:`sqlite3` module internally uses a statement cache to avoid SQL parsing
214 overhead. If you want to explicitly set the number of statements that are cached
215 for the connection, you can set the *cached_statements* parameter. The currently
216 implemented default is to cache 100 statements.
217
Antoine Pitrou902fc8b2013-02-10 00:02:44 +0100218 If *uri* is true, *database* is interpreted as a URI. This allows you
219 to specify options. For example, to open a database in read-only mode
220 you can use::
221
222 db = sqlite3.connect('file:path/to/database?mode=ro', uri=True)
223
224 More information about this feature, including a list of recognized options, can
Serhiy Storchaka6dff0202016-05-07 10:49:07 +0300225 be found in the `SQLite URI documentation <https://www.sqlite.org/uri.html>`_.
Antoine Pitrou902fc8b2013-02-10 00:02:44 +0100226
227 .. versionchanged:: 3.4
228 Added the *uri* parameter.
229
Anders Lorentsena22a1272017-11-07 01:47:43 +0100230 .. versionchanged:: 3.7
231 *database* can now also be a :term:`path-like object`, not only a string.
232
Georg Brandl116aa622007-08-15 14:28:22 +0000233
234.. function:: register_converter(typename, callable)
235
236 Registers a callable to convert a bytestring from the database into a custom
237 Python type. The callable will be invoked for all database values that are of
238 the type *typename*. Confer the parameter *detect_types* of the :func:`connect`
239 function for how the type detection works. Note that the case of *typename* and
240 the name of the type in your query must match!
241
242
243.. function:: register_adapter(type, callable)
244
245 Registers a callable to convert the custom Python type *type* into one of
246 SQLite's supported types. The callable *callable* accepts as single parameter
Georg Brandl5c106642007-11-29 17:41:05 +0000247 the Python value, and must return a value of the following types: int,
Antoine Pitrouf06917e2010-02-02 23:00:29 +0000248 float, str or bytes.
Georg Brandl116aa622007-08-15 14:28:22 +0000249
250
251.. function:: complete_statement(sql)
252
253 Returns :const:`True` if the string *sql* contains one or more complete SQL
254 statements terminated by semicolons. It does not verify that the SQL is
255 syntactically correct, only that there are no unclosed string literals and the
256 statement is terminated by a semicolon.
257
258 This can be used to build a shell for SQLite, as in the following example:
259
260
261 .. literalinclude:: ../includes/sqlite3/complete_statement.py
262
263
264.. function:: enable_callback_tracebacks(flag)
265
266 By default you will not get any tracebacks in user-defined functions,
Serhiy Storchakafbc1c262013-11-29 12:17:13 +0200267 aggregates, converters, authorizer callbacks etc. If you want to debug them,
268 you can call this function with *flag* set to ``True``. Afterwards, you will
269 get tracebacks from callbacks on ``sys.stderr``. Use :const:`False` to
270 disable the feature again.
Georg Brandl116aa622007-08-15 14:28:22 +0000271
272
273.. _sqlite3-connection-objects:
274
275Connection Objects
276------------------
277
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000278.. class:: Connection
279
280 A SQLite database connection has the following attributes and methods:
Georg Brandl116aa622007-08-15 14:28:22 +0000281
R David Murray6db23352012-09-30 20:44:43 -0400282 .. attribute:: isolation_level
Georg Brandl116aa622007-08-15 14:28:22 +0000283
R David Murray6db23352012-09-30 20:44:43 -0400284 Get or set the current isolation level. :const:`None` for autocommit mode or
285 one of "DEFERRED", "IMMEDIATE" or "EXCLUSIVE". See section
286 :ref:`sqlite3-controlling-transactions` for a more detailed explanation.
Georg Brandl116aa622007-08-15 14:28:22 +0000287
R David Murray6db23352012-09-30 20:44:43 -0400288 .. attribute:: in_transaction
R. David Murrayd35251d2010-06-01 01:32:12 +0000289
R David Murray6db23352012-09-30 20:44:43 -0400290 :const:`True` if a transaction is active (there are uncommitted changes),
291 :const:`False` otherwise. Read-only attribute.
R. David Murrayd35251d2010-06-01 01:32:12 +0000292
R David Murray6db23352012-09-30 20:44:43 -0400293 .. versionadded:: 3.2
Georg Brandl116aa622007-08-15 14:28:22 +0000294
Serhiy Storchakaef113cd2016-08-29 14:29:55 +0300295 .. method:: cursor(factory=Cursor)
Georg Brandl116aa622007-08-15 14:28:22 +0000296
Serhiy Storchakaef113cd2016-08-29 14:29:55 +0300297 The cursor method accepts a single optional parameter *factory*. If
298 supplied, this must be a callable returning an instance of :class:`Cursor`
299 or its subclasses.
Georg Brandl116aa622007-08-15 14:28:22 +0000300
R David Murray6db23352012-09-30 20:44:43 -0400301 .. method:: commit()
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000302
R David Murray6db23352012-09-30 20:44:43 -0400303 This method commits the current transaction. If you don't call this method,
304 anything you did since the last call to ``commit()`` is not visible from
305 other database connections. If you wonder why you don't see the data you've
306 written to the database, please check you didn't forget to call this method.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000307
R David Murray6db23352012-09-30 20:44:43 -0400308 .. method:: rollback()
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000309
R David Murray6db23352012-09-30 20:44:43 -0400310 This method rolls back any changes to the database since the last call to
311 :meth:`commit`.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000312
R David Murray6db23352012-09-30 20:44:43 -0400313 .. method:: close()
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000314
R David Murray6db23352012-09-30 20:44:43 -0400315 This closes the database connection. Note that this does not automatically
316 call :meth:`commit`. If you just close your database connection without
317 calling :meth:`commit` first, your changes will be lost!
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000318
Berker Peksagc4154402016-06-12 13:41:47 +0300319 .. method:: execute(sql[, parameters])
Georg Brandl116aa622007-08-15 14:28:22 +0000320
Berker Peksagc4154402016-06-12 13:41:47 +0300321 This is a nonstandard shortcut that creates a cursor object by calling
322 the :meth:`~Connection.cursor` method, calls the cursor's
323 :meth:`~Cursor.execute` method with the *parameters* given, and returns
324 the cursor.
Georg Brandl116aa622007-08-15 14:28:22 +0000325
Berker Peksagc4154402016-06-12 13:41:47 +0300326 .. method:: executemany(sql[, parameters])
Georg Brandl116aa622007-08-15 14:28:22 +0000327
Berker Peksagc4154402016-06-12 13:41:47 +0300328 This is a nonstandard shortcut that creates a cursor object by
329 calling the :meth:`~Connection.cursor` method, calls the cursor's
330 :meth:`~Cursor.executemany` method with the *parameters* given, and
331 returns the cursor.
Georg Brandl116aa622007-08-15 14:28:22 +0000332
R David Murray6db23352012-09-30 20:44:43 -0400333 .. method:: executescript(sql_script)
Georg Brandl116aa622007-08-15 14:28:22 +0000334
Berker Peksagc4154402016-06-12 13:41:47 +0300335 This is a nonstandard shortcut that creates a cursor object by
336 calling the :meth:`~Connection.cursor` method, calls the cursor's
337 :meth:`~Cursor.executescript` method with the given *sql_script*, and
338 returns the cursor.
Georg Brandl116aa622007-08-15 14:28:22 +0000339
R David Murray6db23352012-09-30 20:44:43 -0400340 .. method:: create_function(name, num_params, func)
Georg Brandl116aa622007-08-15 14:28:22 +0000341
R David Murray6db23352012-09-30 20:44:43 -0400342 Creates a user-defined function that you can later use from within SQL
343 statements under the function name *name*. *num_params* is the number of
Berker Peksagfa0f62d2016-03-27 22:39:14 +0300344 parameters the function accepts (if *num_params* is -1, the function may
345 take any number of arguments), and *func* is a Python callable that is
346 called as the SQL function.
Georg Brandl116aa622007-08-15 14:28:22 +0000347
R David Murray6db23352012-09-30 20:44:43 -0400348 The function can return any of the types supported by SQLite: bytes, str, int,
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300349 float and ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +0000350
R David Murray6db23352012-09-30 20:44:43 -0400351 Example:
Georg Brandl116aa622007-08-15 14:28:22 +0000352
R David Murray6db23352012-09-30 20:44:43 -0400353 .. literalinclude:: ../includes/sqlite3/md5func.py
Georg Brandl116aa622007-08-15 14:28:22 +0000354
355
R David Murray6db23352012-09-30 20:44:43 -0400356 .. method:: create_aggregate(name, num_params, aggregate_class)
Georg Brandl116aa622007-08-15 14:28:22 +0000357
R David Murray6db23352012-09-30 20:44:43 -0400358 Creates a user-defined aggregate function.
Georg Brandl116aa622007-08-15 14:28:22 +0000359
R David Murray6db23352012-09-30 20:44:43 -0400360 The aggregate class must implement a ``step`` method, which accepts the number
Berker Peksagfa0f62d2016-03-27 22:39:14 +0300361 of parameters *num_params* (if *num_params* is -1, the function may take
362 any number of arguments), and a ``finalize`` method which will return the
R David Murray6db23352012-09-30 20:44:43 -0400363 final result of the aggregate.
Georg Brandl116aa622007-08-15 14:28:22 +0000364
R David Murray6db23352012-09-30 20:44:43 -0400365 The ``finalize`` method can return any of the types supported by SQLite:
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300366 bytes, str, int, float and ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +0000367
R David Murray6db23352012-09-30 20:44:43 -0400368 Example:
Georg Brandl116aa622007-08-15 14:28:22 +0000369
R David Murray6db23352012-09-30 20:44:43 -0400370 .. literalinclude:: ../includes/sqlite3/mysumaggr.py
Georg Brandl116aa622007-08-15 14:28:22 +0000371
372
R David Murray6db23352012-09-30 20:44:43 -0400373 .. method:: create_collation(name, callable)
Georg Brandl116aa622007-08-15 14:28:22 +0000374
R David Murray6db23352012-09-30 20:44:43 -0400375 Creates a collation with the specified *name* and *callable*. The callable will
376 be passed two string arguments. It should return -1 if the first is ordered
377 lower than the second, 0 if they are ordered equal and 1 if the first is ordered
378 higher than the second. Note that this controls sorting (ORDER BY in SQL) so
379 your comparisons don't affect other SQL operations.
Georg Brandl116aa622007-08-15 14:28:22 +0000380
R David Murray6db23352012-09-30 20:44:43 -0400381 Note that the callable will get its parameters as Python bytestrings, which will
382 normally be encoded in UTF-8.
Georg Brandl116aa622007-08-15 14:28:22 +0000383
R David Murray6db23352012-09-30 20:44:43 -0400384 The following example shows a custom collation that sorts "the wrong way":
Georg Brandl116aa622007-08-15 14:28:22 +0000385
R David Murray6db23352012-09-30 20:44:43 -0400386 .. literalinclude:: ../includes/sqlite3/collation_reverse.py
Georg Brandl116aa622007-08-15 14:28:22 +0000387
Serhiy Storchakaecf41da2016-10-19 16:29:26 +0300388 To remove a collation, call ``create_collation`` with ``None`` as callable::
Georg Brandl116aa622007-08-15 14:28:22 +0000389
R David Murray6db23352012-09-30 20:44:43 -0400390 con.create_collation("reverse", None)
Georg Brandl116aa622007-08-15 14:28:22 +0000391
392
R David Murray6db23352012-09-30 20:44:43 -0400393 .. method:: interrupt()
Georg Brandl116aa622007-08-15 14:28:22 +0000394
R David Murray6db23352012-09-30 20:44:43 -0400395 You can call this method from a different thread to abort any queries that might
396 be executing on the connection. The query will then abort and the caller will
397 get an exception.
Georg Brandl116aa622007-08-15 14:28:22 +0000398
399
R David Murray6db23352012-09-30 20:44:43 -0400400 .. method:: set_authorizer(authorizer_callback)
Georg Brandl116aa622007-08-15 14:28:22 +0000401
R David Murray6db23352012-09-30 20:44:43 -0400402 This routine registers a callback. The callback is invoked for each attempt to
403 access a column of a table in the database. The callback should return
404 :const:`SQLITE_OK` if access is allowed, :const:`SQLITE_DENY` if the entire SQL
405 statement should be aborted with an error and :const:`SQLITE_IGNORE` if the
406 column should be treated as a NULL value. These constants are available in the
407 :mod:`sqlite3` module.
Georg Brandl116aa622007-08-15 14:28:22 +0000408
R David Murray6db23352012-09-30 20:44:43 -0400409 The first argument to the callback signifies what kind of operation is to be
410 authorized. The second and third argument will be arguments or :const:`None`
411 depending on the first argument. The 4th argument is the name of the database
412 ("main", "temp", etc.) if applicable. The 5th argument is the name of the
413 inner-most trigger or view that is responsible for the access attempt or
414 :const:`None` if this access attempt is directly from input SQL code.
Georg Brandl116aa622007-08-15 14:28:22 +0000415
R David Murray6db23352012-09-30 20:44:43 -0400416 Please consult the SQLite documentation about the possible values for the first
417 argument and the meaning of the second and third argument depending on the first
418 one. All necessary constants are available in the :mod:`sqlite3` module.
Georg Brandl116aa622007-08-15 14:28:22 +0000419
Georg Brandl116aa622007-08-15 14:28:22 +0000420
R David Murray6db23352012-09-30 20:44:43 -0400421 .. method:: set_progress_handler(handler, n)
Georg Brandl116aa622007-08-15 14:28:22 +0000422
R David Murray6db23352012-09-30 20:44:43 -0400423 This routine registers a callback. The callback is invoked for every *n*
424 instructions of the SQLite virtual machine. This is useful if you want to
425 get called from SQLite during long-running operations, for example to update
426 a GUI.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000427
R David Murray6db23352012-09-30 20:44:43 -0400428 If you want to clear any previously installed progress handler, call the
429 method with :const:`None` for *handler*.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000430
Simon Willisonac03c032017-11-02 07:34:12 -0700431 Returning a non-zero value from the handler function will terminate the
432 currently executing query and cause it to raise an :exc:`OperationalError`
433 exception.
434
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000435
R David Murray842ca5f2012-09-30 20:49:19 -0400436 .. method:: set_trace_callback(trace_callback)
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000437
R David Murray842ca5f2012-09-30 20:49:19 -0400438 Registers *trace_callback* to be called for each SQL statement that is
439 actually executed by the SQLite backend.
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200440
R David Murray842ca5f2012-09-30 20:49:19 -0400441 The only argument passed to the callback is the statement (as string) that
442 is being executed. The return value of the callback is ignored. Note that
443 the backend does not only run statements passed to the :meth:`Cursor.execute`
444 methods. Other sources include the transaction management of the Python
445 module and the execution of triggers defined in the current database.
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200446
R David Murray842ca5f2012-09-30 20:49:19 -0400447 Passing :const:`None` as *trace_callback* will disable the trace callback.
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200448
R David Murray842ca5f2012-09-30 20:49:19 -0400449 .. versionadded:: 3.3
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200450
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200451
R David Murray6db23352012-09-30 20:44:43 -0400452 .. method:: enable_load_extension(enabled)
Antoine Pitrou5bfa0622011-04-04 00:12:04 +0200453
R David Murray6db23352012-09-30 20:44:43 -0400454 This routine allows/disallows the SQLite engine to load SQLite extensions
455 from shared libraries. SQLite extensions can define new functions,
456 aggregates or whole new virtual table implementations. One well-known
457 extension is the fulltext-search extension distributed with SQLite.
Gerhard Häringf9cee222010-03-05 15:20:03 +0000458
R David Murray6db23352012-09-30 20:44:43 -0400459 Loadable extensions are disabled by default. See [#f1]_.
Gerhard Häringf9cee222010-03-05 15:20:03 +0000460
R David Murray6db23352012-09-30 20:44:43 -0400461 .. versionadded:: 3.2
Petri Lehtinen4d2bfb52012-03-01 21:18:34 +0200462
R David Murray6db23352012-09-30 20:44:43 -0400463 .. literalinclude:: ../includes/sqlite3/load_extension.py
Georg Brandl67b21b72010-08-17 15:07:14 +0000464
R David Murray6db23352012-09-30 20:44:43 -0400465 .. method:: load_extension(path)
Gerhard Häringf9cee222010-03-05 15:20:03 +0000466
R David Murray6db23352012-09-30 20:44:43 -0400467 This routine loads a SQLite extension from a shared library. You have to
468 enable extension loading with :meth:`enable_load_extension` before you can
469 use this routine.
Gerhard Häringf9cee222010-03-05 15:20:03 +0000470
R David Murray6db23352012-09-30 20:44:43 -0400471 Loadable extensions are disabled by default. See [#f1]_.
Gerhard Häringf9cee222010-03-05 15:20:03 +0000472
R David Murray6db23352012-09-30 20:44:43 -0400473 .. versionadded:: 3.2
Gerhard Häringe0941c52010-10-03 21:47:06 +0000474
R David Murray6db23352012-09-30 20:44:43 -0400475 .. attribute:: row_factory
Petri Lehtinen4d2bfb52012-03-01 21:18:34 +0200476
R David Murray6db23352012-09-30 20:44:43 -0400477 You can change this attribute to a callable that accepts the cursor and the
478 original row as a tuple and will return the real result row. This way, you can
479 implement more advanced ways of returning results, such as returning an object
480 that can also access columns by name.
Georg Brandl116aa622007-08-15 14:28:22 +0000481
R David Murray6db23352012-09-30 20:44:43 -0400482 Example:
Georg Brandl116aa622007-08-15 14:28:22 +0000483
R David Murray6db23352012-09-30 20:44:43 -0400484 .. literalinclude:: ../includes/sqlite3/row_factory.py
Georg Brandl116aa622007-08-15 14:28:22 +0000485
R David Murray6db23352012-09-30 20:44:43 -0400486 If returning a tuple doesn't suffice and you want name-based access to
487 columns, you should consider setting :attr:`row_factory` to the
488 highly-optimized :class:`sqlite3.Row` type. :class:`Row` provides both
489 index-based and case-insensitive name-based access to columns with almost no
490 memory overhead. It will probably be better than your own custom
491 dictionary-based approach or even a db_row based solution.
Georg Brandl116aa622007-08-15 14:28:22 +0000492
R David Murray6db23352012-09-30 20:44:43 -0400493 .. XXX what's a db_row-based solution?
Georg Brandl116aa622007-08-15 14:28:22 +0000494
Georg Brandl116aa622007-08-15 14:28:22 +0000495
R David Murray6db23352012-09-30 20:44:43 -0400496 .. attribute:: text_factory
Georg Brandl116aa622007-08-15 14:28:22 +0000497
R David Murray6db23352012-09-30 20:44:43 -0400498 Using this attribute you can control what objects are returned for the ``TEXT``
499 data type. By default, this attribute is set to :class:`str` and the
500 :mod:`sqlite3` module will return Unicode objects for ``TEXT``. If you want to
501 return bytestrings instead, you can set it to :class:`bytes`.
Georg Brandl116aa622007-08-15 14:28:22 +0000502
R David Murray6db23352012-09-30 20:44:43 -0400503 You can also set it to any other callable that accepts a single bytestring
504 parameter and returns the resulting object.
Georg Brandl116aa622007-08-15 14:28:22 +0000505
R David Murray6db23352012-09-30 20:44:43 -0400506 See the following example code for illustration:
Georg Brandl116aa622007-08-15 14:28:22 +0000507
R David Murray6db23352012-09-30 20:44:43 -0400508 .. literalinclude:: ../includes/sqlite3/text_factory.py
Georg Brandl116aa622007-08-15 14:28:22 +0000509
510
R David Murray6db23352012-09-30 20:44:43 -0400511 .. attribute:: total_changes
Georg Brandl116aa622007-08-15 14:28:22 +0000512
R David Murray6db23352012-09-30 20:44:43 -0400513 Returns the total number of database rows that have been modified, inserted, or
514 deleted since the database connection was opened.
Georg Brandl116aa622007-08-15 14:28:22 +0000515
516
Berker Peksag557a0632016-03-27 18:46:18 +0300517 .. method:: iterdump
Christian Heimesbbe741d2008-03-28 10:53:29 +0000518
R David Murray6db23352012-09-30 20:44:43 -0400519 Returns an iterator to dump the database in an SQL text format. Useful when
520 saving an in-memory database for later restoration. This function provides
521 the same capabilities as the :kbd:`.dump` command in the :program:`sqlite3`
522 shell.
Christian Heimesbbe741d2008-03-28 10:53:29 +0000523
R David Murray6db23352012-09-30 20:44:43 -0400524 Example::
Christian Heimesbbe741d2008-03-28 10:53:29 +0000525
R David Murray6db23352012-09-30 20:44:43 -0400526 # Convert file existing_db.db to SQL dump file dump.sql
Berker Peksag557a0632016-03-27 18:46:18 +0300527 import sqlite3
Christian Heimesbbe741d2008-03-28 10:53:29 +0000528
R David Murray6db23352012-09-30 20:44:43 -0400529 con = sqlite3.connect('existing_db.db')
530 with open('dump.sql', 'w') as f:
531 for line in con.iterdump():
532 f.write('%s\n' % line)
Christian Heimesbbe741d2008-03-28 10:53:29 +0000533
534
Emanuele Gaifasd7aed412018-03-10 23:08:31 +0100535 .. method:: backup(target, *, pages=0, progress=None, name="main", sleep=0.250)
536
537 This method makes a backup of a SQLite database even while it's being accessed
538 by other clients, or concurrently by the same connection. The copy will be
539 written into the mandatory argument *target*, that must be another
540 :class:`Connection` instance.
541
542 By default, or when *pages* is either ``0`` or a negative integer, the entire
543 database is copied in a single step; otherwise the method performs a loop
544 copying up to *pages* pages at a time.
545
546 If *progress* is specified, it must either be ``None`` or a callable object that
547 will be executed at each iteration with three integer arguments, respectively
548 the *status* of the last iteration, the *remaining* number of pages still to be
549 copied and the *total* number of pages.
550
551 The *name* argument specifies the database name that will be copied: it must be
552 a string containing either ``"main"``, the default, to indicate the main
553 database, ``"temp"`` to indicate the temporary database or the name specified
554 after the ``AS`` keyword in an ``ATTACH DATABASE`` statement for an attached
555 database.
556
557 The *sleep* argument specifies the number of seconds to sleep by between
558 successive attempts to backup remaining pages, can be specified either as an
559 integer or a floating point value.
560
561 Example 1, copy an existing database into another::
562
563 import sqlite3
564
565 def progress(status, remaining, total):
566 print(f'Copied {total-remaining} of {total} pages...')
567
568 con = sqlite3.connect('existing_db.db')
569 with sqlite3.connect('backup.db') as bck:
570 con.backup(bck, pages=1, progress=progress)
571
572 Example 2, copy an existing database into a transient copy::
573
574 import sqlite3
575
576 source = sqlite3.connect('existing_db.db')
577 dest = sqlite3.connect(':memory:')
578 source.backup(dest)
579
580 Availability: SQLite 3.6.11 or higher
581
582 .. versionadded:: 3.7
583
584
Georg Brandl116aa622007-08-15 14:28:22 +0000585.. _sqlite3-cursor-objects:
586
587Cursor Objects
588--------------
589
Georg Brandl96115fb22010-10-17 09:33:24 +0000590.. class:: Cursor
Georg Brandl116aa622007-08-15 14:28:22 +0000591
Georg Brandl96115fb22010-10-17 09:33:24 +0000592 A :class:`Cursor` instance has the following attributes and methods.
Georg Brandl116aa622007-08-15 14:28:22 +0000593
Berker Peksagc4154402016-06-12 13:41:47 +0300594 .. method:: execute(sql[, parameters])
Georg Brandl116aa622007-08-15 14:28:22 +0000595
Zachary Ware9d085622014-04-01 12:21:56 -0500596 Executes an SQL statement. The SQL statement may be parameterized (i. e.
R David Murray6db23352012-09-30 20:44:43 -0400597 placeholders instead of SQL literals). The :mod:`sqlite3` module supports two
598 kinds of placeholders: question marks (qmark style) and named placeholders
599 (named style).
Georg Brandl116aa622007-08-15 14:28:22 +0000600
R David Murray6db23352012-09-30 20:44:43 -0400601 Here's an example of both styles:
Georg Brandl116aa622007-08-15 14:28:22 +0000602
R David Murray6db23352012-09-30 20:44:43 -0400603 .. literalinclude:: ../includes/sqlite3/execute_1.py
Georg Brandl116aa622007-08-15 14:28:22 +0000604
R David Murray6db23352012-09-30 20:44:43 -0400605 :meth:`execute` will only execute a single SQL statement. If you try to execute
Berker Peksag7d92f892016-08-25 00:50:24 +0300606 more than one statement with it, it will raise a :exc:`.Warning`. Use
R David Murray6db23352012-09-30 20:44:43 -0400607 :meth:`executescript` if you want to execute multiple SQL statements with one
608 call.
Georg Brandl116aa622007-08-15 14:28:22 +0000609
610
R David Murray6db23352012-09-30 20:44:43 -0400611 .. method:: executemany(sql, seq_of_parameters)
Georg Brandl116aa622007-08-15 14:28:22 +0000612
R David Murray6db23352012-09-30 20:44:43 -0400613 Executes an SQL command against all parameter sequences or mappings found in
Berker Peksagc4154402016-06-12 13:41:47 +0300614 the sequence *seq_of_parameters*. The :mod:`sqlite3` module also allows
615 using an :term:`iterator` yielding parameters instead of a sequence.
Georg Brandl116aa622007-08-15 14:28:22 +0000616
R David Murray6db23352012-09-30 20:44:43 -0400617 .. literalinclude:: ../includes/sqlite3/executemany_1.py
Georg Brandl116aa622007-08-15 14:28:22 +0000618
R David Murray6db23352012-09-30 20:44:43 -0400619 Here's a shorter example using a :term:`generator`:
Georg Brandl116aa622007-08-15 14:28:22 +0000620
R David Murray6db23352012-09-30 20:44:43 -0400621 .. literalinclude:: ../includes/sqlite3/executemany_2.py
Georg Brandl116aa622007-08-15 14:28:22 +0000622
623
R David Murray6db23352012-09-30 20:44:43 -0400624 .. method:: executescript(sql_script)
Georg Brandl116aa622007-08-15 14:28:22 +0000625
R David Murray6db23352012-09-30 20:44:43 -0400626 This is a nonstandard convenience method for executing multiple SQL statements
627 at once. It issues a ``COMMIT`` statement first, then executes the SQL script it
628 gets as a parameter.
Georg Brandl116aa622007-08-15 14:28:22 +0000629
Berker Peksagc4154402016-06-12 13:41:47 +0300630 *sql_script* can be an instance of :class:`str`.
Georg Brandl116aa622007-08-15 14:28:22 +0000631
R David Murray6db23352012-09-30 20:44:43 -0400632 Example:
Georg Brandl116aa622007-08-15 14:28:22 +0000633
R David Murray6db23352012-09-30 20:44:43 -0400634 .. literalinclude:: ../includes/sqlite3/executescript.py
Georg Brandl116aa622007-08-15 14:28:22 +0000635
636
R David Murray6db23352012-09-30 20:44:43 -0400637 .. method:: fetchone()
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000638
R David Murray6db23352012-09-30 20:44:43 -0400639 Fetches the next row of a query result set, returning a single sequence,
640 or :const:`None` when no more data is available.
Christian Heimesfdab48e2008-01-20 09:06:41 +0000641
642
R David Murray6db23352012-09-30 20:44:43 -0400643 .. method:: fetchmany(size=cursor.arraysize)
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000644
R David Murray6db23352012-09-30 20:44:43 -0400645 Fetches the next set of rows of a query result, returning a list. An empty
646 list is returned when no more rows are available.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000647
R David Murray6db23352012-09-30 20:44:43 -0400648 The number of rows to fetch per call is specified by the *size* parameter.
649 If it is not given, the cursor's arraysize determines the number of rows
650 to be fetched. The method should try to fetch as many rows as indicated by
651 the size parameter. If this is not possible due to the specified number of
652 rows not being available, fewer rows may be returned.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000653
R David Murray6db23352012-09-30 20:44:43 -0400654 Note there are performance considerations involved with the *size* parameter.
655 For optimal performance, it is usually best to use the arraysize attribute.
656 If the *size* parameter is used, then it is best for it to retain the same
657 value from one :meth:`fetchmany` call to the next.
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +0000658
R David Murray6db23352012-09-30 20:44:43 -0400659 .. method:: fetchall()
Christian Heimesfdab48e2008-01-20 09:06:41 +0000660
R David Murray6db23352012-09-30 20:44:43 -0400661 Fetches all (remaining) rows of a query result, returning a list. Note that
662 the cursor's arraysize attribute can affect the performance of this operation.
663 An empty list is returned when no rows are available.
Christian Heimesfdab48e2008-01-20 09:06:41 +0000664
Berker Peksagf70fe6f2016-03-27 21:51:02 +0300665 .. method:: close()
666
667 Close the cursor now (rather than whenever ``__del__`` is called).
668
Berker Peksaged789f92016-08-25 00:45:07 +0300669 The cursor will be unusable from this point forward; a :exc:`ProgrammingError`
Berker Peksagf70fe6f2016-03-27 21:51:02 +0300670 exception will be raised if any operation is attempted with the cursor.
Christian Heimesfdab48e2008-01-20 09:06:41 +0000671
R David Murray6db23352012-09-30 20:44:43 -0400672 .. attribute:: rowcount
Georg Brandl116aa622007-08-15 14:28:22 +0000673
R David Murray6db23352012-09-30 20:44:43 -0400674 Although the :class:`Cursor` class of the :mod:`sqlite3` module implements this
675 attribute, the database engine's own support for the determination of "rows
676 affected"/"rows selected" is quirky.
Georg Brandl116aa622007-08-15 14:28:22 +0000677
R David Murray6db23352012-09-30 20:44:43 -0400678 For :meth:`executemany` statements, the number of modifications are summed up
679 into :attr:`rowcount`.
Georg Brandl116aa622007-08-15 14:28:22 +0000680
R David Murray6db23352012-09-30 20:44:43 -0400681 As required by the Python DB API Spec, the :attr:`rowcount` attribute "is -1 in
682 case no ``executeXX()`` has been performed on the cursor or the rowcount of the
683 last operation is not determinable by the interface". This includes ``SELECT``
684 statements because we cannot determine the number of rows a query produced
685 until all rows were fetched.
Georg Brandl116aa622007-08-15 14:28:22 +0000686
R David Murray6db23352012-09-30 20:44:43 -0400687 With SQLite versions before 3.6.5, :attr:`rowcount` is set to 0 if
688 you make a ``DELETE FROM table`` without any condition.
Guido van Rossum04110fb2007-08-24 16:32:05 +0000689
R David Murray6db23352012-09-30 20:44:43 -0400690 .. attribute:: lastrowid
Gerhard Häringd3372792008-03-29 19:13:55 +0000691
R David Murray6db23352012-09-30 20:44:43 -0400692 This read-only attribute provides the rowid of the last modified row. It is
Berker Peksage0b70cd2016-06-14 15:25:36 +0300693 only set if you issued an ``INSERT`` or a ``REPLACE`` statement using the
694 :meth:`execute` method. For operations other than ``INSERT`` or
695 ``REPLACE`` or when :meth:`executemany` is called, :attr:`lastrowid` is
696 set to :const:`None`.
697
698 If the ``INSERT`` or ``REPLACE`` statement failed to insert the previous
699 successful rowid is returned.
700
701 .. versionchanged:: 3.6
702 Added support for the ``REPLACE`` statement.
Georg Brandl116aa622007-08-15 14:28:22 +0000703
csabella02e12132017-04-04 01:16:14 -0400704 .. attribute:: arraysize
705
706 Read/write attribute that controls the number of rows returned by :meth:`fetchmany`.
707 The default value is 1 which means a single row would be fetched per call.
708
R David Murray6db23352012-09-30 20:44:43 -0400709 .. attribute:: description
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000710
R David Murray6db23352012-09-30 20:44:43 -0400711 This read-only attribute provides the column names of the last query. To
712 remain compatible with the Python DB API, it returns a 7-tuple for each
713 column where the last six items of each tuple are :const:`None`.
Georg Brandl48310cd2009-01-03 21:18:54 +0000714
R David Murray6db23352012-09-30 20:44:43 -0400715 It is set for ``SELECT`` statements without any matching rows as well.
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000716
Ezio Melotti62564db2016-03-18 20:10:36 +0200717 .. attribute:: connection
718
719 This read-only attribute provides the SQLite database :class:`Connection`
720 used by the :class:`Cursor` object. A :class:`Cursor` object created by
721 calling :meth:`con.cursor() <Connection.cursor>` will have a
722 :attr:`connection` attribute that refers to *con*::
723
724 >>> con = sqlite3.connect(":memory:")
725 >>> cur = con.cursor()
726 >>> cur.connection == con
727 True
728
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000729.. _sqlite3-row-objects:
730
731Row Objects
732-----------
733
734.. class:: Row
735
736 A :class:`Row` instance serves as a highly optimized
Georg Brandl48310cd2009-01-03 21:18:54 +0000737 :attr:`~Connection.row_factory` for :class:`Connection` objects.
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000738 It tries to mimic a tuple in most of its features.
739
740 It supports mapping access by column name and index, iteration,
741 representation, equality testing and :func:`len`.
742
743 If two :class:`Row` objects have exactly the same columns and their
744 members are equal, they compare equal.
Georg Brandl48310cd2009-01-03 21:18:54 +0000745
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000746 .. method:: keys
747
R David Murray092135e2014-06-05 15:16:38 -0400748 This method returns a list of column names. Immediately after a query,
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000749 it is the first member of each tuple in :attr:`Cursor.description`.
750
Serhiy Storchaka72e731c2015-03-31 13:33:11 +0300751 .. versionchanged:: 3.5
752 Added support of slicing.
753
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000754Let's assume we initialize a table as in the example given above::
755
Senthil Kumaran946eb862011-07-03 10:17:22 -0700756 conn = sqlite3.connect(":memory:")
757 c = conn.cursor()
758 c.execute('''create table stocks
759 (date text, trans text, symbol text,
760 qty real, price real)''')
761 c.execute("""insert into stocks
762 values ('2006-01-05','BUY','RHAT',100,35.14)""")
763 conn.commit()
764 c.close()
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000765
766Now we plug :class:`Row` in::
767
Senthil Kumaran946eb862011-07-03 10:17:22 -0700768 >>> conn.row_factory = sqlite3.Row
769 >>> c = conn.cursor()
770 >>> c.execute('select * from stocks')
771 <sqlite3.Cursor object at 0x7f4e7dd8fa80>
772 >>> r = c.fetchone()
773 >>> type(r)
774 <class 'sqlite3.Row'>
775 >>> tuple(r)
776 ('2006-01-05', 'BUY', 'RHAT', 100.0, 35.14)
777 >>> len(r)
778 5
779 >>> r[2]
780 'RHAT'
781 >>> r.keys()
782 ['date', 'trans', 'symbol', 'qty', 'price']
783 >>> r['qty']
784 100.0
785 >>> for member in r:
786 ... print(member)
787 ...
788 2006-01-05
789 BUY
790 RHAT
791 100.0
792 35.14
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000793
794
Berker Peksaged789f92016-08-25 00:45:07 +0300795.. _sqlite3-exceptions:
796
797Exceptions
798----------
799
800.. exception:: Warning
801
802 A subclass of :exc:`Exception`.
803
804.. exception:: Error
805
806 The base class of the other exceptions in this module. It is a subclass
807 of :exc:`Exception`.
808
809.. exception:: DatabaseError
810
811 Exception raised for errors that are related to the database.
812
813.. exception:: IntegrityError
814
815 Exception raised when the relational integrity of the database is affected,
816 e.g. a foreign key check fails. It is a subclass of :exc:`DatabaseError`.
817
818.. exception:: ProgrammingError
819
820 Exception raised for programming errors, e.g. table not found or already
821 exists, syntax error in the SQL statement, wrong number of parameters
822 specified, etc. It is a subclass of :exc:`DatabaseError`.
823
824
Georg Brandl116aa622007-08-15 14:28:22 +0000825.. _sqlite3-types:
826
827SQLite and Python types
828-----------------------
829
830
831Introduction
832^^^^^^^^^^^^
833
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000834SQLite natively supports the following types: ``NULL``, ``INTEGER``,
835``REAL``, ``TEXT``, ``BLOB``.
Georg Brandl116aa622007-08-15 14:28:22 +0000836
837The following Python types can thus be sent to SQLite without any problem:
838
Georg Brandlf6945182008-02-01 11:56:49 +0000839+-------------------------------+-------------+
840| Python type | SQLite type |
841+===============================+=============+
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000842| :const:`None` | ``NULL`` |
Georg Brandlf6945182008-02-01 11:56:49 +0000843+-------------------------------+-------------+
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000844| :class:`int` | ``INTEGER`` |
Georg Brandlf6945182008-02-01 11:56:49 +0000845+-------------------------------+-------------+
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000846| :class:`float` | ``REAL`` |
Georg Brandlf6945182008-02-01 11:56:49 +0000847+-------------------------------+-------------+
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000848| :class:`str` | ``TEXT`` |
Georg Brandlf6945182008-02-01 11:56:49 +0000849+-------------------------------+-------------+
Antoine Pitrouf06917e2010-02-02 23:00:29 +0000850| :class:`bytes` | ``BLOB`` |
Georg Brandlf6945182008-02-01 11:56:49 +0000851+-------------------------------+-------------+
Georg Brandl116aa622007-08-15 14:28:22 +0000852
Benjamin Petersonf10a79a2008-10-11 00:49:57 +0000853
Georg Brandl116aa622007-08-15 14:28:22 +0000854This is how SQLite types are converted to Python types by default:
855
Zachary Ware9d085622014-04-01 12:21:56 -0500856+-------------+----------------------------------------------+
857| SQLite type | Python type |
858+=============+==============================================+
859| ``NULL`` | :const:`None` |
860+-------------+----------------------------------------------+
861| ``INTEGER`` | :class:`int` |
862+-------------+----------------------------------------------+
863| ``REAL`` | :class:`float` |
864+-------------+----------------------------------------------+
865| ``TEXT`` | depends on :attr:`~Connection.text_factory`, |
866| | :class:`str` by default |
867+-------------+----------------------------------------------+
868| ``BLOB`` | :class:`bytes` |
869+-------------+----------------------------------------------+
Georg Brandl116aa622007-08-15 14:28:22 +0000870
871The type system of the :mod:`sqlite3` module is extensible in two ways: you can
872store additional Python types in a SQLite database via object adaptation, and
873you can let the :mod:`sqlite3` module convert SQLite types to different Python
874types via converters.
875
876
877Using adapters to store additional Python types in SQLite databases
878^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
879
880As described before, SQLite supports only a limited set of types natively. To
881use other Python types with SQLite, you must **adapt** them to one of the
Georg Brandl5c106642007-11-29 17:41:05 +0000882sqlite3 module's supported types for SQLite: one of NoneType, int, float,
Antoine Pitrouf06917e2010-02-02 23:00:29 +0000883str, bytes.
Georg Brandl116aa622007-08-15 14:28:22 +0000884
Georg Brandl116aa622007-08-15 14:28:22 +0000885There are two ways to enable the :mod:`sqlite3` module to adapt a custom Python
886type to one of the supported ones.
887
888
889Letting your object adapt itself
890""""""""""""""""""""""""""""""""
891
892This is a good approach if you write the class yourself. Let's suppose you have
893a class like this::
894
Éric Araujo28053fb2010-11-22 03:09:19 +0000895 class Point:
Georg Brandl116aa622007-08-15 14:28:22 +0000896 def __init__(self, x, y):
897 self.x, self.y = x, y
898
899Now you want to store the point in a single SQLite column. First you'll have to
900choose one of the supported types first to be used for representing the point.
901Let's just use str and separate the coordinates using a semicolon. Then you need
902to give your class a method ``__conform__(self, protocol)`` which must return
903the converted value. The parameter *protocol* will be :class:`PrepareProtocol`.
904
905.. literalinclude:: ../includes/sqlite3/adapter_point_1.py
906
907
908Registering an adapter callable
909"""""""""""""""""""""""""""""""
910
911The other possibility is to create a function that converts the type to the
912string representation and register the function with :meth:`register_adapter`.
913
Georg Brandl116aa622007-08-15 14:28:22 +0000914.. literalinclude:: ../includes/sqlite3/adapter_point_2.py
915
916The :mod:`sqlite3` module has two default adapters for Python's built-in
917:class:`datetime.date` and :class:`datetime.datetime` types. Now let's suppose
918we want to store :class:`datetime.datetime` objects not in ISO representation,
919but as a Unix timestamp.
920
921.. literalinclude:: ../includes/sqlite3/adapter_datetime.py
922
923
924Converting SQLite values to custom Python types
925^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
926
927Writing an adapter lets you send custom Python types to SQLite. But to make it
928really useful we need to make the Python to SQLite to Python roundtrip work.
929
930Enter converters.
931
932Let's go back to the :class:`Point` class. We stored the x and y coordinates
933separated via semicolons as strings in SQLite.
934
935First, we'll define a converter function that accepts the string as a parameter
936and constructs a :class:`Point` object from it.
937
938.. note::
939
Zachary Ware9d085622014-04-01 12:21:56 -0500940 Converter functions **always** get called with a :class:`bytes` object, no
941 matter under which data type you sent the value to SQLite.
Georg Brandl116aa622007-08-15 14:28:22 +0000942
Georg Brandl116aa622007-08-15 14:28:22 +0000943::
944
945 def convert_point(s):
Petri Lehtinen1ca93952012-02-15 22:17:21 +0200946 x, y = map(float, s.split(b";"))
Georg Brandl116aa622007-08-15 14:28:22 +0000947 return Point(x, y)
948
949Now you need to make the :mod:`sqlite3` module know that what you select from
950the database is actually a point. There are two ways of doing this:
951
952* Implicitly via the declared type
953
954* Explicitly via the column name
955
956Both ways are described in section :ref:`sqlite3-module-contents`, in the entries
957for the constants :const:`PARSE_DECLTYPES` and :const:`PARSE_COLNAMES`.
958
959The following example illustrates both approaches.
960
961.. literalinclude:: ../includes/sqlite3/converter_point.py
962
963
964Default adapters and converters
965^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
966
967There are default adapters for the date and datetime types in the datetime
968module. They will be sent as ISO dates/ISO timestamps to SQLite.
969
970The default converters are registered under the name "date" for
971:class:`datetime.date` and under the name "timestamp" for
972:class:`datetime.datetime`.
973
974This way, you can use date/timestamps from Python without any additional
975fiddling in most cases. The format of the adapters is also compatible with the
976experimental SQLite date/time functions.
977
978The following example demonstrates this.
979
980.. literalinclude:: ../includes/sqlite3/pysqlite_datetime.py
981
Petri Lehtinen5f794092013-02-26 21:32:02 +0200982If a timestamp stored in SQLite has a fractional part longer than 6
983numbers, its value will be truncated to microsecond precision by the
984timestamp converter.
985
Georg Brandl116aa622007-08-15 14:28:22 +0000986
987.. _sqlite3-controlling-transactions:
988
989Controlling Transactions
990------------------------
991
992By default, the :mod:`sqlite3` module opens transactions implicitly before a
Georg Brandl48310cd2009-01-03 21:18:54 +0000993Data Modification Language (DML) statement (i.e.
Berker Peksagab994ed2016-09-11 12:57:15 +0300994``INSERT``/``UPDATE``/``DELETE``/``REPLACE``).
Georg Brandl116aa622007-08-15 14:28:22 +0000995
Georg Brandl8a1e4c42009-05-25 21:13:36 +0000996You can control which kind of ``BEGIN`` statements sqlite3 implicitly executes
Georg Brandl116aa622007-08-15 14:28:22 +0000997(or none at all) via the *isolation_level* parameter to the :func:`connect`
998call, or via the :attr:`isolation_level` property of connections.
999
Serhiy Storchakaecf41da2016-10-19 16:29:26 +03001000If you want **autocommit mode**, then set :attr:`isolation_level` to ``None``.
Georg Brandl116aa622007-08-15 14:28:22 +00001001
1002Otherwise leave it at its default, which will result in a plain "BEGIN"
Georg Brandla971c652008-11-07 09:39:56 +00001003statement, or set it to one of SQLite's supported isolation levels: "DEFERRED",
1004"IMMEDIATE" or "EXCLUSIVE".
Georg Brandl116aa622007-08-15 14:28:22 +00001005
Berker Peksagfe70d922017-02-26 18:31:12 +03001006The current transaction state is exposed through the
1007:attr:`Connection.in_transaction` attribute of the connection object.
1008
Berker Peksagab994ed2016-09-11 12:57:15 +03001009.. versionchanged:: 3.6
1010 :mod:`sqlite3` used to implicitly commit an open transaction before DDL
1011 statements. This is no longer the case.
Georg Brandl116aa622007-08-15 14:28:22 +00001012
1013
Georg Brandl8a1e4c42009-05-25 21:13:36 +00001014Using :mod:`sqlite3` efficiently
1015--------------------------------
Georg Brandl116aa622007-08-15 14:28:22 +00001016
1017
1018Using shortcut methods
1019^^^^^^^^^^^^^^^^^^^^^^
1020
1021Using the nonstandard :meth:`execute`, :meth:`executemany` and
1022:meth:`executescript` methods of the :class:`Connection` object, your code can
1023be written more concisely because you don't have to create the (often
1024superfluous) :class:`Cursor` objects explicitly. Instead, the :class:`Cursor`
1025objects are created implicitly and these shortcut methods return the cursor
Benjamin Petersonf10a79a2008-10-11 00:49:57 +00001026objects. This way, you can execute a ``SELECT`` statement and iterate over it
Georg Brandl116aa622007-08-15 14:28:22 +00001027directly using only a single call on the :class:`Connection` object.
1028
1029.. literalinclude:: ../includes/sqlite3/shortcut_methods.py
1030
1031
1032Accessing columns by name instead of by index
1033^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1034
Georg Brandl22b34312009-07-26 14:54:51 +00001035One useful feature of the :mod:`sqlite3` module is the built-in
Georg Brandl116aa622007-08-15 14:28:22 +00001036:class:`sqlite3.Row` class designed to be used as a row factory.
1037
1038Rows wrapped with this class can be accessed both by index (like tuples) and
1039case-insensitively by name:
1040
1041.. literalinclude:: ../includes/sqlite3/rowclass.py
1042
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +00001043
1044Using the connection as a context manager
1045^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1046
Gerhard Häring0d7d6cf2008-03-29 01:32:44 +00001047Connection objects can be used as context managers
1048that automatically commit or rollback transactions. In the event of an
1049exception, the transaction is rolled back; otherwise, the transaction is
1050committed:
1051
1052.. literalinclude:: ../includes/sqlite3/ctx_manager.py
Gerhard Häringc34d76c2010-08-06 06:12:05 +00001053
1054
1055Common issues
1056-------------
1057
1058Multithreading
1059^^^^^^^^^^^^^^
1060
1061Older SQLite versions had issues with sharing connections between threads.
1062That's why the Python module disallows sharing connections and cursors between
1063threads. If you still try to do so, you will get an exception at runtime.
1064
1065The only exception is calling the :meth:`~Connection.interrupt` method, which
1066only makes sense to call from a different thread.
1067
Gerhard Häringe0941c52010-10-03 21:47:06 +00001068.. rubric:: Footnotes
1069
1070.. [#f1] The sqlite3 module is not built with loadable extension support by
Senthil Kumaran946eb862011-07-03 10:17:22 -07001071 default, because some platforms (notably Mac OS X) have SQLite
1072 libraries which are compiled without this feature. To get loadable
1073 extension support, you must pass --enable-loadable-sqlite-extensions to
1074 configure.