blob: 8d35b5a0e260b4d36e253b38e8f4a31d22bc557f [file] [log] [blame]
Fredrik Lundhb9056332001-07-11 17:42:21 +00001#
2# XML-RPC CLIENT LIBRARY
3# $Id$
4#
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00005# an XML-RPC client interface for Python.
6#
7# the marshalling and response parser code can also be used to
8# implement XML-RPC servers.
9#
10# Notes:
Martin v. Löwis37af9862004-08-20 07:31:37 +000011# this version is designed to work with Python 2.1 or newer.
Fredrik Lundhc4c062f2001-09-10 19:45:02 +000012#
Fredrik Lundhb9056332001-07-11 17:42:21 +000013# History:
14# 1999-01-14 fl Created
15# 1999-01-15 fl Changed dateTime to use localtime
16# 1999-01-16 fl Added Binary/base64 element, default to RPC2 service
17# 1999-01-19 fl Fixed array data element (from Skip Montanaro)
18# 1999-01-21 fl Fixed dateTime constructor, etc.
19# 1999-02-02 fl Added fault handling, handle empty sequences, etc.
20# 1999-02-10 fl Fixed problem with empty responses (from Skip Montanaro)
21# 1999-06-20 fl Speed improvements, pluggable parsers/transports (0.9.8)
22# 2000-11-28 fl Changed boolean to check the truth value of its argument
23# 2001-02-24 fl Added encoding/Unicode/SafeTransport patches
24# 2001-02-26 fl Added compare support to wrappers (0.9.9/1.0b1)
25# 2001-03-28 fl Make sure response tuple is a singleton
26# 2001-03-29 fl Don't require empty params element (from Nicholas Riley)
Fredrik Lundh78eedce2001-08-23 20:04:33 +000027# 2001-06-10 fl Folded in _xmlrpclib accelerator support (1.0b2)
28# 2001-08-20 fl Base xmlrpclib.Error on built-in Exception (from Paul Prescod)
Fredrik Lundhc4c062f2001-09-10 19:45:02 +000029# 2001-09-03 fl Allow Transport subclass to override getparser
30# 2001-09-10 fl Lazy import of urllib, cgi, xmllib (20x import speedup)
Fredrik Lundh1538c232001-10-01 19:42:03 +000031# 2001-10-01 fl Remove containers from memo cache when done with them
32# 2001-10-01 fl Use faster escape method (80% dumps speedup)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000033# 2001-10-02 fl More dumps microtuning
34# 2001-10-04 fl Make sure import expat gets a parser (from Guido van Rossum)
Skip Montanaro5e9c71b2001-10-10 15:56:34 +000035# 2001-10-10 sm Allow long ints to be passed as ints if they don't overflow
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000036# 2001-10-17 sm Test for int and long overflow (allows use on 64-bit systems)
Fredrik Lundhb6ab93f2001-12-19 21:40:04 +000037# 2001-11-12 fl Use repr() to marshal doubles (from Paul Felix)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000038# 2002-03-17 fl Avoid buffered read when possible (from James Rucker)
39# 2002-04-07 fl Added pythondoc comments
40# 2002-04-16 fl Added __str__ methods to datetime/binary wrappers
41# 2002-05-15 fl Added error constants (from Andrew Kuchling)
42# 2002-06-27 fl Merged with Python CVS version
Fredrik Lundh1303c7c2002-10-22 18:23:00 +000043# 2002-10-22 fl Added basic authentication (based on code from Phillip Eby)
Martin v. Löwis541342f2003-07-12 07:53:04 +000044# 2003-01-22 sm Add support for the bool type
45# 2003-02-27 gvr Remove apply calls
46# 2003-04-24 sm Use cStringIO if available
47# 2003-04-25 ak Add support for nil
48# 2003-06-15 gn Add support for time.struct_time
49# 2003-07-12 gp Correct marshalling of Faults
Martin v. Löwis45394c22003-10-31 13:49:36 +000050# 2003-10-31 mvl Add multicall support
Martin v. Löwis37af9862004-08-20 07:31:37 +000051# 2004-08-20 mvl Bump minimum supported Python version to 2.1
Fredrik Lundhb9056332001-07-11 17:42:21 +000052#
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000053# Copyright (c) 1999-2002 by Secret Labs AB.
54# Copyright (c) 1999-2002 by Fredrik Lundh.
Fredrik Lundhb9056332001-07-11 17:42:21 +000055#
56# info@pythonware.com
57# http://www.pythonware.com
58#
59# --------------------------------------------------------------------
60# The XML-RPC client interface is
61#
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000062# Copyright (c) 1999-2002 by Secret Labs AB
63# Copyright (c) 1999-2002 by Fredrik Lundh
Fredrik Lundhb9056332001-07-11 17:42:21 +000064#
65# By obtaining, using, and/or copying this software and/or its
66# associated documentation, you agree that you have read, understood,
67# and will comply with the following terms and conditions:
68#
69# Permission to use, copy, modify, and distribute this software and
70# its associated documentation for any purpose and without fee is
71# hereby granted, provided that the above copyright notice appears in
72# all copies, and that both that copyright notice and this permission
73# notice appear in supporting documentation, and that the name of
74# Secret Labs AB or the author not be used in advertising or publicity
75# pertaining to distribution of the software without specific, written
76# prior permission.
77#
78# SECRET LABS AB AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH REGARD
79# TO THIS SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANT-
80# ABILITY AND FITNESS. IN NO EVENT SHALL SECRET LABS AB OR THE AUTHOR
81# BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY
82# DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS,
83# WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS
84# ACTION, ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE
85# OF THIS SOFTWARE.
86# --------------------------------------------------------------------
87
88#
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000089# things to look into some day:
Fredrik Lundhb9056332001-07-11 17:42:21 +000090
Fredrik Lundh3d9addd2002-06-27 21:36:21 +000091# TODO: sort out True/False/boolean issues for Python 2.3
Fredrik Lundhb9056332001-07-11 17:42:21 +000092
Fred Drake1b410792001-09-04 18:55:03 +000093"""
94An XML-RPC client interface for Python.
95
96The marshalling and response parser code can also be used to
97implement XML-RPC servers.
98
Fred Drake1b410792001-09-04 18:55:03 +000099Exported exceptions:
100
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000101 Error Base class for client errors
102 ProtocolError Indicates an HTTP protocol error
103 ResponseError Indicates a broken response package
104 Fault Indicates an XML-RPC fault package
Fred Drake1b410792001-09-04 18:55:03 +0000105
106Exported classes:
107
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000108 ServerProxy Represents a logical connection to an XML-RPC server
Fred Drake1b410792001-09-04 18:55:03 +0000109
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000110 MultiCall Executor of boxcared xmlrpc requests
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000111 DateTime dateTime wrapper for an ISO 8601 string or time tuple or
112 localtime integer value to generate a "dateTime.iso8601"
113 XML-RPC value
114 Binary binary data wrapper
Fred Drake1b410792001-09-04 18:55:03 +0000115
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000116 Marshaller Generate an XML-RPC params chunk from a Python data structure
117 Unmarshaller Unmarshal an XML-RPC response from incoming XML event message
118 Transport Handles an HTTP transaction to an XML-RPC server
119 SafeTransport Handles an HTTPS transaction to an XML-RPC server
Fred Drake1b410792001-09-04 18:55:03 +0000120
121Exported constants:
122
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000123 True
124 False
Fred Drake1b410792001-09-04 18:55:03 +0000125
126Exported functions:
127
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000128 getparser Create instance of the fastest available parser & attach
129 to an unmarshalling object
130 dumps Convert an argument tuple or a Fault instance to an XML-RPC
131 request (or response, if the methodresponse option is used).
132 loads Convert an XML-RPC packet to unmarshalled data plus a method
133 name (None if not present).
Fred Drake1b410792001-09-04 18:55:03 +0000134"""
135
Neal Norwitzff113342007-04-17 08:42:15 +0000136import re, time, operator
Georg Brandl24420152008-05-26 16:32:26 +0000137import http.client
Georg Brandlcef803f2009-06-04 09:04:53 +0000138from xml.parsers import expat
Fredrik Lundh1538c232001-10-01 19:42:03 +0000139
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000140# --------------------------------------------------------------------
141# Internal stuff
142
Fredrik Lundhb9056332001-07-11 17:42:21 +0000143try:
Fred Drakeba613c32005-02-10 18:33:30 +0000144 import datetime
145except ImportError:
146 datetime = None
147
Fredrik Lundhb9056332001-07-11 17:42:21 +0000148def _decode(data, encoding, is8bit=re.compile("[\x80-\xff]").search):
149 # decode non-ascii string (if possible)
Guido van Rossum54ad5232007-05-27 09:17:48 +0000150 if encoding and is8bit(data):
Guido van Rossumef87d6e2007-05-02 19:09:54 +0000151 data = str(data, encoding)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000152 return data
153
Neal Norwitzff113342007-04-17 08:42:15 +0000154def escape(s):
155 s = s.replace("&", "&")
156 s = s.replace("<", "&lt;")
157 return s.replace(">", "&gt;",)
Fredrik Lundh1538c232001-10-01 19:42:03 +0000158
Guido van Rossum54ad5232007-05-27 09:17:48 +0000159def _stringify(string):
160 # convert to 7-bit ascii if possible
161 try:
Brett Cannon2dbde5e2007-07-30 03:50:35 +0000162 return string.decode("ascii")
Guido van Rossum261f9df2007-08-31 14:07:27 +0000163 except (UnicodeError, TypeError, AttributeError):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000164 return string
165
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000166__version__ = "1.0.1"
167
168# xmlrpc integer limits
Guido van Rossume2a383d2007-01-15 16:59:06 +0000169MAXINT = 2**31-1
170MININT = -2**31
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000171
172# --------------------------------------------------------------------
173# Error constants (from Dan Libby's specification at
174# http://xmlrpc-epi.sourceforge.net/specs/rfc.fault_codes.php)
175
176# Ranges of errors
177PARSE_ERROR = -32700
178SERVER_ERROR = -32600
179APPLICATION_ERROR = -32500
180SYSTEM_ERROR = -32400
181TRANSPORT_ERROR = -32300
182
183# Specific errors
184NOT_WELLFORMED_ERROR = -32700
185UNSUPPORTED_ENCODING = -32701
186INVALID_ENCODING_CHAR = -32702
187INVALID_XMLRPC = -32600
188METHOD_NOT_FOUND = -32601
189INVALID_METHOD_PARAMS = -32602
190INTERNAL_ERROR = -32603
Fredrik Lundhb9056332001-07-11 17:42:21 +0000191
192# --------------------------------------------------------------------
193# Exceptions
194
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000195##
196# Base class for all kinds of client-side errors.
197
Fredrik Lundh78eedce2001-08-23 20:04:33 +0000198class Error(Exception):
Fred Drake1b410792001-09-04 18:55:03 +0000199 """Base class for client errors."""
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000200 def __str__(self):
201 return repr(self)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000202
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000203##
204# Indicates an HTTP-level protocol error. This is raised by the HTTP
205# transport layer, if the server returns an error code other than 200
206# (OK).
207#
208# @param url The target URL.
209# @param errcode The HTTP error code.
210# @param errmsg The HTTP error message.
211# @param headers The HTTP header dictionary.
212
Fredrik Lundhb9056332001-07-11 17:42:21 +0000213class ProtocolError(Error):
Fred Drake1b410792001-09-04 18:55:03 +0000214 """Indicates an HTTP protocol error."""
Fredrik Lundhb9056332001-07-11 17:42:21 +0000215 def __init__(self, url, errcode, errmsg, headers):
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000216 Error.__init__(self)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000217 self.url = url
218 self.errcode = errcode
219 self.errmsg = errmsg
220 self.headers = headers
221 def __repr__(self):
222 return (
223 "<ProtocolError for %s: %s %s>" %
224 (self.url, self.errcode, self.errmsg)
225 )
226
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000227##
228# Indicates a broken XML-RPC response package. This exception is
229# raised by the unmarshalling layer, if the XML-RPC response is
230# malformed.
231
Fredrik Lundhb9056332001-07-11 17:42:21 +0000232class ResponseError(Error):
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000233 """Indicates a broken response package."""
Fredrik Lundhb9056332001-07-11 17:42:21 +0000234 pass
235
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000236##
237# Indicates an XML-RPC fault response package. This exception is
238# raised by the unmarshalling layer, if the XML-RPC response contains
239# a fault string. This exception can also used as a class, to
240# generate a fault XML-RPC message.
241#
242# @param faultCode The XML-RPC fault code.
243# @param faultString The XML-RPC fault string.
244
Fredrik Lundhb9056332001-07-11 17:42:21 +0000245class Fault(Error):
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000246 """Indicates an XML-RPC fault package."""
Fredrik Lundhb9056332001-07-11 17:42:21 +0000247 def __init__(self, faultCode, faultString, **extra):
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000248 Error.__init__(self)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000249 self.faultCode = faultCode
250 self.faultString = faultString
251 def __repr__(self):
252 return (
253 "<Fault %s: %s>" %
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000254 (self.faultCode, repr(self.faultString))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000255 )
256
257# --------------------------------------------------------------------
258# Special values
259
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000260##
Georg Brandl38eceaa2008-05-26 11:14:17 +0000261# Backwards compatibility
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000262
Guido van Rossum47b9ff62006-08-24 00:41:19 +0000263boolean = Boolean = bool
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000264
265##
266# Wrapper for XML-RPC DateTime values. This converts a time value to
267# the format used by XML-RPC.
268# <p>
269# The value can be given as a string in the format
270# "yyyymmddThh:mm:ss", as a 9-item time tuple (as returned by
271# time.localtime()), or an integer value (as returned by time.time()).
272# The wrapper uses time.localtime() to convert an integer to a time
273# tuple.
274#
275# @param value The time, given as an ISO 8601 string, a time
276# tuple, or a integer time value.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000277
Christian Heimesdae2a892008-04-19 00:55:37 +0000278def _strftime(value):
279 if datetime:
280 if isinstance(value, datetime.datetime):
281 return "%04d%02d%02dT%02d:%02d:%02d" % (
282 value.year, value.month, value.day,
283 value.hour, value.minute, value.second)
284
285 if not isinstance(value, (tuple, time.struct_time)):
286 if value == 0:
287 value = time.time()
288 value = time.localtime(value)
289
290 return "%04d%02d%02dT%02d:%02d:%02d" % value[:6]
291
Fredrik Lundhb9056332001-07-11 17:42:21 +0000292class DateTime:
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000293 """DateTime wrapper for an ISO 8601 string or time tuple or
294 localtime integer value to generate 'dateTime.iso8601' XML-RPC
295 value.
296 """
Fredrik Lundhb9056332001-07-11 17:42:21 +0000297
298 def __init__(self, value=0):
Christian Heimesdae2a892008-04-19 00:55:37 +0000299 if isinstance(value, str):
300 self.value = value
301 else:
302 self.value = _strftime(value)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000303
Christian Heimes05e8be12008-02-23 18:30:17 +0000304 def make_comparable(self, other):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000305 if isinstance(other, DateTime):
Christian Heimes05e8be12008-02-23 18:30:17 +0000306 s = self.value
307 o = other.value
308 elif datetime and isinstance(other, datetime.datetime):
309 s = self.value
310 o = other.strftime("%Y%m%dT%H:%M:%S")
311 elif isinstance(other, (str, unicode)):
312 s = self.value
313 o = other
314 elif hasattr(other, "timetuple"):
315 s = self.timetuple()
316 o = other.timetuple()
317 else:
318 otype = (hasattr(other, "__class__")
319 and other.__class__.__name__
320 or type(other))
321 raise TypeError("Can't compare %s and %s" %
322 (self.__class__.__name__, otype))
323 return s, o
324
325 def __lt__(self, other):
326 s, o = self.make_comparable(other)
327 return s < o
328
329 def __le__(self, other):
330 s, o = self.make_comparable(other)
331 return s <= o
332
333 def __gt__(self, other):
334 s, o = self.make_comparable(other)
335 return s > o
336
337 def __ge__(self, other):
338 s, o = self.make_comparable(other)
339 return s >= o
340
341 def __eq__(self, other):
342 s, o = self.make_comparable(other)
343 return s == o
Guido van Rossum47b9ff62006-08-24 00:41:19 +0000344
345 def __ne__(self, other):
Christian Heimes05e8be12008-02-23 18:30:17 +0000346 s, o = self.make_comparable(other)
347 return s != o
348
349 def timetuple(self):
350 return time.strptime(self.value, "%Y%m%dT%H:%M:%S")
351
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000352 ##
353 # Get date/time value.
354 #
355 # @return Date/time value, as an ISO 8601 string.
356
357 def __str__(self):
358 return self.value
359
Fredrik Lundhb9056332001-07-11 17:42:21 +0000360 def __repr__(self):
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000361 return "<DateTime %s at %x>" % (repr(self.value), id(self))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000362
363 def decode(self, data):
Neal Norwitzff113342007-04-17 08:42:15 +0000364 self.value = str(data).strip()
Fredrik Lundhb9056332001-07-11 17:42:21 +0000365
366 def encode(self, out):
367 out.write("<value><dateTime.iso8601>")
368 out.write(self.value)
369 out.write("</dateTime.iso8601></value>\n")
370
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000371def _datetime(data):
372 # decode xml element contents into a DateTime structure.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000373 value = DateTime()
374 value.decode(data)
375 return value
376
Skip Montanaro174dd222005-05-14 20:54:16 +0000377def _datetime_type(data):
378 t = time.strptime(data, "%Y%m%dT%H:%M:%S")
379 return datetime.datetime(*tuple(t)[:6])
380
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000381##
382# Wrapper for binary data. This can be used to transport any kind
383# of binary data over XML-RPC, using BASE64 encoding.
384#
385# @param data An 8-bit string containing arbitrary data.
386
Skip Montanarobfcbfa72003-04-24 19:51:31 +0000387import base64
Guido van Rossum68937b42007-05-18 00:51:22 +0000388import io
Skip Montanarobfcbfa72003-04-24 19:51:31 +0000389
Fredrik Lundhb9056332001-07-11 17:42:21 +0000390class Binary:
Fred Drake1b410792001-09-04 18:55:03 +0000391 """Wrapper for binary data."""
Fredrik Lundhb9056332001-07-11 17:42:21 +0000392
393 def __init__(self, data=None):
Guido van Rossum54a40cb2007-08-27 22:27:41 +0000394 if data is None:
395 data = b""
396 else:
397 if not isinstance(data, bytes):
398 raise TypeError("expected bytes, not %s" %
399 data.__class__.__name__)
400 data = bytes(data) # Make a copy of the bytes!
Fredrik Lundhb9056332001-07-11 17:42:21 +0000401 self.data = data
402
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000403 ##
404 # Get buffer contents.
405 #
406 # @return Buffer contents, as an 8-bit string.
407
408 def __str__(self):
Guido van Rossum54a40cb2007-08-27 22:27:41 +0000409 return str(self.data, "latin-1") # XXX encoding?!
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000410
Guido van Rossum47b9ff62006-08-24 00:41:19 +0000411 def __eq__(self, other):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000412 if isinstance(other, Binary):
413 other = other.data
Guido van Rossum47b9ff62006-08-24 00:41:19 +0000414 return self.data == other
415
416 def __ne__(self, other):
417 if isinstance(other, Binary):
418 other = other.data
419 return self.data != other
Fredrik Lundhb9056332001-07-11 17:42:21 +0000420
421 def decode(self, data):
Georg Brandlb54d8012009-06-04 09:11:51 +0000422 self.data = base64.decodebytes(data)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000423
424 def encode(self, out):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000425 out.write("<value><base64>\n")
Georg Brandlb54d8012009-06-04 09:11:51 +0000426 encoded = base64.encodebytes(self.data)
Brett Cannon2dbde5e2007-07-30 03:50:35 +0000427 out.write(encoded.decode('ascii'))
428 out.write('\n')
Fredrik Lundhb9056332001-07-11 17:42:21 +0000429 out.write("</base64></value>\n")
430
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000431def _binary(data):
432 # decode xml element contents into a Binary structure
Fredrik Lundhb9056332001-07-11 17:42:21 +0000433 value = Binary()
434 value.decode(data)
435 return value
436
Skip Montanaro9a7c96a2003-01-22 18:17:25 +0000437WRAPPERS = (DateTime, Binary)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000438
439# --------------------------------------------------------------------
440# XML parsers
441
Georg Brandlcef803f2009-06-04 09:04:53 +0000442class ExpatParser:
443 # fast expat parser for Python 2.0 and later.
444 def __init__(self, target):
445 self._parser = parser = expat.ParserCreate(None, None)
446 self._target = target
447 parser.StartElementHandler = target.start
448 parser.EndElementHandler = target.end
449 parser.CharacterDataHandler = target.data
450 encoding = None
451 target.xml(encoding, None)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000452
Georg Brandlcef803f2009-06-04 09:04:53 +0000453 def feed(self, data):
454 self._parser.Parse(data, 0)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000455
Georg Brandlcef803f2009-06-04 09:04:53 +0000456 def close(self):
457 self._parser.Parse("", 1) # end of data
458 del self._target, self._parser # get rid of circular references
Fredrik Lundhb9056332001-07-11 17:42:21 +0000459
Fredrik Lundhb9056332001-07-11 17:42:21 +0000460# --------------------------------------------------------------------
461# XML-RPC marshalling and unmarshalling code
462
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000463##
464# XML-RPC marshaller.
465#
466# @param encoding Default encoding for 8-bit strings. The default
467# value is None (interpreted as UTF-8).
468# @see dumps
469
Fredrik Lundhb9056332001-07-11 17:42:21 +0000470class Marshaller:
Fred Drake1b410792001-09-04 18:55:03 +0000471 """Generate an XML-RPC params chunk from a Python data structure.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000472
Fredrik Lundhc4c062f2001-09-10 19:45:02 +0000473 Create a Marshaller instance for each set of parameters, and use
474 the "dumps" method to convert your data (represented as a tuple)
475 to an XML-RPC params chunk. To write a fault response, pass a
476 Fault instance instead. You may prefer to use the "dumps" module
477 function for this purpose.
Fred Drake1b410792001-09-04 18:55:03 +0000478 """
Fredrik Lundhb9056332001-07-11 17:42:21 +0000479
480 # by the way, if you don't understand what's going on in here,
481 # that's perfectly ok.
482
Georg Brandlb044b2a2009-09-16 16:05:59 +0000483 def __init__(self, encoding=None, allow_none=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000484 self.memo = {}
485 self.data = None
486 self.encoding = encoding
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000487 self.allow_none = allow_none
Tim Petersc2659cf2003-05-12 20:19:37 +0000488
Fredrik Lundhb9056332001-07-11 17:42:21 +0000489 dispatch = {}
490
491 def dumps(self, values):
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000492 out = []
493 write = out.append
494 dump = self.__dump
Fredrik Lundhb9056332001-07-11 17:42:21 +0000495 if isinstance(values, Fault):
496 # fault instance
497 write("<fault>\n")
Martin v. Löwis541342f2003-07-12 07:53:04 +0000498 dump({'faultCode': values.faultCode,
499 'faultString': values.faultString},
500 write)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000501 write("</fault>\n")
502 else:
503 # parameter block
Fredrik Lundhc266bb02001-08-23 20:13:08 +0000504 # FIXME: the xml-rpc specification allows us to leave out
505 # the entire <params> block if there are no parameters.
506 # however, changing this may break older code (including
507 # old versions of xmlrpclib.py), so this is better left as
508 # is for now. See @XMLRPC3 for more information. /F
Fredrik Lundhb9056332001-07-11 17:42:21 +0000509 write("<params>\n")
510 for v in values:
511 write("<param>\n")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000512 dump(v, write)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000513 write("</param>\n")
514 write("</params>\n")
Neal Norwitzff113342007-04-17 08:42:15 +0000515 result = "".join(out)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000516 return result
517
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000518 def __dump(self, value, write):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000519 try:
520 f = self.dispatch[type(value)]
521 except KeyError:
Thomas Wouters89f507f2006-12-13 04:49:30 +0000522 # check if this object can be marshalled as a structure
523 try:
524 value.__dict__
525 except:
Collin Winterce36ad82007-08-30 01:19:48 +0000526 raise TypeError("cannot marshal %s objects" % type(value))
Thomas Wouters89f507f2006-12-13 04:49:30 +0000527 # check if this class is a sub-class of a basic type,
528 # because we don't know how to marshal these types
529 # (e.g. a string sub-class)
530 for type_ in type(value).__mro__:
531 if type_ in self.dispatch.keys():
Collin Winterce36ad82007-08-30 01:19:48 +0000532 raise TypeError("cannot marshal %s objects" % type(value))
Thomas Wouters89f507f2006-12-13 04:49:30 +0000533 # XXX(twouters): using "_arbitrary_instance" as key as a quick-fix
534 # for the p3yk merge, this should probably be fixed more neatly.
535 f = self.dispatch["_arbitrary_instance"]
536 f(self, value, write)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000537
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000538 def dump_nil (self, value, write):
539 if not self.allow_none:
Collin Winterce36ad82007-08-30 01:19:48 +0000540 raise TypeError("cannot marshal None unless allow_none is enabled")
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000541 write("<value><nil/></value>")
Guido van Rossum13257902007-06-07 23:15:56 +0000542 dispatch[type(None)] = dump_nil
Tim Petersc2659cf2003-05-12 20:19:37 +0000543
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000544 def dump_int(self, value, write):
Skip Montanaro5449e082001-10-17 22:53:33 +0000545 # in case ints are > 32 bits
546 if value > MAXINT or value < MININT:
Collin Winterce36ad82007-08-30 01:19:48 +0000547 raise OverflowError("int exceeds XML-RPC limits")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000548 write("<value><int>")
549 write(str(value))
550 write("</int></value>\n")
Guido van Rossum13257902007-06-07 23:15:56 +0000551 #dispatch[int] = dump_int
Fredrik Lundhb9056332001-07-11 17:42:21 +0000552
Georg Brandl38eceaa2008-05-26 11:14:17 +0000553 def dump_bool(self, value, write):
554 write("<value><boolean>")
555 write(value and "1" or "0")
556 write("</boolean></value>\n")
557 dispatch[bool] = dump_bool
Skip Montanaro9a7c96a2003-01-22 18:17:25 +0000558
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000559 def dump_long(self, value, write):
Skip Montanaro5449e082001-10-17 22:53:33 +0000560 if value > MAXINT or value < MININT:
Collin Winterce36ad82007-08-30 01:19:48 +0000561 raise OverflowError("long int exceeds XML-RPC limits")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000562 write("<value><int>")
563 write(str(int(value)))
564 write("</int></value>\n")
Guido van Rossum13257902007-06-07 23:15:56 +0000565 dispatch[int] = dump_long
Skip Montanaro5e9c71b2001-10-10 15:56:34 +0000566
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000567 def dump_double(self, value, write):
568 write("<value><double>")
569 write(repr(value))
570 write("</double></value>\n")
Guido van Rossum13257902007-06-07 23:15:56 +0000571 dispatch[float] = dump_double
Fredrik Lundhb9056332001-07-11 17:42:21 +0000572
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000573 def dump_string(self, value, write, escape=escape):
574 write("<value><string>")
575 write(escape(value))
576 write("</string></value>\n")
Guido van Rossum98297ee2007-11-06 21:34:58 +0000577 dispatch[bytes] = dump_string
Fredrik Lundhb9056332001-07-11 17:42:21 +0000578
Guido van Rossum54ad5232007-05-27 09:17:48 +0000579 def dump_unicode(self, value, write, escape=escape):
Guido van Rossum54ad5232007-05-27 09:17:48 +0000580 write("<value><string>")
581 write(escape(value))
582 write("</string></value>\n")
583 dispatch[str] = dump_unicode
Fredrik Lundhb9056332001-07-11 17:42:21 +0000584
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000585 def dump_array(self, value, write):
586 i = id(value)
Guido van Rossume2b70bc2006-08-18 22:13:04 +0000587 if i in self.memo:
Collin Winterce36ad82007-08-30 01:19:48 +0000588 raise TypeError("cannot marshal recursive sequences")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000589 self.memo[i] = None
Fredrik Lundh1538c232001-10-01 19:42:03 +0000590 dump = self.__dump
Fredrik Lundhb9056332001-07-11 17:42:21 +0000591 write("<value><array><data>\n")
592 for v in value:
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000593 dump(v, write)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000594 write("</data></array></value>\n")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000595 del self.memo[i]
Guido van Rossum13257902007-06-07 23:15:56 +0000596 dispatch[tuple] = dump_array
597 dispatch[list] = dump_array
Fredrik Lundhb9056332001-07-11 17:42:21 +0000598
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000599 def dump_struct(self, value, write, escape=escape):
600 i = id(value)
Guido van Rossume2b70bc2006-08-18 22:13:04 +0000601 if i in self.memo:
Collin Winterce36ad82007-08-30 01:19:48 +0000602 raise TypeError("cannot marshal recursive dictionaries")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000603 self.memo[i] = None
Fredrik Lundh1538c232001-10-01 19:42:03 +0000604 dump = self.__dump
Fredrik Lundhb9056332001-07-11 17:42:21 +0000605 write("<value><struct>\n")
Andrew M. Kuchling5962f452004-06-05 12:35:58 +0000606 for k, v in value.items():
Fredrik Lundhb9056332001-07-11 17:42:21 +0000607 write("<member>\n")
Guido van Rossum3172c5d2007-10-16 18:12:55 +0000608 if not isinstance(k, str):
Collin Winterce36ad82007-08-30 01:19:48 +0000609 raise TypeError("dictionary key must be string")
Fredrik Lundh1538c232001-10-01 19:42:03 +0000610 write("<name>%s</name>\n" % escape(k))
Andrew M. Kuchling5962f452004-06-05 12:35:58 +0000611 dump(v, write)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000612 write("</member>\n")
613 write("</struct></value>\n")
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000614 del self.memo[i]
Guido van Rossum13257902007-06-07 23:15:56 +0000615 dispatch[dict] = dump_struct
Fredrik Lundhb9056332001-07-11 17:42:21 +0000616
Fred Drakeba613c32005-02-10 18:33:30 +0000617 if datetime:
618 def dump_datetime(self, value, write):
619 write("<value><dateTime.iso8601>")
Christian Heimesdae2a892008-04-19 00:55:37 +0000620 write(_strftime(value))
Fred Drakeba613c32005-02-10 18:33:30 +0000621 write("</dateTime.iso8601></value>\n")
622 dispatch[datetime.datetime] = dump_datetime
623
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000624 def dump_instance(self, value, write):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000625 # check for special wrappers
626 if value.__class__ in WRAPPERS:
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000627 self.write = write
Fredrik Lundhb9056332001-07-11 17:42:21 +0000628 value.encode(self)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000629 del self.write
Fredrik Lundhb9056332001-07-11 17:42:21 +0000630 else:
631 # store instance attributes as a struct (really?)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000632 self.dump_struct(value.__dict__, write)
Guido van Rossume4dea982006-04-21 13:45:00 +0000633 dispatch[DateTime] = dump_instance
634 dispatch[Binary] = dump_instance
Thomas Wouters89f507f2006-12-13 04:49:30 +0000635 # XXX(twouters): using "_arbitrary_instance" as key as a quick-fix
636 # for the p3yk merge, this should probably be fixed more neatly.
637 dispatch["_arbitrary_instance"] = dump_instance
Fredrik Lundhb9056332001-07-11 17:42:21 +0000638
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000639##
640# XML-RPC unmarshaller.
641#
642# @see loads
643
Fredrik Lundhb9056332001-07-11 17:42:21 +0000644class Unmarshaller:
Fred Drake1b410792001-09-04 18:55:03 +0000645 """Unmarshal an XML-RPC response, based on incoming XML event
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000646 messages (start, data, end). Call close() to get the resulting
Fred Drake1b410792001-09-04 18:55:03 +0000647 data structure.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000648
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000649 Note that this reader is fairly tolerant, and gladly accepts bogus
650 XML-RPC data without complaining (but not bogus XML).
Fred Drake1b410792001-09-04 18:55:03 +0000651 """
Fredrik Lundhb9056332001-07-11 17:42:21 +0000652
653 # and again, if you don't understand what's going on in here,
654 # that's perfectly ok.
655
Georg Brandlb044b2a2009-09-16 16:05:59 +0000656 def __init__(self, use_datetime=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000657 self._type = None
658 self._stack = []
659 self._marks = []
660 self._data = []
661 self._methodname = None
662 self._encoding = "utf-8"
663 self.append = self._stack.append
Skip Montanaro174dd222005-05-14 20:54:16 +0000664 self._use_datetime = use_datetime
665 if use_datetime and not datetime:
Collin Winterce36ad82007-08-30 01:19:48 +0000666 raise ValueError("the datetime module is not available")
Fredrik Lundhb9056332001-07-11 17:42:21 +0000667
668 def close(self):
669 # return response tuple and target method
670 if self._type is None or self._marks:
671 raise ResponseError()
672 if self._type == "fault":
Guido van Rossum68468eb2003-02-27 20:14:51 +0000673 raise Fault(**self._stack[0])
Fredrik Lundhb9056332001-07-11 17:42:21 +0000674 return tuple(self._stack)
675
676 def getmethodname(self):
677 return self._methodname
678
679 #
680 # event handlers
681
682 def xml(self, encoding, standalone):
683 self._encoding = encoding
684 # FIXME: assert standalone == 1 ???
685
686 def start(self, tag, attrs):
687 # prepare to handle this element
688 if tag == "array" or tag == "struct":
689 self._marks.append(len(self._stack))
690 self._data = []
691 self._value = (tag == "value")
692
693 def data(self, text):
694 self._data.append(text)
695
Neal Norwitzff113342007-04-17 08:42:15 +0000696 def end(self, tag):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000697 # call the appropriate end tag handler
698 try:
699 f = self.dispatch[tag]
700 except KeyError:
701 pass # unknown tag ?
702 else:
Neal Norwitzff113342007-04-17 08:42:15 +0000703 return f(self, "".join(self._data))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000704
705 #
706 # accelerator support
707
708 def end_dispatch(self, tag, data):
709 # dispatch data
710 try:
711 f = self.dispatch[tag]
712 except KeyError:
713 pass # unknown tag ?
714 else:
715 return f(self, data)
716
717 #
718 # element decoders
719
720 dispatch = {}
721
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000722 def end_nil (self, data):
723 self.append(None)
724 self._value = 0
725 dispatch["nil"] = end_nil
Tim Petersc2659cf2003-05-12 20:19:37 +0000726
Fredrik Lundh1538c232001-10-01 19:42:03 +0000727 def end_boolean(self, data):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000728 if data == "0":
729 self.append(False)
730 elif data == "1":
731 self.append(True)
732 else:
Collin Winterce36ad82007-08-30 01:19:48 +0000733 raise TypeError("bad boolean value")
Fredrik Lundhb9056332001-07-11 17:42:21 +0000734 self._value = 0
735 dispatch["boolean"] = end_boolean
736
Fredrik Lundh1538c232001-10-01 19:42:03 +0000737 def end_int(self, data):
738 self.append(int(data))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000739 self._value = 0
740 dispatch["i4"] = end_int
Georg Brandlf08a9dd2008-06-10 16:57:31 +0000741 dispatch["i8"] = end_int
Fredrik Lundhb9056332001-07-11 17:42:21 +0000742 dispatch["int"] = end_int
743
Fredrik Lundh1538c232001-10-01 19:42:03 +0000744 def end_double(self, data):
745 self.append(float(data))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000746 self._value = 0
747 dispatch["double"] = end_double
748
Fredrik Lundh1538c232001-10-01 19:42:03 +0000749 def end_string(self, data):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000750 if self._encoding:
751 data = _decode(data, self._encoding)
752 self.append(_stringify(data))
753 self._value = 0
754 dispatch["string"] = end_string
755 dispatch["name"] = end_string # struct keys are always strings
756
757 def end_array(self, data):
Raymond Hettinger46ac8eb2002-06-30 03:39:14 +0000758 mark = self._marks.pop()
Fredrik Lundhb9056332001-07-11 17:42:21 +0000759 # map arrays to Python lists
760 self._stack[mark:] = [self._stack[mark:]]
761 self._value = 0
762 dispatch["array"] = end_array
763
764 def end_struct(self, data):
Raymond Hettinger46ac8eb2002-06-30 03:39:14 +0000765 mark = self._marks.pop()
Fredrik Lundhb9056332001-07-11 17:42:21 +0000766 # map structs to Python dictionaries
767 dict = {}
768 items = self._stack[mark:]
769 for i in range(0, len(items), 2):
770 dict[_stringify(items[i])] = items[i+1]
771 self._stack[mark:] = [dict]
772 self._value = 0
773 dispatch["struct"] = end_struct
774
Fredrik Lundh1538c232001-10-01 19:42:03 +0000775 def end_base64(self, data):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000776 value = Binary()
Guido van Rossum54a40cb2007-08-27 22:27:41 +0000777 value.decode(data.encode("ascii"))
Fredrik Lundhb9056332001-07-11 17:42:21 +0000778 self.append(value)
779 self._value = 0
780 dispatch["base64"] = end_base64
781
Fredrik Lundh1538c232001-10-01 19:42:03 +0000782 def end_dateTime(self, data):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000783 value = DateTime()
Fredrik Lundh1538c232001-10-01 19:42:03 +0000784 value.decode(data)
Skip Montanaro174dd222005-05-14 20:54:16 +0000785 if self._use_datetime:
786 value = _datetime_type(data)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000787 self.append(value)
788 dispatch["dateTime.iso8601"] = end_dateTime
789
790 def end_value(self, data):
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000791 # if we stumble upon a value element with no internal
Fredrik Lundhb9056332001-07-11 17:42:21 +0000792 # elements, treat it as a string element
793 if self._value:
794 self.end_string(data)
795 dispatch["value"] = end_value
796
797 def end_params(self, data):
798 self._type = "params"
799 dispatch["params"] = end_params
800
801 def end_fault(self, data):
802 self._type = "fault"
803 dispatch["fault"] = end_fault
804
Fredrik Lundh1538c232001-10-01 19:42:03 +0000805 def end_methodName(self, data):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000806 if self._encoding:
807 data = _decode(data, self._encoding)
808 self._methodname = data
809 self._type = "methodName" # no params
810 dispatch["methodName"] = end_methodName
811
Martin v. Löwis45394c22003-10-31 13:49:36 +0000812## Multicall support
813#
Fredrik Lundhb9056332001-07-11 17:42:21 +0000814
Martin v. Löwis45394c22003-10-31 13:49:36 +0000815class _MultiCallMethod:
816 # some lesser magic to store calls made to a MultiCall object
817 # for batch execution
818 def __init__(self, call_list, name):
819 self.__call_list = call_list
820 self.__name = name
821 def __getattr__(self, name):
822 return _MultiCallMethod(self.__call_list, "%s.%s" % (self.__name, name))
823 def __call__(self, *args):
824 self.__call_list.append((self.__name, args))
825
Martin v. Löwis12237b32004-08-22 16:04:50 +0000826class MultiCallIterator:
Martin v. Löwis45394c22003-10-31 13:49:36 +0000827 """Iterates over the results of a multicall. Exceptions are
828 thrown in response to xmlrpc faults."""
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000829
Martin v. Löwis12237b32004-08-22 16:04:50 +0000830 def __init__(self, results):
831 self.results = results
832
833 def __getitem__(self, i):
834 item = self.results[i]
835 if type(item) == type({}):
836 raise Fault(item['faultCode'], item['faultString'])
837 elif type(item) == type([]):
838 return item[0]
Martin v. Löwis45394c22003-10-31 13:49:36 +0000839 else:
Collin Winterce36ad82007-08-30 01:19:48 +0000840 raise ValueError("unexpected type in multicall result")
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000841
Martin v. Löwis45394c22003-10-31 13:49:36 +0000842class MultiCall:
843 """server -> a object used to boxcar method calls
844
845 server should be a ServerProxy object.
846
847 Methods can be added to the MultiCall using normal
848 method call syntax e.g.:
849
850 multicall = MultiCall(server_proxy)
851 multicall.add(2,3)
852 multicall.get_address("Guido")
853
854 To execute the multicall, call the MultiCall object e.g.:
855
856 add_result, address = multicall()
857 """
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000858
Martin v. Löwis45394c22003-10-31 13:49:36 +0000859 def __init__(self, server):
860 self.__server = server
861 self.__call_list = []
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000862
Martin v. Löwis45394c22003-10-31 13:49:36 +0000863 def __repr__(self):
864 return "<MultiCall at %x>" % id(self)
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000865
Martin v. Löwis45394c22003-10-31 13:49:36 +0000866 __str__ = __repr__
867
868 def __getattr__(self, name):
869 return _MultiCallMethod(self.__call_list, name)
870
871 def __call__(self):
872 marshalled_list = []
873 for name, args in self.__call_list:
874 marshalled_list.append({'methodName' : name, 'params' : args})
875
876 return MultiCallIterator(self.__server.system.multicall(marshalled_list))
Raymond Hettingercc523fc2003-11-02 09:47:05 +0000877
Fredrik Lundhb9056332001-07-11 17:42:21 +0000878# --------------------------------------------------------------------
879# convenience functions
880
Georg Brandl38eceaa2008-05-26 11:14:17 +0000881FastMarshaller = FastParser = FastUnmarshaller = None
882
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000883##
884# Create a parser object, and connect it to an unmarshalling instance.
885# This function picks the fastest available XML parser.
886#
887# return A (parser, unmarshaller) tuple.
888
Georg Brandlb044b2a2009-09-16 16:05:59 +0000889def getparser(use_datetime=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000890 """getparser() -> parser, unmarshaller
891
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000892 Create an instance of the fastest available parser, and attach it
893 to an unmarshalling object. Return both objects.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000894 """
Skip Montanaro174dd222005-05-14 20:54:16 +0000895 if use_datetime and not datetime:
Collin Winterce36ad82007-08-30 01:19:48 +0000896 raise ValueError("the datetime module is not available")
Fredrik Lundhb9056332001-07-11 17:42:21 +0000897 if FastParser and FastUnmarshaller:
Skip Montanaro174dd222005-05-14 20:54:16 +0000898 if use_datetime:
899 mkdatetime = _datetime_type
900 else:
901 mkdatetime = _datetime
902 target = FastUnmarshaller(True, False, _binary, mkdatetime, Fault)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000903 parser = FastParser(target)
904 else:
Skip Montanaro174dd222005-05-14 20:54:16 +0000905 target = Unmarshaller(use_datetime=use_datetime)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000906 if FastParser:
907 parser = FastParser(target)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000908 else:
Georg Brandlcef803f2009-06-04 09:04:53 +0000909 parser = ExpatParser(target)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000910 return parser, target
911
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000912##
913# Convert a Python tuple or a Fault instance to an XML-RPC packet.
914#
915# @def dumps(params, **options)
916# @param params A tuple or Fault instance.
917# @keyparam methodname If given, create a methodCall request for
918# this method name.
919# @keyparam methodresponse If given, create a methodResponse packet.
920# If used with a tuple, the tuple must be a singleton (that is,
921# it must contain exactly one element).
922# @keyparam encoding The packet encoding.
923# @return A string containing marshalled data.
924
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000925def dumps(params, methodname=None, methodresponse=None, encoding=None,
Georg Brandlb044b2a2009-09-16 16:05:59 +0000926 allow_none=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000927 """data [,options] -> marshalled data
928
929 Convert an argument tuple or a Fault instance to an XML-RPC
930 request (or response, if the methodresponse option is used).
931
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000932 In addition to the data object, the following options can be given
933 as keyword arguments:
Fredrik Lundhb9056332001-07-11 17:42:21 +0000934
935 methodname: the method name for a methodCall packet
936
937 methodresponse: true to create a methodResponse packet.
938 If this option is used with a tuple, the tuple must be
939 a singleton (i.e. it can contain only one element).
940
941 encoding: the packet encoding (default is UTF-8)
942
943 All 8-bit strings in the data structure are assumed to use the
944 packet encoding. Unicode strings are automatically converted,
Fredrik Lundhb0e8e9b2001-09-10 21:45:42 +0000945 where necessary.
Fredrik Lundhb9056332001-07-11 17:42:21 +0000946 """
947
Guido van Rossum13257902007-06-07 23:15:56 +0000948 assert isinstance(params, (tuple, Fault)), "argument must be tuple or Fault instance"
Fredrik Lundhb9056332001-07-11 17:42:21 +0000949 if isinstance(params, Fault):
950 methodresponse = 1
Guido van Rossum13257902007-06-07 23:15:56 +0000951 elif methodresponse and isinstance(params, tuple):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000952 assert len(params) == 1, "response tuple must be a singleton"
953
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000954 if not encoding:
Fredrik Lundhb9056332001-07-11 17:42:21 +0000955 encoding = "utf-8"
956
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000957 if FastMarshaller:
958 m = FastMarshaller(encoding)
959 else:
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +0000960 m = Marshaller(encoding, allow_none)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000961
Fredrik Lundhb9056332001-07-11 17:42:21 +0000962 data = m.dumps(params)
963
964 if encoding != "utf-8":
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000965 xmlheader = "<?xml version='1.0' encoding='%s'?>\n" % str(encoding)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000966 else:
967 xmlheader = "<?xml version='1.0'?>\n" # utf-8 is default
968
969 # standard XML-RPC wrappings
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000970 if methodname:
Fredrik Lundhb9056332001-07-11 17:42:21 +0000971 # a method call
Guido van Rossum3172c5d2007-10-16 18:12:55 +0000972 if not isinstance(methodname, str):
Fredrik Lundhb9056332001-07-11 17:42:21 +0000973 methodname = methodname.encode(encoding)
974 data = (
975 xmlheader,
976 "<methodCall>\n"
977 "<methodName>", methodname, "</methodName>\n",
978 data,
979 "</methodCall>\n"
980 )
981 elif methodresponse:
982 # a method response, or a fault structure
983 data = (
984 xmlheader,
985 "<methodResponse>\n",
986 data,
987 "</methodResponse>\n"
988 )
989 else:
990 return data # return as is
Neal Norwitzff113342007-04-17 08:42:15 +0000991 return "".join(data)
Fredrik Lundhb9056332001-07-11 17:42:21 +0000992
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000993##
994# Convert an XML-RPC packet to a Python object. If the XML-RPC packet
995# represents a fault condition, this function raises a Fault exception.
996#
997# @param data An XML-RPC packet, given as an 8-bit string.
Walter Dörwaldf0dfc7a2003-10-20 14:01:56 +0000998# @return A tuple containing the unpacked data, and the method name
Fredrik Lundh3d9addd2002-06-27 21:36:21 +0000999# (None if not present).
1000# @see Fault
1001
Georg Brandlb044b2a2009-09-16 16:05:59 +00001002def loads(data, use_datetime=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +00001003 """data -> unmarshalled data, method name
1004
1005 Convert an XML-RPC packet to unmarshalled data plus a method
1006 name (None if not present).
1007
1008 If the XML-RPC packet represents a fault condition, this function
1009 raises a Fault exception.
1010 """
Skip Montanaro174dd222005-05-14 20:54:16 +00001011 p, u = getparser(use_datetime=use_datetime)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001012 p.feed(data)
1013 p.close()
1014 return u.close(), u.getmethodname()
1015
1016
1017# --------------------------------------------------------------------
1018# request dispatcher
1019
1020class _Method:
1021 # some magic to bind an XML-RPC method to an RPC server.
1022 # supports "nested" methods (e.g. examples.getStateName)
1023 def __init__(self, send, name):
1024 self.__send = send
1025 self.__name = name
1026 def __getattr__(self, name):
1027 return _Method(self.__send, "%s.%s" % (self.__name, name))
1028 def __call__(self, *args):
1029 return self.__send(self.__name, args)
1030
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001031##
1032# Standard transport class for XML-RPC over HTTP.
1033# <p>
1034# You can create custom transports by subclassing this method, and
1035# overriding selected methods.
Fredrik Lundhb9056332001-07-11 17:42:21 +00001036
1037class Transport:
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00001038 """Handles an HTTP transaction to an XML-RPC server."""
Fredrik Lundhb9056332001-07-11 17:42:21 +00001039
1040 # client identifier (may be overridden)
1041 user_agent = "xmlrpclib.py/%s (by www.pythonware.com)" % __version__
1042
Georg Brandlb044b2a2009-09-16 16:05:59 +00001043 def __init__(self, use_datetime=False):
Skip Montanaro174dd222005-05-14 20:54:16 +00001044 self._use_datetime = use_datetime
1045
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001046 ##
1047 # Send a complete request, and parse the response.
1048 #
1049 # @param host Target host.
1050 # @param handler Target PRC handler.
1051 # @param request_body XML-RPC request body.
1052 # @param verbose Debugging flag.
1053 # @return Parsed response.
1054
Georg Brandlb044b2a2009-09-16 16:05:59 +00001055 def request(self, host, handler, request_body, verbose=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +00001056 # issue XML-RPC request
1057
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001058 http_conn = self.send_request(host, handler, request_body, verbose)
1059 resp = http_conn.getresponse()
Fredrik Lundhb9056332001-07-11 17:42:21 +00001060
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001061 if resp.status != 200:
Fredrik Lundhb9056332001-07-11 17:42:21 +00001062 raise ProtocolError(
1063 host + handler,
Hye-Shik Chang96042862007-08-19 10:49:11 +00001064 resp.status, resp.reason,
Guido van Rossumcfe02a42007-08-22 23:45:42 +00001065 dict(resp.getheaders())
Fredrik Lundhb9056332001-07-11 17:42:21 +00001066 )
1067
1068 self.verbose = verbose
1069
Kristján Valur Jónsson7e11b3f2009-02-02 16:04:04 +00001070 return self.parse_response(resp)
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001071
1072 ##
1073 # Create parser.
1074 #
1075 # @return A 2-tuple containing a parser and a unmarshaller.
Fredrik Lundhb9056332001-07-11 17:42:21 +00001076
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00001077 def getparser(self):
1078 # get parser and unmarshaller
Skip Montanaro174dd222005-05-14 20:54:16 +00001079 return getparser(use_datetime=self._use_datetime)
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00001080
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001081 ##
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001082 # Get authorization info from host parameter
1083 # Host may be a string, or a (host, x509-dict) tuple; if a string,
1084 # it is checked for a "user:pw@host" format, and a "Basic
1085 # Authentication" header is added if appropriate.
1086 #
1087 # @param host Host descriptor (URL or (URL, x509 info) tuple).
1088 # @return A 3-tuple containing (actual host, extra headers,
1089 # x509 info). The header and x509 fields may be None.
1090
1091 def get_host_info(self, host):
1092
1093 x509 = {}
Guido van Rossum13257902007-06-07 23:15:56 +00001094 if isinstance(host, tuple):
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001095 host, x509 = host
1096
Jeremy Hylton1afc1692008-06-18 20:49:58 +00001097 import urllib.parse
1098 auth, host = urllib.parse.splituser(host)
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001099
1100 if auth:
1101 import base64
Georg Brandlc8dcfb62009-02-13 10:50:01 +00001102 auth = urllib.parse.unquote_to_bytes(auth)
Georg Brandlb54d8012009-06-04 09:11:51 +00001103 auth = base64.encodebytes(auth).decode("utf-8")
Neal Norwitzff113342007-04-17 08:42:15 +00001104 auth = "".join(auth.split()) # get rid of whitespace
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001105 extra_headers = [
1106 ("Authorization", "Basic " + auth)
1107 ]
1108 else:
1109 extra_headers = None
1110
1111 return host, extra_headers, x509
1112
1113 ##
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001114 # Connect to server.
1115 #
1116 # @param host Target host.
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001117 # @return An HTTPConnection object
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001118
Fredrik Lundhb9056332001-07-11 17:42:21 +00001119 def make_connection(self, host):
1120 # create a HTTP connection object from a host descriptor
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001121 host, extra_headers, x509 = self.get_host_info(host)
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001122
Fredrik Lundhb9056332001-07-11 17:42:21 +00001123
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001124 ##
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001125 # Send HTTP request.
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001126 #
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001127 # @param host Host descriptor (URL or (URL, x509 info) tuple).
1128 # @param handler Targer RPC handler (a path relative to host)
1129 # @param request_body The XML-RPC request body
1130 # @param debug Enable debugging if debug is true.
1131 # @return An HTTPConnection.
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001132
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001133 def send_request(self, host, handler, request_body, debug):
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001134 host, extra_headers, x509 = self.get_host_info(host)
Georg Brandl24420152008-05-26 16:32:26 +00001135 connection = http.client.HTTPConnection(host)
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001136 if debug:
1137 connection.set_debuglevel(1)
1138 headers = {}
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001139 if extra_headers:
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001140 for key, val in extra_headers:
Amaury Forgeot d'Arc41e36672008-08-20 21:35:50 +00001141 headers[key] = val
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001142 headers["Content-Type"] = "text/xml"
1143 headers["User-Agent"] = self.user_agent
1144 connection.request("POST", handler, request_body, headers)
1145 return connection
Fredrik Lundhb9056332001-07-11 17:42:21 +00001146
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001147 ##
1148 # Parse response.
1149 #
1150 # @param file Stream.
1151 # @return Response tuple and target method.
1152
1153 def parse_response(self, file):
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001154 # read response from input file/socket, and parse it
Fredrik Lundhb9056332001-07-11 17:42:21 +00001155
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00001156 p, u = self.getparser()
Fredrik Lundhb9056332001-07-11 17:42:21 +00001157
1158 while 1:
Kristján Valur Jónsson7e11b3f2009-02-02 16:04:04 +00001159 response = file.read(1024)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001160 if not response:
1161 break
1162 if self.verbose:
Guido van Rossumbe19ed72007-02-09 05:37:30 +00001163 print("body:", repr(response))
Fredrik Lundhb9056332001-07-11 17:42:21 +00001164 p.feed(response)
1165
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001166 file.close()
Fredrik Lundhb9056332001-07-11 17:42:21 +00001167 p.close()
1168
1169 return u.close()
1170
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001171##
1172# Standard transport class for XML-RPC over HTTPS.
1173
Fredrik Lundhb9056332001-07-11 17:42:21 +00001174class SafeTransport(Transport):
Fredrik Lundhc4c062f2001-09-10 19:45:02 +00001175 """Handles an HTTPS transaction to an XML-RPC server."""
Fredrik Lundhb9056332001-07-11 17:42:21 +00001176
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001177 # FIXME: mostly untested
1178
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001179 def send_request(self, host, handler, request_body, debug):
1180 import socket
1181 if not hasattr(socket, "ssl"):
Fredrik Lundh1303c7c2002-10-22 18:23:00 +00001182 raise NotImplementedError(
Georg Brandl24420152008-05-26 16:32:26 +00001183 "your version of http.client doesn't support HTTPS")
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001184
1185 host, extra_headers, x509 = self.get_host_info(host)
Georg Brandl24420152008-05-26 16:32:26 +00001186 connection = http.client.HTTPSConnection(host, None, **(x509 or {}))
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001187 if debug:
1188 connection.set_debuglevel(1)
1189 headers = {}
1190 if extra_headers:
1191 for key, val in extra_headers:
Amaury Forgeot d'Arc41e36672008-08-20 21:35:50 +00001192 headers[key] = val
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001193 headers["Content-Type"] = "text/xml"
1194 headers["User-Agent"] = self.user_agent
1195 connection.request("POST", handler, request_body, headers)
1196 return connection
Fredrik Lundhb9056332001-07-11 17:42:21 +00001197
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001198##
1199# Standard server proxy. This class establishes a virtual connection
1200# to an XML-RPC server.
1201# <p>
1202# This class is available as ServerProxy and Server. New code should
1203# use ServerProxy, to avoid confusion.
1204#
1205# @def ServerProxy(uri, **options)
1206# @param uri The connection point on the server.
1207# @keyparam transport A transport factory, compatible with the
1208# standard transport class.
1209# @keyparam encoding The default encoding used for 8-bit strings
1210# (default is UTF-8).
1211# @keyparam verbose Use a true value to enable debugging output.
1212# (printed to standard output).
1213# @see Transport
1214
Fredrik Lundhb9056332001-07-11 17:42:21 +00001215class ServerProxy:
1216 """uri [,options] -> a logical connection to an XML-RPC server
1217
1218 uri is the connection point on the server, given as
1219 scheme://host/target.
1220
1221 The standard implementation always supports the "http" scheme. If
1222 SSL socket support is available (Python 2.0), it also supports
1223 "https".
1224
1225 If the target part and the slash preceding it are both omitted,
1226 "/RPC2" is assumed.
1227
1228 The following options can be given as keyword arguments:
1229
1230 transport: a transport factory
1231 encoding: the request encoding (default is UTF-8)
1232
1233 All 8-bit strings passed to the server proxy are assumed to use
1234 the given encoding.
1235 """
1236
Georg Brandlb044b2a2009-09-16 16:05:59 +00001237 def __init__(self, uri, transport=None, encoding=None, verbose=False,
1238 allow_none=False, use_datetime=False):
Fredrik Lundhb9056332001-07-11 17:42:21 +00001239 # establish a "logical" server connection
1240
1241 # get the url
Jeremy Hylton1afc1692008-06-18 20:49:58 +00001242 import urllib.parse
1243 type, uri = urllib.parse.splittype(uri)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001244 if type not in ("http", "https"):
Collin Winterce36ad82007-08-30 01:19:48 +00001245 raise IOError("unsupported XML-RPC protocol")
Jeremy Hylton1afc1692008-06-18 20:49:58 +00001246 self.__host, self.__handler = urllib.parse.splithost(uri)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001247 if not self.__handler:
1248 self.__handler = "/RPC2"
1249
1250 if transport is None:
1251 if type == "https":
Skip Montanaro174dd222005-05-14 20:54:16 +00001252 transport = SafeTransport(use_datetime=use_datetime)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001253 else:
Skip Montanaro174dd222005-05-14 20:54:16 +00001254 transport = Transport(use_datetime=use_datetime)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001255 self.__transport = transport
1256
Senthil Kumaranb3af08f2009-04-01 20:20:43 +00001257 self.__encoding = encoding or 'utf-8'
Fredrik Lundhb9056332001-07-11 17:42:21 +00001258 self.__verbose = verbose
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +00001259 self.__allow_none = allow_none
Tim Petersc2659cf2003-05-12 20:19:37 +00001260
Fredrik Lundhb9056332001-07-11 17:42:21 +00001261 def __request(self, methodname, params):
1262 # call a method on the remote server
1263
Andrew M. Kuchlinga4c2b742003-04-25 00:26:51 +00001264 request = dumps(params, methodname, encoding=self.__encoding,
Senthil Kumaranb3af08f2009-04-01 20:20:43 +00001265 allow_none=self.__allow_none).encode(self.__encoding)
Fredrik Lundhb9056332001-07-11 17:42:21 +00001266
1267 response = self.__transport.request(
1268 self.__host,
1269 self.__handler,
1270 request,
1271 verbose=self.__verbose
1272 )
1273
1274 if len(response) == 1:
1275 response = response[0]
1276
1277 return response
1278
1279 def __repr__(self):
1280 return (
Fredrik Lundh78eedce2001-08-23 20:04:33 +00001281 "<ServerProxy for %s%s>" %
Fredrik Lundhb9056332001-07-11 17:42:21 +00001282 (self.__host, self.__handler)
1283 )
1284
1285 __str__ = __repr__
Raymond Hettingercc523fc2003-11-02 09:47:05 +00001286
Fredrik Lundhb9056332001-07-11 17:42:21 +00001287 def __getattr__(self, name):
1288 # magic method dispatcher
1289 return _Method(self.__request, name)
1290
1291 # note: to call a remote object with an non-standard name, use
1292 # result getattr(server, "strange-python-name")(args)
1293
Fredrik Lundh78eedce2001-08-23 20:04:33 +00001294# compatibility
Fredrik Lundh3d9addd2002-06-27 21:36:21 +00001295
Fredrik Lundhb9056332001-07-11 17:42:21 +00001296Server = ServerProxy
1297
1298# --------------------------------------------------------------------
1299# test code
1300
1301if __name__ == "__main__":
1302
1303 # simple test program (from the XML-RPC specification)
1304
Fredrik Lundh78eedce2001-08-23 20:04:33 +00001305 # server = ServerProxy("http://localhost:8000") # local server
Martin v. Löwis12237b32004-08-22 16:04:50 +00001306 server = ServerProxy("http://time.xmlrpc.com/RPC2")
Fredrik Lundhb9056332001-07-11 17:42:21 +00001307
Fredrik Lundhb9056332001-07-11 17:42:21 +00001308 try:
Guido van Rossumbe19ed72007-02-09 05:37:30 +00001309 print(server.currentTime.getCurrentTime())
Guido van Rossumb940e112007-01-10 16:19:56 +00001310 except Error as v:
Guido van Rossumbe19ed72007-02-09 05:37:30 +00001311 print("ERROR", v)
Martin v. Löwis12237b32004-08-22 16:04:50 +00001312
Jeremy Hylton5d8a88a2007-08-14 16:47:39 +00001313 # The server at xmlrpc.com doesn't seem to support multicall anymore.
Martin v. Löwis12237b32004-08-22 16:04:50 +00001314 multi = MultiCall(server)
1315 multi.currentTime.getCurrentTime()
1316 multi.currentTime.getCurrentTime()
1317 try:
1318 for response in multi():
Guido van Rossumbe19ed72007-02-09 05:37:30 +00001319 print(response)
Guido van Rossumb940e112007-01-10 16:19:56 +00001320 except Error as v:
Guido van Rossumbe19ed72007-02-09 05:37:30 +00001321 print("ERROR", v)