blob: a13eabef1ca1b3ed0c58394d1b8eefddc35b2806 [file] [log] [blame]
Andy Greena35c86f2013-01-31 10:16:44 +08001Changelog
2---------
3
Andy Green0c3cc2e2016-02-20 09:12:52 +08004Fixes
5-----
6
71) MAJOR (Windows-only) fix assert firing
8
92) MAJOR http:/1.1 connections handled by lws_return_http_status() did not
10get sent a content-length resulting in the link hanging until the peer closed
11it. attack.sh updated to add a test for this.
12
Andy Green26d42492016-02-24 12:40:21 +0800133) MINOR An error about hdr struct in _lws_ws_related is corrected, it's not
14known to affect anything until after it was fixed
15
Andy Green5c0bcf42016-02-24 21:27:46 +0800164) MINOR During the close shutdown wait state introduced at v1.7, if something
17requests callback on writeable for the socket it will busywait until the
18socket closes
19
Andy Greendbfbbb42016-02-24 20:58:19 +0800205) MAJOR Although the test server has done it for a few versions already, it
21is now required for the user code to explicitly call
22
23 if (lws_http_transaction_completed(wsi))
24 return -1;
25
26when it finishes replying to a transaction in http. Previously the library
27did it for you, but that disallowed large, long transfers with multiple
28trips around the event loop (and cgi...).
29
Andy Green4ba798d2016-02-25 21:50:49 +0800306) MAJOR connections on ah waiting list that closed did not get removed from
31the waiting list...
32
Andy Green83af28a2016-02-28 10:55:31 +0800337) MAJOR since we added the ability to hold an ah across http keepalive
34transactions where more headers had already arrived, we broke the ability
35to tell if more headers had arrived. Result was if the browser didn't
36close the keepalive, we retained ah for the lifetime of the keepalive,
37using up the pool.
38
Andy Green442e1c82016-02-29 10:10:42 +0800398) MAJOR windows-only-POLLHUP was not coming
40
Andy Green4f5ebec2016-03-09 23:13:31 +0800419) Client should not send ext hdr if no exts
Andy Greendbfbbb42016-02-24 20:58:19 +080042
Andy Green0c3cc2e2016-02-20 09:12:52 +080043Changes
44-------
45
461) MINOR test-server gained some new switches
47
48 -C <file> use external SSL cert file
49 -K <file> use external SSL key file
50 -A <file> use external SSL CA cert file
51
52 -u <uid> set effective uid
53 -g <gid> set effective gid
54
55together you can use them like this to have the test-server work with the
56usual purchased SSL certs from an official CA.
57
58 --ssl -C your.crt -K your.key -A your.cer -u 99 -g 99
59
602) MINOR the OpenSSL magic to setup ECDH cipher usage is implemented in the
61library, and the ciphers restricted to use ECDH only.
62Using this, the lws test server can score an A at SSLLABS test
63
643) MINOR STS (SSL always) header is added to the test server if you use --ssl. With
65that, we score A+ at SSLLABS test
66
674) MINOR daemonize function (disabled at cmake by default) is updated to work
68with systemd
69
705) MINOR example systemd .service file now provided for test server
71(not installed by default)
72
Andy Green0ad1a6e2016-02-20 14:05:55 +0800736) test server html is updated with tabs and a new live server monitoring
74feature. Input sanitization added to the js.
75
Andy Green2d8d35a2016-02-29 14:19:16 +0800767) client connections attempted when no ah is free no longer fail, they are
77just deferred until an ah becomes available.
78
Andy Greena661ee52016-02-29 13:18:30 +0800798) The test client pays attention to if you give it an http:/ or https://
80protocol string to its argument in URL format. If so, it stays in http[s]
81client mode and doesn't upgrade to ws[s], allowing you to do generic http client
Andy Green5c8906e2016-03-13 16:44:19 +080082operations. Receiving transfer-encoding: chunked is supported.
Andy Greena661ee52016-02-29 13:18:30 +080083
Andy Green1e5a9ad2016-03-20 11:59:53 +0800849) If you enable -DLWS_WITH_HTTP_PROXY=1 at cmake, the test server has a
85new URI path http://localhost:7681/proxytest If you visit here, a client
86connection to http://example.com:80 is spawned, and the results piped on
87to your original connection.
88
8910) Also with LWS_WITH_HTTP_PROXY enabled at cmake, lws wants to link to an
90additional library, "libhubbub". This allows lws to do html rewriting on the
91fly, adjusting proxied urls in a lightweight and fast way.
Andy Greenfb5f33b2016-03-01 07:19:01 +080092
Andy Greenc6fd3602016-03-23 09:22:11 +08009311) There's a new context creation flag LWS_SERVER_OPTION_DO_SSL_GLOBAL_INIT,
94this is included automatically if you give any other SSL-related option flag.
95If you give no SSL-related option flag, nor this one directly, then even
96though SSL support may be compiled in, it is never initialized nor used for the
97whole lifetime of the lws context.
98
99Conversely in order to prepare the context to use SSL, even though, eg, you
100are not listening on SSL but will use SSL client connections later, you must
101give this flag explicitly to make sure SSL is initialized.
102
Andy Green2d8d35a2016-02-29 14:19:16 +0800103
Andy Greend7fddad2016-02-18 20:36:55 +0800104User API additions
105------------------
106
Andy Green0c3cc2e2016-02-20 09:12:52 +08001071) MINOR APIBREAK There's a new member in struct lws_context_creation_info, ecdh_curve,
Andy Greend7fddad2016-02-18 20:36:55 +0800108which lets you set the name of the ECDH curve OpenSSL should use. By
109default (if you leave ecdh_curve NULL) it will use "prime256v1"
110
Andy Green51d9afa2016-02-24 11:05:56 +08001112) MINOR NEWAPI It was already possible to adopt a foreign socket that had not
112been read from using lws_adopt_socket() since v1.7. Now you can adopt a
113partially-used socket if you don't need SSL, by passing it what you read
114so it can drain that before reading from the socket.
115
116LWS_VISIBLE LWS_EXTERN struct lws *
117lws_adopt_socket_readbuf(struct lws_context *context, lws_sockfd_type accept_fd,
118 const char *readbuf, size_t len);
Andy Greend7fddad2016-02-18 20:36:55 +0800119
Andy Green6a8099b2016-02-21 21:25:48 +08001203) MINOR NEWAPI CGI type "network io" subprocess execution is now possible from
121a simple api.
122
123LWS_VISIBLE LWS_EXTERN int
Andy Green1a138852016-03-20 11:55:25 +0800124lws_cgi(struct lws *wsi, char * const *exec_array, int script_uri_path_len,
125 int timeout_secs);
Andy Green6a8099b2016-02-21 21:25:48 +0800126
127LWS_VISIBLE LWS_EXTERN int
128lws_cgi_kill(struct lws *wsi);
129
130To use it, you must first set the cmake option
131
132$ cmake .. -DLWS_WITH_CGI=1
133
134See test-server-http.c and test server path
135
136http://localhost:7681/cgitest
137
138stdin gets http body, you can test it with wget
139
140$ echo hello > hello.txt
141$ wget http://localhost:7681/cgitest --post-file=hello.txt -O- --quiet
142lwstest script
143read="hello"
144
Andy Green1a138852016-03-20 11:55:25 +0800145The test script returns text/html table showing /proc/meminfo. But the cgi
146support is complete enough to run cgit cgi.
147
Andy Greend61bed32016-02-25 15:01:55 +08001484) There is a helper api for forming logging timestamps
149
150LWS_VISIBLE int
151lwsl_timestamp(int level, char *p, int len)
152
153this generates this kind of timestamp for use as logging preamble
154
155lwsts[13116]: [2016/01/25 14:52:52:8386] NOTICE: Initial logging level 7
156
Andy Greena661ee52016-02-29 13:18:30 +08001575) struct lws_client_connect_info has a new member
158
159 const char *method
160
161If it's NULL, then everything happens as before, lws_client_connect_via_info()
162makes a ws or wss connection to the address given.
163
164If you set method to a valid http method like "GET", though, then this method
165is used and the connection remains in http[s], it's not upgraded to ws[s].
166
167So with this, you can perform http[s] client operations as well as ws[s] ones.
168
169There are 4 new related callbacks
170
171 LWS_CALLBACK_ESTABLISHED_CLIENT_HTTP = 44,
172 LWS_CALLBACK_CLOSED_CLIENT_HTTP = 45,
173 LWS_CALLBACK_RECEIVE_CLIENT_HTTP = 46,
174 LWS_CALLBACK_COMPLETED_CLIENT_HTTP = 47,
Andy Green6a8099b2016-02-21 21:25:48 +0800175
Andy Green494418a2016-03-02 09:17:22 +08001766) struct lws_client_connect_info has a new member
177
178 const char *parent_wsi
179
180if non-NULL, the client wsi is set to be a child of parent_wsi. This ensures
181if parent_wsi closes, then the client child is closed just before.
182
Andy Green0f9904f2016-03-17 15:26:49 +08001837) If you're using SSL, there's a new context creation-time option flag
184LWS_SERVER_OPTION_REDIRECT_HTTP_TO_HTTPS. If you give this, non-ssl
185connections to the server listen port are accepted and receive a 301
186redirect to / on the same host and port using https://
187
Andy Greenc5376b12016-04-08 09:45:49 +08001888) User code may set per-connection extension options now, using a new api
189"lws_set_extension_option()".
190
191This should be called from the ESTABLISHED callback like this
192
193 lws_set_extension_option(wsi, "permessage-deflate",
194 "rx_buf_size", "12"); /* 1 << 12 */
195
196If the extension is not active (missing or not negotiated for the
197connection, or extensions are disabled on the library) the call is
198just returns -1. Otherwise the connection's extension has its
199named option changed.
200
201The extension may decide to alter or disallow the change, in the
202example above permessage-deflate restricts the size of his rx
203output buffer also considering the protocol's rx_buf_size member.
204
205
Andy Greencd0c6962016-03-28 10:12:37 +0800206New application lwsws
207---------------------
208
209A libwebsockets-based general webserver is built by default now, lwsws.
210
211It's configured by JSON, by default in
212
213 /etc/lwsws/conf
214
215which contains global lws context settings like this
216
217{
218 "global": {
219 "uid": "99",
220 "gid": "99",
221 "interface": "eth0",
222 "count-threads": "1"
223 }
224}
225
226 /etc/lwsws/conf.d/*
227
228which contains zero or more files describing vhosts, like this
229
230{
231 "vhosts": [
232 { "name": "warmcat.com",
233 "port": "443",
234 "host-ssl-key": "/etc/pki/tls/private/warmcat.com.key",
235 "host-ssl-cert": "/etc/pki/tls/certs/warmcat.com.crt",
236 "host-ssl-ca": "/etc/pki/tls/certs/warmcat.com.cer",
237 "mounts": [
238 { "/": [
239 { "home": "file:///var/www/warmcat.com" },
240 { "default": "index.html" }
241 ]
242 }
243 ]
244 }
245 ]
246}
247
248
Andy Green0c3cc2e2016-02-20 09:12:52 +0800249
Andy Green9c60ed92016-02-16 12:32:18 +0800250v1.7.0
251======
252
Andy Green67112662016-01-11 11:34:01 +0800253Extension Changes
254-----------------
255
2561) There is now a "permessage-deflate" / RFC7692 implementation. It's very
257similar to "deflate-frame" we have offered for a long while; deflate-frame is
258now provided as an alias of permessage-deflate.
259
260The main differences are that the new permessage-deflate implementation:
261
262 - properly performs streaming respecting input and output buffer limits. The
263 old deflate-frame implementation could only work on complete deflate input
264 and produce complete inflate output for each frame. The new implementation
265 only mallocs buffers at initialization.
266
267 - goes around the event loop after each input package is processed allowing
268 interleaved output processing. The RX flow control api can be used to
269 force compressed input processing to match the rate of compressed output
270 processing (test--echo shows an example of how to do this).
271
272 - when being "deflate-frame" for compatibility he uses the same default zlib
273 settings as the old "deflate-frame", but instead of exponentially increasing
274 malloc allocations until the whole output will fit, he observes the default
275 input and output chunking buffer sizes of "permessage-deflate", that's
276 1024 in and 1024 out at a time.
277
2782) deflate-stream has been disabled for many versions (for over a year) and is
279now removed. Browsers are now standardizing on "permessage-deflate" / RFC7692
280
2813) struct lws_extension is simplified, and lws extensions now have a public
282api (their callback) for use in user code to compose extensions and options
283the user code wants. lws_get_internal_exts() is deprecated but kept around
284as a NOP. The changes allow one extension implementation to go by different
285names and allows the user client code to control option offers per-ext.
286
287The test client and server are updated to use the new way. If you use
288the old way it should still work, but extensions will be disabled until you
289update your code.
290
291Extensions are now responsible for allocating and per-instance private struct
292at instance construction time and freeing it when the instance is destroyed.
293Not needing to know the size means the extension's struct can be opaque
294to user code.
295
296
Andy Green3df58002015-12-25 12:44:12 +0800297User api additions
298------------------
299
Andy Green200a6a22016-02-15 20:36:02 +08003001) The info struct gained three new members
Andy Green3df58002015-12-25 12:44:12 +0800301
302 - max_http_header_data: 0 for default (1024) or set the maximum amount of known
303 http header payload that lws can deal with. Payload in unknown http
304 headers is dropped silently. If for some reason you need to send huge
305 cookies or other HTTP-level headers, you can now increase this at context-
306 creation time.
307
308 - max_http_header_pool: 0 for default (16) or set the maximum amount of http
309 headers that can be tracked by lws in this context. For the server, if
310 the header pool is completely in use then accepts on the listen socket
311 are disabled until one becomes free. For the client, if you simultaneously
312 have pending connects for more than this number of client connections,
313 additional connects will fail until some of the pending connections timeout
314 or complete.
315
Andy Green200a6a22016-02-15 20:36:02 +0800316 - timeout_secs: 0 for default (currently 20s), or set the library's
317 network activity timeout to the given number of seconds
318
Andy Green3df58002015-12-25 12:44:12 +0800319HTTP header processing in lws only exists until just after the first main
320callback after the HTTP handshake... for ws connections that is ESTABLISHED and
321for HTTP connections the HTTP callback.
322
323So these settings are not related to the maximum number of simultaneous
Andy Green3246ebb2015-12-26 12:03:06 +0800324connections, but the number of HTTP handshakes that may be expected or ongoing,
Andy Green3df58002015-12-25 12:44:12 +0800325or have just completed, at one time. The reason it's useful is it changes the
326memory allocation for header processing to be one-time at context creation
327instead of every time there is a new connection, and gives you control over
328the peak allocation.
329
330Setting max_http_header_pool to 1 is fine it will just queue incoming
331connections before the accept as necessary, you can still have as many
Andy Green5b85e392015-12-26 13:23:11 +0800332simultaneous post-header connections as you like. Since the http header
333processing is completed and the allocation released after ESTABLISHED or the
334HTTP callback, even with a pool of 1 many connections can be handled rapidly.
335
Andy Green066a7a12015-12-26 15:47:06 +08003362) There is a new callback that allows the user code to get acccess to the
337optional close code + aux data that may have been sent by the peer.
338
339LWS_CALLBACK_WS_PEER_INITIATED_CLOSE:
340 The peer has sent an unsolicited Close WS packet. @in and
341 @len are the optional close code (first 2 bytes, network
342 order) and the optional additional information which is not
343 defined in the standard, and may be a string or non-human-
344 readble data.
345 If you return 0 lws will echo the close and then close the
Andy Green67112662016-01-11 11:34:01 +0800346 connection. If you return nonzero lws will just close the
347 connection.
Andy Green066a7a12015-12-26 15:47:06 +0800348
349As usual not handling it does the right thing, if you're not interested in it
350just ignore it.
351
352The test server has "open and close" testing buttons at the bottom, if you
353open and close that connection, on close it will send a close code 3000 decimal
354and the string "Bye!" as the aux data.
355
356The test server dumb-increment callback handles this callback reason and prints
357
358lwsts[15714]: LWS_CALLBACK_WS_PEER_INITIATED_CLOSE: len 6
359lwsts[15714]: 0: 0x0B
360lwsts[15714]: 1: 0xB8
361lwsts[15714]: 2: 0x42
362lwsts[15714]: 3: 0x79
363lwsts[15714]: 4: 0x65
364lwsts[15714]: 5: 0x21
365
Andy Green1fb95e82015-12-26 17:20:34 +08003663) There is a new API to allow the user code to control the content of the
367close frame sent when about to return nonzero from the user callback to
368indicate the connection should close.
369
370/**
371 * lws_close_reason - Set reason and aux data to send with Close packet
372 * If you are going to return nonzero from the callback
373 * requesting the connection to close, you can optionally
374 * call this to set the reason the peer will be told if
375 * possible.
376 *
377 * @wsi: The websocket connection to set the close reason on
378 * @status: A valid close status from websocket standard
379 * @buf: NULL or buffer containing up to 124 bytes of auxiliary data
380 * @len: Length of data in @buf to send
381 */
382LWS_VISIBLE LWS_EXTERN void
383lws_close_reason(struct lws *wsi, enum lws_close_status status,
384 unsigned char *buf, size_t len);
385
386An extra button is added to the "open and close" test server page that requests
387that the test server close the connection from his end.
388
389The test server code will do so by
390
391 lws_close_reason(wsi, LWS_CLOSE_STATUS_GOINGAWAY,
392 (unsigned char *)"seeya", 5);
393 return -1;
394
395The browser shows the close code and reason he received
396
397websocket connection CLOSED, code: 1001, reason: seeya
398
Vijay Khurdiyae73d4462016-01-15 16:21:51 +08003994) There's a new context creation time option flag
Andy Green44a7f652015-12-29 11:20:09 +0800400
401LWS_SERVER_OPTION_VALIDATE_UTF8
402
403if you set it in info->options, then TEXT and CLOSE frames will get checked to
404confirm that they contain valid UTF-8. If they don't, the connection will get
405closed by lws.
406
Vijay Khurdiyae73d4462016-01-15 16:21:51 +08004075) ECDH Certs are now supported. Enable the CMake option
408
409cmake .. -DLWS_SSL_SERVER_WITH_ECDH_CERT=1
410
411**and** the info->options flag
412
Andy Greenff696482016-02-17 07:46:27 +0800413LWS_SERVER_OPTION_SSL_ECDH
Vijay Khurdiyae73d4462016-01-15 16:21:51 +0800414
415to build in support and select it at runtime.
416
Andy Greenff696482016-02-17 07:46:27 +08004176) There's a new api lws_parse_uri() that simplifies chopping up
Andy Green809d69a2016-01-14 11:37:56 +0800418https://xxx:yyy/zzz uris into parts nicely. The test client now uses this
Andy Greend3a55052016-01-19 03:34:24 +0800419to allow proper uris as well as the old address style.
420
4217) SMP support is integrated into LWS without any internal threading. It's
422very simple to use, libwebsockets-test-server-pthread shows how to do it,
423use -j <n> argument there to control the number of service threads up to 32.
424
425Two new members are added to the info struct
426
427 unsigned int count_threads;
428 unsigned int fd_limit_per_thread;
429
430leave them at the default 0 to get the normal singlethreaded service loop.
431
432Set count_threads to n to tell lws you will have n simultaneous service threads
433operating on the context.
434
435There is still a single listen socket on one port, no matter how many
436service threads.
437
438When a connection is made, it is accepted by the service thread with the least
439connections active to perform load balancing.
440
441The user code is responsible for spawning n threads running the service loop
442associated to a specific tsi (Thread Service Index, 0 .. n - 1). See
443the libwebsockets-test-server-pthread for how to do.
444
445If you leave fd_limit_per_thread at 0, then the process limit of fds is shared
446between the service threads; if you process was allowed 1024 fds overall then
447each thread is limited to 1024 / n.
448
449You can set fd_limit_per_thread to a nonzero number to control this manually, eg
450the overall supported fd limit is less than the process allowance.
451
452You can control the context basic data allocation for multithreading from Cmake
453using -DLWS_MAX_SMP=, if not given it's set to 32. The serv_buf allocation
454for the threads (currently 4096) is made at runtime only for active threads.
455
456Because lws will limit the requested number of actual threads supported
457according to LWS_MAX_SMP, there is an api lws_get_count_threads(context) to
458discover how many threads were actually allowed when the context was created.
459
460It's required to implement locking in the user code in the same way that
461libwebsockets-test-server-pthread does it, for the FD locking callbacks.
462
Andy Greenba119e92016-01-26 21:40:32 +0800463If LWS_MAX_SMP=1, then there is no code related to pthreads compiled in the
464library. If more than 1, a small amount of pthread mutex code is built into
465the library.
Andy Green809d69a2016-01-14 11:37:56 +0800466
Andy Greenba119e92016-01-26 21:40:32 +08004678) New API
468
469LWS_VISIBLE struct lws *
470lws_adopt_socket(struct lws_context *context, lws_sockfd_type accept_fd)
471
472allows foreign sockets accepted by non-lws code to be adopted by lws as if they
473had just been accepted by lws' own listen socket.
Andy Green3df58002015-12-25 12:44:12 +0800474
Danomi Czaski4e9c7f32016-01-28 09:40:53 +08004759) X-Real-IP: header has been added as WSI_TOKEN_HTTP_X_REAL_IP
476
Andy Green86ed65f2016-02-14 09:27:41 +080047710) Libuv support is added, there are new related user apis
478
479typedef void (lws_uv_signal_cb_t)(uv_loop_t *l, uv_signal_t *w, int revents);
480
481LWS_VISIBLE LWS_EXTERN int
482lws_uv_sigint_cfg(struct lws_context *context, int use_uv_sigint,
483 lws_uv_signal_cb_t *cb);
484
485LWS_VISIBLE LWS_EXTERN int
486lws_uv_initloop(struct lws_context *context, uv_loop_t *loop, int tsi);
487
488LWS_VISIBLE void
489lws_uv_sigint_cb(uv_loop_t *loop, uv_signal_t *watcher, int revents);
490
491and CMAKE option
492
493LWS_WITH_LIBUV
494
Danomi Czaski4e9c7f32016-01-28 09:40:53 +0800495
Andy Green3246ebb2015-12-26 12:03:06 +0800496User api changes
497----------------
498
4991) LWS_SEND_BUFFER_POST_PADDING is now 0 and deprecated. You can remove it; if
500you still use it, obviously it does nothing. Old binary code with nonzero
501LWS_SEND_BUFFER_POST_PADDING is perfectly compatible, the old code just
Andy Green5b85e392015-12-26 13:23:11 +0800502allocated a buffer bigger than the library is going to use.
Andy Green3246ebb2015-12-26 12:03:06 +0800503
Andy Green5b85e392015-12-26 13:23:11 +0800504The example apps no longer use LWS_SEND_BUFFER_POST_PADDING.
Andy Green3246ebb2015-12-26 12:03:06 +0800505
Andy Green4e2ac762015-12-26 20:26:11 +0800506The only path who made use of it was sending with LWS_WRITE_CLOSE --->
Andy Green3246ebb2015-12-26 12:03:06 +0800507
Andy Green1fb95e82015-12-26 17:20:34 +08005082) Because of lws_close_reason() formalizing handling close frames,
509LWS_WRITE_CLOSE is removed from libwebsockets.h. It was only of use to send
510close frames...close frame content should be managed using lws_close_reason()
511now.
512
Andy Green44a7f652015-12-29 11:20:09 +08005133) We check for invalid CLOSE codes and complain about protocol violation in
514our close code. But it changes little since we were in the middle of closing
515anyway.
516
5174) zero-length RX frames and zero length TX frames are now allowed.
518
5195) Pings and close used to be limited to 124 bytes, the correct limit is 125
520so that is now also allowed.
Andy Green3246ebb2015-12-26 12:03:06 +0800521
Steffen Vogelf9267172016-02-09 07:19:15 +01005226) LWS_PRE is provided as a synonym for LWS_SEND_BUFFER_PRE_PADDING, either is
Andy Green67112662016-01-11 11:34:01 +0800523valid to use now.
524
5257) There's generic support for RFC7462 style extension options built into the
526library now. As a consequence, a field "options" is added to lws_extension.
527It can be NULL if there are no options on the extension. Extension internal
528info is part of the public abi because extensions may be implemented outside
529the library.
530
Danomi Czaski4e9c7f32016-01-28 09:40:53 +08005318) WSI_TOKEN_PROXY enum was accidentally defined to collide with another token
532of value 73. That's now corrected and WSI_TOKEN_PROXY moved to his own place at
53377.
534
Andy Green86ed65f2016-02-14 09:27:41 +08005359) With the addition of libuv support, libev is not the only event loop
536library in town and his api names must be elaborated with _ev_
537
538 Callback typedef: lws_signal_cb ---> lws_ev_signal_cb_t
539 lws_sigint_cfg --> lws_ev_sigint_cfg
540 lws_initloop --> lws_ev_initloop
541 lws_sigint_cb --> lws_ev_sigint_cb
542
54310) Libev support is made compatible with multithreaded service,
544lws_ev_initloop (was lws_initloop) gets an extra argument for the
545thread service index (use 0 if you will just have 1 service thread).
546
547LWS_VISIBLE LWS_EXTERN int
Andy Greenff696482016-02-17 07:46:27 +0800548lws_ev_initloop(struct lws_context *context, ev_loop_t *loop, int tsi);
Andy Green86ed65f2016-02-14 09:27:41 +0800549
Andy Green3df58002015-12-25 12:44:12 +0800550
Andy Green9e8d1482015-12-18 11:01:03 +0800551v1.6.0-chrome48-firefox42
552=======================
553
554Major API improvements
555----------------------
556
557v1.6.0 has many cleanups and improvements in the API. Although at first it
558looks pretty drastic, user code will only need four actions to update it.
559
560 - Do the three search/replaces in your user code, /libwebsocket_/lws_/,
561 /libwebsockets_/lws_/, and /struct\ libwebsocket/struct\ lws/
562
563 - Remove the context parameter from your user callbacks
564
565 - Remove context as the first parameter from the "Eleven APIS" listed in the
566 User Api Changes section
567
568 - Add lws_get_context(wsi) as the first parameter on the "Three APIS" listed
569 in the User Api Changes section, and anywhere else you still need context
570
571That's it... generally only a handful of the 14 affected APIs are actually in
572use in your user code and you can find them quickest by compiling and visiting
573the errors each in turn. And the end results are much cleaner, more
574predictable and maintainable.
575
576
Andy Green4e442b72015-12-10 07:58:58 +0800577User api additions
578------------------
579
Andy Green3f628702015-12-14 07:16:32 +08005801) lws now exposes his internal platform file abstraction in a way that can be
Andy Green4e442b72015-12-10 07:58:58 +0800581both used by user code to make it platform-agnostic, and be overridden or
582subclassed by user code. This allows things like handling the URI "directory
583space" as a virtual filesystem that may or may not be backed by a regular
584filesystem. One example use is serving files from inside large compressed
585archive storage without having to unpack anything except the file being
586requested.
587
588The test server shows how to use it, basically the platform-specific part of
589lws prepares a file operations structure that lives in the lws context.
590
Andy Green3f599962015-12-14 07:21:42 +0800591Helpers are provided to also leverage these platform-independent file handling
592apis
Andy Green4e442b72015-12-10 07:58:58 +0800593
594static inline lws_filefd_type
Andy Green3f599962015-12-14 07:21:42 +0800595lws_plat_file_open(struct lws *wsi, const char *filename,
Andy Green4e442b72015-12-10 07:58:58 +0800596 unsigned long *filelen, int flags)
Andy Green4e442b72015-12-10 07:58:58 +0800597static inline int
Andy Green3f599962015-12-14 07:21:42 +0800598lws_plat_file_close(struct lws *wsi, lws_filefd_type fd)
Andy Green4e442b72015-12-10 07:58:58 +0800599
600static inline unsigned long
Andy Green3f599962015-12-14 07:21:42 +0800601lws_plat_file_seek_cur(struct lws *wsi, lws_filefd_type fd, long offset)
Andy Green4e442b72015-12-10 07:58:58 +0800602
603static inline int
Andy Green3f599962015-12-14 07:21:42 +0800604lws_plat_file_read(struct lws *wsi, lws_filefd_type fd, unsigned long *amount,
605 unsigned char *buf, unsigned long len)
Andy Green4e442b72015-12-10 07:58:58 +0800606
607static inline int
Andy Green3f599962015-12-14 07:21:42 +0800608lws_plat_file_write(struct lws *wsi, lws_filefd_type fd, unsigned long *amount,
609 unsigned char *buf, unsigned long len)
Andy Green4e442b72015-12-10 07:58:58 +0800610
611The user code can also override or subclass the file operations, to either
612wrap or replace them. An example is shown in test server.
613
Andy Green3f599962015-12-14 07:21:42 +0800614A wsi can be associated with the file activity, allowing per-connection
615authentication and state to be used when interpreting the file request.
616
Andy Green3f628702015-12-14 07:16:32 +08006172) A new API void * lws_wsi_user(struct lws *wsi) lets you get the pointer to
618the user data associated with the wsi, just from the wsi.
619
Andy Green9e8d1482015-12-18 11:01:03 +08006203) URI argument handling. Libwebsockets parses and protects URI arguments
621like test.html?arg1=1&arg2=2, it decodes %xx uriencoding format and reduces
622path attacks like ../.../../etc/passwd so they cannot go behind the web
623server's /. There is a list of confirmed attacks we're proof against in
624./test-server/attack.sh.
625
626There is a new API lws_hdr_copy_fragment that should be used now to access
627the URI arguments (it returns the fragments length)
628
629 while (lws_hdr_copy_fragment(wsi, buf, sizeof(buf),
630 WSI_TOKEN_HTTP_URI_ARGS, n) > 0) {
631 lwsl_info("URI Arg %d: %s\n", ++n, buf);
632 }
633
634For the example above, calling with n=0 will return "arg1=1" and n=1 "arg2=2".
635All legal uriencodings will have been reduced in those strings.
636
637lws_hdr_copy_fragment() returns the length of the x=y fragment, so it's also
638possible to deal with arguments containing %00. If you don't care about that,
639the returned string has '\0' appended to simplify processing.
640
Andy Green4e442b72015-12-10 07:58:58 +0800641
Andy Green6d417202015-12-04 10:39:23 +0800642User api changes
643----------------
644
Andy Green1a366bf2015-12-14 07:02:51 +08006451) Three APIS
646
647 - lws_callback_on_writable_all_protocol(const struct lws_protocols *protocol)
648 - lws_callback_all_protocol(const struct lws_protocols *protocol)
649 - lws_rx_flow_allow_all_protocol(lws_rx_flow_allow_all_protocol)
650
651Now take an additional pointer to the lws_context in their first argument.
652
653The reason for this change is struct lws_protocols has been changed to remove
654members that lws used for private storage: so the protocols struct in now
655truly const and may be reused serially or simultaneously by different contexts.
656
Andy Green11c05bf2015-12-16 18:19:08 +08006572) Eleven APIs
658
659LWS_VISIBLE LWS_EXTERN int
660lws_add_http_header_by_name(struct lws_context *context,
661 struct lws *wsi,
662 const unsigned char *name,
663 const unsigned char *value,
664 int length,
665 unsigned char **p,
666 unsigned char *end);
667LWS_VISIBLE LWS_EXTERN int
668lws_finalize_http_header(struct lws_context *context,
669 struct lws *wsi,
670 unsigned char **p,
671 unsigned char *end);
672LWS_VISIBLE LWS_EXTERN int
673lws_add_http_header_by_token(struct lws_context *context,
674 struct lws *wsi,
675 enum lws_token_indexes token,
676 const unsigned char *value,
677 int length,
678 unsigned char **p,
679 unsigned char *end);
680LWS_VISIBLE LWS_EXTERN int
681lws_add_http_header_content_length(struct lws_context *context,
682 struct lws *wsi,
683 unsigned long content_length,
684 unsigned char **p,
685 unsigned char *end);
686LWS_VISIBLE LWS_EXTERN int
687lws_add_http_header_status(struct lws_context *context, struct lws *wsi,
688 unsigned int code, unsigned char **p,
689 unsigned char *end);
690
691LWS_VISIBLE LWS_EXTERN int
692lws_serve_http_file(struct lws_context *context, struct lws *wsi,
693 const char *file, const char *content_type,
694 const char *other_headers, int other_headers_len);
695LWS_VISIBLE LWS_EXTERN int
696lws_serve_http_file_fragment(struct lws_context *context, struct lws *wsi);
697
698LWS_VISIBLE LWS_EXTERN int
699lws_return_http_status(struct lws_context *context, struct lws *wsi,
700 unsigned int code, const char *html_body);
701
702LWS_VISIBLE LWS_EXTERN int
703lws_callback_on_writable(const struct lws_context *context, struct lws *wsi);
704
705LWS_VISIBLE LWS_EXTERN void
706lws_get_peer_addresses(struct lws_context *context, struct lws *wsi,
707 lws_sockfd_type fd, char *name, int name_len,
708 char *rip, int rip_len);
709
710LWS_VISIBLE LWS_EXTERN int
711lws_read(struct lws_context *context, struct lws *wsi,
712 unsigned char *buf, size_t len);
713
714no longer require their initial struct lws_context * parameter.
715
7163) Several older apis start with libwebsocket_ or libwebsockets_ while newer ones
Andy Green6d417202015-12-04 10:39:23 +0800717all begin lws_. These apis have been changed to all begin with lws_.
718
Andy Green11c05bf2015-12-16 18:19:08 +0800719To convert, search-replace
Andy Green6d417202015-12-04 10:39:23 +0800720
Andy Green11c05bf2015-12-16 18:19:08 +0800721 - libwebsockets_/lws_
722 - libwebsocket_/lws_
723 - struct\ libwebsocket/struct\ lws
Andy Green00c6d152015-12-17 07:54:44 +0800724
7254) context parameter removed from user callback.
726
727Since almost all apis no longer need the context as a parameter, it's no longer
728provided at the user callback directly.
729
730However if you need it, for ALL callbacks wsi is valid and has a valid context
Andy Green6d645392015-12-17 18:25:25 +0800731pointer you can recover using lws_get_context(wsi).
Andy Green6d417202015-12-04 10:39:23 +0800732
733
Andy Greenab620ff2015-10-28 08:39:09 +0800734v1.5-chrome47-firefox41
735=======================
MGadkari020c53c2015-08-21 16:15:36 +0530736
737User api changes
738----------------
739
740LWS_CALLBACK_CLIENT_CONNECTION_ERROR may provide an error string if in is
741non-NULL. If so, the string has length len.
742
Andy Green6d59f592015-10-15 09:12:58 +0800743LWS_SERVER_OPTION_PEER_CERT_NOT_REQUIRED is available to relax the requirement
744for peer certs if you are using the option to require client certs.
745
Andy Green4c79ee72015-10-15 11:20:40 +0800746LWS_WITHOUT_BUILTIN_SHA1 cmake option forces lws to use SHA1() defined
747externally, eg, byOpenSSL, and disables build of libwebsockets_SHA1()
748
749
Andy Green16fb0132015-03-28 11:35:40 +0800750v1.4-chrome43-firefox36
751=======================
Olehfaeac3c2014-07-29 23:18:41 +0800752
753User api additions
754------------------
755
756There's a new member in the info struct used to control context creation,
757ssl_private_key_password, which allows passing into lws the passphrase on
758an SSL cetificate
759
Andy Greeneabed8d2014-08-11 12:11:36 +0800760There's a new member in struct protocols, id, which is ignored by lws but can
761be used by the user code to mark the selected protocol by user-defined version
762or capabliity flag information, for the case multiple versions of a protocol are
763supported.
764
Andy Greenb128ccc2014-08-16 09:54:27 +0800765int lws_is_ssl(wsi) added to allow user code to know if the connection was made
766over ssl or not. If LWS_SERVER_OPTION_ALLOW_NON_SSL_ON_SSL_PORT is used, both
767ssl and non-ssl connections are possible and may need to be treated differently
768in the user code.
769
Andy Green14425ea2014-08-18 22:49:39 +0800770int lws_partial_buffered(wsi) added... should be checked after any
771libwebsocket_write that will be followed by another libwebsocket_write inside
772the same writeable callback. If set, you can't do any more writes until the
773writeable callback is called again. If you only do one write per writeable callback,
774you can ignore this.
775
Andy Green917f43a2014-10-12 14:31:47 +0800776HTTP2-related: HTTP2 changes how headers are handled, lws now has new version-
777agnositic header creation APIs. These do the right thing depending on each
778connection's HTTP version without the user code having to know or care, except
779to make sure to use the new APIs for headers (test-server is updated to use
780them already, so look there for examples)
781
782The APIs "render" the headers into a user-provided buffer and bump *p as it
783is used. If *p reaches end, then the APIs return nonzero for error.
784
785LWS_VISIBLE LWS_EXTERN int
786lws_add_http_header_status(struct libwebsocket_context *context,
787 struct libwebsocket *wsi,
788 unsigned int code,
789 unsigned char **p,
790 unsigned char *end);
791
792Start a response header reporting status like 200, 500, etc
793
794LWS_VISIBLE LWS_EXTERN int
795lws_add_http_header_by_name(struct libwebsocket_context *context,
796 struct libwebsocket *wsi,
797 const unsigned char *name,
798 const unsigned char *value,
799 int length,
800 unsigned char **p,
801 unsigned char *end);
802
803Add a header like name: value in HTTP1.x
804
805LWS_VISIBLE LWS_EXTERN int
806lws_finalize_http_header(struct libwebsocket_context *context,
807 struct libwebsocket *wsi,
808 unsigned char **p,
809 unsigned char *end);
810
811Finish off the headers, like add the extra \r\n in HTTP1.x
812
813LWS_VISIBLE LWS_EXTERN int
814lws_add_http_header_by_token(struct libwebsocket_context *context,
815 struct libwebsocket *wsi,
816 enum lws_token_indexes token,
817 const unsigned char *value,
818 int length,
819 unsigned char **p,
820 unsigned char *end);
821
822Add a header by using a lws token as the name part. In HTTP2, this can be
823compressed to one or two bytes.
824
Olehfaeac3c2014-07-29 23:18:41 +0800825
Andy Green822241c2014-08-18 22:21:51 +0800826User api removal
827----------------
828
829protocols struct member no_buffer_all_partial_tx is removed. Under some
Peter Pentchevbb085da2015-12-03 15:55:11 +0200830conditions like rewriting extension such as compression in use, the built-in
Andy Green822241c2014-08-18 22:21:51 +0800831partial send buffering is the only way to deal with the problem, so turning
832it off is deprecated.
833
834
Andy Green917f43a2014-10-12 14:31:47 +0800835User api changes
836----------------
837
838HTTP2-related: API libwebsockets_serve_http_file() takes an extra parameter at
839the end now
840
841int other_headers_len)
842
843If you are providing other headers, they must be generated using the new
844HTTP-version-agnostic APIs, and you must provide the length of them using this
845additional parameter.
846
joseph.urciuoli4d9c8fc2014-10-16 08:53:19 +0800847struct lws_context_creation_info now has an additional member
848SSL_CTX *provided_client_ssl_ctx you may set to an externally-initialized
849SSL_CTX managed outside lws. Defaulting to zero keeps the existing behaviour of
850lws managing the context, if you memset the struct to 0 or have as a filescope
851initialized struct in bss, no need to change anything.
852
Andy Green822241c2014-08-18 22:21:51 +0800853
Andy Greenc1fdd102014-07-06 09:56:11 +0800854v1.3-chrome37-firefox30
855=======================
856
857 .gitignore | 1 -
858 CMakeLists.txt | 447 +++--
859 README.build | 35 +-
860 README.coding | 14 +
861 changelog | 66 +
862 cmake/LibwebsocketsConfig.cmake.in | 17 +
863 cmake/LibwebsocketsConfigVersion.cmake.in | 11 +
864 config.h.cmake | 18 +
865 cross-ming.cmake | 31 +
866 cross-openwrt-makefile | 91 +
867 lib/client-handshake.c | 205 ++-
868 lib/client-parser.c | 58 +-
869 lib/client.c | 158 +-
870 lib/context.c | 341 ++++
871 lib/extension-deflate-frame.c | 2 +-
872 lib/extension.c | 178 ++
873 lib/handshake.c | 287 +---
874 lib/lextable.h | 338 ++++
875 lib/libev.c | 175 ++
876 lib/libwebsockets.c | 2089 +++--------------------
877 lib/libwebsockets.h | 253 ++-
878 lib/lws-plat-unix.c | 404 +++++
879 lib/lws-plat-win.c | 358 ++++
880 lib/minilex.c | 530 +++---
881 lib/output.c | 445 ++---
882 lib/parsers.c | 682 ++++----
883 lib/pollfd.c | 239 +++
884 lib/private-libwebsockets.h | 501 +++++-
885 lib/server-handshake.c | 274 +--
886 lib/server.c | 858 ++++++++--
887 lib/service.c | 517 ++++++
888 lib/sha-1.c | 38 +-
889 lib/ssl-http2.c | 78 +
890 lib/ssl.c | 571 +++++++
891 test-server/attack.sh | 101 +-
892 test-server/test-client.c | 9 +-
893 test-server/test-echo.c | 17 +-
894 test-server/test-fraggle.c | 7 -
895 test-server/test-ping.c | 12 +-
896 test-server/test-server.c | 330 ++--
897 test-server/test.html | 4 +-
898 win32port/client/client.vcxproj | 259 ---
899 win32port/client/client.vcxproj.filters | 39 -
900 .../libwebsocketswin32.vcxproj.filters | 93 -
901 win32port/server/server.vcxproj | 276 ---
902 win32port/server/server.vcxproj.filters | 51 -
903 win32port/win32helpers/gettimeofday.h | 59 +-
904 win32port/win32helpers/netdb.h | 1 -
905 win32port/win32helpers/strings.h | 0
906 win32port/win32helpers/sys/time.h | 1 -
907 win32port/win32helpers/unistd.h | 0
908 win32port/win32helpers/websock-w32.c | 104 --
909 win32port/win32helpers/websock-w32.h | 62 -
910 win32port/win32port.sln | 100 --
911 win32port/zlib/gzio.c | 3 +-
912 55 files changed, 6779 insertions(+), 5059 deletions(-)
913
Andy Green79002562013-11-09 11:04:35 +0800914
kapejodce64fb02013-11-19 13:38:16 +0100915User api additions
916------------------
917
918POST method is supported
919
920The protocol 0 / HTTP callback can now get two new kinds of callback,
921LWS_CALLBACK_HTTP_BODY (in and len are a chunk of the body of the HTTP request)
922and LWS_CALLBACK_HTTP_BODY_COMPLETION (the expected amount of body has arrived
923and been passed to the user code already). These callbacks are used with the
924post method (see the test server for details).
925
926The period between the HTTP header completion and the completion of the body
927processing is protected by a 5s timeout.
928
929The chunks are stored in a malloc'd buffer of size protocols[0].rx_buffer_size.
930
931
James Devine5b34c972013-12-14 11:41:29 +0800932New server option you can enable from user code
933LWS_SERVER_OPTION_ALLOW_NON_SSL_ON_SSL_PORT allows non-SSL connections to
934also be accepted on an SSL listening port. It's disabled unless you enable
935it explicitly.
936
937
Andy Green7a132792013-12-18 09:48:26 +0800938Two new callbacks are added in protocols[0] that are optional for allowing
939limited thread access to libwebsockets, LWS_CALLBACK_LOCK_POLL and
940LWS_CALLBACK_UNLOCK_POLL.
941
942If you use them, they protect internal and external poll list changes, but if
943you want to use external thread access to libwebsocket_callback_on_writable()
944you have to implement your locking here even if you don't use external
945poll support.
946
947If you will use another thread for this, take a lot of care about managing
948your list of live wsi by doing it from ESTABLISHED and CLOSED callbacks
949(with your own locking).
950
Andrew Canaday9769f4f2014-03-23 13:25:07 +0800951If you configure cmake with -DLWS_WITH_LIBEV=1 then the code allowing the libev
952eventloop instead of the default poll() one will also be compiled in. But to
953use it, you must also set the LWS_SERVER_OPTION_LIBEV flag on the context
954creation info struct options member.
Andy Green7a132792013-12-18 09:48:26 +0800955
Andy Greenc1fdd102014-07-06 09:56:11 +0800956IPV6 is supported and enabled by default except for Windows, you can disable
957the support at build-time by giving -DLWS_IPV6=, and disable use of it even if
James Devine3f13ea22014-03-24 16:09:25 +0800958compiled in by making sure the flag LWS_SERVER_OPTION_DISABLE_IPV6 is set on
959the context creation info struct options member.
960
Andy Greenc1fdd102014-07-06 09:56:11 +0800961You can give LWS_SERVER_OPTION_DISABLE_OS_CA_CERTS option flag to
962guarantee the OS CAs will not be used, even if that support was selected at
963build-time.
964
965Optional "token limits" may be enforced by setting the member "token_limits"
966in struct lws_context_creation_info to point to a struct lws_token_limits.
967NULL means no token limits used for compatibility.
968
Andy Green7a132792013-12-18 09:48:26 +0800969
Andy Green79002562013-11-09 11:04:35 +0800970User api changes
971----------------
972
973Extra optional argument to libwebsockets_serve_http_file() allows injecion
974of HTTP headers into the canned response. Eg, cookies may be added like
975that without getting involved in having to send the header by hand.
976
Patrick Gansterer148b9452014-02-28 02:31:23 +0100977A new info member http_proxy_address may be used at context creation time to
978set the http proxy. If non-NULL, it overrides http_proxy environment var.
Andy Green79002562013-11-09 11:04:35 +0800979
Andy Greend2ec7ad2014-03-15 10:39:29 +0800980Cmake supports LWS_SSL_CLIENT_USE_OS_CA_CERTS defaulting to on, which gets
981the client to use the OS CA Roots. If you're worried somebody with the
982ability to forge for force creation of a client cert from the root CA in
983your OS, you should disable this since your selfsigned $0 cert is a lot safer
984then...
985
Andy Green79002562013-11-09 11:04:35 +0800986
Andy Green81877e62013-10-26 20:36:08 +0800987v1.23-chrome32-firefox24
988========================
989
990 Android.mk | 29 +
991 CMakeLists.txt | 573 ++++++++----
992 COPYING | 503 -----------
993 INSTALL | 365 --------
994 Makefile.am | 13 -
995 README.build | 371 ++------
996 README.coding | 63 ++
997 autogen.sh | 1578 ---------------------------------
998 changelog | 69 ++
999 cmake/FindGit.cmake | 163 ++++
1000 cmake/FindOpenSSLbins.cmake | 15 +-
1001 cmake/UseRPMTools.cmake | 176 ++++
1002 config.h.cmake | 25 +-
1003 configure.ac | 226 -----
1004 cross-arm-linux-gnueabihf.cmake | 28 +
1005 lib/Makefile.am | 89 --
1006 lib/base64-decode.c | 98 +-
1007 lib/client-handshake.c | 123 ++-
1008 lib/client-parser.c | 19 +-
1009 lib/client.c | 145 ++-
1010 lib/daemonize.c | 4 +-
1011 lib/extension.c | 2 +-
1012 lib/getifaddrs.h | 4 +-
1013 lib/handshake.c | 76 +-
1014 lib/libwebsockets.c | 491 ++++++----
1015 lib/libwebsockets.h | 164 ++--
1016 lib/output.c | 214 ++++-
1017 lib/parsers.c | 102 +--
1018 lib/private-libwebsockets.h | 66 +-
1019 lib/server-handshake.c | 5 +-
1020 lib/server.c | 29 +-
1021 lib/sha-1.c | 2 +-
1022 libwebsockets-api-doc.html | 249 +++---
1023 libwebsockets.pc.in | 11 -
1024 libwebsockets.spec | 14 +-
1025 m4/ignore-me | 2 -
1026 scripts/FindLibWebSockets.cmake | 33 +
1027 scripts/kernel-doc | 1 +
1028 test-server/Makefile.am | 131 ---
1029 test-server/leaf.jpg | Bin 0 -> 2477518 bytes
1030 test-server/test-client.c | 78 +-
1031 test-server/test-echo.c | 33 +-
1032 test-server/test-fraggle.c | 26 +-
1033 test-server/test-ping.c | 15 +-
1034 test-server/test-server.c | 197 +++-
1035 test-server/test.html | 5 +-
1036 win32port/win32helpers/gettimeofday.c | 74 +-
1037 win32port/win32helpers/websock-w32.h | 6 +-
1038 48 files changed, 2493 insertions(+), 4212 deletions(-)
1039
Andy Green54cb3462013-02-14 22:23:54 +08001040
1041User api additions
1042------------------
1043
1044 - You can now call libwebsocket_callback_on_writable() on http connectons,
1045 and get a LWS_CALLBACK_HTTP_WRITEABLE callback, the same way you can
1046 regulate writes with a websocket protocol connection.
1047
Andy Green2672fb22013-02-22 09:54:35 +08001048 - A new member in the context creation parameter struct "ssl_cipher_list" is
1049 added, replacing CIPHERS_LIST_STRING. NULL means use the ssl library
1050 default list of ciphers.
1051
Andy Green58f214e2013-03-09 13:03:53 +08001052 - Not really an api addition, but libwebsocket_service_fd() will now zero
1053 the revents field of the pollfd it was called with if it handled the
1054 descriptor. So you can tell if it is a non-lws fd by checking revents
1055 after the service call... if it's still nonzero, the descriptor
1056 belongs to you and you need to take care of it.
1057
Andy Greenb55451c2013-03-16 12:32:27 +08001058 - libwebsocket_rx_flow_allow_all_protocol(protocol) will unthrottle all
1059 connections with the established protocol. It's designed to be
1060 called from user server code when it sees it can accept more input
1061 and may have throttled connections using the server rx flow apis
1062 while it was unable to accept any other input The user server code
1063 then does not have to try to track while connections it choked, this
1064 will free up all of them in one call.
1065
Andy Green0c9563b2013-06-10 22:54:40 +08001066 - there's a new, optional callback LWS_CALLBACK_CLOSED_HTTP which gets
1067 called when an HTTP protocol socket closes
1068
Andy Green96d48fd2013-09-18 08:32:55 +08001069 - for LWS_CALLBACK_FILTER_PROTOCOL_CONNECTION callback, the user_space alloc
1070 has already been done before the callback happens. That means we can
1071 use the user parameter to the callback to contain the user pointer, and
1072 move the protocol name to the "in" parameter. The docs for this
1073 callback are also updated to reflect how to check headers in there.
1074
Andy Green5dc62ea2013-09-20 20:26:12 +08001075 - libwebsocket_client_connect() is now properly nonblocking and async. See
1076 README.coding and test-client.c for information on the callbacks you
1077 can rely on controlling the async connection period with.
1078
Andy Green81877e62013-10-26 20:36:08 +08001079 - if your OS does not support the http_proxy environment variable convention
1080 (eg, reportedly OSX), you can use a new api libwebsocket_set_proxy()
Peter Pentchevbb085da2015-12-03 15:55:11 +02001081 to set the proxy details in between context creation and the connection
Andy Green81877e62013-10-26 20:36:08 +08001082 action. For OSes that support http_proxy, that's used automatically.
Andy Greenb55451c2013-03-16 12:32:27 +08001083
Andy Green50097dd2013-02-15 22:36:30 +08001084User api changes
1085----------------
1086
1087 - the external poll callbacks now get the socket descriptor coming from the
1088 "in" parameter. The user parameter provides the user_space for the
1089 wsi as it normally does on the other callbacks.
Edwin van den Oetelaar8c8a8e12013-02-20 20:56:59 +08001090 LWS_CALLBACK_FILTER_NETWORK_CONNECTION also has the socket descriptor
1091 delivered by @in now instead of @user.
Andy Green50097dd2013-02-15 22:36:30 +08001092
Andy Greenfc7c5e42013-02-23 10:50:10 +08001093 - libwebsocket_write() now returns -1 for error, or the amount of data
1094 actually accepted for send. Under load, the OS may signal it is
1095 ready to send new data on the socket, but have only a restricted
1096 amount of memory to buffer the packet compared to usual.
1097
Andy Green50097dd2013-02-15 22:36:30 +08001098
Andy Greendc914cf2013-02-18 16:54:26 +08001099User api removal
1100----------------
1101
1102 - libwebsocket_ensure_user_space() is removed from the public api, if you
1103 were using it to get user_space, you need to adapt your code to only
1104 use user_space inside the user callback.
1105
Andy Green2672fb22013-02-22 09:54:35 +08001106 - CIPHERS_LIST_STRING is removed
1107
Andy Green0097a992013-03-09 13:06:37 +08001108 - autotools build has been removed. See README.build for info on how to
1109 use CMake for your platform
1110
Andy Green54cb3462013-02-14 22:23:54 +08001111
Andy Green53a46782013-02-14 11:23:49 +08001112v1.21-chrome26-firefox18
1113========================
1114
1115 - Fixes buffer overflow bug in max frame size handling if you used the
1116 default protocol buffer size. If you declared rx_buffer_size in your
1117 protocol, which is recommended anyway, your code was unaffected.
1118
Andy Green182cb9a2013-02-13 11:54:08 +08001119v1.2-chrome26-firefox18
1120=======================
1121
1122Diffstat
1123--------
1124
1125 .gitignore | 16 +++
1126 CMakeLists.txt | 544 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
1127 LICENSE | 526 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
1128 Makefile.am | 1 +
1129 README | 20 +++
1130 README.build | 258 ++++++++++++++++++++++++++++++++-----
1131 README.coding | 52 ++++++++
1132 changelog | 136 ++++++++++++++++++++
1133 cmake/FindOpenSSLbins.cmake | 33 +++++
1134 config.h.cmake | 173 +++++++++++++++++++++++++
1135 configure.ac | 22 +++-
1136 lib/Makefile.am | 20 ++-
1137 lib/base64-decode.c | 2 +-
1138 lib/client-handshake.c | 190 +++++++++++-----------------
1139 lib/client-parser.c | 88 +++++++------
1140 lib/client.c | 384 ++++++++++++++++++++++++++++++-------------------------
1141 lib/daemonize.c | 32 +++--
1142 lib/extension-deflate-frame.c | 58 +++++----
1143 lib/extension-deflate-stream.c | 19 ++-
1144 lib/extension-deflate-stream.h | 4 +-
1145 lib/extension.c | 11 +-
1146 lib/getifaddrs.c | 315 +++++++++++++++++++++++-----------------------
1147 lib/getifaddrs.h | 30 ++---
1148 lib/handshake.c | 124 +++++++++++-------
1149 lib/libwebsockets.c | 736 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++--------------------------------------
1150 lib/libwebsockets.h | 237 ++++++++++++++++++++++------------
1151 lib/output.c | 192 +++++++++++-----------------
1152 lib/parsers.c | 966 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++----------------------------------------------------------------
1153 lib/private-libwebsockets.h | 225 +++++++++++++++++++++------------
1154 lib/server-handshake.c | 82 ++++++------
1155 lib/server.c | 96 +++++++-------
1156 libwebsockets-api-doc.html | 189 ++++++++++++++++++----------
1157 libwebsockets.spec | 17 +--
1158 test-server/attack.sh | 148 ++++++++++++++++++++++
1159 test-server/test-client.c | 125 +++++++++---------
1160 test-server/test-echo.c | 31 +++--
1161 test-server/test-fraggle.c | 32 ++---
1162 test-server/test-ping.c | 52 ++++----
1163 test-server/test-server.c | 129 ++++++++++++-------
1164 win32port/libwebsocketswin32/libwebsocketswin32.vcxproj | 279 ----------------------------------------
1165 win32port/libwebsocketswin32/libwebsocketswin32.vcxproj.filters | 23 +++-
1166 41 files changed, 4398 insertions(+), 2219 deletions(-)
1167
Andy Green7b405452013-02-01 10:50:15 +08001168
1169User api additions
1170------------------
1171
1172 - lws_get_library_version() returns a const char * with a string like
1173 "1.1 9e7f737", representing the library version from configure.ac
1174 and the git HEAD hash the library was built from
1175
Andy Greena47865f2013-02-10 09:39:47 +08001176 - TCP Keepalive can now optionally be applied to all lws sockets, on Linux
1177 also with controllable timeout, number of probes and probe interval.
1178 (On BSD type OS, you can only use system default settings for the
1179 timing and retries, although enabling it is supported by setting
1180 ka_time to nonzero, the exact value has no meaning.)
1181 This enables detection of idle connections which are logically okay,
1182 but are in fact dead, due to network connectivity issues at the server,
Andy Greena690cd02013-02-09 12:25:31 +08001183 client, or any intermediary. By default it's not enabled, but you
1184 can enable it by setting a non-zero timeout (in seconds) at the new
1185 ka_time member at context creation time.
1186
Andy Greena7109e62013-02-11 12:05:54 +08001187 - Two new optional user callbacks added, LWS_CALLBACK_PROTOCOL_DESTROY which
1188 is called one-time per protocol as the context is being destroyed, and
1189 LWS_CALLBACK_PROTOCOL_INIT which is called when the context is created
1190 and the protocols are added, again it's a one-time affair.
1191 This lets you manage per-protocol allocations properly including
1192 cleaning up after yourself when the server goes down.
Andy Green7b405452013-02-01 10:50:15 +08001193
Andy Greened334462013-02-07 21:14:33 +08001194User api changes
1195----------------
1196
Andy Green1b265272013-02-09 14:01:09 +08001197 - libwebsocket_create_context() has changed from taking a ton of parameters
1198 to just taking a pointer to a struct containing the parameters. The
1199 struct lws_context_creation_info is in libwebsockets.h, the members
1200 are in the same order as when they were parameters to the call
1201 previously. The test apps are all updated accordingly so you can
1202 see example code there.
1203
Andy Greened334462013-02-07 21:14:33 +08001204 - Header tokens are now deleted after the websocket connection is
Andy Green54495112013-02-06 21:10:16 +09001205 established. Not just the header data is saved, but the pointer and
1206 length array is also removed from (union) scope saving several hundred
1207 bytes per connection once it is established
1208
1209 - struct libwebsocket_protocols has a new member rx_buffer_size, this
1210 controls rx buffer size per connection of that protocol now. Sources
1211 for apps built against older versions of the library won't declare
1212 this in their protocols, defaulting it to 0. Zero buffer is legal,
1213 it causes a default buffer to be allocated (currently 4096)
1214
1215 If you want to receive only atomic frames in your user callback, you
1216 should set this to greater than your largest frame size. If a frame
1217 comes that exceeds that, no error occurs but the callback happens as
1218 soon as the buffer limit is reached, and again if it is reached again
1219 or the frame completes. You can detect that has happened by seeing
1220 there is still frame content pending using
1221 libwebsockets_remaining_packet_payload()
1222
1223 By correctly setting this, you can save a lot of memory when your
1224 protocol has small frames (see the test server and client sources).
1225
Andy Green16ab3182013-02-10 18:02:31 +08001226 - LWS_MAX_HEADER_LEN now defaults to 1024 and is the total amount of known
1227 header payload lws can cope with, that includes the GET URL, origin
1228 etc. Headers not understood by lws are ignored and their payload
1229 not included in this.
1230
Andy Green54495112013-02-06 21:10:16 +09001231
1232User api removals
1233-----------------
1234
Andy Green16ab3182013-02-10 18:02:31 +08001235 - The configuration-time option MAX_USER_RX_BUFFER has been replaced by a
1236 buffer size chosen per-protocol. For compatibility, there's a default
1237 of 4096 rx buffer, but user code should set the appropriate size for
1238 the protocol frames.
1239
1240 - LWS_INITIAL_HDR_ALLOC and LWS_ADDITIONAL_HDR_ALLOC are no longer needed
1241 and have been removed. There's a new header management scheme that
1242 handles them in a much more compact way.
Andy Greened334462013-02-07 21:14:33 +08001243
Andy Green70edd6f2013-02-12 10:15:25 +08001244 - libwebsockets_hangup_on_client() is removed. If you want to close the
1245 connection you must do so from the user callback and by returning
1246 -1 from there.
1247
Andy Green508946c2013-02-12 10:19:08 +08001248 - libwebsocket_close_and_free_session() is now private to the library code
1249 only and not exposed for user code. If you want to close the
1250 connection, you must do so from the user callback by returning -1
1251 from there.
1252
Andy Greened334462013-02-07 21:14:33 +08001253
Andy Greendf60b0c2013-02-06 19:57:12 +09001254New features
1255------------
1256
Andy Green9b09dc02013-02-08 12:48:36 +08001257 - Cmake project file added, aimed initially at Windows support: this replaces
Andy Green16ab3182013-02-10 18:02:31 +08001258 the visual studio project files that were in the tree until now.
Andy Greendf60b0c2013-02-06 19:57:12 +09001259
Andy Greenc3ef0d62013-02-12 10:50:49 +08001260 - CyaSSL now supported in place of OpenSSL (--use-cyassl on configure)
1261
Andy Green9b09dc02013-02-08 12:48:36 +08001262 - PATH_MAX or MAX_PATH no longer needed
Andy Greendf60b0c2013-02-06 19:57:12 +09001263
Andy Green54495112013-02-06 21:10:16 +09001264 - cutomizable frame rx buffer size by protocol
1265
Andy Greenc3ef0d62013-02-12 10:50:49 +08001266 - optional TCP keepalive so dead peers can be detected, can be enabled at
1267 context-creation time
1268
1269 - valgrind-clean: no SSL or CyaSSL: completely clean. With OpenSSL, 88 bytes
1270 lost at OpenSSL library init and symptomless reports of uninitialized
1271 memory usage... seems to be a known and ignored problem at OpenSSL
1272
Andy Greena3957ef2013-02-11 09:31:43 +08001273 - By default debug is enabled and the library is built for -O0 -g to faclitate
1274 that. Use --disable-debug configure option to build instead with -O4
1275 and no -g (debug info), obviously providing best performance and
1276 reduced binary size.
Andy Green7b405452013-02-01 10:50:15 +08001277
Andy Green895d56d2013-02-11 09:32:53 +08001278 - 1.0 introduced some code to try to not deflate small frames, however this
1279 seems to break when confronted with a mixture of frames above and
1280 below the threshold, so it's removed. Veto the compression extension
1281 in your user callback if you will typically have very small frames.
1282
Andy Green16ab3182013-02-10 18:02:31 +08001283 - There are many memory usage improvements, both a reduction in malloc/
1284 realloc and architectural changes. A websocket connection now
1285 consumes only 296 bytes with SSL or 272 bytes without on x86_64,
1286 during header processing an additional 1262 bytes is allocated in a
1287 single malloc, but is freed when the websocket connection starts.
1288 The RX frame buffer defined by the protocol in user
1289 code is also allocated per connection, this represents the largest
1290 frame you can receive atomically in that protocol.
1291
Andy Greenc3ef0d62013-02-12 10:50:49 +08001292 - On ARM9 build, just http+ws server no extensions or ssl, <12Kbytes .text
1293 and 112 bytes per connection (+1328 only during header processing)
1294
Andy Green895d56d2013-02-11 09:32:53 +08001295
Andy Greenbd1132f2013-01-31 19:53:05 +08001296v1.1-chrome26-firefox18
Andy Greena35c86f2013-01-31 10:16:44 +08001297=======================
1298
1299Diffstat
1300--------
1301
1302 Makefile.am | 4 +
1303 README-test-server | 291 ---
1304 README.build | 239 ++
1305 README.coding | 138 ++
1306 README.rst | 72 -
1307 README.test-apps | 272 +++
1308 configure.ac | 116 +-
1309 lib/Makefile.am | 55 +-
1310 lib/base64-decode.c | 5 +-
1311 lib/client-handshake.c | 121 +-
1312 lib/client-parser.c | 394 ++++
1313 lib/client.c | 807 +++++++
1314 lib/daemonize.c | 212 ++
1315 lib/extension-deflate-frame.c | 132 +-
1316 lib/extension-deflate-stream.c | 12 +-
1317 lib/extension-x-google-mux.c | 1223 ----------
1318 lib/extension-x-google-mux.h | 96 -
1319 lib/extension.c | 8 -
1320 lib/getifaddrs.c | 271 +++
1321 lib/getifaddrs.h | 76 +
1322 lib/handshake.c | 582 +----
1323 lib/libwebsockets.c | 2493 ++++++---------------
1324 lib/libwebsockets.h | 115 +-
1325 lib/md5.c | 217 --
1326 lib/minilex.c | 440 ++++
1327 lib/output.c | 628 ++++++
1328 lib/parsers.c | 2016 +++++------------
1329 lib/private-libwebsockets.h | 284 +--
1330 lib/server-handshake.c | 275 +++
1331 lib/server.c | 377 ++++
1332 libwebsockets-api-doc.html | 300 +--
1333 m4/ignore-me | 2 +
1334 test-server/Makefile.am | 111 +-
1335 test-server/libwebsockets.org-logo.png | Bin 0 -> 7029 bytes
1336 test-server/test-client.c | 45 +-
1337 test-server/test-echo.c | 330 +++
1338 test-server/test-fraggle.c | 20 +-
1339 test-server/test-ping.c | 22 +-
1340 test-server/test-server-extpoll.c | 554 -----
1341 test-server/test-server.c | 349 ++-
1342 test-server/test.html | 3 +-
1343 win32port/zlib/ZLib.vcxproj | 749 ++++---
1344 win32port/zlib/ZLib.vcxproj.filters | 188 +-
1345 win32port/zlib/adler32.c | 348 ++-
1346 win32port/zlib/compress.c | 160 +-
1347 win32port/zlib/crc32.c | 867 ++++----
1348 win32port/zlib/crc32.h | 882 ++++----
1349 win32port/zlib/deflate.c | 3799 +++++++++++++++-----------------
1350 win32port/zlib/deflate.h | 688 +++---
1351 win32port/zlib/gzclose.c | 50 +-
1352 win32port/zlib/gzguts.h | 325 ++-
1353 win32port/zlib/gzlib.c | 1157 +++++-----
1354 win32port/zlib/gzread.c | 1242 ++++++-----
1355 win32port/zlib/gzwrite.c | 1096 +++++----
1356 win32port/zlib/infback.c | 1272 ++++++-----
1357 win32port/zlib/inffast.c | 680 +++---
1358 win32port/zlib/inffast.h | 22 +-
1359 win32port/zlib/inffixed.h | 188 +-
1360 win32port/zlib/inflate.c | 2976 +++++++++++++------------
1361 win32port/zlib/inflate.h | 244 +-
1362 win32port/zlib/inftrees.c | 636 +++---
1363 win32port/zlib/inftrees.h | 124 +-
1364 win32port/zlib/trees.c | 2468 +++++++++++----------
1365 win32port/zlib/trees.h | 256 +--
1366 win32port/zlib/uncompr.c | 118 +-
1367 win32port/zlib/zconf.h | 934 ++++----
1368 win32port/zlib/zlib.h | 3357 ++++++++++++++--------------
1369 win32port/zlib/zutil.c | 642 +++---
1370 win32port/zlib/zutil.h | 526 ++---
1371 69 files changed, 19556 insertions(+), 20145 deletions(-)
1372
1373user api changes
1374----------------
1375
1376 - libwebsockets_serve_http_file() now takes a context as first argument
1377
1378 - libwebsockets_get_peer_addresses() now takes a context and wsi as first
1379 two arguments
1380
1381
1382user api additions
1383------------------
1384
1385 - lwsl_...() logging apis, default to stderr but retargetable by user code;
1386 may be used also by user code
1387
1388 - lws_set_log_level() set which logging apis are able to emit (defaults to
1389 notice, warn, err severities), optionally set the emit callback
1390
1391 - lwsl_emit_syslog() helper callback emits to syslog
1392
1393 - lws_daemonize() helper code that forks the app into a headless daemon
1394 properly, maintains a lock file with pid in suitable for sysvinit etc to
1395 control lifecycle
1396
1397 - LWS_CALLBACK_HTTP_FILE_COMPLETION callback added since http file
1398 transfer is now asynchronous (see test server code)
1399
1400 - lws_frame_is_binary() from a wsi pointer, let you know if the received
1401 data was sent in BINARY mode
1402
1403
1404user api removals
1405-----------------
1406
1407 - libwebsockets_fork_service_loop() - no longer supported (had intractable problems)
1408 arrange your code to act from the user callback instead from same
1409 process context as the service loop
1410
1411 - libwebsockets_broadcast() - use libwebsocket_callback_on_writable[_all_protocol]()
1412 instead from same process context as the service loop. See the test apps
1413 for examples.
1414
1415 - x-google-mux() removed until someone wants it
1416
1417 - pre -v13 (ancient) protocol support removed
1418
1419
1420New features
1421------------
1422
1423 - echo test server and client compatible with echo.websocket.org added
1424
1425 - many new configure options (see README.build) to reduce footprint of the
1426 library to what you actually need, eg, --without-client and
1427 --without-server
1428
1429 - http + websocket server can build to as little as 12K .text for ARM
1430
1431 - no more MAX_CLIENTS limitation; adapts to support the max number of fds
1432 allowed to the process by ulimit, defaults to 1024 on Fedora and
1433 Ubuntu. Use ulimit to control this without needing to configure
1434 the library. Code here is smaller and faster.
1435
1436 - adaptive ratio of listen socket to connection socket service allows
1437 good behaviour under Apache ab test load. Tested with thousands
1438 of simultaneous connections
1439
1440 - reduction in per-connection memory footprint by moving to a union to hold
1441 mutually-exclusive state for the connection
1442
1443 - robustness: Out of Memory taken care of for all allocation code now
1444
1445 - internal getifaddrs option if your toolchain lacks it (some uclibc)
1446
1447 - configurable memory limit for deflate operations
1448
1449 - improvements in SSL code nonblocking operation, possible hang solved,
1450 some SSL operations broken down into pollable states so there is
1451 no library blocking, timeout coverage for SSL_connect
1452
1453 - extpoll test server merged into single test server source
1454
1455 - robustness: library should deal with all recoverable socket conditions
1456
1457 - rx flowcontrol for backpressure notification fixed and implmeneted
1458 correctly in the test server
1459
1460 - optimal lexical parser added for header processing; all headers in a
1461 single 276-byte state table
1462
1463 - latency tracking api added (configure --with-latency)
1464
1465 - Improved in-tree documentation, REAME.build, README.coding,
1466 README.test-apps, changelog
1467
1468 - Many small fixes
1469
1470
1471v1.0-chrome25-firefox17 (6cd1ea9b005933f)