blob: 931c66398e13f500c0d80be9087a4675b7b8f802 [file] [log] [blame] [view]
A. Unique TensorFlower79228c72016-10-19 16:25:46 -08001# Changes since the last release
2
3## Breaking Changes to the API
4
Andrew Sellefcc39232016-11-22 10:04:37 -08005* Division and modulus operators (/, //, %) now match Python (flooring)
Andrew Sellef0a6d1e2016-12-13 16:01:12 -08006 semantics. This applies to `tf.div` and `tf.mod` as well. To obtain forced
7 integer truncation based behaviors you can use `tf.truncatediv`
8 and `tf.truncatemod`.
9* `tf.divide()` is now the recommended division function. `tf.div()` will
10 remain, but its semantics do not respond to Python 3 or `from future`
11 mechanisms.
12* tf.reverse() now takes indices of axes to be reversed. E.g.
13 `tf.reverse(a, [True, False, True])` must now be written as
14 `tf.reverse(a, [0, 2])`. `tf.reverse_v2()` will remain until 1.0 final.
15* `tf.mul`, `tf.sub` and `tf.neg` are deprecated in favor of `tf.multiply`,
16 `tf.subtract` and `tf.negative`.
17* The following Python functions have had their arguments changed to use `axis`
18 when referring to specific dimensions. We have kept the old keyword arguments
19 for compatibility currently, but we will be removing them well before the
20 final 1.0.
21 * `tf.argmax`: `dimension` becomes `axis`
22 * `tf.argmin`: `dimension` becomes `axis`
23 * `tf.count_nonzero`: `reduction_indices` becomes `axis`
24 * `tf.expand_dims`: `dim` becomes `axis`
25 * `tf.reduce_all`: `reduction_indices` becomes `axis`
26 * `tf.reduce_any`: `reduction_indices` becomes `axis`
27 * `tf.reduce_join`: `reduction_indices` becomes `axis`
28 * `tf.reduce_logsumexp`: `reduction_indices` becomes `axis`
29 * `tf.reduce_max`: `reduction_indices` becomes `axis`
30 * `tf.reduce_mean`: `reduction_indices` becomes `axis`
31 * `tf.reduce_min`: `reduction_indices` becomes `axis`
32 * `tf.reduce_prod`: `reduction_indices` becomes `axis`
33 * `tf.reduce_sum`: `reduction_indices` becomes `axis`
34 * `tf.reverse_sequence`: `batch_dim` becomes `batch_axis`, `seq_dim` becomes `seq_axis`
35 * `tf.sparse_concat`: `concat_dim` becomes `axis`
36 * `tf.sparse_reduce_sum`: `reduction_axes` becomes `axis`
37 * `tf.sparse_reduce_sum_sparse`: `reduction_axes` becomes `axis`
38 * `tf.sparse_split`: `split_dim` becomes `axis`
39* `tf.listdiff` has been renamed to `tf.setdiff1d` to match NumPy naming.
40* `tf.inv` has been renamed to be `tf.reciprocal` (component-wise reciprocal)
41 to avoid confusion with `np.inv` which is matrix inversion
42* tf.round now uses banker's rounding (round to even) semantics to match NumPy.
43* `tf.split` now takes arguments in a reversed order and with different
44 keywords. In particular, we now match NumPy order as
45 `tf.split(value, num_or_size_splits, axis)`.
46* `tf.sparse_split` now takes arguments in reversed order and with different
47 keywords. In particular we now match NumPy order as
48 `tf.sparse_split(sp_input, num_split, axis)`. NOTE: we have temporarily
49 made `tf.sparse_split` require keyword arguments.
A. Unique TensorFlowerbfff0a52016-12-13 23:01:32 -080050* Deprecated `tf.concat` operator. Please switch to use `tf.concat_v2` for now.
51 In the Beta release, we will update `tf.concat` to match argument order of
52 `tf.concat_v2.
Andrew Harp1cb96892016-12-08 20:05:49 -080053
54# Release 0.12.0
55
56## Major Features and Improvements
57
58* TensorFlow now builds and runs on Microsoft Windows (tested on Windows 10,
59 Windows 7, and Windows Server 2016). Supported languages include Python (via a
60 pip package) and C++. CUDA 8.0 and cuDNN 5.1 are supported for GPU
61 acceleration. Known limitations include: It is not currently possible to load
62 a custom op library. The GCS and HDFS file systems are not currently
63 supported. The following ops are not currently implemented:
Martin Wicke2e4869a2016-12-14 15:46:53 -080064 Dequantize, QuantizeAndDequantize, QuantizedAvgPool,
Andrew Harp1cb96892016-12-08 20:05:49 -080065 QuantizedBatchNomWithGlobalNormalization, QuantizedBiasAdd, QuantizedConcat,
66 QuantizedConv2D, QuantizedMatmul, QuantizedMaxPool,
67 QuantizeDownAndShrinkRange, QuantizedRelu, QuantizedRelu6, QuantizedReshape,
68 QuantizeV2, RequantizationRange, and Requantize.
69* Go: Experimental API in Go to create and execute graphs
70 (https://godoc.org/github.com/tensorflow/tensorflow/tensorflow/go)
71* New checkpoint format becomes the default in `tf.train.Saver`. Old V1
72 checkpoints continue to be readable; controlled by the `write_version`
73 argument, `tf.train.Saver` now by default writes out in the new V2
74 format. It significantly reduces the peak memory required and latency
75 incurred during restore.
76* Added a new library for library of matrix-free (iterative) solvers for linear
77 equations, linear least-squares, eigenvalues and singular values in
78 tensorflow/contrib/solvers. Initial version has lanczos bidiagonalization,
79 conjugate gradients and CGLS.
80* Added gradients for `matrix_solve_ls` and `self_adjoint_eig`.
81* Large cleanup to add second order gradient for ops with C++ gradients and
82 improve existing gradients such that most ops can now be differentiated
83 multiple times.
84* Added a solver for ordinary differential equations,
85 `tf.contrib.integrate.odeint`.
86* New contrib module for tensors with named axes, `tf.contrib.labeled_tensor`.
87* Visualization of embeddings in TensorBoard.
88
89## Breaking Changes to the API
90
A. Unique TensorFlower79228c72016-10-19 16:25:46 -080091* `BusAdjacency` enum replaced with a protocol buffer `DeviceLocality`. PCI bus
Andrew Harp1cb96892016-12-08 20:05:49 -080092 indexing now starts from 1 instead of 0, and bus_id==0 is used where
93 previously BUS_ANY was used.
Jonathan Hseu879e0ac2016-11-04 11:53:50 -080094* `Env::FileExists` and `FileSystem::FileExists` now return a tensorflow::Status
95 intead of a bool. Any callers to this function can be converted to a bool
96 by adding .ok() to the call.
Asim Shankare580e722016-11-09 08:21:50 -080097* The C API type `TF_SessionWithGraph` has been renamed to `TF_Session`,
98 indicating its preferred use in language bindings for TensorFlow.
99 What was previously `TF_Session` has been renamed to `TF_DeprecatedSession`.
Jonathan Hseu8f6cb222016-11-16 14:11:44 -0800100* Renamed TF_Port to TF_Output in the C API.
Andrew Harp1cb96892016-12-08 20:05:49 -0800101* Removes RegisterShape from public API. Use C++ shape function registration instead.
102 indexing now starts from 1 instead of 0, and `bus_id==0` is used where
103 previously `BUS_ANY` was used.
Eugene Brevdo7a7c1eb2016-11-29 09:38:37 -0800104* Most RNN cells and RNN functions now use different variable scopes to be
105 consistent with layers (`tf.contrib.layers`). This means old checkpoints
106 written using this code will not load after this change without providing
107 `Saver` a list of variable renames. Examples of variable scope changes
108 include `RNN` -> `rnn` in `tf.nn.rnn`, `tf.nn.dynamic_rnn` and moving from
109 `Linear/Matrix` -> `weights` and `Linear/Bias` -> `biases` in most RNN cells.
A. Unique TensorFlowerfe558b02016-11-30 11:51:57 -0800110* Deprecated tf.select op. tf.where should be used instead.
Martin Wickea7cd5f62016-12-14 15:22:55 -0800111* `SparseTensor.shape` has been renamed to `SparseTensor.dense_shape`. Same for
112 `SparseTensorValue.shape`.
Andrew Harp1cb96892016-12-08 20:05:49 -0800113* `Env::FileExists` and `FileSystem::FileExists` now return a
114 `tensorflow::Status` intead of a bool. Any callers to this function can be
115 converted to a bool by adding `.ok()` to the call.
116* C API: Type `TF_SessionWithGraph` has been renamed to `TF_Session`, indicating
117 its preferred use in language bindings for TensorFlow. What was previously
118 `TF_Session` has been renamed to `TF_DeprecatedSession`.
119* C API: Renamed `TF_Port` to `TF_Output`.
120* C API: The caller retains ownership of `TF_Tensor` objects provided to
121 `TF_Run`, `TF_SessionRun`, `TF_SetAttrTensor` etc.
122* Renamed `tf.image.per_image_whitening()` to
123 `tf.image.per_image_standardization()`
124* Move Summary protobuf constructors to `tf.summary` submodule.
125* Deprecate `histogram_summary`, `audio_summary`, `scalar_summary`,
126 `image_summary`, `merge_summary`, and `merge_all_summaries`.
127* Combined `batch_*` and regular version of linear algebra and FFT ops. The
128 regular op now handles batches as well. All `batch_*` Python interfaces were
129 removed.
130* `tf.all_variables`, `tf.VARIABLES` and `tf.initialize_all_variables` renamed
131 to `tf.global_variables`, `tf.GLOBAL_VARIABLES` and
132 `tf.global_variables_initializer` respectively.
133
134## Bug Fixes and Other Changes
135
136* Use threadsafe version of `lgamma` function.
137* Fix `tf.sqrt` handling of negative arguments.
138* Fixed bug causing incorrect number of threads to be used for multi-threaded
139 benchmarks.
140* Performance optimizations for `batch_matmul` on multi-core CPUs.
141* Improve trace, `matrix_set_diag`, `matrix_diag_part` and their gradients to
142 work for rectangular matrices.
143* Support for SVD of complex valued matrices.
144
145
146## Thanks to our Contributors
147
148This release contains contributions from many people at Google, as well as:
149
150@a7744hsc, Abhi Agg, @admcrae, Adriano Carmezim, Aki Sukegawa, Alex Kendall,
151Alexander Rosenberg Johansen, @amcrae, Amlan Kar, Andre Simpelo, Andreas Eberle,
152Andrew Hundt, Arnaud Lenglet, @b0noI, Balachander Ramachandran, Ben Barsdell,
153Ben Guidarelli, Benjamin Mularczyk, Burness Duan, @c0g, Changming Sun,
154@chanis, Corey Wharton, Dan J, Daniel Trebbien, Darren Garvey, David Brailovsky,
155David Jones, Di Zeng, @DjangoPeng, Dr. Kashif Rasul, @drag0, Fabrizio (Misto)
156Milo, FabríCio Ceschin, @fp, @Ghedeon, @guschmue, Gökçen Eraslan, Haosdent
157Huang, Haroen Viaene, Harold Cooper, Henrik Holst, @hoangmit, Ivan Ukhov, Javier
158Dehesa, Jingtian Peng, Jithin Odattu, Joan Pastor, Johan Mathe, Johannes Mayer,
159Jongwook Choi, Justus Schwabedal, Kai Wolf, Kamil Hryniewicz, Kamran Amini,
160Karen Brems, Karl Lattimer, @kborer, Ken Shirriff, Kevin Rose, Larissa Laich,
161Laurent Mazare, Leonard Lee, Liang-Chi Hsieh, Liangliang He, Luke Iwanski,
162Marek Kolodziej, Moustafa Alzantot, @MrQianjinsi, @nagachika, Neil Han, Nick
163Meehan, Niels Ole Salscheider, Nikhil Mishra, @nschuc, Ondrej Skopek, OndřEj
164Filip, @OscarDPan, Pablo Moyano, Przemyslaw Tredak, @qitaishui, @Quarazy,
165@raix852, Philipp Helo, Sam Abrahams, @SriramRamesh, Till Hoffmann, Tushar Soni,
166@tvn, @tyfkda, Uwe Schmidt, Victor Villas, Vit Stepanovs, Vladislav Gubarev,
167@wujingyue, Xuesong Yang, Yi Liu, Yilei Yang, @youyou3, Yuan (Terry) Tang,
168Yuming Wang, Zafar Takhirov, @zhongyuk, Ziming Dong, @guotong1988
169
170We are also grateful to all who filed issues or helped resolve them, asked and
171answered questions, and were part of inspiring discussions.
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800172
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800173# Release 0.11.0
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800174
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800175## Major Features and Improvements
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800176
Vijay Vasudevan818993c2016-11-03 17:07:01 -0800177* CUDA 8 support.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800178* cuDNN 5 support.
179* HDFS Support.
180* Adds Fused LSTM support via cuDNN 5 in `tensorflow/contrib/cudnn_rnn`.
181* Improved support for NumPy style basic slicing including non-1 strides,
182 ellipses, newaxis, and negative indices. For example complicated expressions
183 like `foo[1, 2:4, tf.newaxis, ..., :-3:-1, :]` are now supported. In addition
184 we have preliminary (non-broadcasting) support for sliced assignment to
185 variables. In particular one can write `var[1:3].assign([1,11,111])`.
186* Deprecated `tf.op_scope` and `tf.variable_op_scope` in favor of a unified `tf.name_scope` and `tf.variable_scope`. The new argument order of `tf.variable_scope` is incompatible with previous versions.
187* Introducing `core/util/tensor_bundle` module: a module to efficiently
188 serialize/deserialize tensors to disk. Will be used in TF's new checkpoint
189 format.
190* Added tf.svd for computing the singular value decomposition (SVD) of dense
191 matrices or batches of matrices (CPU only).
192* Added gradients for eigenvalues and eigenvectors computed using
193 `self_adjoint_eig` or `self_adjoint_eigvals`.
194* Eliminated `batch_*` methods for most linear algebra and FFT ops and promoted
195 the non-batch version of the ops to handle batches of matrices.
196* Tracing/timeline support for distributed runtime (no GPU profiler yet).
197* C API gives access to inferred shapes with `TF_GraphGetTensorNumDims` and
198 `TF_GraphGetTensorShape`.
199* Shape functions for core ops have moved to C++ via
200 `REGISTER_OP(...).SetShapeFn(...)`. Python shape inference RegisterShape calls
201 use the C++ shape functions with `common_shapes.call_cpp_shape_fn`. A future
202 release will remove `RegisterShape` from python.
203
204
205## Bug Fixes and Other Changes
206
207* Documentation now includes operator overloads on Tensor and Variable.
208* `tensorflow.__git_version__` now allows users to identify the version of the
209 code that TensorFlow was compiled with. We also have
210 `tensorflow.__git_compiler__` which identifies the compiler used to compile
211 TensorFlow's core.
212* Improved multi-threaded performance of `batch_matmul`.
Eugene Brevdo21e1cc72016-08-11 21:45:39 -0800213* LSTMCell, BasicLSTMCell, and MultiRNNCell constructors now default to
214 `state_is_tuple=True`. For a quick fix while transitioning to the new
215 default, simply pass the argument `state_is_tuple=False`.
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800216* DeviceFactory's AddDevices and CreateDevices functions now return
217 a Status instead of void.
A. Unique TensorFlower84cefad2016-08-12 07:06:13 -0800218* Int32 elements of list(type) arguments are no longer placed in host memory by
219 default. If necessary, a list(type) argument to a kernel can be placed in host
220 memory using a HostMemory annotation.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800221* `uniform_unit_scaling_initializer()` no longer takes a `full_shape` arg,
222 instead relying on the partition info passed to the initializer function when
223 it's called.
224* The NodeDef protocol message is now defined in its own file `node_def.proto`
225 `instead of graph.proto`.
226* `ops.NoGradient` was renamed `ops.NotDifferentiable`. `ops.NoGradient` will
Vijay Vasudevan612bae72016-09-09 11:03:09 -0800227 be removed soon.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800228* `dot.h` / DotGraph was removed (it was an early analysis tool prior
Vijay Vasudevan269bfee2016-09-21 21:41:19 -0800229 to TensorBoard, no longer that useful). It remains in history
230 should someone find the code useful.
Vijay Vasudevan914625a2016-09-23 13:51:34 -0800231* re2 / regexp.h was removed from being a public interface of TF.
232 Should users need regular expressions, they should depend on the RE2
233 library directly rather than via TensorFlow.
Dan Manée5bcf542016-05-16 13:39:34 -0800234
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800235## Thanks to our Contributors
236
237This release contains contributions from many people at Google, as well as:
238
239Abid K, @afshinrahimi, @AidanGG, Ajay Rao, Aki Sukegawa, Alex Rothberg,
240Alexander Rosenberg Johansen, Andrew Gibiansky, Andrew Thomas, @Appleholic,
241Bastiaan Quast, Ben Dilday, Bofu Chen, Brandon Amos, Bryon Gloden, Cissp®,
242@chanis, Chenyang Liu, Corey Wharton, Daeyun Shin, Daniel Julius Lasiman, Daniel
243Waterworth, Danijar Hafner, Darren Garvey, Denis Gorbachev, @DjangoPeng,
244Egor-Krivov, Elia Palme, Eric Platon, Fabrizio Milo, Gaetan Semet,
245Georg Nebehay, Gu Wang, Gustav Larsson, @haosdent, Harold Cooper, Hw-Zz,
246@ichuang, Igor Babuschkin, Igor Macedo Quintanilha, Ilya Edrenkin, @ironhead,
247Jakub Kolodziejczyk, Jennifer Guo, Jihun Choi, Jonas Rauber, Josh Bleecher
248Snyder, @jpangburn, Jules Gagnon-Marchand, Karen Brems, @kborer, Kirill Bobyrev,
249Laurent Mazare, Longqi Yang, Malith Yapa, Maniteja Nandana, Martin Englund,
250Matthias Winkelmann, @mecab, Mu-Ik Jeon, Nand Dalal, Niels Ole Salscheider,
251Nikhil Mishra, Park Jiin, Pieter De Rijk, @raix852, Ritwik Gupta, Sahil Sharma,
Patrick Nguyenc5ab3dd2016-10-20 12:09:18 -0800252Sangheum Hwang, @SergejsRk, Shinichiro Hamaji, Simon Denel, @Steve, @suiyuan2009,
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800253Tiago Jorge, Tijmen Tieleman, @tvn, @tyfkda, Wang Yang, Wei-Ting Kuo, Wenjian
254Huang, Yan Chen, @YenChenLin, Yuan (Terry) Tang, Yuncheng Li, Yunfeng Wang, Zack
255Polizzi, @zhongzyd, Ziming Dong, @perhapszzy
256
257We are also grateful to all who filed issues or helped resolve them, asked and
258answered questions, and were part of inspiring discussions.
259
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800260# Release 0.10.0
A. Unique TensorFlower533d8912016-06-30 12:10:50 -0800261
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800262## Major Features and Improvements
263
264* Added support for C++ shape inference
265* Added graph-construction C API
266* Major revision to the graph-construction C++ API
267* Support makefile build for iOS
268* Added Mac GPU support
269* Full version of TF-Slim available as `tf.contrib.slim`
270* Added k-Means clustering and WALS matrix factorization
271
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800272## Bug Fixes and Other Changes
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800273
274* Allow gradient computation for scalar values.
275* Performance improvements for gRPC
276* Improved support for fp16
277* New high-level ops in tf.contrib.{layers,metrics}
278* New features for TensorBoard, such as shape display, exponential smoothing
279* Faster and more stable Google Cloud Storage (GCS) filesystem support
280* Support for zlib compression and decompression for TFRecordReader and TFRecordWriter
281* Support for reading (animated) GIFs
282* Improved support for SparseTensor
283* Added support for more probability distributions (Dirichlet, Beta, Bernoulli, etc.)
284* Added Python interfaces to reset resource containers.
285* Many bugfixes and performance improvements
286* Many documentation fixes
287
288## Thanks to our Contributors
289
290This release contains contributions from many people at Google, as well as:
291
292Alex Rothberg, Andrew Royer, Austin Marshall, @BlackCoal, Bob Adolf, Brian Diesel, Charles-Emmanuel Dias, @chemelnucfin, Chris Lesniewski, Daeyun Shin, Daniel Rodriguez, Danijar Hafner, Darcy Liu, Kristinn R. Thórisson, Daniel Castro, Dmitry Savintsev, Kashif Rasul, Dylan Paiton, Emmanuel T. Odeke, Ernest Grzybowski, Gavin Sherry, Gideon Dresdner, Gregory King, Harold Cooper, @heinzbeinz, Henry Saputra, Huarong Huo, Huazuo Gao, Igor Babuschkin, Igor Macedo Quintanilha, Ivan Ukhov, James Fysh, Jan Wilken Dörrie, Jihun Choi, Johnny Lim, Jonathan Raiman, Justin Francis, @lilac, Li Yi, Marc Khoury, Marco Marchesi, Max Melnick, Micael Carvalho, @mikowals, Mostafa Gazar, Nico Galoppo, Nishant Agrawal, Petr Janda, Yuncheng Li, @raix852, Robert Rose, @Robin-des-Bois, Rohit Girdhar, Sam Abrahams, satok16, Sergey Kishchenko, Sharkd Tu, @shotat, Siddharth Agrawal, Simon Denel, @sono-bfio, SunYeop Lee, Thijs Vogels, @tobegit3hub, @Undo1, Wang Yang, Wenjian Huang, Yaroslav Bulatov, Yuan Tang, Yunfeng Wang, Ziming Dong
293
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800294We are also grateful to all who filed issues or helped resolve them, asked and
295answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800296
297# Release 0.9.0
298
299## Major Features and Improvements
300
301* Python 3.5 support and binaries
302* Added iOS support
303* Added support for processing on GPUs on MacOS
304* Added makefile for better cross-platform build support (C API only)
305* fp16 support and improved complex128 support for many ops
306* Higher level functionality in contrib.{layers,losses,metrics,learn}
307* More features to Tensorboard
308* Improved support for string embedding and sparse features
309* The RNN api is finally "official" (see, e.g., `tf.nn.dynamic_rnn`,
310 `tf.nn.rnn`, and the classes in `tf.nn.rnn_cell`).
311* TensorBoard now has an Audio Dashboard, with associated audio summaries.
312
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800313## Bug Fixes and Other Changes
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800314
315* Turned on CuDNN Autotune.
316* Added support for using third-party Python optimization algorithms (contrib.opt).
317* Google Cloud Storage filesystem support.
318* HDF5 support
319* Add support for 3d convolutions and pooling.
320* Update gRPC release to 0.14.
321* Eigen version upgrade.
322* Switch to eigen thread pool
323* `tf.nn.moments()` now accepts a `shift` argument. Shifting by a good estimate
324 of the mean improves numerical stability. Also changes the behavior of the
325 `shift` argument to `tf.nn.sufficient_statistics()`.
326* Performance improvements
327* Many bugfixes
328* Many documentation fixes
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800329* TensorBoard fixes: graphs with only one data point, Nan values,
330 reload button and auto-reload, tooltips in scalar charts, run
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800331 filtering, stable colors
332* Tensorboard graph visualizer now supports run metadata. Clicking on nodes
333 while viewing a stats for a particular run will show runtime statistics, such
334 as memory or compute usage. Unused nodes will be faded out.
335
336## Thanks to our Contributors
337
338This release contains contributions from many people at Google, as well as:
339
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800340Aaron Schumacher, Aidan Dang, Akihiko ITOH, Aki Sukegawa, Arbit Chen, Aziz Alto, Danijar Hafner, Erik Erwitt, Fabrizio Milo, Felix Maximilian Möller, Henry Saputra, Sung Kim, Igor Babuschkin, Jan Zikes, Jeremy Barnes, Jesper Steen Møller, Johannes Mayer, Justin Harris, Kashif Rasul, Kevin Robinson, Loo Rong Jie, Lucas Moura, Łukasz Bieniasz-Krzywiec, Mario Cho, Maxim Grechkin, Michael Heilman, Mostafa Rahmani, Mourad Mourafiq, @ninotoshi, Orion Reblitz-Richardson, Yuncheng Li, @raoqiyu, Robert DiPietro, Sam Abrahams, Sebastian Raschka, Siddharth Agrawal, @snakecharmer1024, Stephen Roller, Sung Kim, SunYeop Lee, Thijs Vogels, Till Hoffmann, Victor Melo, Ville Kallioniemi, Waleed Abdulla, Wenjian Huang, Yaroslav Bulatov, Yeison Rodriguez, Yuan Tang, Yuxin Wu, @zhongzyd, Ziming Dong, Zohar Jackson
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800341
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800342We are also grateful to all who filed issues or helped resolve them, asked and
343answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800344
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800345# Release 0.8.0
346
347## Major Features and Improvements
348
349* Added a distributed runtime using GRPC
350* Move skflow to `contrib/learn`
351* Better linear optimizer in `contrib/linear_optimizer`
352* Random forest implementation in `contrib/tensor_forest`
353* CTC loss and decoders in `contrib/ctc`
354* Basic support for `half` data type
355* Better support for loading user ops (see examples in `contrib/`)
356* Allow use of (non-blocking) Eigen threadpool with `TENSORFLOW_USE_EIGEN_THREADPOOL` define
357* Add an extension mechanism for adding network file system support
358* TensorBoard displays metadata stats (running time, memory usage and device used) and tensor shapes
359
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800360## Bug Fixes and Other Changes
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800361
362* Utility for inspecting checkpoints
363* Basic tracing and timeline support
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800364* Allow building against cuDNN 5 (not incl. RNN/LSTM support)
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800365* Added instructions and binaries for ProtoBuf library with fast serialization and without 64MB limit
366* Added special functions
Dan Mané54a71782016-09-09 16:07:46 -0800367* `bool`-strictness: Tensors have to be explicitly compared to `None`
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800368* Shape strictness: all fed values must have a shape that is compatible with the tensor they are replacing
369* Exposed `tf.while_loop` (deprecated `control_flow_ops.While`)
370* run() now takes RunOptions and RunMetadata, which enable timing stats
371* Fixed lots of potential overflow problems in op kernels
372* Various performance improvements, especially for RNNs and convolutions
373* Many bugfixes
374* Nightly builds, tutorial tests, many test improvements
375* New examples: transfer learning and deepdream ipython notebook
376* Added tutorials, many documentation fixes.
377
378## Thanks to our Contributors
379
380This release contains contributions from many people at Google, as well as:
381
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800382Abhinav Upadhyay, Aggelos Avgerinos, Alan Wu, Alexander G. de G. Matthews, Aleksandr Yahnev, @amchercashin, Andy Kitchen, Aurelien Geron, Awni Hannun, @BanditCat, Bas Veeling, Cameron Chen, @cg31, Cheng-Lung Sung, Christopher Bonnett, Dan Becker, Dan Van Boxel, Daniel Golden, Danijar Hafner, Danny Goodman, Dave Decker, David Dao, David Kretch, Dongjoon Hyun, Dustin Dorroh, @e-lin, Eurico Doirado, Erik Erwitt, Fabrizio Milo, @gaohuazuo, Iblis Lin, Igor Babuschkin, Isaac Hodes, Isaac Turner, Iván Vallés, J Yegerlehner, Jack Zhang, James Wexler, Jan Zikes, Jay Young, Jeff Hodges, @jmtatsch, Johnny Lim, Jonas Meinertz Hansen, Kanit Wongsuphasawat, Kashif Rasul, Ken Shirriff, Kenneth Mitchner, Kenta Yonekura, Konrad Magnusson, Konstantin Lopuhin, @lahwran, @lekaha, @liyongsea, Lucas Adams, @makseq, Mandeep Singh, @manipopopo, Mark Amery, Memo Akten, Michael Heilman, Michael Peteuil, Nathan Daly, Nicolas Fauchereau, @ninotoshi, Olav Nymoen, @panmari, @papelita1234, Pedro Lopes, Pranav Sailesh Mani, RJ Ryan, Rob Culliton, Robert DiPietro, @ronrest, Sam Abrahams, Sarath Shekkizhar, Scott Graham, Sebastian Raschka, Sung Kim, Surya Bhupatiraju, Syed Ahmed, Till Hoffmann, @timsl, @urimend, @vesnica, Vlad Frolov, Vlad Zagorodniy, Wei-Ting Kuo, Wenjian Huang, William Dmitri Breaden Madden, Wladimir Schmidt, Yuan Tang, Yuwen Yan, Yuxin Wu, Yuya Kusakabe, @zhongzyd, @znah.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800383
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800384We are also grateful to all who filed issues or helped resolve them, asked and
385answered questions, and were part of inspiring discussions.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800386
387
Eugene Brevdo56f1d642016-03-10 17:18:30 -0800388# Release 0.7.1
389
390## Bug Fixes and Other Changes
391
392* Added gfile.Open and gfile.Copy, used by input_data.py.
393* Fixed Saver bug when MakeDirs tried to create empty directory.
394* GPU Pip wheels are built with cuda 7.5 and cudnn-v4, making them
395 required for the binary releases. Lower versions of cuda/cudnn can
396 be supported by installing from sources and setting the options
397 during ./configure
398* Fix dataset encoding example for Python3 (@danijar)
399* Fix PIP installation by not packaging protobuf as part of wheel,
400 require protobuf 3.0.0b2.
401* Fix Mac pip installation of numpy by requiring pip >= 1.10.1.
402* Improvements and fixes to Docker image.
403
404
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800405# Release 0.7.0
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -0800406
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800407## Major Features and Improvements
408
409* Allow using any installed Cuda >= 7.0 and cuDNN >= R2, and add support
410 for cuDNN R4
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800411* Added a `contrib/` directory for unsupported or experimental features,
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800412 including higher level `layers` module
413* Added an easy way to add and dynamically load user-defined ops
414* Built out a good suite of tests, things should break less!
415* Added `MetaGraphDef` which makes it easier to save graphs with metadata
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800416* Added assignments for "Deep Learning with TensorFlow" udacity course
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800417
418
419## Bug Fixes and Other Changes
420
421* Added a versioning framework for `GraphDef`s to ensure compatibility
422* Enforced Python 3 compatibility
423* Internal changes now show up as sensibly separated commits
424* Open-sourced the doc generator
425* Un-fork Eigen
426* Simplified the `BUILD` files and cleaned up C++ headers
427* TensorFlow can now be used as a submodule in another bazel build
428* New ops (e.g., `*fft`, `*_matrix_solve`)
429* Support for more data types in many ops
430* Performance improvements
431* Various bugfixes
432* Documentation fixes and improvements
433
434
435## Breaking Changes to the API
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -0800436
437* `AdjustContrast` kernel deprecated, new kernel `AdjustContrastv2` takes and
438 outputs float only. `adjust_contrast` now takes all data types.
439* `adjust_brightness`'s `delta` argument is now always assumed to be in `[0,1]`
440 (as is the norm for images in floating point formats), independent of the
441 data type of the input image.
442* The image processing ops do not take `min` and `max` inputs any more, casting
443 safety is handled by `saturate_cast`, which makes sure over- and underflows
444 are handled before casting to data types with smaller ranges.
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -0800445* For C++ API users: `IsLegacyScalar` and `IsLegacyVector` are now gone from
446 `TensorShapeUtils` since TensorFlow is scalar strict within Google (for
447 example, the shape argument to `tf.reshape` can't be a scalar anymore). The
448 open source release was already scalar strict, so outside Google `IsScalar`
449 and `IsVector` are exact replacements.
Josh Levenbergdb7478e2016-01-20 14:54:50 -0800450* The following files are being removed from `tensorflow/core/public/`:
451 * `env.h` -> `../platform/env.h`
452 * `status.h` -> `../lib/core/status.h`
453 * `tensor.h` -> `../framework/tensor.h`
454 * `tensor_shape.h` -> `../framework/tensor_shape.h`
455 * `partial_tensor_shape.h` -> `../framework/partial_tensor_shape.h`
456 * `tensorflow_server.h` deleted
Geoffrey Irving56437752016-01-25 09:43:13 -0800457* For C++ API users: `TensorShape::ShortDebugString` has been renamed to
458 `DebugString`, and the previous `DebugString` behavior is gone (it was
459 needlessly verbose and produced a confusing empty string for scalars).
Manjunath Kudlurc2722a12016-01-27 13:24:50 -0800460* `GraphOptions.skip_common_subexpression_elimination` has been removed. All
461 graph optimizer options are now specified via
462 `GraphOptions.OptimizerOptions`.
Geoffrey Irving18297122016-02-10 11:48:34 -0800463* `ASSERT_OK` / `EXPECT_OK` macros conflicted with external projects, so they
464 were renamed `TF_ASSERT_OK`, `TF_EXPECT_OK`. The existing macros are
465 currently maintained for short-term compatibility but will be removed.
Eugene Brevdofea55e12016-01-27 14:54:54 -0800466* The non-public `nn.rnn` and the various `nn.seq2seq` methods now return
467 just the final state instead of the list of all states.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800468* `tf.scatter_update` now no longer guarantees that lexicographically largest
469 index be used for update when duplicate entries exist.
Geoffrey Irving3e33d442016-02-08 12:02:44 -0800470* `tf.image.random_crop(image, [height, width])` is now
471 `tf.random_crop(image, [height, width, depth])`, and `tf.random_crop` works
472 for any rank (not just 3-D images). The C++ `RandomCrop` op has been replaced
473 with pure Python.
Geoffrey Irving18297122016-02-10 11:48:34 -0800474* Renamed `tf.test.GetTempDir` and `tf.test.IsBuiltWithCuda` to
475 `tf.test.get_temp_dir` and `tf.test.is_built_with_cuda` for PEP-8
476 compatibility.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800477* `parse_example`'s interface has changed, the old interface is accessible in
478 `legacy_parse_example` (same for related functions).
479* New `Variable`s are not added to the same collection several times even if
480 a list with duplicates is passed to the constructor.
Josh Levenberg02dff6d2016-01-07 18:37:54 -0800481* The Python API will now properly set the `list` member of `AttrValue` in
482 constructed `GraphDef` messages for empty lists. The serialization of some
483 graphs will change, but the change is both forwards and backwards compatible.
484 It will break tests that compare a generated `GraphDef` to a golden serialized
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800485 `GraphDef` (which is discouraged).
486
487
488## Thanks to our Contributors
489
490This release contains contributions from many people at Google, as well as:
491
492Akiomi Kamakura, Alex Vig, Alexander Rosenberg Johansen, Andre Cruz, Arun Ahuja,
493Bart Coppens, Bernardo Pires, Carl Vondrick, Cesar Salgado, Chen Yu,
494Christian Jauvin, Damien Aymeric, Dan Vanderkam, Denny Britz, Dongjoon Hyun,
495Eren Güven, Erik Erwitt, Fabrizio Milo, G. Hussain Chinoy, Jim Fleming,
496Joao Felipe Santos, Jonas Meinertz Hansen, Joshi Rekha, Julian Viereck,
497Keiji Ariyama, Kenton Lee, Krishna Sankar, Kristina Chodorow, Linchao Zhu,
498Lukas Krecan, Mark Borgerding, Mark Daoust, Moussa Taifi,
499Nathan Howell, Naveen Sundar Govindarajulu, Nick Sweeting, Niklas Riekenbrauck,
500Olivier Grisel, Patrick Christ, Povilas Liubauskas, Rainer Wasserfuhr,
501Romain Thouvenin, Sagan Bolliger, Sam Abrahams, Taehoon Kim, Timothy J Laurent,
502Vlad Zavidovych, Yangqing Jia, Yi-Lin Juang, Yuxin Wu, Zachary Lipton,
503Zero Chen, Alan Wu, @brchiu, @emmjaykay, @jalammar, @Mandar-Shinde,
504@nsipplswezey, @ninotoshi, @panmari, @prolearner and @rizzomichaelg.
505
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800506We are also grateful to all who filed issues or helped resolve them, asked and
507answered questions, and were part of inspiring discussions.
Josh Levenberg02dff6d2016-01-07 18:37:54 -0800508
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -0800509
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800510# Release 0.6.0
511
512## Major Features and Improvements
513
514* Python 3.3+ support via changes to python codebase and ability
515 to specify python version via ./configure.
516
517* Some improvements to GPU performance and memory usage:
518 [convnet benchmarks](https://github.com/soumith/convnet-benchmarks/issues/66)
519 roughly equivalent with native cudnn v2 performance. Improvements mostly due
520 to moving to 32-bit indices, faster shuffling kernels. More improvements to
521 come in later releases.
522
523
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800524## Bug Fixes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800525
526* Lots of fixes to documentation and tutorials, many contributed
527 by the public.
528
529* 271 closed issues on github issues.
530
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800531## Backwards-Incompatible Changes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800532
Geoffrey Irving18297122016-02-10 11:48:34 -0800533* `tf.nn.fixed_unigram_candidate_sampler` changed its default 'distortion'
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800534 attribute from 0.0 to 1.0. This was a bug in the original release
535 that is now fixed.
536
Vijay Vasudevanddd4aaf2015-12-08 09:58:59 -0800537# Release 0.5.0
538
539Initial release of TensorFlow.