blob: e04bd3fc505d51ade9e9fa12c822cb695e90b4f3 [file] [log] [blame] [view]
Eugene Brevdocb331412017-08-22 11:10:29 -07001# Release 1.4.0
2
3## Major Features And Improvements
Benoit Steiner355e25e2017-10-24 19:47:46 -07004* `tf.keras` is now part of the core TensorFlow API.
Mark Daouste6623e32017-10-17 14:44:47 -07005* [`tf.data`](http://tensorflow.org/programmers_guide/datasets) is now part of
6 the core TensorFlow API.
Derek Murrayf6e187a2017-10-04 19:07:31 -07007 * The API is now subject to backwards compatibility guarantees.
8 * For a guide to migrating from the `tf.contrib.data` API, see the
Benoit Steiner355e25e2017-10-24 19:47:46 -07009 [README](https://github.com/tensorflow/tensorflow/blob/r1.4/tensorflow/contrib/data/README.md).
Derek Murrayf6e187a2017-10-04 19:07:31 -070010 * Major new features include `Dataset.from_generator()` (for building an input
11 pipeline from a Python generator), and the `Dataset.apply()` method for
12 applying custom transformation functions.
13 * Several custom transformation functions have been added, including
14 `tf.contrib.data.batch_and_drop_remainder()` and
15 `tf.contrib.data.sloppy_interleave()`.
Benoit Steiner355e25e2017-10-24 19:47:46 -070016* Add `train_and_evaluate` for simple distributed `Estimator` training.
17* Add `tf.spectral.dct` for computing the DCT-II.
18* Add Mel-Frequency Cepstral Coefficient support to `tf.contrib.signal`
19 (with GPU and gradient support).
20* Add a self-check on `import tensorflow` for Windows DLL issues.
21* Add NCHW support to `tf.depth_to_space` on GPU.
Andrew Harp88917882017-11-02 15:22:08 -070022* TensorFlow Debugger (tfdbg):
23 * Add `eval` command to allow evaluation of arbitrary Python/numpy expressions
24 in tfdbg command-line interface. See
25 [Debugging TensorFlow Programs](https://www.tensorflow.org/programmers_guide/debugger)
26 for more details.
27 * Usability improvement: The frequently used tensor filter `has_inf_or_nan` is
28 now added to `Session` wrappers and hooks by default. So there is no need
29 for clients to call `.add_tensor_filter(tf_debug.has_inf_or_nan)` anymore.
Benoit Steiner355e25e2017-10-24 19:47:46 -070030* SinhArcsinh (scalar) distribution added to `contrib.distributions`.
31* Make `GANEstimator` opensource.
32* `Estimator.export_savedmodel()` now includes all valid serving signatures
33 that can be constructed from the Serving Input Receiver and all available
34 ExportOutputs. For instance, a classifier may provide regression- and
35 prediction-flavored outputs, in addition to the classification-flavored one.
36 Building signatures from these allows TF Serving to honor requests using the
37 different APIs (Classify, Regress, and Predict). Furthermore,
38 `serving_input_receiver_fn()` may now specify alternative subsets of nodes
39 that may act as inputs. This allows, for instance, producing a prediction
40 signature for a classifier that accepts raw `Tensors` instead of a serialized
41 `tf.Example`.
42* Add `tf.contrib.bayesflow.hmc`.
43* Add `tf.contrib.distributions.MixtureSameFamily`.
44* Make `Dataset.shuffle()` always reshuffles after each iteration by default.
45* Add `tf.contrib.bayesflow.metropolis_hastings`.
46* Add `log_rate` parameter to `tf.contrib.distributions.Poisson`.
47* Extend `tf.contrib.distributions.bijector` API to handle some non-injective
48 transforms.
Asim Shankarc7246912017-10-03 08:55:28 -070049* Java:
Benoit Steiner355e25e2017-10-24 19:47:46 -070050 * Generics (e.g., `Tensor<Integer>`) for improved type-safety
51 (courtesy @andrewcmyers).
Asim Shankarc7246912017-10-03 08:55:28 -070052 * Support for multi-dimensional string tensors.
Benoit Steiner355e25e2017-10-24 19:47:46 -070053 * Support loading of custom operations (e.g. many in `tf.contrib`) on Linux
54 and OS X
55* All our prebuilt binaries have been built with CUDA 8 and cuDNN 6.
56 We anticipate releasing TensorFlow 1.5 with CUDA 9 and cuDNN 7.
Eugene Brevdocb331412017-08-22 11:10:29 -070057
58## Bug Fixes and Other Changes
59* `tf.nn.rnn_cell.DropoutWrapper` is now more careful about dropping out LSTM
60 states. Specifically, it no longer ever drops the `c` (memory) state of an
61 `LSTMStateTuple`. The new behavior leads to proper dropout behavior
62 for LSTMs and stacked LSTMs. This bug fix follows recommendations from
63 published literature, but is a behavioral change. State dropout behavior
64 may be customized via the new `dropout_state_filter_visitor` argument.
Eugene Brevdo48e3b622017-08-30 09:27:00 -070065* Removed `tf.contrib.training.python_input`. The same behavior, in a more
66 flexible and reproducible package, is available via the new
67 `tf.contrib.data.Dataset.from_generator` method!
Benoit Steiner355e25e2017-10-24 19:47:46 -070068* Fix `tf.contrib.distributions.Affine` incorrectly computing log-det-jacobian.
69* Fix `tf.random_gamma` incorrectly handling non-batch, scalar draws.
70* Resolved a race condition in TensorForest TreePredictionsV4Op.
Andrew Harp88917882017-11-02 15:22:08 -070071* Google Cloud Storage file system, Amazon S3 file system, and Hadoop file
72 system support are now default build options.
Benoit Steiner355e25e2017-10-24 19:47:46 -070073* Custom op libraries must link against libtensorflow_framework.so
74 (installed at `tf.sysconfig.get_lib()`).
Andrew Harp88917882017-11-02 15:22:08 -070075* Change `RunConfig` default behavior to not set a random seed, making random
76 behavior independently random on distributed workers. We expect this to
77 generally improve training performance. Models that do rely on determinism
78 should set a random seed explicitly.
Eugene Brevdocb331412017-08-22 11:10:29 -070079
Derek Murrayf6e187a2017-10-04 19:07:31 -070080## Breaking Changes to the API
81* The signature of the `tf.contrib.data.rejection_resample()` function has been
82 changed. It now returns a function that can be used as an argument to
83 `Dataset.apply()`.
Benoit Steiner355e25e2017-10-24 19:47:46 -070084* Remove `tf.contrib.data.Iterator.from_dataset()` method. Use
85 `Dataset.make_initializable_iterator()` instead.
86* Remove seldom used and unnecessary `tf.contrib.data.Iterator.dispose_op()`.
87* Reorder some TFGAN loss functions in a non-backwards compatible way.
88
Andrew Harp88917882017-11-02 15:22:08 -070089## Known Issues
90* In Python 3, `Dataset.from_generator()` does not support Unicode strings.
91 You must convert any strings to bytes objects before yielding them from
92 the generator.
93
Benoit Steiner355e25e2017-10-24 19:47:46 -070094## Thanks to our Contributors
95
96This release contains contributions from many people at Google, as well as:
97
984d55397500, Abdullah Alrasheed, abenmao, Adam Salvail, Aditya Dhulipala, Ag Ramesh,
99Akimasa Kimura, Alan Du, Alan Yee, Alexander, Amit Kushwaha, Amy, Andrei Costinescu,
100Andrei Nigmatulin, Andrew Erlichson, Andrew Myers, Andrew Stepanov, Androbin, AngryPowman,
101Anish Shah, Anton Daitche, Artsiom Chapialiou, asdf2014, Aseem Raj Baranwal, Ash Hall,
102Bart Kiers, Batchu Venkat Vishal, ben, Ben Barsdell, Bill Piel, Carl Thomé, Catalin Voss,
103Changming Sun, Chengzhi Chen, Chi Zeng, Chris Antaki, Chris Donahue, Chris Oelmueller,
104Chris Tava, Clayne Robison, Codrut, Courtial Florian, Dalmo Cirne, Dan J, Darren Garvey,
105David Kristoffersson, David Norman, David RöThlisberger, DavidNorman, Dhruv, DimanNe,
106Dorokhov, Duncan Mac-Vicar P, EdwardDixon, EMCP, error.d, FAIJUL, Fan Xia,
107Francois Xavier, Fred Reiss, Freedom" Koan-Sin Tan, Fritz Obermeyer, Gao, Xiang,
108Guenther Schmuelling, Guo Yejun (郭叶军), Hans Gaiser, HectorSVC, Hyungsuk Yoon,
109James Pruegsanusak, Jay Young, Jean Wanka, Jeff Carpenter, Jeremy Rutman, Jeroen BéDorf,
110Jett Jones, Jimmy Jia, jinghuangintel, jinze1994, JKurland, Joel Hestness, joetoth,
111John B Nelson, John Impallomeni, John Lawson, Jonas, Jonathan Dekhtiar, joshkyh, Jun Luan,
112Jun Mei, Kai Sasaki, Karl Lessard, karl@kubx.ca, Kb Sriram, Kenichi Ueno, Kevin Slagle,
113Kongsea, Lakshay Garg, lhlmgr, Lin Min, liu.guangcong, Loki Der Quaeler, Louie Helm,
114lucasmoura, Luke Iwanski, Lyndon White, Mahmoud Abuzaina, Marcel Puyat, Mark Aaron Shirley,
115Michele Colombo, MtDersvan, Namrata-Ibm, Nathan Luehr, Naurril, Nayana Thorat, Nicolas Lopez,
116Niranjan Hasabnis, Nolan Liu, Nouce, Oliver Hennigh, osdamv, Patrik Erdes,
117Patryk Chrabaszcz, Pavel Christof, Penghao Cen, postBG, Qingqing Cao, Qingying Chen, qjivy,
118Raphael, Rasmi, raymondxyang, Renze Yu, resec, Roffel, Ruben Vereecken, Ryohei Kuroki,
119sandipmgiri, Santiago Castro, Scott Kirkland, Sean Vig, Sebastian Raschka, Sebastian Weiss,
120Sergey Kolesnikov, Sergii Khomenko, Shahid, Shivam Kotwalia, Stuart Berg, Sumit Gouthaman,
121superzerg, Sven Mayer, tetris, Ti Zhou, Tiago Freitas Pereira, Tian Jin, Tomoaki Oiki,
122Vaibhav Sood, vfdev, Vivek Rane, Vladimir Moskva, wangqr, Weber Xie, Will Frey,
123Yan Facai (颜发才), yanivbl6, Yaroslav Bulatov, Yixing Lao, Yong Tang, youkaichao,
124Yuan (Terry) Tang, Yue Zhang, Yuxin Wu, Ziming Dong, ZxYuan, 黄璞
125
126We are also grateful to all who filed issues or helped resolve them, asked and
127answered questions, and were part of inspiring discussions.
Derek Murrayf6e187a2017-10-04 19:07:31 -0700128
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700129# Release 1.3.0
130
Andrew Harp6e3e7d12017-08-21 12:10:44 -0700131See also [TensorBoard 0.1.4](https://github.com/tensorflow/tensorboard/releases/tag/0.1.4) release notes.
132
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700133## Major Features and Improvements
Benoit Steiner05c491d2017-08-01 16:16:52 -0700134* Added canned estimators to Tensorflow library. List of added estimators:
135 * `DNNClassifier`
136 * `DNNRegressor`
137 * `LinearClassifier`
138 * `LinearRegressor`
139 * `DNNLinearCombinedClassifier`
140 * `DNNLinearCombinedRegressor`.
Andrew Harp6e3e7d12017-08-21 12:10:44 -0700141* All our prebuilt binaries have been built with cuDNN 6. We anticipate releasing TensorFlow 1.4 with cuDNN 7.
A. Unique TensorFlower28ce1d12017-08-15 12:08:29 -0700142* `import tensorflow` now goes much faster.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700143* Adds a file cache to the GCS filesystem with configurable max staleness for file contents. This permits caching of file contents across close/open boundaries.
144* Added an axis parameter to `tf.gather`.
145* Added a `constant_values` keyword argument to `tf.pad`.
146* Adds `Dataset.interleave` transformation.
147* Add `ConcatenateDataset` to concatenate two datasets.
148* Added Mobilenet support to TensorFlow for Poets training script.
149* Adds a block cache to the GCS filesystem with configurable block size and count.
150* SinhArcSinh bijector added.
151* Added `Dataset.list_files` API.
152* Introduces new operations and Python bindings for the Cloud TPU.
153* Adding TensorFlow-iOS CocoaPod for symmetry with tensorflow-android.
154* Introduces base implementations of ClusterResolvers.
155* Unify memory representations of TensorShape and PartialTensorShape. As a consequence, tensors now have a maximum of 254 dimensions, not 255.
156* Changed references to LIBXSMM to use version 1.8.1.
Benoit Steiner05c491d2017-08-01 16:16:52 -0700157* TensorFlow Debugger (tfdbg):
158 * Display summaries of numeric tensor values with the `-s` flag to command `print_tensor` or `pt`.
159 * Display feed values with the `print_feed` or `pf` command and clickable links in the curses UI.
160 * Runtime profiler at the op level and the Python source line level with the `run -p` command.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700161* Initial release of the statistical distribution library `tf.distributions`.
Martin Wicked57572e2017-09-02 19:21:45 -0700162* GPU kernels and speed improvements for unary `tf.where` and `tf.nn.top_k`.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700163* Monotonic Attention wrappers added to `tf.contrib.seq2seq`.
Benoit Steiner05c491d2017-08-01 16:16:52 -0700164* Added `tf.contrib.signal`, a library for signal processing primitives.
A. Unique TensorFlower28ce1d12017-08-15 12:08:29 -0700165* Added `tf.contrib.resampler`, containing CPU and GPU ops for differentiable resampling of images.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700166
167## Breaking Changes to the API
168* `tf.RewriterConfig` was removed from the Python API after being available in 1.2 release candidates (it was never in an actual release). Graph rewriting is still available, just not as `tf.RewriterConfig`. Instead add an explicit import.
169* Breaking change to `tf.contrib.data.Dataset` APIs that expect a nested structure. Lists are now converted to `tf.Tensor` implicitly. You may need to change uses of lists to tuples in existing code. In addition, dicts are now supported as a nested structure.
170
171## Changes to contrib APIs
172* Adds tf.contrib.nn.rank_sampled_softmax_loss, a sampled-softmax variant that can improve rank loss.
173* `tf.contrib.metrics`.{streaming_covariance,streaming_pearson_correlation} modified to return nan when they have seen less or equal to 1 unit of weight.
174* Adds time series models to contrib. See contrib/timeseries/README.md for details.
175* Adds FULLY_CONNECTED Op to tensorflow/contrib/lite/schema.fbs
176
Andrew Harp6e3e7d12017-08-21 12:10:44 -0700177## Known Issues
178* Tensorflow_gpu compilation fails with Bazel 0.5.3.
179
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700180## Bug Fixes and Other Changes
Benoit Steiner05c491d2017-08-01 16:16:52 -0700181* Fixes `strides` and `begin` dtype mismatch when slicing using int64 Tensor index in python.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700182* Improved convolution padding documentation.
183* Add a tag constant, gpu, to present graph with GPU support.
184* `saved_model.utils` now support SparseTensors transparently.
185* A more efficient implementation of non-max suppression.
186* Add support for the shrinkage-type L2 to FtrlOptimizer in addition to the online L2 it already supports.
187* Fix negative variance in moments calculation.
188* Expand UniqueOp Benchmark Tests to cover more collision cases.
189* Improves stability of GCS filesystem on Mac.
190* Add time estimation to HloCostAnalysis.
191* Fixed the bug in Estimator that params in constructor was not a deepcopy of the user provided one. This bugs inadvertently enabled user to mutate the params after the creation of Estimator, leading to potentially undefined behavior.
192* Added None check for save_path in `saver.restore`.
193* Register devices under their legacy names in device_mgr to ease the transition to clusterspec-propagated configurations.
194* VectorExponential added to distributions.
195* Add a bitwise module with bitwise_and, bitwise_or, bitwise_xor, and invert functions.
196* Add fixed-grid ODE integration routines.
197* Allow passing bounds to ScipyOptimizerInterface.
198* Correctness fixes for fft_length parameter to `tf.spectral.rfft` & `tf.spectral.irfft`.
199* Exported model signatures using the 'predict' method will no longer have their input and output keys silently ignored and rewritten to 'inputs' and 'outputs'. If a model was exported with different names before 1.2, and is now served with tensorflow/serving, it will accept requests using 'inputs' and 'outputs'. Starting at 1.2, such a model will accept the keys specified during export. Therefore, inference requests using 'inputs' and 'outputs' may start to fail. To fix this, either update any inference clients to send requests with the actual input and output keys used by the trainer code, or conversely, update the trainer code to name the input and output Tensors 'inputs' and 'outputs', respectively. Signatures using the 'classify' and 'regress' methods are not affected by this change; they will continue to standardize their input and output keys as before.
200* Add in-memory caching to the Dataset API.
201* Set default end_of_sequence variable in datasets iterators to false.
A. Unique TensorFlower28ce1d12017-08-15 12:08:29 -0700202* [Performance] Increase performance of `tf.layers.conv2d` when setting use_bias=True by 2x by using nn.bias_add.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700203* Update iOS examples to use CocoaPods, and moved to tensorflow/examples/ios.
204* Adds a family= attribute in `tf.summary` ops to allow controlling the tab name used in Tensorboard for organizing summaries.
205* When GPU is configured, do not require --config=cuda, instead, automatically build for GPU if this is requested in the configure script.
206* Fix incorrect sampling of small probabilities in CPU/GPU multinomial.
207* Add a list_devices() API on sessions to list devices within a cluster. Additionally, this change augment the ListDevices master API to support specifying a session.
208* Allow uses of over-parameterized separable convolution.
209* TensorForest multi-regression bug fix.
210* Framework now supports armv7, cocoapods.org now displays correct page.
211* Script to create iOS framework for CocoaPods.
212* Android releases of TensorFlow are now pushed to jcenter for easier integration into apps. See https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/android/README.md for more details.
Benoit Steiner05c491d2017-08-01 16:16:52 -0700213* TensorFlow Debugger (tfdbg):
214 * Fixed a bug that prevented tfdbg from functioning with multi-GPU setups.
215 * Fixed a bug that prevented tfdbg from working with `tf.Session.make_callable`.
Vijay Vasudevana1fba7f2017-07-28 10:58:56 -0700216
217## Thanks to our Contributors
218
219This release contains contributions from many people at Google, as well as:
220
2214F2E4A2E, Adriano Carmezim, Adrià Arrufat, Alan Yee, Alex Lattas, Alex Rothberg,
222Alexandr Baranezky, Ali Siddiqui, Andreas Solleder, Andrei Costinescu, Andrew Hundt,
223Androbin, Andy Kernahan, Anish Shah, Anthony Platanios, Arvinds-Ds, b1rd, Baptiste
224Arnaud, Ben Mabey, Benedikt Linse, Beomsu Kim, Bo Wang, Boyuan Deng, Brett Koonce,
225Bruno Rosa, Carl Thomé, Changming Sun, Chase Roberts, Chirag Bhatia, Chris Antaki,
226Chris Hoyean Song, Chris Tava, Christos Nikolaou, Croath Liu, cxx, Czxck001, Daniel
227Ylitalo, Danny Goodman, Darren Garvey, David Brailovsky, David Norman, DavidNorman,
228davidpham87, ddurham2, Dhruv, DimanNe, Drew Hintz, Dustin Tran, Earthson Lu, ethiraj,
229Fabian Winnen, Fei Sun, Freedom" Koan-Sin Tan, Fritz Obermeyer, Gao, Xiang, Gautam,
230Guenther Schmuelling, Gyu-Ho Lee, Hauke Brammer, horance, Humanity123, J Alammar,
231Jayeol Chun, Jeroen BéDorf, Jianfei Wang, jiefangxuanyan, Jing Jun Yin, Joan Puigcerver,
232Joel Hestness, Johannes Mayer, John Lawson, Johnson145, Jon Malmaud, Jonathan Alvarez-Gutierrez,
233Juang, Yi-Lin, Julian Viereck, Kaarthik Sivashanmugam, Karl Lessard, karl@kubx.ca, Kevin
234Carbone, Kevin Van Der Burgt, Kongsea, ksellesk, lanhin, Lef Ioannidis, Liangliang He,
235Louis Tiao, Luke Iwanski, LáSzló Csomor, magixsno, Mahmoud Abuzaina, Marcel Hlopko, Mark
236Neumann, Maxwell Paul Brickner, mdfaijul, MichaëL Defferrard, Michał JastrzęBski, Michele
237Colombo, Mike Brodie, Mosnoi Ion, mouradmourafiq, myPrecious, Nayana Thorat,
238Neeraj Kashyap, Nelson Liu, Niranjan Hasabnis, Olivier Moindrot, orome, Pankaj Gupta, Paul
239Van Eck, peeyush18, Peng Yu, Pierre, preciousdp11, qjivy, Raingo, raoqiyu, ribx, Richard S.
240Imaoka, Rishabh Patel, Robert Walecki, Rockford Wei, Ryan Kung, Sahil Dua, Sandip Giri, Sayed
241Hadi Hashemi, sgt101, Shitian Ni, Shuolongbj, Siim PõDer, Simon Perkins, sj6077, SOLARIS,
242Spotlight0xff, Steffen Eberbach, Stephen Fox, superryanguo, Sven Mayer, Tapan Prakash,
243Tiago Morais Morgado, Till Hoffmann, Tj Rana, Vadim Markovtsev, vhasanov, Wei Wu,
244windead, Yan (Asta) Li, Yan Chen, Yann Henon, Yi Wang, Yong Tang, yorkie, Yuan (Terry)
245Tang, Yuxin Wu, zhengjiajin, zhongzyd, 黄璞
246
247We are also grateful to all who filed issues or helped resolve them, asked and
248answered questions, and were part of inspiring discussions.
249
Shanqing Cai90d64212017-07-10 19:22:04 -0700250# Release 1.2.1
251
252## Bug Fixes and Other Changes
253* Updating markdown version required to >= 2.6.8.
254* Support tensors as dropout rates again, by removing the min(max(..))
255
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700256# Release 1.2.0
Derek Murray4e69ce82017-04-11 10:31:27 -0800257
258## Major Features and Improvements
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700259* Python 3.6 support on Windows.
Dan Ringwalt692fad22017-05-05 09:09:05 -0800260* Added `tf.layers.conv3d_transpose` layer for spatio temporal deconvolution.
Derek Murray4e69ce82017-04-11 10:31:27 -0800261* Added `tf.Session.make_callable()`, which provides a lower overhead means of running a similar step multiple times.
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700262* Added libverbs-based RDMA support to contrib (courtesy @junshi15 from Yahoo).
263* Bring `tf.feature_column.*` into the API. Non-deprecated functionality from `tf.contrib.layers.*` is moved to `tf.feature_column.*` with cosmetic changes.
Eugene Brevdo827d2e42017-05-22 17:32:50 -0700264* `RNNCell` objects now subclass `tf.layers.Layer`. The strictness described
Eugene Brevdoe8482ab2017-04-21 16:34:59 -0800265 in the TensorFlow 1.1 release is gone: The first time an RNNCell is used,
266 it caches its scope. All future uses of the RNNCell will reuse variables from
267 that same scope. This is a breaking change from the behavior of RNNCells
268 in TensorFlow versions <= 1.0.1. TensorFlow 1.1 had checks in place to
269 ensure old code works correctly with the new semantics; this version
270 allows more flexible uses of RNNCell but can lead to subtle errors if
271 using code meant for TensorFlow <= 1.0.1. For example, writing:
272 `MultiRNNCell([lstm] * 5)` will now build a 5-layer LSTM stack where each
273 layer shares the **same** parameters. To get 5 layers each with their own
274 parameters, write: `MultiRNNCell([LSTMCell(...) for _ in range(5)])`.
275 If at all unsure, first test your code with TF 1.1; ensure it raises no
276 errors, and then upgrade to TF 1.2.
Eugene Brevdo827d2e42017-05-22 17:32:50 -0700277* RNNCells' variable names have been renamed for consistency with Keras layers.
278 Specifically, the previous variable names "weights" and "biases" have
279 been changed to "kernel" and "bias", respectively.
280 This may cause backward incompatibility with regard to your old
281 checkpoints containing such RNN cells, in which case you can use the tool
282 [checkpoint_convert script](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/rnn/python/tools/checkpoint_convert.py)
283 to convert the variable names in your old checkpoints.
284* Many of the RNN functions and classes that were in the `tf.nn` namespace
285 before the 1.0 release and which were moved to `tf.contrib.rnn` have now
286 been moved back to the core namespace. This includes
287 `RNNCell`, `LSTMCell`, `GRUCell`, and a number of other cells. These
288 now reside in `tf.nn.rnn_cell` (with aliases in `tf.contrib.rnn` for backwards
289 compatibility). The original `tf.nn.rnn` function is now `tf.nn.static_rnn`,
290 and the bidirectional static and state saving static rnn functions are also
291 now back in the `tf.nn` namespace.
292
293 Notable exceptions are the `EmbeddingWrapper`, `InputProjectionWrapper` and
294 `OutputProjectionWrapper`, which will slowly be moved to deprecation
295 in `tf.contrib.rnn`. These are inefficient wrappers that should often
296 be replaced by calling `embedding_lookup` or `layers.dense` as pre- or post-
297 processing of the rnn. For RNN decoding, this functionality has been replaced
298 with an alternative API in `tf.contrib.seq2seq`.
A. Unique TensorFlowerce322282017-01-07 09:19:27 -0800299* Intel MKL Integration (https://software.intel.com/en-us/articles/tensorflow-optimizations-on-modern-intel-architecture). Intel developed a number of
300 optimized deep learning primitives: In addition to matrix multiplication and
301 convolution, these building blocks include:
302 Direct batched convolution
303 Pooling: maximum, minimum, average
304 Normalization: LRN, batch normalization
305 Activation: rectified linear unit (ReLU)
306 Data manipulation: multi-dimensional transposition (conversion), split,
307 concat, sum and scale.
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700308* TensorForest Estimator now supports SavedModel export for serving.
309* Support client-provided ClusterSpec's and propagate them to all workers to enable the creation of dynamic TensorFlow clusters.
310* TensorFlow C library now available for Windows.
311* We released a new open-source version of TensorBoard.
312* [`SavedModel CLI`](https://www.tensorflow.org/versions/master/programmers_guide/saved_model_cli) tool available to inspect and execute MetaGraph in SavedModel
313* Android releases of TensorFlow are now pushed to jcenter for easier
314 integration into apps. See
315 https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/android/README.md
316 for more details.
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700317
318## Deprecations
319
320* TensorFlow 1.2 may be the last time we build with cuDNN 5.1. Starting with
321 TensorFlow 1.3, we will try to build all our prebuilt binaries with cuDNN 6.0.
322 While we will try to keep our source code compatible with cuDNN 5.1, it will
323 be best effort.
324
325## Breaking Changes to the API
326* `org.tensorflow.contrib.android.TensorFlowInferenceInterface` now throws exceptions where possible and has simplified method signatures.
327
328## Changes to contrib APIs
329* Added `tf.contrib.util.create_example`.
330* Added bilinear interpolation to `tf.contrib.image`.
331* Add `tf.contrib.stateless` for random ops with custom seed control.
332* MultivariateNormalFullCovariance added to contrib/distributions/
333* tensorflow/contrib/rnn undergoes RNN cell variable renaming for
334 consistency with Keras layers. Specifically, the previous variable names
335 "weights" and "biases" are changed to "kernel" and "bias", respectively.
336 This may cause backward incompatibility with regard to your old
337 checkpoints containing such RNN cells, in which case you can use the
338 [checkpoint_convert script](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/rnn/python/tools/checkpoint_convert.py)
339 to convert the variable names in your old checkpoints.
A. Unique TensorFlower50b999a2017-06-27 16:33:00 -0700340* Added `tf.contrib.kernel_methods` module with Ops and estimators for primal
341 (explicit) kernel methods in TensorFlow.
Derek Murray4e69ce82017-04-11 10:31:27 -0800342
Vijay Vasudevan15f32d92017-05-10 12:31:10 -0700343## Bug Fixes and Other Changes
344* In python, `Operation.get_attr` on type attributes returns the Python DType
345 version of the type to match expected get_attr documentation rather than the
346 protobuf enum.
Jonathan Hseu1b5235f2017-06-09 10:37:18 -0700347* tensorflow/contrib/rnn undergoes RNN cell variable renaming for
348 consistency with Keras layers. Specifically, the previous variable names
349 "weights" and "biases" are changed to "kernel" and "bias", respectively.
350* Changed MIN_SDK version to 8.0 when building iOS libraries.
351* Fixed LIBXSMM integration.
352* Make decode_jpeg/decode_png/decode_gif handle all formats, since users frequently try to decode an image as the wrong type.
353* Improve implicit broadcasting lowering.
354* Improving stability of GCS/Bigquery clients by a faster retrying of stale transmissions.
355* Remove OpKernelConstruction::op_def() as part of minimizing proto dependencies.
356* VectorLaplaceDiag distribution added.
357* Android demo no longer requires libtensorflow_demo.so to run (libtensorflow_inference.so still required)
358* Added `categorical_column_with_vocabulary_file`.
359* Introduce ops for batching/unbatching tensors across Session::Run() calls.
360* Add tf.log_sigmoid(x) = tf.log(tf.sigmoid(x)) = -tf.nn.softplus(-x).
361* Changed hooks lists to immutable tuples, and now allow any iterable for the associated arguments.
362* Introduce TFDecorator.
363* Added an Mfcc op for speech feature generation.
364* Improved DirectSession::Run() overhead and error checking. Feeding a value of the wrong type will now synchronously raise an INVALID_ARGUMENT error instead of asynchronously raising an INTERNAL error. Code that depends on the (undefined) behavior when feeding a tensor of the wrong type may need to be updated.
365* Added unreduced NONE, and reduced MEAN options for losses. Removed "WEIGHTED_" prefix from other Reduction constants.
366* assertAllClose now handles dicts.
367* Added Gmock matcher for HloInstructions.
368* Add var name to errors on variable restore.
369* Added an AudioSpectrogram op for audio feature generation.
370* Added `reduction` arg to losses.
371* `tf.placeholder` can represent scalar shapes and partially known.
372* Remove estimator_spec(mode) argument.
373* Added an AudioSpectrogram op for audio feature generation.
374* TensorBoard disables all runs by default if there are more than 40 runs.
375* Removed old doc generator code.
376* GCS file system integration now supports domain buckets, e.g gs://bucket.domain.com/path.
377* Add `tf.summary.text` for outputting text to TensorBoard.
378* The "run" command of tfdbg's command-line interface now supports filtering of tensors by node name, op type and tensor dtype.
379* `tf.string_to_number` now supports int64 and float64 outputs.
380
381## Thanks to our Contributors
382
383This release contains contributions from many people at Google, as well as:
384
3854F2E4A2E, Aaron Schumacher, Abhi Agg, admcrae, Adriano Carmezim, Adrià Arrufat,
386agramesh1, Akimitsu Seo, Alan Mosca, Alex Egg, Alex Rothberg, Alexander Heinecke,
387Alexander Matyasko, Alexandr Baranezky, Alexandre Caulier, Ali Siddiqui, Anand Venkat,
388Andrew Hundt, Androbin, Anmol Sharma, Arie, Arno Leist, Arron Cao, AuréLien Geron, Bairen Yi,
389Beomsu Kim, Carl Thomé, cfperez, Changming Sun, Corey Wharton, critiqjo, Dalei Li, Daniel
390Rasmussen, Daniel Trebbien, DaríO Hereñú, David Eng, David Norman, David Y. Zhang, Davy Song, ddurham2,
391Deepak Subburam, Dmytro Kyrychuk, Dominic Rossi, Dominik SchlöSser, Dustin Tran,
392Eduardo Pinho, Egil Martinsson, Elliot Saba, Eric Bigelow, Erik Smistad, Evan Klitzke,
393Fabrizio Milo, Falcon Dai, Fei Gao, FloopCZ, Fung Lam, Gautam, GBLin5566, Greg Peatfield,
394Gu Wang, Guenther Schmuelling, Hans Pabst, Harun Gunaydin, Huaizheng, Ido Shamay, Ikaro
395Silva, Ilya Edrenkin, Immexxx, James Mishra, Jamie Cooke, Jay Young, Jayaram Bobba,
396Jianfei Wang, jinghua2, Joey Meyer, John Maidens, Jonghoon Jin, Julian Villella,
397Jun Kim, Jun Shi, Junwei Pan, jyegerlehner, Karan Desai, Karel Van De Plassche,
398Kb Sriram, KhabarlakKonstantin, Koan-Sin Tan, krivard, Kwotsin, Leandro Gracia Gil,
399Li Chen, Liangliang He, Louie Helm, lspvic, Luiz Henrique Soares, LáSzló Csomor,
400Mark Wong, Mathew Wicks, Matthew Rahtz, Maxwell Paul Brickner, Michael Hofmann, Miguel
401Flores Ruiz De Eguino, MikeTam1021, Mortada Mehyar, Mycosynth, Namnamseo,
402Nate Harada, Neven Miculinic, Nghia Tran, Nick Lyu, Niranjan Hasabnis, Nishidha, Oleksii
403Kuchaiev, Oyesh Mann Singh, Panmari, Patrick, Paul Van Eck, Piyush Chaudhary, Quim Llimona,
404Raingo, Richard Davies, Ruben Vereecken, Sahit Chintalapudi, Sam Abrahams, Santiago Castro,
405Scott Sievert, Sean O'Keefe, Sebastian Schlecht, Shane, Shubhankar Deshpande, Spencer Schaber,
406Sunyeop Lee, t13m, td2014, Thomas H. P. Andersen, Toby Petty, Umang Mehta,
407Vadim Markovtsev, Valentin Iovene, Vincent Zhao, Vit Stepanovs, Vivek Rane, Vu Pham, wannabesrevenge,
408weipingpku, wuhaixutab, wydwww, Xiang Gao, Xiaolin Lin, xiaoyaozhuzi, Yaroslav Bulatov, Yi Liu,
409Yoshihiro Sugi, Yuan (Terry) Tang, Yuming Wang, Yuxin Wu, Zader Zheng, Zhaojun Zhang, zhengjiajin,
410ZhipengShen, Ziming Dong, zjj2wry
411
412We are also grateful to all who filed issues or helped resolve them, asked and
413answered questions, and were part of inspiring discussions.
Derek Murray4e69ce82017-04-11 10:31:27 -0800414
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800415# Release 1.1.0
416
417## Major Features and Improvements
418* Added Java API support for Windows.
419* Added `tf.spectral` module. Moved existing FFT ops to `tf.spectral` while
420 keeping an alias in the old location (`tf.*`).
421* Added 1D, 2D and 3D Fourier transform ops for real signals to `tf.spectral`.
422* Added a `tf.bincount` function.
423* Added Keras 2 API to contrib.
424* Added a new lightweight queue-like object - `RecordInput`.
425* Added `tf.contrib.image.compose_transforms` function.
426* Bring `tf.estimator.*` into the API. Non-deprecated functionality from `tf.contrib.learn.Estimator` is moved to `tf.estimator.Estimator` with cosmetic changes.
427* Docker images: TF images on gcr.io and Docker Hub are upgraded to ubuntu:16.04.
428* Added the following features to TensorFlow Debugger (tfdbg):
429 * Ability to inspect Python source file against TF ops and tensors (command `print_source` / `ps`)
430 * New navigation bar in Curses-based UI
431 * NodeStepper (command `invoke_stepper`) now uses intermediate tensor dumps. It also uses `TensorHandles` as direct feeds during successive `cont` calls for improved performance and reduced memory consumption.
Rohan Jaind0697152017-04-07 08:29:08 -0800432* Initial release of installation guides for Java, C, and Go.
Shanqing Cai32694232017-04-22 06:08:17 -0800433* Added Text Dashboard to TensorBoard.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800434
435## Deprecations
436
437* TensorFlow 1.1.0 will be the last time we release a binary with Mac GPU support. Going forward, we will stop testing on Mac GPU systems. We continue to welcome patches that maintain Mac GPU support, and we will try to keep the Mac GPU build working.
438
439## Changes to contrib APIs
440* The behavior of RNNCells is now stricter due to the transition towards making RNNCells act more like Keras layers.
441 * If an RNNCell is used twice in two different variable scopes, an error is raised describing how to avoid this behavior.
442 * If an RNNCell is used in a variable scope with existing conflicting variables, an error is raised showing that the RNNCell must be constructed with argument `reuse=True`.
443* Deprecated contrib/distributions `pmf`, `pdf`, `log_pmf`, `log_pdf`.
444* Moved `bayesflow.special_math` to distributions.
445* `tf.contrib.tensor_forest.python.tensor_forest.RandomForestDeviceAssigner` removed.
446* Changed some MVN classes and parameters:
447 * `tf.contrib.distributions.MultivariateNormalFull` replaced by `tf.contrib.distributions.MultivariateNormalTriL`.
448 * `tf.contrib.distributions.MultivariateNormalCholesky` replaced by `tf.contrib.distributions.MultivariateNormalTriL`
449 * `tf.contrib.distributions.MultivariateNormalDiagWithSoftplusStDev` replaced
450 by `tf.contrib.distributions.MultivariateNormalDiagWithSoftplusScale`
451 * `tf.contrib.distributions.MultivariateNormalDiag` arguments changed from `mu`, `diag_stddev` to `log`, `scale_diag`.
452 * `tf.contrib.distributions.MultivariateNormalDiagPlusVDVT` removed.
453 * `tf.contrib.distributions.MultivariateNormalDiagPlusLowRank` added.
454
455## Bug Fixes and Other Changes
456* Java: Support for loading models exported using the SavedModel API (courtesy @EronWright).
457* Go: Added support for incremental graph execution.
458* Fix a bug in the WALS solver when single-threaded.
459* Added support for integer sparse feature values in `tf.contrib.layers.sparse_column_with_keys`.
460* Fixed `tf.set_random_seed(0)` to be deterministic for all ops.
461* Stability improvements for the GCS file system support.
462* Improved TensorForest performance.
463* Added support for multiple filename globs in `tf.matching_files`.
464* `LogMessage` now includes a timestamp as beginning of a message.
465* Added MultiBox person detector example standalone binary.
466* Android demo: Makefile build functionality added to build.gradle to fully support building TensorFlow demo in Android on Windows.
467* Android demo: read MultiBox priors from txt file rather than protobuf.
468* Added colocation constraints to `StagingArea`.
469* `sparse_matmul_op` reenabled for Android builds.
470* Restrict weights rank to be the same as the broadcast target, to avoid ambiguity on broadcast rules.
471* Upgraded libxsmm to 1.7.1 and applied other changes for performance and memory usage.
472* Fixed bfloat16 integration of LIBXSMM sparse mat-mul.
473* Improved performance and reduce memory usage by allowing ops to forward input buffers to output buffers and perform computations in-place.
474* Improved the performance of CPU assignment for strings.
475* Speed up matrix * vector multiplication and matrix * matrix with unknown shapes.
476* C API: Graph imports now support input remapping, control dependencies, and returning imported nodes (see `TF_GraphImportGraphDefWithReturnOutputs()`)
477* Multiple C++ API updates.
478* Multiple TensorBoard updates including:
479 * Users can now view image summaries at various sampled steps (instead of just the last step).
480 * Bugs involving switching runs as well as the image dashboard are fixed.
481 * Removed data download links from TensorBoard.
482 * TensorBoard uses a relative data directory, for easier embedding.
483 * TensorBoard automatically ignores outliers for domain calculation, and formats proportional values consistently.
484* Multiple tfdbg bug fixes:
485 * Fixed Windows compatibility issues.
486 * Command history now persists across runs.
Rohan Jaind0697152017-04-07 08:29:08 -0800487 * Bug fix in graph validation related to `tf.while_loops`.
488* Java Maven fixes for bugs with Windows installation.
Shanqing Cai32694232017-04-22 06:08:17 -0800489* Backport fixes and improvements from external keras.
490* Keras config file handling fix.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800491
492## Thanks to our Contributors
493
494This release contains contributions from many people at Google, as well as:
495
496A. Besir Kurtulmus, Adal Chiriliuc, @akash, Alec-Desouza, Alex Rothberg, Alex
A. Unique TensorFlower191825e2017-11-27 06:29:45 -0800497Sergeev, Alexander Heinecke, Allen Guo, Andreas Madsen, Ankesh Anand, Anton
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800498Loss, @Aravind, @Arie, Ashutosh Das, AuréLien Geron, Bairen Yi, @bakunyo, Ben
Rohan Jaind0697152017-04-07 08:29:08 -0800499Visser, Brady Zhou, Calpa Liu, Changming Sun, Chih Cheng Liang, Christopher
500Berner, Clark Zinzow, @Conchylicultor, Dan Ellis, Dan J, Dan Jarvis, Daniel
501Ylitalo, Darren Garvey, David Norman, David Truong, @DavidNorman, Dimitar
502Pavlov, Dmitry Persiyanov, @Eddie, @elirex, Erfan Noury, Eron Wright, Evgeny
503Mazovetskiy, Fabrizio (Misto) Milo, @fanlu, Fisher Coder, Florian Courtial,
504Franck Dernoncourt, Gagan Goel, Gao, Xiang, @Gautam, Gefu Tang, @guilherme,
505@guschmue, Hannah Provenza, Hans Pabst, @hartb, Hsiao Yi, Huazuo Gao, Igor
506ChorążEwicz, Ivan Smirnov, Jakub Kolodziejczyk, Jason Gavris, Jason Morton, Jay
507Young, Jayaram Bobba, Jeremy Sawruk, Jiaming Liu, Jihun Choi, @jiqiu, Joan Thibault,
508John C F, Jojy George Varghese, Jon Malmaud, Julian Berman, Julian Niedermeier,
509Junpeng Lao, Kai Sasaki, @Kankroc, Karl Lessard, Kyle Bostelmann, @Lezcano, Li
510Yi, Luo Yun, @lurker, Mahmoud-Abuzaina, Mandeep Singh, Marek Kolodziej, Mark
511Szepieniec, Martial Hue, Medhat Omr, Memo Akten, Michael Gharbi, MichaëL Defferrard,
512Milan Straka, @MircoT, @mlucool, Muammar Ibn Faisal, Nayana Thorat, @nghiattran,
513Nicholas Connor, Nikolaas Steenbergen, Niraj Patel, Niranjan Hasabnis, @Panmari,
514Pavel Bulanov, Philip Pries Henningsen, Philipp Jund, @polonez, Prayag Verma, Rahul
515Kavi, Raphael Gontijo Lopes, @rasbt, Raven Iqqe, Reid Pryzant, Richard Shin, Rizwan
516Asif, Russell Kaplan, Ryo Asakura, RüDiger Busche, Saisai Shao, Sam Abrahams, @sanosay,
517Sean Papay, @seaotterman, @selay01, Shaurya Sharma, Sriram Narayanamoorthy, Stefano
518Probst, @taknevski, @tbonza, @teldridge11, Tim Anglade, Tomas Reimers, Tomer Gafner,
519Valentin Iovene, Vamsi Sripathi, Viktor Malyi, Vit Stepanovs, Vivek Rane, Vlad Firoiu,
520@wangg12, @will, Xiaoyu Tao, Yaroslav Bulatov, Yi Liu, Yuan (Terry) Tang, @Yufeng,
521Yuming Wang, Yuxin Wu, Zafar Takhirov, Ziming Dong
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800522
523We are also grateful to all who filed issues or helped resolve them, asked and
524answered questions, and were part of inspiring discussions.
525
526
Martin Wickebc456e32017-03-23 12:31:16 -0800527# Release 1.0.1
528
529## Bug Fixes and Other Changes
530* Change GraphConstructor to not increase the version when importing, but instead take the min of all versions.
531* Google Cloud Storage fixes.
532* Removed `tf.core` and `tf.python` modules from the API. These were never intended to be exposed. Please use the same objects through top-level `tf` module instead.
533
Benoit Steiner639b4e72017-02-08 09:25:09 -0800534# Release 1.0.0
535
536## Major Features and Improvements
537* XLA (experimental): initial release of [XLA](https://www.tensorflow.org/versions/master/experimental/xla/), a domain-specific compiler for TensorFlow graphs, that targets CPUs and GPUs.
538* TensorFlow Debugger (tfdbg): command-line interface and API.
539* New python 3 docker images added.
540* Made pip packages pypi compliant. TensorFlow can now be installed by `pip
541 install tensorflow` command.
542* Several python API calls have been changed to resemble NumPy more closely.
543* Android: person detection + tracking demo implementing Scalable Object
544 Detection using Deep Neural Networks.
545* New (experimental) [Java API](https://github.com/tensorflow/tensorflow/tree/master/tensorflow/java).
546* Add new Android image stylization demo based on "A Learned Representation For Artistic Style", and add YOLO object detector support.
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800547
548## Breaking Changes to the API
Benoit Steiner639b4e72017-02-08 09:25:09 -0800549To help you upgrade your existing TensorFlow Python code to match the API changes below, we have prepared a [conversion script](https://github.com/tensorflow/tensorflow/tree/master/tensorflow/tools/compatibility).
550* TensorFlow/models have been moved to a separate github repository.
Andrew Sellefcc39232016-11-22 10:04:37 -0800551* Division and modulus operators (/, //, %) now match Python (flooring)
Andrew Sellef0a6d1e2016-12-13 16:01:12 -0800552 semantics. This applies to `tf.div` and `tf.mod` as well. To obtain forced
553 integer truncation based behaviors you can use `tf.truncatediv`
554 and `tf.truncatemod`.
555* `tf.divide()` is now the recommended division function. `tf.div()` will
556 remain, but its semantics do not respond to Python 3 or `from future`
557 mechanisms.
558* tf.reverse() now takes indices of axes to be reversed. E.g.
559 `tf.reverse(a, [True, False, True])` must now be written as
560 `tf.reverse(a, [0, 2])`. `tf.reverse_v2()` will remain until 1.0 final.
561* `tf.mul`, `tf.sub` and `tf.neg` are deprecated in favor of `tf.multiply`,
562 `tf.subtract` and `tf.negative`.
A. Unique TensorFlower44977ae2016-12-15 18:36:06 -0800563* `tf.pack` and `tf.unpack` are deprecated in favor of `tf.stack` and
564 `tf.unstack`.
565* `TensorArray.pack` and `TensorArray.unpack` are getting deprecated in favor of
566 `TensorArray.stack` and `TensorArray.unstack`.
Andrew Sellef0a6d1e2016-12-13 16:01:12 -0800567* The following Python functions have had their arguments changed to use `axis`
568 when referring to specific dimensions. We have kept the old keyword arguments
569 for compatibility currently, but we will be removing them well before the
570 final 1.0.
571 * `tf.argmax`: `dimension` becomes `axis`
572 * `tf.argmin`: `dimension` becomes `axis`
573 * `tf.count_nonzero`: `reduction_indices` becomes `axis`
574 * `tf.expand_dims`: `dim` becomes `axis`
575 * `tf.reduce_all`: `reduction_indices` becomes `axis`
576 * `tf.reduce_any`: `reduction_indices` becomes `axis`
577 * `tf.reduce_join`: `reduction_indices` becomes `axis`
578 * `tf.reduce_logsumexp`: `reduction_indices` becomes `axis`
579 * `tf.reduce_max`: `reduction_indices` becomes `axis`
580 * `tf.reduce_mean`: `reduction_indices` becomes `axis`
581 * `tf.reduce_min`: `reduction_indices` becomes `axis`
582 * `tf.reduce_prod`: `reduction_indices` becomes `axis`
583 * `tf.reduce_sum`: `reduction_indices` becomes `axis`
584 * `tf.reverse_sequence`: `batch_dim` becomes `batch_axis`, `seq_dim` becomes `seq_axis`
585 * `tf.sparse_concat`: `concat_dim` becomes `axis`
586 * `tf.sparse_reduce_sum`: `reduction_axes` becomes `axis`
587 * `tf.sparse_reduce_sum_sparse`: `reduction_axes` becomes `axis`
588 * `tf.sparse_split`: `split_dim` becomes `axis`
589* `tf.listdiff` has been renamed to `tf.setdiff1d` to match NumPy naming.
590* `tf.inv` has been renamed to be `tf.reciprocal` (component-wise reciprocal)
591 to avoid confusion with `np.inv` which is matrix inversion
592* tf.round now uses banker's rounding (round to even) semantics to match NumPy.
593* `tf.split` now takes arguments in a reversed order and with different
594 keywords. In particular, we now match NumPy order as
595 `tf.split(value, num_or_size_splits, axis)`.
596* `tf.sparse_split` now takes arguments in reversed order and with different
597 keywords. In particular we now match NumPy order as
598 `tf.sparse_split(sp_input, num_split, axis)`. NOTE: we have temporarily
599 made `tf.sparse_split` require keyword arguments.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800600* `tf.concat` now takes arguments in reversed order and with different keywords. In particular we now match NumPy order as `tf.concat(values, axis, name)`.
601* `tf.image.decode_jpeg` by default uses the faster DCT method, sacrificing
Vijay Vasudevanfebdc1d2016-12-19 21:04:00 -0800602 a little fidelity for improved speed. One can revert to the old
Benoit Steiner639b4e72017-02-08 09:25:09 -0800603 behavior by specifying the attribute `dct_method='INTEGER_ACCURATE'`.
A. Unique TensorFloweredb095c2016-12-20 14:37:03 -0800604* `tf.complex_abs` has been removed from the Python interface. `tf.abs`
605 supports complex tensors and should be used instead.
A. Unique TensorFlowerfac4a352017-01-20 13:14:02 -0800606* In the C++ API (in tensorflow/cc), Input, Output, etc. have moved
607 from the tensorflow::ops namespace to tensorflow.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800608* Template.`var_scope` property renamed to `.variable_scope`
609* SyncReplicasOptimizer is removed and SyncReplicasOptimizerV2 renamed to SyncReplicasOptimizer.
610* `tf.zeros_initializer()` and `tf.ones_initializer()` now return a callable
611 that must be called with initializer arguments, in your code replace
612 `tf.zeros_initializer` with `tf.zeros_initializer()`.
613* `SparseTensor.shape` has been renamed to `SparseTensor.dense_shape`. Same for
614 `SparseTensorValue.shape`.
615* Replace tf.scalar_summary, tf.histogram_summary, tf.audio_summary, tf.image_summary with tf.summary.scalar, tf.summary.histogram, tf.summary.audio, tf.summary.image, respectively. The new summary ops take name rather than tag as their first argument, meaning summary ops now respect TensorFlow name scopes.
616* Replace tf.train.SummaryWriter and tf.train.SummaryWriterCache with tf.summary.FileWriter and tf.summary.FileWriterCache.
617* Removes RegisterShape from public API. Use C++ shape function registration
618 instead.
619* Deprecated `_ref` dtypes from the python API.
620* In the C++ API (in tensorflow/cc), Input, Output, etc. have moved
621 from the tensorflow::ops namespace to tensorflow.
622* Change arg order for `{softmax,sparse_softmax,sigmoid}_cross_entropy_with_logits` to be (labels, predictions), and force use of named args.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800623* tf.nn.rnn_cell.* and most functions in tf.nn.rnn.* (with the exception of dynamic_rnn and raw_rnn) are temporarily in tf.contrib.rnn. They will be moved back into core for TF 1.2.
Martin Wickebc456e32017-03-23 12:31:16 -0800624* `tf.nn.sampled_softmax_loss` and `tf.nn.nce_loss` have both changed their API such that you need to switch the `inputs, labels` to `labels, inputs` parameters.
625* The shape keyword argument of the `SparseTensor` constructor changes its name to `dense_shape` between Tensorflow 0.12 and Tensorflow 1.0.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800626
627## Bug Fixes and Other Changes
Andrew Harp3e975ea2017-03-01 17:59:22 -0800628* Numerous C++ API updates.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800629* New op: `parallel_stack`.
630* Introducing common tf io compression options constants for
631 RecordReader/RecordWriter.
632* Add `sparse_column_with_vocabulary_file`, to specify a feature column that
633 transform string features to IDs, where the mapping is defined by a vocabulary
634 file.
635* Added `index_to_string_table` which returns a lookup table that maps indices to
636 strings.
637* Add `string_to_index_table`, which returns a lookup table that matches strings
638 to indices.
639* Add a `ParallelForWithWorkerId` function.
640* Add `string_to_index_table`, which returns a lookup table that matches strings
641 to indices.
642* Support restore session from checkpoint files in v2 in `contrib/session_bundle`.
643* Added a tf.contrib.image.rotate function for arbitrary angles.
644* Added `tf.contrib.framework.filter_variables` as a convenience function to
645 filter lists of variables based on regular expressions.
646* `make_template()` takes an optional `custom_getter_ param`.
647* Added comment about how existing directories are handled by
648 `recursive_create_dir`.
649* Added an op for QR factorizations.
650* Divides and mods in Python API now use flooring (Python) semantics.
651* Android: pre-built libs are now built nightly.
652* Android: cmake/gradle build for TensorFlow Inference library under
653 `contrib/android/cmake`
654* Android: Much more robust Session initialization code.
655* Android: TF stats now exposed directly in demo and log when debug mode is
656 active
657* Android: new/better README.md documentation
658* saved_model is available as `tf.saved_model`.
659* Empty op is now stateful.
660* Improve speed of scatter_update on the cpu for ASSIGN operations.
661* Change `reduce_join` to treat `reduction_indices` in the same way as other `reduce_` ops.
662* Move `TensorForestEstimator` to `contrib/tensor_forest`.
663* Enable compiler optimizations by default and allow configuration in configure.
664* `tf.divide` now honors the name field.
665* Make metrics weight broadcasting more strict.
666* Add new queue-like `StagingArea` and new ops: `stage` and `unstage`.
Andrew Harp3e975ea2017-03-01 17:59:22 -0800667* Enable inplace update ops for strings on CPU. Speed up string concat.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800668
669## Thanks to our Contributors
670
671This release contains contributions from many people at Google, as well as:
672
673Aaron Hu, Abhishek Aggarwal, Adam Michael, Adriano Carmezim, @AfirSraftGarrier,
674Alexander Novikov, Alexander Rosenberg Johansen, Andrew Gibiansky, Andrew Hundt,
675Anish Shah, Anton Loss, @b0noI, @BoyuanJiang, Carl Thomé, Chad Kennedy, Comic
676Chang, Connor Braa, Daniel N. Lang, Daniel Trebbien,
677@danielgordon10, Darcy Liu, Darren Garvey, Dmitri Lapin, Eron Wright, Evan
678Cofer, Fabrizio Milo, Finbarr Timbers, Franck Dernoncourt, Garrett Smith,
679@guschmue, Hao Wei, Henrik Holst, Huazuo Gao, @Ian, @Issac, Jacob Israel,
680Jangsoo Park, Jin Kim, Jingtian Peng, John Pope, Kye Bostelmann, Liangliang He,
681Ling Zhang, Luheng He, Luke Iwanski, @lvli, Michael Basilyan, Mihir Patel,
682Mikalai Drabovich, Morten Just, @newge, Nick Butlin, Nishant Shukla,
683Pengfei Ni, Przemyslaw Tredak, @rasbt, @Ronny, Rudolf Rosa, @RustingSword,
684Sam Abrahams, Sam Putnam, @SeongAhJo, Shi Jiaxin, @skavulya, Steffen MüLler,
685@TheUSER123, @tiriplicamihai, @vhasanov, Victor Costan, Vit Stepanovs,
686Wangda Tan, Wenjian Huang, Xingdong Zuo, Yaroslav Bulatov, Yota Toyama,
687Yuan (Terry) Tang, Yuxin Wu
688
689We are also grateful to all who filed issues or helped resolve them, asked and
690answered questions, and were part of inspiring discussions.
691
Andrew Harp1cb96892016-12-08 20:05:49 -0800692
693# Release 0.12.0
694
695## Major Features and Improvements
696
697* TensorFlow now builds and runs on Microsoft Windows (tested on Windows 10,
698 Windows 7, and Windows Server 2016). Supported languages include Python (via a
699 pip package) and C++. CUDA 8.0 and cuDNN 5.1 are supported for GPU
700 acceleration. Known limitations include: It is not currently possible to load
701 a custom op library. The GCS and HDFS file systems are not currently
702 supported. The following ops are not currently implemented:
Martin Wicke2e4869a2016-12-14 15:46:53 -0800703 Dequantize, QuantizeAndDequantize, QuantizedAvgPool,
Andrew Harp1cb96892016-12-08 20:05:49 -0800704 QuantizedBatchNomWithGlobalNormalization, QuantizedBiasAdd, QuantizedConcat,
705 QuantizedConv2D, QuantizedMatmul, QuantizedMaxPool,
706 QuantizeDownAndShrinkRange, QuantizedRelu, QuantizedRelu6, QuantizedReshape,
707 QuantizeV2, RequantizationRange, and Requantize.
708* Go: Experimental API in Go to create and execute graphs
709 (https://godoc.org/github.com/tensorflow/tensorflow/tensorflow/go)
710* New checkpoint format becomes the default in `tf.train.Saver`. Old V1
711 checkpoints continue to be readable; controlled by the `write_version`
712 argument, `tf.train.Saver` now by default writes out in the new V2
713 format. It significantly reduces the peak memory required and latency
714 incurred during restore.
715* Added a new library for library of matrix-free (iterative) solvers for linear
716 equations, linear least-squares, eigenvalues and singular values in
717 tensorflow/contrib/solvers. Initial version has lanczos bidiagonalization,
718 conjugate gradients and CGLS.
719* Added gradients for `matrix_solve_ls` and `self_adjoint_eig`.
720* Large cleanup to add second order gradient for ops with C++ gradients and
721 improve existing gradients such that most ops can now be differentiated
722 multiple times.
723* Added a solver for ordinary differential equations,
724 `tf.contrib.integrate.odeint`.
725* New contrib module for tensors with named axes, `tf.contrib.labeled_tensor`.
726* Visualization of embeddings in TensorBoard.
727
728## Breaking Changes to the API
729
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800730* `BusAdjacency` enum replaced with a protocol buffer `DeviceLocality`. PCI bus
Benoit Steiner639b4e72017-02-08 09:25:09 -0800731 indexing now starts from 1 instead of 0, and `bus_id==0` is used where
732 previously `BUS_ANY` was used.
Jonathan Hseu879e0ac2016-11-04 11:53:50 -0800733* `Env::FileExists` and `FileSystem::FileExists` now return a tensorflow::Status
Vijay Vasudevan93a975e2017-02-17 17:05:49 -0800734 instead of a bool. Any callers to this function can be converted to a bool
Jonathan Hseu879e0ac2016-11-04 11:53:50 -0800735 by adding .ok() to the call.
Asim Shankare580e722016-11-09 08:21:50 -0800736* The C API type `TF_SessionWithGraph` has been renamed to `TF_Session`,
737 indicating its preferred use in language bindings for TensorFlow.
738 What was previously `TF_Session` has been renamed to `TF_DeprecatedSession`.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800739* Renamed `TF_Port` to `TF_Output` in the C API.
Andrew Harp1cb96892016-12-08 20:05:49 -0800740* Removes RegisterShape from public API. Use C++ shape function registration instead.
741 indexing now starts from 1 instead of 0, and `bus_id==0` is used where
742 previously `BUS_ANY` was used.
Eugene Brevdo7a7c1eb2016-11-29 09:38:37 -0800743* Most RNN cells and RNN functions now use different variable scopes to be
744 consistent with layers (`tf.contrib.layers`). This means old checkpoints
745 written using this code will not load after this change without providing
746 `Saver` a list of variable renames. Examples of variable scope changes
747 include `RNN` -> `rnn` in `tf.nn.rnn`, `tf.nn.dynamic_rnn` and moving from
748 `Linear/Matrix` -> `weights` and `Linear/Bias` -> `biases` in most RNN cells.
A. Unique TensorFlowerfe558b02016-11-30 11:51:57 -0800749* Deprecated tf.select op. tf.where should be used instead.
Martin Wickea7cd5f62016-12-14 15:22:55 -0800750* `SparseTensor.shape` has been renamed to `SparseTensor.dense_shape`. Same for
751 `SparseTensorValue.shape`.
Andrew Harp1cb96892016-12-08 20:05:49 -0800752* `Env::FileExists` and `FileSystem::FileExists` now return a
Vijay Vasudevan93a975e2017-02-17 17:05:49 -0800753 `tensorflow::Status` instead of a bool. Any callers to this function can be
Andrew Harp1cb96892016-12-08 20:05:49 -0800754 converted to a bool by adding `.ok()` to the call.
755* C API: Type `TF_SessionWithGraph` has been renamed to `TF_Session`, indicating
756 its preferred use in language bindings for TensorFlow. What was previously
757 `TF_Session` has been renamed to `TF_DeprecatedSession`.
758* C API: Renamed `TF_Port` to `TF_Output`.
759* C API: The caller retains ownership of `TF_Tensor` objects provided to
760 `TF_Run`, `TF_SessionRun`, `TF_SetAttrTensor` etc.
761* Renamed `tf.image.per_image_whitening()` to
762 `tf.image.per_image_standardization()`
763* Move Summary protobuf constructors to `tf.summary` submodule.
764* Deprecate `histogram_summary`, `audio_summary`, `scalar_summary`,
765 `image_summary`, `merge_summary`, and `merge_all_summaries`.
766* Combined `batch_*` and regular version of linear algebra and FFT ops. The
767 regular op now handles batches as well. All `batch_*` Python interfaces were
768 removed.
769* `tf.all_variables`, `tf.VARIABLES` and `tf.initialize_all_variables` renamed
770 to `tf.global_variables`, `tf.GLOBAL_VARIABLES` and
771 `tf.global_variables_initializer` respectively.
A. Unique TensorFlower46d2c282017-01-02 22:19:48 -0800772* `tf.zeros_initializer()` and `tf.ones_initializer()` now return a callable
773 that must be called with initializer arguments, in your code replace
Benoit Steiner639b4e72017-02-08 09:25:09 -0800774 `tf.zeros_initializer` with `tf.zeros_initializer()`
Andrew Harp1cb96892016-12-08 20:05:49 -0800775
776## Bug Fixes and Other Changes
777
778* Use threadsafe version of `lgamma` function.
779* Fix `tf.sqrt` handling of negative arguments.
780* Fixed bug causing incorrect number of threads to be used for multi-threaded
781 benchmarks.
782* Performance optimizations for `batch_matmul` on multi-core CPUs.
783* Improve trace, `matrix_set_diag`, `matrix_diag_part` and their gradients to
784 work for rectangular matrices.
785* Support for SVD of complex valued matrices.
786
787
788## Thanks to our Contributors
789
790This release contains contributions from many people at Google, as well as:
791
792@a7744hsc, Abhi Agg, @admcrae, Adriano Carmezim, Aki Sukegawa, Alex Kendall,
793Alexander Rosenberg Johansen, @amcrae, Amlan Kar, Andre Simpelo, Andreas Eberle,
794Andrew Hundt, Arnaud Lenglet, @b0noI, Balachander Ramachandran, Ben Barsdell,
795Ben Guidarelli, Benjamin Mularczyk, Burness Duan, @c0g, Changming Sun,
796@chanis, Corey Wharton, Dan J, Daniel Trebbien, Darren Garvey, David Brailovsky,
797David Jones, Di Zeng, @DjangoPeng, Dr. Kashif Rasul, @drag0, Fabrizio (Misto)
798Milo, FabríCio Ceschin, @fp, @Ghedeon, @guschmue, Gökçen Eraslan, Haosdent
799Huang, Haroen Viaene, Harold Cooper, Henrik Holst, @hoangmit, Ivan Ukhov, Javier
800Dehesa, Jingtian Peng, Jithin Odattu, Joan Pastor, Johan Mathe, Johannes Mayer,
801Jongwook Choi, Justus Schwabedal, Kai Wolf, Kamil Hryniewicz, Kamran Amini,
802Karen Brems, Karl Lattimer, @kborer, Ken Shirriff, Kevin Rose, Larissa Laich,
803Laurent Mazare, Leonard Lee, Liang-Chi Hsieh, Liangliang He, Luke Iwanski,
804Marek Kolodziej, Moustafa Alzantot, @MrQianjinsi, @nagachika, Neil Han, Nick
805Meehan, Niels Ole Salscheider, Nikhil Mishra, @nschuc, Ondrej Skopek, OndřEj
806Filip, @OscarDPan, Pablo Moyano, Przemyslaw Tredak, @qitaishui, @Quarazy,
807@raix852, Philipp Helo, Sam Abrahams, @SriramRamesh, Till Hoffmann, Tushar Soni,
808@tvn, @tyfkda, Uwe Schmidt, Victor Villas, Vit Stepanovs, Vladislav Gubarev,
809@wujingyue, Xuesong Yang, Yi Liu, Yilei Yang, @youyou3, Yuan (Terry) Tang,
810Yuming Wang, Zafar Takhirov, @zhongyuk, Ziming Dong, @guotong1988
811
812We are also grateful to all who filed issues or helped resolve them, asked and
813answered questions, and were part of inspiring discussions.
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800814
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800815# Release 0.11.0
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800816
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800817## Major Features and Improvements
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800818
Vijay Vasudevan818993c2016-11-03 17:07:01 -0800819* CUDA 8 support.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800820* cuDNN 5 support.
821* HDFS Support.
822* Adds Fused LSTM support via cuDNN 5 in `tensorflow/contrib/cudnn_rnn`.
823* Improved support for NumPy style basic slicing including non-1 strides,
824 ellipses, newaxis, and negative indices. For example complicated expressions
825 like `foo[1, 2:4, tf.newaxis, ..., :-3:-1, :]` are now supported. In addition
826 we have preliminary (non-broadcasting) support for sliced assignment to
827 variables. In particular one can write `var[1:3].assign([1,11,111])`.
828* Deprecated `tf.op_scope` and `tf.variable_op_scope` in favor of a unified `tf.name_scope` and `tf.variable_scope`. The new argument order of `tf.variable_scope` is incompatible with previous versions.
829* Introducing `core/util/tensor_bundle` module: a module to efficiently
830 serialize/deserialize tensors to disk. Will be used in TF's new checkpoint
831 format.
832* Added tf.svd for computing the singular value decomposition (SVD) of dense
833 matrices or batches of matrices (CPU only).
834* Added gradients for eigenvalues and eigenvectors computed using
835 `self_adjoint_eig` or `self_adjoint_eigvals`.
836* Eliminated `batch_*` methods for most linear algebra and FFT ops and promoted
837 the non-batch version of the ops to handle batches of matrices.
838* Tracing/timeline support for distributed runtime (no GPU profiler yet).
839* C API gives access to inferred shapes with `TF_GraphGetTensorNumDims` and
840 `TF_GraphGetTensorShape`.
841* Shape functions for core ops have moved to C++ via
842 `REGISTER_OP(...).SetShapeFn(...)`. Python shape inference RegisterShape calls
843 use the C++ shape functions with `common_shapes.call_cpp_shape_fn`. A future
844 release will remove `RegisterShape` from python.
845
846
847## Bug Fixes and Other Changes
848
849* Documentation now includes operator overloads on Tensor and Variable.
850* `tensorflow.__git_version__` now allows users to identify the version of the
851 code that TensorFlow was compiled with. We also have
852 `tensorflow.__git_compiler__` which identifies the compiler used to compile
853 TensorFlow's core.
854* Improved multi-threaded performance of `batch_matmul`.
Eugene Brevdo21e1cc72016-08-11 21:45:39 -0800855* LSTMCell, BasicLSTMCell, and MultiRNNCell constructors now default to
856 `state_is_tuple=True`. For a quick fix while transitioning to the new
857 default, simply pass the argument `state_is_tuple=False`.
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800858* DeviceFactory's AddDevices and CreateDevices functions now return
859 a Status instead of void.
A. Unique TensorFlower84cefad2016-08-12 07:06:13 -0800860* Int32 elements of list(type) arguments are no longer placed in host memory by
861 default. If necessary, a list(type) argument to a kernel can be placed in host
862 memory using a HostMemory annotation.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800863* `uniform_unit_scaling_initializer()` no longer takes a `full_shape` arg,
864 instead relying on the partition info passed to the initializer function when
865 it's called.
866* The NodeDef protocol message is now defined in its own file `node_def.proto`
867 `instead of graph.proto`.
868* `ops.NoGradient` was renamed `ops.NotDifferentiable`. `ops.NoGradient` will
Vijay Vasudevan612bae72016-09-09 11:03:09 -0800869 be removed soon.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800870* `dot.h` / DotGraph was removed (it was an early analysis tool prior
Vijay Vasudevan269bfee2016-09-21 21:41:19 -0800871 to TensorBoard, no longer that useful). It remains in history
872 should someone find the code useful.
Vijay Vasudevan914625a2016-09-23 13:51:34 -0800873* re2 / regexp.h was removed from being a public interface of TF.
874 Should users need regular expressions, they should depend on the RE2
875 library directly rather than via TensorFlow.
Dan Manée5bcf542016-05-16 13:39:34 -0800876
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800877## Thanks to our Contributors
878
879This release contains contributions from many people at Google, as well as:
880
881Abid K, @afshinrahimi, @AidanGG, Ajay Rao, Aki Sukegawa, Alex Rothberg,
882Alexander Rosenberg Johansen, Andrew Gibiansky, Andrew Thomas, @Appleholic,
883Bastiaan Quast, Ben Dilday, Bofu Chen, Brandon Amos, Bryon Gloden, Cissp®,
884@chanis, Chenyang Liu, Corey Wharton, Daeyun Shin, Daniel Julius Lasiman, Daniel
885Waterworth, Danijar Hafner, Darren Garvey, Denis Gorbachev, @DjangoPeng,
886Egor-Krivov, Elia Palme, Eric Platon, Fabrizio Milo, Gaetan Semet,
887Georg Nebehay, Gu Wang, Gustav Larsson, @haosdent, Harold Cooper, Hw-Zz,
888@ichuang, Igor Babuschkin, Igor Macedo Quintanilha, Ilya Edrenkin, @ironhead,
889Jakub Kolodziejczyk, Jennifer Guo, Jihun Choi, Jonas Rauber, Josh Bleecher
890Snyder, @jpangburn, Jules Gagnon-Marchand, Karen Brems, @kborer, Kirill Bobyrev,
891Laurent Mazare, Longqi Yang, Malith Yapa, Maniteja Nandana, Martin Englund,
892Matthias Winkelmann, @mecab, Mu-Ik Jeon, Nand Dalal, Niels Ole Salscheider,
893Nikhil Mishra, Park Jiin, Pieter De Rijk, @raix852, Ritwik Gupta, Sahil Sharma,
Patrick Nguyenc5ab3dd2016-10-20 12:09:18 -0800894Sangheum Hwang, @SergejsRk, Shinichiro Hamaji, Simon Denel, @Steve, @suiyuan2009,
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800895Tiago Jorge, Tijmen Tieleman, @tvn, @tyfkda, Wang Yang, Wei-Ting Kuo, Wenjian
896Huang, Yan Chen, @YenChenLin, Yuan (Terry) Tang, Yuncheng Li, Yunfeng Wang, Zack
897Polizzi, @zhongzyd, Ziming Dong, @perhapszzy
898
899We are also grateful to all who filed issues or helped resolve them, asked and
900answered questions, and were part of inspiring discussions.
901
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800902# Release 0.10.0
A. Unique TensorFlower533d8912016-06-30 12:10:50 -0800903
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800904## Major Features and Improvements
905
906* Added support for C++ shape inference
907* Added graph-construction C API
908* Major revision to the graph-construction C++ API
909* Support makefile build for iOS
910* Added Mac GPU support
911* Full version of TF-Slim available as `tf.contrib.slim`
912* Added k-Means clustering and WALS matrix factorization
913
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800914## Bug Fixes and Other Changes
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800915
916* Allow gradient computation for scalar values.
917* Performance improvements for gRPC
918* Improved support for fp16
919* New high-level ops in tf.contrib.{layers,metrics}
920* New features for TensorBoard, such as shape display, exponential smoothing
921* Faster and more stable Google Cloud Storage (GCS) filesystem support
922* Support for zlib compression and decompression for TFRecordReader and TFRecordWriter
923* Support for reading (animated) GIFs
924* Improved support for SparseTensor
925* Added support for more probability distributions (Dirichlet, Beta, Bernoulli, etc.)
926* Added Python interfaces to reset resource containers.
927* Many bugfixes and performance improvements
928* Many documentation fixes
929
930## Thanks to our Contributors
931
932This release contains contributions from many people at Google, as well as:
933
934Alex Rothberg, Andrew Royer, Austin Marshall, @BlackCoal, Bob Adolf, Brian Diesel, Charles-Emmanuel Dias, @chemelnucfin, Chris Lesniewski, Daeyun Shin, Daniel Rodriguez, Danijar Hafner, Darcy Liu, Kristinn R. Thórisson, Daniel Castro, Dmitry Savintsev, Kashif Rasul, Dylan Paiton, Emmanuel T. Odeke, Ernest Grzybowski, Gavin Sherry, Gideon Dresdner, Gregory King, Harold Cooper, @heinzbeinz, Henry Saputra, Huarong Huo, Huazuo Gao, Igor Babuschkin, Igor Macedo Quintanilha, Ivan Ukhov, James Fysh, Jan Wilken Dörrie, Jihun Choi, Johnny Lim, Jonathan Raiman, Justin Francis, @lilac, Li Yi, Marc Khoury, Marco Marchesi, Max Melnick, Micael Carvalho, @mikowals, Mostafa Gazar, Nico Galoppo, Nishant Agrawal, Petr Janda, Yuncheng Li, @raix852, Robert Rose, @Robin-des-Bois, Rohit Girdhar, Sam Abrahams, satok16, Sergey Kishchenko, Sharkd Tu, @shotat, Siddharth Agrawal, Simon Denel, @sono-bfio, SunYeop Lee, Thijs Vogels, @tobegit3hub, @Undo1, Wang Yang, Wenjian Huang, Yaroslav Bulatov, Yuan Tang, Yunfeng Wang, Ziming Dong
935
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800936We are also grateful to all who filed issues or helped resolve them, asked and
937answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800938
939# Release 0.9.0
940
941## Major Features and Improvements
942
943* Python 3.5 support and binaries
944* Added iOS support
945* Added support for processing on GPUs on MacOS
946* Added makefile for better cross-platform build support (C API only)
947* fp16 support and improved complex128 support for many ops
948* Higher level functionality in contrib.{layers,losses,metrics,learn}
949* More features to Tensorboard
950* Improved support for string embedding and sparse features
951* The RNN api is finally "official" (see, e.g., `tf.nn.dynamic_rnn`,
952 `tf.nn.rnn`, and the classes in `tf.nn.rnn_cell`).
953* TensorBoard now has an Audio Dashboard, with associated audio summaries.
954
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800955## Bug Fixes and Other Changes
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800956
957* Turned on CuDNN Autotune.
958* Added support for using third-party Python optimization algorithms (contrib.opt).
959* Google Cloud Storage filesystem support.
960* HDF5 support
961* Add support for 3d convolutions and pooling.
962* Update gRPC release to 0.14.
963* Eigen version upgrade.
964* Switch to eigen thread pool
965* `tf.nn.moments()` now accepts a `shift` argument. Shifting by a good estimate
966 of the mean improves numerical stability. Also changes the behavior of the
967 `shift` argument to `tf.nn.sufficient_statistics()`.
968* Performance improvements
969* Many bugfixes
970* Many documentation fixes
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800971* TensorBoard fixes: graphs with only one data point, Nan values,
972 reload button and auto-reload, tooltips in scalar charts, run
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800973 filtering, stable colors
974* Tensorboard graph visualizer now supports run metadata. Clicking on nodes
975 while viewing a stats for a particular run will show runtime statistics, such
976 as memory or compute usage. Unused nodes will be faded out.
977
978## Thanks to our Contributors
979
980This release contains contributions from many people at Google, as well as:
981
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800982Aaron Schumacher, Aidan Dang, Akihiko ITOH, Aki Sukegawa, Arbit Chen, Aziz Alto, Danijar Hafner, Erik Erwitt, Fabrizio Milo, Felix Maximilian Möller, Henry Saputra, Sung Kim, Igor Babuschkin, Jan Zikes, Jeremy Barnes, Jesper Steen Møller, Johannes Mayer, Justin Harris, Kashif Rasul, Kevin Robinson, Loo Rong Jie, Lucas Moura, Łukasz Bieniasz-Krzywiec, Mario Cho, Maxim Grechkin, Michael Heilman, Mostafa Rahmani, Mourad Mourafiq, @ninotoshi, Orion Reblitz-Richardson, Yuncheng Li, @raoqiyu, Robert DiPietro, Sam Abrahams, Sebastian Raschka, Siddharth Agrawal, @snakecharmer1024, Stephen Roller, Sung Kim, SunYeop Lee, Thijs Vogels, Till Hoffmann, Victor Melo, Ville Kallioniemi, Waleed Abdulla, Wenjian Huang, Yaroslav Bulatov, Yeison Rodriguez, Yuan Tang, Yuxin Wu, @zhongzyd, Ziming Dong, Zohar Jackson
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800983
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800984We are also grateful to all who filed issues or helped resolve them, asked and
985answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800986
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800987# Release 0.8.0
988
989## Major Features and Improvements
990
991* Added a distributed runtime using GRPC
992* Move skflow to `contrib/learn`
993* Better linear optimizer in `contrib/linear_optimizer`
994* Random forest implementation in `contrib/tensor_forest`
995* CTC loss and decoders in `contrib/ctc`
996* Basic support for `half` data type
997* Better support for loading user ops (see examples in `contrib/`)
998* Allow use of (non-blocking) Eigen threadpool with `TENSORFLOW_USE_EIGEN_THREADPOOL` define
999* Add an extension mechanism for adding network file system support
1000* TensorBoard displays metadata stats (running time, memory usage and device used) and tensor shapes
1001
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001002## Bug Fixes and Other Changes
Illia Polosukhin5c9bc512016-04-18 17:56:51 -08001003
1004* Utility for inspecting checkpoints
1005* Basic tracing and timeline support
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001006* Allow building against cuDNN 5 (not incl. RNN/LSTM support)
Illia Polosukhin5c9bc512016-04-18 17:56:51 -08001007* Added instructions and binaries for ProtoBuf library with fast serialization and without 64MB limit
1008* Added special functions
Dan Mané54a71782016-09-09 16:07:46 -08001009* `bool`-strictness: Tensors have to be explicitly compared to `None`
Illia Polosukhin5c9bc512016-04-18 17:56:51 -08001010* Shape strictness: all fed values must have a shape that is compatible with the tensor they are replacing
1011* Exposed `tf.while_loop` (deprecated `control_flow_ops.While`)
1012* run() now takes RunOptions and RunMetadata, which enable timing stats
1013* Fixed lots of potential overflow problems in op kernels
1014* Various performance improvements, especially for RNNs and convolutions
1015* Many bugfixes
1016* Nightly builds, tutorial tests, many test improvements
1017* New examples: transfer learning and deepdream ipython notebook
1018* Added tutorials, many documentation fixes.
1019
1020## Thanks to our Contributors
1021
1022This release contains contributions from many people at Google, as well as:
1023
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -08001024Abhinav Upadhyay, Aggelos Avgerinos, Alan Wu, Alexander G. de G. Matthews, Aleksandr Yahnev, @amchercashin, Andy Kitchen, Aurelien Geron, Awni Hannun, @BanditCat, Bas Veeling, Cameron Chen, @cg31, Cheng-Lung Sung, Christopher Bonnett, Dan Becker, Dan Van Boxel, Daniel Golden, Danijar Hafner, Danny Goodman, Dave Decker, David Dao, David Kretch, Dongjoon Hyun, Dustin Dorroh, @e-lin, Eurico Doirado, Erik Erwitt, Fabrizio Milo, @gaohuazuo, Iblis Lin, Igor Babuschkin, Isaac Hodes, Isaac Turner, Iván Vallés, J Yegerlehner, Jack Zhang, James Wexler, Jan Zikes, Jay Young, Jeff Hodges, @jmtatsch, Johnny Lim, Jonas Meinertz Hansen, Kanit Wongsuphasawat, Kashif Rasul, Ken Shirriff, Kenneth Mitchner, Kenta Yonekura, Konrad Magnusson, Konstantin Lopuhin, @lahwran, @lekaha, @liyongsea, Lucas Adams, @makseq, Mandeep Singh, @manipopopo, Mark Amery, Memo Akten, Michael Heilman, Michael Peteuil, Nathan Daly, Nicolas Fauchereau, @ninotoshi, Olav Nymoen, @panmari, @papelita1234, Pedro Lopes, Pranav Sailesh Mani, RJ Ryan, Rob Culliton, Robert DiPietro, @ronrest, Sam Abrahams, Sarath Shekkizhar, Scott Graham, Sebastian Raschka, Sung Kim, Surya Bhupatiraju, Syed Ahmed, Till Hoffmann, @timsl, @urimend, @vesnica, Vlad Frolov, Vlad Zagorodniy, Wei-Ting Kuo, Wenjian Huang, William Dmitri Breaden Madden, Wladimir Schmidt, Yuan Tang, Yuwen Yan, Yuxin Wu, Yuya Kusakabe, @zhongzyd, @znah.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -08001025
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001026We are also grateful to all who filed issues or helped resolve them, asked and
1027answered questions, and were part of inspiring discussions.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -08001028
1029
Eugene Brevdo56f1d642016-03-10 17:18:30 -08001030# Release 0.7.1
1031
1032## Bug Fixes and Other Changes
1033
1034* Added gfile.Open and gfile.Copy, used by input_data.py.
1035* Fixed Saver bug when MakeDirs tried to create empty directory.
1036* GPU Pip wheels are built with cuda 7.5 and cudnn-v4, making them
1037 required for the binary releases. Lower versions of cuda/cudnn can
1038 be supported by installing from sources and setting the options
1039 during ./configure
1040* Fix dataset encoding example for Python3 (@danijar)
1041* Fix PIP installation by not packaging protobuf as part of wheel,
1042 require protobuf 3.0.0b2.
1043* Fix Mac pip installation of numpy by requiring pip >= 1.10.1.
1044* Improvements and fixes to Docker image.
1045
1046
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001047# Release 0.7.0
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -08001048
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001049## Major Features and Improvements
1050
1051* Allow using any installed Cuda >= 7.0 and cuDNN >= R2, and add support
1052 for cuDNN R4
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001053* Added a `contrib/` directory for unsupported or experimental features,
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001054 including higher level `layers` module
1055* Added an easy way to add and dynamically load user-defined ops
1056* Built out a good suite of tests, things should break less!
1057* Added `MetaGraphDef` which makes it easier to save graphs with metadata
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001058* Added assignments for "Deep Learning with TensorFlow" udacity course
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001059
1060
1061## Bug Fixes and Other Changes
1062
1063* Added a versioning framework for `GraphDef`s to ensure compatibility
1064* Enforced Python 3 compatibility
1065* Internal changes now show up as sensibly separated commits
1066* Open-sourced the doc generator
1067* Un-fork Eigen
1068* Simplified the `BUILD` files and cleaned up C++ headers
1069* TensorFlow can now be used as a submodule in another bazel build
1070* New ops (e.g., `*fft`, `*_matrix_solve`)
1071* Support for more data types in many ops
1072* Performance improvements
1073* Various bugfixes
1074* Documentation fixes and improvements
1075
1076
1077## Breaking Changes to the API
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -08001078
1079* `AdjustContrast` kernel deprecated, new kernel `AdjustContrastv2` takes and
1080 outputs float only. `adjust_contrast` now takes all data types.
1081* `adjust_brightness`'s `delta` argument is now always assumed to be in `[0,1]`
1082 (as is the norm for images in floating point formats), independent of the
1083 data type of the input image.
1084* The image processing ops do not take `min` and `max` inputs any more, casting
1085 safety is handled by `saturate_cast`, which makes sure over- and underflows
1086 are handled before casting to data types with smaller ranges.
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -08001087* For C++ API users: `IsLegacyScalar` and `IsLegacyVector` are now gone from
1088 `TensorShapeUtils` since TensorFlow is scalar strict within Google (for
1089 example, the shape argument to `tf.reshape` can't be a scalar anymore). The
1090 open source release was already scalar strict, so outside Google `IsScalar`
1091 and `IsVector` are exact replacements.
Josh Levenbergdb7478e2016-01-20 14:54:50 -08001092* The following files are being removed from `tensorflow/core/public/`:
1093 * `env.h` -> `../platform/env.h`
1094 * `status.h` -> `../lib/core/status.h`
1095 * `tensor.h` -> `../framework/tensor.h`
1096 * `tensor_shape.h` -> `../framework/tensor_shape.h`
1097 * `partial_tensor_shape.h` -> `../framework/partial_tensor_shape.h`
1098 * `tensorflow_server.h` deleted
Geoffrey Irving56437752016-01-25 09:43:13 -08001099* For C++ API users: `TensorShape::ShortDebugString` has been renamed to
1100 `DebugString`, and the previous `DebugString` behavior is gone (it was
1101 needlessly verbose and produced a confusing empty string for scalars).
Manjunath Kudlurc2722a12016-01-27 13:24:50 -08001102* `GraphOptions.skip_common_subexpression_elimination` has been removed. All
1103 graph optimizer options are now specified via
1104 `GraphOptions.OptimizerOptions`.
Geoffrey Irving18297122016-02-10 11:48:34 -08001105* `ASSERT_OK` / `EXPECT_OK` macros conflicted with external projects, so they
1106 were renamed `TF_ASSERT_OK`, `TF_EXPECT_OK`. The existing macros are
1107 currently maintained for short-term compatibility but will be removed.
Eugene Brevdofea55e12016-01-27 14:54:54 -08001108* The non-public `nn.rnn` and the various `nn.seq2seq` methods now return
1109 just the final state instead of the list of all states.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001110* `tf.scatter_update` now no longer guarantees that lexicographically largest
1111 index be used for update when duplicate entries exist.
Geoffrey Irving3e33d442016-02-08 12:02:44 -08001112* `tf.image.random_crop(image, [height, width])` is now
1113 `tf.random_crop(image, [height, width, depth])`, and `tf.random_crop` works
1114 for any rank (not just 3-D images). The C++ `RandomCrop` op has been replaced
1115 with pure Python.
Geoffrey Irving18297122016-02-10 11:48:34 -08001116* Renamed `tf.test.GetTempDir` and `tf.test.IsBuiltWithCuda` to
1117 `tf.test.get_temp_dir` and `tf.test.is_built_with_cuda` for PEP-8
1118 compatibility.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001119* `parse_example`'s interface has changed, the old interface is accessible in
1120 `legacy_parse_example` (same for related functions).
1121* New `Variable`s are not added to the same collection several times even if
1122 a list with duplicates is passed to the constructor.
Josh Levenberg02dff6d2016-01-07 18:37:54 -08001123* The Python API will now properly set the `list` member of `AttrValue` in
1124 constructed `GraphDef` messages for empty lists. The serialization of some
1125 graphs will change, but the change is both forwards and backwards compatible.
1126 It will break tests that compare a generated `GraphDef` to a golden serialized
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001127 `GraphDef` (which is discouraged).
1128
1129
1130## Thanks to our Contributors
1131
1132This release contains contributions from many people at Google, as well as:
1133
1134Akiomi Kamakura, Alex Vig, Alexander Rosenberg Johansen, Andre Cruz, Arun Ahuja,
1135Bart Coppens, Bernardo Pires, Carl Vondrick, Cesar Salgado, Chen Yu,
1136Christian Jauvin, Damien Aymeric, Dan Vanderkam, Denny Britz, Dongjoon Hyun,
1137Eren Güven, Erik Erwitt, Fabrizio Milo, G. Hussain Chinoy, Jim Fleming,
1138Joao Felipe Santos, Jonas Meinertz Hansen, Joshi Rekha, Julian Viereck,
1139Keiji Ariyama, Kenton Lee, Krishna Sankar, Kristina Chodorow, Linchao Zhu,
1140Lukas Krecan, Mark Borgerding, Mark Daoust, Moussa Taifi,
1141Nathan Howell, Naveen Sundar Govindarajulu, Nick Sweeting, Niklas Riekenbrauck,
1142Olivier Grisel, Patrick Christ, Povilas Liubauskas, Rainer Wasserfuhr,
1143Romain Thouvenin, Sagan Bolliger, Sam Abrahams, Taehoon Kim, Timothy J Laurent,
1144Vlad Zavidovych, Yangqing Jia, Yi-Lin Juang, Yuxin Wu, Zachary Lipton,
1145Zero Chen, Alan Wu, @brchiu, @emmjaykay, @jalammar, @Mandar-Shinde,
1146@nsipplswezey, @ninotoshi, @panmari, @prolearner and @rizzomichaelg.
1147
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -08001148We are also grateful to all who filed issues or helped resolve them, asked and
1149answered questions, and were part of inspiring discussions.
Josh Levenberg02dff6d2016-01-07 18:37:54 -08001150
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -08001151
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -08001152# Release 0.6.0
1153
1154## Major Features and Improvements
1155
1156* Python 3.3+ support via changes to python codebase and ability
1157 to specify python version via ./configure.
1158
1159* Some improvements to GPU performance and memory usage:
1160 [convnet benchmarks](https://github.com/soumith/convnet-benchmarks/issues/66)
1161 roughly equivalent with native cudnn v2 performance. Improvements mostly due
1162 to moving to 32-bit indices, faster shuffling kernels. More improvements to
1163 come in later releases.
1164
1165
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001166## Bug Fixes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -08001167
1168* Lots of fixes to documentation and tutorials, many contributed
1169 by the public.
1170
1171* 271 closed issues on github issues.
1172
Vijay Vasudevanfe056f02016-02-17 11:42:30 -08001173## Backwards-Incompatible Changes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -08001174
Geoffrey Irving18297122016-02-10 11:48:34 -08001175* `tf.nn.fixed_unigram_candidate_sampler` changed its default 'distortion'
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -08001176 attribute from 0.0 to 1.0. This was a bug in the original release
1177 that is now fixed.
1178
Vijay Vasudevanddd4aaf2015-12-08 09:58:59 -08001179# Release 0.5.0
1180
1181Initial release of TensorFlow.