blob: 1590aabfefdcaf3a9178c356129ac169970bb186 [file] [log] [blame] [view]
Derek Murray4e69ce82017-04-11 10:31:27 -08001# Changes since the last release
2
3## Major Features and Improvements
Dan Ringwalt692fad22017-05-05 09:09:05 -08004* Added `tf.layers.conv3d_transpose` layer for spatio temporal deconvolution.
Derek Murray4e69ce82017-04-11 10:31:27 -08005* Added `tf.Session.make_callable()`, which provides a lower overhead means of running a similar step multiple times.
Jonathan Hseue8082d52017-04-20 09:34:42 -08006* Added ibverbs-based RDMA support to contrib (courtesy @junshi15 from Yahoo).
Eugene Brevdo827d2e42017-05-22 17:32:50 -07007* `RNNCell` objects now subclass `tf.layers.Layer`. The strictness described
Eugene Brevdoe8482ab2017-04-21 16:34:59 -08008 in the TensorFlow 1.1 release is gone: The first time an RNNCell is used,
9 it caches its scope. All future uses of the RNNCell will reuse variables from
10 that same scope. This is a breaking change from the behavior of RNNCells
11 in TensorFlow versions <= 1.0.1. TensorFlow 1.1 had checks in place to
12 ensure old code works correctly with the new semantics; this version
13 allows more flexible uses of RNNCell but can lead to subtle errors if
14 using code meant for TensorFlow <= 1.0.1. For example, writing:
15 `MultiRNNCell([lstm] * 5)` will now build a 5-layer LSTM stack where each
16 layer shares the **same** parameters. To get 5 layers each with their own
17 parameters, write: `MultiRNNCell([LSTMCell(...) for _ in range(5)])`.
18 If at all unsure, first test your code with TF 1.1; ensure it raises no
19 errors, and then upgrade to TF 1.2.
Eugene Brevdo827d2e42017-05-22 17:32:50 -070020* RNNCells' variable names have been renamed for consistency with Keras layers.
21 Specifically, the previous variable names "weights" and "biases" have
22 been changed to "kernel" and "bias", respectively.
23 This may cause backward incompatibility with regard to your old
24 checkpoints containing such RNN cells, in which case you can use the tool
25 [checkpoint_convert script](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/rnn/python/tools/checkpoint_convert.py)
26 to convert the variable names in your old checkpoints.
27* Many of the RNN functions and classes that were in the `tf.nn` namespace
28 before the 1.0 release and which were moved to `tf.contrib.rnn` have now
29 been moved back to the core namespace. This includes
30 `RNNCell`, `LSTMCell`, `GRUCell`, and a number of other cells. These
31 now reside in `tf.nn.rnn_cell` (with aliases in `tf.contrib.rnn` for backwards
32 compatibility). The original `tf.nn.rnn` function is now `tf.nn.static_rnn`,
33 and the bidirectional static and state saving static rnn functions are also
34 now back in the `tf.nn` namespace.
35
36 Notable exceptions are the `EmbeddingWrapper`, `InputProjectionWrapper` and
37 `OutputProjectionWrapper`, which will slowly be moved to deprecation
38 in `tf.contrib.rnn`. These are inefficient wrappers that should often
39 be replaced by calling `embedding_lookup` or `layers.dense` as pre- or post-
40 processing of the rnn. For RNN decoding, this functionality has been replaced
41 with an alternative API in `tf.contrib.seq2seq`.
A. Unique TensorFlowerce322282017-01-07 09:19:27 -080042* Intel MKL Integration (https://software.intel.com/en-us/articles/tensorflow-optimizations-on-modern-intel-architecture). Intel developed a number of
43 optimized deep learning primitives: In addition to matrix multiplication and
44 convolution, these building blocks include:
45 Direct batched convolution
46 Pooling: maximum, minimum, average
47 Normalization: LRN, batch normalization
48 Activation: rectified linear unit (ReLU)
49 Data manipulation: multi-dimensional transposition (conversion), split,
50 concat, sum and scale.
Derek Murray4e69ce82017-04-11 10:31:27 -080051
Vijay Vasudevan15f32d92017-05-10 12:31:10 -070052## Bug Fixes and Other Changes
53* In python, `Operation.get_attr` on type attributes returns the Python DType
54 version of the type to match expected get_attr documentation rather than the
55 protobuf enum.
Derek Murray4e69ce82017-04-11 10:31:27 -080056
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -080057# Release 1.1.0
58
59## Major Features and Improvements
60* Added Java API support for Windows.
61* Added `tf.spectral` module. Moved existing FFT ops to `tf.spectral` while
62 keeping an alias in the old location (`tf.*`).
63* Added 1D, 2D and 3D Fourier transform ops for real signals to `tf.spectral`.
64* Added a `tf.bincount` function.
65* Added Keras 2 API to contrib.
66* Added a new lightweight queue-like object - `RecordInput`.
67* Added `tf.contrib.image.compose_transforms` function.
68* Bring `tf.estimator.*` into the API. Non-deprecated functionality from `tf.contrib.learn.Estimator` is moved to `tf.estimator.Estimator` with cosmetic changes.
69* Docker images: TF images on gcr.io and Docker Hub are upgraded to ubuntu:16.04.
70* Added the following features to TensorFlow Debugger (tfdbg):
71 * Ability to inspect Python source file against TF ops and tensors (command `print_source` / `ps`)
72 * New navigation bar in Curses-based UI
73 * NodeStepper (command `invoke_stepper`) now uses intermediate tensor dumps. It also uses `TensorHandles` as direct feeds during successive `cont` calls for improved performance and reduced memory consumption.
Rohan Jaind0697152017-04-07 08:29:08 -080074* Initial release of installation guides for Java, C, and Go.
Shanqing Cai32694232017-04-22 06:08:17 -080075* Added Text Dashboard to TensorBoard.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -080076
77## Deprecations
78
79* TensorFlow 1.1.0 will be the last time we release a binary with Mac GPU support. Going forward, we will stop testing on Mac GPU systems. We continue to welcome patches that maintain Mac GPU support, and we will try to keep the Mac GPU build working.
80
81## Changes to contrib APIs
82* The behavior of RNNCells is now stricter due to the transition towards making RNNCells act more like Keras layers.
83 * If an RNNCell is used twice in two different variable scopes, an error is raised describing how to avoid this behavior.
84 * If an RNNCell is used in a variable scope with existing conflicting variables, an error is raised showing that the RNNCell must be constructed with argument `reuse=True`.
85* Deprecated contrib/distributions `pmf`, `pdf`, `log_pmf`, `log_pdf`.
86* Moved `bayesflow.special_math` to distributions.
87* `tf.contrib.tensor_forest.python.tensor_forest.RandomForestDeviceAssigner` removed.
88* Changed some MVN classes and parameters:
89 * `tf.contrib.distributions.MultivariateNormalFull` replaced by `tf.contrib.distributions.MultivariateNormalTriL`.
90 * `tf.contrib.distributions.MultivariateNormalCholesky` replaced by `tf.contrib.distributions.MultivariateNormalTriL`
91 * `tf.contrib.distributions.MultivariateNormalDiagWithSoftplusStDev` replaced
92 by `tf.contrib.distributions.MultivariateNormalDiagWithSoftplusScale`
93 * `tf.contrib.distributions.MultivariateNormalDiag` arguments changed from `mu`, `diag_stddev` to `log`, `scale_diag`.
94 * `tf.contrib.distributions.MultivariateNormalDiagPlusVDVT` removed.
95 * `tf.contrib.distributions.MultivariateNormalDiagPlusLowRank` added.
96
97## Bug Fixes and Other Changes
98* Java: Support for loading models exported using the SavedModel API (courtesy @EronWright).
99* Go: Added support for incremental graph execution.
100* Fix a bug in the WALS solver when single-threaded.
101* Added support for integer sparse feature values in `tf.contrib.layers.sparse_column_with_keys`.
102* Fixed `tf.set_random_seed(0)` to be deterministic for all ops.
103* Stability improvements for the GCS file system support.
104* Improved TensorForest performance.
105* Added support for multiple filename globs in `tf.matching_files`.
106* `LogMessage` now includes a timestamp as beginning of a message.
107* Added MultiBox person detector example standalone binary.
108* Android demo: Makefile build functionality added to build.gradle to fully support building TensorFlow demo in Android on Windows.
109* Android demo: read MultiBox priors from txt file rather than protobuf.
110* Added colocation constraints to `StagingArea`.
111* `sparse_matmul_op` reenabled for Android builds.
112* Restrict weights rank to be the same as the broadcast target, to avoid ambiguity on broadcast rules.
113* Upgraded libxsmm to 1.7.1 and applied other changes for performance and memory usage.
114* Fixed bfloat16 integration of LIBXSMM sparse mat-mul.
115* Improved performance and reduce memory usage by allowing ops to forward input buffers to output buffers and perform computations in-place.
116* Improved the performance of CPU assignment for strings.
117* Speed up matrix * vector multiplication and matrix * matrix with unknown shapes.
118* C API: Graph imports now support input remapping, control dependencies, and returning imported nodes (see `TF_GraphImportGraphDefWithReturnOutputs()`)
119* Multiple C++ API updates.
120* Multiple TensorBoard updates including:
121 * Users can now view image summaries at various sampled steps (instead of just the last step).
122 * Bugs involving switching runs as well as the image dashboard are fixed.
123 * Removed data download links from TensorBoard.
124 * TensorBoard uses a relative data directory, for easier embedding.
125 * TensorBoard automatically ignores outliers for domain calculation, and formats proportional values consistently.
126* Multiple tfdbg bug fixes:
127 * Fixed Windows compatibility issues.
128 * Command history now persists across runs.
Rohan Jaind0697152017-04-07 08:29:08 -0800129 * Bug fix in graph validation related to `tf.while_loops`.
130* Java Maven fixes for bugs with Windows installation.
Shanqing Cai32694232017-04-22 06:08:17 -0800131* Backport fixes and improvements from external keras.
132* Keras config file handling fix.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800133
134## Thanks to our Contributors
135
136This release contains contributions from many people at Google, as well as:
137
138A. Besir Kurtulmus, Adal Chiriliuc, @akash, Alec-Desouza, Alex Rothberg, Alex
Rohan Jaind0697152017-04-07 08:29:08 -0800139Sergeev, Alexander Heinecke, Allen Guo, Andreas Madsen, Ankesh Anand, Anton
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800140Loss, @Aravind, @Arie, Ashutosh Das, AuréLien Geron, Bairen Yi, @bakunyo, Ben
Rohan Jaind0697152017-04-07 08:29:08 -0800141Visser, Brady Zhou, Calpa Liu, Changming Sun, Chih Cheng Liang, Christopher
142Berner, Clark Zinzow, @Conchylicultor, Dan Ellis, Dan J, Dan Jarvis, Daniel
143Ylitalo, Darren Garvey, David Norman, David Truong, @DavidNorman, Dimitar
144Pavlov, Dmitry Persiyanov, @Eddie, @elirex, Erfan Noury, Eron Wright, Evgeny
145Mazovetskiy, Fabrizio (Misto) Milo, @fanlu, Fisher Coder, Florian Courtial,
146Franck Dernoncourt, Gagan Goel, Gao, Xiang, @Gautam, Gefu Tang, @guilherme,
147@guschmue, Hannah Provenza, Hans Pabst, @hartb, Hsiao Yi, Huazuo Gao, Igor
148ChorążEwicz, Ivan Smirnov, Jakub Kolodziejczyk, Jason Gavris, Jason Morton, Jay
149Young, Jayaram Bobba, Jeremy Sawruk, Jiaming Liu, Jihun Choi, @jiqiu, Joan Thibault,
150John C F, Jojy George Varghese, Jon Malmaud, Julian Berman, Julian Niedermeier,
151Junpeng Lao, Kai Sasaki, @Kankroc, Karl Lessard, Kyle Bostelmann, @Lezcano, Li
152Yi, Luo Yun, @lurker, Mahmoud-Abuzaina, Mandeep Singh, Marek Kolodziej, Mark
153Szepieniec, Martial Hue, Medhat Omr, Memo Akten, Michael Gharbi, MichaëL Defferrard,
154Milan Straka, @MircoT, @mlucool, Muammar Ibn Faisal, Nayana Thorat, @nghiattran,
155Nicholas Connor, Nikolaas Steenbergen, Niraj Patel, Niranjan Hasabnis, @Panmari,
156Pavel Bulanov, Philip Pries Henningsen, Philipp Jund, @polonez, Prayag Verma, Rahul
157Kavi, Raphael Gontijo Lopes, @rasbt, Raven Iqqe, Reid Pryzant, Richard Shin, Rizwan
158Asif, Russell Kaplan, Ryo Asakura, RüDiger Busche, Saisai Shao, Sam Abrahams, @sanosay,
159Sean Papay, @seaotterman, @selay01, Shaurya Sharma, Sriram Narayanamoorthy, Stefano
160Probst, @taknevski, @tbonza, @teldridge11, Tim Anglade, Tomas Reimers, Tomer Gafner,
161Valentin Iovene, Vamsi Sripathi, Viktor Malyi, Vit Stepanovs, Vivek Rane, Vlad Firoiu,
162@wangg12, @will, Xiaoyu Tao, Yaroslav Bulatov, Yi Liu, Yuan (Terry) Tang, @Yufeng,
163Yuming Wang, Yuxin Wu, Zafar Takhirov, Ziming Dong
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800164
165We are also grateful to all who filed issues or helped resolve them, asked and
166answered questions, and were part of inspiring discussions.
167
168
Martin Wickebc456e32017-03-23 12:31:16 -0800169# Release 1.0.1
170
171## Bug Fixes and Other Changes
172* Change GraphConstructor to not increase the version when importing, but instead take the min of all versions.
173* Google Cloud Storage fixes.
174* Removed `tf.core` and `tf.python` modules from the API. These were never intended to be exposed. Please use the same objects through top-level `tf` module instead.
175
Benoit Steiner639b4e72017-02-08 09:25:09 -0800176# Release 1.0.0
177
178## Major Features and Improvements
179* XLA (experimental): initial release of [XLA](https://www.tensorflow.org/versions/master/experimental/xla/), a domain-specific compiler for TensorFlow graphs, that targets CPUs and GPUs.
180* TensorFlow Debugger (tfdbg): command-line interface and API.
181* New python 3 docker images added.
182* Made pip packages pypi compliant. TensorFlow can now be installed by `pip
183 install tensorflow` command.
184* Several python API calls have been changed to resemble NumPy more closely.
185* Android: person detection + tracking demo implementing Scalable Object
186 Detection using Deep Neural Networks.
187* New (experimental) [Java API](https://github.com/tensorflow/tensorflow/tree/master/tensorflow/java).
188* Add new Android image stylization demo based on "A Learned Representation For Artistic Style", and add YOLO object detector support.
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800189
190## Breaking Changes to the API
Benoit Steiner639b4e72017-02-08 09:25:09 -0800191To help you upgrade your existing TensorFlow Python code to match the API changes below, we have prepared a [conversion script](https://github.com/tensorflow/tensorflow/tree/master/tensorflow/tools/compatibility).
192* TensorFlow/models have been moved to a separate github repository.
Andrew Sellefcc39232016-11-22 10:04:37 -0800193* Division and modulus operators (/, //, %) now match Python (flooring)
Andrew Sellef0a6d1e2016-12-13 16:01:12 -0800194 semantics. This applies to `tf.div` and `tf.mod` as well. To obtain forced
195 integer truncation based behaviors you can use `tf.truncatediv`
196 and `tf.truncatemod`.
197* `tf.divide()` is now the recommended division function. `tf.div()` will
198 remain, but its semantics do not respond to Python 3 or `from future`
199 mechanisms.
200* tf.reverse() now takes indices of axes to be reversed. E.g.
201 `tf.reverse(a, [True, False, True])` must now be written as
202 `tf.reverse(a, [0, 2])`. `tf.reverse_v2()` will remain until 1.0 final.
203* `tf.mul`, `tf.sub` and `tf.neg` are deprecated in favor of `tf.multiply`,
204 `tf.subtract` and `tf.negative`.
A. Unique TensorFlower44977ae2016-12-15 18:36:06 -0800205* `tf.pack` and `tf.unpack` are deprecated in favor of `tf.stack` and
206 `tf.unstack`.
207* `TensorArray.pack` and `TensorArray.unpack` are getting deprecated in favor of
208 `TensorArray.stack` and `TensorArray.unstack`.
Andrew Sellef0a6d1e2016-12-13 16:01:12 -0800209* The following Python functions have had their arguments changed to use `axis`
210 when referring to specific dimensions. We have kept the old keyword arguments
211 for compatibility currently, but we will be removing them well before the
212 final 1.0.
213 * `tf.argmax`: `dimension` becomes `axis`
214 * `tf.argmin`: `dimension` becomes `axis`
215 * `tf.count_nonzero`: `reduction_indices` becomes `axis`
216 * `tf.expand_dims`: `dim` becomes `axis`
217 * `tf.reduce_all`: `reduction_indices` becomes `axis`
218 * `tf.reduce_any`: `reduction_indices` becomes `axis`
219 * `tf.reduce_join`: `reduction_indices` becomes `axis`
220 * `tf.reduce_logsumexp`: `reduction_indices` becomes `axis`
221 * `tf.reduce_max`: `reduction_indices` becomes `axis`
222 * `tf.reduce_mean`: `reduction_indices` becomes `axis`
223 * `tf.reduce_min`: `reduction_indices` becomes `axis`
224 * `tf.reduce_prod`: `reduction_indices` becomes `axis`
225 * `tf.reduce_sum`: `reduction_indices` becomes `axis`
226 * `tf.reverse_sequence`: `batch_dim` becomes `batch_axis`, `seq_dim` becomes `seq_axis`
227 * `tf.sparse_concat`: `concat_dim` becomes `axis`
228 * `tf.sparse_reduce_sum`: `reduction_axes` becomes `axis`
229 * `tf.sparse_reduce_sum_sparse`: `reduction_axes` becomes `axis`
230 * `tf.sparse_split`: `split_dim` becomes `axis`
231* `tf.listdiff` has been renamed to `tf.setdiff1d` to match NumPy naming.
232* `tf.inv` has been renamed to be `tf.reciprocal` (component-wise reciprocal)
233 to avoid confusion with `np.inv` which is matrix inversion
234* tf.round now uses banker's rounding (round to even) semantics to match NumPy.
235* `tf.split` now takes arguments in a reversed order and with different
236 keywords. In particular, we now match NumPy order as
237 `tf.split(value, num_or_size_splits, axis)`.
238* `tf.sparse_split` now takes arguments in reversed order and with different
239 keywords. In particular we now match NumPy order as
240 `tf.sparse_split(sp_input, num_split, axis)`. NOTE: we have temporarily
241 made `tf.sparse_split` require keyword arguments.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800242* `tf.concat` now takes arguments in reversed order and with different keywords. In particular we now match NumPy order as `tf.concat(values, axis, name)`.
243* `tf.image.decode_jpeg` by default uses the faster DCT method, sacrificing
Vijay Vasudevanfebdc1d2016-12-19 21:04:00 -0800244 a little fidelity for improved speed. One can revert to the old
Benoit Steiner639b4e72017-02-08 09:25:09 -0800245 behavior by specifying the attribute `dct_method='INTEGER_ACCURATE'`.
A. Unique TensorFloweredb095c2016-12-20 14:37:03 -0800246* `tf.complex_abs` has been removed from the Python interface. `tf.abs`
247 supports complex tensors and should be used instead.
A. Unique TensorFlowerfac4a352017-01-20 13:14:02 -0800248* In the C++ API (in tensorflow/cc), Input, Output, etc. have moved
249 from the tensorflow::ops namespace to tensorflow.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800250* Template.`var_scope` property renamed to `.variable_scope`
251* SyncReplicasOptimizer is removed and SyncReplicasOptimizerV2 renamed to SyncReplicasOptimizer.
252* `tf.zeros_initializer()` and `tf.ones_initializer()` now return a callable
253 that must be called with initializer arguments, in your code replace
254 `tf.zeros_initializer` with `tf.zeros_initializer()`.
255* `SparseTensor.shape` has been renamed to `SparseTensor.dense_shape`. Same for
256 `SparseTensorValue.shape`.
257* Replace tf.scalar_summary, tf.histogram_summary, tf.audio_summary, tf.image_summary with tf.summary.scalar, tf.summary.histogram, tf.summary.audio, tf.summary.image, respectively. The new summary ops take name rather than tag as their first argument, meaning summary ops now respect TensorFlow name scopes.
258* Replace tf.train.SummaryWriter and tf.train.SummaryWriterCache with tf.summary.FileWriter and tf.summary.FileWriterCache.
259* Removes RegisterShape from public API. Use C++ shape function registration
260 instead.
261* Deprecated `_ref` dtypes from the python API.
262* In the C++ API (in tensorflow/cc), Input, Output, etc. have moved
263 from the tensorflow::ops namespace to tensorflow.
264* Change arg order for `{softmax,sparse_softmax,sigmoid}_cross_entropy_with_logits` to be (labels, predictions), and force use of named args.
A. Unique TensorFlowerccbc8992017-04-04 16:10:08 -0800265* tf.nn.rnn_cell.* and most functions in tf.nn.rnn.* (with the exception of dynamic_rnn and raw_rnn) are temporarily in tf.contrib.rnn. They will be moved back into core for TF 1.2.
Martin Wickebc456e32017-03-23 12:31:16 -0800266* `tf.nn.sampled_softmax_loss` and `tf.nn.nce_loss` have both changed their API such that you need to switch the `inputs, labels` to `labels, inputs` parameters.
267* The shape keyword argument of the `SparseTensor` constructor changes its name to `dense_shape` between Tensorflow 0.12 and Tensorflow 1.0.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800268
269## Bug Fixes and Other Changes
Andrew Harp3e975ea2017-03-01 17:59:22 -0800270* Numerous C++ API updates.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800271* New op: `parallel_stack`.
272* Introducing common tf io compression options constants for
273 RecordReader/RecordWriter.
274* Add `sparse_column_with_vocabulary_file`, to specify a feature column that
275 transform string features to IDs, where the mapping is defined by a vocabulary
276 file.
277* Added `index_to_string_table` which returns a lookup table that maps indices to
278 strings.
279* Add `string_to_index_table`, which returns a lookup table that matches strings
280 to indices.
281* Add a `ParallelForWithWorkerId` function.
282* Add `string_to_index_table`, which returns a lookup table that matches strings
283 to indices.
284* Support restore session from checkpoint files in v2 in `contrib/session_bundle`.
285* Added a tf.contrib.image.rotate function for arbitrary angles.
286* Added `tf.contrib.framework.filter_variables` as a convenience function to
287 filter lists of variables based on regular expressions.
288* `make_template()` takes an optional `custom_getter_ param`.
289* Added comment about how existing directories are handled by
290 `recursive_create_dir`.
291* Added an op for QR factorizations.
292* Divides and mods in Python API now use flooring (Python) semantics.
293* Android: pre-built libs are now built nightly.
294* Android: cmake/gradle build for TensorFlow Inference library under
295 `contrib/android/cmake`
296* Android: Much more robust Session initialization code.
297* Android: TF stats now exposed directly in demo and log when debug mode is
298 active
299* Android: new/better README.md documentation
300* saved_model is available as `tf.saved_model`.
301* Empty op is now stateful.
302* Improve speed of scatter_update on the cpu for ASSIGN operations.
303* Change `reduce_join` to treat `reduction_indices` in the same way as other `reduce_` ops.
304* Move `TensorForestEstimator` to `contrib/tensor_forest`.
305* Enable compiler optimizations by default and allow configuration in configure.
306* `tf.divide` now honors the name field.
307* Make metrics weight broadcasting more strict.
308* Add new queue-like `StagingArea` and new ops: `stage` and `unstage`.
Andrew Harp3e975ea2017-03-01 17:59:22 -0800309* Enable inplace update ops for strings on CPU. Speed up string concat.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800310
311## Thanks to our Contributors
312
313This release contains contributions from many people at Google, as well as:
314
315Aaron Hu, Abhishek Aggarwal, Adam Michael, Adriano Carmezim, @AfirSraftGarrier,
316Alexander Novikov, Alexander Rosenberg Johansen, Andrew Gibiansky, Andrew Hundt,
317Anish Shah, Anton Loss, @b0noI, @BoyuanJiang, Carl Thomé, Chad Kennedy, Comic
318Chang, Connor Braa, Daniel N. Lang, Daniel Trebbien,
319@danielgordon10, Darcy Liu, Darren Garvey, Dmitri Lapin, Eron Wright, Evan
320Cofer, Fabrizio Milo, Finbarr Timbers, Franck Dernoncourt, Garrett Smith,
321@guschmue, Hao Wei, Henrik Holst, Huazuo Gao, @Ian, @Issac, Jacob Israel,
322Jangsoo Park, Jin Kim, Jingtian Peng, John Pope, Kye Bostelmann, Liangliang He,
323Ling Zhang, Luheng He, Luke Iwanski, @lvli, Michael Basilyan, Mihir Patel,
324Mikalai Drabovich, Morten Just, @newge, Nick Butlin, Nishant Shukla,
325Pengfei Ni, Przemyslaw Tredak, @rasbt, @Ronny, Rudolf Rosa, @RustingSword,
326Sam Abrahams, Sam Putnam, @SeongAhJo, Shi Jiaxin, @skavulya, Steffen MüLler,
327@TheUSER123, @tiriplicamihai, @vhasanov, Victor Costan, Vit Stepanovs,
328Wangda Tan, Wenjian Huang, Xingdong Zuo, Yaroslav Bulatov, Yota Toyama,
329Yuan (Terry) Tang, Yuxin Wu
330
331We are also grateful to all who filed issues or helped resolve them, asked and
332answered questions, and were part of inspiring discussions.
333
Andrew Harp1cb96892016-12-08 20:05:49 -0800334
335# Release 0.12.0
336
337## Major Features and Improvements
338
339* TensorFlow now builds and runs on Microsoft Windows (tested on Windows 10,
340 Windows 7, and Windows Server 2016). Supported languages include Python (via a
341 pip package) and C++. CUDA 8.0 and cuDNN 5.1 are supported for GPU
342 acceleration. Known limitations include: It is not currently possible to load
343 a custom op library. The GCS and HDFS file systems are not currently
344 supported. The following ops are not currently implemented:
Martin Wicke2e4869a2016-12-14 15:46:53 -0800345 Dequantize, QuantizeAndDequantize, QuantizedAvgPool,
Andrew Harp1cb96892016-12-08 20:05:49 -0800346 QuantizedBatchNomWithGlobalNormalization, QuantizedBiasAdd, QuantizedConcat,
347 QuantizedConv2D, QuantizedMatmul, QuantizedMaxPool,
348 QuantizeDownAndShrinkRange, QuantizedRelu, QuantizedRelu6, QuantizedReshape,
349 QuantizeV2, RequantizationRange, and Requantize.
350* Go: Experimental API in Go to create and execute graphs
351 (https://godoc.org/github.com/tensorflow/tensorflow/tensorflow/go)
352* New checkpoint format becomes the default in `tf.train.Saver`. Old V1
353 checkpoints continue to be readable; controlled by the `write_version`
354 argument, `tf.train.Saver` now by default writes out in the new V2
355 format. It significantly reduces the peak memory required and latency
356 incurred during restore.
357* Added a new library for library of matrix-free (iterative) solvers for linear
358 equations, linear least-squares, eigenvalues and singular values in
359 tensorflow/contrib/solvers. Initial version has lanczos bidiagonalization,
360 conjugate gradients and CGLS.
361* Added gradients for `matrix_solve_ls` and `self_adjoint_eig`.
362* Large cleanup to add second order gradient for ops with C++ gradients and
363 improve existing gradients such that most ops can now be differentiated
364 multiple times.
365* Added a solver for ordinary differential equations,
366 `tf.contrib.integrate.odeint`.
367* New contrib module for tensors with named axes, `tf.contrib.labeled_tensor`.
368* Visualization of embeddings in TensorBoard.
369
370## Breaking Changes to the API
371
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800372* `BusAdjacency` enum replaced with a protocol buffer `DeviceLocality`. PCI bus
Benoit Steiner639b4e72017-02-08 09:25:09 -0800373 indexing now starts from 1 instead of 0, and `bus_id==0` is used where
374 previously `BUS_ANY` was used.
Jonathan Hseu879e0ac2016-11-04 11:53:50 -0800375* `Env::FileExists` and `FileSystem::FileExists` now return a tensorflow::Status
Vijay Vasudevan93a975e2017-02-17 17:05:49 -0800376 instead of a bool. Any callers to this function can be converted to a bool
Jonathan Hseu879e0ac2016-11-04 11:53:50 -0800377 by adding .ok() to the call.
Asim Shankare580e722016-11-09 08:21:50 -0800378* The C API type `TF_SessionWithGraph` has been renamed to `TF_Session`,
379 indicating its preferred use in language bindings for TensorFlow.
380 What was previously `TF_Session` has been renamed to `TF_DeprecatedSession`.
Benoit Steiner639b4e72017-02-08 09:25:09 -0800381* Renamed `TF_Port` to `TF_Output` in the C API.
Andrew Harp1cb96892016-12-08 20:05:49 -0800382* Removes RegisterShape from public API. Use C++ shape function registration instead.
383 indexing now starts from 1 instead of 0, and `bus_id==0` is used where
384 previously `BUS_ANY` was used.
Eugene Brevdo7a7c1eb2016-11-29 09:38:37 -0800385* Most RNN cells and RNN functions now use different variable scopes to be
386 consistent with layers (`tf.contrib.layers`). This means old checkpoints
387 written using this code will not load after this change without providing
388 `Saver` a list of variable renames. Examples of variable scope changes
389 include `RNN` -> `rnn` in `tf.nn.rnn`, `tf.nn.dynamic_rnn` and moving from
390 `Linear/Matrix` -> `weights` and `Linear/Bias` -> `biases` in most RNN cells.
A. Unique TensorFlowerfe558b02016-11-30 11:51:57 -0800391* Deprecated tf.select op. tf.where should be used instead.
Martin Wickea7cd5f62016-12-14 15:22:55 -0800392* `SparseTensor.shape` has been renamed to `SparseTensor.dense_shape`. Same for
393 `SparseTensorValue.shape`.
Andrew Harp1cb96892016-12-08 20:05:49 -0800394* `Env::FileExists` and `FileSystem::FileExists` now return a
Vijay Vasudevan93a975e2017-02-17 17:05:49 -0800395 `tensorflow::Status` instead of a bool. Any callers to this function can be
Andrew Harp1cb96892016-12-08 20:05:49 -0800396 converted to a bool by adding `.ok()` to the call.
397* C API: Type `TF_SessionWithGraph` has been renamed to `TF_Session`, indicating
398 its preferred use in language bindings for TensorFlow. What was previously
399 `TF_Session` has been renamed to `TF_DeprecatedSession`.
400* C API: Renamed `TF_Port` to `TF_Output`.
401* C API: The caller retains ownership of `TF_Tensor` objects provided to
402 `TF_Run`, `TF_SessionRun`, `TF_SetAttrTensor` etc.
403* Renamed `tf.image.per_image_whitening()` to
404 `tf.image.per_image_standardization()`
405* Move Summary protobuf constructors to `tf.summary` submodule.
406* Deprecate `histogram_summary`, `audio_summary`, `scalar_summary`,
407 `image_summary`, `merge_summary`, and `merge_all_summaries`.
408* Combined `batch_*` and regular version of linear algebra and FFT ops. The
409 regular op now handles batches as well. All `batch_*` Python interfaces were
410 removed.
411* `tf.all_variables`, `tf.VARIABLES` and `tf.initialize_all_variables` renamed
412 to `tf.global_variables`, `tf.GLOBAL_VARIABLES` and
413 `tf.global_variables_initializer` respectively.
A. Unique TensorFlower46d2c282017-01-02 22:19:48 -0800414* `tf.zeros_initializer()` and `tf.ones_initializer()` now return a callable
415 that must be called with initializer arguments, in your code replace
Benoit Steiner639b4e72017-02-08 09:25:09 -0800416 `tf.zeros_initializer` with `tf.zeros_initializer()`
Andrew Harp1cb96892016-12-08 20:05:49 -0800417
418## Bug Fixes and Other Changes
419
420* Use threadsafe version of `lgamma` function.
421* Fix `tf.sqrt` handling of negative arguments.
422* Fixed bug causing incorrect number of threads to be used for multi-threaded
423 benchmarks.
424* Performance optimizations for `batch_matmul` on multi-core CPUs.
425* Improve trace, `matrix_set_diag`, `matrix_diag_part` and their gradients to
426 work for rectangular matrices.
427* Support for SVD of complex valued matrices.
428
429
430## Thanks to our Contributors
431
432This release contains contributions from many people at Google, as well as:
433
434@a7744hsc, Abhi Agg, @admcrae, Adriano Carmezim, Aki Sukegawa, Alex Kendall,
435Alexander Rosenberg Johansen, @amcrae, Amlan Kar, Andre Simpelo, Andreas Eberle,
436Andrew Hundt, Arnaud Lenglet, @b0noI, Balachander Ramachandran, Ben Barsdell,
437Ben Guidarelli, Benjamin Mularczyk, Burness Duan, @c0g, Changming Sun,
438@chanis, Corey Wharton, Dan J, Daniel Trebbien, Darren Garvey, David Brailovsky,
439David Jones, Di Zeng, @DjangoPeng, Dr. Kashif Rasul, @drag0, Fabrizio (Misto)
440Milo, FabríCio Ceschin, @fp, @Ghedeon, @guschmue, Gökçen Eraslan, Haosdent
441Huang, Haroen Viaene, Harold Cooper, Henrik Holst, @hoangmit, Ivan Ukhov, Javier
442Dehesa, Jingtian Peng, Jithin Odattu, Joan Pastor, Johan Mathe, Johannes Mayer,
443Jongwook Choi, Justus Schwabedal, Kai Wolf, Kamil Hryniewicz, Kamran Amini,
444Karen Brems, Karl Lattimer, @kborer, Ken Shirriff, Kevin Rose, Larissa Laich,
445Laurent Mazare, Leonard Lee, Liang-Chi Hsieh, Liangliang He, Luke Iwanski,
446Marek Kolodziej, Moustafa Alzantot, @MrQianjinsi, @nagachika, Neil Han, Nick
447Meehan, Niels Ole Salscheider, Nikhil Mishra, @nschuc, Ondrej Skopek, OndřEj
448Filip, @OscarDPan, Pablo Moyano, Przemyslaw Tredak, @qitaishui, @Quarazy,
449@raix852, Philipp Helo, Sam Abrahams, @SriramRamesh, Till Hoffmann, Tushar Soni,
450@tvn, @tyfkda, Uwe Schmidt, Victor Villas, Vit Stepanovs, Vladislav Gubarev,
451@wujingyue, Xuesong Yang, Yi Liu, Yilei Yang, @youyou3, Yuan (Terry) Tang,
452Yuming Wang, Zafar Takhirov, @zhongyuk, Ziming Dong, @guotong1988
453
454We are also grateful to all who filed issues or helped resolve them, asked and
455answered questions, and were part of inspiring discussions.
A. Unique TensorFlower79228c72016-10-19 16:25:46 -0800456
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800457# Release 0.11.0
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800458
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800459## Major Features and Improvements
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800460
Vijay Vasudevan818993c2016-11-03 17:07:01 -0800461* CUDA 8 support.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800462* cuDNN 5 support.
463* HDFS Support.
464* Adds Fused LSTM support via cuDNN 5 in `tensorflow/contrib/cudnn_rnn`.
465* Improved support for NumPy style basic slicing including non-1 strides,
466 ellipses, newaxis, and negative indices. For example complicated expressions
467 like `foo[1, 2:4, tf.newaxis, ..., :-3:-1, :]` are now supported. In addition
468 we have preliminary (non-broadcasting) support for sliced assignment to
469 variables. In particular one can write `var[1:3].assign([1,11,111])`.
470* Deprecated `tf.op_scope` and `tf.variable_op_scope` in favor of a unified `tf.name_scope` and `tf.variable_scope`. The new argument order of `tf.variable_scope` is incompatible with previous versions.
471* Introducing `core/util/tensor_bundle` module: a module to efficiently
472 serialize/deserialize tensors to disk. Will be used in TF's new checkpoint
473 format.
474* Added tf.svd for computing the singular value decomposition (SVD) of dense
475 matrices or batches of matrices (CPU only).
476* Added gradients for eigenvalues and eigenvectors computed using
477 `self_adjoint_eig` or `self_adjoint_eigvals`.
478* Eliminated `batch_*` methods for most linear algebra and FFT ops and promoted
479 the non-batch version of the ops to handle batches of matrices.
480* Tracing/timeline support for distributed runtime (no GPU profiler yet).
481* C API gives access to inferred shapes with `TF_GraphGetTensorNumDims` and
482 `TF_GraphGetTensorShape`.
483* Shape functions for core ops have moved to C++ via
484 `REGISTER_OP(...).SetShapeFn(...)`. Python shape inference RegisterShape calls
485 use the C++ shape functions with `common_shapes.call_cpp_shape_fn`. A future
486 release will remove `RegisterShape` from python.
487
488
489## Bug Fixes and Other Changes
490
491* Documentation now includes operator overloads on Tensor and Variable.
492* `tensorflow.__git_version__` now allows users to identify the version of the
493 code that TensorFlow was compiled with. We also have
494 `tensorflow.__git_compiler__` which identifies the compiler used to compile
495 TensorFlow's core.
496* Improved multi-threaded performance of `batch_matmul`.
Eugene Brevdo21e1cc72016-08-11 21:45:39 -0800497* LSTMCell, BasicLSTMCell, and MultiRNNCell constructors now default to
498 `state_is_tuple=True`. For a quick fix while transitioning to the new
499 default, simply pass the argument `state_is_tuple=False`.
Vijay Vasudevan2d0d1262016-08-08 14:06:20 -0800500* DeviceFactory's AddDevices and CreateDevices functions now return
501 a Status instead of void.
A. Unique TensorFlower84cefad2016-08-12 07:06:13 -0800502* Int32 elements of list(type) arguments are no longer placed in host memory by
503 default. If necessary, a list(type) argument to a kernel can be placed in host
504 memory using a HostMemory annotation.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800505* `uniform_unit_scaling_initializer()` no longer takes a `full_shape` arg,
506 instead relying on the partition info passed to the initializer function when
507 it's called.
508* The NodeDef protocol message is now defined in its own file `node_def.proto`
509 `instead of graph.proto`.
510* `ops.NoGradient` was renamed `ops.NotDifferentiable`. `ops.NoGradient` will
Vijay Vasudevan612bae72016-09-09 11:03:09 -0800511 be removed soon.
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800512* `dot.h` / DotGraph was removed (it was an early analysis tool prior
Vijay Vasudevan269bfee2016-09-21 21:41:19 -0800513 to TensorBoard, no longer that useful). It remains in history
514 should someone find the code useful.
Vijay Vasudevan914625a2016-09-23 13:51:34 -0800515* re2 / regexp.h was removed from being a public interface of TF.
516 Should users need regular expressions, they should depend on the RE2
517 library directly rather than via TensorFlow.
Dan Manée5bcf542016-05-16 13:39:34 -0800518
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800519## Thanks to our Contributors
520
521This release contains contributions from many people at Google, as well as:
522
523Abid K, @afshinrahimi, @AidanGG, Ajay Rao, Aki Sukegawa, Alex Rothberg,
524Alexander Rosenberg Johansen, Andrew Gibiansky, Andrew Thomas, @Appleholic,
525Bastiaan Quast, Ben Dilday, Bofu Chen, Brandon Amos, Bryon Gloden, Cissp®,
526@chanis, Chenyang Liu, Corey Wharton, Daeyun Shin, Daniel Julius Lasiman, Daniel
527Waterworth, Danijar Hafner, Darren Garvey, Denis Gorbachev, @DjangoPeng,
528Egor-Krivov, Elia Palme, Eric Platon, Fabrizio Milo, Gaetan Semet,
529Georg Nebehay, Gu Wang, Gustav Larsson, @haosdent, Harold Cooper, Hw-Zz,
530@ichuang, Igor Babuschkin, Igor Macedo Quintanilha, Ilya Edrenkin, @ironhead,
531Jakub Kolodziejczyk, Jennifer Guo, Jihun Choi, Jonas Rauber, Josh Bleecher
532Snyder, @jpangburn, Jules Gagnon-Marchand, Karen Brems, @kborer, Kirill Bobyrev,
533Laurent Mazare, Longqi Yang, Malith Yapa, Maniteja Nandana, Martin Englund,
534Matthias Winkelmann, @mecab, Mu-Ik Jeon, Nand Dalal, Niels Ole Salscheider,
535Nikhil Mishra, Park Jiin, Pieter De Rijk, @raix852, Ritwik Gupta, Sahil Sharma,
Patrick Nguyenc5ab3dd2016-10-20 12:09:18 -0800536Sangheum Hwang, @SergejsRk, Shinichiro Hamaji, Simon Denel, @Steve, @suiyuan2009,
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800537Tiago Jorge, Tijmen Tieleman, @tvn, @tyfkda, Wang Yang, Wei-Ting Kuo, Wenjian
538Huang, Yan Chen, @YenChenLin, Yuan (Terry) Tang, Yuncheng Li, Yunfeng Wang, Zack
539Polizzi, @zhongzyd, Ziming Dong, @perhapszzy
540
541We are also grateful to all who filed issues or helped resolve them, asked and
542answered questions, and were part of inspiring discussions.
543
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800544# Release 0.10.0
A. Unique TensorFlower533d8912016-06-30 12:10:50 -0800545
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800546## Major Features and Improvements
547
548* Added support for C++ shape inference
549* Added graph-construction C API
550* Major revision to the graph-construction C++ API
551* Support makefile build for iOS
552* Added Mac GPU support
553* Full version of TF-Slim available as `tf.contrib.slim`
554* Added k-Means clustering and WALS matrix factorization
555
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800556## Bug Fixes and Other Changes
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800557
558* Allow gradient computation for scalar values.
559* Performance improvements for gRPC
560* Improved support for fp16
561* New high-level ops in tf.contrib.{layers,metrics}
562* New features for TensorBoard, such as shape display, exponential smoothing
563* Faster and more stable Google Cloud Storage (GCS) filesystem support
564* Support for zlib compression and decompression for TFRecordReader and TFRecordWriter
565* Support for reading (animated) GIFs
566* Improved support for SparseTensor
567* Added support for more probability distributions (Dirichlet, Beta, Bernoulli, etc.)
568* Added Python interfaces to reset resource containers.
569* Many bugfixes and performance improvements
570* Many documentation fixes
571
572## Thanks to our Contributors
573
574This release contains contributions from many people at Google, as well as:
575
576Alex Rothberg, Andrew Royer, Austin Marshall, @BlackCoal, Bob Adolf, Brian Diesel, Charles-Emmanuel Dias, @chemelnucfin, Chris Lesniewski, Daeyun Shin, Daniel Rodriguez, Danijar Hafner, Darcy Liu, Kristinn R. Thórisson, Daniel Castro, Dmitry Savintsev, Kashif Rasul, Dylan Paiton, Emmanuel T. Odeke, Ernest Grzybowski, Gavin Sherry, Gideon Dresdner, Gregory King, Harold Cooper, @heinzbeinz, Henry Saputra, Huarong Huo, Huazuo Gao, Igor Babuschkin, Igor Macedo Quintanilha, Ivan Ukhov, James Fysh, Jan Wilken Dörrie, Jihun Choi, Johnny Lim, Jonathan Raiman, Justin Francis, @lilac, Li Yi, Marc Khoury, Marco Marchesi, Max Melnick, Micael Carvalho, @mikowals, Mostafa Gazar, Nico Galoppo, Nishant Agrawal, Petr Janda, Yuncheng Li, @raix852, Robert Rose, @Robin-des-Bois, Rohit Girdhar, Sam Abrahams, satok16, Sergey Kishchenko, Sharkd Tu, @shotat, Siddharth Agrawal, Simon Denel, @sono-bfio, SunYeop Lee, Thijs Vogels, @tobegit3hub, @Undo1, Wang Yang, Wenjian Huang, Yaroslav Bulatov, Yuan Tang, Yunfeng Wang, Ziming Dong
577
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800578We are also grateful to all who filed issues or helped resolve them, asked and
579answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800580
581# Release 0.9.0
582
583## Major Features and Improvements
584
585* Python 3.5 support and binaries
586* Added iOS support
587* Added support for processing on GPUs on MacOS
588* Added makefile for better cross-platform build support (C API only)
589* fp16 support and improved complex128 support for many ops
590* Higher level functionality in contrib.{layers,losses,metrics,learn}
591* More features to Tensorboard
592* Improved support for string embedding and sparse features
593* The RNN api is finally "official" (see, e.g., `tf.nn.dynamic_rnn`,
594 `tf.nn.rnn`, and the classes in `tf.nn.rnn_cell`).
595* TensorBoard now has an Audio Dashboard, with associated audio summaries.
596
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800597## Bug Fixes and Other Changes
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800598
599* Turned on CuDNN Autotune.
600* Added support for using third-party Python optimization algorithms (contrib.opt).
601* Google Cloud Storage filesystem support.
602* HDF5 support
603* Add support for 3d convolutions and pooling.
604* Update gRPC release to 0.14.
605* Eigen version upgrade.
606* Switch to eigen thread pool
607* `tf.nn.moments()` now accepts a `shift` argument. Shifting by a good estimate
608 of the mean improves numerical stability. Also changes the behavior of the
609 `shift` argument to `tf.nn.sufficient_statistics()`.
610* Performance improvements
611* Many bugfixes
612* Many documentation fixes
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800613* TensorBoard fixes: graphs with only one data point, Nan values,
614 reload button and auto-reload, tooltips in scalar charts, run
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800615 filtering, stable colors
616* Tensorboard graph visualizer now supports run metadata. Clicking on nodes
617 while viewing a stats for a particular run will show runtime statistics, such
618 as memory or compute usage. Unused nodes will be faded out.
619
620## Thanks to our Contributors
621
622This release contains contributions from many people at Google, as well as:
623
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800624Aaron Schumacher, Aidan Dang, Akihiko ITOH, Aki Sukegawa, Arbit Chen, Aziz Alto, Danijar Hafner, Erik Erwitt, Fabrizio Milo, Felix Maximilian Möller, Henry Saputra, Sung Kim, Igor Babuschkin, Jan Zikes, Jeremy Barnes, Jesper Steen Møller, Johannes Mayer, Justin Harris, Kashif Rasul, Kevin Robinson, Loo Rong Jie, Lucas Moura, Łukasz Bieniasz-Krzywiec, Mario Cho, Maxim Grechkin, Michael Heilman, Mostafa Rahmani, Mourad Mourafiq, @ninotoshi, Orion Reblitz-Richardson, Yuncheng Li, @raoqiyu, Robert DiPietro, Sam Abrahams, Sebastian Raschka, Siddharth Agrawal, @snakecharmer1024, Stephen Roller, Sung Kim, SunYeop Lee, Thijs Vogels, Till Hoffmann, Victor Melo, Ville Kallioniemi, Waleed Abdulla, Wenjian Huang, Yaroslav Bulatov, Yeison Rodriguez, Yuan Tang, Yuxin Wu, @zhongzyd, Ziming Dong, Zohar Jackson
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800625
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800626We are also grateful to all who filed issues or helped resolve them, asked and
627answered questions, and were part of inspiring discussions.
Vijay Vasudevan490afa92016-06-21 09:18:06 -0800628
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800629# Release 0.8.0
630
631## Major Features and Improvements
632
633* Added a distributed runtime using GRPC
634* Move skflow to `contrib/learn`
635* Better linear optimizer in `contrib/linear_optimizer`
636* Random forest implementation in `contrib/tensor_forest`
637* CTC loss and decoders in `contrib/ctc`
638* Basic support for `half` data type
639* Better support for loading user ops (see examples in `contrib/`)
640* Allow use of (non-blocking) Eigen threadpool with `TENSORFLOW_USE_EIGEN_THREADPOOL` define
641* Add an extension mechanism for adding network file system support
642* TensorBoard displays metadata stats (running time, memory usage and device used) and tensor shapes
643
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800644## Bug Fixes and Other Changes
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800645
646* Utility for inspecting checkpoints
647* Basic tracing and timeline support
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800648* Allow building against cuDNN 5 (not incl. RNN/LSTM support)
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800649* Added instructions and binaries for ProtoBuf library with fast serialization and without 64MB limit
650* Added special functions
Dan Mané54a71782016-09-09 16:07:46 -0800651* `bool`-strictness: Tensors have to be explicitly compared to `None`
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800652* Shape strictness: all fed values must have a shape that is compatible with the tensor they are replacing
653* Exposed `tf.while_loop` (deprecated `control_flow_ops.While`)
654* run() now takes RunOptions and RunMetadata, which enable timing stats
655* Fixed lots of potential overflow problems in op kernels
656* Various performance improvements, especially for RNNs and convolutions
657* Many bugfixes
658* Nightly builds, tutorial tests, many test improvements
659* New examples: transfer learning and deepdream ipython notebook
660* Added tutorials, many documentation fixes.
661
662## Thanks to our Contributors
663
664This release contains contributions from many people at Google, as well as:
665
A. Unique TensorFlowerabe9ab32016-07-31 22:07:30 -0800666Abhinav Upadhyay, Aggelos Avgerinos, Alan Wu, Alexander G. de G. Matthews, Aleksandr Yahnev, @amchercashin, Andy Kitchen, Aurelien Geron, Awni Hannun, @BanditCat, Bas Veeling, Cameron Chen, @cg31, Cheng-Lung Sung, Christopher Bonnett, Dan Becker, Dan Van Boxel, Daniel Golden, Danijar Hafner, Danny Goodman, Dave Decker, David Dao, David Kretch, Dongjoon Hyun, Dustin Dorroh, @e-lin, Eurico Doirado, Erik Erwitt, Fabrizio Milo, @gaohuazuo, Iblis Lin, Igor Babuschkin, Isaac Hodes, Isaac Turner, Iván Vallés, J Yegerlehner, Jack Zhang, James Wexler, Jan Zikes, Jay Young, Jeff Hodges, @jmtatsch, Johnny Lim, Jonas Meinertz Hansen, Kanit Wongsuphasawat, Kashif Rasul, Ken Shirriff, Kenneth Mitchner, Kenta Yonekura, Konrad Magnusson, Konstantin Lopuhin, @lahwran, @lekaha, @liyongsea, Lucas Adams, @makseq, Mandeep Singh, @manipopopo, Mark Amery, Memo Akten, Michael Heilman, Michael Peteuil, Nathan Daly, Nicolas Fauchereau, @ninotoshi, Olav Nymoen, @panmari, @papelita1234, Pedro Lopes, Pranav Sailesh Mani, RJ Ryan, Rob Culliton, Robert DiPietro, @ronrest, Sam Abrahams, Sarath Shekkizhar, Scott Graham, Sebastian Raschka, Sung Kim, Surya Bhupatiraju, Syed Ahmed, Till Hoffmann, @timsl, @urimend, @vesnica, Vlad Frolov, Vlad Zagorodniy, Wei-Ting Kuo, Wenjian Huang, William Dmitri Breaden Madden, Wladimir Schmidt, Yuan Tang, Yuwen Yan, Yuxin Wu, Yuya Kusakabe, @zhongzyd, @znah.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800667
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800668We are also grateful to all who filed issues or helped resolve them, asked and
669answered questions, and were part of inspiring discussions.
Illia Polosukhin5c9bc512016-04-18 17:56:51 -0800670
671
Eugene Brevdo56f1d642016-03-10 17:18:30 -0800672# Release 0.7.1
673
674## Bug Fixes and Other Changes
675
676* Added gfile.Open and gfile.Copy, used by input_data.py.
677* Fixed Saver bug when MakeDirs tried to create empty directory.
678* GPU Pip wheels are built with cuda 7.5 and cudnn-v4, making them
679 required for the binary releases. Lower versions of cuda/cudnn can
680 be supported by installing from sources and setting the options
681 during ./configure
682* Fix dataset encoding example for Python3 (@danijar)
683* Fix PIP installation by not packaging protobuf as part of wheel,
684 require protobuf 3.0.0b2.
685* Fix Mac pip installation of numpy by requiring pip >= 1.10.1.
686* Improvements and fixes to Docker image.
687
688
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800689# Release 0.7.0
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -0800690
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800691## Major Features and Improvements
692
693* Allow using any installed Cuda >= 7.0 and cuDNN >= R2, and add support
694 for cuDNN R4
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800695* Added a `contrib/` directory for unsupported or experimental features,
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800696 including higher level `layers` module
697* Added an easy way to add and dynamically load user-defined ops
698* Built out a good suite of tests, things should break less!
699* Added `MetaGraphDef` which makes it easier to save graphs with metadata
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800700* Added assignments for "Deep Learning with TensorFlow" udacity course
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800701
702
703## Bug Fixes and Other Changes
704
705* Added a versioning framework for `GraphDef`s to ensure compatibility
706* Enforced Python 3 compatibility
707* Internal changes now show up as sensibly separated commits
708* Open-sourced the doc generator
709* Un-fork Eigen
710* Simplified the `BUILD` files and cleaned up C++ headers
711* TensorFlow can now be used as a submodule in another bazel build
712* New ops (e.g., `*fft`, `*_matrix_solve`)
713* Support for more data types in many ops
714* Performance improvements
715* Various bugfixes
716* Documentation fixes and improvements
717
718
719## Breaking Changes to the API
Vijay Vasudevan10e62dc2015-12-11 23:03:16 -0800720
721* `AdjustContrast` kernel deprecated, new kernel `AdjustContrastv2` takes and
722 outputs float only. `adjust_contrast` now takes all data types.
723* `adjust_brightness`'s `delta` argument is now always assumed to be in `[0,1]`
724 (as is the norm for images in floating point formats), independent of the
725 data type of the input image.
726* The image processing ops do not take `min` and `max` inputs any more, casting
727 safety is handled by `saturate_cast`, which makes sure over- and underflows
728 are handled before casting to data types with smaller ranges.
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -0800729* For C++ API users: `IsLegacyScalar` and `IsLegacyVector` are now gone from
730 `TensorShapeUtils` since TensorFlow is scalar strict within Google (for
731 example, the shape argument to `tf.reshape` can't be a scalar anymore). The
732 open source release was already scalar strict, so outside Google `IsScalar`
733 and `IsVector` are exact replacements.
Josh Levenbergdb7478e2016-01-20 14:54:50 -0800734* The following files are being removed from `tensorflow/core/public/`:
735 * `env.h` -> `../platform/env.h`
736 * `status.h` -> `../lib/core/status.h`
737 * `tensor.h` -> `../framework/tensor.h`
738 * `tensor_shape.h` -> `../framework/tensor_shape.h`
739 * `partial_tensor_shape.h` -> `../framework/partial_tensor_shape.h`
740 * `tensorflow_server.h` deleted
Geoffrey Irving56437752016-01-25 09:43:13 -0800741* For C++ API users: `TensorShape::ShortDebugString` has been renamed to
742 `DebugString`, and the previous `DebugString` behavior is gone (it was
743 needlessly verbose and produced a confusing empty string for scalars).
Manjunath Kudlurc2722a12016-01-27 13:24:50 -0800744* `GraphOptions.skip_common_subexpression_elimination` has been removed. All
745 graph optimizer options are now specified via
746 `GraphOptions.OptimizerOptions`.
Geoffrey Irving18297122016-02-10 11:48:34 -0800747* `ASSERT_OK` / `EXPECT_OK` macros conflicted with external projects, so they
748 were renamed `TF_ASSERT_OK`, `TF_EXPECT_OK`. The existing macros are
749 currently maintained for short-term compatibility but will be removed.
Eugene Brevdofea55e12016-01-27 14:54:54 -0800750* The non-public `nn.rnn` and the various `nn.seq2seq` methods now return
751 just the final state instead of the list of all states.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800752* `tf.scatter_update` now no longer guarantees that lexicographically largest
753 index be used for update when duplicate entries exist.
Geoffrey Irving3e33d442016-02-08 12:02:44 -0800754* `tf.image.random_crop(image, [height, width])` is now
755 `tf.random_crop(image, [height, width, depth])`, and `tf.random_crop` works
756 for any rank (not just 3-D images). The C++ `RandomCrop` op has been replaced
757 with pure Python.
Geoffrey Irving18297122016-02-10 11:48:34 -0800758* Renamed `tf.test.GetTempDir` and `tf.test.IsBuiltWithCuda` to
759 `tf.test.get_temp_dir` and `tf.test.is_built_with_cuda` for PEP-8
760 compatibility.
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800761* `parse_example`'s interface has changed, the old interface is accessible in
762 `legacy_parse_example` (same for related functions).
763* New `Variable`s are not added to the same collection several times even if
764 a list with duplicates is passed to the constructor.
Josh Levenberg02dff6d2016-01-07 18:37:54 -0800765* The Python API will now properly set the `list` member of `AttrValue` in
766 constructed `GraphDef` messages for empty lists. The serialization of some
767 graphs will change, but the change is both forwards and backwards compatible.
768 It will break tests that compare a generated `GraphDef` to a golden serialized
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800769 `GraphDef` (which is discouraged).
770
771
772## Thanks to our Contributors
773
774This release contains contributions from many people at Google, as well as:
775
776Akiomi Kamakura, Alex Vig, Alexander Rosenberg Johansen, Andre Cruz, Arun Ahuja,
777Bart Coppens, Bernardo Pires, Carl Vondrick, Cesar Salgado, Chen Yu,
778Christian Jauvin, Damien Aymeric, Dan Vanderkam, Denny Britz, Dongjoon Hyun,
779Eren Güven, Erik Erwitt, Fabrizio Milo, G. Hussain Chinoy, Jim Fleming,
780Joao Felipe Santos, Jonas Meinertz Hansen, Joshi Rekha, Julian Viereck,
781Keiji Ariyama, Kenton Lee, Krishna Sankar, Kristina Chodorow, Linchao Zhu,
782Lukas Krecan, Mark Borgerding, Mark Daoust, Moussa Taifi,
783Nathan Howell, Naveen Sundar Govindarajulu, Nick Sweeting, Niklas Riekenbrauck,
784Olivier Grisel, Patrick Christ, Povilas Liubauskas, Rainer Wasserfuhr,
785Romain Thouvenin, Sagan Bolliger, Sam Abrahams, Taehoon Kim, Timothy J Laurent,
786Vlad Zavidovych, Yangqing Jia, Yi-Lin Juang, Yuxin Wu, Zachary Lipton,
787Zero Chen, Alan Wu, @brchiu, @emmjaykay, @jalammar, @Mandar-Shinde,
788@nsipplswezey, @ninotoshi, @panmari, @prolearner and @rizzomichaelg.
789
A. Unique TensorFloweredaf3b32016-10-10 10:26:22 -0800790We are also grateful to all who filed issues or helped resolve them, asked and
791answered questions, and were part of inspiring discussions.
Josh Levenberg02dff6d2016-01-07 18:37:54 -0800792
Geoffrey Irvingcbff45c2016-01-12 08:06:56 -0800793
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800794# Release 0.6.0
795
796## Major Features and Improvements
797
798* Python 3.3+ support via changes to python codebase and ability
799 to specify python version via ./configure.
800
801* Some improvements to GPU performance and memory usage:
802 [convnet benchmarks](https://github.com/soumith/convnet-benchmarks/issues/66)
803 roughly equivalent with native cudnn v2 performance. Improvements mostly due
804 to moving to 32-bit indices, faster shuffling kernels. More improvements to
805 come in later releases.
806
807
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800808## Bug Fixes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800809
810* Lots of fixes to documentation and tutorials, many contributed
811 by the public.
812
813* 271 closed issues on github issues.
814
Vijay Vasudevanfe056f02016-02-17 11:42:30 -0800815## Backwards-Incompatible Changes
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800816
Geoffrey Irving18297122016-02-10 11:48:34 -0800817* `tf.nn.fixed_unigram_candidate_sampler` changed its default 'distortion'
Vijay Vasudevan2c3738d2015-12-08 14:55:13 -0800818 attribute from 0.0 to 1.0. This was a bug in the original release
819 that is now fixed.
820
Vijay Vasudevanddd4aaf2015-12-08 09:58:59 -0800821# Release 0.5.0
822
823Initial release of TensorFlow.