TensorFlow 2.10 shines on Keras, Decision Forests
TensorFlow 2.10, an upgrade to the Google-developed open source machine learning platform, has been released, bringing new user-friendly features to the Keras API, improved aarch64 CPU performance, and the arrival of TensorFlow Decision Forests 1.0, which the developers now describe as stable, mature, and ready for professional environments.
Among the Keras improvements, TensorFlow 2.10 expands and unifies mask handling for Keras attention layers. Two new features have been added. All three layers, tf.keras.layers.Attention, tf.keras.layers.AdditiveAttention, and tf.keras.layers.MultiHeadAttention, now support casual attention (with a use_causal_mask argument to call) and implicit masking (set mask_zero=True in tf.keras.layers.Embedding). These new capabilities simplify implementation of any Transformer-style model.