Transformer neural networks are shaking up Artificial Intelligence — July 15, 2021 Starting in 2017, Transformers have facilitated impressive progress in the field of deep learning. Many of us consider Transformers to be the most important development in recent years and with the greatest potential in the area. …

Hugging Face library makes Transformers affordable for everyone — We have already seen that Transformers neural networks are currently the dominant technology in the field of Natural Language Processing, being able to be used in tasks such as classification, extraction, generation, etc. For example, it allows you to classify a text according to whether it has been written with…

In recent years, Transformers have experienced rapid progress in Natural Language Processing — We spend most of our time communicating in natural language, that is, in unstructured text, whether written or spoken. For this reason, research work has been going on for many years to ensure that machines understand these unstructured texts and extract relevant information from them. …

Hands-on about how to scale a Deep Learning application in the BSC’s CTE-Power cluster — This post will be used as documentation in the PATC course Introduction to Big Data Analytics at BSC In a previous post, we demonstrated that supercomputers are a key component of the progress of Artificial Intelligence and what drove changes in effective compute over the last years was the increased…

Contenido abierto del libro DEEP LEARNING Introducción práctica con Keras — Este post contiene el capítulo 7 del libro “Deep Learning — Introducción práctica con Keras (SEGUNDA PARTE)” de Kindle Direct Publishing con ISBN 978–1–687–47399–8 en la colección WATCH THIS SPACE — Barcelona (Book 6). Nota: En el proceso semiautomático de generación de esta versión HTML a partir de la versión…

Introducción práctica con Keras (primera parte) — Acceso en abierto del contenido del libro ISBN 978–1–687–47399–8 Editorial WHAT THIS SPACE Fecha publicación del libro: 27 de mayo de 2018. Esta es una obra introductoria, basada en unos apuntes para dar soporte a mi docencia en la UPC a alumnos y alumnas de ingeniería informática pero con pocos…

Scaling Deep Learning on a Supercomputer using Horovod — [This post will be used in the master course Supercomputers Architecture at UPC Barcelona Tech with the support of the BSC] In the previous post we explored how we can scale the training on Multiple GPUs in one Server with TensorFlow using tf.distributed.MirroredStrategy(). …

Data parallelism approach using tf.distribute.MirroredStrategy — [This post will be used in the master course Supercomputers Architecture at UPC Barcelona Tech with the support of the BSC] In the previous post we introduced the basic concepts in distributed and parallel training Deep Learning. We also presented the frameworks and infrastructure that we will use to scale…

Reduce training time for deep neural networks using Supercomputers — [This post will be used in the master course Supercomputers Architecture at UPC Barcelona Tech with the support of the BSC] “Methods that scale with computation are the future of Artificial Intelligence” — Rich Sutton, father of reinforcement learning (video 4:49) This third post of this series will explore some…