Transfer learning and Transformer models (ML Tech Talks)

In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, will walk us through the recent history of natural language processing, including the current state of the art architecture, the Transformer.

0:00 – Intro
1:07 – Encoding text
8:21 – Language modeling & transformers
29:46 – Transfer learning & BERT
43:55 – Conclusion

Catch more ML Tech Talks → http://goo.gle/ml-tech-talks
Subscribe to TensorFlow → https://goo.gle/TensorFlow

product: TensorFlow – General; re_ty: Publish;

Source of this TensorFlow AI Video

AI video(s) you might be interested in …