SimCLR implementations – Data Transforms

This is video no. 10 in a series walking through simCLR research paper, going over implementing the data transforms.

William Falcon, PyTorch Lightning founder, and Ananya Harsh Ja, Lightning research engineer, deep dive into simCLR (“A Simple Framework for Contrastive Learning of Visual Representations”), self-supervised representation learning on images. Start here to get an overview of the paper, and get all the details on PyTorch Lightning implementation: https://www.youtube.com/watch?v=pDJx8i3jenA&list=PLaMu-SDt_RB4k8VXiB3hOdsn0Y3GoXo1k

Next up: implementing the projection head – https://youtu.be/-brxmoHvJBE

Paper: https://arxiv.org/abs/2002.05709
PyTorch Lightning implementation: https://github.com/PyTorchLightning/pytorch-lightning-bolts/tree/master/pl_bolts/models/self_supervised/simclr
Colab: https://colab.research.google.com/drive/1UK8BD3xvTpuSj75blz8hThfXksh19YbA?usp=sharing

Thanks for watching! Please Subscribe!

Source of this PyTorch Lightning Video

AI video(s) you might be interested in …