Jordan Edwards: ML Engineering and DevOps on AzureML
This week we had a super insightful conversation with Jordan Edwards, Principal Program Manager for the AzureML team! Jordan is on the coalface of turning machine learning software engineering into a reality for some of Microsoft’s largest customers.
ML DevOps is all about increasing the velocity of- and orchastrating the non-interactive phase of- software deployments for ML. We cover ML DevOps and Microsoft Azure ML. We discuss model governance, testing, intepretability, tooling. We cover the age-old discussion of the dichotomy between science and engineering and how you can bridge the gap with ML DevOps. We cover Jordan’s maturity model for ML DevOps.
We also cover off some of the exciting ML announcments from the recent Microsoft Build conference i.e. FairLearn, IntepretML, SEAL, WhiteNoise, OpenAI code generation, OpenAI GPT-3.
**ERRATA**: Open AI/GPT-3 DOES NOT USE Microsoft’s ZeRO/DeepSpeed for training
00:00:04 Introduction to ML DevOps and Microsoft Build ML Announcements
00:10:29 Main show kick-off
00:11:06 Jordan’s story
00:14:36 Typical ML DevOps workflow
00:17:38 Tim’s articulation of ML DevOps
00:19:31 Intepretability / Fairness
00:24:31 Testing / Robustness
00:28:10 Using GANs to generate testing data
00:30:26 Gratuitous DL?
00:33:46 Challenges of making an ML DevOps framework / IaaS
00:38:48 Cultural battles in ML DevOps
00:43:04 Maturity Model for Ml DevOps
00:49:19 ML: High interest credit card of technical debt paper
00:50:19 ML Engineering at Microsoft
01:01:20 ML Flow
01:03:05 Company-wide governance
01:08:15 What’s coming next
01:12:10 Jordan’s hillarious piece of advice for his younger self
Super happy with how this turned out, this is not one to miss folks!
* WE DON’T WORK FOR MICROSOFT, THIS IS NOT A MICROSOFT CHANNEL
* NO MS-CONFIDENTIAL INFO DISCUSSED
* JORDAN IS NOT A SPOKESPERSON FOR MICROSOFT, HIS OPINIONS
#deeplearning #machinelearning #devops #mldevops