[ML News] Uber: Deep Learning for ETA | MuZero Video Compression | Block-NeRF | EfficientNet-X

#mlnews #muzero #nerf

Your regularly irregular updates on everything new in the ML world!
Merch: http://store.ykilcher.com

OUTLINE:
0:00 – Intro
0:15 – Sponsor: Weights & Biases
2:15 – Uber switches from XGBoost to Deep Learning for ETA prediction
5:45 – MuZero advances video compression
10:10 – Learned Soft Prompts can steer large language models
12:45 – Block-NeRF captures entire city blocks
14:15 – Neural Architecture Search considers underlying hardware
16:50 – Mega-Blog on Self-Organizing Agents
18:40 – Know Your Data (for Tensorflow Datasets)
20:30 – Helpful Things

Sponsor: Weights & Biases
https://wandb.me/yannic

References:
https://docs.wandb.ai/guides/integrations/other/openai
https://colab.research.google.com/github/wandb/examples/blob/master/colabs/openai/Fine_tune_GPT_3_with_Weights_%26_Biases.ipynb#scrollTo=rJdQqrC8Ablo
https://wandb.ai/borisd13/GPT-3/reports/Fine-Tuning-Tips-and-Exploration-on-OpenAI-s-GPT-3—VmlldzoxNDYwODA2

Uber switches from XGBoost to Deep Learning for ETA prediction

DeepETA: How Uber Predicts Arrival Times Using Deep Learning

MuZero advances video compression
https://deepmind.com/blog/article/MuZeros-first-step-from-research-into-the-real-world
https://storage.googleapis.com/deepmind-media/MuZero/MuZero%20with%20self-competition.pdf

Learned Soft Prompts can steer large language models
https://ai.googleblog.com/2022/02/guiding-frozen-language-models-with.html
https://aclanthology.org/2021.emnlp-main.243/

Block-NeRF captures entire city blocks
https://arxiv.org/abs/2202.05263
https://arxiv.org/pdf/2202.05263.pdf
https://waymo.com/intl/zh-cn/research/block-nerf/

Neural Architecture Search considers underlying hardware
https://ai.googleblog.com/2022/02/unlocking-full-potential-of-datacenter.html
https://openaccess.thecvf.com/content/CVPR2021/papers/Li_Searching_for_Fast_Model_Families_on_Datacenter_Accelerators_CVPR_2021_paper.pdf

Mega-Blog on Self-Organizing Agents
https://developmentalsystems.org/sensorimotor-lenia/

Home

Know Your Data (for Tensorflow Datasets)
https://knowyourdata-tfds.withgoogle.com/#dataset=pass&filters=kyd%2Fcloud_vision%2Fface_probability:9&tab=RELATIONS&item=train%5B89%25%3A91%25%5D_27143&expanded_groups=cloud_vision
https://knowyourdata.withgoogle.com/

Helpful Things

[R] PhD thesis: On Neural Differential Equations! from MachineLearning


https://arxiv.org/abs/2202.02435
https://github.com/vicariousinc/PGMax
https://www.vicarious.com/posts/pgmax-factor-graphs-for-discrete-probabilistic-graphical-models-and-loopy-belief-propagation-in-jax/?utm_content=197542312&utm_medium=social&utm_source=twitter&hss_channel=tw-204185426
https://diambra.ai/tournaments
https://github.com/diambra/diambraArena

https://gitlab.com/deepcypher/python-fhez
https://python-fhez.readthedocs.io/en/latest/
https://joss.theoj.org/papers/10.21105/joss.04101?s=09&utm_source=pocket_mylist
https://github.com/PyTorchLightning/metrics
https://torchmetrics.readthedocs.io/en/latest/


https://github.com/google/evojax
https://arxiv.org/abs/2202.05008

[N] Gym now has a documentation website from MachineLearning


https://www.gymlibrary.ml/pages/api/#initializing-environments

Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content 🙂

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

YouTube Source for this AI Video

AI video(s) you might be interested in …