[ML News] BLOOM: 176B Open-Source | Chinese Brain-Scale Computer | Meta AI: No Language Left Behind
#mlnews #bloom #ai
Today we look at all the recent giant language models in the AI world!
OUTLINE:
0:00 – Intro
0:55 – BLOOM: Open-Source 176B Language Model
5:25 – YALM 100B
5:40 – Chinese Brain-Scale Supercomputer
7:25 – Meta AI Translates over 200 Languages
10:05 – Reproducibility Crisis Workshop
10:55 – AI21 Raises $64M
11:50 – Ian Goodfellow leaves Apple
12:20 – Andrej Karpathy leaves Tesla
12:55 – Wordalle
References:
BLOOM: Open-Source 176B Language Model
https://bigscience.huggingface.co/blog/bloom
https://huggingface.co/spaces/bigscience/license
https://huggingface.co/bigscience/bloom?text=34%2B10%3D44+%0A54%2B20%3D
YALM 100B
https://github.com/yandex/YaLM-100B
Chinese Brain-Scale Supercomputer
https://www.scmp.com/news/china/science/article/3182498/china-supercomputer-achieves-global-first-brain-scale-ai-model?utm_source=pocket_mylist
https://archive.ph/YaoA6#selection-1237.156-1237.246
Meta AI Translates over 200 Languages
https://ai.facebook.com/research/no-language-left-behind/
Reproducibility Crisis Workshop
https://reproducible.cs.princeton.edu/
AI21 Raises $64M
OpenAI rival AI21 Labs raises $64M to ramp up its AI-powered language services
Ian Goodfellow leaves Apple
I'm excited to announce that I've joined DeepMind! I'll be a research scientist in @OriolVinyalsML 's Deep Learning team.
— Ian Goodfellow (@goodfellow_ian) July 6, 2022
Andrey Karpathy leaves Tesla
https://mobile.twitter.com/karpathy/status/1547332300186066944
https://www.businessinsider.com/report-tesla-laid-off-about-200-people-in-autopilot-unit-2022-6?r=US&IR=T
Wordalle
https://huggingface.co/spaces/huggingface-projects/wordalle?utm_source=pocket_mylist
Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher
If you want to support me, the best thing to do is to share out the content 🙂
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
