1656098132_maxresdefault.jpg
13
03:46

Acoustic synthesis for AR/VR experiences

Existing AI models do a good job of understanding images but require more work to understand the acoustics of environments in the related image. This is why researchers from Meta AI and the University of Texas are open-sourcing three new models for audio-visual understanding of human speech and sounds in video, helping us achieve immersive […]
1652841047_maxresdefault.jpg
13
01:24

SingularityNET: MUSEVERSE | Music into the metaverse

Create an AI for analyzing musical instruments from physical space and projecting them in real-time into virtual reality, starting with a piano keyboard. This solution will provide an opportunity for creating VR applications for playing, composing, and collaborating on music in VR.  https://proposals.deepfunding.ai/collaborate/6c6b947e-2b00-49d0-9212-063d4a355cac —- SingularityNET is a decentralized marketplace for artificial intelligence. We aim to […]
1642971844_maxresdefault.jpg
99
08:59

2022: The Year in which Virtual Reality goes Mainstream

The Future of Virtual Reality has been shown at CES 2022 in the form of retina display VR Headsets, full body tracking solutions and brain computer interfaces previewing what the future of full dive virtual reality could look like. Companies such as Meta/Facebook, Google, Apple and Valve are all investing millions into making Virtual Reality […]
1640587025_maxresdefault.jpg
4.14K
05:47

Two Minute Papers: Virtual Reality Fluid Drawing Is Here! 🥛

❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.com/papers 📝 The paper “Interactive Liquid Splash Modeling by User Sketches” is available here: https://web.cse.ohio-state.edu/~wang.3602/Yan-2020-ILS/Yan-2020-ILS.pdf https://web.cse.ohio-state.edu/~wang.3602/publications.html 📝My earlier work on fluid control is available here: Real-time Control and Stopping of Fluids – Eurographics 2013, Poster – Károly Zsolnai, László Szirmay-Kalos (2013) […]
1640500214_maxresdefault.jpg
11.60K
04:57

Two Minute Papers: NVIDIA’s New AI: Journey Into Virtual Reality!

❤️ Train a neural network and track your experiments with Weights & Biases here: http://wandb.me/paperintro 📝 The paper “Physics-based Human Motion Estimation and Synthesis from Videos” is available here: https://nv-tlabs.github.io/physics-pose-estimation-project-page/ 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Angelos […]
1640305111_maxresdefault.jpg
406
03:18

Two Minute Papers: Shape2vec: Understanding 3D Shapes With AI | Two Minute Papers #138

The paper “Shape2Vec: semantic-based descriptors for 3D shapes, sketches and images” is available here: http://www.cl.cam.ac.uk/research/rainbow/projects/shape2vec/ Code (coming soon according to the authors): https://github.com/ftasse/Shape2Vec WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Claudio Fernandes, Daniel John Benton, Dave Rushton-Smith, Sunil Kim, VR Wizard. https://www.patreon.com/TwoMinutePapers Subscribe if you […]
1640261781_maxresdefault.jpg
609
02:45

Two Minute Papers: Digital Creatures Learn to Navigate in 3D | Two Minute Papers #153

The paper “DeepLoco: Dynamic Locomotion Skills Using Hierarchical Deep Reinforcement Learning” is available here: http://www.cs.ubc.ca/~van/papers/2017-TOG-deepLoco/index.html Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Dave Rushton-Smith, Dennis Abts, e, Esa Turkulainen, Michael Albrecht, Sunil Kim, VR Wizard. […]
1640240061_maxresdefault.jpg
468
03:18

Two Minute Papers: Semantic Scene Completion From One Depth Image | Two Minute Papers #147

The paper “Semantic Scene Completion from a Single Depth Image” is available here: http://sscnet.cs.princeton.edu/ Recommended for you: How Does Deep Learning Work? – https://www.youtube.com/watch?v=He4t7Zekob0 Artificial Neural Networks and Deep Learning – https://www.youtube.com/watch?v=rCWTOOgVXyE WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Daniel John Benton, Dave […]
1640218318_maxresdefault.jpg
557
03:08

Two Minute Papers: AI Learns Geometric Descriptors From Depth Images | Two Minute Papers #148

The paper “3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions” is available here: http://3dmatch.cs.princeton.edu/ Recommended for you: Our earlier episode on Siamese networks – https://www.youtube.com/watch?v=a3sgFQjEfp4 WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Daniel John Benton, Dave Rushton-Smith, Esa Turkulainen, Sunil Kim, VR Wizard. […]
1640066588_maxresdefault.jpg
573
03:04

Two Minute Papers: Stable Neural Style Transfer | Two Minute Papers #136

The paper “Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses” is available here: https://arxiv.org/abs/1701.08893 Texture synthesis survey: http://www-sop.inria.fr/reves/Basilic/2009/WLKT09/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Claudio Fernandes, Daniel John Benton, Dave Rushton-Smith, Sunil Kim, VR Wizard. https://www.patreon.com/TwoMinutePapers Subscribe if you would […]
1639871542_maxresdefault.jpg
664
04:05

Two Minute Papers: Deep Photo Style Transfer | Two Minute Papers #150

The paper “Deep Photo Style Transfer” is and its source code is available here: https://arxiv.org/pdf/1703.07511.pdf https://github.com/luanfujun/deep-photo-styletransfer One more different implementation: https://github.com/martinbenson/deep-photo-styletransfer Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ Distill: http://distill.pub/ Distill article on research debt: http://distill.pub/2017/research-debt/ Recommended for you: How Do Neural Networks See The World? – https://www.youtube.com/watch?v=hBobYd8nNtQ WE WOULD LIKE TO THANK OUR […]
1639828213_maxresdefault.jpg
654
03:10

Two Minute Papers: Phace: Physics-based Face Modeling and Animation | Two Minute Papers #172

The paper “Phace: Physics-based Face Modeling and Animation” is available here: http://lgg.epfl.ch/publications/2017/Phace/index.php Our Patreon page: https://www.patreon.com/TwoMinutePapers Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Dave Rushton-Smith, Dennis Abts, e, Esa Turkulainen, Kaben Gabriel Nanlohy, Michael Albrecht, […]
1639568037_maxresdefault.jpg
631
02:33

Two Minute Papers: AI Learns Visual Common Sense With New Dataset | Two Minute Papers #169

The paper “The “something something” video database for learning and evaluating visual common sense” is available here: https://arxiv.org/abs/1706.04261 Source for the video results: https://medium.com/@raghavgoyal14/7383596f58df Recommended for you: Recurrent Neural Network Writes Sentences About Images – https://www.youtube.com/watch?v=e-WB4lfg30M Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE […]
1639481261_maxresdefault.jpg
761
03:43

Two Minute Papers: Breaking DeepMind’s Game AI System | Two Minute Papers #135

Our Patreon page is available here: https://www.patreon.com/TwoMinutePapers The paper “Adversarial Attacks on Neural Network Policies” is available here: http://rll.berkeley.edu/adversarial/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Claudio Fernandes, Daniel John Benton, Dave Rushton-Smith, Sunil Kim, VR Wizard. https://www.patreon.com/TwoMinutePapers Recommended for you: Breaking Deep Learning Systems With Adversarial […]
1639416198_maxresdefault.jpg
1.04K
03:46

Two Minute Papers: Refocusing Videos With Neural Networks | Two Minute Papers #173

The paper “Light Field Video Capture Using a Learning-Based Hybrid Imaging System” and its implementation is available here: https://arxiv.org/abs/1705.02997 https://github.com/junyanz/light-field-video Recommended for you: Amazing Slow Motion Videos With Optical Flow – https://www.youtube.com/watch?v=7aLda2E0Yyg Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: […]
1639394548_maxresdefault.jpg
1.12K
02:50

Two Minute Papers: Real-Time Character Control With Phase-Functioned Neural Networks | Two Minute Papers #154

The paper “Phase-Functioned Neural Networks for Character Control” is available here: http://theorangeduck.com/page/phase-functioned-neural-networks-character-control Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Andrew Melnychuk, Christian Lawson, Dave Rushton-Smith, Dennis Abts, e, Esa Turkulainen, Michael Albrecht, Sunil Kim, VR Wizard. https://www.patreon.com/TwoMinutePapers Music: Antarctica […]
1639086701_maxresdefault.jpg
107
10:43

How Elon Musk's Neuralink is using AI to understand the Brain

Neuralink is one of Elon Musk’s most exciting and revolutionary companies and has just posted an update on how they use Artificial Intelligence to read and write information to the human brain and help people move again after having paralysis. Human Trials are expected to be approved in 2022 with other updates of the Neuralink […]
1638787108_maxresdefault.jpg
1.00K
04:42

Two Minute Papers: Computer Games Empower Deep Learning Research | Two Minute Papers #105

The paper “Playing for Data: Ground Truth from Computer Games” is available here: http://download.visinf.tu-darmstadt.de/data/from_games/ Computer graphics / VR challenge grant at Experiment: https://experiment.com/grants/graphics-and-virtualreality Other popular datasets: – CamVid – http://mi.eng.cam.ac.uk/research/projects/VideoRec/CamVid/ – CityScapes – https://www.cityscapes-dataset.com/dataset-overview/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE TWO MINUTE PAPERS POSSIBLE: Sunil Kim, Julian Josephs, Daniel John […]
1638200090_maxresdefault.jpg
1.40K
04:20

Two Minute Papers: AI Learns Real-Time Defocus Effects in VR

The paper “DeepFocus: Learned Image Synthesis for Computational Displays” and its source code is available here: DeepFocus: Learned Image Synthesis for Computational Displays https://www.oculus.com/blog/introducing-deepfocus-the-ai-rendering-system-powering-half-dome/ https://github.com/facebookresearch/DeepFocus Pick up cool perks on our Patreon page: › https://www.patreon.com/TwoMinutePapers We would like to thank our generous Patreon supporters who make Two Minute Papers possible: 313V, Alex Haro, Andrew Melnychuk, […]
Two Minute Papers: AI Learns to Synthesize Pictures of Animals | Two Minute Papers #152
1.13K
03:54

Two Minute Papers: AI Learns to Synthesize Pictures of Animals | Two Minute Papers #152

Our Patreon page is available here. Thanks so much for your generous support! https://www.patreon.com/TwoMinutePapers The paper “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks” and its source code is available here: https://junyanz.github.io/CycleGAN/ Our earlier episodes on regularization: Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE TO THANK OUR GENEROUS PATREON SUPPORTERS WHO MAKE […]
1636346952_maxresdefault.jpg
0

DeepMind’s AI Learns Superhuman Relational Reasoning | Two Minute Papers #168

The paper “A simple neural network module for relational reasoning” is available here: https://arxiv.org/abs/1706.01427 Details on our Patreon page: https://www.patreon.com/TwoMinutePapers More on Long Short-Term Memory: Recurrent Neural Network Writes Music and Shakespeare Novels – https://www.youtube.com/watch?v=Jkkjy7dVdaY Recurrent Neural Network Writes Sentences About Images – https://www.youtube.com/watch?v=e-WB4lfg30M Two Minute Papers Merch: US: http://twominutepapers.com/ EU/Worldwide: https://shop.spreadshirt.net/TwoMinutePapers/ WE WOULD LIKE […]
1636302756_maxresdefault.jpg
0

DeepMind’s AI Creates Images From Your Sentences | Two Minute Papers #163

The paper “Parallel Multiscale Autoregressive Density Estimation” is available here: https://arxiv.org/pdf/1703.03664.pdf Our Patreon page: https://www.patreon.com/TwoMinutePapers Scott Reed’s results: Some more animations: pic.twitter.com/EptRR6iIZ4 — Scott Reed (@scott_e_reed) March 13, 2017 Sampling animations for Parallel Multiscale Autoregressive Density Estimation. pic.twitter.com/rNabVgzPGa — Scott Reed (@scott_e_reed) March 13, 2017 The older work, PixelCNN is available here: https://arxiv.org/pdf/1606.05328.pdf Two Minute […]
1636262287_maxresdefault.jpg
6.93K
04:12

This AI Makes Digital Copies of Humans! 👤

❤️ Check out the Gradient Dissent podcast by Weights & Biases: http://wandb.me/gd  📝 The paper “The Relightables: Volumetric Performance Capture of Humans with Realistic Relighting” is available here: https://augmentedperception.github.io/therelightables/ 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Aleksandr Mashrabov, Alex Haro, Andrew Melnychuk, Angelos Evripiotis, Benji Rabhan, […]
1636181120_maxresdefault.jpg
0

This Neural Network Performs Foveated Rendering

❤️ Check out Linode here and get $20 free credit on your account: https://www.linode.com/papers 📝 The paper “DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos” is available here: DeepFovea: Neural Reconstruction for Foveated Rendering and Video Compression using Learned Statistics of Natural Videos ❤️ Watch these videos in […]