Two Minute Papers: Recurrent Neural Network Writes Music and Shakespeare Novels | Two Minute Papers #19
Artificial neural networks are powerful machine learning techniques that can learn to recognize images or paint in the style of Van Gogh. Recurrent neural networks offer a more general model that can learn input sequences and create output sequences. The resulting technique (Long Short-Term Memory in these examples) can write novels in the style of Tolstoy, Shakespeare, or write their own music.
________________________
Andrej Karpathy’s original article is available here:
http://karpathy.github.io/2015/05/21/rnn-effectiveness/
Source code: https://github.com/karpathy/char-rnn
The paper “Long Short-Term Memory” by Sepp Hochreiter and Jürgen Schmidhuber is available here:
http://www.bioinf.jku.at/publications/older/2604.pdf
http://deeplearning.cs.cmu.edu/pdfs/Hochreiter97_lstm.pdf
Continuing “Let It Go” from Disney with a recurrent neural network:
https://ericye16.com/music-rnn/
Recommended for you:
Artificial Neural Networks and Deep Learning – https://www.youtube.com/watch?v=rCWTOOgVXyE
Deep Neural Network Learns Van Gogh’s Art – https://www.youtube.com/watch?v=-R9bJGNHltQ
Creating Photographs Using Deep Learning – https://www.youtube.com/watch?v=HOLoPgTzV6g
A great write-up on how LSTMs work:
http://colah.github.io/posts/2015-08-Understanding-LSTMs/
More applications of Long Short-Term Memory:
http://googleresearch.blogspot.co.uk/2015/09/google-voice-search-faster-and-more.html
http://googleresearch.blogspot.co.at/2015/08/the-neural-networks-behind-google-voice.html
Subscribe if you would like to see more of these! – http://www.youtube.com/subscription_center?add_user=keeroyz
The thumbnail image background was created by Brandon Giesbrecht (license: CC BY 2.0). Slight changes were made for better blending. – https://www.flickr.com/photos/naturegeak/5819184201/
Splash screen/thumbnail design: Felícia Fehér – http://felicia.hu
Music: “Gymnopedie no1” by Satie.
Károly Zsolnai-Fehér’s links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/
