User Tools
deepdreameffect
====== Differences ====== This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
deepdreameffect [2015/10/25 11:17] dmr |
deepdreameffect [2015/11/05 04:54] dmr |
||
|---|---|---|---|
| Line 4: | Line 4: | ||
| | **Affiliation** | International Audio Laboratories Erlangen | | | **Affiliation** | International Audio Laboratories Erlangen | | ||
| | **eMail** | [[christian.dittmar@audiolabs-erlangen.de]] | | | **eMail** | [[christian.dittmar@audiolabs-erlangen.de]] | | ||
| + | | **code** | [[http://nbviewer.ipython.org/github/stefan-balke/deepdreameffect/blob/master/dream.ipynb]] | | ||
| ===== What did I do ===== | ===== What did I do ===== | ||
| Line 9: | Line 10: | ||
| I used Google's DeepDream processing as an audio effect. Therefore, I export music magnitude spectrogram as RGB channels of PNG images and apply so-called 'Gradient Ascent' with pre-trained networks to these images. Afterwards, I convert the resulting images to spectrograms again and resynthesize them using Griffin and Lim's method. | I used Google's DeepDream processing as an audio effect. Therefore, I export music magnitude spectrogram as RGB channels of PNG images and apply so-called 'Gradient Ascent' with pre-trained networks to these images. Afterwards, I convert the resulting images to spectrograms again and resynthesize them using Griffin and Lim's method. | ||
| - | {{ :overview.png?nolink&400 |}} | + | {{ :overview.png?nolink&800 |}} |
| Since the networks were trained on natural images, this makes no sense musically. However, it gives interesting results: | Since the networks were trained on natural images, this makes no sense musically. However, it gives interesting results: | ||
| Line 22: | Line 23: | ||
| Input signal {{ :olcay.wav |}} | Input signal {{ :olcay.wav |}} | ||
| - | Result using layer conv3 {{ :output_olcay_layer3.wav |}} | + | Result using layer conv3 (MIT places network) {{ :output_olcay_layer3.wav |}} |
| - | ===== Example 3: Separated Breakbeat ===== | + | ===== Example 3: Breakbeat ===== |
| - | Input signal {{ :amenbrotherbreaknorm_mix.wav |}} | + | Input signal (Different drums encoded as RGB) {{ :amenbrotherbreaknorm_mix.wav |}} |
| - | Result using layer conv3 {{ :output_amen_layer3.wav |}} | + | Result using layer conv3 (MIT places network) {{ :output_amen_layer3.wav |}} |
| ===== Libraries Used ===== | ===== Libraries Used ===== | ||
deepdreameffect.txt · Last modified: 2015/11/05 04:57 by dmr
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 3.0 Unported
