Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
@jordipons
jordipons authored Jul 17, 2024
1 parent 0c4b2c7 commit 5033a68
Showing 1 changed file with 7 additions and 17 deletions.
24 changes: 7 additions & 17 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -60,23 +60,13 @@ Our methodology is based on comparing our model's generations against the traini
The most interesting memorization candidates, together with their closest training data, are listed here. We extensively listened to potential memorization candidates, and **could not find memorization**. Those are the most interesting candidates from (repeated) training data prompts:


| Generation by our model | Closest #1 | Closest #2 | Closest #3 | Prompt |
| ----------------------- | ---------- | ---------- | ---------- | ------ |
| <audio controls preload=False><source src="audio/427105.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.427160">427160</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.427105">427105</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.140843">140843</a>| Birds chirping, forest birds, tropical, africa wild life, singing birds, sound effects. |
| <audio controls preload=False><source src="audio/978535.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.978924">978924</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.979616">979616</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.978717">978717</a>| Totally rad 8-bit melodies and intense arps create that fearless throwback vibe. |
| <audio controls preload=False><source src="audio/972457.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.979544">979544</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.979695">979695</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.979670">979670</a>| Totally rad 8-bit melodies and intense arps create that strong-willed throwback vibe. |
| <audio controls preload=False><source src="audio/978661.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.972466">972466</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.972983">972983</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.973055">973055</a>| Pleasant strings create desire in this adamant scoring cue. |

We found a fair ammount of 8-bit/chiptunes that were repeated in the training dataset. Still, our model does not memorize them.

We even selected additional outstanding generations from Song Describer Dataset prompts, and **could not find memorization**. Those are the most interesting memorization candidates:

| Generation by our model | Closest #1 | Closest #2 | Closest #3 | Prompt |
| ----------------------- | ---------- | ---------- | ---------- | ------ |
| <audio controls preload=False><source src="audio/94_original.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.796563">796563</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.1083119">1083119</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.634461">634461</a>| One cannot avoid moving the feet and neck listening to this fast and loopy brazilian tune. |
| <audio controls preload=False><source src="audio/1001_original.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.279428">279428</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.1082095">1082095</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.326758">326758</a>| An uplifting jazz song that makes your head shake. |
| <audio controls preload=False><source src="audio/1091_original.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.1024058">1024058</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.1023046">1023046</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.788950">788950</a>| Calming instrumental music primarily on piano can be used for relaxing. |
| <audio controls preload=False><source src="audio/1069_original.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.470048">470048</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.470047">470047</a>| <a href="https://www.audiosparx.com/sa/summary/play.cfm/crumb.31/crumc.0/sound_iid.696082">696082</a>| This song starts with a ukulele and builds up with percussion using claps and an acoustic guitar that plays the same rhythm as the ukulele with melody played on a xylophone and has a very upbeat feel to it. |
| Generation by our model | Closest #1 | Prompt |
| ----------------------- | ----------- | ------ |
| <audio controls preload=False><source src="audio/rain.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://freesound.org/people/ionisaattor/sounds/256173/">link</a>| 160-BPM, kick-hat-snare, drumloop. |
| <audio controls preload=False><source src="audio/drumloop.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://freesound.org/people/stoltingmediagroup/sounds/596826/">link</a>| 160-BPM, kick-hat-snare, drumloop. |
| <audio controls preload=False><source src="audio/1k.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://freesound.org/people/Sean_hay_ca/sounds/174551/">link</a>| 1000Hz 48k sample rate MP3 |
| <audio controls preload=False><source src="audio/violin.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://freemusicarchive.org/music/Kosta_T/__________________/Kosta_T_-__-_03____-/">link</a>| Avant-garde, improv, contemporary classical, instrumental. |
| <audio controls preload=False><source src="audio/piano.mp3" type="audio/mpeg">Audio not supported by your browser.</audio> | <a href="https://freemusicarchive.org/music/Unheard_Music_Concepts/Industry/10_The_Trail/">link</a>| Piano, modern jazz, minimalism, instrumental. |

## Autoencoder: reconstructions

Expand Down

0 comments on commit 5033a68

Please sign in to comment.