Update README.md
Browse files
README.md
CHANGED
@@ -15,10 +15,193 @@ tags:
|
|
15 |
|
16 |
# Model Card for musicgen-songstarter-v0.1
|
17 |
|
18 |
-
musicgen-songstarter-v0.1 is a
|
19 |
|
20 |
This is a proof of concept. Hopefully, we will be able to collect more data and train a better models in the future.
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
## Usage
|
23 |
|
24 |
Install [audiocraft](https://github.com/facebookresearch/audiocraft):
|
@@ -78,4 +261,4 @@ for i in range(N):
|
|
78 |
|
79 |
# Or, if in a notebook, display audio widgets
|
80 |
# display_audio(out, model.sample_rate)
|
81 |
-
```
|
|
|
15 |
|
16 |
# Model Card for musicgen-songstarter-v0.1
|
17 |
|
18 |
+
musicgen-songstarter-v0.1 is a [`musicgen-melody`](https://huggingface.co/facebook/musicgen-melody) fine-tuned on a dataset of melody loops from my Splice sample library. It's intended to be used to generate song ideas that are useful for music producers.
|
19 |
|
20 |
This is a proof of concept. Hopefully, we will be able to collect more data and train a better models in the future.
|
21 |
|
22 |
+
## Prompt Format
|
23 |
+
|
24 |
+
## Prompt Format
|
25 |
+
|
26 |
+
Follow the following prompt format:
|
27 |
+
|
28 |
+
```
|
29 |
+
{tag_1}, {tag_1}, ..., {tag_n}, {key}, {bpm} bpm
|
30 |
+
```
|
31 |
+
|
32 |
+
<details>
|
33 |
+
<summary>The training dataset had the following tags in it (click)</summary>
|
34 |
+
```
|
35 |
+
hip hop
|
36 |
+
trap
|
37 |
+
soul
|
38 |
+
rnb
|
39 |
+
synth
|
40 |
+
songstarters
|
41 |
+
melody
|
42 |
+
keys
|
43 |
+
chords
|
44 |
+
guitar
|
45 |
+
vocals
|
46 |
+
dancehall
|
47 |
+
melodic stack
|
48 |
+
piano
|
49 |
+
electric
|
50 |
+
layered
|
51 |
+
music
|
52 |
+
drill
|
53 |
+
lo-fi hip hop
|
54 |
+
cinematic
|
55 |
+
pop
|
56 |
+
resampled
|
57 |
+
afropop & afrobeats
|
58 |
+
strings
|
59 |
+
leads
|
60 |
+
dark
|
61 |
+
african
|
62 |
+
acoustic
|
63 |
+
brass & woodwinds
|
64 |
+
live sounds
|
65 |
+
reggaeton
|
66 |
+
boom bap
|
67 |
+
pads
|
68 |
+
electric piano
|
69 |
+
fx
|
70 |
+
downtempo
|
71 |
+
wet
|
72 |
+
electric guitar
|
73 |
+
lo-fi
|
74 |
+
caribbean
|
75 |
+
chops
|
76 |
+
chillout
|
77 |
+
riffs
|
78 |
+
percussion
|
79 |
+
electronic
|
80 |
+
bass
|
81 |
+
choir
|
82 |
+
arp
|
83 |
+
uk drill
|
84 |
+
female
|
85 |
+
plucks
|
86 |
+
future bass
|
87 |
+
processed
|
88 |
+
future soul
|
89 |
+
ensemble
|
90 |
+
mallets
|
91 |
+
hooks
|
92 |
+
uk
|
93 |
+
flute
|
94 |
+
phrases
|
95 |
+
drums
|
96 |
+
atmospheres
|
97 |
+
jazz
|
98 |
+
emo
|
99 |
+
gospel
|
100 |
+
male
|
101 |
+
reverse
|
102 |
+
latin american
|
103 |
+
trap edm
|
104 |
+
latin
|
105 |
+
bells
|
106 |
+
pitched
|
107 |
+
ambient
|
108 |
+
tonal
|
109 |
+
distorted
|
110 |
+
moombahton
|
111 |
+
vinyl
|
112 |
+
orchestral
|
113 |
+
dry
|
114 |
+
psychedelic
|
115 |
+
edm
|
116 |
+
funk
|
117 |
+
neo soul
|
118 |
+
classical
|
119 |
+
harmony
|
120 |
+
adlib
|
121 |
+
trumpet
|
122 |
+
high
|
123 |
+
horns
|
124 |
+
electronica
|
125 |
+
violin
|
126 |
+
808
|
127 |
+
synthwave
|
128 |
+
ngoni
|
129 |
+
house
|
130 |
+
drones
|
131 |
+
progressive house
|
132 |
+
g-funk
|
133 |
+
hats
|
134 |
+
trip hop
|
135 |
+
baile funk
|
136 |
+
filtered
|
137 |
+
doo wop
|
138 |
+
tambourine
|
139 |
+
kora
|
140 |
+
stabs
|
141 |
+
textures
|
142 |
+
claps
|
143 |
+
grooves
|
144 |
+
clean
|
145 |
+
analog
|
146 |
+
harp
|
147 |
+
ambience
|
148 |
+
smooth
|
149 |
+
acapella
|
150 |
+
blues
|
151 |
+
saxophone
|
152 |
+
organ
|
153 |
+
soft
|
154 |
+
tremolo
|
155 |
+
chillwave
|
156 |
+
reverb
|
157 |
+
electric bass
|
158 |
+
low
|
159 |
+
moog
|
160 |
+
wah
|
161 |
+
wobble
|
162 |
+
indie pop
|
163 |
+
modular
|
164 |
+
sub
|
165 |
+
indie dance
|
166 |
+
glide
|
167 |
+
k-pop
|
168 |
+
afrobeat
|
169 |
+
mid
|
170 |
+
balafon
|
171 |
+
bitcrushed
|
172 |
+
phaser
|
173 |
+
middle eastern
|
174 |
+
zither
|
175 |
+
shakers
|
176 |
+
delay
|
177 |
+
tech house
|
178 |
+
disco
|
179 |
+
experimental
|
180 |
+
celesta
|
181 |
+
cello
|
182 |
+
drum and bass
|
183 |
+
trance
|
184 |
+
rock
|
185 |
+
rhythm
|
186 |
+
whistle
|
187 |
+
sidechained
|
188 |
+
saw
|
189 |
+
breakbeat
|
190 |
+
techno
|
191 |
+
brazilian
|
192 |
+
music box
|
193 |
+
glitch
|
194 |
+
clarinet
|
195 |
+
```
|
196 |
+
</details>
|
197 |
+
|
198 |
+
|
199 |
+
For example:
|
200 |
+
|
201 |
+
```
|
202 |
+
hip hop, soul, piano, chords, jazz, neo jazz, G# minor, 140 bpm
|
203 |
+
```
|
204 |
+
|
205 |
## Usage
|
206 |
|
207 |
Install [audiocraft](https://github.com/facebookresearch/audiocraft):
|
|
|
261 |
|
262 |
# Or, if in a notebook, display audio widgets
|
263 |
# display_audio(out, model.sample_rate)
|
264 |
+
```
|