File size: 7,727 Bytes
caf3ca6 55feb03 caf3ca6 9e2198c caf3ca6 9e2198c 183e446 caf3ca6 9e2198c caf3ca6 9e2198c 55feb03 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 |
---
tags:
- text-to-image
- lora
- diffusers
- template:sd-lora
- flux
widget:
- text: >-
1girl is standing leftside by a blackboard rightside. pvc style. from front
shot, 1girl; 1girl, nendoroid, blue hair, medium hair, cat ears, looking at
viewer, white dress shirt, black shorts, arm up, open mouth, chibi.
blackboard; blackboard with wooden frame and feet, text of "schnell LoRA
workflow" on the board.
output:
url: images/flux_lora_00221_.png
- text: >-
1girl, solo, full body, gloves, groin, hair between eyes, hair ornament,
head tilt, holding, holding staff, horns, long hair, looking at viewer, maid
headdress, mole, mole under eye, navel, parted lips, purple eyes, purple
hair, purple theme, shawl, shorts, single horn, staff, standing, thighhighs,
twintails, white footwear, white gloves, white thighhighs
output:
url: images/flux_lora_00222_.png
- text: >-
1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at
viewer, white dress shirt, rainy, sitting
output:
url: images/flux_lora_00223_.png
- text: >-
cute anime girl with massive fluffy fennec ears and a big fluffy tail blonde
messy long hair blue eyes wearing a maid outfit with a long black gold leaf
pattern dress and a white apron mouth open placing a fancy black forest cake
with candles on top of a dinner table of an old dark Victorian mansion lit
by candlelight with a bright window to the foggy forest and very expensive
stuff everywhere there are paintings on the walls
output:
url: images/flux_lora_00224_.png
- text: >-
1girl, solo, maid, cowboy shot, cup, green eyes, green hair, hair intakes,
hair ornament, holding, holding cup, lips, long hair, looking at viewer,
ponytail, realistic, simple background, teacup, very long hair, white
background, wrist cuffs
output:
url: images/flux_lora_00227_.png
- text: >-
1girl, hatsune miku, vocaloid, solo, :o, bare shoulders, black skirt, black
sleeves, black thighhighs, blue eyes, blue hair, blush, collared shirt,
detached sleeves, hair ornament, kneeling, long hair, long sleeves, looking
at viewer, miniskirt, parted lips, pleated skirt, shirt, skirt, sleeveless,
sleeveless shirt, thighhighs, twintails, very long hair, white shirt, wing
collar
output:
url: images/flux_lora_00229_.png
- text: >-
1girl, solo, outdoors, looking at viewer, flower, gloves, grey hair, hat,
jacket, long hair, long skirt, long sleeves, looking at viewer, open
clothes, open jacket, pantyhose, red eyes, red flower, red hat, red jacket,
red rose, red skirt, rose, shirt, skirt, smile, snowing, standing, white
gloves, white shirt
output:
url: images/flux_lora_00247_.png
base_model: black-forest-labs/FLUX.1-schnell
instance_prompt: pvc figure, nendoroid, figma
license: apache-2.0
datasets:
- p1atdev/pvc
---
# FLUX.1 schnell PVC style
<Gallery />
## Model description
PVC figure style LoRA for [FLUX.1-schnell](https://huggingface.co/black-forest-labs/FLUX.1-schnell),
trained on [FLUX.1-schnell](https://huggingface.co/black-forest-labs/FLUX.1-schnell)
with the [training adapter](https://huggingface.co/ostris/FLUX.1-schnell-training-adapter) using
[ostris/ai-toolkit](https://huggingface.co/ostris/FLUX.1-schnell-training-adapter).
## Trigger words
You should use `pvc figure` to trigger the image generation.
You should use `nendoroid` to trigger the image generation.
You should use `figma` to trigger the image generation.
### Prompt guide
This LoRA was trained with danbooru tags, but maybe not of all danbooru tags will work. Please consider to use natural language to align.
## Download model
Weights for this model are available in Safetensors format.
[Download](/p1atdev/flux.1-schnell-pvc-style-lora/tree/main) them in the Files & versions tab.
## Training config
WandB log: https://wandb.ai/p1atdev/flux_lora_pvc_schnell_1
TL;DR:
- `learning_rate` `1e-4` for `constant` with `AdamW8bit` (default)
- used about 2500 images
- `batch_size` `4`, `gradient_accumulation_steps` `1`
- took about 32GB VRAM
- LoRA config (default)
- `linear`: `16`
- `linear_alpha`: `16`
- base model: [black-forest-labs/FLUX.1-schnell](https://huggingface.co/black-forest-labs/FLUX.1-schnell)
- assistant lora: [ostris/FLUX.1-schnell-training-adapter](https://huggingface.co/ostris/FLUX.1-schnell-training-adapter)
- trained for 10,000 steps but finally used the merge of checkpoint at 7250 and 7500 for 1:1.
- GPU: A6000 x1 (VRAM 48GB)
<details><summary>Full config.yaml</summary>
```yaml
job: extension
config:
name: flux_lora_pvc_schnell_1
process:
- type: sd_trainer
training_folder: output
device: cuda:3
network:
type: lora
linear: 16
linear_alpha: 16
save:
dtype: bfloat16
save_every: 250
max_step_saves_to_keep: 10
datasets:
- folder_path: /workspace/ai-toolkit/dataset/pvc
caption_ext: txt
caption_dropout_rate: 0.01
shuffle_tokens: true
cache_latents_to_disk: true
resolution:
- 768
- 1024
train:
batch_size: 4
steps: 10000
gradient_accumulation_steps: 1
train_unet: true
train_text_encoder: false
gradient_checkpointing: true
noise_scheduler: flowmatch
optimizer: adamw8bit
lr: 0.0001
ema_config:
use_ema: true
ema_decay: 0.99
dtype: bf16
model:
name_or_path: black-forest-labs/FLUX.1-schnell
assistant_lora_path: ostris/FLUX.1-schnell-training-adapter
is_flux: true
quantize: true
sample:
sampler: flowmatch
sample_every: 250
width: 832
height: 1152
prompts:
- 1girl, solo, blue hair, cat ears, parted bangs, long hair, looking at viewer,
white dress shirt, rainy, wariza, sitting
- 1girl, solo, full body, gloves, groin, hair between eyes, hair ornament, head
tilt, holding, holding staff, horns, long hair, looking at viewer, maid headdress,
mole, mole under eye, navel, parted lips, purple eyes, purple hair, purple
theme, shawl, shorts, single horn, staff, standing, thighhighs, twintails,
white footwear, white gloves, white thighhighs
- 1girl, aqua eyes, baseball cap, blonde hair, closed mouth, earrings, green
background, hat, hoop earrings, jewelry, looking at viewer, shirt, short hair,
solo, upper body, yellow shirt,
- 1girl, bangs, bare shoulders, beret, black hair, black shorts, blue hair,
bracelet, breasts, buttons, colored inner hair, double-breasted, eyewear removed,
green headwear, green jacket, grey eyes, grey sky, hat, jacket, jewelry, long
hair, looking at viewer, multicolored hair, neck ring, o-ring, off shoulder,
rain, round eyewear, shorts, sidelocks, small breasts, solo, sunglasses, wavy
hair, wet, zipper,
- 1girl, brown hair, green eyes, colorful, autumn, cumulonimbus clouds, lighting,
blue sky, falling leaves, garden
- 1girl, bangs, black wings, blush, choker, collarbone, feathered wings, hair
between eyes, halo, hand on hip, hat, head wings, long hair, long sleeves,
looking at viewer, pink eyes, pink hair, pleated skirt, school hat, school
uniform, serafuku, sidelocks, simple background, skirt, solo, twintails, wavy
mouth, white background, wings, waifu,
neg: ''
seed: 42
walk_seed: true
guidance_scale: 1
sample_steps: 4
logging:
use_wandb: true
project_name: flux_lora_pvc_schnell_1
run_name: run-1
meta:
name: flux_lora_schnell_pvc
version: '1.0'
```
</details> |