adds retrained Chise LoRA

README.md

@@ -18,7 +18,9 @@ Here you will find the various LoRAs I've trained, typically of Blue Archive cha
 [Available on old Mega.co.nz repository.](https://mega.nz/folder/SqYwQTRI#GN2SmGTBsV6S4q-L-V4VeA)
 
 ### Chise
-[Available on old Mega.co.nz repository.](https://mega.nz/folder/SqYwQTRI#GN2SmGTBsV6S4q-L-V4VeA)
+[Waraku Chise / 和楽チセ / 와라쿠 치세 / 和楽千世](https://huggingface.co/khanon/lora-training/blob/main/chise/README.md)
+
+[![Chise](chise/chara-chise-v2.png)](https://huggingface.co/khanon/lora-training/blob/main/chise/README.md)
 
 ### Hibiki
 [Available on old Mega.co.nz repository.](https://mega.nz/folder/SqYwQTRI#GN2SmGTBsV6S4q-L-V4VeA)

chise/README.md

@@ -1,31 +1,55 @@
 # Waraku Chise (Blue Archive)
-Came out pretty well I think.  Smaller dataset than Mari, but otherwise very similar settings.
+和楽チセ (ブルーアーカイブ) / 와라쿠 치세 (블루 아카이브) / 和楽千世 (碧蓝档案)
 
-## Usage
-Use any or all of these tags to summon Chise:
-`chise, halo, red eyes, blue hair`
-Hair and eyes are mostly optional if you describe a bit of her outfit as well.
-She naturally likes to make her `:o` expression because most art features her doing that.  However I also included images tagged with other expressions.
-Use `open mouth`, `closed mouth`, and `parted lips` as necessary to get her to make whatever expressions you want.
+[**Download here.**](chara-chise-v2.safetensors)
+
+## Table of Contents
+- [Preview](#preview)
+- [Usage](#usage)
+- [Training](#training)
+- [Revisions](#revisions)
+- [Alternate Version](#alternate-version---v1)
 
-For her normal outfit (add as many as necessary):
-`braid, japanese clothes, detached sleeves, obi, tabi, geta, sailor collar, blue bow`
-Her shoes are weird but they're tagged `geta` and the socks as `tabi`.
+## Preview
+![Chise portrait](chara-chise-v2.png)
+![Chise moon](example-001-Defmix-v2.png)
+![Chise calligraphy](example-002-Defmix-v2.png)
+![Chise swimsuit](example-003-Defmix-v2.png)
+
+## Usage
+Use any or all of these tags to summon Chise: `chise, halo, oni horns, hair flower, red eyes, blue hair`
 
-For her swimsuit outfit (add as many as necessary):
-`side ponytail, swimsuit, striped bikini, see-through, sailor collar, side-tie bikini bottom`
-You can also add `pointed ears`, which are usually only visible in her swimsuit outfit.
+For her normal outfit: `braid, japanese clothes, detached sleeves, bridal gauntlets, obi, tabi, geta, sailor collar, blue bow`
 
-Weight 1 works fine. Also included epoch 6 in case you find the last epoch to be a bit stubborn with her outfits.
+For her swimsuit alt: `side ponytail, swimsuit, striped bikini, see-through, see-through shirt, white sailor collar, side-tie bikini bottom`
+- You may also add `pointy ears`, which are usually only visible in her swimsuit outfit.
 
 ## Training
-*All parameters are provided in the accompanying JSON files.*
-- Trained on a set of 119 images split by outfit, repeated 10 times (swimsuit) or 14 times (uniform) for 7 epochs (119 images * 10 or 14 repeats / 3 batch size * 7 epochs = 3178 steps)
-  - Dataset included a mixture of SFW and NSFW.
-- Initially tagged with WD1.4 VITv2 model, then performed heavy pruning and editing.
-  - Pruned implicit (`oni horns`) or redundant tags and simplified outfits so that they were always tagged with the same handful of tags
-  - Made sure important traits were present and consitently described, and traits like `halo` were consistent with actual visibility
-  - Added many facial expression, camera angle, and image composition hints
-- Used network_dimension 128 (same as usual) and network_alpha 64 (new)
-  - This relies on the new alpha 
+*Exact parameters are provided in the accompanying JSON files.*
+- Trained on a set of 119 images; 76 swimsuit, 43 normal.
+  - 15 repeats for normal outfit
+  - 9 repeats for swimsuit outfit
+  - 3 batch size, 4 epochs
+  - `(76*9 + 43*15) / 3 * 4` = 1772 steps
+- 832x832 training resolution
+- `constant_with_warmup` scheduler
+- Initially tagged with WD1.4 Convnext-v2 model, then heavily edited.
+  - Pruned redundant tags and simplified outfit tags such that Chise's outfit was always described with the same words
+  - Ensured unique traits such as `halo` were consistent with actual visibility
+  - Added many tags for facial expressions, camera angles, and image composition
+- Used network_dimension 128 (same as usual) / network alpha 128 (default)
+  - Resized to 32dim after training
 - Trained without VAE.
+
+## Revisions
+- v5b (2023-02-12)
+  - Completely re-trained to correct issue where caption files were not being loaded correctly.  New version should have more flexibility but requires additional outfit prompting.
+- v1 (2023-01-26)
+  - Initial release.
+  - **Issue:** caption files were completely ignored during training. As a result, prompting "chise" grants a very strong effect, but the LoRA is highly overfit.
+
+## Alternate Version - c1
+**v1** is also available. This version was improperly configured and ignored caption files, so it was trained on the word `chise` only.  It looks quite good, however the model is very overfit and it is difficult to adjust Chise's outfit.
+
+**[Download v1.](v1/chara-chise-v1.safetensors)**
+![Chise v1 Preview](v1/chara-chise-v1.png)

chise/chara-chise-v2.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f36d3ea331c2f817acabeced642c9298ad6422aea6db8cace08682d06541307
+size 37873407

chise/lora_chara_chise_v2_76i9r-43i15r.json

@@ -0,0 +1,59 @@
+{
+  "pretrained_model_name_or_path": "G:/sd/repo/models/Stable-diffusion/nai-animefull-final-pruned.safetensors",
+  "v2": false,
+  "v_parameterization": false,
+  "logging_dir": "",
+  "train_data_dir": "G:/sd/training/datasets/chise/dataset",
+  "reg_data_dir": "",
+  "output_dir": "G:/sd/lora/trained/chara/chise",
+  "max_resolution": "832,832",
+  "learning_rate": "1e-5",
+  "lr_scheduler": "constant_with_warmup",
+  "lr_warmup": "5",
+  "train_batch_size": 3,
+  "epoch": "4",
+  "save_every_n_epochs": "",
+  "mixed_precision": "fp16",
+  "save_precision": "fp16",
+  "seed": "31337",
+  "num_cpu_threads_per_process": 32,
+  "cache_latents": true,
+  "caption_extension": ".txt",
+  "enable_bucket": true,
+  "gradient_checkpointing": false,
+  "full_fp16": false,
+  "no_token_padding": false,
+  "stop_text_encoder_training": 0,
+  "use_8bit_adam": true,
+  "xformers": true,
+  "save_model_as": "safetensors",
+  "shuffle_caption": true,
+  "save_state": false,
+  "resume": "",
+  "prior_loss_weight": 1.0,
+  "text_encoder_lr": "1.5e-5",
+  "unet_lr": "1.5e-4",
+  "network_dim": 128,
+  "lora_network_weights": "",
+  "color_aug": false,
+  "flip_aug": false,
+  "clip_skip": 2,
+  "gradient_accumulation_steps": 1.0,
+  "mem_eff_attn": false,
+  "output_name": "chara-chise-v2",
+  "model_list": "",
+  "max_token_length": "150",
+  "max_train_epochs": "",
+  "max_data_loader_n_workers": "",
+  "network_alpha": 128,
+  "training_comment": "Character: `chise, halo, red eyes, blue hair, oni`\nStandard outfit: `braid, japanese clothes, detached sleeves, obi, tabi, geta, sailor collar, blue bow`\nSwimsuit: `side ponytail, swimsuit, striped bikini, see-through, sailor collar, side-tie bikini bottom, pointed ears`\n(76 swimsuit * 9 repeats  + 43 normal *15 repeats)/ 3 batch size * 4 epochs = 1772 steps",
+  "keep_tokens": 2,
+  "lr_scheduler_num_cycles": "",
+  "lr_scheduler_power": "",
+  "persistent_data_loader_workers": true,
+  "bucket_no_upscale": true,
+  "random_crop": false,
+  "bucket_reso_steps": 64.0,
+  "caption_dropout_every_n_epochs": 0.0,
+  "caption_dropout_rate": 0
+}

chise/v1/chara-chise-v1.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:07cc79fffeab73e4931864c5f12a36e8393f18674a2f3612b906329901a94b67
+size 151110333