haruka/tagging methodology.md · khanon/lora-training at main

Tagging methodology for Haruka (blue archive)

Start with WD1.4 Swinv2 at ~0.25-0.3 confidence.

Tag unique features
- ie. halo / demon horns / low wings
- Remove when not present or out of view. WD1.4 likes putting halo even on images where no halo is visible.
Tag outfit variants with a single master tag
- ie. for Haruka:
  - Uniform: school uniform
  - NY Alt: japanese clothes
    - Add official alternate costume
  - Non-canon costumes
    - Add alternate costume
- Nudity (WD1.4 usually does this accurately)
  - nude / completely nude
Prune eye colors
- Keep tags which describe unusual eye features (multicolored eyes, heterochromia, slit pupils) as they can otherwise be too subtle and inconsistently drawn for the AI to learn
Prune hair colors
- This includes two-toned hair, gradiant hair, etc. The AI learns all of these very consistently without the tags, likely because artists tend to draw them consistently
Partially prune hair styles
- Leave key style tags like twintails, ponytail, short hair with long locks.
- Prune exceedingly common tags like bangs, eyebrows visible through hair, hair between eyes, etc.
- Prune length, except for images which differ from the character's usual length
  - Add alternate hairstyle and/or alternate hair length for these
Fixup hair ornaments
- Prune generic hair ornament in favor of more specificity
  - hairclip / black headband / hair flower / hair ribbon, etc.
- Consolidate tags that have color variants (headband >> black headband)
Consolidate outfits
- Only tag an item when it is actually visible. If it is only barely visible along the edge of an image, keep in mind it may be cropped during bucketing.
- Danbooru's wiki entry for a character often provides a good list of tags commonly used to describe a character's outfits.
- Haruka outfits:
  - Uniform
    - garrison cap
    - miniskirt
    - pleated skirt
    - black skirt
    - boots
    - hairclip
    - juliet sleeves
    - black belt
    - red shirt
    - collared shirt
    - purple jacket
  - NY Alt
    - frilled kimono
    - purple kimono
    - kimono skirt
    - floral print
    - purple hairband
    - hair flower
    - wide sleeves
    - obi
    - geta
    - tabi
Fixup sleeves
- ie. long sleeves / puffy long sleeves / detached sleeves / off shoulder
- You only need one, but pick one and be consistent. If sleeves aren't tagged properly the tends to add them inappropriately (such as when prompting for sleeveless outfits or nudity)
Fixup collars
- ie. detached dollar / collared shirt / choker / etc.
- Same deal as sleeves, they tend to appear when unwanted if not consistently tagged according to visibility in the training data.
Tag expressions
- WD1.4 rarely tags these, but doing them manually can help the AI reproduce a character's iconic expressions well.
- Start by searching for images without one of these, and add them.
  - open mouth
  - closed mouth
  - parted lips
- Add less common expressions
- wavy mouth
- surprised / o_o
- embarrassed / flustered / panicked / swirly eyes / @_@
- smile / light smile / :d
- upset / annoyed / frustrated
- naughty face / seductive smile
- smug / :3
- eyes closed / one eye closed
  - WD1.4 usually gets these for you.
Tag camera angles/composition
- cowboy shot
- upper body
- full body
- portrait
- cropped torso / cropped legs
- feet out of frame
- from side / from above / from below / from behind
Tag iconic poses/actions
- ie. v / standing on one leg
- Haruka
  - object hug
  - holding weapon
Flip through each image and use Hydrus's "related tags" feature to quickly identify important tags that might be missing.
- This feature looks at other images with similar tags to provide suggestions.