Upload ponyxl_loras_n_stuff.md

ponyxl_loras_n_stuff.md

@@ -1,4 +1,7 @@
 #PonyXL Notes
+
+[TOC2]
+
 ##Get PonyXL here
 https://civitai.com/models/257749?modelVersionId=290640
 
@@ -17,11 +20,12 @@ An anon also created a LoRA extract of it if you want to experiment with it on b
 https://civitai.com/models/312010/4th-tail-lora-extract
 
 ##Reverse Engineered Hashed Tokens
-It seems like the obfuscated/hashed tokens in the model are only mapped to three letter strings. There's only about 17k possible 3 letter combinations so it might be possible to just reverse engineer the remapped tokens through brute force, here's a few that are already known, hopefully this list will be expanded.
+It seems like the obfuscated/hashed tokens in the model can often times be exposed through three letter strings (probably substrings of the full hash). There's only about 17k possible 3 letter combinations so it's possible to just reverse engineer the remapped tokens through brute force, an amazing anon went through the trouble of genning every 3 letter combination and noting which combinations seemed to affect the style. Here's his latest update:
 
-**Update 3/11/2024**
-An anon has been generating images for each 3 letter combination and noting which ones seem to change the image significantly. Here's his output: 
+All tokens I found: https://files.catbox.moe/41sbn0.txt
+Zip with all images (small) and tokens: https://files.catbox.moe/tqb4go.zip
 
+Compilations:
 aaa to bzm:
 https://files.catbox.moe/c0rl1r.jpg
 cad to eum:
@@ -34,12 +38,26 @@ jkv to lek:
 https://files.catbox.moe/tj2aeq.jpg
 lgu to mkb:
 https://files.catbox.moe/p7qqaz.jpg
+mkg to nyj:
+https://files.catbox.moe/365n8h.jpg
+and nyp to pyb:
+https://files.catbox.moe/64zi6v.jpg
 pyh to rwy:
 https://files.catbox.moe/ws5643.jpg
 rxb to tir:
 https://files.catbox.moe/yhg6tr.jpg
-
-Less consistent:
+tjt to ulx:
+https://files.catbox.moe/5pipmv.jpg
+ulz to viv:
+https://files.catbox.moe/pj5qsd.jpg
+vix to wgv:
+https://files.catbox.moe/niiwxt.jpg
+wha to xph:
+https://files.catbox.moe/w00hdt.jpg
+xpk to zzj
+https://files.catbox.moe/pjt03o.jpg
+
+Some more repetitive ones:
 aav to frw:
 https://files.catbox.moe/1z4efd.jpg
 fsp to klm:
@@ -48,32 +66,19 @@ kmq to ojn:
 https://files.catbox.moe/6qpxyi.jpg
 oka to rrg:
 https://files.catbox.moe/hvy7re.jpg
+rzj to xlv:
+https://files.catbox.moe/jrk1xl.jpg
+xmj to zzr:
+https://files.catbox.moe/882h83.jpg
 
-There's an effort underway to identify the triggers.
-
-###Hashed Styles
-arb - superbusty
-bnp - konpeto?
-aqe - melon22
-dhg - nyantcha?
-fqx - camonome?
-grt - dikko?
-mjm
-wfk
-lbp
-zkm
-qse
-ert
-hrt
-rer
-rty
-zzg - jvteemo
 
+There's an effort underway to identify the triggers.
 
-###Hashed Characters
-aua - houshou_marine 
-
+###Hashed Styles/Characters
 
+**Update 3/21/2024**
+Here's a csv of the latest version of a collaborative spreadsheet with some identified styles.
+https://files.catbox.moe/j7g22l.csv
 
 ##List of Ponyxl LoRAs from /h/
 NEW NOTE 1/24/2024: I've noticed that some LoRA bakers are using different negatives when testing their LoRAs, which can lead to discrepancies when using them. I've mostly noticed that some LoRAs have a significantly reduced effect if you don't have source_pony or some combination of the source_* tags other than source anime in the negatives. This is unfortunate but a byproduct of not having a standardized process for creating the LoRAs. There's another section down below that has more info about similar issues with PonyXL that's worth reading.
@@ -127,7 +132,7 @@ https://files.catbox.moe/nvc1m8.safetensors ndc
 https://files.catbox.moe/kbaz4k.safetensors trogfor
 https://files.catbox.moe/4b97sc.safetensors nephlite
 https://files.catbox.moe/swjqw4.safetensors yd
-https://files.catbox.moe/qyreix.safetensors rustle
+https://files.catbox.moe/ecebk5.safetensors rustle
 https://files.catbox.moe/ojbvr4.safetensors afrobull
 https://files.catbox.moe/rqqk5m.safetensors akihiko_yoshida
 https://files.catbox.moe/cuzgnf.safetensors aoi_nagia just using stuff from Elf Mori
@@ -274,10 +279,10 @@ https://files.catbox.moe/6mq6hn.safetensors wamudraws
 https://files.catbox.moe/dkjzm3.safetensors gattles
 https://files.catbox.moe/6nnfzi.safetensors norza
 https://files.catbox.moe/4z5ngk.safetensors ter
-https://litter.catbox.moe/cburag.safetensors juno really only trained on paizuri since that's pretty much all the artist draws, has activation trigger junopai, 1girl, solo focus, 1boy, penis, paizuri, large breasts will get the typical image layout 
 https://files.catbox.moe/5oa88d.safetensors shadman
 https://files.catbox.moe/tccjiu.safetensors kylin 
 https://files.catbox.moe/7sgo6g.safetensors uno_makoto exmaple gen: https://files.catbox.moe/yt0ip7.png
+https://files.catbox.moe/vlmuy2.safetensors pixzapix 
 
 **These are from the megas below, unmodified, if you want good example gens you can check in their respective megas.**
 https://files.catbox.moe/9qqq1s.safetensors suga_hideo
@@ -329,6 +334,9 @@ https://rentry.org/shitty_loras#styles-pony-diffusion-v6-xl made_in_abyss, moshi
 https://mega.nz/folder/1yRSXQCR#Ziu9Q9Is5BCTYn53tnionw akatsuki_giken, alkemanubism, annin, aoin, chabo_fuketsudan, collagen, go_robots, ishida_umi, kafun, kaomin, kenya_suzuki, kink_(tortoiseshell), lucient, m_k, marui, miche, nezumi, nnf, pantsu_ruipper, RA, shizuoka, simzarts, testsuwan_woopie
 https://mega.nz/folder/NegX3DDL#NX3YguN8GSrEbOXuN918BA inhoso
 https://mega.nz/folder/fdoG2QDQ#6ZS_K55fY3g4NottW2NJng thanuki
+https://mega.nz/folder/L7Q3XaQC#jg7_M_gCun-aQenQmLISIQ banpai_akira, cluseller, tangobat, toi8, bonnie, everyntrge, gbf splashes (I assume some sort of gran blue style?), kaptivate
+https://mega.nz/folder/TZElCCIL#OEutCsJPD0G5lXPXLGgfcQ/folder/qMUFgTrR 2b213, Aestheticc-meme, Avotoma3, Blurent, Colodraws, Dustbinrat, Healthyman, Ibuo, Inkterton-kun, Jlullaby, Kairunoburogu, Kevbot, Korotsuke, Lakilolom03, Leftlewdz, Lone, Mantis-x, Marui Maru, Mctamagomaki, Murata Renge, Namespace, Possum Machine, Randomboobguy, Roly, Sandcavern, Sano-br, Sarikyou, Sweetdynamite, Takato Kurosuke, Vammzu, Wamudraws, Woofycakes, Yume Yoroi, Akai Sashimi, Fluffydango, Jujunaught, Jun (Rojiura Jack), Kanabun, Kanden-ki, Mystical, Spring2013, Bunybunyboi, Captainjerkpants, Citrusdoodles, Cloudxmoe, Coffeelove68, Doppel, Eigaka, Forastero, Gats, Gloss, Grayimpact, Greatm8, Kabos, Kanikama, Krekkov, Lk149, Loliconder, Marthedog, Naga U, Neo Hajime, Nuclearwasabi, Oekakizuki, Peculiart, Rizdraws, Ryusei Hashida, Sokonasu, Suzuki Kenya, Tod0231, Tomu (Tomubobu), Torathi, Zako
+
 ###Characters
 
 https://files.catbox.moe/1wdl00.safetensors character_momoka helps to prompt features like hair, clothes
@@ -360,9 +368,11 @@ https://files.catbox.moe/ydfkfj.safetensors character_seele_starchasm_nyx activa
 https://files.catbox.moe/0escz4.safetensors character_sindel activation trigger is sindel, helps to have multicolored_hair in the prompt to get the black streak in her hair to show up
 https://files.catbox.moe/pagyj3.safetensors character_agnes_tachyon activation trigger is agnes_tachyon_\(umamusume\)
 https://files.catbox.moe/ou15oe.safetensors character_rishiah_ivyred activation trigger is rishia ivyred, seemd like you need to prompt her features as well like green hair, green eyes, twin braids, very long hair, hair bow. example gen: https://files.catbox.moe/5t64vg.png
+https://files.catbox.moe/62g6g1.safetensors character_uni seems like un1 is the activation trigger,  example gens: https://files.catbox.moe/3ijdtz.png, https://files.catbox.moe/rgndp3.png, https://files.catbox.moe/t306wb.png
 
 **Mega uploads with files too large for catbox**
 https://mega.nz/folder/uuI2DCjA#JKGPF0uYT-1Zo0dE3wCPJQ sorceress_sellen
+https://mega.nz/folder/L7Q3XaQC#jg7_M_gCun-aQenQmLISIQ characters from nikke, hsr, yugioh, azure lane, blue archive, gran blue
 
 ##Innate artists/styles
 List of tags innate to ponyxl that change the style significantly, usually artists but sometimes other strange behavior some of these could just be getting activated by character names in the artist name or just misfires in the AI network ¯\_(ツ)_/¯
@@ -703,6 +713,9 @@ koikatsu
 [![no scores](https://files.catbox.moe/ymxn5j.png)](https://files.catbox.moe/ssmhux.png)[![using 3d in neg](https://files.catbox.moe/bp3ebs.png)](https://files.catbox.moe/g17f51.png)[![using score_9](https://files.catbox.moe/lui5ad.png)](https://files.catbox.moe/nvy14k.png)[![using all score tags](https://files.catbox.moe/ctx00a.png)](https://files.catbox.moe/ro2z3l.png)
 mamimi
 
+[![1girl, cowboy shot, wide hips, hand on hip, contrapposto, one-piece-swimsuit, beach, sky, cloud NEG: monochrome, greyscale](https://files.catbox.moe/xlr9r6.png)](https://files.catbox.moe/aoeusb.png)[![chun-li, upper body, looking at viewer, crossed_arms, annoyed, city, sky NEG: 3d, monochrome, greyscale](https://files.catbox.moe/qevsx5.png)](https://files.catbox.moe/vd6lg0.png)[![source_anime, score_9, from behind, cowboy_shot, 2b \(nier:automata\), ass_focus, leotard, hands on hips, looking back NEG: monochrome, greyscale](https://files.catbox.moe/c3rsm6.png)](https://files.catbox.moe/sh86y8.png)[![source_anime, score_9, score_8_up, score_7_up, score_6_up, score_5_up, score_4_up, tatsumaki, sitting, on_bed, leg_up, leaning back, arm_support, smug NEG: source_pony, monochrome, greyscale, topless](https://files.catbox.moe/54ojqr.png)](https://files.catbox.moe/3ggenf.png)
+mdf_an
+
 **strong and doesn't look anything like the artist imo but still possibly useful through varying strength and combining with other artists**
 [![no scores](https://files.catbox.moe/usoc6a.png)](https://files.catbox.moe/h6q88a.png)[![using 3d in neg](https://files.catbox.moe/svb2wy.png)](https://files.catbox.moe/izu8y9.png)[![using score_9](https://files.catbox.moe/29h794.png)](https://files.catbox.moe/jt3val.png)[![using all score tags](https://files.catbox.moe/kqnti6.png)](https://files.catbox.moe/rm24aw.png)
 geo_(yukishitadou)
@@ -804,16 +817,9 @@ mana_kakkowarai
 last tried was yanyan_\(shinken_gomi\)
 
 ##Innate Characters
-An anon went through the trouble of compiling a  list of characters known to the model, these are not comprehensive it seems to know hundreds if not thousands of characters. Any popular female character from a popular franchise has a good chance of being known to the model, movies, video games, and tv shows are a good source.
-
-**I've gotten some complaints that these lists aren't accurate, I'm keeping them around for posterity but don't count on a character showing up just because it's in these lists.**
+I spent some time generating images of the characters on danbooru in descending order by post count, here's about 500 of the ones I saw that pony recognized.
 
-Females: https://files.catbox.moe/oklpz8.txt
-Males: https://files.catbox.moe/1lptzn.txt
-Female Pokemon: https://files.catbox.moe/sljtm8.txt
-Male Pokemon: https://files.catbox.moe/ka331j.txt
-Western Characters: https://files.catbox.moe/15bayo.txt
-More Western Characters: https://files.catbox.moe/bhjnpb.txt
+https://files.catbox.moe/r29xho.txt
 
 ##Tricks with the model for more anime style
 There's some evidence that the model has a bit of a bias towards western style art, particularly when using the score tags (it is made by furries after all). It might be beneficial to tag your image sets with the score tags, the laziest way would be to tag every image with score_9, source_anime, this may affect the overall "quality" of images the lora generates since some of the knowledge in the model about "high quality" might be overwritten but it will look more like the artist's style. 
@@ -860,7 +866,6 @@ https://files.catbox.moe/m861nn.json
 ####My Current Settings
 My current settings are pretty similar to the prodigy one above, a couple times I've had a hard time getting prodigy to get that last bit of distance to really recreate the artist and have used AdamW in those cases, which takes a bit more tweaking with the learning rates. Usually I'll resize the resulting LoRA down to 16ish dims (for a style) and make sure it still looks good.
 
- --network_module = networks.lora
  --train_data_dir = "$IMAGES_PATH$"
  --output_dir = "$OUTPUT_FOLDER$"
  --output_name = "$LORA_NAME$"