What year is it? What month is it?
Henlo. Haven't posted in like ten years... And I had my reasons. But honestly, fuck it, it is what it is.
TL;DR so I don't rot your brain - start of the year, I decided to update the Dittochad style LoRA (yeah, again), and ran into issues (again).
Specifically: for a month and a bit, my life was just coming home from work, firing up training runs, hating the results, and going to sleep. Rinse and repeat, day after day.
I tried a ton of stuff and actually managed to lose hope and get disillusioned with my own methods and beliefs in the process.
Specifically: for a month and a bit, my life was just coming home from work, firing up training runs, hating the results, and going to sleep. Rinse and repeat, day after day.
I tried a ton of stuff and actually managed to lose hope and get disillusioned with my own methods and beliefs in the process.
The main takeaway - I think I'm ditching the B-LoRA method, at least partially. Even though pruning insignificant blocks makes for faster training and lighter files, for some styles with crucial details, those "cut" blocks actually play a role. Without them, the output style just doesn't look close enough to the original.
That’s exactly what happened with the Dittochad style. And a few others. Turning off B-LoRA turned out to be the best call in the end.
That’s exactly what happened with the Dittochad style. And a few others. Turning off B-LoRA turned out to be the best call in the end.
It’s probably not as simple as I'm making it sound. For instance, I feel like B-LoRA training could be improved by lowering the learning aggressiveness and increasing the step count, but I seriously do not give a fuck anymore. I am so done with toggling the same three checkboxes 8 times over, you have no idea.
Also, I switched to the Easy Scripts fork by 67372a. They added a ton of stuff and fixed a lot of things I probably won't even touch. However, a specific optimizer there helped me get better results with the Dittochad LoRA on Illustrious... And on Noob, actually.
Anyway, I'm continuing to expand my understanding of style training, moving away from trying to find "universal settings" and accepting that there is no magic button.
Right now I'm mostly busy playing Arknights Endfield, so I probably won't be super productive going forward either, but if you want to commission a style LoRA - hit me up, don't be shy.
I also remembered that I'm actually decent at training character LoRAs, not just styles. Keep that in mind, but also remember character training has more nuances and doesn't always turn out perfect.
I also remembered that I'm actually decent at training character LoRAs, not just styles. Keep that in mind, but also remember character training has more nuances and doesn't always turn out perfect.
Thanks for reading!
