Even_Adder@lemmy.dbzer0.com to Stable Diffusion@lemmy.dbzer0.comEnglish · 4 days agoStable Diffusion 3 Medium Fine-tuning Tutorial — Stability AIstability.aiexternal-linkmessage-square8fedilinkarrow-up112arrow-down11
arrow-up111arrow-down1external-linkStable Diffusion 3 Medium Fine-tuning Tutorial — Stability AIstability.aiEven_Adder@lemmy.dbzer0.com to Stable Diffusion@lemmy.dbzer0.comEnglish · 4 days agomessage-square8fedilink
minus-squareEven_Adder@lemmy.dbzer0.comOPlinkfedilinkEnglisharrow-up1arrow-down1·4 days agoLast I heard, LoRAs cause catastrophic forgetting in the model, and full fine-tuning doesn’t really work.
minus-squareerenkoylu@lemmy.mllinkfedilinkEnglisharrow-up1·edit-22 days agoquite the opposite. Lora’s are very effective against catastrophic forgetting, and full finetuning is very dangerous (but also much more powerful).
minus-squareclb92@feddit.dklinkfedilinkEnglisharrow-up2·4 days agoOh well, in practice I’ll just continue to enjoy this (possibly forgetful and not-fully-finetunable) model then, that still gives me amazing results 😊
Last I heard, LoRAs cause catastrophic forgetting in the model, and full fine-tuning doesn’t really work.
quite the opposite. Lora’s are very effective against catastrophic forgetting, and full finetuning is very dangerous (but also much more powerful).
Oh well, in practice I’ll just continue to enjoy this (possibly forgetful and not-fully-finetunable) model then, that still gives me amazing results 😊