Posit AI Blog: Understanding LoRA with a minimal example You can then train this model like before, without having to explicitly worry about QLoRA during training. Of course, the idea of LoRA is simple enough that it can be applied not only to linear layers. You can apply it to convolutions, embedding layers and actually […]