Modify update_model_with_lora() - load weights from single_blocks, double_blocks with/withour LoRA weights