INT4 LoRA high-quality-tuning vs QLoRA: A user inquired about the discrepancies amongst INT4 LoRA good-tuning and QLoRA in terms of precision and speed. An additional member explained that QLoRA with HQQ consists of frozen quantized weights, doesn't use tinnygemm, and makes use of dequantizing together with torch.matmul Update vision product