Hacker Next
SVDQuant: 4-Bit Quantization Powers 12B Flux on a 16GB 4090 GPU with 3x Speeduphanlab.mit.edu
178 points by lmxyy 6 days ago | 64 comments