Blackwell consumer GPUs offer 'F-tier value for S-tier prices, ' moans the naturalized Russian.
  • Viri4thus@feddit.orgEnglish
    2·
    22 hours ago

    Ty. I’ll try ollama with the Q-4-M quantization. I wouldn’t expect to see a difference between ollama and SGlang.