• Padit@feddit.org
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 day ago

    Well, honestly: I have this kind of computational power at my university, and we are in dire need of a locally hosted LLM for a project, so at least for me as a researcher, its really really cool to have that.

    • Teanut@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 hours ago

      Lucky you! I need to check my university’s current GPU power but sadly my thesis won’t be needing that kind of horsepower, so I won’t be able to give it a try unless I pay AWS or someone else for it on my own dime.