• veni_vedi_veni@lemmy.world
    link
    fedilink
    arrow-up
    12
    ·
    2 days ago

    I’m so glad the latest breakthroughs in AI are about doing more with less in the form of Quantization and Distillation efforts.

    It’s gonna make these AI focused companies like Meta realize how exposed and stupid they are for buying out more equipment then they had any plans to do with. And I hope that they fail hard without a government bailout.

    • Phoenixz@lemmy.ca
      link
      fedilink
      arrow-up
      2
      ·
      20 hours ago

      Oh come on, of course they’ll be bailed out. They’re US flagship IT companies and the c-suite is all billionaires. It doesn’t matter they only produce utter shit now, they will be hailed out when they fail, the Cheeto will make sure of that

    • TehWorld@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 days ago

      I’m no expert, but I’ll bet that there is plenty of work being done on the ultra-high level to maximize usage of their resources.

      • schipelblorp@sh.itjust.works
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        24 hours ago

        It’s not surprise that the real efficiency gains came out of China.

        Most of AI is funded by NVIDIA explicitly and obviously as a way to goose their stock price. You think AI companies who depend on getting money from NVIDIA on the condition they buy a lot of NVIDIA GPUs are going to go out of their way to lower the cost of compute?

        Edit: Actually, I think it doesn’t matter. AI is so divorced from reality, OpenAI can say they lowered the cost of compute by 95% and therefore they have to triple their orders of GPUs.