• Dr. Dabbles@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    8
    ·
    1 year ago

    How much electricity was used to train Copilot? How much MORE is going to be used in the future.

    Feels to me like you don’t understand the problem set and you’re just impressed by a tool spitting out guesses based on millions of examples it hoovered up.

    • FaceDeer@kbin.social
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      Oh no, electricity! If only there were some way to generate more of it.

      This “it uses electricity” thing is such a weird objection. Yes, it uses electricity. That’s why it costs money to run. People pay that money to run it, and if it wasn’t helpful enough to be worth that money they wouldn’t pay it.

      • Dr. Dabbles@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        2
        ·
        1 year ago

        Yeah, for those of you that don’t know your ass from your elbow, these systems are predicted to reach 1 gigawatt per data center up from 50 to 75MW, 100 at the peak. So a 10 to 20 times increase in power, now, I don’t know where you think we’re going to get 10 to 20 times. More power for every single built data center, but you’re smoking crack if you think it’s reasonable.

        Not only that, but there’s this little issue we’ve been noticing for the past 100 years called climate change. Have you heard of it? It’s truly idiotic to consider increasing the demands of these data centers by 10 to 20 times while we’re talking about complete global catastrophe within 50 to 100 years. Monumentally stupid shit.

        And then, of course, we have the people that don’t understand how electronics work. People that might drive by and say will reduce the amount of power these systems need. No, we won’t. We will reduce the amount of joules per operation, but will increase the number of operations drastically. Thereby, causing the power demand to increase. These numbers aren’t for me, they’re from actual industry insiders designing the far future generations of these products.

        Nice attempt with a snark, you’ve proven. You don’t know what you’re talking about. Thank you for playing.

        • FaceDeer@kbin.social
          link
          fedilink
          arrow-up
          1
          arrow-down
          1
          ·
          1 year ago

          As I said, yes, it uses electricity. You realize that there are ways to generate electricity that don’t contribute to global warming? We’re going to need to be switching to those methods anyway.

          • Dr. Dabbles@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            1 year ago

            You seem utterly confused about the scale of the problem I described. Which isn’t entirely surprising. But I think you should go look up those sources. Because the output of a good sized nuclear station is about 1GW and we aren’t going to be building a nuclear station next to every single datacenter, now are we…

            • FaceDeer@kbin.social
              link
              fedilink
              arrow-up
              1
              arrow-down
              1
              ·
              1 year ago

              I fail to see any problem here at all.

              It’s really quite simple. If AI is useful enough that people are willing to pay for the electricity it consumes, then they will pay for that electricity and the generating capacity will be funded by that. If it’s not useful enough for people to be willing to pay for the electricity, then the AI won’t be run. This is a trivial supply and demand situation. The AIs won’t use “too much electricity” because nobody’s going to want to pay for that.

              So if you point at an AI and exclaim “it’s using a kajillion dollars worth of electricity!” I’ll shrug and say “it must be providing a kajillion dollars worth of services, otherwise who’s paying for it?”

              • Dr. Dabbles@lemmy.world
                link
                fedilink
                English
                arrow-up
                3
                ·
                1 year ago

                You fail to see a problem with increasing power demands by 10-20x beyond their existing consumption rates? While the world burns around you? Alright Niro, enjoy your fiddle.

                If AI is useful enough that people are willing to pay for the electricity it consumes, then they will pay for that electricity and the generating capacity will be funded by that.

                Let me change your sentence, then you try it on for size and see how you like it.

                “If CFCs are useful enough that people are willing to pay for them, then they will pay for those CFCs and the hole in the ozone will be an acceptable consequence”. I could go on with Asbestos, lead in gasoline, literally anything that releases a greenhouse gas.

                And again, you clearly can not conceive of what you’re talking about. The cost for such generation is beyond reasonable, and you’ve entirely missed that point. Not a surprise, really, but you’ve missed it all the same. Guessing the next word isn’t useful enough to humanity to burn the world to the ground, but it IS something that companies can sell to simple rubes that have been conned into thinking that the illusion is real magic. And we know what companies will do for money.

                This is a trivial supply and demand situation.

                It isn’t. Because as it is already, these systems are behemoths that consume insane amounts of energy, they are not making enough money to pay for themselves, they are not serving a real utility that provides value, and still the drooling masses use them for their amusement. Either way, you’ve proven you don’t understand the technical aspects of this, the consumption aspects of it, the as-implemented state of the industry, or the scale of demand induced by companies trying to make a buck. So I think the value of this conversation is about the value of any of these rube goldberg guessing machines.

                • FaceDeer@kbin.social
                  link
                  fedilink
                  arrow-up
                  1
                  arrow-down
                  1
                  ·
                  1 year ago

                  You fail to see a problem with increasing power demands by 10-20x beyond their existing consumption rates?

                  Do you have any sources to back up that asspull? Seriously, you have no idea what you’re talking about here. How would we suddenly build ten to twenty times as many power generators as we currently have, even with infinite money being thrown at the problem?

                  Let me change your sentence, then you try it on for size and see how you like it.

                  Again, do you not realize there are environmentally friendly ways to produce electricity?

                  these systems are behemoths that consume insane amounts of energy, they are not making enough money to pay for themselves

                  Then how are the people who are running them able to keep running them?

                  • Dr. Dabbles@lemmy.world
                    link
                    fedilink
                    English
                    arrow-up
                    2
                    ·
                    1 year ago

                    Do you have any sources to back up that asspull?

                    Directly from a keynote given at OpenCompute a few weeks ago. Swing and a miss.

                    Again, do you not realize there are environmentally friendly ways to produce electricity?

                    List for me which ones can be built in 1GW installations feasibly and cost effectively, please. And if you choose solar, detail the physical size of the facility. I’ll wait here.

                    Then how are the people who are running them able to keep running them?

                    Do you forget my initial comment? Go read it again.

    • mrnotoriousman@kbin.social
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      I work on AI and it feels to me like you literally don’t understand it at all based on your comments in this thread. But you sure do have all the buzzwords down pat.

      • FaceDeer@kbin.social
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        1 year ago

        He thinks LLMs could be replaced by a “text template”, so yeah, this guy’s clearly not actually tried using it for anything meaningful before.

        • Dr. Dabbles@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          You’re right, a template would be more specific to the question and guaranteed accurate, while not taking GPU years to train and untold quantities of stolen content. So, I guess a template would be a much better solution.