• boonhet@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    6
    ·
    58 minutes ago

    This makes it official, I’m skipping DDR5. I have ryzen 5700 and 32 GiB of DDR4, it’ll hold me over for a few more years. When I finally upgrade, it’s going to be at least 128 GiB.

  • Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    15
    ·
    2 hours ago

    One good thing about the AI boom is that it’s flooding capital into ram development and ram production. Once the bubble pops all these ram companies will have a glut of cheap high performance memory to sell to anyone who can buy it in cash. The question is if the bubble popping triggers a full blown recession will anyone have any cash to buy.

  • Sam_Bass@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    ·
    6 hours ago

    when will they go back to optimizing software to run in the available ram, rather than continuing to increase ram size?

    • marzhall@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      5 hours ago

      When the devs run out of available RAM.

      Or if you’re 100 Rabbits and you live on a boat powered by solar so you’re actively limited by available electricity so you write tools based on your home-made tiny VM.

    • gigaqps@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      2 hours ago

      If you’re able to optimize AI tools to run larger models in less RAM, you’ll have a lucrative future ahead of you.

      • Sam_Bass@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        51 minutes ago

        i would not use ai for anything. too many errors and falsehoods come from them. and theyre now out there hacking other systems because nobody reins them in

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 hour ago

        It’s KINDA being done in the ways we run MoE models. Strata makes more efficient use of limited VRAM if you have a decent amount of RAM, but you don’t even need to keep the entire model in RAM with it, it can keep the least frequently used experts on disk instead (it being an NVMe SSD hopefully, otherwise if you hit those experts, good luck)

  • varyingExpertise@feddit.org
    link
    fedilink
    English
    arrow-up
    20
    ·
    7 hours ago

    I hope that one day I can afford a ticket to an exhibition where we all gather around a security-glass display case with a stick of one of those in it and bask in its presence.

  • Wildmimic@anarchist.nexus
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    1
    ·
    8 hours ago

    Since limited waver space (because HBM takes so much of it at the same capacity) is one of the main driving factors for the Ram-apocalyse, this might actually help. And the performance looks actually great (the comparison to the DDR4 i am running shows some parameters being 10x better, this is actually a meaningful upgrade), meaning that some applications that currently use HBM might be able to just use DDR6 instead, causing a greater allocation of wavers towards that.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      Generative ML inference isn’t so dramatically bandwidth limited anymore, either, so the “demand” for HBM isn’t as clear.

      • boonhet@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 hour ago

        Eh the really big models want a lot of bandwidth still, otherwise you just don’t make use of all the compute power you have.

        • deadbeef79000@lemmy.nz
          link
          fedilink
          English
          arrow-up
          1
          ·
          24 minutes ago

          I generally edit my comments like this:

          Since limited waver wafer space

          So that is fixed for the next reader but the comment chain still makes sense.

  • InnerScientist@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    ·
    10 hours ago

    DDR6 has no official launch date. Many believe 2029 is a realistic target for commercialization. However, in the current state of things, it would be a miracle if DDR6 had no setbacks.

    One can only hope the bubble pops before 2029.

    • Corkyskog@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      8 hours ago

      It will, it’s coming next summer/fall unless it comes earlier. If the AI industry continues on in its current state until 2029 without popping, then it won’t pop. It means they stabilized their debt and financing.

        • Corkyskog@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          I firmly believe it will based on the financials. I am just saying if it’s 2029 and it “hasn’t happened yet” then it won’t happen. It’s coming within the next year, I would bet money on it. Not my life savings, but a chunk. In fact I have bet some money on it.

  • DupaCycki@lemmy.world
    link
    fedilink
    English
    arrow-up
    24
    ·
    11 hours ago

    Great how real RAM development starts the moment nobody but a handful of billionaires can afford it.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        4 hours ago

        GDDR versioning doesn’t necessarily line up like that. For instance, GDDR7 is technologically akin to LPDDR5X, just with a different set of configuration tradeoffs.

  • Mihies@programming.dev
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    13 hours ago

    At this point it doesn’t matter anymore if it were DDR99 with 578644.7 GT/s modules as we, consumers, won’t see them again in real life

  • wonderingwanderer@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    11 hours ago

    I mean a TiB of RAM sounds awesome, until you realize what a nightmare that would make setting up the swap partition if you ever use hibernate.

    Plus I never even come close to using all of my whopping 64GiB, and even if I did I could still (theoretically) upgrade to 128GiB using the same slots (if I had a million dollars, at least).

    • boonhet@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      What even is the point of using hibernate anymore? Used to be that it started up slightly faster on Windows since it’d skip a lot of the startup bloat, but in the year of our lord 2026, even Windows starts pretty fast on modern hardware, let alone Linux

      • wonderingwanderer@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 hours ago

        I don’t know, I haven’t booted a windows system in several years.

        I also haven’t used hibernate yet, but normally I put my laptop to sleep and if it’s not plugged in it’ll still die within 24 hours.

        Sometimes I have lots of documents and windows open cause I’m mentally fucked in the head and I never close anything, so I’m usually reluctant to shut down because it doesn’t all reopen on startup the way it’s supposed to (I use KDE’s “save session” option, which I love, but a few things like Pluma and LibreOffice don’t work with it perfectly).

        • boonhet@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 hour ago

          Ah, well, I use a desktop PC and get power outages occasionally, so I just need to factor in sudden loss of power. My IDE auto saves every time I stop typing for a few seconds (default functionality actually) and LibreOffice has my shit in recovery if I didn’t save it. But I also hit ctrl + s religiously. Something my friend told me I should be doing when I was playing Skyrim and complained that I lost half an hour progress when the game crashed. “You gotta keep hitting F5 religiously in that game”. I just apply it to everything I do now.

          I actually disabled the save session option on Plasma though, it keeps me honest with what I actually need open. Turns out I didn’t need 20 terminal windows, one window with 5 tabs is enough half the time.

    • Metz@lemmy.world
      link
      fedilink
      English
      arrow-up
      18
      ·
      10 hours ago

      Swap for hibernation does not need to be the same size as the RAM. It only needs to be big enough to hold what is currently loaded at that time. So in many cases you can get by with only a couple of GB or less.