• RustyNova@lemmy.world
    link
    fedilink
    arrow-up
    81
    arrow-down
    1
    ·
    1 day ago

    Claude didn’t “go rogue”. The predictive text machine created bad text and it was allowed to run that stuff.

  • Rimu@piefed.social
    link
    fedilink
    English
    arrow-up
    7
    ·
    21 hours ago

    After reading this I checked my backup system and found it hadn’t worked for the last month because a disk was full.

    Woops!

  • Klanky@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    19
    ·
    1 day ago

    It blows my mind that people continue to trust spicy auto-complete to do anything remotely important.

  • Grimy@lemmy.world
    link
    fedilink
    arrow-up
    14
    arrow-down
    1
    ·
    1 day ago

    https://www.deccanherald.com/india/karnataka/bengaluru/when-claude-code-went-rogue-years-of-bengaluru-heritage-work-disappeared-4131958

    For four minutes, heritage conservationist Udaya Kumar P L watched an AI agent wreak havoc on his computer. The agent was testing software it was developing and clearing the cache when “a quoting error in an AI-generated command turned the instruction into ‘delete everything’”. “When it understood and tried to kill the process, its safety system blocked the kill. Twice… The safety layer permitted the destruction,” Udaya wrote on X. A former IT professional, he eventually shut down the the computer.

    So this guy watched it do it for four minutes, and closed the computer instead of just clicking the little stop symbol. No backup and working in a workspace with basically everything in it. Guy should be fired lol, completely tech illiterate. They lost 15% of their data, all kept only on that one computer apparently.

    Of course OP only posted a picture of the headline. Wonder why.

    • Jason2357@lemmy.ca
      link
      fedilink
      arrow-up
      5
      arrow-down
      2
      ·
      1 day ago

      Yeah AI is barely relevant to this story. It could have been a bad quote in human written code.