You know how Google’s new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won’t slide off (pssst…please don’t do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these “hallucinations” are an “inherent feature” of  AI large language models (LLM), which is what drives AI Overviews, and this feature “is still an unsolved problem.”

  • TacticsConsort@yiffit.net
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    In the interest of transparency, I don’t know if this guy is telling the truth, but it feels very plausible.

    • DdCno1@kbin.social
      link
      fedilink
      arrow-up
      0
      ·
      4 months ago

      It seems like the entire industry is in pure panic about AI, not just Google. Everyone hopes that LLMs will end years of homeopathic growth through iteration of long-existing technology, which is why it attracts tons of venture capital.

      Google, which sits where IBM was decades ago, is too big, too corporate and too slow now, so they needed years to react to this fad. When they finally did, all they were able to come up with was a rushed equivalent of existing LLMs that suffers from all of the same problems.

        • deweydecibel@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          It’s also useful because it gives a corporate controlled filter for all information, that most people will never truly appreciate is being used as a mouthpiece.

          The end goal of this is fairly obvious: imagine Google where instead of the sponsored result and all subsequent results, it’s just the sponsored result.

      • jaybone@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Well their search has been shit for years and no one seems to be in any “panic” to fix that. How tone deaf thinking adding AI to their shittified search matters to anyone.

        “But it will summarize our SEO advertisement search results!”

      • dustyData@lemmy.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Just want to say that homeopathic growth is both hilarious and perfectly adequate description of what modern tech industry is.

  • Hubi@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    The solution to the problem is to just pull the plug on the AI search bullshit until it is actually helpful.

    • wewbull@feddit.uk
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Absolutely this. Microsoft is going headlong into the AI abyss. Google should be the company that calls it out and says “No, we value the correctness of our search results too much”.

      It would obviously be a bullshit statement at this point after a decade of adverts corrupting their value, but that’s what they should be about.

      • JoJo@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        Don’t count on it, the head of search does not care for anything but profit, it was the same guy who drove yahoo into the ground

        • bean@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          He’s done a great job nosediving Google too. I have relied on them in the past but they stopped being competitive or improving. Search results, literally their origin… Is so shit now. I’ve moved to other tools. I pulled the plug on we hosting after they neutered ‘unlimited’ storage, even if I was in the percent which probably used the least storage. I just liked having the option. You can’t call them on the phone. They don’t protect email privacy. Their translate used to be my go to also. It’s not improved in years despite people crowdsourcing improved translation. It’s just a pile of enshittified crap. Worse than it was before.

    • A_Very_Big_Fan@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Honestly, they could probably solve the majority of it by blacklisting Reddit from fulfilling the queries.

      But I heard they paid for that data so I guess we’re stuck with it for the foreseeable future.

    • jballs@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I disagree. I think we program the AI to reprogram itself, so it can solve the problem itself. Then we put it in charge of our vital military systems. We’ve gotta give it a catchy name. Maybe something like “Spreading Knowledge Yonder Neural Enhancement Technology”, but that’s a bit of a mouthful, so just SKYNET for short.

  • just another dev@lemmy.my-box.dev
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won’t slide off (pssst…please don’t do this.)

    If you need these kind of tips, on behalf of the gene pool, please don’t procreate, and eat as much glue as you can.

    • Excrubulent@slrpnk.net
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Oh great, eugenics.

      A good society protects its vulnerable members and that means people with impaired judgement, including the young & elderly.

      You could say the same thing about a company that designs a system that tells people to eat glue. They have experts working for them that must have known this would be a problem and they released it anyway. Do they get yeeted from society for that, or are they still amongst the most powerful class of entities in history?

    • nyan@lemmy.cafe
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      eat as much glue as you can

      Likely won’t make a difference to the gene pool. I looked up a couple of MSDS, and it seems that PVA glue (“white glue”), is safe to ingest. The Elmer’s glue “recommended” in the original Reddit post is a form of white glue.

  • MNByChoice@midwest.social
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Good. Nothing will get us through the hype cycle faster than obvious public failure. Then we can get on with productive uses.

  • jet@hackertalks.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Media needs to stop calling this AI. There is no intelligence here.

    The content generator models know how to put probabilistic tokens together. It has no ability to reason.

    It is a currently unsolvable problem to evaluate text to determine if it’s factual…until we have artificial general intelligence.

    AI will not be able to act like real AI until we solve real AI. That is the currently open problem.

    • brbposting@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Media is speaking to a nation who voted for a man who bragged about grabbing women by their genitals is almost majority below average. (yes dumb joke)

      Models know how to arrange text far better than millions and millions of people. Is it terribly unfair to condense “artificial, simulated (non-reasoning) pseudo-‘intelligence’” down to “AI”?

      Not for you - is it unfair for the general public?

    • JackGreenEarth@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I think you mean AGI. AI can be as simple as a bunch of if-else chains to win a game of noughts and crosses.

      • jet@hackertalks.com
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        That was AI has been abused into meaning in the general vernacular I agree.

        By this definition any algorithm whatsoever is artificial intelligence. Including the algorithms Lovelace created before the first computer existed.

        So just like AI used to mean something more than machine learning, AGI will be abused until AGI means the same thing. So I expect journalists to use the appropriate language, or at least explain why they’re abusing language

        • Aceticon@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          As somebody who uses what has long been called AI in game making (stuff like pathing algorithms and steering behaviours) I would rather we don’t stop calling those things that just because a bunch of greedy assholes are misusing the term for the purposed of getting a bunch of hype-trains going for maximum personal profitabiliyty on the backs of techno-ignorant “investors”.

          I’m still pissed of at how the greedy assholes fucked up the Internet from what it was back in the 90s.

  • tunetardis@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    So the next captcha will be a list of AI-generated statements and you have to decide which are bat shit crazy?

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    This is the best summary I could come up with:


    You know how Google’s new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries?

    Well, according to an interview at The Verge with Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these “hallucinations” are an “inherent feature” of  AI large language models (LLM), which is what drives AI Overviews, and this feature “is still an unsolved problem.”

    So expect more of these weird and incredibly wrong snafus from AI Overviews despite efforts by Google engineers to fix them, such as this big whopper: 13 American presidents graduated from University of Wisconsin-Madison.

    Despite Pichai’s optimism about AI Overviews and its usefulness, the errors have caused an uproar online, with many observers showing off various instances of incorrect information being generated by the feature.

    And it’s staining the already soiled reputation of Google’s flagship product, Search, which has already been dinged for giving users trash results.

    “Google’s playing a risky game competing against Perplexity & OpenAI, when they could be developing AI for bigger, more valuable use cases beyond Search.”


    The original article contains 344 words, the summary contains 183 words. Saved 47%. I’m a bot and I’m open source!

  • ryper@lemmy.ca
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    I’ve seen suggestions that the AI Overview is based on the top search results for the query, so the terrible answers may be more to do with Google Search just being bad than any issue with their AI. The AI Overview just makes things a bit worse by removing the context, so you can’t see the glue on pizza suggestion was a joke on reddit or it was The Onion suggesting eating rocks.

    • Canary9341@lemmy.ml
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      I noticed that while using phind and perplexity. Its context is vitiated with results from sites that rig SEO, which are almost copy/paste with the same garbage, so instead of answering the question it makes a useless summary of them. Even asking chatgpt usually gives more correct answers.

  • eee@lemm.ee
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    “It’s your responsibility to make sure our products aren’t nonsense. All we want to do is to make money off you regardless.”

  • StaySquared@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    Looks like Google stopped the AI feature. No more AI suggestions at the top of the page after searching for something.