Quasarke Forums
  • Communities
  • Multi-communities
  • Support Lemmy
  • Search
  • Login
Technology@lemmy.worldbybeep@piefed.world
2 days

AI chatbots give us a narrow slice of knowledge: Researchers warn of ‘knowledge collapse’

news.ku.dk English

cross-posted from: https://piefed.world/c/tech/p/1429829/ai-chatbots-give-us-a-narrow-slice-of-knowledge-researchers-warn-of-knowledge-collapse

22
    We are exposed to a much narrower range of knowledge through AI chatbots than through a basic web search. This is documented by a new study led by the University of Copenhagen. As more and more of us turn to AI chatbots for information, researchers warn that the risk of ‘knowledge collapse’ increases.
    You must log in or register to comment.

    • toiletobserver@lemmy.worldEnglish
      2 days

      Narrow AND incorrect

        • latetolemmy@lemmy.worldEnglish
          1 day

          More correct than whatever slop one liners you get from dudebros on the internet

          • plateee@piefed.socialEnglish
            2 days

            Hey, incorrect only the majority of times!

            /s

          • DeathsEmbrace@lemmy.worldEnglish
            2 days

            Not the fact that now every government can control that information if they wanted to?

            • latetolemmy@lemmy.worldEnglish
              1 day

              Dumb alarmists raise alarm because they don’t have a real job and are afraid they won’t get funding if they don’t create sensationalism every time

              • Eq0@literature.cafeEnglish
                2 days

                Great, another reason to not like AI…

                • ExLisper@lemmy.curiana.netEnglish
                  2 days

                  Not really an issue if the knowledge they expose you to is still more than you can absorb. Classic web search can show you 10x more info but you will just skim it anyway and absorb only tiny portion of it.

                    • yeahiknow3@lemmy.dbzer0.comEnglish
                      2 days

                      This isn’t about individuals. We safeguard knowledge institutionally. For instance, everyone should read this open letter from the top mathematicians on the planet, describing how we are about to undermine our mathematical understanding IDIOCRACY style. (I’m paraphrasing.)

                      Essentially, mathematical proofs are worthless without the communities that discover them. We care about math proofs because they create these communities (safeguarding knowledge for the next generation), not vice versa.

                      Having ChatGPT assert a proof we lack the expertise to check defeats the purpose. Not to mention, we already know it will get things wrong because of Gödel incompleteness so this whole situation is peak irony.

                        • ExLisper@lemmy.curiana.netEnglish
                          2 days

                          Yes but that’s a completely different issue than the one the article describes.

                            • yeahiknow3@lemmy.dbzer0.comEnglish
                              1 day

                              You’re right, but the article had a similar flavor. Specifically, when looking up information, users should be discovering curious details that raise additional questions. The AI is a homogenizing service that removes this “creative discovery” aspect of information gathering.

                          • non_burglar@lemmy.worldEnglish
                            2 days

                            Really narrow view of knowledge.

                            The danger of catapulting an entire generation into ai-fed answers isn’t the amount or quality of knowledge, it’s training people to ask and NOT verify, a pillar of attaining wisdom and true expertise.

                              • ExLisper@lemmy.curiana.netEnglish
                                2 days

                                Yes but that’s a completely different issue than the one the article describes.

                                  • Toga77@lemmy.worldEnglish
                                    21 hours

                                    You keep saying that and it’s not true.

                                    Knowledge collapse due to AI feeding everyone the same answer without people having to do real research, aka comparing sources, will absolutely happen.

                                    It’s like people can’t see data and extrapolate anymore.

                                    Can you not see the numerous ways that funneling all information through a single source like AI is a terrible idea?

                                    Hell off the top of my head, the consolidation of information to AI would easily let whatever company/govt that’s in charge change a narrative on a scale humanity has rarely or never seen.

                                      • ExLisper@lemmy.curiana.netEnglish
                                        15 hours

                                        Yes but that’s a completely different issue than the one the article describes.

                                • NotAnOtter@lemmus.orgEnglish
                                  2 days

                                  There are a lot of reasons to hate AI, I don’t really buy into this one. “New technology only captures a subset of knowledge” is just not a new issue, and fearmongering around it is not new either.

                                  I would be concerned about language collapse (i.e. models incrementally forget vocabulary + fail to adapt to new terms leading to language becoming incrementally worse) before I would worry about knowledge collapse, and I’m not that worries about language collapse.

                                    • NocturnalMorning@lemmy.worldEnglish
                                      2 days

                                      It’s a pretty obvious issue to anybody who cares to look.

                                      • yeahiknow3@lemmy.dbzer0.comEnglish
                                        2 days

                                        Well, unlike you, experts are worried. Consider how knowledge is gathered, stored, and disseminated. AI interferes with each of these steps in dramatic ways.

                                          • NotAnOtter@lemmus.orgEnglish
                                            2 days

                                            Fortunately I have media literacy and know that the existence of someone marketing a scary narrative doesn’t actually provide any credibility. I can read scary headlines and pass it through the “does the make sense?” filter before getting worried.

                                            I agree the friction + manipulation that LLMs introduce is troubling, but “knowledge collapse” is the extreme end of that concern.

                                              • Toga77@lemmy.worldEnglish
                                                21 hours

                                                “thing doesn’t work on me, therefore it’s the same for everyone or not a problem”.

                                                Fuckin classic lol.

                                                It’s wild when people like you act wise but expose the complete lack of worldview extremely fast.

                                            • AmbitiousProcess (they/them)@piefed.socialEnglish
                                              2 days

                                              I would be concerned about language collapse (i.e. models incrementally forget vocabulary + fail to adapt to new terms leading to language becoming incrementally worse) before I would worry about knowledge collapse

                                              Why so?

                                              The exact same mechanism is on display here. Ask an LLM for information, and it’s more likely to condense an answer, not display additional relevant information, and slowly but surely produce less and less outputs including that given information.

                                              Sources then begin to be generated by the AI model that adds less and less of that information over time, LLMs cite those new sources that don’t include that information, etc, etc, and now that information is just not present in a majority of sources, and is never stated in any LLM responses.

                                              If anything, this is more likely than models forgetting certain vocabulary, because while the underlying tokens for a lot of that vocabulary still exist in the model, the subsequent combinations for a given piece of information are substantially less likely, and the models’ finite size can only store a subset of that actual information in statistical averages. (i.e. you can store the alphabet and a dictionary of every word in the English language, and many simple phrases, in a tiny fraction of what the sum of Wikipedia is, and Wikipedia itself will contain a subset of all information on the internet, and so on, but you can still theoretically write any English content you’ll find on Wikipedia or the internet using that alphabet and dictionary)

                                            • Labna@lemmy.worldEnglish
                                              2 days

                                              Not since AI, it’s been since internet. No since national school. No, since religious teaching (this one is very dangerous). No since…

                                              You know what, screw this. Knowledge where never the issue, cause the easier the acces is, the less you make it, and if you never process what you understand, you end up a complete dumb with high knowledge. The only difference is that you can’t trust any knowledge from anywhere on the internet anymore.

                                                • yeahiknow3@lemmy.dbzer0.comEnglish
                                                  2 days

                                                  You are contradicting yourself. The first half of your comment seems to deny the deterioration of knowledge. The second half admits that “you can’t trust any knowledge from the internet anymore.”

                                                  So which is it? Is our relationship with technology epistemically suboptimal or not?

                                                Technology@lemmy.world

                                                technology@lemmy.world

                                                Subscribe from remote instance

                                                Create post

                                                Report community

                                                Modlog
                                                You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.world

                                                This is a most excellent place for technology news and articles.


                                                Our Rules


                                                1. Follow the lemmy.world rules.
                                                2. Only tech related news or articles.
                                                3. Be excellent to each other!
                                                4. Mod approved content bots can post up to 10 articles per day.
                                                5. Threads asking for personal tech support may be deleted.
                                                6. Politics threads may be removed.
                                                7. No memes allowed as posts, OK to post as comments.
                                                8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
                                                9. Check for duplicates before posting, duplicates may be removed
                                                10. Accounts 7 days and younger will have their posts automatically removed.

                                                Approved Bots


                                                • @L4s@lemmy.world
                                                • @autotldr@lemmings.world
                                                • @PipedLinkBot@feddit.rocks
                                                • @wikibot@lemmy.world
                                                Visibility: Public

                                                This community is visible to everyone.

                                                6.62K users / Day6.83K users / Week7.55K users / Month7.58K users / 6 months431 posts8.81K comments1 local subscriber88.3K subscribers
                                                Mods: L3s@lemmy.world
                                                • BE: 1.0.0-beta.2
                                                • Modlog
                                                • Instances
                                                • Docs
                                                • Code
                                                • join-lemmy.org