LLMs as a Cognitive Virus

(arxiv.org)

74 points | by canjobear 1 hour ago

17 comments

  • dvt 0 minutes ago
    I just don't see that the main thrust of their argument: (oversimplified) "humans will become so dependent on AI, they'll become dumb" just doesn't hold any water. I mean even from an evolutionary standpoint, intelligence is (by far) our most valuable competitive advantage.

    It's like saying that moving from manual-labor-intensive agrarian societies to industrial ones will make us weak and meek. In fact, it's had the opposite effect: humans, on average, are healthier and live longer than ever in human history.

  • Murfalo 15 minutes ago
    I love this line of thinking but the framing comes across to me as a bit inflammatory and uncharitable. Just about anything involved in the exchanged of ideas can be viewed as a virus! That is because, when viewed from an evolutionary biology perspective, ideas are the cognitive equivalent of genes (in fact, this is where the term meme comes from).

    There's a whole field, evolutionary memetics, dedicated to this. Cultural values, marketing, religion, social media, education, propaganda, etc. can all be viewed quite naturally through this lense. Even the terms we use in every day language (eg, going "viral") seem to intuitively grasp this.

    Is my friend a virus for recommending me their favorite book? Well, yes I guess, but that's kind of just how ideas work. Just my two cents

    • cyanydeez 7 minutes ago
      Memes are what we are talking about.
  • Upvoter33 15 minutes ago
    Not sure why this is interesting; it seems like anything that becomes "popular" could be cast as a "virus", including things like "having a fridge". Why does this give particular insight?
    • E-Reverance 3 minutes ago
      Smart fridges are a pathological virus, yes /jk
  • SoStupid 4 minutes ago
    The wording alone is just so Idiocracy.

    What our descendants will think when they look back on this time period.

    They weren’t trying to solve aging or bring everyone to the highest standard of living, they didn’t care to connect the world, explore it, and find others.

    They wondered whether or not a word calculator was the antichrist. They assembled in the highest courts of the day and involved the most brilliant minds to discuss whether or not linear algebra will bring about Armageddon.

    They shunned any creative or productive endeavor which dared to automate tedium or build on the works of the public domain (lowercase)…

    for any any such indulgence had become a great sin in Eden, a forbidden fruit that must never be obtained by the Adam, so that he may not become as we are!

  • FailMore 2 minutes ago
    Because I am LLM Dependent I got distracted reading the article and made my LLM summarise it to me in a few slides. For those in a rush/interested in LLM summary slop:

    https://smalldocs.org/s/scB6O8KiZEmLWgK855A1vt#k=yiw8FB_G5Ld...

    I do agree that we are on a pathway to losing much. If you focusing on maximising LLM-powered productivity you basically lose the learning that used to naturally happen when doing actual work. At the company I work for the focus is on productivity, and it's easy in many ways (less mental workload and I receive more praise) to go with it instead of fight it.

  • Xmd5a 10 minutes ago
  • Suhinnall27 18 minutes ago
    LLMs are both a blessing and a curse, they magnificent tools for those who know how to employ them , but a crutch for those who rely on them.
    • dspillett 8 minutes ago
      And like a cult to those of us preferring not to engage, for whatever reason, with everyone and their dog telling us that we should (and sometimes getting quite offended, like our refusal to play that game is a personal attack on them for choosing to).
  • ionetan 23 minutes ago
    Leads me to think of a related topic, the Cost of Cognitive Debt. I think it is about time that we start to quantify what it means that we no longer grasp major parts of our systems and infrastructure. Once we quantify it, we can start to reason about how to address it.

    I explored this concept in this post:

    https://ljtn.github.io/epiq/blog/cost-of-cognitive-debt.html

  • techas 31 minutes ago
    Snow crash?
  • qarl2 17 minutes ago
    Ok... but are automobiles also a virus? Because we've become dependent on them? Should we also facilitate reversibility in our automobile usage?

    What about cooking food? We've become entirely dependent on cooking food.

    • pixl97 1 minute ago
      >Ok... but are automobiles also a virus?

      Yes.

      >Because we've become dependent on them?

      Because we're burning the planet down with them.

      >Should we also facilitate reversibility in our automobile usage?

      Yes, because in places we do people enjoy higher qualities of life and happiness. Along with things like health improvement from doing more excersize.

      >What about cooking food? We've become entirely dependent on cooking food.

      Moreso we've become dependent on eating processed junk over the past 50 years and gotten fat as shit.

      So yea, maybe think a little more deeply about your analogies?

      >What about cooking food? We've become entirely dependent on cooking food.

    • Retr0id 15 minutes ago
      > Should we also facilitate reversibility in our automobile usage

      Yes?

      • qarl2 13 minutes ago
        That's why I added the part about food. Or heck, computers. Or telephones. Or any incredibly useful technology.

        Toothbrushes! What will we do if we come to rely on toothbrushes??? The use of toothbrushes travels from person to person exactly like a virus!!!

  • calf 11 minutes ago
    I literally thought of this comparison last week. The problem I noticed was how my parents' generation lacked the cognitive "defenses" to separate AI social media content on YouTube, WhatsApp and the like from high quality information. The AI generated content does not trigger an "uncanny valley" reaction, and so people (I myself included) have greater difficulty immediately separating what information is genuine and what is synthetic, and then this spreads exponentially through social networks.
  • einpoklum 25 minutes ago
    > The viral analogy does not imply that LLM-human interactions are intrinsically parasitic.

    The analogy doesn't, but LLMs are trained on text, or content, generated by humans, with the aim of their output being acceptable to human interlocutors. That's one parasitic aspect. A second one is the nature and behavior of the organizational entities providing and promoting the popular LLM services: Microsoft, Google, Meta, Anthropic etc - their influence on the economy, e.g. in energy and water use and the drawing of capital/human efforts - also has a somewhat parasitic aspect.

    • varispeed 19 minutes ago
      > with the aim of their output being acceptable to human interlocutors.

      The more I use LLMs I find that their output drifts toward being acceptable to other LLMs. I find myself quite often telling the model: "this is not human readable.". Especially Opus and Fable write in such a way that it is difficult to follow. The often put sentences out of context, the context itself is fragmented. Often start with what you would think is end of a story so when you start reading you are like wtf it is about.

      If think the issue might be that LLMs read text all at once whereas humans are somewhat linear. So when LLM puts out text it understands, to human it is close to random gibberish that looks like English.

  • paufernandez 39 minutes ago
    My thesis advisor and team doing interesting work.
  • j45 28 minutes ago
    Have to take commentary by non tech folks speaking about tech with a grain of salt and perspective since the tech is changing so fast both in capability and application.

    Research can be more of a lagging indicator than a leading indicator with AI.

    • podgietaru 21 minutes ago
      I can't disagree enough with this. Not everything needs to be understood in a technical context. Technology intersects with society, and understanding its impacts on that society is vital.

      Or in other words: the humanities are good.

    • djeastm 26 minutes ago
      It helps to have outside observers looking at the effects of a new technology and industry and not just depending on those within it to report for us.
    • tptacek 28 minutes ago
      They're specifically not using the term "virus" pejoratively, but rather distinguishing the social mechanism LLMs seem to have from something as simple as a "meme".
      • Avicebron 24 minutes ago
        Contagion probably is more accurate.
        • tptacek 10 minutes ago
          Well, a meme is contagious, but it doesn't do the same work a virus can at altering the structure of its host.
          • Avicebron 2 minutes ago
            I'm actually not too sure about that, I guess if you dig into it, language is a "meme" on some level. And every language you are "thinking" in tends to frame the world a little differently.

            All memes are viruses but not all viruses are memes?

        • grebc 8 minutes ago
          STD outbreak maps better.
  • CityOfThrowaway 17 minutes ago
    Zero surprise this is coming from a European institution. The continent is destined to be left behind.
    • canjobear 10 minutes ago
      It is a collaboration across many institutions including those from Europe, the US, and Japan
    • mentalgear 16 minutes ago
      [dead]
  • tylerchilds 22 minutes ago
    If this is interesting, message me about my “elves”

    They are the cognitive construct I fortified in my mind and in my code before the models began producing their own training materials. My approach is based on two decades of coding without ai.

    The immunization is becoming increasingly more valuable as people begin understanding the market in which I do business.