• baltakatei@sopuli.xyz
    link
    fedilink
    arrow-up
    1
    ·
    4 months ago

    “Create a python script to count the number of r characters are present in the string strawberry.”

    The number of 'r' characters in 'strawberry' is: 2
    

  • glimse@lemmy.world
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    4 months ago

    Copilot may be a stupid LLM but the human in the screenshot used an apostrophe to pluralize which, in my opinion, is an even more egregious offense.

    It’s incorrect to pluralizing letters, numbers, acronyms, or decades with apostrophes in English. I will now pass the pedant stick to the next person in line.

    • Beanie@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      4 months ago

      That’s half-right. Upper-case letters aren’t pluralised with apostrophes but lower-case letters are. (So the plural of ‘R’ is ‘Rs’ but the plural of ‘r’ is ‘r’s’.) With numbers (written as ‘123’) it’s optional - IIRC, it’s more popular in Britain to pluralise with apostrophes and more popular in America to pluralise without. (And of course numbers written as words are never pluralised with apostrophes.) Acronyms are indeed not pluralised with apostrophes if they’re written in all caps. I’m not sure what you mean by decades.

      • Mouselemming@sh.itjust.works
        link
        fedilink
        arrow-up
        2
        ·
        4 months ago

        By decades they meant “the 1970s” or “the 60s”

        I don’t know if we can rely on British popularity, given y’all’s prevalence of the “greengrocer’s apostrophe.”

        • bisby@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 months ago

          Because otherwise if you have too many small letters in a row it stops looking like a plural and more like a misspelled word. Because capitalization differences you can make more sense of As but not so much as.

          • psud@aussie.zone
            link
            fedilink
            arrow-up
            2
            ·
            4 months ago

            As

            That looks like an oddly capitalised “as”

            That really gives the reason it’s acceptable to use apostrophes when pluralising that sort of case

    • Melvin_Ferd@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      4 months ago

      English is a filthy gutter language and deserves to be wielded as such. It does some of its best work in the mud and dirt behind seedy boozestablishments.

  • schnurrito@discuss.tchncs.de
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    4 months ago

    This is hardly programmer humor… there is probably an infinite amount of wrong responses by LLMs, which is not surprising at all.

      • KairuByte@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        0
        ·
        4 months ago

        Eh

        If I program something to always reply “2” when you ask it “how many [thing] in [thing]?” It’s not really good at counting. Could it be good? Sure. But that’s not what it was designed to do.

        Similarly, LLMs were not designed to count things. So it’s unsurprising when they get such an answer wrong.

        • Rainer Burkhardt@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          4 months ago

          I can evaluate this because it’s easy for me to count. But how can I evaluate something else, how can I know whether the LLM ist good at it or not?

          • KairuByte@lemmy.dbzer0.com
            link
            fedilink
            arrow-up
            1
            ·
            4 months ago

            Assume it is not. If you’re asking an LLM for information you don’t understand, you’re going to have a bad time. It’s not a learning tool, and using it as such is a terrible idea.

            If you want to use it for search, don’t just take it at face value. Click into its sources, and verify the information.

    • Matriks404@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      4 months ago

      That’s one example when LLMs won’t work without some tuning. What it does is probably looking up information of how many Rs there are, instead of actually analyzing it.

      • exocortex@discuss.tchncs.de
        link
        fedilink
        arrow-up
        1
        ·
        4 months ago

        It cannot “analyze” it. It’s fundamentally not how LLM’s work. The LLM has a finite set of “tokens”: words and word-pieces like “dog”, “house”, but also like “berry” and “straw” or “rasp”. When it reads the input it splits the words into the recognized tokens. It’s like a lookup table. The input becomes “token15, token20043, token1923, token984, token1234, …” and so on. The LLM “thinks” of these tokens as coordinates in a very high dimensional space. But it cannot go back and examine the actual contents (letters) in each token. It has to get the information about the number or “r” from somewhere else. So it has likely ingested some texts where the number of "r"s in strawberry is discussed. But it can never actually “test” it.

        A completely new architecture or paradigm is needed to make these LLM’s capable of reading letter by letter and keep some kind of count-memory.

        • pyre@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          4 months ago

          the sheer audacity to call this shit intelligence is making me angrier every day

          • VirtualOdour@sh.itjust.works
            link
            fedilink
            arrow-up
            0
            ·
            4 months ago

            That’s because you don’t have a basic understanding of language, if you had been exposed to the word intelligence in scientific literature such as biology textbooks then you’d more easily understand what’s being said.

            ‘Rich in nutrients?! How can a banana be rich when it doesn’t have a job or generational wealth? Makes me so fucking mad when these scientists lie to us!!!’

            The comment looks dumb to you because you understand the word ‘rich’ doesn’t only mean having lots of money, you’re used to it in other contexts - likewise if you’d read about animal intelligence and similar subjects then ‘how can you call it intelligence when it does know basic math’ or ‘how is it intelligent when it doesn’t do this thing literally only humans can do’ would sound silly too.

            • pyre@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              4 months ago

              this is not language mate, it’s pr. if you don’t understand the difference between rich being used to mean plentiful and intelligence being used to mean glorified autocorrect that doesn’t even know what it’s saying that’s a problem with your understanding of language.

              also my problem isn’t about doing math. doing math is a skill, it’s not intelligence. if you don’t teach someone about math they’re most likely not going to invent the whole concept from scratch no matter how intelligent they may be. my problem is that it can’t analyze and solve problems. this is not a skill, it’s basic intelligence you find in most animals.

              also it doesn’t even deal with meaning, and doesn’t even know what it says means, and doesn’t even know whether it knows something or not, and it’s called a “language model”. the whole thing is a joke.