There will be times when the struggle seems impossible. Alone, unsure, dwarfed by the scale of the enemy. Freedom is a pure idea. It occurs spontaneously and without instruction. Random acts of insurrection are occurring constantly. There are whole armies, battalions that have no idea that they’ve already enlisted in the cause. And even the smallest act of insurrection pushes our lines forward. Tyranny requires constant effort. It breaks, it leaks. Authority is brittle. Oppression is the mask of fear.

  • 0 Posts
  • 617 Comments
Joined 3 years ago
cake
Cake day: March 3rd, 2024

help-circle














  • My mind is still blown in how words and concepts can be translated into high dimensional vertexes and through the math of their position and direction retain their meanings, and even be changed into the correct alternate versions by doing calculations on them. That doesn’t mean the vectors understand what they represent, but there’s some core level of meaning there. Same with LLMs. No thinking, they screw up stuff that a reasoning being would figure out. Yet there’s something in even the simplest local model that is far more than just autocompleting sentences. That is part of the mechanics, but not nearly enough to describe it.


  • I think that would depend on the knowledge the subject had before entering the testing scenario

    That was my main point on this test being an interesting question starter, but not being conclusive enough because we don’t know. The subjects were purposefully random and not evaluated before the test.

    fractions because it’s something that everyone who’s gone through the public education system should know

    Yes, well. I don’t think I need to comment on how bad the US system has become. I wonder how much higher the assisted people did while they had the help compared to others?



  • They weren’t measuring the math ability levels, but the changes in what those skills were per individual. But for the assisted ones, we don’t know what they started with, so there’s no base level to compare. If they’re comparing them with the others, then that’s a problem in the study since we’re not measuring their math abilities.

    What would a companion study reveal that does the same thing for the math part but just offers calculators instead? Probably the same? If it was dramatically different then there’d be a case that LLMs are affecting the result in some other way and it’s not just the human nature of leaning on what they lost. Or what if that person had a tutor/help with them but they left for the rest of the test? Should be similar results, right?


  • As I’ve said before, the abilities of the ones with ChatGPT assist don’t seem to be known, as they started off with help. The assumption is that they might on average be the same as the others, but we don’t know that. A simple fix to start is to offer the LLM help in the middle of the test for them, see how the curve of ability goes up and down, and compare before and after.

    Not answering the rest, I was more interested in the study and what it was claiming and not arguing about missing context of commentary. I think the study may be right in suggesting people today have more trouble understanding things than they used to, but it’s far deeper and older than LLMs. They are just the latest part of the bigger problem.