Are those studies in the context of software development? What are the tasks at hand? Do they evaluate critical thinking on matters that people actually care about or on chores? Were they instructed to use LLMs in a particular way that is equivalent to their personal preference?
You can’t pull a wildcard saying something like that because it’s too broad of a conclusion.
This is where you go look at any of the studies and start figuring out for yourself.
They’ve been looking at it in several contexts including software development, general problem solving, reading comprehension, writing ability, and more.
In some they were instructed to use LLMs certain ways, in others they weren’t. That’s the neat thing about so many studies being done is they’ve used a wide set of methodologies.
well, you didn’t link any and you’re the one generalizing it, so the proof is on you to provide. I doubt their conclusions are like you’re making them sound.
Their conclusions are right in the abstract in black and white terms. And this is just a teeny tiny sample of the papers that exist all saying the same thing.
Are those studies in the context of software development? What are the tasks at hand? Do they evaluate critical thinking on matters that people actually care about or on chores? Were they instructed to use LLMs in a particular way that is equivalent to their personal preference?
You can’t pull a wildcard saying something like that because it’s too broad of a conclusion.
This is where you go look at any of the studies and start figuring out for yourself.
They’ve been looking at it in several contexts including software development, general problem solving, reading comprehension, writing ability, and more.
In some they were instructed to use LLMs certain ways, in others they weren’t. That’s the neat thing about so many studies being done is they’ve used a wide set of methodologies.
well, you didn’t link any and you’re the one generalizing it, so the proof is on you to provide. I doubt their conclusions are like you’re making them sound.
I didn’t link any because the internet exists. Spend literally five seconds on google.
https://www.mdpi.com/2075-4698/15/1/6
https://arxiv.org/abs/2506.08872
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=6097646
Their conclusions are right in the abstract in black and white terms. And this is just a teeny tiny sample of the papers that exist all saying the same thing.
Yeah, they never are. Scientific conclusions are generally a lot more nuanced and cautious than what this guy’s claiming. He only read headlines.