Yet another opinion on LLMs · Hasufell's blog

AshleyYakeley: > I have found them excellent for understanding new technologies (especially how to use package X with library Y in situation Z), general planning design and architecture, debugging and analysis (e.g. “why is this SQL query so slow and what are some alternative approaches”), code review, and a certain amount of code writing on existing projects. This might not apply to you. But in general if someone tells me they consider these tools to have “deep experience” it’s a huge red flag to me. Because this comes with a notion of competence these tools just can’t have today. Which in turn means that person will likely be far too trusting of the output those tools. Resulting in problems down the road. They sometimes make basic mistakes that really only an idiot would make. Sure it’s a very useful idiot for certain tasks. But elevating them to the status of “expert” seems highly problematic to me. I find it far more helpful to think of it as my “idiot bot” that’s hooked up to “all” the worlds knowledge. Because these tools already do far too much to make you trust their output, so calling it an idiot really only partially offsets the bias using them fosters within me.