RE: https://hachyderm.io/@benjamineskola/116656513183367271
This.💯
When you give an LLM instructions like “don’t make stuff up” the best you’re going to get is that the “make stuff up” machine will make stuff up that sounds a bit less like it’s making stuff up.
Getting people to treat them like they can actually think or understand instructions is all part of the con.
#TheOnlyWinningMoveIsNotToPlay
Quoting
LLM advocates still don’t seem to be able to comprehend that ordering the machine not to ‘make stuff up’ doesn’t help. It doesn’t know when it’s making stuff up, and it couldn’t change that even if you told it to. (In fact it’s always just making stuff up, and is only ever true by chance.)
Part of why I’m so negative about them is that their advocates simply do not understand how they work and do not seem to want to.
https://mas.to/@carnage4life/116653425489923041
Open quoted post