A while ago, some asshole with a blog noted:
But in professional life, there are many who are bad at either reading or writing (or both). This includes people with technical skills and hoity-toity degrees. Not mediocre, but bad. They have a hard time reading and understanding various texts, and their writing is both laborious and unintelligible. For them, I could see ‘AI’ being a godsend. AI is pretty good at being mediocre, and, often, that’s all that’s needed.
With that as prelude, we turn to the Occupation of Chicago (boldface mine):
The judge also revealed for the first time that one body-worn camera video captured an immigration agent using the AI tool ChatGPT to “compile a narrative for a report based on a brief sentence about an encounter and several images.”
“To the extent that agents use ChatGPT to create their use of force reports, this further undermines their credibility and may explain the inaccuracy of these reports when viewed in light of the BWC footage,” Ellis wrote.
At the very least, we should make it harder to engage in ‘testilying.’ But snark aside, this is an example of mediocre writing that LLMs could do–and part of that mediocrity includes errors, which, in the legal system, have real consequences.
