When I was asked to beta test its AI research bot, I informed a major legal research provider that it worse than sucked. It was dangerous. Not only did it hallucinate, which could be ascertained with minimal fact checking, but it conflated almost all the critical distinctions that make law work. It failed to distinguish between jurisdictions, both states and state and federal, as well as majority, concurrences and dissents. To AI, it was all the same, words about law, all of which melded into one amorphous mass of misbegotten but seemingly accurate “law.”
It will improve, I was told. Perhaps, but enough that it can be relied upon to tell us who wins and loses? Continue reading →