The Supreme Court of Colombia has started to impose restrictions on the use of artificial intelligence (AI) in legal proceedings and judicial decisions. Recently, the Court revoked a previous ruling that had been influenced by an AI-generated draft sentence, which had wrongly assessed evidence and fabricated hearing accounts that had never occurred. This decision marked a significant step in ensuring the integrity of the judicial process and protecting the rights of the defendants in legal cases.

In a groundbreaking case, the Supreme Court has fined a lawyer who utilized AI to draft an extraordinary review resource, aimed at challenging a previous decision. The Court's ruling stated that the AI system produced 'hallucinations,' which included fictitious jurisprudential citations. The lawyer not only failed to verify these inaccuracies in the initial submission of the resource, but also during its revision, until he eventually acknowledged the assistance he received from the AI tool.

This event reflects a growing concern regarding the integrity and reliability of legal documents generated by artificial intelligence. The fine imposed on the lawyer underscores the Court's commitment to ensuring that legal professionals adhere to standards of truthfulness and verification in their work, particularly as AI becomes more prevalent in legal settings. The implications of this ruling may set a precedent for the future use of AI in law, emphasizing a need for caution and rigorous verification of AI-assisted outputs.