Large Language Models for Executable Tax Code Generation
The domain-specific language (DSL) Catala provides a way of formalizing legislative texts in order to write correct-by-construction implementations and resolve potential ambiguities. Motivated by their success in code generation domains, we propose using LLMs to generate executable Catala code to answer legal questions about the tax code. While we find that documentation and various prompting strategies can improve the compilation rate of LLM-generated Catala programs, we observe many difficulties with reasoning about the tax code, whose meaning is highly contextual. In response, we design Dagger, a new DSL that implicitly handles context in a way more akin to the way context is used in natural language and legal documents. We hypothesize this will create opportunities to further explore and improve the translation of legal documents into executable code.
Tue 22 OctDisplayed time zone: Pacific Time (US & Canada) change
11:00 - 12:30 | Author Presentations with DiscussantsProLaLa at IBR East Chair(s): Sarah Lawsky Northwestern University Four presenters will share work they’ve submitted that is either already published elsewhere or in progress. Two discussants will lead a conversation about the works. Presentation of short papers will be followed by a discussion prompt corresponding to a question or topic for which the authors are specifically requesting feedback. | ||
11:00 20mTalk | Metamorphic Debugging for Accountable Software ProLaLa Saeid Tizpaz-Niari University of Texas at El Paso, Shiva Darian University of Colorado Boulder, Ashutosh Trivedi University of Colorado Boulder Pre-print | ||
11:20 10mTalk | Large Language Models for Executable Tax Code Generation ProLaLa | ||
11:45 20mTalk | Cross-Disciplinarity in Contemporary Code-Driven Legal Informatics ProLaLa | ||
12:05 10mTalk | CUTECat: Generating Testcases for Fiscal Laws through Concolic Execution ProLaLa Pierre Goutagny Inria and University of Lille, Aymeric Fromherz Inria, Raphaël Monat Inria and University of Lille |