Talking to Objects in Natural Language: Toward Semantic Tools for Exploratory ProgrammingRemote
In exploratory programming, programmers often face a semantic gap between their high-level understanding and the low-level interfaces available for interacting with objects in a system. That is, technical object structure and behavior need to be interpreted as abstract domain concepts, which then increases cognitive load and thus impedes exploration progress. We propose semantic object interfaces that bridge this gap by enabling contextual, natural-language conversations with objects. Our approach leverages an exploratory programming agent powered by a large language model (LLM) to translate natural-language questions into low-level experiments and provide high-level answers. We describe a framework for integrating semantic object interfaces into existing exploratory programming systems, including a prototype implementation in Squeak/Smalltalk using GPT-4o. We showcase the potential of semantic object interfaces through case studies and discuss their feasibility, limitations, and impact on the programming experience. While challenges remain, our approach promises to reduce mental effort and empower programmers to explore and understand systems at a higher level of abstraction for a better programming experience.
Poster (semexp-paper-poster.pdf) | 453KiB |
Slides (semexp-paper-presentation.pdf) | 1.53MiB |
Fri 25 OctDisplayed time zone: Pacific Time (US & Canada) change
13:50 - 15:30 | |||
13:50 25mTalk | Talking to Objects in Natural Language: Toward Semantic Tools for Exploratory ProgrammingRemote Onward! Papers Christoph Thiede Hasso Plattner Institute, University of Potsdam, Germany, Marcel Taeumel University of Potsdam; Hasso Plattner Institute, Lukas Böhme Hasso Plattner Institute, University of Potsdam, Potsdam, Germany, Robert Hirschfeld Hasso Plattner Institute; University of Potsdam DOI Media Attached File Attached | ||
14:25 25mTalk | Active DSU: Dynamic Software Updates for Active Functions Onward! Papers DOI | ||
15:00 25mTalk | Source-level debugging of compiler-optimised code: ill-posed, but not impossible Onward! Papers DOI |