Direct Manipulation and Natural Language Programming, Together at Last?
What it is
This paper introduces a framework that unifies direct manipulation and natural language programming by treating programs as sequences of structured edits. It uses an edit language as a shared interface, leveraging constrained decoding for natural language inputs, and instantiates this in a variant of the cartokit system.
The problem it solves
The rapid growth of natural language programming reinforces a view of programs as unstructured text, ignoring decades of research on direct manipulation and structure editing, leading to a lack of unified systems that bridge these approaches.
What you could use it for
- Developing unified programming environments that support both visual and text-based editing
- Researching user preferences between direct manipulation and natural language interfaces
- Designing constrained decoding strategies for program synthesis
Read the source ↗Back to the library →
Summary written by an AI model from the source; check the source before you rely on it.