4 ms·
I follow the GUI development space out of curiosity. I have made a few GUIs in Java Swing toolkit and I enjoyed it. When I did GUIs in Android native, I didn't
by samsquire 3y ago
I follow the GUI development space out of curiosity. I have made a few GUIs in Java Swing toolkit and I enjoyed it.
When I did GUIs in Android native, I didn't enjoy it at all.
I have loosely played with Qt Quick but I didn't know C++ so I was clueless how to encode user behaviour into a program that implemented the behaviour. My immediate mode Javascript canvas work is far simpler.
LLMs are already generating web GUIs (such as vercel's v0 and others) and we can encode mapping of current state tokens to next behaviour tokens. Hopefully we can specify all the interactions and what should happen due to them.
React vdom refreshes the whole tree changed nodes for recomputation, LLMs could generate the new tree and use an animating library to transform between states - the difference in the trees.
Immediate mode GUIs lend themselves well to this; you just generate/rerender everything.
What I'm interested in is a novel desktop paradigm alternative to windows, mousing and drag and drop.
Intellisense and LSP lets us see the types of what an operation has. But computer GUIs are inherently synchronous unless you're writing a script or program. I would like to click through operations and transform and map from one kind of things to another type of things. This would queue operations up and the computer can schedule them efficiently.
Haskells knows the type of a pipeline at each stage of processing.
I would like to do "algebra with behaviour" and have built in transformations such as joins, swapping, queries and scheduling. If you can map a problem into something you understand based on position, you can do algebraic transformations between states such as binpacking or path finding.
"Break these files into batches, compress+encrypt them, keep them synchronized between these machines and back them up"
- CyberDildonics 3y agoIs this an LLM comment? It has basically nothing to do with the topic and seems incoherent even between paragraphs.
- samsquire 3y agoIt is not an LLM comment. I am interested in immediate mode GUIs but I think we need a different paradigm for GUIs that is less synchronous from a user perspective. Encoding behaviour in GUI code is complex due to state management and complexity. See jQuery. In most GUIs as a user you do an operation and wait for it to complete (direct manipulation). You can't queue operations unless you code. I haven't seen macro recording done well.