12 ms·
A good GenerativeUI product depends on a datasource for the AI to have some working history to make decisions about what kind of interface to show a user. An A
by hansonkd 3y ago
A good GenerativeUI product depends on a datasource for the AI to have some working history to make decisions about what kind of interface to show a user.
An A/B test needs thousands of samples in some cases to make a determination about which is preferred. A generative UI would be like running 100 simultaneous a/b tests for your users.
I would think you would need a significant amount of traffic on the order of millions of users to be able to determine to some degree that one UI configuration is better for a particular type of user.
Without the data to know what works the AI will essentially just be randomly generating UIs for each user.
Defining an outcome is actually one of the hardest problems in AI and even in organizations. While you think startups can easily just say "make the UI that gets the most revenue" that isn't necessarily true. For example if a terrible user experience results in more short term revenue but your users die out, that isn't a good outcome for the company. Or maybe you have a free tier that you want people to use for network effect, etc.
So it is very hard to have a single number to use for outcome. If every user has a different UI, then it also becomes hard to spot things that go against the company's interests, etc.