4 ms·

> all of the extra information that comes with being visual I think the key is to not make everything visual. You want to be able to view your system as you wo

> all of the extra information that comes with being visual I think the key is to not make everything visual. You want to be able to view your system as you would draw it on a whiteboard. I believe it could be done using a restricted syntax of a proglang. > Teams I've been close to lately have taken the python pill... Most people have a desired result and want it as fast as possible. When imperatively using map, groupBy, filter, you can usually get the immediate result you want very quickly. This is the appeal of Pandas, Python notebooks, etc. But when someone asks: I want to re-compute on change, which pretty much applies to every task...their quick solution is not optimal. And then if the schema changes, and you're doing all this intermediary stuff...then refactoring is next to impossible. Any SQL query could also be written in an imperative prog lang and its probably easier to understand and tweak and also trace. An SQL relation does not maintain any info about its source, which then makes incremental updates difficult, and also refactoring. You can basically ask the question: for every piece of data you see in your company, can you easily see the "data lineage" from its source and all the transformations it was involved in, and how clean and efficient is this pipeline when receiving new data. Then a step further is, how easy is it to change something.

taeric 4y ago
The problem with, "as you would draw it on a whiteboard," is that much of what makes whiteboard drawings useful is his much you omit. Such that I agree being able to visualize things is nice. But don't confuse the visualization with the system. A step you have to make in many visual tools. I'm pretty much agreed on most of what you wrote, though.
- vaughan 4y ago
  > But don't confuse the visualization with the system. I think this is where people have got it wrong in the past. This tool is an example of something in the right direction: https://www.ilograph.com/ https://www.ilograph.com/ It's just completely disconnected from code.
  - taeric 4y ago
    Agreed that I think that is where folks go wrong. And the very valid counter claim from folks that do some of this is that there needs to be some mechanism to keep things synchronized between the visualization and the execution.

taeric 4y ago

The problem with, "as you would draw it on a whiteboard," is that much of what makes whiteboard drawings useful is his much you omit. Such that I agree being able to visualize things is nice. But don't confuse the visualization with the system. A step you have to make in many visual tools. I'm pretty much agreed on most of what you wrote, though.

vaughan 4y ago
> But don't confuse the visualization with the system. I think this is where people have got it wrong in the past. This tool is an example of something in the right direction: https://www.ilograph.com/ https://www.ilograph.com/ It's just completely disconnected from code.
- taeric 4y ago
  Agreed that I think that is where folks go wrong. And the very valid counter claim from folks that do some of this is that there needs to be some mechanism to keep things synchronized between the visualization and the execution.