3 ms·
It's software, everything is possible :) It is fairly straightforward to add compile time information via a simple case class definition. There is still a dynam
by pacala 11y ago
It's software, everything is possible :) It is fairly straightforward to add compile time information via a simple case class definition. There is still a dynamic type check that json matches the case class, but the spec of the structure of the data is done in one place, not spread out arbitrarily over the query code base.
- threeseed 11y agoDynamic type checks are actually pretty damn useful. For example the MongoDB adapter samples the data at runtime to determine what the DataFrame definition i.e. types is.
- rxin 11y agoThat part is actually coming: https://github.com/apache/spark/pull/5713 https://github.com/apache/spark/pull/5713