3 ms·
We use arrow to do the validation 'for free': it has a typed columnar schema, so by passing the schema, we get the recordset validation without inspecting value
by lmeyerov 6y ago
We use arrow to do the validation 'for free': it has a typed columnar schema, so by passing the schema, we get the recordset validation without inspecting values.
we still need to do semantic validation, but w/ arrow, now we do that in bulk and on gpus :)