4 ms·
Is there progress on general structured/relational/graphed data modalities? In practice, you spend time and expertise to reform the data into previously-known-
by algo_trader 5y ago
Is there progress on general structured/relational/graphed data modalities?
In practice, you spend time and expertise to reform the data into previously-known-to-work form.
FWIW, our datasets are huge, with dense data/noise ratio.
- zmgsabst 5y agoCan you clarify a little bit on what you mean by your question? One area of research is extracting an effective type theory from data that is viewed as a semantic model, eg sensor data of a phenomenon would lead to a type theory describing it. You’re essentially taking a TDA persistent homology/covering and reinterpreting that through the lens of homotopy type theory to “decompile” your data. There’s some early results, eg connecting convolutions and type division. But that’s overall at really early stages of research.
- enchiridion 5y agoAny papers cover this?
- zmgsabst 5y agoNone published; I’m working on a white paper about type division in the abstract case this quarter, once I finish up the second one on shape algebras. Type division is like convolution from ML, which is why we can recognize “shapes of shapes” and undo the product structure. (And arguably, another avenue towards arriving at the manifold hypothesis.) I’m currently working on the “easy” direction of encoding the type statements to matrices, with the hope most steps are reversible. (So far, so good.) Still rough white paper: https://www.zmgsabstract.com/whitepapers/shapes-as-digital-images https://www.zmgsabstract.com/whitepapers/shapes-as-digital-i... GitHub repo for encoding type theory models, still VERY early: https://github.com/zmgsabstract/mathengine https://github.com/zmgsabstract/mathengine
- algo_trader 5y ago> effective type theory from data that is viewed as a semantic model, Well, much simpler stuff. You have a logistic dataset of objects/GPS/time. Fine. Now you add historic truck data which is location time series. If is not obvious how you can learn the delivery times between 2 items. You need human expertise, and design a way to extract usable routes, and also solve multi-hop routes, and then maybe you can learn typical speed between 2 items. It is doable. But it not with a generic "multi-modal architecture".
- zmgsabst 5y agoNaively, it sounds like the same problem — you’d want some kind of sheaf on your data to evaluate rules. Detecting routes sounds like a persistent homology problem — and then you’re detecting flow across that inferred structure. I think Michael Robinson has work in that area: https://www.youtube.com/watch?v=b1Wu8kTngoE https://www.youtube.com/watch?v=b1Wu8kTngoE