bgavran

5 ms·

1.
by bgavran 5mo ago
There is an existing implementation validating this idea, and the plan is to make it publicly available at some point. > It seems to me that such an idea would be workable on a given language with a given type system, but it seems to me
2.
by bgavran 5mo ago
There's been some exciting work generalising transformers to data structures that aren't just pure arrays: https://glaive-research.org/2025/02/11/Generalized-Transform... I've implemented these
3.
by bgavran 5mo ago
Author here - thanks for engaging. > One way to think of the bitter lesson as it applies to generative models is that ~all data carries some information about the structure of reality Completely agree. It might have not come across, but
4.
by bgavran 5mo ago
A coproduct in the category Set is a disjoint union of sets, i.e. A + B + C where A, B, C are sets. We can think of this coproduct as involving two choices: 1) a choice of which component of the coproduct we're interested in (first, se
5.
by bgavran 5mo ago
Author here - thanks for engaging. On existing techniques - Type-Constrained Generation paper is discussed in the blog post (under Constrained Decoding), and I'd group typed holes in the same bucket. The problem with those methods is t
6.
Types and Neural Networks(brunogavranovic.com)
83 points by bgavran 5mo ago|27 comments
7.
by bgavran 1y ago
This is an interesting writeup, I wonder if the authors considered a categorical approach to representation of general applicative arrays (which might be tree-shaped), as described here ( https://www.cs.ox.ac.uk/people/j
8.
by bgavran 1y ago
Indeed, the author seems to have a misunderstanding about both undecidability and complexity as they pertain to dependent types. Dependent types do not add complexity to our system, they reveal it. Case in point: here is a fully dependent
9.
by bgavran 2y ago
"Anybody can share a sucess story of using a car to go places I couldn't have gone on foot"? CT is a language and a tool, meaning anything you can say in the language of CT you can say in other languages. Like cars, if you le
10.
Towards Categorical Foundations of Learning(brunogavranovic.com)
3 points by bgavran 3y ago|0 comments
11.
by bgavran 4y ago
There's a well-articulated essay from Christopher Olah that captures the undercurrent, and perhaps even the motivation of many of these papers https://colah.github.io/posts/2015-09-NN-Types-FP/ You're co
12.
by bgavran 4y ago
It's also meant to suggest where things are going (the kind of a chart I have in mind is this one https://twitter.com/bgavran3/status/1422206118688956420 ), though I understand this is something that deserves
13.
by bgavran 4y ago
OP here. The exponential growth in CS publication is much faster. This repository is simply a testament that CT is slowly ramping up. It's meant to show what kind of expressive power and breadth current CT models have, which to my kn
14.
Category Theory ∩ Machine Learning(github.com)
118 points by bgavran 4y ago|69 comments