3 ms·

No Clojure. No Julia. No Haskell. No Racket. No Scheme. No Common Lisp. No OCaml. And, as much as I despise Microsoft, No C#. No F#. No Swift. No Object

No Clojure. No Julia. No Haskell. No Racket. No Scheme. No Common Lisp. No OCaml. And, as much as I despise Microsoft, No C#. No F#. No Swift. No Objective-C. No Perl. No Datalog. A glaringly lacking choice of languages.

ebiester 3y ago
I'm sure that has to do with the dataset available to them.
- runnerup 3y ago
  Which is a deduplicated version of this: https://www.bigcode-project.org/docs/about/the-stack/ https://www.bigcode-project.org/docs/about/the-stack/ And probably, yes. While it contains 358 programming languages, obviously there's a long tail after the 20 most-represented languages. Some people might not expect without thinking about it for a bit that many of the most-represented "languages" are actually things like JSON, XML, HTML, CSV, text, markdown, YAML, SVG. Also note that it won't be able to parse natural language nearly as well without additionally being trained on something like the LAION dataset, so this version will be more of an autocomplete like Copilot rather than something which can manifest high level business logic from whole cloth like ChatGPT.
Dayshine 3y ago
C# was available in the dataset they link, and is the most glaring ommission by global usage...
ubertaco 3y ago
I fed it some OCaml and it worked, though the example was trivial: type point = { x: int; y : int } let manhattan_distance (a: point) (b: point) : int = which it completed to type point = { x: int; y : int } let manhattan_distance (a: point) (b: point) : int = abs (a.x - b.x) + abs (a.y - b.y) ...which is a valid and correct OCaml definition of this method: https://try.ocamlpro.com/#code/type'point'='$4'x:'int;'y':'int'$6!let'manhattan_distance'(a:'point)'(b:'point)':'int'=!abs'(a.x'-'b.x)'+'abs'(a.y'-'b.y)!;;!!let'origin'='$4x'='0;'y'='0$6'in!let'dest'='$4x'='2;'y'='3$6'in!Printf.printf'$($+d$('(manhattan_distance'origin'dest) https://try.ocamlpro.com/#code/type'point'='$4'x:'int;'y':'i...
mclide 3y ago
Despite the lack of examples, it still completes trivial clojure like "(defn connect [" and other lisp syntax like "(define (hello" which is promising for further refinement training on Lisp languages.
sitkack 3y ago
You could take it and finetune it on a bunch of Lisps, probably cost on the order of 50-500 to do that.
- swyx 3y ago
  if anyone from MosaicML is reading this, i’d love a guide on how to do exactly this!
esjeon 3y ago
I hate to admit, but Python, C, Java, and JS cover most of the modern programming. But not supporting C# sounds like a bad idea.

ebiester 3y ago

I'm sure that has to do with the dataset available to them.

runnerup 3y ago
Which is a deduplicated version of this: https://www.bigcode-project.org/docs/about/the-stack/ https://www.bigcode-project.org/docs/about/the-stack/ And probably, yes. While it contains 358 programming languages, obviously there's a long tail after the 20 most-represented languages. Some people might not expect without thinking about it for a bit that many of the most-represented "languages" are actually things like JSON, XML, HTML, CSV, text, markdown, YAML, SVG. Also note that it won't be able to parse natural language nearly as well without additionally being trained on something like the LAION dataset, so this version will be more of an autocomplete like Copilot rather than something which can manifest high level business logic from whole cloth like ChatGPT.

Dayshine 3y ago

C# was available in the dataset they link, and is the most glaring ommission by global usage...

ubertaco 3y ago

I fed it some OCaml and it worked, though the example was trivial: type point = { x: int; y : int } let manhattan_distance (a: point) (b: point) : int = which it completed to type point = { x: int; y : int } let manhattan_distance (a: point) (b: point) : int = abs (a.x - b.x) + abs (a.y - b.y) ...which is a valid and correct OCaml definition of this method: https://try.ocamlpro.com/#code/type'point'='$4'x:'int;'y':'int'$6!let'manhattan_distance'(a:'point)'(b:'point)':'int'=!abs'(a.x'-'b.x)'+'abs'(a.y'-'b.y)!;;!!let'origin'='$4x'='0;'y'='0$6'in!let'dest'='$4x'='2;'y'='3$6'in!Printf.printf'$($+d$('(manhattan_distance'origin'dest) https://try.ocamlpro.com/#code/type'point'='$4'x:'int;'y':'i...

mclide 3y ago

Despite the lack of examples, it still completes trivial clojure like "(defn connect [" and other lisp syntax like "(define (hello" which is promising for further refinement training on Lisp languages.

sitkack 3y ago

You could take it and finetune it on a bunch of Lisps, probably cost on the order of 50-500 to do that.

swyx 3y ago
if anyone from MosaicML is reading this, i’d love a guide on how to do exactly this!

esjeon 3y ago

I hate to admit, but Python, C, Java, and JS cover most of the modern programming. But not supporting C# sounds like a bad idea.