7 ms·

Sorry, but I can't understand what this actually is. A library, a stand-alone tool, a Rust crate? What users does it target? Text editors, website creators?

by teo_zero 10mo ago

Rodmine 10mo ago
Not for you then. You don't need to understand everything.
jasonjmcghee 10mo ago
GitHub repo is a bit more helpful, but users or building of text editors that use tree-sitter. Or... website text editors which historically have had imperfect syntax highlighting. Notice the Zed sponsorship. https://github.com/bearcove/arborium https://github.com/bearcove/arborium
- tombh 10mo ago
  > Batteries-included tree-sitter grammar collection with HTML rendering and WASM support. That's the best one sentence description there is and it's at the top of the Github README. I think that would fit nice at the top of https://arborium.bearcove.eu https://arborium.bearcove.eu too
joshka 10mo ago
See https://fasterthanli.me/articles/my-gift-to-the-rust-docs-team https://fasterthanli.me/articles/my-gift-to-the-rust-docs-te...
discord9 10mo ago
I think this gives some context?:https://fasterthanli.me/articles/my-gift-to-the-rust-docs-team https://fasterthanli.me/articles/my-gift-to-the-rust-docs-te... TLDR: for rust doc highlighting stuff in document
GolDDranks 10mo ago
It's a Rust library (comprised of a bunch of crates) that wraps a high-performance, high-accuracy syntax highlighter (called Tree-sitter) with vetted support for almost 100 programming/markup languages. You can use it as a normal Rust library, or you can use the JavaScript/WASM wrapper to highlight source code on a web page.
- oersted 10mo ago
  > high-accuracy syntax highlighter (called Tree-sitter) Just wanted to note that tree-sitter is lower-level and more general: it's an incremental parser that is specialised for gracefully and efficiently parsing partially-correct code snippets or code being edited live. It's an important building block of the highlighter, but it needs more on top to complete the package. It can be used for anything that requires awareness of code structure in an editor.
  - GolDDranks 10mo ago
    Thanks for the correction!
  - debugnik 10mo ago
    If only it were usable for really-correct parsing. In my experience error recovery is so aggressive it will accept broken ASTs without marking any node as an error. Plus, you can't really solve some ambiguities without C-based lexer hacks. I wonder if targeting the Tree-sitter ABI directly could be a viable way to write more accurate parsers in an actual programming language while piggybacking on the ecosystem. Could tree-sitter's runtime ABI be adapted for GLL parsers instead of GLR? I haven't looked deep into it yet.
    - conartist6 10mo ago
      Now you're in my wheelhouse! Come check out https://github.com/bablr-lang/ https://github.com/bablr-lang/. I'm gearing up for a big release announcement here once I fix these bugs and ship all the latest code.
- 10mo ago

Sorry, but I can't understand what this actually is. A library, a stand-alone tool, a Rust crate? What users does it target? Text editors, website creators?

Rodmine 10mo ago

Not for you then. You don't need to understand everything.

jasonjmcghee 10mo ago

GitHub repo is a bit more helpful, but users or building of text editors that use tree-sitter. Or... website text editors which historically have had imperfect syntax highlighting. Notice the Zed sponsorship. https://github.com/bearcove/arborium https://github.com/bearcove/arborium

tombh 10mo ago
> Batteries-included tree-sitter grammar collection with HTML rendering and WASM support. That's the best one sentence description there is and it's at the top of the Github README. I think that would fit nice at the top of https://arborium.bearcove.eu https://arborium.bearcove.eu too

joshka 10mo ago

See https://fasterthanli.me/articles/my-gift-to-the-rust-docs-team https://fasterthanli.me/articles/my-gift-to-the-rust-docs-te...

discord9 10mo ago

I think this gives some context?:https://fasterthanli.me/articles/my-gift-to-the-rust-docs-team https://fasterthanli.me/articles/my-gift-to-the-rust-docs-te... TLDR: for rust doc highlighting stuff in document

GolDDranks 10mo ago

It's a Rust library (comprised of a bunch of crates) that wraps a high-performance, high-accuracy syntax highlighter (called Tree-sitter) with vetted support for almost 100 programming/markup languages. You can use it as a normal Rust library, or you can use the JavaScript/WASM wrapper to highlight source code on a web page.

oersted 10mo ago
> high-accuracy syntax highlighter (called Tree-sitter) Just wanted to note that tree-sitter is lower-level and more general: it's an incremental parser that is specialised for gracefully and efficiently parsing partially-correct code snippets or code being edited live. It's an important building block of the highlighter, but it needs more on top to complete the package. It can be used for anything that requires awareness of code structure in an editor.
- GolDDranks 10mo ago
  Thanks for the correction!
- debugnik 10mo ago
  If only it were usable for really-correct parsing. In my experience error recovery is so aggressive it will accept broken ASTs without marking any node as an error. Plus, you can't really solve some ambiguities without C-based lexer hacks. I wonder if targeting the Tree-sitter ABI directly could be a viable way to write more accurate parsers in an actual programming language while piggybacking on the ecosystem. Could tree-sitter's runtime ABI be adapted for GLL parsers instead of GLR? I haven't looked deep into it yet.
  - conartist6 10mo ago
    Now you're in my wheelhouse! Come check out https://github.com/bablr-lang/ https://github.com/bablr-lang/. I'm gearing up for a big release announcement here once I fix these bugs and ship all the latest code.
10mo ago