8 ms·

Rerun 0.9 – a framework for visualizing streams of multimodal data

117 points by Tycho87 3y ago

lukax 3y ago
The creator of Rerun (Emil Ernerfeldt) also created egui [1], an immediate GUI library for Rust. The library is similar to Dear ImGui but it is written in Rust and can be used for desktop and web apps (compiles to WASM and uses WebGL, demo [2]). Desktop apps can target OpenGL (does not display correct colors on macOS, does not work in VirtualBox on Windows) or WGPU (uses native APIs for each platform, works without any problems, but the binary is a big larger). [1] https://github.com/emilk/egui https://github.com/emilk/egui [2] https://www.egui.rs/ https://www.egui.rs/
- lazypenguin 3y ago
  I’ve used this library fairly extensively and it’s very enjoyable and productive. A hearty thanks to Emil and all the contributors
- Torkel 3y ago
  Egui is great, and the eframe way of writing small apps is so nice! I cranked out my own custom video player (for tagging video) the other day using it and the ffmpeg bindings. Very pleasant experience.
tinytera 3y ago
Looks interesting. Do you have visualizations or examples on debugging audio embeddings (like https://huggingface.co/spaces/facebook/MusicGen https://huggingface.co/spaces/facebook/MusicGen) ?
- deleted 3y ago
  [deleted]
- jeremyleibs 3y ago
  No specific support for audio embeddings yet, though depending on you're specific use-case, you might be able to map your data to more generic primitives such a TimeSeriesScalar, LineStrips2D, BarChart, or Tensor. We have an open issue for adding more support for audio-based projects -- if you have specific needs feel free to add a comment: https://github.com/rerun-io/rerun/issues/2852 https://github.com/rerun-io/rerun/issues/2852
nu11ptr 3y ago
I like the styling of the app. It is quite different than default egui styling. If someone is reading that is familiar with the source can you point me to the parts most responsible for the look? (custom components, styling code, etc.) It will just save me a bunch of research. Thx
- jeremyleibs 3y ago
  The `re_ui` crate is responsible for most of the non-default styling. Here's the method where it it gets applied, which probably serves as a good reference for extending the look and feel of an egui application: https://github.com/rerun-io/rerun/blob/release-0.9.0/crates/re_ui/src/lib.rs#L63 https://github.com/rerun-io/rerun/blob/release-0.9.0/crates/...
  - nu11ptr 3y ago
    I will start there and see where it leads - thanks!
  - KRAKRISMOTT 3y ago
    Any plans to spin it out as an egui UI library?
    - nu11ptr 3y ago
      That would be awesome if they did. I decided to create an enhancement request: https://github.com/rerun-io/rerun/issues/3706 https://github.com/rerun-io/rerun/issues/3706
    - terhechte 3y ago
      You can just use the crate. I’m using it in personal projects: re_ui = "0.6.0"
      - nu11ptr 3y ago
        Interesting. Does that include the UI styling only or also the custom components? Update: look at rustdoc and I'm not seeing components, or at least not many
gorenb 3y ago
i found out about this today unrelated to this post
- nikonp 3y ago
  Cool! Where was that? (I’m on the Rerun team so curious)
  - diggan 3y ago
    Not parent but came across it yesterday as well, in these comments: https://news.ycombinator.com/item?id=37770008 https://news.ycombinator.com/item?id=37770008 (Show HN: A nom parser for the Starcraft 2 Protocol Replay format)
    - nikonp 3y ago
      Ah yeah that was definitely a usecase we hadn’t thought of. Really cool project!
jlaneve 3y ago
Heads up, this blog doesn't seem to work on Safari. I see a couple errors in the console, but the culprit appears to be `SyntaxError: Invalid regular expression: invalid group specifier name`
- nikonp 3y ago
  Thanks for the heads up! Looking into it. Haven't been able to reproduce yet on mobile or desktop safari but that error message helps
r-w 3y ago
> Application error: a client-side exception has occurred (see the browser console for more information). I’m using the latest Brave (v1.57) on iOS 15.
j1elo 3y ago
> Open source. The Rerun OSS project is dual licensed under MIT and Apache 2 Honest question: What does dual licensing MIT + Apache-2.0 accomplish that just Apache-2.0 doesn't?
- nu11ptr 3y ago
  "Requiring both MIT and Apache 2.0 as inbound licenses for contributions means that anyone making a contribution is providing the Apache 2.0 patent grant. And then having MIT and Apache 2.0 as outbound licenses people can use Rust under means that Rust provides widespread compatibility with all sorts of other FOSS licenses, including GPLv2." from: https://internals.rust-lang.org/t/rationale-of-apache-dual-licensing/8952/4 https://internals.rust-lang.org/t/rationale-of-apache-dual-l...
  - j1elo 3y ago
    Very interesting, thanks. The link also mentions other alternatives that weren't around when Rust got its licenses, but that do exist now, so that's good to know. It also brought me to learn about the incompatibility between Apache-2.0 and GPLv2, of which I didn't know about: * https://www.gnu.org/licenses/license-list.en.html#apache2 https://www.gnu.org/licenses/license-list.en.html#apache2 * https://opensource.stackexchange.com/questions/1357/can-i-link-a-apache-2-0-library-into-software-under-gplv2/1364#1364 https://opensource.stackexchange.com/questions/1357/can-i-li...
transfire 3y ago
I don’t get it. Can some explain this like I was 5.
gugagore 3y ago
https://polyscope.run/data_adaptors/ https://polyscope.run/data_adaptors/ has an interesting approach to handling custom C++ types. I wonder if that could carry over to this project.
sendfoods 3y ago
Great to see continued development of rerun! I'm a SLAM engineer and work with C++ and ROS1 mainly, so I am exited to see the C++ SDK about to be released. The ROS visualization tools can be a bit crusty, even in ROS2.

117 points by Tycho87 3y ago

The creator of Rerun (Emil Ernerfeldt) also created egui [1], an immediate GUI library for Rust. The library is similar to Dear ImGui but it is written in Rust and can be used for desktop and web apps (compiles to WASM and uses WebGL, demo [2]). Desktop apps can target OpenGL (does not display correct colors on macOS, does not work in VirtualBox on Windows) or WGPU (uses native APIs for each platform, works without any problems, but the binary is a big larger). [1] https://github.com/emilk/egui https://github.com/emilk/egui [2] https://www.egui.rs/ https://www.egui.rs/

lazypenguin 3y ago
I’ve used this library fairly extensively and it’s very enjoyable and productive. A hearty thanks to Emil and all the contributors
Torkel 3y ago
Egui is great, and the eframe way of writing small apps is so nice! I cranked out my own custom video player (for tagging video) the other day using it and the ffmpeg bindings. Very pleasant experience.

tinytera 3y ago

Looks interesting. Do you have visualizations or examples on debugging audio embeddings (like https://huggingface.co/spaces/facebook/MusicGen https://huggingface.co/spaces/facebook/MusicGen) ?

deleted 3y ago
[deleted]
jeremyleibs 3y ago
No specific support for audio embeddings yet, though depending on you're specific use-case, you might be able to map your data to more generic primitives such a TimeSeriesScalar, LineStrips2D, BarChart, or Tensor. We have an open issue for adding more support for audio-based projects -- if you have specific needs feel free to add a comment: https://github.com/rerun-io/rerun/issues/2852 https://github.com/rerun-io/rerun/issues/2852

nu11ptr 3y ago

I like the styling of the app. It is quite different than default egui styling. If someone is reading that is familiar with the source can you point me to the parts most responsible for the look? (custom components, styling code, etc.) It will just save me a bunch of research. Thx

jeremyleibs 3y ago
The `re_ui` crate is responsible for most of the non-default styling. Here's the method where it it gets applied, which probably serves as a good reference for extending the look and feel of an egui application: https://github.com/rerun-io/rerun/blob/release-0.9.0/crates/re_ui/src/lib.rs#L63 https://github.com/rerun-io/rerun/blob/release-0.9.0/crates/...
- nu11ptr 3y ago
  I will start there and see where it leads - thanks!
- KRAKRISMOTT 3y ago
  Any plans to spin it out as an egui UI library?
  - nu11ptr 3y ago
    That would be awesome if they did. I decided to create an enhancement request: https://github.com/rerun-io/rerun/issues/3706 https://github.com/rerun-io/rerun/issues/3706
  - terhechte 3y ago
    You can just use the crate. I’m using it in personal projects: re_ui = "0.6.0"
    - nu11ptr 3y ago
      Interesting. Does that include the UI styling only or also the custom components? Update: look at rustdoc and I'm not seeing components, or at least not many

gorenb 3y ago

i found out about this today unrelated to this post

nikonp 3y ago
Cool! Where was that? (I’m on the Rerun team so curious)
- diggan 3y ago
  Not parent but came across it yesterday as well, in these comments: https://news.ycombinator.com/item?id=37770008 https://news.ycombinator.com/item?id=37770008 (Show HN: A nom parser for the Starcraft 2 Protocol Replay format)
  - nikonp 3y ago
    Ah yeah that was definitely a usecase we hadn’t thought of. Really cool project!

jlaneve 3y ago

Heads up, this blog doesn't seem to work on Safari. I see a couple errors in the console, but the culprit appears to be `SyntaxError: Invalid regular expression: invalid group specifier name`

nikonp 3y ago
Thanks for the heads up! Looking into it. Haven't been able to reproduce yet on mobile or desktop safari but that error message helps

r-w 3y ago

> Application error: a client-side exception has occurred (see the browser console for more information). I’m using the latest Brave (v1.57) on iOS 15.

j1elo 3y ago

> Open source. The Rerun OSS project is dual licensed under MIT and Apache 2 Honest question: What does dual licensing MIT + Apache-2.0 accomplish that just Apache-2.0 doesn't?

nu11ptr 3y ago
"Requiring both MIT and Apache 2.0 as inbound licenses for contributions means that anyone making a contribution is providing the Apache 2.0 patent grant. And then having MIT and Apache 2.0 as outbound licenses people can use Rust under means that Rust provides widespread compatibility with all sorts of other FOSS licenses, including GPLv2." from: https://internals.rust-lang.org/t/rationale-of-apache-dual-licensing/8952/4 https://internals.rust-lang.org/t/rationale-of-apache-dual-l...
- j1elo 3y ago
  Very interesting, thanks. The link also mentions other alternatives that weren't around when Rust got its licenses, but that do exist now, so that's good to know. It also brought me to learn about the incompatibility between Apache-2.0 and GPLv2, of which I didn't know about: * https://www.gnu.org/licenses/license-list.en.html#apache2 https://www.gnu.org/licenses/license-list.en.html#apache2 * https://opensource.stackexchange.com/questions/1357/can-i-link-a-apache-2-0-library-into-software-under-gplv2/1364#1364 https://opensource.stackexchange.com/questions/1357/can-i-li...

transfire 3y ago

I don’t get it. Can some explain this like I was 5.

gugagore 3y ago

https://polyscope.run/data_adaptors/ https://polyscope.run/data_adaptors/ has an interesting approach to handling custom C++ types. I wonder if that could carry over to this project.

sendfoods 3y ago

Great to see continued development of rerun! I'm a SLAM engineer and work with C++ and ROS1 mainly, so I am exited to see the C++ SDK about to be released. The ROS visualization tools can be a bit crusty, even in ROS2.