3 ms·

I've been searching for a GPU Node Graph library for some time. All my Github Fu failed me. I'd like to have something which offers: - Video - Images - Rich

I've been searching for a GPU Node Graph library for some time. All my Github Fu failed me. I'd like to have something which offers: - Video - Images - Rich Text - Animations And a way to compose these blocks together into bigger structures with shader effects. Preferably in a compiled language such as C++, Rust or Swift. Does something like that exist?

jcelerier 3y ago
https://ossia.io https://ossia.io does some of it, I've been working on a new release that also supports the whole QtQuick stack in the node graph items but you can already combine videos & shader effects. There are also text and image nodes but i want to redo them, they were quick and dirty prototypes for an exhibition and don't support some of the use cases artists using the software then came up with, e.g. sifting through gigabytes of images more or less instantly. The underlying C++ part of this is kiiinda independent of the rest of the app, at least the graph part : https://github.com/ossia/score/tree/master/src/plugins/score-plugin-gfx/Gfx/Graph https://github.com/ossia/score/tree/master/src/plugins/score... - I'm sure it wouldn't be too hard to extract this folder specifically. Shaders use the ISF specification (https://isf.video https://isf.video) and the backend is through Qt's RHI so things are then mapped to metal, vk, d3d or GL.
- hermitcrab 3y ago
  Ossia looks very cool. I have also developed a node-based tool in Qt/C++ (https://www.easydatatransform.com/ https://www.easydatatransform.com/). Might be interesting to talk Qt-related stuff with you some time (Qt versions, deployment, OSs etc).
- pjmlp 3y ago
  The ISF specification is kind of neat, I wasn't aware of it, thanks for the hint.
s-macke 3y ago
I have experimented with the new WebGPU API a lot and it seems this API is predistined for node graph type of programming. I am hoping that someone will build a website such as Shadertoy [1] and compute.toys [2], but with a node graph editor. [1] https://www.shadertoy.com/ https://www.shadertoy.com/ [2] https://compute.toys/ https://compute.toys/
deleted 3y ago
[deleted]
ux 3y ago
We've just released a new version of Nope Foundry yesterday: https://www.nope-foundry.org https://www.nope-foundry.org You might want to have a look. Video, Images, Rich Text and Animations are typically what we strive for. Check out maybe https://nopefoundry.github.io/nope.gl/usr/howto/renders.html https://nopefoundry.github.io/nope.gl/usr/howto/renders.html and the other howtos.
bj-rn 3y ago
Check out Fuse[1/2]. It's an open source library for visually programming on the GPU. It is built for use in the visual programming environment vvvv[3]. VVVV itself is based on .Net and you can extend its functionality by either writing nodes in C# or importing just about every existing .Net library just by referencing it or installing it as nuget. No need for wrappers[4]. For rendering vvvv uses the Stride [5] game engine which comes with a really neat shader system / language which is basically a superset of HLSL [6]. In vvvv those shaders are represented as nodes and you can open them in your favorite text editor directly from the vvvv evironment, edit the code, save and the changed result will instantly be loaded in vvvv[7]. If you have any questions join the vvvv matrix chat: https://matrix.to/#/#vvvv:matrix.org https://matrix.to/#/#vvvv:matrix.org [1]https://www.thefuselab.io https://www.thefuselab.io [2]https://github.com/TheFuseLab/VL.Fuse https://github.com/TheFuseLab/VL.Fuse [3]https://visualprogramming.net https://visualprogramming.net [4]https://thegraybook.vvvv.org/reference/extending/overview.html https://thegraybook.vvvv.org/reference/extending/overview.ht... [5]https://www.stride3d.net https://www.stride3d.net [6]https://doc.stride3d.net/latest/en/manual/graphics/effects-and-shaders/shading-language/index.html https://doc.stride3d.net/latest/en/manual/graphics/effects-a... [7]https://thegraybook.vvvv.org/reference/libraries/3d/shaders.html https://thegraybook.vvvv.org/reference/libraries/3d/shaders....
- nmaleki 3y ago
  VVVV reminds me of a 2D TOOLL3

jcelerier 3y ago

https://ossia.io https://ossia.io does some of it, I've been working on a new release that also supports the whole QtQuick stack in the node graph items but you can already combine videos & shader effects. There are also text and image nodes but i want to redo them, they were quick and dirty prototypes for an exhibition and don't support some of the use cases artists using the software then came up with, e.g. sifting through gigabytes of images more or less instantly. The underlying C++ part of this is kiiinda independent of the rest of the app, at least the graph part : https://github.com/ossia/score/tree/master/src/plugins/score-plugin-gfx/Gfx/Graph https://github.com/ossia/score/tree/master/src/plugins/score... - I'm sure it wouldn't be too hard to extract this folder specifically. Shaders use the ISF specification (https://isf.video https://isf.video) and the backend is through Qt's RHI so things are then mapped to metal, vk, d3d or GL.

hermitcrab 3y ago
Ossia looks very cool. I have also developed a node-based tool in Qt/C++ (https://www.easydatatransform.com/ https://www.easydatatransform.com/). Might be interesting to talk Qt-related stuff with you some time (Qt versions, deployment, OSs etc).
pjmlp 3y ago
The ISF specification is kind of neat, I wasn't aware of it, thanks for the hint.

s-macke 3y ago

I have experimented with the new WebGPU API a lot and it seems this API is predistined for node graph type of programming. I am hoping that someone will build a website such as Shadertoy [1] and compute.toys [2], but with a node graph editor. [1] https://www.shadertoy.com/ https://www.shadertoy.com/ [2] https://compute.toys/ https://compute.toys/

deleted 3y ago

[deleted]

ux 3y ago

We've just released a new version of Nope Foundry yesterday: https://www.nope-foundry.org https://www.nope-foundry.org You might want to have a look. Video, Images, Rich Text and Animations are typically what we strive for. Check out maybe https://nopefoundry.github.io/nope.gl/usr/howto/renders.html https://nopefoundry.github.io/nope.gl/usr/howto/renders.html and the other howtos.

bj-rn 3y ago

Check out Fuse[1/2]. It's an open source library for visually programming on the GPU. It is built for use in the visual programming environment vvvv[3]. VVVV itself is based on .Net and you can extend its functionality by either writing nodes in C# or importing just about every existing .Net library just by referencing it or installing it as nuget. No need for wrappers[4]. For rendering vvvv uses the Stride [5] game engine which comes with a really neat shader system / language which is basically a superset of HLSL [6]. In vvvv those shaders are represented as nodes and you can open them in your favorite text editor directly from the vvvv evironment, edit the code, save and the changed result will instantly be loaded in vvvv[7]. If you have any questions join the vvvv matrix chat: https://matrix.to/#/#vvvv:matrix.org https://matrix.to/#/#vvvv:matrix.org [1]https://www.thefuselab.io https://www.thefuselab.io [2]https://github.com/TheFuseLab/VL.Fuse https://github.com/TheFuseLab/VL.Fuse [3]https://visualprogramming.net https://visualprogramming.net [4]https://thegraybook.vvvv.org/reference/extending/overview.html https://thegraybook.vvvv.org/reference/extending/overview.ht... [5]https://www.stride3d.net https://www.stride3d.net [6]https://doc.stride3d.net/latest/en/manual/graphics/effects-and-shaders/shading-language/index.html https://doc.stride3d.net/latest/en/manual/graphics/effects-a... [7]https://thegraybook.vvvv.org/reference/libraries/3d/shaders.html https://thegraybook.vvvv.org/reference/libraries/3d/shaders....

nmaleki 3y ago
VVVV reminds me of a 2D TOOLL3