4 ms·

I like the playful vibe of the site, but it’s incredibly unclear what this actually is. Needs more specific description of the problems being solved.

by dchuk 4y ago

jeffail 4y ago
Yeah that's my bad, the site assumes you already know what benthos is as it's an early stages UI for it. The best place to start is https://www.benthos.dev https://www.benthos.dev, or if you like dumb videos: https://youtu.be/88DSzCFV4Ng https://youtu.be/88DSzCFV4Ng
mihaitodor 4y ago
Benthos Studio is an application that provides visual editing capabilities to the Benthos (https://www.benthos.dev https://www.benthos.dev) stream processor, which lets you craft and test yaml-based configurations that you can then run using Benthos. Benthos itself is a stateless command line (CLI) app written in Go. It supports quite a few types of "macro" building blocks (aka components) which are various flavours of inputs, outputs, processors, caches, rate limits, buffers, metrics, tracers and loggers. The most important processor is the `mapping` one which lets you execute Bloblang code against each message which passes through it. Bloblang is a functional programming language embedded in Benthos as a DSL for manipulating structured data. You can read more about it over here: https://www.benthos.dev/docs/guides/bloblang/about https://www.benthos.dev/docs/guides/bloblang/about Also, if you'd like to use it outside of Benthos, you can import it as a library: https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/public/bloblang https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/... Since I mentioned importing Bloblang as a library, you can import the entire Benthos framework as a library and inject your own custom plugins to create a custom Benthos build with whatever components and extra functionality you need. It's also a great way to slim down the existing distribution and only import the components that you require. See some examples here: https://github.com/benthosdev/benthos-plugin-example https://github.com/benthosdev/benthos-plugin-example
- bunkertor 4y ago
  why is Pulsar disabled?
  - mihaitodor 4y ago
    Some history here https://github.com/benthosdev/benthos/issues/1184#issuecomment-1075599257 https://github.com/benthosdev/benthos/issues/1184#issuecomme... but the TL; DR version is that the client library has caused a bit of friction in the past. They had several releases where one of its dependencies produced various compiler warnings and there was this dbus zombie processes issue which caused some concern... However, if you wish to run this at scale in production, you might want to look at https://github.com/benthosdev/benthos-plugin-example https://github.com/benthosdev/benthos-plugin-example and craft your own custom Benthos build, where you import just the components you need, such as the Pulsar ones.

I like the playful vibe of the site, but it’s incredibly unclear what this actually is. Needs more specific description of the problems being solved.

by dchuk 4y ago

I like the playful vibe of the site, but it’s incredibly unclear what this actually is. Needs more specific description of the problems being solved.

jeffail 4y ago

Yeah that's my bad, the site assumes you already know what benthos is as it's an early stages UI for it. The best place to start is https://www.benthos.dev https://www.benthos.dev, or if you like dumb videos: https://youtu.be/88DSzCFV4Ng https://youtu.be/88DSzCFV4Ng

mihaitodor 4y ago

Benthos Studio is an application that provides visual editing capabilities to the Benthos (https://www.benthos.dev https://www.benthos.dev) stream processor, which lets you craft and test yaml-based configurations that you can then run using Benthos. Benthos itself is a stateless command line (CLI) app written in Go. It supports quite a few types of "macro" building blocks (aka components) which are various flavours of inputs, outputs, processors, caches, rate limits, buffers, metrics, tracers and loggers. The most important processor is the `mapping` one which lets you execute Bloblang code against each message which passes through it. Bloblang is a functional programming language embedded in Benthos as a DSL for manipulating structured data. You can read more about it over here: https://www.benthos.dev/docs/guides/bloblang/about https://www.benthos.dev/docs/guides/bloblang/about Also, if you'd like to use it outside of Benthos, you can import it as a library: https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/public/bloblang https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/... Since I mentioned importing Bloblang as a library, you can import the entire Benthos framework as a library and inject your own custom plugins to create a custom Benthos build with whatever components and extra functionality you need. It's also a great way to slim down the existing distribution and only import the components that you require. See some examples here: https://github.com/benthosdev/benthos-plugin-example https://github.com/benthosdev/benthos-plugin-example

bunkertor 4y ago
why is Pulsar disabled?
- mihaitodor 4y ago
  Some history here https://github.com/benthosdev/benthos/issues/1184#issuecomment-1075599257 https://github.com/benthosdev/benthos/issues/1184#issuecomme... but the TL; DR version is that the client library has caused a bit of friction in the past. They had several releases where one of its dependencies produced various compiler warnings and there was this dbus zombie processes issue which caused some concern... However, if you wish to run this at scale in production, you might want to look at https://github.com/benthosdev/benthos-plugin-example https://github.com/benthosdev/benthos-plugin-example and craft your own custom Benthos build, where you import just the components you need, such as the Pulsar ones.