amath

9 ms·

31.
by amath 3y ago
That paper is too good not to link - https://www.usenix.org/system/files/conference/hotos15/hotos... I hope more companies can be built around timely-dataflow.
32.
by amath 3y ago
Correct, there is the open source project and then the platform is proprietary and has additional features. We are licensing those portions and those are what are requested to be in escrow. Do you mean a copy left or business source type of
33.
by amath 3y ago
Thanks for sharing. I hadn’t heard of many scenarios in recent years, but I’m not sure if that’s just because nobody advertises that they had to put the source code in escrow.
34.
Ask HN: Is source code escrow still a thing?
7 points by amath 3y ago|9 comments
35.
Anaconda's 2023 State of Data Science Dataset(github.com)
1 points by amath 3y ago|0 comments
36.
Reddit's Real-Time Abuse Detection System Built with Apache Flink(old.reddit.com)
4 points by amath 3y ago|0 comments
37.
Show HN: We built rescaling for distributed stateful stream processing(bytewax.io)
5 points by amath 3y ago|0 comments
38.
Show HN: Performant Rust Streaming Algorithms from Python(github.com)
7 points by amath 3y ago|0 comments
39.
Embeddable Code Playgrounds/Sandbox Environments(codapi.org)
2 points by amath 3y ago|0 comments
40.
by amath 3y ago
Nice! I want to see about using that in https://github.com/bytewax/stateful-chat to remove the OpenAI endpoint requirement.
41.
by amath 3y ago
Hey HN! I am one of the people working on Bytewax ( https://github.com/bytewax/bytewax ). Bytewax came out of our experience working with ML infrastructure at GitHub. We wanted to use Python because we could move fast, t
42.
by amath 3y ago
describing so many nightmares here :). The overhead of testing/running locally is so important and yet so frequently not optimized for.
43.
by amath 3y ago
Author of the post here. I would love to hear thoughts on folks experience using the different architectures and more pros and cons to each one. There was surprisingly not a lot of information comparing these different architectures that I
44.
Ask HN: What are some public real-time data sources?
1 points by amath 3y ago|0 comments
45.
by amath 3y ago
https://github.com/rerun-io/rerun is such a great tool for creating interactive dashboards to look at real-time data. Curious if there are others looking for something like this and what the other use cases would be in
46.
Real-Time Visualization of Streaming Data in Python with ReRun(bytewax.io)
6 points by amath 3y ago|1 comments
47.
by amath 4y ago
Cool, nice idea. Can you sub in different backend like bytewax ( https://github.com/bytewax/bytewax ) for stateful processing?
48.
by amath 4y ago
Have you tried Pulsar or Redpanda? Both seem mature enough and provide decent performance to probably meet your needs. What I hear is that Redpanda is a lot easier to manage than Kafka.
49.
Show HN: A framework of open-source technologies to design real-time ML systems(github.com)
2 points by amath 4y ago|0 comments
50.
by amath 4y ago
Yes, open to contributors! I would say checkout PyO3 to learn more about how you can marry Python with Rust code. It is an awesome project.
51.
by amath 4y ago
Thank you!
52.
by amath 4y ago
Thank you! Would love to
53.
by amath 4y ago
That’s one thing we are really excited about! Kubernetes makes it easy to scale Bytewax dataflows across multiple nodes relatively easily. We have some long format docs about how it works https://docs.bytewax.io/deployment&
54.
by amath 4y ago
Zander here, part of the team working on Bytewax. Much of the magic of Timely is passed through to the Python library, but there are a few features that we thought would make it easier to build with and run in production. - We deepened the
55.
Show HN: Bytewax – Python Stateful Stream Processing on Timely Dataflow(github.com)
21 points by amath 4y ago|13 comments
56.
by amath 4y ago
Excited to see this, BentoML strikes a good balance between flexibility and opinion.
57.
by amath 4y ago
Bytewax | Software Engineer & Developer Advocate | Remote | Full-time | https://www.bytewax.io/ At Bytewax we are building the next generation of stream processing with a focus on developer experience as well as scalabi
58.
by amath 5y ago
I have a hard time trusting the research that the author did with misspellings like this :).