jeffreysmith

8 ms·

31.
by jeffreysmith 9y ago
Shameless plug: I cover this topic in my book, Reactive Machine Learning Systems: https://www.manning.com/books/reactive-machine-learning-syst... In particular, chapters 7 and 8 cover the design of model servers and mo
32.
by jeffreysmith 9y ago
Hi, I'm the author. Please let me know if you have any questions I can help answer.
33.
by jeffreysmith 9y ago
defguard/defguardp is a really welcome addition that should improve lots of normal code. Planning on using it in a refactor today . Great to see improvements like this.
34.
by jeffreysmith 9y ago
Intent Media ( http://intentmedia.com)'s data science functionality has a fair amount of Clojure behind the scenes.
35.
by jeffreysmith 9y ago
Totally! And their frontend from what I know.
36.
by jeffreysmith 10y ago
x.ai | Infrastructure Engineer | NYC | https://boards.greenhouse.io/xdotai/jobs/509427 x.ai | Senior Data Engineer | NYC | https://boards.greenhouse.io/xdotai/jobs/574020 x.ai | Senior F
37.
by jeffreysmith 10y ago
x.ai | New York, NY Data Engineer, NLP Data Scientist, and Backend Engineer https://x.ai/jobs/ At x.ai, we are building an artificial intelligence powered personal assistant. The software will schedule meetings for our
38.
by jeffreysmith 10y ago
I work at x.ai ( https://x.ai/ ) building an artificial intelligence that schedules meetings. You could take a look at this job post for our team https://x.ai/jobs/#data-engineer As stated, we need an
39.
by jeffreysmith 10y ago
Because people used Cython to build performant numerical data processing libraries like SciPy, NumPy, and Pandas, which makes then building sufficiently performant machine learning libraries like scikit-learn much easier.
40.
by jeffreysmith 11y ago
Posting the links again (since HN doesn't allow links in text posts): The book: https://www.manning.com/books/reactive-machine-learning-syst... Chapter 1: https://manning-content.s3.amazonaws.com/d
41.
Reactive Machine Learning Systems Book
10 points by jeffreysmith 11y ago|1 comments
42.
by jeffreysmith 11y ago
I recently played around in this space ( https://medium.com/data-engineering/artificial-startup-style... ). I was merely thinking through what it would take to turn this into a Turing test and not actually executing on
43.
Show HN: Experiments in neural art for startup fashion(medium.com)
2 points by jeffreysmith 11y ago|0 comments
44.
by jeffreysmith 11y ago
Sure. The story is somewhat different with Hadoop. But it's really quite feasible to adapt your systems incrementally from Hadoop to Spark. One of the details that I elided in the post is that we're just now decommissioning ou
45.
by jeffreysmith 11y ago
I have nothing against GCE. There's certainly innovation going on there. The new dataflow system certainly includes some very exciting and powerful ideas: https://cloud.google.com/dataflow/ The empowerment of th
46.
by jeffreysmith 11y ago
Yep, our Spark deployment, like many others, uses YARN and HDFS. EMR has done some great work to make YARN a great target for deployment of jobs using various technologies. I'm very much not against the Hadoop ecosystem. The ecosyste
47.
by jeffreysmith 11y ago
I think that the Hadoop ecosystem has just expanded. Spark is now a key part of that ecosystem. Hadoop's MapReduce implementation is arguably quickly becoming obsolete with so many more powerful platforms beating it on several dimensi
48.
by jeffreysmith 11y ago
I agree that the spin up time is not 0, but how much that matters is really influenced by the size of your jobs. I would also call out that, when developing against Spark, you can and should be running your jobs locally to develop and debug
49.
by jeffreysmith 11y ago
Jeff here. Glad that people are interested in this post. Feel free to ping me with any questions.
50.
by jeffreysmith 11y ago
Glad you like it. Always feel free to reach out, if you have questions or suggestions on the library. We're certainly open to PRs on the repo: https://github.com/intentmedia/mario
51.
Imperative Animals: Ship It Squirrel Gets a Family(medium.com)
1 points by jeffreysmith 11y ago|0 comments
52.
by jeffreysmith 12y ago
I do like to use dogs in my examples. See https://medium.com/tractable-constraints/in-search-of-divers... and https://medium.com/j-smith-in-ink/the-purginator-1dfae16327b... . There's somet
53.
by jeffreysmith 12y ago
Jeff, here. I put this up in time for folks coming to Spark Summit East in the hope that the influx of Spark folks to NYC might want to think a bit about my favorite type of distributed system: machine learning. Even though this thing is a