prions

11 ms·

61.
by prions 6y ago
Its not trivial to create and manage Data Pipelines if you care about scale, serving a wide range of inputs and outputs, or making this data easy to surface and spread throughout your org (i.e. making it actually useful to regular people).
62.
by prions 7y ago
Really similar to the pipelines that I engineer/manage at my current company. Although we have our Airflow on kubernetes. One optimization though is separating your loading tasks from compute tasks. This makes the pipeline more resilie
63.
by prions 7y ago
Same! I have three (dev, stg, prd) aws accounts. Without containers, I'd need to log in and out to jump between s3/emr/etc buckets between environments. With firefox containers I can run all three concurrently.
64.
Insert, Update, Delete Data on S3 with Amazon EMR and Apache Hudi(aws.amazon.com)
2 points by prions 7y ago|0 comments
65.
by prions 7y ago
Wow! I'm a twin and this is the first article I've read that really puts into words how I feel about it at times. Especially: " Not coincidentally, twins are at strong risk of being objectified. First, we get reduced to our a
66.
by prions 7y ago
Carbon footprint is one thing to be critical about, but a bigger advantage with electric vehicles is removing point source pollution and moving the ghg production to powerplants. Powerplants are usually farther away from people (not idling
67.
by prions 7y ago
Open offices are ruined by people. Some people cant work and interact with others in a respectful manner. Just because you're in an open office doesn't mean that others DON'T have the right to a low-disruption work environmen
68.
by prions 7y ago
And? All of the companies listed in the article are expanding in Manhattan, including Amazon. "Many of these companies are willing to spend big dollars renting high-end Manhattan real estate, rather than the older office stock in Queen
69.
by prions 7y ago
The article misses the point that a big part of Amazon's HQ2 was building new offices in an industrial area of LIC and not using existing real estate Manhattan.
70.
by prions 7y ago
One of my favorites when I was a CE and looking for interesting usecases for my job was Automate the Boring Stuff with Python. I was able to automate and speed up lot of slow, manual processes like signing and stamping shop drawings.
71.
by prions 7y ago
Thanks! It was risky quitting to go to school full time but having professional work experience helped a lot to manage myself.
72.
by prions 7y ago
The embedded work was just for an internship at Nokia/Bell Labs. I work at the place where I did my second internship; started doing ML engineering then pivoted to more data engineering work. You're right about embedded though. Mo
73.
by prions 7y ago
I went back for my masters in CS after being a civil engineer for two years and learning cs my free time. These articles panning formal education don't fully grasp how difficult it is to get your foot in the door as a non-cs person who
74.
by prions 7y ago
This was the best quote of the article for me: Forget the lousy microphones and the dinky interstitial stock music — the thing that derails most podcasts is the blab. There are two kinds, more or less. The first is that soft, inquisitive s
75.
by prions 8y ago
I'm surprised with how people enjoy AirPods in the city, seeing as they don't block any noise and are functionally useless in any noisy environment (trains, streets, etc). I liked the form factor, but couldn't hear anything o
76.
by prions 8y ago
Where I am (Manhattan) its truck noise. Trucks are the absolute worst in terms of noise pollution and emissions. Most modern cars/taxis around here are some sort of hybrid which shuts the engine when stopped, yet trucks are still in th
77.
by prions 8y ago
https://www.npr.org/2019/01/29/689663720/a-robot-named-tappy... This was big news last week and gave a lot of legitimacy to the allegations. Huawei China allegedly continued to pester Huawei USA em
78.
by prions 8y ago
In my experience (as a civil then software engineer with a MS in CS in ML/Big Data) "real" engineering is much more prescriptive than software. When you're designing a real-world engineering project, the entire specifica
79.
by prions 8y ago
I implemented a similar BiLSTM-CRF model at my current job. The architecture itself is really interesting, but runs into scaling issues. With LSTMs, you run into the constraint of having to wait on previous inputs and cache those results as
80.
by prions 8y ago
As stated in the parent comments that the likelihood of prions spreading in an infectious disease like fashion is very slim. Articles like this, ironically from a science-oriented publication, really don't help the conversation. Lucki
81.
by prions 8y ago
I'm about to finish my masters in CS, where I focused in machine learning. While I don't research at my school, my current job is a software/ML engineer in a machine learning focused team; I consider my role between a softwar
82.
by prions 8y ago
Not too much different? I can speak out against the government here and not get disappeared, or have a negative impact on my social credit score. A social credit score which can limit my ability to associate with certain people, get good em
83.
by prions 8y ago
I like the simple layout, but the topic aggregation algorithm could use some adjustment. Frozen 2 is in both Top Stories and Business, but not in Entertainment. There's some objectivity at play here, but I'd rather see articles ab
84.
by prions 8y ago
This is the same tired argument that's dragged out anytime people raise concerns about using Chinese hardware. >I don't care if the Chinese government has my data, I'm not a Chinese citizen >The US spies as well >The
85.
by prions 8y ago
This actually answers my question! I was getting mixed up with their re-purposing of generative and descriptive models. Can you clear up what you mean by a hidden seed? My understanding of GANs were that the generator learns the distributio
86.
by prions 8y ago
The paper mentions markov random fields as a descriptive model, but I've read that MRF's are a type of generative classifier. Are generative classifiers a type of descriptive model?
87.
by prions 8y ago
Military bases are some of the most polluted sites in America. Lots of soil/groundwater contamination from BTEX and other poorly handled chemicals. However, Military bases provide a lot of research for remediation engineering. https:&
88.
by prions 8y ago
Or, without making ridiculous unsupported pop-psych claims, people buy iPhones because they like them better. But I think Apple managing to induce Stockholm syndrome to millions of people worldwide is much more plausible.
89.
by prions 8y ago
This is a great article. One big thing NLP lacks (soon enough, lacked) over computer vision is its own version of ImageNet and other similar off the shelf models that can be fit to different domains. Many NLP models are brittle due to the d
90.
by prions 8y ago
That doesn't excuse his fans/followers encouraging and condoning his racist tirades

More ›