eggie5

10 ms·

31.
by eggie5 6y ago
does this mean the TF S3 plugin will stop cluttering my logs w/ s3 retries?
32.
by eggie5 6y ago
you forgot prototype before jquery
33.
by eggie5 6y ago
Just did a deep dive of this a few days ago. Mostly looked at the Elkan paper, which this post called naive. I've been researching in the context of weak-supervision data from the Snorkel software package. It's very easy to create
34.
by eggie5 6y ago
Thanks for the lead on PU Learning. I signed up for a demo of the new platform, looking forward to chatting. Me and a colleague from work spoke w/ Henry last year about a potential partnership but I guess it got lost in the mix...
35.
by eggie5 6y ago
you have a dataset of images and you write code (labeling functions LF) to label the images. Snorkel handles the pipeline but more importantly corrects the conflicts/correlations between the LFs. The output is a supervised dataset w&#x
36.
by eggie5 6y ago
Snorkel has a label mutual exclusion assumption right? My core problem is a multi-label problem, but my snorkel data, from the LabelModel is inherently single-label (mutually exclusive). What is the prevailing recommendation to do multi-lab
37.
by eggie5 6y ago
Thanks Alex. I'm sure you can relate that when you have a an unbounded input distribution (like w/ user-interaction systems), defining that other class w/ current snorkel is difficult/impossible.
38.
by eggie5 6y ago
yeah, you can do single-label w/ snorkel, but not multi-label. Multi-label snorkel would be the killer feature bc making the negatives (ie for a softmax) is very hard especially when you work w/ user-interaction systems with an un
39.
by eggie5 6y ago
can you do multi-label w/ Compose? Snorkel only supports single-label.
40.
by eggie5 6y ago
can you do multi-label w/ Compose? Snorkel only supports single-label.
41.
by eggie5 6y ago
can you educate me on how you do multi-label w/ snorkel? As far as I can understand that's one it's largest drawbacks.
42.
by eggie5 6y ago
Why do think that? It's a very powerful and useful technique. You can get supervised labels in a day (ostensibly for free) vs paying humans to do it and waiting...
43.
by eggie5 6y ago
That's too bad. Myself and colleagues have had good success using the current snorkel package.
44.
by eggie5 6y ago
A human will label data according to hand-rules or heuristics. What's the difference is a program labels data according to hand-rules or heuristics. The down-stream discriminates model's goal is to generalize via supervision.
45.
by eggie5 6y ago
The former project is a python package that labels your data using a weak supervision technique. It's not just a pipeline, it's a sophisticated algorithm that helps combine multiple competing labeling functions by removing reweigh
46.
by eggie5 6y ago
To that end the OS project will remain: https://spectrum.chat/snorkel/general/announcing-snorkel-flo...
47.
by eggie5 6y ago
Snorkel does weak supervision for you. It takes your unlabeled data and use defined labeling functions (LFs), maps the LFs on the data and then de-correlates relates everything to give you a dataset that you can use for multi-class single-l
48.
by eggie5 6y ago
I can say Grubhub and Chegg use it.
49.
by eggie5 6y ago
anyone figure out how to do multi-label classification w/ snorkel? It seems like it's current formulation only supports single-label, ie softmax. I find in practice, especially w/ user-interaction, system most problems are no
50.
by eggie5 6y ago
why does everyone say Grubhub is not profitable?
51.
by eggie5 6y ago
simple LTR w/ clickstream data would fix this easy
52.
by eggie5 7y ago
this killed Trivago too
53.
by eggie5 7y ago
True the are lots of booking scrapers like trivago
54.
by eggie5 7y ago
good
55.
by eggie5 7y ago
You can use a knowledge graph for query expansion. For example, if the query is "Dan Dan Noodles", you can expand that to "Asain Noodles", "Chinese", "Tan Tan Noodles" to achieve higher Recall in you
56.
by eggie5 7y ago
So IG ins't using collaborative filtering? The whole process starts w/ simple NN search in the account embedding space. Those candidates are then passed to the ranking stack. This makes sense w/ what I see in IG recs: past be
57.
by eggie5 7y ago
I recently saw this strange word Serde in some Hive table create commands...
58.
by eggie5 7y ago
Development of models in our data environment: notebooks, pyspark EMR clusters for analytical workloads and offline models, tensorflow/EC2 P2s for online models. Jobs are scheduled (Azkaban) for reruns/re-training and pushed from
59.
by eggie5 7y ago
one word: Dask
60.
by eggie5 7y ago
The latent graph structure is encoded into the embeddings. Each node in the graph is a vector and you traverse the graph by preforming NN search in the embedding space.

More ›