fredliu

36 ms·

61.
by fredliu 6y ago
Looks like it's the latter, which makes it even more impressive!
62.
by fredliu 6y ago
What amazes me is that all those super meta "patterns" are already embedded in GPT-3's giant model. As compared to GPT-2, where you'd need to have your own large dataset to fine-tune for a specific use case/ the pat
63.
by fredliu 6y ago
OMG, then it is even more impressive than I thought! There's no way GPT-3 knows the part in parentheses is supposed to be "the monolog", or even what a monolog is supposed to be. And yet based on the pattern between Q, A and
64.
by fredliu 6y ago
Do you mean the "internal monolog" in parentheses are added by you, and only the text after the parentheses are generated by GPT-3? Either way, it's kind of fun to think of it as kind of an experiment on the bicameral mind th
65.
by fredliu 6y ago
Cargo-Cult programming is already happening at a not-insignificant scale due to the vast amount of sample code/tutorial/Q&A online. There could be lots of nuances in that snippet you just copied from a SO comment, which "
66.
by fredliu 6y ago
This, the difference between one-shot fine-tuning, vs fine tuning for GPT-2, is one of the major breakthroughs. Since GPT-3 is so hot in the past few days, people seem to forgot or not realize lots of the GPT-3 examples shown off today were
67.
Neural Network creates South Park character responses to tweets(reddit.com)
2 points by fredliu 6y ago|0 comments
68.
by fredliu 6y ago
We fine-tuned GPT-2's 774M model using all seasons' South Park scripts. The result is a model that we can use to generate chats/conversations between South Park characters. If you've watched the show before, the characte
69.
Show HN: Replicating South Park Characters in chats using GPT-2(soulreplica.com)
6 points by fredliu 6y ago|2 comments
70.
by fredliu 8y ago
Exactly! I didn't know the author, but couldn't help but check on his background after reading the blogpost. It's almost a dead giveaway for excerpts like 'The notion of a counter is not that of a single concrete class o
71.
by fredliu 8y ago
FWIW, "Amazon EC2 Queue" actually covers a lot of real world use cases for SWF where a "queue" is needed to manage states and distribute works among workers. The list is a bit out dated, and as for Amazon State Machines,
72.
by fredliu 8y ago
Good to know it generalized, but seems it's only generalized on board games like problems where you have a problem space to search through, is that understanding correct? If so, it probably won't help in the use cases we are talki
73.
by fredliu 8y ago
I didn't mean it's a requirement, but a fact that what ever DL could do is based on its input (labeled data), and that input has to come from human, or the task underneath is possible for human.
74.
by fredliu 8y ago
The reason I relate human skill with DL, is because for tasks where there are real patterns that humans can consistently recognize, DL is applicable, because it relies on human labeled inputs. For patterns, even humans can't consistent
75.
by fredliu 8y ago
By DL, i meant generic DL techniques like CNN, LSTM (used in this article), which relies on large amount of labeled data to train, and predict on similar data, thus my comment about automation. Alpha Go (Zero) is very specialized for the ga
76.
by fredliu 8y ago
Total noob question in this space (algotrading with DL algorithms). What DL is good at, is to automate tasks that are easy for humans (e.g. telling cat from dog, understand a sentence from sound wave, translation, etc) but hard for machines
77.
by fredliu 8y ago
Honest Question: is there enough data to show how likely the battery will burst into flames in crashes? So far the few incidences that I'm aware of make it feels like "the battery don't always burn, but when it does, there&#x
78.
by fredliu 8y ago
Qualcomm has been facing multi-front battles in the past few years: Apple Lawsuit, NXP deal nixed, Broadcom hostile take over, China problem, Regulator problems, Board In-fights, pressure from activist investor to "cut cost"/
79.
by fredliu 8y ago
There's a documentary: The Science of Fasting ( https://www.youtube.com/watch?v=t1b08X-GvRs ) which talks about fascinating effects of fasting therapy, and interesting effects of fasting on cancer treatment. Looks like
80.
by fredliu 8y ago
Not sure why you are downvoted, reading the 2nd paragraph you cited (and some other parts in the article), it's definitely hard to view them as comments only against the government instead of generalizing over a people. I guess since t
81.
by fredliu 8y ago
I see lots of evaluation of GCP, or comparison between GCP vs AWS recently. But I don't see as many for the Azure platform, although Azure being the 2nd in the cloud provider market, and even closing on AWS in market share. Anybody has
82.
by fredliu 8y ago
After this research, when do we expect to see male luxury brand stores in the mall start selling testosterone boosting snacks?
83.
by fredliu 8y ago
I guess the premise of the parent comment is that China, at least in the tech sector, is considered as "developed" as the US. If that assumption holds true, what the parent comment isn't far off. But that's an assumption
84.
by fredliu 8y ago
Sure, CDMA vs OFDM, definitely they can be regarded as "material difference" But that's not the logic/argument the original article made. They only used bandwidth and delay to quantify "material difference". Fo
85.
by fredliu 8y ago
The coverage/range of 5G depends on the scale of deployment, and the environment of the deployment (e.g. urban with lots of tall buildings, vs rural), assuming we are talking about mmw type of 5G not LTE+ type of 5G. Due to higher freq
86.
by fredliu 8y ago
When "4G" was initially commercialized, one could have claimed it has No "Material Difference Between 3G and 4G". HSPA(+) was just faster 3G, already reaching lower end of 4G bandwidth requirement, minimally qualifiable
87.
by fredliu 8y ago
So the run time is in web assembly as well, and "complied" in the final "executable"?
88.
by fredliu 8y ago
How are features like go routines and channels etc going to be supported? or they are not?
89.
by fredliu 8y ago
Very interesting post. Could you elaborate more (maybe another blog?) on the DevOps perspectives on how to manage a prod Elixir/BEAM stack (CI/CD, scaling, dev vs test vs prod environment management)?
90.
by fredliu 8y ago
Definitely the things Linkedin do are so much worse and creepier, just by looking at the people they recommend me to connect to, the level of offline tracking they must be doing are creepy beyond imagination.

More ›