isaacfung

11 ms·

61.
by isaacfung 3y ago
The paper mentioned was submitted in May. I think encoder-decoder architectures still make a lot of sense for multimodal models. There are still many low hanging fruits. I have probably seen dozens of variations of chain-of-thoughts, tree-o
62.
by isaacfung 3y ago
>What's the difference between a linear map and a linear transformation? Are they not the same?
63.
by isaacfung 3y ago
For prototype/internal use or customer facing products? Zappier, airtable, retool(or open source alternatives) seem ok if you need something quick.
64.
by isaacfung 3y ago
It seems to me the interesting thing is that they showed there was some measurable change in the brain scan after six weeks. Her amygdala has reduced in size while the cingulate cortex has increased in size, although they didn't say by
65.
by isaacfung 3y ago
You are correct that SimCLR and BYOL were released one year earlier. Sorry I worded it poorly. By "at the time", I meant the period of time when masked language models just found success in NLP.
66.
by isaacfung 3y ago
This article was written in 2021 when masked language models have been successfully applied in nlp(Bert, word2vec, glove, etc). However at the time, it was unclear how the same technique could be applied to vision tasks because unlike langu
67.
by isaacfung 3y ago
Like ChoGGi said, you can use tbs=li:1 You can test the other parameters here. https://serpapi.com/playground?q=The+most+popular+fruit+in+t... Other useful parameters, you can use nfpr to force it to not correct your search
68.
by isaacfung 3y ago
Similar ideas Certified Reasoning with Language Models https://github.com/gpoesia/certified-reasoning It's based on Peano, a theorem proving environment Peano: Learning Formal Mathematical Reasoning https:&
69.
by isaacfung 3y ago
Quality matters just as much as quantity. LIMA: Less Is More for Alignment https://arxiv.org/abs/2305.11206 AlpaGasus: Training A Better Alpaca with Fewer Data https://arxiv.org/abs/2307.08701 Tex
70.
by isaacfung 3y ago
Claude instant 100k does this all the time.
71.
by isaacfung 3y ago
When ProgrammerHumor mixed with DadJokes
72.
by isaacfung 3y ago
I think MIT students are expected to have very strong self learning abilities and do a lot of experiments on their own. https://www.quora.com/Who-produces-better-computer-engineers...
73.
by isaacfung 3y ago
I wish I had these when I first started: The Missing Semester of Your CS Education https://missing.csail.mit.edu/ Check the playlists that say fundamentals https://www.youtube.com/@LearnCantrill/playlis
74.
by isaacfung 3y ago
I really enjoyed playing with BertViz. Another similar visual exploration tool I found recently is in Edwin Chen's blog. I am pretty sure this is the best explanation of LSTM. I think more tutorials should use this visual approach. ht
75.
by isaacfung 3y ago
Sometimes chatgpt fails at tasks like counting number of a letter in a short string or checking if two nodes are connected in a simple forest of 7 nodes, even with chain of thoughts prompt. Human can solve those pretty easily.
76.
by isaacfung 3y ago
Someone shared a long list of visual explanation of math concepts a few days ago. https://news.ycombinator.com/item?id=37305485 I haven't gone through all of them but I definitely recommend 3blue1brown and betterexplai
77.
by isaacfung 3y ago
I wouldn't say blogs are dead. There are still some good ones(swyx.io, simonwillison.net, eugeneyan.com, etc). There are also a lot of good content in the form of podcasts and newletters(basically blogs with regular update). I think na
78.
by isaacfung 3y ago
Please show proof of your claims. Do you really think it is feasible/a good idea that the moment someone makes a new site google should send all the traffic to that site? Please THINK how easily that would be abused.
79.
by isaacfung 3y ago
Was looking for a guide on how to make my devtools earlier. It was actually easier than I thought. https://github.com/GoogleChrome/chrome-extensions-samples/tr... You can do things like adding a new tab/pann
80.
by isaacfung 3y ago
(not algorithms, just beautiful math related visualisation) https://seeing-theory.brown.edu/ https://www.3blue1brown.com/ https://playground.tensorflow.org/ I wish there are more researches
81.
by isaacfung 3y ago
Oobabooga and fastchat support openai compatible APIs so we can use cody with open source local LLMs?
82.
by isaacfung 3y ago
I did some tests and compared with the clip demo on https://huggingface.co/spaces/vivien/clip It seems clip performs better for prompts like "three birds", "man and woman"
83.
by isaacfung 3y ago
Can you name a few successful research mathematicians who solved an important open problem by just being "lucky"?
84.
by isaacfung 3y ago
I was trying to make a web browsing ai agent a few days ago and I was shocked to find that hacker news comments are implemented as table inside table inside table.
85.
by isaacfung 3y ago
So are you guys using faiss instead of the vector search of postgres? I think vespa also supports hybrid search(it can also use late interaction model like colbert). How is retake compared to vespa? Will retake supports sparse vector models
86.
by isaacfung 3y ago
A few weeks ago, there was news that some Harvard MIT researchers had discovered a chemical cocktail that can reverse aging. https://news.yahoo.com/harvard-mit-scientists-claim-chemical...
87.
by isaacfung 3y ago
It originated from the japanese video sharing website Niconico. It gives the users a sense of participation. Some twitch streams also have on-screen elements that can be controlled by chat. Many twitch viewers enjoy chaos and like mindlessl
88.
by isaacfung 3y ago
I asked it to make a shit post on r/askReddit every minute and it got an error File "/home/glot/main.py", line 1 var BLOCK_INPUT = `"If you could instantly become an expert in any one subject, what would i
89.
by isaacfung 3y ago
I use a search engine called phind. For simple problems, usually I just have to pass in a short description of what I am doing and the error message, and it would find the relevant SO posts and summarize several potential solutions. Half th
90.
by isaacfung 3y ago
There is text under the table.

More ›