ntonozzi

9 ms·

61.
by ntonozzi 3y ago
Can you explain why? I write web apps, and I typically want to know an instant in time when something occurred and then localize the time for display. Why would I need to store a time zone for that?
62.
by ntonozzi 3y ago
Yes, it’s definitely my personal preference, I don’t mean everyone should use this exact phrase. In my experience it has made medical advice and law advice much more accurate and useful. Feel free to try it and see if it improves anything.
63.
by ntonozzi 3y ago
I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer
64.
by ntonozzi 3y ago
I've been bitten many times by the CFS scheduler while using containers and cgroups. What's the new scheduler? Has anyone here tried it in a production cluster? We're now going on two decades of wasted cores: https:/&#x
65.
by ntonozzi 3y ago
People bike and ski that fast every day with no protection other than a helmet.
66.
by ntonozzi 3y ago
I wish the writer would let us know if the total number of activations went up or down.
67.
by ntonozzi 3y ago
> Residents interested in adding vacant lots or side lots to their properties objected that those additions would have increased their tax bills as if there were a house on the added land, even if it was just an empty lot. From https:&#
68.
by ntonozzi 3y ago
By adding the features that those new age startups launch: https://www.elastic.co/guide/en/elasticsearch/reference/curr... Building a classic text search engine is way harder than building a KNN engine,
69.
by ntonozzi 3y ago
Yes! Check out this paper describing how Linear Transformers are secretly Fast Weight Programmers: https://arxiv.org/abs/2102.11174 .
70.
by ntonozzi 3y ago
What are the most impactful and likely features that you'd like to see merged into CPython?
71.
by ntonozzi 3y ago
How reliable is surgery?
72.
by ntonozzi 3y ago
It uses Claude from anthropic which has a 100k context window. It typically stuffs the 15 most relevant files into the prompt to spit out the output. It’s shockingly fast. I really like it for figuring out how something in my code base is d
73.
by ntonozzi 3y ago
Insulin resistance causes weight gain, and insulin can cause insulin resistance right? It's complicated but not implausible.
74.
What makes transformers unreasonably effective?(crypticsilicon.substack.com)
1 points by ntonozzi 3y ago|1 comments
75.
by ntonozzi 3y ago
Even with this setting enabled (for Safari), it still asks me every week or two where I want to open the link and tries to get me to download Chrome. I doubt they do this if you have Chrome enabled.
76.
by ntonozzi 3y ago
The most effective architecture for LLMs without tokenization is Meta's MEGABYTE architecture: https://arxiv.org/abs/2305.07185 . The sacrifice here is that they have two different types of layers, instead of the s
77.
Direct Preference Optimization: Your Language Model Is a Reward Model(arxiv.org)
3 points by ntonozzi 3y ago|0 comments
78.
by ntonozzi 3y ago
The episode focuses on Utah’s housing first program, not California. They also bring up that it wasn’t a panacea and in practice it took more time than expected before the cost to the public went down.
79.
by ntonozzi 3y ago
Why do people think that Meta released their model in order to get open source coders to improve their models? They will get absolutely no competitive advantage from this. Every other team developing a closed source LLM can easily copy the
80.
by ntonozzi 3y ago
Why did they say they got this working in the browser? They should be more clear about which runtimes support which system calls.
81.
by ntonozzi 3y ago
How do they get networking and sockets working in the browser? As far as I know, no browsers allow raw network access. Some apps can get around this by using things like a websocket proxy, but this relies on routing your network traffic thr
82.
by ntonozzi 3y ago
It’s great for prototyping and seeing what is possible but for running in production you’ll likely need to write it yourself, and it will just take a few minutes.
83.
by ntonozzi 3y ago
https://thedailywtf.com/articles/the-inner-json-effect
84.
by ntonozzi 3y ago
I am not an expert, but I think that they are structurally identical only in decoder only transformers like GPT. The original transformers were used for translation, and so the encoder-decoder layers use Q from the decoder layer and K from
85.
by ntonozzi 3y ago
How does this work? I've seen a cool project about forcing Llama to output valid JSON: https://twitter.com/GrantSlatton/status/1657559506069463040 , but it doesn't seem like it would be practical with rem
86.
APIs are about Policy: A pox on both houses(acko.net)
2 points by ntonozzi 3y ago|0 comments
87.
by ntonozzi 3y ago
I requested access on March 14th or 15th and got it on March 20th.
88.
by ntonozzi 3y ago
Have you tried VS Code or WebStorm? They are both independent debuggers. They are quite good for debugging in my experience. I don't know that they offer profiling capabilities.
89.
by ntonozzi 3y ago
WebStorm and VSCode both have OK debuggers, but in my experience they are even more finicky than the Chrome one, which as you noted does have issues. Firefox and Safari are likewise fine, but not as good as Chrome. More importantly though,
90.
by ntonozzi 3y ago
I’m not saying it’s easy but it’s much better than tokens IMO. I think bytes would be understandable too.

More ›