montebicyclelo

7 ms·

31.
by montebicyclelo 1y ago
Yeah... Looks like can get about $1/hr for 10 small VMs, ($0.10 per VM). So for $3000, that's 3000 hours, or 125 days, (if just wastefully leave them on all the time, instead of turning them on when needed). Say you wanted to play
32.
by montebicyclelo 1y ago
I stopped using apple's notes app with an ipad pen after it lost 20 minutes of my handwritten notes when trying to sync them. (Which fits the theme of apple losing people's stuff.)
33.
by montebicyclelo 1y ago
I think OP is suggesting that Apple / AMD / Intel do the work of integrating their NPUs into popular libraries like `llama.cpp`. Which might make sense. My impression is that by the time the vendors support a certain model with th
34.
by montebicyclelo 1y ago
Although note — people are likely to be infuenced by the recent prevalence of em dash to use it more in their own writing nowadays
35.
by montebicyclelo 1y ago
> the Python code in the previous example is still readable Yes, I agree with the author, list comprehensions are readible, and I'd add, practical. > it gets worse as the complexity of the logic increases len(list(filter(la
36.
by montebicyclelo 1y ago
So, they are included in the normal backpropagation of the model. But there is no one-hot encoding, because, although you are correct that it is equivalent, it would be very inefficient to do it that way. You can make indexing differentiabl
37.
by montebicyclelo 1y ago
Nice tutorial — the contextual vs static embeddings is the important point; many are familiar with word2vec (static), but contextual embeddings are more powerful for many tasks. (However, there seems to be some serious back-button / br
38.
by montebicyclelo 1y ago
I always found that badly named things did make learning harder / more jarring; especially if an explanation for the incongruous name wasn't provided.
39.
by montebicyclelo 1y ago
> if the weights are taken from HF then what's the implementation for The weights are essentially a bunch of floating point numbers, (grouped into tensors). The code says what operations to do with the weights. E.g. say you load mat
40.
by montebicyclelo 1y ago
TLDR, unexpected blank fields > policy change was inserted into the regional Spanner tables > This policy data contained unintended blank fields > Service Control... pulled in blank fields... hit null pointer causing the binaries
41.
by montebicyclelo 1y ago
Forced password rotation and expiry seems the bigger problem; given that it causes people to get locked out so often, (e.g. if pw expires when on holiday), — often then requiring travelling to IT, or at least a few hours trying to get IT on
42.
by montebicyclelo 1y ago
I guess where it could potentially bring value is by: Removing a major concern that prevents individuals / small customers from using GCP in the first place; so more of them do use it That could then lead to value in two ways: - They m
43.
by montebicyclelo 1y ago
Not providing a cap on spending is a major flaw of GCP for individuals / small projects. With Cloud Run, AFAIK, spending can effectively be capped by: limiting concurrency, plus limiting the max number of instances it can scale to. (Bu
44.
by montebicyclelo 1y ago
Reason Cloud Run is so nice compared to other providers is that it has autoscaling, with scaling to 0. Meaning it can cost basically 0 if it's not being used. Also can set a cap on the scaling, e.g. 5 instances max, which caps the max
45.
Gridnotes – an infinite 2D text editor(sidsite.com)
4 points by montebicyclelo 1y ago|0 comments
46.
by montebicyclelo 1y ago
The industry standard has been Poetry for a good few years now, and UV is the newer exciting tool in this space. Both create universal lockfiles from more loosely specified dependencies in pyproject.toml resulting in reproducible environmen
47.
by montebicyclelo 1y ago
> The difference between spoilage and fermentation/aging is whether humans like the result at the end Is not whether it makes humans unwell quite an important factor..
48.
by montebicyclelo 1y ago
Not sure "original concept" is quite right, given it had been tried earlier, e.g. here's a 2023 attempt to get gpt-4-vision to play pokemon, (it didn't really work, but it's clearly "the concept") https:&
49.
by montebicyclelo 1y ago
Related to ways of understanding neural networks, I've seen these views expressed a lot, which to me seem like misconceptions: - LLMs are basically just slightly better `n-gram` models - The idea of "just" predicting the next
50.
by montebicyclelo 1y ago
> then go on to explain how they aren't useful in any field whatsoever > Where are the AI-driven breakthroughs > are we just using AI to remix existing general knowledge, while making no progress of any sort in any field using
51.
by montebicyclelo 1y ago
Language vocab seems a good use case. What other things are people here using spaced repition for?
52.
by montebicyclelo 1y ago
> The results we obtained in Section 7 imply that, at least on simple datasets like TinyStories and Wikipedia, LLM predictions contain much quantifiable structure insofar that they often can be described in terms of our simple statistica
53.
by montebicyclelo 1y ago
Edit: increased the validation to 10,000 life grids for 100 steps, (taking 16 minutes to check), which is hopefully somewhat more convincing. That's 1,000,000 life steps computed without errors in total. Plus 32,000 steps computed with
54.
by montebicyclelo 1y ago
> This is such an insane statement. In what way? Maybe you mean something different when you say computing the game of Life algorithm.
55.
by montebicyclelo 1y ago
> I really didn't want to root the phone, but nothing else did what I needed Shame that rooting is such a pain, and risks bricking the device. (Apparently Google's introduction of an anti-rollback bootloader this month has caus
56.
by montebicyclelo 1y ago
Hmm, just my intuition: training this model was very sensitive to the initial seed and training hyperparameters. It struggles to actually get to the 3x3 conv solution; but once it gets close to that things move much more quickly. This can k
57.
by montebicyclelo 1y ago
> the paper does not investigate whether the resulting NN actually performs the game of life algorithm How could it not be computing the game of life algorithm? Given that it gets 100% accuracy over multiple steps on a bunch random game
58.
by montebicyclelo 1y ago
it won't AFAIK, without some extra hand coded logic
59.
by montebicyclelo 1y ago
It wasn't obvious that a transformer could do this, and learn to produce conv via attention
60.
by montebicyclelo 1y ago
> it's brute forcing a small grid If by small grid you are referring to the attention matrix plot shown, then that is not a correct interpretation. That diagonal-like pattern it learns, is 3x3 convolution, so it can compare the neig

More ›