npsomaratna

8 ms·

61.
by npsomaratna 3y ago
Almost sounds like a piece from the BOFH
62.
by npsomaratna 3y ago
Whoops, sorry. 34b :)
63.
by npsomaratna 3y ago
Not necessarily true anymore. As a counterexample, consider CodeLlama 33b, which is quite good (and which has replaced GPT-4 for my coding assistant needs). OpenAI's models are likely to remain the best, but I see open models catching
64.
by npsomaratna 3y ago
Made me think of touch typing. I can touch type at a decent speed (~100 wpm). However, if I let myself think about where the various letters are on the keyboard, I stumble and start having trouble typing. I need to clear my mind to start to
65.
by npsomaratna 3y ago
Understood, thank you. That makes sense.
66.
by npsomaratna 3y ago
Interesting, thank you. I wonder if that that area had stagnant water, allowing mosquito growth.
67.
by npsomaratna 3y ago
This is fantastic. One thought that came to my mind is: would mosquito borne diseases have been a problem in city surrounded by so much water?
68.
by npsomaratna 3y ago
I reevaluated this in my 20s and 30s - and I still learned the true meaning only just now.
69.
by npsomaratna 3y ago
Came here to say this. My understanding is that locked Macbooks are unusable, only have salvage value, and are therefore sold at pennies on the dollar. (Many such laptops are quite likely stolen.) When the OP mentioned a different login, et
70.
by npsomaratna 3y ago
Understood, thank you. I appreciate the explanation.
71.
by npsomaratna 3y ago
Can you explain more about the voltage/clock band please? Do you mean that they are very energy inefficient?
72.
by npsomaratna 3y ago
Yes, this was interesting to learn. On a tangent: it's awe-inspiring just how much older the Egyptian pyramids are, vis-a-vis the other pyramidal structures listed there.
73.
by npsomaratna 3y ago
Came here to say that. I believe that AI assistance will make a big difference to many professions going forward—certainly any profession that has to deal with large volumes of information, whether it's education, knowledge, or red tap
74.
by npsomaratna 3y ago
I was in an apartment building in Santiago, Chile—in fact, pretty much all of the earthquakes I experienced were in Santiago. Never heard any (out of the normal) sounds. Is that because the buildings were built to handle earthquakes?
75.
by npsomaratna 3y ago
I remember the first earthquake I experienced. Same feeling: everything around me started shaking; for several seconds, I couldn't figure out what was happening; and then it suddenly hit me: it's an earthquake. (I'm from a co
76.
by npsomaratna 3y ago
NTSB investigates/provides advice on civil aviation and commercial space accidents as well—not just land stuff.
77.
by npsomaratna 3y ago
Possibly a lot. See: https://espadrine.github.io/blog/posts/chinchilla-s-death.ht...
78.
by npsomaratna 3y ago
I’m wondering about economics though. The cost of solar panels vis-a-vis the increased range of only 5000km per year. Even if you amortize this cost over several years, and even in climes with more sun, would the economic math work out?
79.
by npsomaratna 3y ago
Sure. So, my startup[1] does data processing for clients in aviation and finance. Due to security, legal, and regulatory requirements, sending our code on to a third party (e.g., OpenAI) is a no-go. Thanks to CodeLlama (the WizardCoder fine
80.
by npsomaratna 3y ago
WizardCoder is fantastic. I use it as my local "code assistant" LLM[1]. I'd really like to hear from the Phind team about this. Using someone else's work without attribution isn't cool (assuming this thread is true)
81.
by npsomaratna 3y ago
Thank you. I had to reduce the context length to get this to work without crashing (from 16k to 8k)—and I'm seeing the ~100% speed up you mentioned. However, when I run the LLM, OSX becomes sluggish. I assume this is because the GPU&#x
82.
by npsomaratna 3y ago
Do a search on the HuggingFace models page, e.g.: https://huggingface.co/models?sort=trending&search=wizardcod...
83.
by npsomaratna 3y ago
Yes. In the llama.cpp server command, specify the number of layers you'd like offloaded to your GPU via the -ngl parameter, e.g.: ./server -t 8 -m models/wizardcoder-python-34b-v1.0.Q4_K_S.gguf -c 16384 --mlock -ngl 60
84.
by npsomaratna 3y ago
M1 with 32 GB RAM. I can just about fit the 4-bit quantized 33 GB Code Llama model (and it's finetunes, e.g. WizardCoder, etc.) into memory. It's somewhat slow, but good enough for my purposes. Edit: when I bought my Macbook in 20
85.
by npsomaratna 3y ago
You don't need so many layers of stuff (or API keys, signups, or other nonsense). Llama.cpp (to serve the model) + the Continue VS Code extension are enough. The rough list of steps to do so are: Part A: Install llama.cpp and get i
86.
by npsomaratna 3y ago
Exactly. LLMs are useful out of the box—and that enables tons of use-cases that just weren't economical (or even possible) with older models.
87.
by npsomaratna 3y ago
Disagree. As a lawyer I use LLMs with RAG to help me surface information all the time. Often, this allows me to find niche case law that I just wouldn't have had the time to find on my own. However, I double-check everything, and read
88.
How to Roman Republic 101, Part IIIb: Imperium(acoup.blog)
3 points by npsomaratna 3y ago|0 comments
89.
by npsomaratna 3y ago
Isn't the Chinchilla estimate considered to be wrong now? https://espadrine.github.io/blog/posts/chinchilla-s-death.ht...
90.
by npsomaratna 3y ago
Non-US doctor here. Completely agree. Licensing exams mainly confirm that the aspiring doctor won't harm/kill patients by mistake. Specialist-level exams assess standard of care.

More ›