pilotneko

8 ms·

31.
by pilotneko 3y ago
For what it is worth, I threw your statement into my internally hosted interface with Claude. Claude Instant (v1.2 balked). Claude Sonnet did not. # Claude Instant ## User Given that Gemini, Claude, and ChatGPT are all relatively similar in
32.
by pilotneko 3y ago
Not really, that sounds like the kind of person who starts a sentence without knowing where it'll end up :-) Kidding aside, I think this a version of differences in visual imagery between individuals.
33.
by pilotneko 3y ago
Can confirm, my local Checkers has a voice assistant for orders. Typically only a single person working the kitchen and register.
34.
by pilotneko 3y ago
This project is using Mistral, not Phi-2. However, it is clear from reading the README.MD that this runs locally, so your point still stands. That being said, it looks like all models have been optimized for TensorRT, so the Whisper compone
35.
by pilotneko 3y ago
Crazy, but even AWS resources are not unlimited. In 2023, I experienced multiple days where g4dn instances were not available in us-east-1 (in any AZ).
36.
by pilotneko 3y ago
Isn’t 8_0 8-bit quantization?
37.
by pilotneko 3y ago
I haven’t looked at the structure carefully, but It’s hard to guess there are shared layers between models. Likely the input layers for sure, since there is no need to tokenize separately for each model (unless different models have special
38.
by pilotneko 3y ago
It's not sped up. I tried it locally last night and it was just as fast. Running on Windows 11 w/ a RTX 3090.
39.
by pilotneko 3y ago
Llama 2 does, but Llama does not. Vicuna is based on Llama.
40.
by pilotneko 3y ago
Not the original poster, but you have it more or less correct. An order of magnitude is 10X. Orders of magnitude just refers to “at least 100X.” Colloquially, orders of magnitude just means “significantly more/less.”
41.
by pilotneko 3y ago
I think both Candle and Hugging Face Text Generation Inference leverage Rust.
42.
by pilotneko 3y ago
To be fair, iOS 17 is not out yet. If you are currently using it, you are beta testing it.
43.
by pilotneko 3y ago
If you properly deidentify the patient information, then yes, you are not sending PHI to Google. Proper deidentification is tricky though: https://www.hhs.gov/hipaa/for-professionals/privacy/special-...
44.
by pilotneko 3y ago
I assume you and your wife are not in the US. Stateside, you would need a Business Associate Agreement to send protected health information to a third party.
45.
by pilotneko 3y ago
Because sometimes you don’t want to write your own training loops, you just want a working method to train a model.
46.
by pilotneko 3y ago
Do you typically run your market research on Uber drivers? Maybe you ask the bathroom attendant for tips on Crypto to purchase? There are physical limitations to construction. Sometimes things take time to set and/or cure. Even when do
47.
by pilotneko 3y ago
Personally, I use notebooks to do exploratory data analysis and to get model training configured. Any large-scale model training event is converted to a script, and nothing production-facing is in a notebook.
48.
by pilotneko 3y ago
OpenAI will sign a business agreement and run an instance with isolated servers, for HIPAA compliance. That being said, you can run LLMs on-prem.
49.
by pilotneko 3y ago
The latter, not the former. The former is extraction, not prediction. A lot of factors go into predicting the post-acute care route that results in the best outcome. You are correct that it would be possible to create features using an LLM,
50.
by pilotneko 3y ago
Here is a very real example where 32k tokens is not enough: predicting discharge disposition for a long stay inpatient. A 30-day hospital stay can produce over 1,000 clinical notes.
51.
by pilotneko 4y ago
Yeah, during the Manhattan Project he broke into everyone’s locked filing cabinets to prove that the security measure was basically for show.
52.
by pilotneko 4y ago
I mean, you wrote code for a weapon system. Did you think only “bad guys” were going to get killed?
53.
by pilotneko 4y ago
Because the measurement itself was noisy, and unless the operational metric was updated, it would never be stable. I’ve experienced this hell, where a client is “red” or “yellow” based on an a phone call with an account manager. That asses
54.
by pilotneko 4y ago
Sometimes directly from the publisher. Anecdotal example, I like an album by a band Tap Tap. They were short lived and based out of the UK. US Spotify does not have that album, but I can purchase it from their publisher at the time (ironica
55.
by pilotneko 4y ago
There is a ton of stuff not on Spotify. It might align well with your tastes, but they are subject to licensing issues. I’m not even talking about live versions or sessions, but bog-standard albums.
56.
by pilotneko 4y ago
I know you are just arguing to argue at this point, but you can’t really think that creating a disease to cause crippling pain in livestock will make it more acceptable to eat them.
57.
by pilotneko 4y ago
I would suggest sentence tokenization followed by clustering to pull the most representative sentence from each cluster. Unless you want to go abstractive, that is. If you run into issues with the token limit, there are some nice architectu
58.
by pilotneko 4y ago
In the US, both Beyond and Impossible have very good bratwurst-style sausages. Like you said, sausage is apparently very forgiving when it comes to replacing the meat.
59.
by pilotneko 4y ago
Making a sausage is a form of processing. Sausage is a processed food, no matter what. The distinction is whether or not it is highly processed (i.e., amount of additives).
60.
by pilotneko 4y ago
Likely only summarizing the abstracts.

More ›