Garcia98

7 ms·

31.
Spain calls snap election after conservative and far-right wins in local polls(theguardian.com)
2 points by Garcia98 3y ago|0 comments
32.
Impossible Distillation: From Low-Quality Model to High-Quality Dataset & Model(arxiv.org)
1 points by Garcia98 3y ago|0 comments
33.
by Garcia98 3y ago
You can also submit this Google Forms buried three links deep in their privacy policy: https://docs.google.com/forms/d/e/1FAIpQLScrnC-_A7JFs4LbIuze...
34.
by Garcia98 3y ago
Note that the FLAN-T5 variant in 10th place is 3B parameters large, there is another FLAN-T5 variant that has 11B parameters that should perform better (and the fact that a 3B model is able to compete with Alpaca-13B is impressive by itself
35.
Alexandria, an open-source initiative to embed the internet(alex.macrocosm.so)
3 points by Garcia98 3y ago|0 comments
36.
QLoRA: Efficient Finetuning of Quantized LLMs(arxiv.org)
315 points by Garcia98 3y ago|107 comments
37.
Microsoft Build brings AI tools to the forefront for developers(blogs.microsoft.com)
13 points by Garcia98 3y ago|3 comments
38.
by Garcia98 3y ago
It is the same in Spain. Fun story, I had a professor in university that tried to force us to buy his own book for his course, refusing to provide notes or any other free alternatives, and for the final exam he allowed anyone to bring in hi
39.
by Garcia98 3y ago
I have no clue where the data for Spain comes from, in June 2022 the average price for the regulated market was 0.291347 €/kWh[0], that's ignoring the free market rates which are what 70% of Spaniards use (and they are cheaper whe
40.
by Garcia98 3y ago
Spaniard here, on my last bill I paid 0.120268 €/kWh, admittedly I'm on the free market but even on the regulated market the average price for March was 0.158719 €/kWh. Is electricity really that cheap in the US? This chart s
41.
RWKV – An RNN with the Advantages of a Transformer(huggingface.co)
6 points by Garcia98 3y ago|0 comments
42.
by Garcia98 3y ago
Providing a checksum along with the binary singlehandedly solves your concerns, and you can add gpg signatures if you want.
43.
by Garcia98 3y ago
The author is overly optimistic with the current state of open source LLMs, (e.g., Koala is very far away from matching ChatGPT performance). However, I agree with their spirit, Google has been one of the most important contributors to the
44.
LLM leaderboard based on Elo rating and community input(chat.lmsys.org)
2 points by Garcia98 3y ago|0 comments
45.
by Garcia98 3y ago
The most notable paper is probably the one that defined the concept of transformers, Attention Is All You Need: https://arxiv.org/abs/1706.03762
46.
by Garcia98 3y ago
LaMini-Flan-T5-783M outperforming Alpaca-7B in human evaluation is impressive, and I wish Flan-T5 got some more love from the community, there's too much buzz around Llama based models that could be invested into improving a more open
47.
WebGPT: Run GPT2 on the Browser with WebGPU(github.com)
5 points by Garcia98 3y ago|0 comments
48.
by Garcia98 3y ago
I use a GPU server and runtime is not free unfortunately.
49.
by Garcia98 3y ago
5-shot prompting.
50.
by Garcia98 3y ago
I disagree, they made the decision to use datasets with restrictive licensing, jumping the alpaca/gpt4all/sharegpt bandwagon. They also chose to toot their horn about how open-source their models are, even though for practical use
51.
by Garcia98 3y ago
I would have compared it to the fine-tuned version if it had been released under a truly open-source license. I think developers implementing LLMs care more about licensing than about the underlying details of the model. Also t5-base is 220
52.
by Garcia98 3y ago
I really dislike this approach of announcing new models that some companies have taken, they don't mention evaluation results or performance of the model, but instead talk about how "transparent", "accessible" and &
53.
by Garcia98 4y ago
What's the most cost-effective alternative to Paperspace? I had a nightmarish experience with them last week after my account got locked up twice when I was training a model with a 1.5 GB dataset that somewhere contained the string &qu
54.
LangChainJS Support for Multiple JavaScript Environments(blog.langchain.dev)
2 points by Garcia98 4y ago|0 comments
55.
by Garcia98 4y ago
Sure, but gddccontrol has a GUI, has been supported since 2004 and works fine in 2023, that's why I find it a bit odd that he didn't know what to recommend to Linux users until now.
56.
by Garcia98 4y ago
gddccontrol has been around for ages on Linux and it's not exclusive to a single desktop environment (and I'm sure there's a plethora of alternatives, but that's just the one I use).
57.
by Garcia98 4y ago
I've seen this question asked repeatedly in many LLaMa threads, currently the best models that are truly open are the released models from the Flan family by Google, which includes Flan-T5[0] and Flan-UL2[1]. According to its paper, Fl
58.
by Garcia98 4y ago
It's all client side, it downloads a model and performs the inference using ONNX runtime (which uses WASM).
59.
by Garcia98 4y ago
Sorry for the late reply, as I said Flan-UL2 (or Flan-T5 if you want lighter models) fine-tuned against a dataset like CodeAlpaca's[0] is probably the best solution if it's intended for commercial use (otherwise LLaMa should perfo
60.
by Garcia98 4y ago
Google's Flan-T5, Flan-UL2 and derivatives, are so far the most promising open (including commercial use) models that I have tried, however they are very "general purpose" and don't perform well in specific tasks like co

More ›