ebalit

8 ms·

31.
by ebalit 3y ago
They released a reference implementation with Mistral 7B and a fork of a framework they probably used to train the Mixture of Experts for the new one. But it's still early and I guess that they kept just enough mystery to kickstart the
32.
by ebalit 3y ago
No, what better way to send a message of unity than to all send the same message?
33.
by ebalit 3y ago
I disagree. Diffusion models are trained to generate the probability distribution of their training dataset, like other generative models (GAN, VAE, etc). The fact that the architecture is a Transformer (or a CNN with attention like in Stab
34.
by ebalit 3y ago
This is not how I interpret the messages from the OpenAI team members. They are sending messages of unity, not fealty to Sam Altman. Working together brought them to the top of the world both in term of research and product. This is a dream
35.
by ebalit 3y ago
OpenAI IP is not code that you can read. It's the know-how of their team. The board tried to get a merger with Anthropic, probably the second best team in the world for this type of work. They don't seem to think they can "ju
36.
by ebalit 3y ago
They already have access to GPT4 per their agreement with OpenAI.
37.
by ebalit 3y ago
Generative methods have usually been considered unsupervised. You're right that conditional generation start to blur the lines though.
38.
by ebalit 3y ago
I've built exactly this as an experiment (code interpreter with pyodide sandbox). Should probably tidy it up to open-source it.
39.
by ebalit 3y ago
Are you sure it was a chat bot? I believe Apple customer service chat wasn't run by bots last time I needed it.
40.
by ebalit 3y ago
It really depends on the release. It's not the case for the base Mistral 7B model. But many finetuned models are released with some information about the dataset used.
41.
by ebalit 3y ago
Both would be even better but it would be much smaller progress for the open source community in comparison to the release of the weights.
42.
by ebalit 3y ago
Mistral 7B [1] and many models stemming from it are released under permissive Apache license. Some might argue that a "pure" open-source would require the dataset and the training "recipe" as it would be needed to reprod
43.
by ebalit 3y ago
I know the answer is a bit tongue in cheek, but that would be very valuable and cool, just in case someone from Cursor or Refact is reading this thread ^^
44.
by ebalit 3y ago
That's more expensive than Paris. Well it depends the type of restaurant of course. Would you have some examples in Bucharest?
45.
by ebalit 3y ago
GPT4 can be used to describe your tone by analyzing a few of your emails. Adding that to your prompt should help to get something closer to what you would write, and you can iterate on this description if needed. Source: I built a chatgpt u
46.
by ebalit 3y ago
I saw once the proposal that revenues from a carbon tax should be redistributed equally. It seems like a practical implementation of a bonus-malus system.
47.
by ebalit 3y ago
Yes that was an interesting part. Here in France it seems like the apps say the delivery should be upstairs if the customer asked for that, but drivers have the same issue with going upstairs as in Brazil. And I can see why if they get paid
48.
by ebalit 3y ago
It seems like "upstairs" delivery should be a paid option and be explicit in the ordering and delivery apps.
49.
by ebalit 3y ago
Great insights. It should be the top comment IMO. That's the kind of field-tested perspectives that give HN its value.
50.
by ebalit 3y ago
I wrote about that "platform play" a few month ago with a different take [0]. They could have made a "Connect with OpenAI" scheme so that developers can use the user OpenAI API directly. That way developers could focus o
51.
by ebalit 4y ago
A "bunch of words" has been the standard for the dissemination of scientific results for decades. Worse, those results are often locked behind a paywall... Publishing models is definitely better than only a paper, but I think you&
52.
by ebalit 4y ago
What kind of payment method are you looking for?
53.
by ebalit 4y ago
It looks like a description of Speculative Sampling. There's a recent paper from DeepMind about this in the context of LLM [0], although it's not a completely new idea of course. The potential for speedup according to their paper
54.
by ebalit 4y ago
It's a side effect of the way the text input is represented before being used by the model. It doesn't get the text as a sequence of chars but as a sequence of tokens. This paper [1] shows that giving character-level awareness to
55.
by ebalit 4y ago
Reactivated [1] looks similar in spirit, but using React on the frontend. I haven't tested it yet but the idea is very interesting. [1] https://www.reactivated.io/
56.
by ebalit 4y ago
Not only new users. I was logged off after reloading the page.
57.
by ebalit 4y ago
It's not AI but it's definitely a tool to build AI systems. Similarly, GPUs or CUDA aren't AI in themself but are fundamental in the day to day work of AI practitioners.
58.
by ebalit 4y ago
It might be very interesting to write the "no value" comments automatically. It can help us focus on and emphasize the part that we think is missing from the autogenerated ones.
59.
by ebalit 5y ago
This is the first time I read this and I'm very surprised that it is the case. Would you have a source I could read to learn more about this.
60.
by ebalit 5y ago
Given the wavy logo, I guess it reads as "Seven Seas"?

More ›