devetec

6 ms·

31.
by devetec 5y ago
You can train models on copyrighted materials. https://towardsdatascience.com/the-most-important-supreme-co...
32.
by devetec 5y ago
Distributed GPT training doesn't really work (sadly). Maybe someone will get a good solution to that, though.
33.
by devetec 5y ago
There is a FOSS version of GPT-3 being worked on by EleutherAI, but they are only at 6 billion parameters so far, while the largest model of GPT-3 is 175 billion (more parameters is better (usually)). EleutherAI is getting more compute fr
34.
by devetec 5y ago
Seems reasonable, however you can make the case that this isn't the course of action that should be taken. But this is Singapore, the country with only 2 infections per 100k people every week. Along with their high vaccination rates, a
35.
by devetec 5y ago
Now, you can get digital e-cards from many major libraries around the US without even having to step foot in a library, giving you access to e-books galore. I think that the library card won't die, but the fact that e-cards are now a c
36.
Curious Alaska: The state used to span 4 time zones. What happened?(adn.com)
1 points by devetec 5y ago|0 comments
37.
Can we create new senses for humans? (2015) [video](ted.com)
3 points by devetec 5y ago|0 comments
38.
by devetec 5y ago
Doesn't something like that already exist: Lenovo's Yoga Book C930? It had 2 screens, with one being an e-Ink keyboard. Very useful tech.
39.
by devetec 5y ago
Also filled with many nuts, though I wish more people would actually use it. It's a very good alternative to YouTube though.
40.
by devetec 5y ago
...wow. Congratulations!
41.
by devetec 5y ago
Technology tends to follow a sigmoid curve. First nothing happens, and then it seems like the world is changing and it is unstoppable, and then it falls into a new normal, not changing much. We never know when it slows down, reaching the th
42.
by devetec 5y ago
Large enough dataset + some way to see context. There could be an ambiguous word that is only found through accompanying media. A multimodal AI would be needed for that task. Maybe something like https://blog.google/products
43.
by devetec 5y ago
It's not an API. It's just a demo site :)
44.
by devetec 5y ago
They're not a company. They made some decision to not add more to the Pile, as they think it is complete enough. However, you could go to the Discord and propose a restarting of the Pile project, they allow those. On the Github, it loo
45.
by devetec 5y ago
Nope, probably not. It's using JAX, which works on both GPUs and TPUs.
46.
by devetec 5y ago
Part of the Pile dataset is the Ubuntu IRC stuff