3 ms·
Very annoying namespace conflict since a package called "mamba" (faster reimplementation of the python conda package manager) already existed for awhile before
by Der_Einzige 3y ago
Very annoying namespace conflict since a package called "mamba" (faster reimplementation of the python conda package manager) already existed for awhile before this architecture was even dreamed up.
https://github.com/mamba-org/mamba https://github.com/mamba-org/mamba
Beyond that, I'll care about an alternative to transformers when it shows superior performance with an open source 7b-34b model compared to transformer model competitors. So far this has not happened yet
- woadwarrior01 3y agoI use the former and have been experimenting with the latter. Fortunately, the contexts are separate enough that they never come up in the same sentence.
- amelius 3y agoI was using mamba to install mamba the other day, when suddenly I had to run for a live mamba.
- jasonjmcghee 3y ago> Please don't complain about tangential annoyances—e.g. article or website formats, name collisions, or back-button breakage. They're too common to be interesting.
- lpasselin 3y agoThe mamba paper shows significant improvements in all model sizes, up to 1b, the largest one tested. Are there any reason why it wouldn't scale to 7b or more? Have they tried it?
- samus 3y agoThat's the issue - I keep hearing that it is beyond small research group's budget to meaningfully train such a large model. You don't just need GPU time, you also need data. And just using the dregs of the internet doesn't cut it.