3 ms·
to be clear this work is not based on redpajama - though we did discuss that in the previous episode https://twitter.com/swyx/status/1648080532734087168?s=46&t=
by swyx 4y ago
to be clear this work is not based on redpajama - though we did discuss that in the previous episode https://twitter.com/swyx/status/1648080532734087168?s=46&t=90xQ8sGy63D2OtiaoGJuww https://twitter.com/swyx/status/1648080532734087168?s=46&t=9...
- GreedClarifies 4y agoOh my bad! I thought I read that, is it based upon: https://arxiv.org/abs/2211.15533 https://arxiv.org/abs/2211.15533 (The Stack) ?
- swyx 4y agopartially. Reza discussed their data pipeline in the blogpost that we reference in the show notes