3 ms·

Report: https://github.com/swiss-ai/apertus-tech-report/raw/refs/heads/main/Apertus_Tech_Report.pdf https://github.com/swiss-ai/apertus-tech-report/raw/refs/hea

Report: https://github.com/swiss-ai/apertus-tech-report/raw/refs/heads/main/Apertus_Tech_Report.pdf https://github.com/swiss-ai/apertus-tech-report/raw/refs/hea... Key features Fully open model: open weights + open data + full training details including all data and training recipes Massively Multilingual: 1811 natively supported languages Compliant: Apertus is trained while respecting opt-out consent of data owners (even retrospectivey), and avoiding memorization of training data

esafak 1y ago
There's an interesting "Swiss AI Charter" on pg. 107.
Bromeo 1y ago
Looks like the performance is pretty decent, somewhere around Llama3.1 for general knowledge (Tables 17) but still a bit behind in Code and Reasoning (Table 18). Llama3.1 was released about one year ago.
lyu07282 1y ago
Their struggle with Nvidia driver bugs they had to work around was very relatable. You'd think if someone buys 10,752 of their high-end GPUs you'd get some support with it.
- _zoltan_ 1y ago
  did I miss a blog on this?
  - lllllm 1y ago
    we didn't have time to write one yet, but there is the tech report which has a lot of details already
    - menaerus 1y ago
      Report is packed with interesting details. Engineering challenges and solutions chapter especially show how things which are supposed and expected to work break when put through a massive scale. Really difficult bugs. Great writeup.
      - lllllm 1y ago
        thank you!
- hodgehog11 1y ago
  Agreed, but the problem seems to be even worse with AMD from what I hear, or at least it was when I checked with some of my HPC buddies a little over a year ago. Constant driver bugs and crickets from upstream "support".
- hhh 1y ago
  no, you have to pay the yearly per gpu license for that.