3 ms·

martin here from the apertus team, happy to answer any questions if i can. the full collection of models is here: https://huggingface.co/collections/swiss-ai/a

by lllllm 1y ago

martin here from the apertus team, happy to answer any questions if i can. the full collection of models is here: https://huggingface.co/collections/swiss-ai/apertus-llm-68b699e65415c231ace3b059 https://huggingface.co/collections/swiss-ai/apertus-llm-68b6... PS: you can run this locally on your mac with this one-liner: pip install mlx-lm mlx_lm.generate --model mlx-community/Apertus-8B-Instruct-2509-8bit --prompt "who are you?"

trcf22 1y ago
Great job! Would it be possible to know what was the cost of training such a model?
- menaerus 1y ago
  From their report: > Once a production environment has been set up, we estimate that the model can be realistically trained in approximately 90 days on 4096 GPUs, accounting for overheads. If we assume 560 W power usage per Grace-Hopper module in this period, below the set power limit of 660 W, we can estimate 5 GWh power usage for the compute of the pretraining run.
trickstra 1y ago
Hi, your "truly open" model is "gated" on Huggingface, restricting downloads unless we agree to "hold you harmless" and share our contact info. Can you fix this please, either by removing the restriction, or removing the "truly open" claim?
- lllllm 1y ago
  We hear you, nevertheless this is one of the very few open-weights and open-data LLMs, and the license is still very permissive (compare for example to Llama). Personally of course I'd like to remove the additional click, but the universities also have a say in this.
  - dougnd 1y ago
    This project looks awesome! In the US, many state governments have anti-indemnify laws that restrict the state government agencies (including state universities) from agreeing to contracts and agreements with such language. I'd love to make this available to researchers at my university, but I'm not sure I can click through such an agreement (similar problems exist with other LLMs). It is Apache 2 and I don't see anything that prohibits another contracting party from agreeing to the Apertus LLM Acceptable Use Policy and redistributing with just Apache 2 and without the AUP. Maybe this provides a solution? Unless I'm missing something?
    - lllllm 1y ago
      yes this seems a good way to go. for example you can already find many quantized versions under https://huggingface.co/models?search=apertus%20mlx https://huggingface.co/models?search=apertus%20mlx and elsewhere
  - trickstra 1y ago
    Ok so why keep calling it "truly open" then? It's an obvious lie and nobody is forcing you to say it. It benefits your marketing, sure, but it harms everyone else by diluting the meaning of the term "open". So stop doing that please.

by lllllm 1y ago

trcf22 1y ago

Great job! Would it be possible to know what was the cost of training such a model?

menaerus 1y ago
From their report: > Once a production environment has been set up, we estimate that the model can be realistically trained in approximately 90 days on 4096 GPUs, accounting for overheads. If we assume 560 W power usage per Grace-Hopper module in this period, below the set power limit of 660 W, we can estimate 5 GWh power usage for the compute of the pretraining run.

trickstra 1y ago

Hi, your "truly open" model is "gated" on Huggingface, restricting downloads unless we agree to "hold you harmless" and share our contact info. Can you fix this please, either by removing the restriction, or removing the "truly open" claim?

lllllm 1y ago
We hear you, nevertheless this is one of the very few open-weights and open-data LLMs, and the license is still very permissive (compare for example to Llama). Personally of course I'd like to remove the additional click, but the universities also have a say in this.
- dougnd 1y ago
  This project looks awesome! In the US, many state governments have anti-indemnify laws that restrict the state government agencies (including state universities) from agreeing to contracts and agreements with such language. I'd love to make this available to researchers at my university, but I'm not sure I can click through such an agreement (similar problems exist with other LLMs). It is Apache 2 and I don't see anything that prohibits another contracting party from agreeing to the Apertus LLM Acceptable Use Policy and redistributing with just Apache 2 and without the AUP. Maybe this provides a solution? Unless I'm missing something?
  - lllllm 1y ago
    yes this seems a good way to go. for example you can already find many quantized versions under https://huggingface.co/models?search=apertus%20mlx https://huggingface.co/models?search=apertus%20mlx and elsewhere
- trickstra 1y ago
  Ok so why keep calling it "truly open" then? It's an obvious lie and nobody is forcing you to say it. It benefits your marketing, sure, but it harms everyone else by diluting the meaning of the term "open". So stop doing that please.