5 ms·
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
by swiftcoder 2mo ago
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
- jonas_scholz 2mo agoagree. I have a usecase for a bigger open-weight model hosted by an EU company and the selection isnt really great, hard to make the regulatory gods (and the devs) happy at the same time right now
- sofixa 2mo agoScaleway have two separate (one fully managed one a bit less) services for that: https://www.scaleway.com/en/generative-apis/ https://www.scaleway.com/en/generative-apis/ https://www.scaleway.com/en/inference/ https://www.scaleway.com/en/inference/
- jonas_scholz 2mo agoyea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
- PaoloBarbolini 2mo agoThey confirmed on LinkedIn that they are working on it. Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-caching-to-reduce-input-tokens-cost https://feature-request.scaleway.com/posts/1251/prompt-cachi...
- deleted 2mo ago[deleted]
- hoppp 2mo agoScaleway does that already but competition is always good.
- Aldipower 2mo agoDoes not scale in my pocket unfortunately.
- atherton94027 2mo agoNever understood why hetzner gets brought up so positively here when there are dozens of EU competitors who are just as good and don't run 7 year old discounted servers
- MathiasPius 2mo agoBecause nobody ever mentions them by name, leaving all of us in the dark.
- atherton94027 2mo agoUpcloud, Scaleway, Clever cloud, etc.
- ffsm8 2mo agoThese are all solid choices, but significantly less performance/€ Understandably too, because hetzner is running things on consumer hardware vs the enterprise hardware the others use
- swiftcoder 2mo ago> don't run 7 year old discounted servers That's a pretty big part of why, honestly. How many of us are running server workloads that actually need the price/performance tradeoff of cutting edge server hardware?
- atherton94027 2mo agoWe're not even talking cutting edge. If you browse hetzner's auction page you can see they're renting machines with almost decade old CPUs like the Xeon W-2145 or i7 6700. That's just a lot of old hardware..
- idiotsecant 2mo agoSo? If it's cheaper and gets the job done who cares?
- eliaskg 2mo agoOVH already provides this → https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalog/ https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalo... It works great.
- someone4958923 2mo agoIONOS (1&1) also offers inference hosted in europe/germany: https://cloud.ionos.com/managed/ai-model-hub https://cloud.ionos.com/managed/ai-model-hub
- npodbielski 2mo agoNo Qwen 3.6? Why?
- rf15 2mo agoBecause they're not serious about their offerings. They are an ISP and like to provide/bundle very basic additional services (hosting, mail, etc. and now 'AI')
- rf15 2mo agoIONOS is established, but uh, 'respectable' is another question...
- ghaering 2mo agoSTACKIT also offers model serving.
- t857295612 2mo ago[dead]
- beernet 2mo agoTo all mentions of IONOS / StackIT / OVH: All of these are lightyears behind US/China LLM offerings. None of them offer any model close to open-source SOTA. Runtime and reliability is a disaster and sure enough you have to pay a "sovereignty" mark up.
- expedition32 2mo agoFreedom isn't free. Unless you want to live in a world were your children have to read the bible in class sacrifice has to be made.
- beernet 2mo agoPaying a premium for inferior service quality is not exactly freedom
- frizlab 2mo agoI live in the EU and want to live in a world where my children actually CAN read the Bible in class. However that’s not really possible anymore… (Also no, modern science is (still) not incompatible with (the Christian) religion. I want my children to have both, as do I, or at least be taught both, so they can decide for themselves what they want when they are grown enough to do so.) Who is sacrificing what, really?