5 ms·
Kimi K3 Now Available via Telnyx Inference API
Moonshot AI released open weights for Kimi K3 today and it's live on Telnyx Inference. The architecture and Moonshot's own benchmarks are in their technical blog. This post is about running it on Telnyx.
What we are adding: K3 is now available via the Telnyx Inference API, hosted on GPUs that we own and operate.
This matters due to the size of this model. A 2.8T model needs dedicated infra to serve well. Because we own and operate the GPUs, we can contorl throughput. with no inter-provider hops and no cloud tenant, latency is minimized.
We have GPUs in each of the US, EU, APAC, and MENA. Inference runs in the region you pick, with zero data retention. We do not store prompts or completions after the response returns.
Because we own the infra, the per-token price reflects the cost of running the model, not the cost of renting someone else's plus their margin.
We have not benchmarked K3 ourselves yet. Moonshot's own numbers and early third-party evaluations put it at frontier level for coding and agentic work, trailing only Claude Fable 5 and GPT 5.6 Sol on aggregate. Full breakdown in their blog.
Pricing on Telnyx: $2.70/1M input tokens, $13.50/1M output tokens, $0.27/1M cached input tokens. Prompt caching enabled by default. Served via an OpenAI-compatible endpoint so you can test easily.
Model ID: [MODEL_ID] API: https://api.telnyx.com/v2/ai/chat/completions https://api.telnyx.com/v2/ai/chat/completions Docs: https://developers.telnyx.com/docs/inference https://developers.telnyx.com/docs/inference Technical blog (Moonshot): https://www.kimi.com/blog/kimi-k3 https://www.kimi.com/blog/kimi-k3
- theredsix 3mo ago10% cheaper than official! Let the inference pricing wars begin!
- deleted 3mo ago[deleted]
- norbert515 3mo agoI'm really curious how far and how fast prices will drop (if at all)!
- deleted 3mo ago[deleted]
- buffer_overlord 3mo agoThat’s huge
- smallerize 3mo agoVery cool. What are your throughput and latency like?
- LoganDark 3mo agoTelnyx was cool until they started demanding KYC. I would use them for burner phone numbers until they started saying they needed my government ID. Fuck that. OVH same thing. Tried to buy a VPS from them some years back and they said no VPS unless I provided ID. Would not refund me. Tried to dispute but my bank just gave me a credit instead.
- nujabe 3mo agoThere were new regulations passed to combat robocalls that forced these companies to tighten up.
- oxidant 3mo ago10DLC in North America
- illliillll 3mo agoYou can go on telegram and pay someone $10 to do the KYC for you.
- tomr75 3mo agohi nsa
- TZubiri 3mo agoSeems like a good riddance, telnyx is for business usecases, not for personal use. Such use would be incompatible because it would lure in fraud, which would ruin the reputation of shared comms resources like ip blocks, phone number blocks, etc.. If you are doing real business, you are providing KYC as a daily matter in procurement, thereby protecting consumers from Sybil scum.
- inigyou 3mo ago> thereby protecting customers from Sybil scum No? Firstly you can't do a Sybil attack when each identity costs actual resources, and secondly you can still have lots of phone numbers, they just know who each one belongs to.
- jakswa 3mo agowhat quantization? FP4?
- NitpickLawyer 3mo agoThe model is native mxfp4 w/ mxfp8 activations via QAT.
- trollbridge 3mo agoI have some morbid curiousity about what K3 would be like in an FP16 or FP32 model.
- hiherer 3mo ago[dead]
- teravor 3mo ago> Because we own the infra, the per-token price reflects the cost of running the model, not the cost of renting someone else's plus their margin. is not compatible with > Pricing on Telnyx: $2.70/1M input tokens, $13.50/1M output tokens, $0.27/1M cached input tokens. since you asserted something false and bizarre, how about telling us what is your markup?
- gruez 3mo agoI don't get it, what's the contradiction supposed to be?
- alexeldeib 3mo agoWhy are those incompatible? Pricing is 10% under moonshot, and pure infra providers also want money
- rubslopes 3mo agoThey are selling it even cheaper than Moonshot AI. Why are you so sure they are lying?
- teravor 3mo agoWe estimate that the true blended price per million tokens for running Opus 4.7 on agentic tasks at $0.99 despite the sticker price being $5/$25 per MTok. https://newsletter.semianalysis.com/p/ai-value-capture-the-shift-to-model https://newsletter.semianalysis.com/p/ai-value-capture-the-s... according to Semianalysis those prices would be far above actual costs.
- FergusArgyll 3mo ago**reflects** the cost... Not the **literal** cost
- tpm 3mo agoIf they are indeed far above actual costs, then surely price discovery will be done by the overall market in due course.
- marsven_422 3mo ago[dead]
- Mossy9 3mo agoAlso available from Nebius, via Cortecs: https://cortecs.ai/detailedServerlessView/kimi-k3 https://cortecs.ai/detailedServerlessView/kimi-k3 €2.693/M input €13.464/M output Surprisingly, cache is not mentioned Upd: Tensorix joined the fray, with the same prices, with cache at €0.673/M read
- nttylock 3mo ago[flagged]
- bedros 3mo agoany of these providers are HIPAA compliant?
- madhu_ghalame 3mo ago[dead]
- fionaattelnyx 3mo agoWe'll be pushing benchmarks over the next few days, will update here when we have them
- TZubiri 3mo agoI think telnyx is a good product, with the only stain to its name being the supply chain attack on their python library. But I don't feel like providing inference is a professional move, it feels like out of scope for a telephony IaaS company. Feels like a FOMO moment where a reputation of years is crashed in a couple of weekends of being drawn into a fad. And the fact that it's a chinese model doesn't quite help? I guess it's on brand with the 'cheap' pay as you go brand telnyx might already be associated to. But more so it reads like Telnyx is trying to 'jump' into the trend of the 'open weights' discussion to compete with closed source incumbents. But we are at the tail end of the boom, anti ai sentiment is ever growing, customers now despise AI, especially in support channels, which is presumably the hook that Telnyx would have into 'AI'(LLMs). At this stage any company or individual that tries to join into the buzzword fueled cycle will pay the full fixed cost reputational price, but only reap the leftover hay from when the sun shone. AI(LLM) on support channels is essentially a decapitalization of a company/brand, the company has a reputation that customers value, and might be worth good money in the market, and by implementing AI (LLMs) on support, a lot of costs can be cut, while the brand loses value, not sustainable. And by Telnyx (or any B2B company)asking their clients to participate in this decapitalization move, they essentially gamble their reputation as well, albeit with better odds as shovel sellers.
- jbstack 3mo agoLarge profitable corporations with very poor customer support have existed long before AI, so why should it be different? Using AI to provide poor customer service is just an implementation detail.
- inigyou 3mo agoCompanies changing their scope or opening side products is not at all unusual. Microsoft is Windows, what's this Xbox thing? Google is search, why do they have email? Y Combinator is a startup accelerator, why'd they make their own Reddit?
- trollbridge 3mo agoI think Microsoft is still trying and failing to figure out what this X-Box thing is.
- rvz 3mo agoJevon's paradox depends on how cheap the tokens get as the price of tokens get driven to zero as intelligence gets better and cheaper.
- inigyou 3mo agoWell this is a very large and expensive model. Try something like Qwen-7B if you want ultra-cheap.
- neuroticnews25 3mo agoLarger than Mythos? How is that?
- philjohn 3mo agoI thought Mythos was rumored to be around 10tn parameters? Kimi k3 is 2.8tn.
- zius 3mo agoIn my first interaction ("hi there kimi k3!"), Kimi K3 identified twice out of three times as Claude: > Hi there! Quick note — I'm actually Claude, made by Anthropic, not Kimi. But no worries! https://imgur.com/a/jqpc2Jc https://imgur.com/a/jqpc2Jc and > Just a quick heads-up — I'm Claude, made by Anthropic, not Kimi! Kimi is a different AI assistant (made by Moonshot AI), so it looks like there might be a little mix-up. https://imgur.com/a/AKxeysH https://imgur.com/a/AKxeysH
- TZubiri 3mo agoBootleg AI
- Grimblewald 3mo agoif this qualifies bootleg, point me at non-bootleg frontier ai.
- victorbjorklund 3mo agoIs Claude bootleg AI? https://www.reddit.com/r/OpenAI/comments/1e34tkr/why_is_claude_35_sonnet_referring_to_itself_as/ https://www.reddit.com/r/OpenAI/comments/1e34tkr/why_is_clau...
- deleted 3mo ago[deleted]
- croes 3mo agoThat’s how a smoking gone turns into a water pistol
- TZubiri 3mo agoI can see how, if all you ever were exposed to was that link and this post, you might think they are equivalent, and the conclusion is "whatever, everyone is stealing from each other. But the answer is no, Claude didn't train itself on ChatGPT, but Kimi K3 did train itself on Claude. There has been no accusation that I am aware of by OpenAI against Anthropic, (which are in the same jurisdiction, so it would amount to legal action). On the other hand there have been accusations with extensive detail by Anthropic on how chinese models are attacking Anthropic to reverse engineer and copy their product. There's nuance if you care to see it, but maybe it's easier to pretend that everyone is ripping each other off so that you can consume a ripoff without seeing yourself as at fault.
- maelito 3mo agoWhere is it hosted ?
- mesmertech 3mo agoWhy are you guys not on Openrouter? I assume you'd get way more volume that way no? Or does openrouter have like a specific contract you have to sign with them and requirements or smth? https://openrouter.ai/moonshotai/kimi-k3#providers https://openrouter.ai/moonshotai/kimi-k3#providers
- hmokiguess 3mo agoWho is "you guys"? Telnyx?
- DaSHacka 3mo agoWell, the OP's username is "Fiona at Telnyx"
- hmokiguess 3mo agoI kinda realized my question was dumb afterwards, I think I misread the question lol thanks
- ljlolel 3mo agoThis (Telnyx) is available on TrustedRouter.com
- addandsubtract 3mo agoSoon, we're gonna need a router for all the different routers.
- morpheuskafka 3mo agoI have used Telnyx for, on the opposite end of cool-ness, their fax API. Curious if their AI pricing and quality are actually competitive or if this is just a rapid pivot to try to ride the AI wave.
- trollbridge 3mo agoBy 2030 or so, it will become clear that AI's impact on the economy has been no greater than the fax machine's.
- contactdq 3mo agoIt's not a rapid pivot. We've been doing AI stuff for quite some time, particularly on the voice side. Soon, you'll see more from us on the physical AI side. Our GPUs are colocated next to our mobile core, so as we roll out vision models, you'll be able to do things like agentically pilot drones with low latency.
- tokai 3mo agoThat is not going to be cheap for long if K3 prices does the same as GLM5.2 prices. If nothing else open weight models are great to get providers to compeete on price.
- hmokiguess 3mo agoIs it also offered via a ZDR + BAA / HIPAA eligible? Would love to use it in prod
- fionaattelnyx 3mo agoYes, we offer BAAs for workloads on our platform
- apexalpha 3mo agoIs this an ad? Why is this provider specifically on the front page? Also why is this not available over openrouter?
- dan_gee 3mo ago[dead]
- accountforih 3mo ago[dead]
- heisgone 3mo agoI don't mind it as long as the company engage in the comments. They haven't so far.
- contactdq 3mo agohere now.
- ljlolel 3mo agoThis (Telnyx) is available on TrustedRouter.com
- blackoil 3mo agoMaybe, but how is it different than post for new Macbook?
- contactdq 3mo agoCo-founder/CEO here. Not sure how we got to the front page, but we'll take it. We've been trying to get on OpenRouter. Just reached out to their CEO. Would be great if people could request it as well. We're unique in that we have B300 in USA, EU, UAE, and AUS. Also, building out other agentic primitives like stateful actors (in beta, but will be rolled out globally in the coming weeks): https://developers.telnyx.com/docs/edge-compute/stateful-actors https://developers.telnyx.com/docs/edge-compute/stateful-act... Also, if you're doing things agentically, check out AI repo: https://github.com/team-telnyx/ai https://github.com/team-telnyx/ai
- htrp 3mo agoToken Type Price per 1M tokens Cached Input $0.27 Input $2.70 Output $13.50 Looks like they are first vendor to undercut in price.
- BVHauge 3mo ago[flagged]