3 ms·
As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't im
by jasobake 5mo ago
As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.
- 33MHz-i486 5mo agoat this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations
- o10449366 5mo agoLol, spinning up swat teams because someone high up decides "drop everything this is my pet priority now" is politicking. It looks good for the leaders, meanwhile its the engineers pulling the all nighters and dealing with having to maintain systems that are operationally compromised from day 0 because there's no proper planning/scoping involved other than "Big Man says this needs to be done in 2 weeks"
- phillipcarter 5mo agoSure, but also... ...anyone with a brain at AWS knows that supporting OpenAI's latest models on Bedrock is simply good for AWS. That context is rather important!
- tt24 5mo agoOkay but I’ll be able to use OpenAI models on bedrock now Why would I care if AWS asks their engineers to work a little harder on a project
- ignoramous 5mo ago> engineers pulling the all nighters There's always some carrot with the stick, even if an imaginary one!
- aab99 5mo agoyup, I think there are few public articles on aws mantle so you can look it up, but internally this is pretty common knowledge. The entire inference engine of bedrock is built and maintained by a handful of ec2 engineers (all principals and above). Judging by the commit history of the project they are able to just build independent of any of the traditional bureaucracy.
- 33MHz-i486 5mo agothe way in which Mantle was built is highlighted internally by PEs as some sort of triumph but really its a fairly tone deaf indicted of AWS’s engineering culture ... “To achieve a meaningful result in a reasonable amount of time we had to break nearly ever constraint that we force all other engineers to work under. good luck to you plebs of L6 and below”
- spelunker 5mo agoCheck out this all of this stuff we can build with a room full of PEs and no rules!
- darkwater 5mo agoI'm going to play devil's advocate here: _what if_ most of lower level engineers are actually not able to self-organize themselves like this dedicated, I bet hand-picked group of PE can? I'm pretty sure AWS ruthless culture would gladly use less middle-managers and be swifter in time to market if it were so easy, no? What works for a single, highly-focused project (or a handful of similar situations) doesn't scale when you have to take care of bazillion customers, do boring/smaller tasks and keep the machine ticking.
- jjmarr 5mo ago[deleted]
- 3748595995 5mo ago[flagged]
- giancarlostoro 5mo agoDepends on how its implemented, but Amazon already did add gpt-oss-20b so if the model is similar enough to the OSS variant of GPT, it might not have been as complicated as you might think.
- londons_explore 5mo agoI imagine there's lots of custom kernels and optimization... Openai hasn't been publishing innovations for quite a while.
- NamlchakKhandro 5mo agoNeither has anthropic. They're both just stealing ideas from pimono extensions
- ignoramous 5mo agoSome say they have been stealing ideas from Chaebols [0] on circular deals [1], government reciprocation, & monopolisation. [0] https://business.columbia.edu/sites/default/files-efs/imce-uploads/PFS/APEC_New/song.pdf https://business.columbia.edu/sites/default/files-efs/imce-u... [1] https://www.reuters.com/business/autos-transportation/companies-pouring-billions-advance-ai-infrastructure-2026-04-21/ https://www.reuters.com/business/autos-transportation/compan...