6 ms·
> 30-50% of engineers on core teams have been forcefully reassigned to data labeling and RLHF, upsetting folks even more. This really doesn't sound believable
by fabian2k 4mo ago
> 30-50% of engineers on core teams have been forcefully reassigned to data labeling and RLHF, upsetting folks even more.
This really doesn't sound believable to me, but who knows with all the craziness going on. Software developers in the US are seriously expensive, using them for data labeling would be a waste of resources. And the percentage sounds very high, unless "core teams" is only a small subset of the total developer count.
- conradfr 4mo agoIt's only until Cold Harbor is completed.
- bickfordb 4mo agoThen all the engineers will get to rejoin their outies.
- panzagl 4mo agoI don't know what Cold Harbor means in a Meta context, but its interesting that its named after the battle that exemplified Grant's strategy of attrition during the American Civil War. I suspect it means waves of engineers ground down against the defenses of OpenAI/Anthropic in the hopes of eventually finding a crack. Might be best to get out while you can.
- georgemcbay 4mo ago> I don't know what Cold Harbor means in a Meta context Cold Harbor is a reference to the TV show Severance. Without going into any real spoilers it was the code name of a data classification project so mysterious that the people working on it weren't allowed to know what they were working on (and yes, the project in the show was probably named after the battle in the Civil War). The Meta connection is that there are some humorous parallels between that project and a project involving people tagging data to train technology to replace themselves, and just the overall creepy dystopian vibe of both the fictional and real-world companies (and founders) involved.
- panzagl 4mo agoThanks for the explanation. Meta indeed.
- djeastm 4mo ago>using them for data labeling would be a waste of resources Would it? It seems like they can spend a few months extracting intelligence and "taste" from their engineers then get years worth of it back from the AI.
- CyLith 4mo agoI wouldn't trust any engineers I know of with their "taste". At best it's a highly skewed view of the world. At worst, it's outright opposite to genpop.
- vinni2 4mo agoUnless they collude and hatch a plan to sabotage the LLM training.
- monster_truck 4mo agoAre there any examples of this actually working? I keep seeing this fantasy repeated but have not seen a plausible explanation for how they wouldn't be contibuting to the pile of negative examples which are just as valuable if not more.
- vanuatu 4mo agoits fantasy scale ai's value prop was catching people like this
- kxxx 4mo agoZuck literally said that he wants folks with higher intelligence on the Applied Intelligence team. And the best way to do that was to move folks internally, since they were "intelligent" enough to pass the Meta interviews. Soooo, yes it is a waste of resources ($$$). But this was the initial intention.
- tayo42 4mo ago> since they were "intelligent" enough to pass the Meta interviews. I haven't interviewed with them in almost 10 years. But aren't they doing the same interview everyone else does?
- monster_truck 4mo agoThe belief that engineers are not doing anything for x amount of time that could be better spent on other immediately measurable things is as old as the profession itself. Ironically this vanishes when the tables are turned and we ask for things like better hardware or software. There are plenty of us here with stories of how much effort it took to convince employers that SSDs were worth it when they were new, small, and very expensive.
- davebren 4mo agoOne of the funniest things is how hard it was to get approval for a $100 software license but now people are being encouraged to burn thousands on tokens.
- ihsw 4mo ago[dead]
- smrtinsert 4mo agoMy favorite one is "NO ACCESS TO PRODUCTION DATA" "it's for agent" "do whatever you want"
- drawnwren 4mo agosee also: we're all developing on min spec Macbook Pros while being encouraged to burn > max spec Macbook Pros cost in tokens/month while still waiting for builds to compile.
- InsideOutSanta 4mo agoI believe it, because it makes a kind of sense. Post-training has a huge impact on how well LLMs perform, and labeled data is what determines the effectiveness of post-training. This is why companies like Anthropic are so worried about distillation. So if you have access to a large number of highly skilled people, and you really don't absolutely need them to do other things, why wouldn't you force data labeling tasks on them? Facebook is also planning a 10% layoff, so this also works as encouragement for people to leave voluntarily. (Before you downvote me, note that I'm not endorsing this or saying it's a good idea. I'm just saying that I believe it's true, because I can see how Facebook's leadership would think it's a good idea.)
- HDThoreaun 4mo agoBecause you can just get rid of all those people and do the data labeling tasks for 1/4 the cost?
- vanuatu 4mo agounironically if those engineers were considered to be 'bloat' its better to have them label data because they are smarter and vetted basically a soft layoff
- xnx 4mo agoDo the skills these people have overlap with the skills needed for a good data labeler? I'm guessing being a domain expert is most valuable as a data labeler.
- layer8 4mo agoFrom the article: > Forced data labeling with 4,500+ engineers is to generate high-quality RLHF I doubt that you get high quality from forced reassignments where the now-data labelers don’t actually want to do that kind of work. It’s crazy to think that Meta leadership believed that it makes sense.
- overfeed 4mo ago> I doubt that you get high quality from forced reassignments Their bonuses depend on it. They'll have to play ball unless they have other jobs lined up, are ready to retire early, or prepared to be on the shitlist for the next round of layoffs due to "underperformance"
- swatcoder 4mo ago> Software developers in the US are seriously expensive, using them for data labeling would be a waste of resources. The frontier work is on labeling and training expert content, by experts. It's unglamorous work and almost certainly doesn't warrant FAANG pay, but neither did most of the work that most FAANG engineers were already doing. But it does require competent talent from the expert domain. Like their peer companies, Meta is still sitting on a huge pool of vetted-as-competant workers from the hiring boom and expert AI training is the most ripe business opportunity in a fragile economy where pretty much every comparable opportunity has evaporated.
- huflungdung 4mo ago[dead]
- danny_codes 4mo agoIt's a bold move cotton. I doubt it'll pay off. Let's face it, the average FB engineer is no better than the average Polish engineer, and the Polish guy is 20x cheaper. If you wanted cost-effective labeling you'd send it to Poland. Or better, Chile.
- bredren 4mo agoYes, this is not labeling what is an apple and what is a pear. "Annotation" does not do this work justice. For a coding agent, for example, there is *very detailed* analysis of the turns and ranking of different portions of the conversation. Adherence or deviation from specific rules matters. Writing quality matters. Expertise in the topic under discussion matters. Having intuition for the tone and beat of a good conversation matters. Scoring a 15-20 turn conversation can easily take two and a half hours. Clicking submit does not mean the author is done. Many annotations will be turned back to them by a reviewer to touch up in some way. This work can be far more mentally taxing than programming, is measured much more by completions more of a timed exercise than SWE. FWIW, Meta employees would probably make great coding agent conversation annotators. But it is absolutely not SWE and they won't enjoy it (for long).
- mancerayder 4mo agoIsn't that Scale AI investment in a company that does labeling? what are we missing? Are we all going to be labelers soon too?
- karel-3d 4mo agoYes
- maxnevermind 4mo agoPlot twist: we already are through the usage of AI lab's API.
- jordanb 4mo ago> Software developers in the US are seriously expensive, using them for data labeling would be a waste of resources. Zuck basically went to a town hall and explained to his employees that their remaining value to him is as training mules for his AI.
- dlev_pika 4mo agoI like the part when he “took full responsibility” for HIS Metaverse mistake, and fired everybody else lmao Gavin from Silicon Valley did it first
- senordevnyc 4mo agoIt seems really dumb to tell them that. I assume they’re all feeding garbage to the models now.
- lovich 4mo agoThey’ve largely filtered their employees for people who have a mental breakdown if they don’t get 110% on a 100% scale or get the top of the top rating because they’ve done that their whole life until they got their first job at the tender age of 25-28 after getting their masters or PhD. I’ve met too many meta members who have stories about their direct reports or peers who had a crashout because they got Exceeds Expectations and a mid 5 figure raise instead of Greatly Exceeds Expectations with a higher 5 figure raise not because of the money but because of not getting the top score. I’m pretty sure zuck is being a rational sociopath and realizing he can use the PSC system to get these people to widely work against their best interests due to their ego.
- godwinson__4-8 4mo agoidk... In their own way these types of people who have blinders on to such a degree that they crashout over such things are also sociopaths... Seems like a side effect of the k shaped economy... our society increasingly doesn't have rewards for normal hardworking people. Given tech has been disrupting blue collar jobs for decades I have a hard time feeling sorry for them. Working at Meta already meant you were chasing a bag knowing the product was more or less social poison anyway. It doesn't seem to me that Zuck is uniquely culpable... maybe he's just the best one at the game they're all playing... The fact he still cares so much about Meta when he is a billionaire is just like those crashouts. Again, it's the same type of person. He's just better at it than they are.
- Apocryphon 4mo agoSilicon Valley strikes again? https://www.youtube.com/watch?v=obS-qZO9uCQ https://www.youtube.com/watch?v=obS-qZO9uCQ
- dylan604 4mo agoI still use the phrase "not a hot dog" to describe things that only does one thing while described as having a lot more capabilities
- ifwinterco 4mo agoFrom the article it sounds like what they're actually doing is reviewing LLM-generated code, for that you do need good software engineers. Although it goes without saying that good software engineers won't enjoy doing this very much
- jasonwatkinspdx 4mo agoI can't give you exact numbers, but this is line with what I'm hearing through the grapevine. Lots of senior managers being converted back to ICs as well. A lot of people are going to leave as soon as they hit their next vest.
- smrtinsert 4mo agoThis reads like a way to get engineers to quit while they work on something "useful". After losing Yann, I doubt its going to end up being useful.
- TrackerFF 4mo agoHave you heard about the various startups that specialize in expert data labeling, like Mercor? They can pay $100-$200/hr for highly specialized work, who knows how much they charge their clients. Translated to an annual wage, that's definitely in the SF/SV engineer range As others have commented, some of the training is very specialized.
- asdff 4mo agoHave you heard about working for mercor? You aren't working full time for them or sniffing anywhere close to a proper annual wage.
- desolate_muffin 4mo agoMy partner works there as an engineer. The org they work in had loads of people transferred to the "AAI" org doing data labelling. I find it almost unbelievable as well, but it is true.
- smrtinsert 4mo agoIt's 100% unbelievable and hysterical that its true. Have they done the simple math on how much labeled data they need to make a model of value?
- cloverich 4mo agoThey are likely managing them out.
- ablation 4mo agoThis is starting to feel like a Peter Watts short story.
- imglorp 4mo agoThey are literally doing the apocryphal corporate dystopian maneuver: training their replacements. They won't be doing it for long.
- swader999 4mo agoCoffin building
- Ifkaluva 4mo agoThose percentages seem in line with what I have heard. Not company-wide, MSL was exempted, of course, and probably a few other golden geese here and there.
- jopolous 4mo agoI totally agree, it sounds unbelievable… Problem is, I’m on one of these core infrastructure teams, and for my team at least we lost between 50-75% of our engineers to the AI org. Most of the other infra teams I collaborate with have a similar story
- _dark_matter_ 4mo agoYour team lost 50-75%? Is that an approximation, or do you just not know? Can't you just count who left to get the actual ratio?
- tverbeure 4mo agoMaybe it's better to be vague in a situation like this?
- jopolous 4mo agoDeliberately vague, half so I can’t be easily identified (though my team’s case is not unique), half so I don’t get in trouble for sharing specific personnel information. True number is much closer to 75% than 50%.
- loeg 4mo agoNot 30-50%.
- bossyTeacher 4mo ago> using them for data labeling would be a waste of resources Is work such as changing the styling of a button on the Instagram app any more useful than that? Mining work was unglamorous and dangerous but was needed. Labeling work is the mining of the AI era.