8 ms·
I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose th
by intellectronica 2y ago
I love the title "Big LLMs" because it means that we are now making a distinction between big LLMs and minute LLMs and maybe medium LLMs. I'd like to propose the we call them "Tall LLMs", "Grande LLMs", and "Venti LLMs" just to be precise.
- deleted 2y ago[deleted]
- HarHarVeryFunny 2y agoBut of course these are all flavors of "large", so then we have big large language models, medium large language models, etc, which does indeed make the tall/grande/venti names appropriate, or perhaps similar "all large" condom size names (large, huge, gargantuan).
- de-moray 2y agoWhat does a 20 LLM signify?
- tonyhart7 2y agocan we have tiny LLM that can run on smartphone now
- rubslopes 2y agoIs a tiny large language model equivalent to a normal sized one?
- tonyhart7 2y agoYes is called MLM (Medium Language Model)
- winter_blue 2y agoApple Intelligence has an LLM that runs locally on the iPhone (15 Pro and up). But the quality of Apple Intelligence shows us what happens when you use a tiny ultra-low-wattage LLM. There’s a whole subreddit dedicated to its notable fails: https://www.reddit.com/r/AppleIntelligenceFail/top/?t=all https://www.reddit.com/r/AppleIntelligenceFail/top/?t=all One example of this is “Sorry I was very drunk and went home and crashed straight into bed” being summarized by Apple Intelligence as ”Drunk and crashed”.
- deleted 2y ago[deleted]
- Spooky23 2y agoI think the real problem with LLMs is we have deterministic expectations of non-deterministic tools. We’ve been trained to expect that the computer is correct. Personally, I think the summaries of alerts is incredibly useful. But my expectation of accuracy for a 20 word summary of multiple 20-30 word summaries is tempered by the reality that’s there’s gonna be issues given the lack of context. The point of the summary is to help me determine if I should read the alerts. LLMs break down when we try to make them independent agents instead of advanced power tools. Alot of people enjoy navel gazing and hand waving about ethics, “safety” and bias… then proceed to do things with obvious issues in those areas.
- mewpmewp2 2y agoLarger LLMs can summarize all of this quite well though.
- hansvm 2y agoDeterminism isn't the issue though. Many responses are fine. The displayed one is bad, whether chosen deterministically or not. Some alternatives: - Passed out drunk - Crashed in bed - Slacking because drunk ... The issue isn't a lack of context; it's that even the available context was handled poorly.
- samstave 2y agoI want a tiny_phone_based LLM to do thought tracking and comms awareness.. I actually applied to YC in like ~2014 or such for thus; -JotPlot - I wanted a timeline for basically giving a histo timeline of comms btwn me and others - such that I had a sankey-ish diagram for when and whom and via method I spoke with folks and then each node eas the message, call, text, meta links... I think its still viable - but my thought process is too currently chaotic to pull it off. Basically looking at a timeline of your comms and thoughts and expand into links of thought - now with LLMs you could have a Throw Tag od some sort whereby you have the bot do work on research expanding on certain things and plugging up a site for that Idea on LOCAL HOST (i.e. your phone so that you can pull up data relevant to the convo - and its all in a timeline of thought/stream of conscious hopefully you can visualize it...
- radlad 2y agoI had a thought that I think some people value social media (e.g. Facebook) essentially for this. Like giving up your Facebook profile means giving up your history or family tree or even your memories. So in that sense, maybe people would prefer a private alternative.
- samstave 2y agoI read this in Sam Wattersons voice with a pipe abt maybey an inch from his beard, (Fyi I was a designer at fb and while it was luxious I still hated what I saw in zucks eyes every morn when I passed him. Super diff from Andy Grove at intel where for whateveer reason we were in the sam oee schekdule (That was me typing with eues ckised as a test (to myself, typos abound
- badlibrarian 2y agoNo. Smartphone only spin animated gif while talk to big building next to nuclear reactor. New radio inside make more efficient.
- intrasight 2y agoI expect that the phone will only do the prompt parsing
- t_mann 2y agoBig LLM is too long as a name. We should agree on calling them BLLMs. Surely everyone is going to remember what the letters stand for.
- temp0826 2y agoBureau of Large Land Management
- bookofjoe 2y ago>What does BLLM stand for? https://www.abbreviations.com/BLLM#google_vignette https://www.abbreviations.com/BLLM#google_vignette
- nullhole 2y agoI still like Big Data Statistical Model
- heyjamesknight 2y agoI want to apologize for this joke in advance. It had to be done. We could take a page from Trump’s book and call them “Beautiful” LLMs. Then we’d have “Big Beautiful LLMs” or just “BBLs” for short. Surely that wouldn’t cause any confusion when Googling.
- cowsaymoo 2y agoWeirdly enough, the ITU already chose the superlative for the bigliest radio frequency band to be Tremendous: - Extremely Low Frequency (ELF) - Super Low Frequency (SLF) - Ultra Low Frequency (ULF) - Very Low Frequency (VLF) - Low Frequency (LF) - Medium Frequency (MF) - High Frequency (HF) - Very High Frequency (VHF) - Ultra High Frequency (UHF) - Super High Frequency (SHF) - Extremely High Frequency (EHF) - Tremendously High Frequency (THF) Maybe one day some very smart people will make Tremendously Large Language Models. They will be very large and need a lot of computer. And then you'll have the Extremely Small Language Model. They are like nothing. https://en.wikipedia.org/wiki/Radio_frequency?#Frequency_bands https://en.wikipedia.org/wiki/Radio_frequency?#Frequency_ban...
- guestbest 2y agoWhy not LLLM for large LLM’s and SLLM for small LLM’s, assuming there is no middle ground
- orbital-decay 2y agoSLM is a widespread term already.
- guestbest 2y agoSlim pickings, then?
- _heimdall 2y agoWhat makes it a Small Large Language Model? Why jot just an SLM?
- guestbest 2y agoIf we can’t have fun with names, why even be in IT?
- technol0gic 2y agoSmedium Language Model
- dbalatero 2y agoLousy Smarch weather
- gpderetta 2y agoS and L cancel out, so it just an LM.
- _heimdall 2y agoSmall !== -Large
- 2y ago
- badlibrarian 2y agoI've sat in more than one board meeting watching them take 20 minutes to land on t-shirt sizes. The greatest enterprise sales minds of our generation...
- ben_w 2y agoI've seen things you people wouldn't believe. I’ve seen corporate slogans fired off from the shoulders of viral creatives. Synergy-beams glittering in the darkness of org charts. Thought leadership gone rogue… All these moments will be lost to NDAs and non-disparagement clauses, like engagement metrics in a sea of pivot decks. Time to leverage.
- badlibrarian 2y ago... destroyed by madness, starving hysterical! Buying weed in a store then meeting with someone off Craiglist to score eggs.
- rnrn 2y agoit's too bad vLLM and VLM are taken because it would have been nice to recycle the VLSI solution to describing sizes - get to very large language models and leave it at that.
- rnrn 2y agowe could also look to magnetoresistance and go for giant, colossal, extraordinary
- do_not_redeem 2y agoAfter very large language models, the next step is mega language models, or MLMs. As a bonus, it describes the VC funding scheme that backs them too.
- AlienRobot 2y agoTerrible names, to be honest. My proposal: Hyper LLMs, Ultra LLMs, Large LLMs, Micro LLMs, Mobile LLMs.
- deleted 2y ago[deleted]
- isoprophlex 2y agoLLM M4 Ultra Pro Max 16e (with headphone jack)
- AlienRobot 2y agoGPT Inside
- BobaFloutist 2y agoLLM, LLM 2.0, LLM 3.0, Mini LLM, Micro LLM, LLM C.
- jfengel 2y agoLLM 95, LLM 98, LLM Millennium Edition, LLM NT, LLM XP, LLM 2000, LLM 7 I really appreciated the way they managed to come up with a new naming scheme each time, usually used exactly once.
- Scarblac 2y agoLLM 3.11 for Workgroups
- ben_w 2y agoCould always go with the Bungie approach for the Marathon series: LLM, LLM2, LLM∞, ℵ₁ — https://alephone.lhowon.org https://alephone.lhowon.org (Obviously ∞ is for the actual singularity, and ℵ₁ is the thing after that).
- jfengel 2y agoAre you sure that ℵ1 is the thing after that? https://en.m.wikipedia.org/wiki/Continuum_hypothesis https://en.m.wikipedia.org/wiki/Continuum_hypothesis ;-)
- davidwritesbugs 2y agoor "DietLLM, RegularLLM, MealLLM and SuperSizedLLMWithFries"
- naveen99 2y agoLLM already has one large in it…
- latexr 2y agoName them like clothing sizes: XXLLM, XLLM, LLM, MLM, SLM, XSLM XXSLM.
- ai-christianson 2y agoMLM... uh oh
- anonym29 2y agoI hate those ponzi schemes! Never buy a cutco knife or those crappy herbalife supplements. Alternatively, just make sure you keep things consensual, and keep yourself safe, no judgement or labels from me :)
- deleted 2y ago[deleted]
- swyx 2y agoi did this! XXLLM: ~1T (GPT4/4.5, Claude Opus, Gemini Pro) XLLM: 300~500B (4o, o1, Sonnet) LLM: 20~200B (4o, GPT3, Claude, Llama 3 70B, Gemma 27B) ~~zone of emergence~~ MLM: 7~14B (4o-mini, Claude Haiku, T5, LLaMA, MPT) SLM: 1~3B (GPT2, Replit, Phi, Dall-E) ~~zone of generality~~ XSLM: <1B (Stable Diffusion, BERT) 4XSLM: <100M (TinyStories) https://x.com/swyx/status/1679241722709311490 https://x.com/swyx/status/1679241722709311490
- _bin_ 2y ago"big large language model" renminds me uncomfortably of "automated teller machine machine"
- semireg 2y agoPro, max, ultra…
- TZubiri 2y agoDoesn't the first L in LLM mean large already? It's like saying Automated ATM. Whoever wrote it barely knows what the acronym means. This whole article feels like written by someone who doesn't understand the subject matter at all
- xanderlewis 2y agoAlmost everyone says ‘PIN number’ as well.
- thih9 2y agoWe’re fine with “The big friendly giant” and the sahara desert (“desert desert”); big llm could join the family of pleonasms. https://en.m.wikipedia.org/wiki/Pleonasm https://en.m.wikipedia.org/wiki/Pleonasm
- TZubiri 2y agoWhen it's a different language it's fine.
- deleted 2y ago[deleted]
- Kiro 2y agoYes, that's the point of the comment and the whole discussion here. LLMs are already Large so what should the prefix be? Big LLM is a strong contender. I'm also pretty sure the creator of redis is not "someone who doesn't understand the subject matter at all".
- TZubiri 2y agoIt's very common for experts on one subject to take a jab at another subject and depend on their reputation while their skillset doesn't translate at all.
- xanderlewis 2y agoAnd the US ‘small’ LLMs will actually be slightly larger than the ‘large’ LLMs in the UK.
- aziaziazi 2y agoI wonder how does the skinnies get dressed oversea: I wear European S which translate to XXS in the US, but there’s many people skinnier than me, still within a “normal" BMI. Do they have to find XXXS? Do they wear oversized clothes? Choosing trousers is way easier because the system of cm/inches of length+perimeter correspond to real values.
- Spivak 2y agoIt's a crazy experience being just physically larger than most of the world. Especially when the size on the label carries some implicit shame/judgement. Like I'm skinny, I'm pretty much the lowest weight I can be and not look emaciated / worrying. But when shopping for a skirt in Asian sizes I was a 4XL, and usually an or L-2XL in European sizes. Having to shift my mental space that a US M is the "right" size for me was hard for many years. But like I guess this is how sizing was always kinda supposed to work.
- krageon 2y agoThe shame you feel is yours, it's not inherent to the sizing.
- Spivak 2y agoThe shame is inherent to the crushing expectations put on women's appearances and the pressure to be small. It manifests in clothing sizing for the same reason it manifests standing on a scale, it's a measure of your smallness. And what makes it insidious is that the measures are juuust comparable enough across different people to make people feel bad for not having the same numbers as someone 5" shorter than you. And my experience isn't unique in any way here and it's really hard to not see it pervasive through our culture.
- thih9 2y agoDismissed, Big LLM will live on along with Big Data.
- deepsun 2y agoWell, big data for me was always clear -- when data sizes are too large to use regular tools (ls, du, wc, vi, pandas). I.e. when pretty much every tool or script I used before doesn't work anymore, and need a special tool (gsutil, bq, dusk, slurm), it's a mind shift.
- huijzer 2y ago“There are 2 hard problems in computer science: cache invalidation, naming things, and off-by-1 errors.“
- saltcured 2y agoI'd prefer to see olive sizes get a renaissance. I was always amused by Super Colossal when following my mom around a store as a little kid. From a random web search, it seems the sizes above Large are: Extra Large, Jumbo, Extra Jumbo, Giant, Colossal, Super Colossal, Mammoth, Super Mammoth, Atlas.
- inciampati 2y agoAnd I'd love to see data compression terminology get an overhaul. Do we need big LLMs or just succinct data structures? Or maybe "compact" would be good enough? (Yeah LLMs are cool but why not just, you know, losslessly compress the actual data in a way that lets us query its content?)
- rowanG077 2y agoWell the obvious answer is that LLMs are more then just pure search. They can synthesize novel information from their learned knowledge.
- deleted 2y ago[deleted]
- taneq 2y agoNeeds more superlatives. “Biggest” < “Extra Biggest” < “Maximum Biggest”. :D
- enlightens 2y agomaximum_biggest_final_2
- fernmyth 2y ago"Non Plus Ultra" Followed by another company introducing their "Plus Ultra" model.
- VectorLock 2y ago
- varispeed 2y agoThen there will be "decaf LLM"
- Arcuru 2y agoI've been labeling LLMS as "teensy", "smol", "mid", "biggg", "yuuge". I've been struggling to figure out where to place the lines between them though.
- zargon 2y agoitsy-bitsy <= 3B teensy 4B to 29B smol 30B to 59B mid 60B to 99B biggg 100B to 299B yuuge 300B+
- nextts 2y agohttps://xkcd.com/1294/ https://xkcd.com/1294/
- deleted 2y ago[deleted]