3 ms·
What an unfortunate name... I initially thought this was about wireless communication. https://en.wikipedia.org/wiki/LoRa https://en.wikipedia.org/wiki/LoRa
by yau8edq12i 2y ago
What an unfortunate name... I initially thought this was about wireless communication. https://en.wikipedia.org/wiki/LoRa https://en.wikipedia.org/wiki/LoRa
- bee_rider 2y agoThe idea of low rank approximations is not new, truncated SVDs for example have been used for many decades.
- yau8edq12i 2y agoThe acronym LoRA used in the context of deep learning (2021) is about seven years younger than the radio communication protocol called LoRa (2014). Type "lora" in a search engine and see what you get.
- kleiba 2y agoIn the first 10 search results, I now get a mix of results for either of the two technologies when searching with Google.
- blamestross 2y agoYeah I would prefer they didn't offusicate the actually useful search term
- sorenjan 2y agoThis gets mentioned here everytime an article about LoRA is posted. Sometimes acronyms means multiple things, they're not in the same field so the risk of confusion beyond short headlines is negligible. It's a bit like if someone reading a bicycling article and getting annoyed that FTP means Functional Threshold Power instead of File Transfer Protocol, or reading about machine learning and getting confused that MLP doesn't mean My Little Pony.
- rakoo 2y ago"computer science" and "bicycles" aren't the same domain, it's fine to have the same acronym. "computer science" and "tv shows" aren't the same domain, it's fine to have the same acronym. "computer science" and "computer science" are the same domain, it's not a good idea to use the same acronym.
- WithinReason 2y agoLarge Models is in the title so it's obviously not about radio
- GuB-42 2y agoThe acronym is also spelled out in the title: LoRA = Low Rank Adaptation.
- squigz 2y agoContext is hard!
- rakoo 2y agoSo instead of LoRa and anything else, everyone now has to say LoRa (the communication protocol) or LoRa (the large model thing). Having to add context all the time makes everything so much simpler !
- WithinReason 2y agoLow rank adaptation is abbreviated LoRA
- squigz 2y agoOr potentially include the necessary context in the title of the post.
- rakoo 2y ago
- rytill 2y agoThat’s LoRa. This is LoRA.
- kcorbitt 2y agoThis specific variant "LoRA+" described in this paper is even harder to search for. I was doing some research on this technique recently and it turns out that "Lora+" matches with "Lora" in Discord search, which is quite unhelpful. :)
- SquareWheel 2y agoDiscord search is one of the worst I've ever used. They remap words like "localization" to "local", which makes it impossible to search for more specific terms.