5 ms·

Cursed acronym. Damnit; I don't want to have to keep up with the difference between LoRa and LoRA.

by gorkish 3y ago

deleted 3y ago
[deleted]
cantSpellSober 3y ago
I, too, clicked through thinking this was about LoRaWAN (despite context clues)
- sleepybrett 3y ago
  The context clues being that every VC in the world is now trying to prop up their over commitments in 'AI' ...
- tlavoie 3y ago
  Same, and I was hoping to be highly amused by someone's Arduino somehow unlocking heavily computational LLM secrets via tiny tiny dribbles of radio traffic.
  - McNutty 3y ago
    Same also. I was fascinated with the idea that someone was trying to fine-tune some RF parameters using AI and accidentally undid some safety mechanism
diggan 3y ago
Usually when people just write "lora" or "lora", it's hard to know the difference indeed. But if someone writes "lora fine-tuning", isn't it already pretty clear what they are talking about?
- gorkish 3y ago
  I find it interesting you would reach for that term to make this argument.
- McNutty 3y ago
  No, because you can fine-tune a number of things in LoRa. Why are you saying lora, just to b8?
dreadlordbone 3y ago
I tried to google this but it's pretty difficult, can you explain the difference between LoRa and LoRA?
- diggan 3y ago
  One is LoRa as in "long range" and the other is LoRA as in "Low-rank adaption". The first is for radio communications, the second is for technique for more efficient fine tuning of deep learning models. - https://en.wikipedia.org/wiki/LoRa https://en.wikipedia.org/wiki/LoRa - https://en.wikipedia.org/wiki/Fine-tuning_(deep_learning)#Low-rank_adaption https://en.wikipedia.org/wiki/Fine-tuning_(deep_learning)#Lo...
esafak 3y ago
That's what happens when people aren't familiar with fields other than their own. ML people famously re-invented statistical terminology, and used the wrong terms when they did exist. For example, they call inference "learning" and prediction "inference". https://insights.sei.cmu.edu/blog/translating-between-statistics-and-machine-learning/ https://insights.sei.cmu.edu/blog/translating-between-statis... They also recycled their own terms: generative models went from being another name for good old joint distributions (more of that terminology re-invention) to being, well, something that a human might associate with generation. Except by that point they had decided to change their field's name too, so we've ended up with "generative AI"!!
dragonwriter 3y ago
Even without capitalization differences, acronym collisions between different domains are common, and this particular pair is usually easily resolved by context, though maybe not always in headlines.

Cursed acronym. Damnit; I don't want to have to keep up with the difference between LoRa and LoRA.

deleted 3y ago

[deleted]

cantSpellSober 3y ago

I, too, clicked through thinking this was about LoRaWAN (despite context clues)

sleepybrett 3y ago
The context clues being that every VC in the world is now trying to prop up their over commitments in 'AI' ...
tlavoie 3y ago
Same, and I was hoping to be highly amused by someone's Arduino somehow unlocking heavily computational LLM secrets via tiny tiny dribbles of radio traffic.
- McNutty 3y ago
  Same also. I was fascinated with the idea that someone was trying to fine-tune some RF parameters using AI and accidentally undid some safety mechanism

diggan 3y ago

Usually when people just write "lora" or "lora", it's hard to know the difference indeed. But if someone writes "lora fine-tuning", isn't it already pretty clear what they are talking about?

gorkish 3y ago
I find it interesting you would reach for that term to make this argument.
McNutty 3y ago
No, because you can fine-tune a number of things in LoRa. Why are you saying lora, just to b8?

dreadlordbone 3y ago

I tried to google this but it's pretty difficult, can you explain the difference between LoRa and LoRA?

diggan 3y ago
One is LoRa as in "long range" and the other is LoRA as in "Low-rank adaption". The first is for radio communications, the second is for technique for more efficient fine tuning of deep learning models. - https://en.wikipedia.org/wiki/LoRa https://en.wikipedia.org/wiki/LoRa - https://en.wikipedia.org/wiki/Fine-tuning_(deep_learning)#Low-rank_adaption https://en.wikipedia.org/wiki/Fine-tuning_(deep_learning)#Lo...

esafak 3y ago

That's what happens when people aren't familiar with fields other than their own. ML people famously re-invented statistical terminology, and used the wrong terms when they did exist. For example, they call inference "learning" and prediction "inference". https://insights.sei.cmu.edu/blog/translating-between-statistics-and-machine-learning/ https://insights.sei.cmu.edu/blog/translating-between-statis... They also recycled their own terms: generative models went from being another name for good old joint distributions (more of that terminology re-invention) to being, well, something that a human might associate with generation. Except by that point they had decided to change their field's name too, so we've ended up with "generative AI"!!

dragonwriter 3y ago

Even without capitalization differences, acronym collisions between different domains are common, and this particular pair is usually easily resolved by context, though maybe not always in headlines.