3 ms·
Feels like i'm missing the introduction paragraph in the repo. What is LoRA in this context? the communication protocol? Or another term appropriated by LLMs?
by monegator 3mo ago
Feels like i'm missing the introduction paragraph in the repo.
What is LoRA in this context? the communication protocol? Or another term appropriated by LLMs? Why the speedrun?
- gowthamgts12 3mo agoLow Rank Adaptation. Google “Lora llm”
- Schlagbohrer 3mo agoYes but what are LoRAs being tested for / trying to do in this case? I couldn't find any information there about what the actual output goal is for the LoRAs. Speed doing what?
- maleldil 3mo agoHow long it takes to train that particular configuration. The table column is named "train time".
- garimbaboy 3mo agoLoRa (Long Range) is a physical radio communication techniche.[1] LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique for large language models.[2] [1] https://en.wikipedia.org/wiki/LoRa https://en.wikipedia.org/wiki/LoRa [2] https://en.wikipedia.org/wiki/LoRA_(machine_learning) https://en.wikipedia.org/wiki/LoRA_(machine_learning)
- nomel 3mo agoThe author responds with reasoning here: https://news.ycombinator.com/item?id=48975473 https://news.ycombinator.com/item?id=48975473 The AI slop "why" section in the readme is completely useless. I struggle with this too. I start every project doc with a "why" then "overview" section, and AI is still horrendously bad at the "why", filled with vapid corpo/tech startup speak. I usually write the "why" myself, or at least put down the outline to be completed.