4 ms·

Great point! Totally agree. I also think -- in the spirit of learning -- most of the folks on HN would probably like to know more details about the fine-tuning

• fnordpiglet 3y ago
  I agree, I’m always interested in the fine tuning mechanics. Unfortunately most of the guides posted these days are selling a SaaS that simplifies the processes whereas I’m not interested in the glossed over process but the brutal details. My grandfather was a relatively renowned medical researcher who eschewed funding to publish his research in the open. As a result he published a huge corpus of research across a vast array of medical topics, but those old papers aren’t indexed anywhere and without a corporate sponsor his work was largely forgotten. We compiled all his papers in his final years and bound them in a multi volume set. I plan to unbind them and have a company OCR them and so I can fine tune a model with them, and provide them and their references and citing papers in a vector db. I’m curious what of his mind I can recapture, as his every moment even in personal life he spoke about and like his language in papers. His only hobby outside research was shotput and trying to cure some beagle he rescued from a shelter that had some unknown chronic skin disease. I’m busy at the moment but have been passingly following and reading papers on the LLM work happening in the open to prepare to do that side project. I’ve been kind of disappointed with the quality of guides out there and the rapid commercialization of the space.