6 ms·
NotebookLlama: An open source version of NotebookLM
- jacksonLiu89 2y ago[dead]
- danpalmer 2y agoI'm not so sure this is an open source NotebookLM as it is a few experiments in an iPython notebook. What NotebookLM does at an LLM level is not particularly novel, it's the packaging as a product in a different way than what others are doing that I think is interesting. Also the "podcast" bit is really just an intro/overview of a large corpus, far more useful is being able to discuss that corpus with the bot and get cited references. What this does however demonstrate is that prototyping with LLMs is very fast. I'd encourage anyone who hasn't had a play around with APIs to give it a go.
- behnamoh 2y ago> What NotebookLM does at an LLM level is not particularly novel, it's the packaging as a product... Disagreed. NLM is novel in how the two hosts interrupt and overlap each other. No other OSS solution does that, they just take turns talking.
- danpalmer 2y agoFair point, although to me the "audio overviews" are a minor feature of the product.
- pmontra 2y agoBut that's a bad habit and we tell people not to do it. So it's a novel but undesirable feature IMHO.
- hackernewds 2y agonot necessarily when you're really jiving with someone, the conversation flows really well. notice this is also what makes for really good vs bad television, example pulp fiction
- gnabgib 2y agoPage title: NotebookLlama: An Open Source version of NotebookLM
- dang 2y agoFixed. Thanks! (Submitted title was "Meta's Open Source NotebookLM") "Please use the original title, unless it is misleading or linkbait; don't editorialize." - https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- alanzhuly 2y agoIf we can have this running locally on mobile phone that would be pretty cool. Imagine receiving a work document (for example, product requirement documents), and then this turning it into a podcast to play for me while I am driving. I think my productivity will be through the roof and I don't need to worry about compliance issues.
- SubiculumCode 2y agoI wish chatgpt or Claude would make an an Android Auto app that I can use while driving.
- hackernewds 2y agoyou could just Bluetooth your speakers
- SubiculumCode 2y agoits more with using the microphones in the car rather than the phone's microphone, as they tend to work better for hearing the driver..or at least I think they would.
- mmaunder 2y agoI’d love to hear the output if anyone has used this.
- herval 2y agoThere’s an example output linked on the github page
- deleted 2y ago[deleted]
- lelag 2y agoPretty weird choice of TTS engines. None of them are anywhere near state of the art as far as open TTS system goes. XTTSv2 or the new F5-TTS would have been much better choices.
- segmondy 2y agoYou can always update the code to use that. Meta releasing stuff on github is not trying to release the "bet" but to give a proof of concept. The licenses of those TTS system matters, it's not enough to be open. If this was a product for their users, they will definitely have better TTS.
- imjonse 2y agoFrom improvements needed on the page: "Speech Model experimentation: The TTS model is the limitation of how natural this will sound. This probably be improved with a better pipeline and with the help of someone more knowledgable-PRs are welcome! :)"
- hackernewds 2y agoThe "PRs are welcome" posture for a for-profit entity, that actively harms minds and pretending to be open source gives me the heebie-jeebies
- zmmmmm 2y agoIt only creates the podcasts right? I am more interested in the other features of NotebookLM. The podcasts are fun but gimmicky.
- creativenolo 2y agoCounterpoint: I have used the podcast numerous times and shared it with many. Great system and medium to digest complex information that I otherwise wouldn’t have.
- jklein11 2y agoMan.. the sample is pretty rough
- ttul 2y agoThe more I listen to NotebookLM “episodes”, the more I am convinced that Google has trained a two-speaker “podcast discussion” model that directly generates the podcast off the back of an existing multimodal backbone. The two speakers interrupt and speak over each other in an uncannily humanlike manner. I wonder whether they basically fine tuned against a huge library of actual podcasts along with the podcast transcripts and perhaps generated synthetic “input material” from the transcripts to feed in as training samples. In other words, take an episode of The Daily and have one language model write a hypothetical article that would summarize what the podcast was about. And then pass that article into the two—speaker model, transcribe the output, and see how well that transcript aligns with the article fed in as input. I am sure I’m missing essential details, but the natural sound of these podcasts cannot possibly be coming from a text transcript.
- rmorey 2y agoI feel similarly about NotebookLM, but have noticed one odd thing - occasionally Host A will be speaking, and suddenly Host B will complete their sentence. And usually when this happens, it's in a way that doesn't make sense, because Host A was just explaining something to or answering a question of Host B. I'm actually not sure what to make of that, but it's interesting to note
- behnamoh 2y agoThat's the annoying part about NLM. It ruins the illusion of having one person explaining it to the other person.
- dleeftink 2y agoIt's speaker diarisation, and depending on the quality of the resulting labelling and speaker end marker tokens, what influences the rhythm of a conversation (Or the input data just has many podcast hosts completing each other's..sandwiches?)
- TibbityFlanders 2y ago[dead]
- rmorey 2y agoThe sample output is very poor. Cool demo, but really just emphasizes how much of a hit product the NotebookLM team has managed to come up with, ostensibly with more or less the same foundation models already available.
- jrm4 2y agoGreat to see this: Fellow tech-geeks, ignore the NotebookLM thing at your peril. NotebookLM, far and away, has been the "AI Killer App" for the VAST MAJORITY of bright-but-not-particularly-techy people I know. My 70ish parents and my 8 year old kid are both just blown away by this thing and can't stop playing with it. Edit: As someone pointed out below, I absolutely mean just the "podcast" thing.
- jeffbee 2y agoAre we talking about NotebookLM generally or specifically the podcast stunt?
- jrm4 2y agoGood question: I absolutely mean the podcast stunt.
- dartos 2y agoIdk if I’d call it a killer app. The podcasts are grating to listen to and usually only contain very surface information I could gain from a paper’s abstract. It’s a wildly impressive technical achievement though.
- factsaresacred 2y agoIt does have a tendacy to meander or spend too time reflecting on a topic instead of distilling the details. However the new ability to add a prompt improves this greatly. Some instructions that worked for me: - Specifics instead of high level - Approach from non-critical perspective - Dont be philosophical - Use direct quotes often - Focus on the details. Provide a lesson, not reflections - Provide a 'sparknotes' style thorough understanding of the subject
- magic_hamster 2y agoOh, when was this added? I'll have to check it out.
- sajid-aipm 2y agoI wonder, how soon they release this in other languages and with different accents epecially Se-Asian accents.
- notpushkin 2y agoThis is in fact pretty explicitly not open source: https://github.com/meta-llama/llama-recipes/blob/d83d0ae7f5c9953737d9bbdca490c03282f24c37/pyproject.toml#L18 https://github.com/meta-llama/llama-recipes/blob/d83d0ae7f5c... (And given there is no LICENSE file, I’m afraid you can only use this code as reference at best right now)
- deleted 2y ago[deleted]
- egnehots 2y agoIt might be a mistake since it's different from what's stated in their readme: https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/USE_POLICY.md https://github.com/meta-llama/llama-models/blob/main/models/... (which is referring to the license of Meta Llama 3.2)
- notpushkin 2y agoOh, I see the links now, thanks! But they reference four different licenses, and those are the licenses just for model weights I think? If the intention was to make something that you can only use with Llama models, stating that clearly in a separate code license file would be better IMO. (Of course, this would also mean that the code still isn’t open source.)
- creativenolo 2y agoIt doesn’t look that useful to use as it. But the approach there are investigating is clearly and well documented in plain text. Seems like a valid contribution to public knowledge to be grateful for, even if it can’t be use verbatim.
- hackernewds 2y agoI would just hope that they disingeniously stop promoting these kind of things as open source
- terhechte 2y agoI tried to build something kind of like NotebookLM (personalized news podcasts) over the past months (https://www.tailoredpod.ai https://www.tailoredpod.ai), but biggest issue is that the existing good TTS Apis are so expensive that a product such as NotebookLM is not really possible for a normal company that doesn't have internal access to Google's models. OpenAI has the cheapest / quality good enough TTS Api, but even then generating hours of audio for free is way too expensive. Open Source TTS models are slowly catching up, but they still need beefy hardware (e.g. https://github.com/SWivid/F5-TTS https://github.com/SWivid/F5-TTS)
- gargablegar 2y agoWhen you say beefy? How much beef?
- leobg 2y agoYou have users? If TTS is your bottleneck, I might be able to help. Email in bio.
- deleted 2y ago[deleted]
- luxus 2y agonow i need something that pseudonyms my pdfs/input in the first step
- antononcube 2y agoHere is another (Jupyter based) notebook solution supporting LLaMA models: https://raku.land/zef:antononcube/Jupyter::Chatbook https://raku.land/zef:antononcube/Jupyter::Chatbook . Here is a demo movie: https://youtu.be/zVX-SqRfFPA https://youtu.be/zVX-SqRfFPA