12 ms·
LinguaCafe: Self-hosted software for language learners to read foreign languages
- AlchemistCamp 3y agoInteresting. This looks like an open source version of Lingq, minus the content library.
- mionhe 3y agoThis looks like a well thought out. It's honestly something I've thought about trying to put together for myself due my own language learning effort. I'm looking forward to trying it out.
- z3n0n 3y agoLooks really promising! Well done. Would love to host an installation for our local learning community. Hopefully we’ll get multiple user accounts soon.
- CyberDildonics 3y agoWouldn't "self hosted software" just be software?
- s0ss 3y agoSure. But the clarifying words are useful in this context. It’s software; a web app that you can host yourself.
- davely 3y agoI found the additional context to be helpful in quickly understanding how / where I could run it.
- Gormo 3y agoIt specifically refers to client/server software where the server-side component is run within one's own server environment, and usually describes FOSS alternatives to SaaS webapps. Normal desktop applications aren't self-hosted, as they aren't hosted in this sense to begin with.
- yellow_lead 3y agoLooks great. I would love to give it a try if it had Chinese support. The japanese support looks good though, maybe another reason to try learning.
- simjanos-dev 3y agoHi! I've added Chinese as an "experimental" language. I couldn't find a dictionary for it yet, and it might need a custom font type. DeepL works as well. I will fix the font issue soon.
- yellow_lead 3y agoThanks! I'll give it a try. There's some various dictionaries I can recommend later, maybe in a GitHub issue.
- huimang 3y agoThis is something I've thought about building for a while. I would definitely use it if there were a Korean option!
- simjanos-dev 3y agoHi! I've added Korean as an "experimental" language. You can try it out if you would like to.
- djordjije 3y ago[dead]
- seusscat 3y agoLooks amazing and I'm keen to try it out. However, I cannot find the sources or set up instructions anywhere on the linked page. Please add at least a link to the github repository to the page so people that stumble upon it can find their way
- burkaman 3y agoThis is incredibly cool. I have been trying to do this exact workflow manually by reading something in Kindle and copy/pasting to DeepL and Anki and it sucks. If the author is here, I'm wondering if you would be open to PRs for other languages? I'd like to try this for French or Italian.
- simjanos-dev 3y agoHi! I've added French and Italian.
- burkaman 3y agoAmazing, thank you! I'll try it out later this week.
- yurishimo 3y agoThis looks sweet! The jellyfin integration especially looks awesome as I find watching videos an excellent way to actively absorb new vocabulary. My current self study centers around movies/tv and Linq, which this tool seems very similar to. I'm learning Dutch, so it's a bummer that it's not supported currently, but I'm keen to dig in and see how much effort it takes to add a new language.
- seusscat 3y agoI agree there. The Jellyfin integration here is the absolute killer feature. I hope to see the first documentation on how to set it up soon.
- barrell 3y agoIf you're shopping around for new ways to learn languages from watching movies/tv, I'm working on another language learning application. I just wrote up the basic features this weekend [1] We support many languages out of the box, would love to hear what's making you consider LinguaCafe over LingQ :) [1] https://blog.phrasing.app/phrasing-first-look/ https://blog.phrasing.app/phrasing-first-look/
- BigElephant 3y agoHello, when do you plan on launching the beta version?
- barrell 3y agoI'm onboarding my second cohort of beta applicants this week, I hope to have a public beta by the end of the quarter or so! I noticed a lot of signups from this post, I'll try to do another round of onboarding this month.
- clbrmbr 3y agoI would be delighted to beta test. I would want to work on my spoken Portuguese so I could interact more naturally with my Brazilian colleagues. I study French, German, Swedish, Mandarin, Japanese, Portuguese, Latin, dabbling in Polish, though it’s hard to find shows dubbed in Latin :). Someday will get to Russian and maybe learn Icelandic as a way of getting closer to the roots of English… but alas life is not forever. I’ve written some LLM-based software for generating podcasts (www.anyglot.com, but the server currently offline). This project showed me that GPT4 is excellent at generating content in English, and in doing various NLP tasks but not translation which was better left for Google. ElevenLabs voices are fantastic but their Japanese would invent weird Kanji readings, tho that was when Multilingual V2 just came out so maybe they’ve fixed that already.
- anadem 3y agoI'd love to try it, but is there a way to get it? Maybe I'm missing a link but I can't figure out a way to try it. Ah, found, it's here: https://github.com/simjanos-dev/LinguaCafe https://github.com/simjanos-dev/LinguaCafe
- i_am_a_squirrel 3y ago+1 OP should add a link!
- pooralaska 3y ago[dead]
- wahnfrieden 3y agoI made an iOS / macOS app with similar functionality, Manabi Reader. It has its own flashcard companion app and also integrates with Anki. https://reader.manabi.io https://reader.manabi.io Japanese only but I am expanding it to more languages early this year.
- outside1234 3y agoLooks great! By the way, I use Apple Books (also works in Kindle) to do something similar - if you press and highlight a section of text, you can translate it, which has done wonders for building my vocabulary in context.
- tracnar 3y agoLooks good! I've been thinking about building something similar but as a desktop app (and maybe browser extension) which would work with whatever text you have on the screen. It seems doable by (ab)using the OS accessibility APIs. I find it hard to stick to importing text, reading them in the app, and marking the words. Having something which works in the background and can tell you where you've previously seen words in different contexts would be ideal for me.
- bunderbunder 3y agoAre you familiar with Language Reactor or Migaku? I think there are a couple others too. They're all implemented as browser extensions, but that works out pretty well because most content that's useful for language learning gets accessed through a browser these days, anyway.
- tracnar 3y agoI wasn't, they look interesting thank you, I'll try it out! Indeed the browser is the most important, even though it would be nice to have something generic for any app.
- wahnfrieden 3y agoMy Manabi Reader app is a browser https://reader.manabi.io https://reader.manabi.io
- bunderbunder 3y agoVery nice. This clearly takes a lot of inspiration from LingQ, but fixes some of LingQ's more glaring challenges such as letting you use a real dictionary, instead of relying on definitions that were crowdsourced from other learners using the app. (And therefore full of quality problems an inaccuracies.) On the other hand, it sounds like some nice features aren't implemented yet, or maybe not even planned, so maybe LingQ is still a good option if you don't want to hassle with self-hosting a webapp or hunting down your own resources, and don't mind paying the subscription fee. All in all, though, it looks very promising!
- barrell 3y agoI’d be curious to hear what niceties you feel LingQ has that it’s missing if you don’t mind sharing
- tenaf0 3y agoLast time I checked, it couldn’t handle expressions that are not just tokens one after the other. For example, German separable verbs. I tried fixing it here: https://news.ycombinator.com/item?id=38915786 https://news.ycombinator.com/item?id=38915786
- tenaf0 3y ago(Misunderstood the question, please ignore my above comment)
- bunderbunder 3y agoEasy importing of lessons from YouTube and Netflix, the built-in libraries of lessons, guidance on what content might be most appropriate to your current level based on known vocabulary, the mobile apps with playlists and audio player, things like that. (Disclaimer: I haven't actually used LinguaCafe, but am a longtime LingQ user, so I'm not really making a fair comparison. I know LingQ's feature set much, much better.)
- gstamp 3y agoImporting audio along with the text is a big one. Failing that some sort of TTS would be very useful.
- zerop 3y agoMy method of learning new languages is always by starting to learn everyday conversations in the language. 1. Learn the translation of the commonly used everyday words 2. Learn the rule to build sentences in different tenses (Verb conjugation) 3. Keep practising in everyday conversations, starting with most simple ones and gradually learn more.
- Tepix 3y agoRegarding 2. i noticed that when learning french, once you know how to form proper questions, conversations take a quantum leap. It also helps to learn the 30ish verbs that are the most important. Good luck.
- novagameco 3y agoWhat about writing? With Korean, learning to sound out the characters is usually the first step, even if you don't know what the words mean. I'm trying to learn some Thai within the next 10 months or so and I heard it's the same way (learn to read first)
- simjanos-dev 3y agoHey guys. I wrote LinguaCafe. I didn't know it was posted here, I've just read it now. I didn't think this many people would be interested. I'll write a guide for Jellyfin, then add Italian, French and Dutch languages tomorrow.
- Beijinger 3y agoChinese please.
- simjanos-dev 3y agoHi! I've added Chinese. However i couldn't find a dictionary for it yet, and it might need a custom font for Chinese characters. DeepL works with it as well. If it has issues, I will fix it soon.
- Beijinger 3y agoThank you so much. There is also Perapeara Dictionary Plug in for Firefox. Maybe can be exctracted.
- simjanos-dev 3y agoHi! I'll release a v0.4 update tomorrow or after. It makes a lot of things more simpler, I would recommend to wait for it before you install it. After that update I'll work on Chinese dictionaries and issues. It will take 1-2 days. It will have two built-in dictionaries for Chinese: cc-cedict and wiktionary.
- allan_s 3y agoI m on my phone but hou have cedict for chinese-english as well as cfdict for chinese to french
- nexawave-ai 3y agoThis is very cool. Yes, please add French and Dutch. Dankjewel!
- _lvbh 3y agoNice! I was just trying to learn Japanese this week but Duolingo is painful
- tenaf0 3y agoI have been working on a similar project on-and-off in my spare time, the only remotely interesting feature that other similar software may not have is that it actually tries to parse/analyze sentences (with an NLP lib). It's made specifically for German, and the reason why I wanted to make it is that no existing software managed to handle separable verbs properly - for example learning "Wir fangen jetzt an." is just wrong if you learn it as 'fangen' and 'an' separately, you actually care about 'anfangen', dictionary-wise. It unfortunately does have false-positives (a complete solution would require LLMs, I believe over the much less complicated NLP algorithms - I just don't want to send whole books to ChatGPT, as that would quickly become expensive), but I found it usable, so I made it public now: https://github.com/tenaf0/lwt https://github.com/tenaf0/lwt I don't want to "advertise" it even more, as the NLP lib is run by academia as a free service, and I don't want to overburden it (I have been planning on hosting it myself, but didn't yet get there).
- jchook 3y agoYou could potentially use an NLP library like SpaCy, or even bundle with a free fine-tuned LLM like Mistral 7b. The fine-tuned mistral models are known to out-perform GPT-4 on their specific tasks.
- ipsi 3y agoInteresting! I have a partially-built, related, tool, to extract "words" from e-books, so I could build flashcard lists and make sure I knew the majority of words that were used - most of them would be common words but every book has a decently-sized selection of specialised vocabulary. I did think about trying to get something fancy done with an LLM or an NLP for figuring out the separable verbs, but in the end, I took a very... brute-force approach, basically grabbing the final word in the "phrase", then prepending that to every word in the phrase one by one and asking "is this a known separable verb?" - I'm not sure how well it worked, but that's a different story.
- seabass-labrax 3y agoYou have my full support for your project, as I think natural language processing is a very exciting and underutilised technology for language learning. But if you want a low-tech solution, I've found Wiktionary to be ideal. Wiktionary has all the declensions and prefixes for German verbs; to use your example: https://en.wiktionary.org/wiki/f%C3%A4ngt_an https://en.wiktionary.org/wiki/f%C3%A4ngt_an tells you what the word is, and gives a link back to: https://en.wiktionary.org/wiki/anfangen#German https://en.wiktionary.org/wiki/anfangen#German I chose to add Wiktionary to Kiwix Android (8GB download) for offline use. In addition, I can search by right-clicking or tap+holding on a word. All that information is available because of the (mostly manual) work done by Wiktionary contributors, but it reaches a very high standard. There is usually more digression and explanation for the usage notes in Wiktionary than, say, Collins German-English dictionary, which is a rather good thing for language learners.
- katspaugh 3y agoNice work! It’s great that you can track your progress in this app! When I was learning German, I used the dictionary lookup on Kindle a lot and made a web app to extract that vocabulary as Anki flashcards. It’s available on https://fluentcards.com https://fluentcards.com. The code is open source on GitHub.
- mdaniel 3y agobecause I didn't see any obvious link to said repo, for convenience: https://github.com/katspaugh/fluentcards https://github.com/katspaugh/fluentcards and https://github.com/katspaugh/fluentcards-grammar https://github.com/katspaugh/fluentcards-grammar Being the resident licensing pedant, I'll point out that neither of those repos have any licensing information aside from package.json and I doubt gravely that's strong enough for any contributor's comfort level
- katspaugh 3y agoAdded licenses, thanks!
- mtalantikite 3y agoThis looks great! One feature request I'd make is to load up two versions of the same text in both your source and target languages to have them displayed side by side. Bonus would be to have the audiobook as well, or some sort of text to speech. Basically, L-R method (Assimil) [1] but for any book! [1] https://learnanylanguage.fandom.com/wiki/Listening-Reading_Method https://learnanylanguage.fandom.com/wiki/Listening-Reading_M...
- jszymborski 3y agoSuper smart idea. I ostensibly do this sort of thing manually to expand my vocabulary in other languages I speak. What does adding a new language involve other than adding a dictionary? It doesn't seem like there are too many language-specific features at first blush.
- qnleigh 3y agoHaving built a similar app, maybe I can comment on this. 1. Languages that have conjugation (I am -> you are -> she is...) need a way to recognize different forms of the same word, as dictionaries typically don't have this information. 2. In some languages, nearby words dramatically modify a word's meaning (in Spanish quito=I take away, me quito=I take off). The modifier words can appear quite far away in the sentence (especially in German I think). 3. Languages that don't put spaces between words are a nightmare. 4. Even for languages that do put spaces, the set of characters that act as a separator can differ slightly. 4. Languages like Chinese and Japanese with their enourmous 'alphabets' need UI changes to help learners with pronounciation of new characters. 5. Fonts and text entry! Does your framework support all 10-jillion Chinese characters and the 5+ different types of on-screen keyboards that people use? Did you remember that Arabic is read right-to-left? Those are all of the main challenges I encounted implementing Spanish, French, Chinese and Japanese. I have no idea what new challenges would come up in Finish, Hindi, Swahili...
- znjxz 3y agoThank you very much. I think this project would be great for my son who just started elementary school to learn English. Please add English.
- qnleigh 3y agoWhat's his native language? One would need a dictionary going from English into that.