5 ms·
This is hugely underrated in my opinion: it’s a very competent search engine. It also ships as part of the Python standard library, so if your machine has Pyth
by simonw 2y ago
This is hugely underrated in my opinion: it’s a very competent search engine.
It also ships as part of the Python standard library, so if your machine has Python installed you have a high quality search engine ready to use without installing anything else.
I have a CLI tool (and Python library) for working with it here: https://sqlite-utils.datasette.io/en/stable/cli.html#configuring-full-text-search https://sqlite-utils.datasette.io/en/stable/cli.html#configu...
- wahnfrieden 2y agothough useless for many non english languages
- keithalewis 2y ago[flagged]
- zarathustreal 2y agoMy brother in Christ, releasing a tool for free does not exempt it from criticism
- epcoa 2y agoEh? The tokenizers are fully pluggable, the Unicode and ICU tokenizers will be good for many purposes and you can always drop something specific in. Eg https://github.com/wangfenjin/simple https://github.com/wangfenjin/simple
- wahnfrieden 2y agoI know it’s extensible, with original work. ICU isn’t helpful for some languages
- AlexeyBelov 2y agoFor what languages? Why ICU isn't helpful? My naive guess would be "it works for anything supported by Unicode".
- wahnfrieden 2y agolanguages that don't use spaces like Japanese
- troupo 2y agoOf all/many opensource projects I looked at, only meilisearch is good for non-English languages: https://www.meilisearch.com/docs/learn/resources/language https://www.meilisearch.com/docs/learn/resources/language
- wahnfrieden 2y agoJapanese support looks good. But it looks like I can’t deploy this inside an iOS app :(
- plq 2y agoWhy not?
- wahnfrieden 2y agoI need an offline client side db/ fts (for this language learning app: https://reader.manabi.io https://reader.manabi.io )
- plq 2y agoTo my knowledge, meili is free software (MIT license) so theoretically, it should be possible to embed it to an IOS app.
- wahnfrieden 2y agoit's more about the tech it uses... it's oriented toward docker based deploy and is made in rust so maybe it can be ported to iOS, I'd have to spend time forking the packaging. looks like it's geared toward server environments
- djhn 2y agoUnfortunately it still works very poorly for languages with compound words (German, Swedish, Finnish) where you would usually want to surface search results if someone uses the second or third part of the compound word, otherwise the user has to enumerate the (often too many) variants. Meilisearch doesn’t support suffix search and their tokenizer can’t handle these languages. For instance searching for ‘___missilestrike’ in Kyiv would ideally surface all incidents, regardless of launch mode (surface-to-surface, air-to-surface…), range, propulsion, warhead, or guidance system. In these languages a number of these would form the prefix of that compound word.
- deleted 2y ago[deleted]
- anitil 2y agoOn a lark I used this to build a local-first code search tool for my organisation. Of course I used datasette for running the queries. Other than getting all my git access revoked and receiving a very concerned email from our security team, it was a great project.
- marvel_boy 2y agoWait, why they revoked git access?
- Retr0id 2y agoSomeone unexpectedly ingesting all git repos at once would look a lot like a compromised workstation being used to harvest company data. I assume everything was fine once they explained what was going on.
- anitil 2y agoYes you're exactly correct. They were worried I'd had my laptop compromised or stolen but after a little bit of back and forth I think they just thought it was funny and restored my access
- rcarmo 2y agoI have been using it as my only searching engine for my blog in years and it’s much better than anything else I’ve thrown at it. For bonus points, peewee ORM supports it directly.
- nxicvyvy 2y agoShh, it's a secret, don't tell people.
- barrenko 2y agoI've got half of my mind to use this as a search for legal documents and "pretend" it's an LLM.