3 ms·
I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2
by kaspermarstal 2y ago
I built an Excel Add-In that allows my girlfriend to quickly filter 7000 paper titles and abstracts for a review paper that she is writing [1]. It uses Gemma 2 2b which is a wonderful little model that can run on her laptop CPU. It works surprisingly well for this kind of binary classification task.
The nice thing is that she can copy/paste the titles and abstracts in to two columns and write e.g. "=PROMPT(A1:B1, "If the paper studies diabetic neuropathy and stroke, return 'Include', otherwise return 'Exclude'")" and then drag down the formula across 7000 rows to bulk process the data on her own because it's just Excel. There is a gif on the readme on the Github repo that shows it.
[1] https://github.com/getcellm/cellm https://github.com/getcellm/cellm
- relistan 2y agoVery cool idea. I’ve used gemma2 2b for a few small things. Very good model for being so small.
- lizamomo96 2y ago[dead]
- afro88 2y agoHow accurate are the classifications?
- kaspermarstal 2y agoI don't know. This paper [1] reports accuracies in the 97-98% range on a similar task with more powerful models. With Gemma 2 2b the accuracy will certainly be lower. [1] https://www.medrxiv.org/content/10.1101/2024.10.01.24314702v1 https://www.medrxiv.org/content/10.1101/2024.10.01.24314702v...
- indolering 2y agoY'all definitely need to cross validate a small number of samples by hand. When I did this kind of research, I would hand validate to at least P < .01.
- kaspermarstal 2y agoShe and one other researcher has manually classified all 7000 papers as per standard protocol. Perhaps for the next article they will measure how this tool agreed with them against them and include it in the protocol if good enough.
- beernet 2y ago> I don't know. HN in a nutshell: I've built some cool tech but have no idea if it is helpful or even counter productive...
- rasmus1610 2y agoSometimes people just like to build stuff for the sake of it.
- jajko 2y agoAlmost like hackers, doing shit just for the heck of it because they can (mostly)
- corobo 2y agoReal HN in a nutshell: People who don't build stuff telling people who do build stuff that the thing they built is useless :P It's a hacker forum, let people hack! If anything have a dig at OP for posting the thread too soon before the parent commenter has had the chance to gather any data, haha
- greenavocado 2y agoJust because you can, doesn't mean you should
- corobo 2y agoIf you're building a dinosaur sanctuary sure
- stackghost 2y agoOr an Internet surveillance-capitalism panopticon.
- Breza 2y agoGreat attitude! I recently built a tool for my wife that uses an LLM to automate a task. Is it production ready? Definitely not. But it saves her time even in its current state.
- donbreo 2y agoRequirements: -Windows Looks like I'm out... Would be great if there was a google apps script alternative. My company gave all devs linux systems and the business team operates on windows. So I always use browser based tech like Gapps script for complex sheet manipulation
- jkman 2y agoWell it's an excel add-in, how else would it work?
- NotMichaelBay 2y agoExcel add-ins can be written with the Office JS API so that they can run on web as well as desktop for Windows and Mac. But I don't think OP's add-in is possible with that API unless the local model can be run in JS.
- 7734128 2y agoYou could have called it CellMate b
- 7734128 2y agoYou could have called it CellMate
- vdm 2y agohttps://x.com/Suhail/status/1882069209129340963 https://x.com/Suhail/status/1882069209129340963
- sdgsgsfg 2y ago[dead]
- basmok 2y agoCan someone hack this together as pure matrix multiplication? Like either as table in the background or as regular script? On most computers you can't compile or add add-ons without administrative rights and LLM Chat sites are blocked to prevent usage of company data. It should run on native Excel or GSheets. I mean, pure without compilation, just like the do the matrix calculations here straight in Excel without admin rights: Lesson 1: Demystifying how LLMs work, from architecture to Excel https://youtu.be/FyeN5tXMnJ8 https://youtu.be/FyeN5tXMnJ8 As far as i know in GSheet the scripts also run on the Google Servers and are not limited by the local computer power. So there larger models could be deployed. Someone can hack this into Excel/GSheet?
- TeamDman 2y agoTried it out, very cool! Fun to see it chugging on a bunch of rows. Had a weird issue where it would recompute values endlessly when I used it in a table, but I had another table it worked with so not sure what that was about
- kaspermarstal 2y agoGlad you tried it out! Excel triggers recalculation when a referenced cell updates, just like with any other formula. This is also why responses are not streamed, as every update would trigger recalculation. But if the async behavior of responses messes with the recalculation logic I am very interested in looking into it and you are most welcome to open an issue in the repo with steps to reproduce.
- gorkish 2y agoProbably would want to run with Manual calculation set on your sheet if using this.
- upcoming-sesame 2y agoCould it be adapted for Google Sheets ?
- kaspermarstal 2y agoYes, and it will be
- ddddqqqq 2y agoSeems very nice and useful. I'd like to have something similar integrated with Zotero to get an easy interaction and get answers about papers I added as references.