3 ms·
1.8B/3.25B is still too much for edge devices. Ideally tens or hundreds mega would be ok. Is there an option to change the builtin Gemini Nano to other smaller
by mikeqq2024 2y ago
1.8B/3.25B is still too much for edge devices. Ideally tens or hundreds mega would be ok. Is there an option to change the builtin Gemini Nano to other smaller models?
By the way, haven't touch the lastest JS code for a while, what does this new syntax mean: "import { chromeai } "
Also not get the textStream code:
for await (const textPart of textStream) {
result = textPart;
}
does result get override for each loop step?
- dchest 2y agoThat's just some supplemental code. The actual API is: const session = await window.ai.createTextSession() const outputText = await session.prompt(inputText) That's all there is for now (createGenericSession does the same at this time, and there are canCreateTextSession/canCreateGenericSession).
- dchest 2y agoUpdate: there's actually quite a lot more: https://github.com/explainers-by-googlers/prompt-api https://github.com/explainers-by-googlers/prompt-api
- oefrha 2y agoThese are 4-bit models.
- zecg 2y agoMade by a by a two-bit company that...
- kevindamm 2y ago`import { chromeai } from ...` is doing destructuring of the exported symbols of the module being imported. So, here it only imports the variable or type or function named chromeai.
- deleted 2y ago[deleted]