coder543

33 ms·

541.
by coder543 3y ago
v3 only comes in one flavor: large. I don’t think you’re going to have a good time running the large model on a Pi of any kind. The large models are 32x slower than the tiny models, roughly.[0] I just tested, and whisper.cpp on my Pi 4 can
542.
by coder543 3y ago
Real time transcription is not necessarily short snippets. In my experience, initial prompt is useless beyond the first 30 seconds if the words in the initial prompt aren’t used every 30 seconds, including the first 30. It may be easy to r
543.
by coder543 3y ago
The submission link is weird. It has far fewer stars than the repo it is forked from, and could just be an ad for replicate.com? It is missing the most recent commits from what appears to be the real source: https://github.com&#x
544.
by coder543 3y ago
“prompt” is arguably a misnomer. In other implementations, it is correctly called “initial-prompt”, and even the whisper.cpp help describes it as an initial prompt. It only affects the first 30 second window of the transcription, as far as
545.
by coder543 3y ago
https://github.com/SpectralVectors/RightMouseNavigation
546.
by coder543 3y ago
The article links to their huggingface page[0], which offers both chat and non-chat models, and it appears that they come with the code necessary to be run, but I have not actually tried to run them. [0]: https://huggingface.co&#
547.
by coder543 3y ago
If you had actually read what it wrote: "Remember, this is a probabilistic approach and works well if the lines in your file are roughly the same length. If the line lengths vary significantly, some lines will have a higher or lower ch
548.
by coder543 3y ago
That is a problematic request for multiple obvious reasons, and for those same reasons, ChatGPT resisted providing an implementation that didn't require indexing the file. By telling it "no indexing is allowed, provide a best ef
549.
by coder543 3y ago
Similarly: https://chat.openai.com/share/bc4a533e-c007-48ea-9232-0e548b... The "<" is actually an unnecessary additional character to type.
550.
by coder543 3y ago
Sure: https://chat.openai.com/share/0a3e52c6-1db8-422a-a98c-cb3500... I laid out the constraints, but I did not mention reservoir sampling at all. The script seems to work as expected when I run it against a dictionary
551.
by coder543 3y ago
For 128k context (even with a 7B model), I don't think 8GB is nearly enough. I've heard there might be tricks to get it under 24GB... but I haven't personally seen it under about 28GB, IIRC. Definitely not heard of it being p
552.
by coder543 3y ago
No... TBW scales with the size of the disk. The 870 EVO is not uniformly rated for 2400TBW. Different technologies will have different TBW per GB of storage, but for a line of SSDs with the same technology, it almost always scales linearly
553.
by coder543 3y ago
What prompt did you use? (Besides the transcript itself)
554.
by coder543 3y ago
> The author didn't say it is a bug. The author's title literally refers to it as a bug.
555.
by coder543 3y ago
The person I replied to had decided to compare Mistral to what was launched, so I went along with their comparison and showed how I have been unsatisfied with it. But, these open models can certainly be fun to play with. Regardless, where d
556.
by coder543 3y ago
OpenAI offering 128k context is very appealing, however. I tried some Mistral variants with larger context windows, and had very poor results… the model would often offer either an empty completion or a nonsensical completion, even though t
557.
by coder543 3y ago
My experience is that what you're describing is only initial_prompt , and it only affects the first 30-second transcription window of the audio in question. It's effectively useless for helping the model transcribe new words in l
558.
by coder543 3y ago
How are you determining "equivalent"? I don't agree with your conclusion at all. My M2 MBA is 2.7lbs. The 14" MBP starts at 3.4lbs. That is a very noticeable 26% increase. 0.44 inches thick versus 0.61 inches thick is
559.
by coder543 3y ago
No. None of what you're writing is accurate. No processor made in the last decade will ever idle at the base clock. Any modern processor idles far, far lower than that, approximately 1Ghz, maybe even lower. Idling at multiple gigaher
560.
by coder543 3y ago
> I don't see why they had to splurge all the way up to 512GB. Quoting the article: "To celebrate the much-hyped launch, our sister site PCMag put the flagship CPU through its paces (remotely) in several popular benchmarks.&quo
561.
by coder543 3y ago
>> and the thermal solution is only just meeting the spec. Ok, so, as I alluded to earlier... make sure to have better-than-minimum-spec cooling to let the processor indefinitely run all cores at the boost clock (or very close to it).
562.
by coder543 3y ago
Single threaded tasks should never run at the base clock. The base clock can pretty much be thought of as the minimum clock speed you should see when all cores are maxed out and the thermal solution is only just meeting the spec.
563.
by coder543 3y ago
You’re the one making the extraordinary claim that Google has the authority to force Qualcomm into a far reaching support agreement. That kind of claim deserves evidence from you if you want it to be taken seriously. I never claimed to be
564.
by coder543 3y ago
Money can’t just make anything happen for any reason. Please re-read my first comment to you. Google has no apparent legal authority to stand on to do what you’re suggesting. You’re not even pretending to explain where they would get the le
565.
by coder543 3y ago
Thanks for those “insights” into trade law… Google isn’t above the law, despite what some people in this thread apparently wish.
566.
by coder543 3y ago
> Google is not a naive poor company that isn't capable to have a lawyer company setting up proper support contracts. Set up contracts with whom, exactly? Google doesn’t control the other OEMs, and the other OEMs are the ones negoti
567.
by coder543 3y ago
The Tensor G1 was probably pretty close to that, but I think subsequent generations have been diverging more. They are still made at Samsung's fabs, and I wouldn't be surprised if Samsung is still helping to design the chips. Eith
568.
by coder543 3y ago
"Business decision" and "artificial limitation" are frequently synonymous. I think @MishaalRahman was correct to say "If OEMs keep buying a particular chipset [...] then it'll continue being supported",
569.
by coder543 3y ago
Fairphone made some claims about this when they launched the Fairphone 5. That's the sole reason it's not using a normal consumer-facing Snapdragon chip, and instead using some kind of industrial Qualcomm chip. Fairphone pointing
570.
by coder543 3y ago
Where did I mention the Tensor G1 and G2? I didn't. I only said "Tensor G3". Yes, feel free to blame Google for not supporting the G1 and G2 better. None of that changes that Qualcomm does not support consumer smartphone

More ›