mzubairtahir

3 ms·

1.
Mind sharing Google Colab pro or a VM?
1 points by mzubairtahir 1mo ago|0 comments
2.
by mzubairtahir 3mo ago
Harness can totally change capability of the model
3.
Companies are optimizing models for specific benchmarks
4 points by mzubairtahir 3mo ago|0 comments
4.
Ask HN: Why AI labs publish different benchmarks?
2 points by mzubairtahir 3mo ago|1 comments
5.
Problem with Muse Spark 1.1
1 points by mzubairtahir 3mo ago|1 comments
6.
by mzubairtahir 3mo ago
Some moats are going to change in future
7.
by mzubairtahir 3mo ago
It is
8.
by mzubairtahir 3mo ago
That's true that businesses don't want to waste their time by maintaining that software but it's also true that a bigger number of users will start cloning in the future especially fable, it's very good at this thing.
9.
by mzubairtahir 3mo ago
It's not about cloning and selling your own app. It's about using app that you are paying for, by cloning it using AI.
10.
by mzubairtahir 3mo ago
You did not get my point. My point was about if user just start cloning apps they are already using.
11.
What if users start cloning SaaS using AI
7 points by mzubairtahir 3mo ago|26 comments
12.
by mzubairtahir 3mo ago
i mean currently people are burn out due to a lot of ai models mainly due to decision fatigue which one to use, what will happen when we would have millions?
13.
by mzubairtahir 3mo ago
what? both are two different things
14.
Ask HN: If there would be millions of AI models in future
1 points by mzubairtahir 3mo ago|4 comments
15.
Open source project for evaluating two models on specific task
1 points by mzubairtahir 3mo ago|0 comments
16.
by mzubairtahir 3mo ago
imporvements are happening in other things like less token usage, speed, cost etc
17.
Ask HN: How much memory is useable by GPU in MacBook?
3 points by mzubairtahir 4mo ago|2 comments
18.
by mzubairtahir 4mo ago
sorry but asking again: how much memory is actually useable by gpu in macbook? as it is shared(os and apps also have to use same memory)? and it is different than dedicated gpu memory?
19.
by mzubairtahir 4mo ago
but still it can run handsome models
20.
by mzubairtahir 4mo ago
are you saying because of speed or it just cant run them?
21.
by mzubairtahir 4mo ago
how much memory is actually useable by gpu in macbook? as it is shared?
22.
Ask HN: MacBook vs. Dedicated GPU for LLM
37 points by mzubairtahir 4mo ago|71 comments
23.
by mzubairtahir 4mo ago
i think you did not check app properly, it is actually taking required context window from the user and then caluclate kv cache size and then count it along with size of model itself. it also reserves some more memory to avoid oom....
24.
by mzubairtahir 4mo ago
that broken input is fixed
25.
by mzubairtahir 4mo ago
now that is fixed, please try it
26.
by mzubairtahir 4mo ago
actually that input is broken. and sorry for that. and I am adding shared memory features in next iterations.
27.
by mzubairtahir 4mo ago
actually, currently it is not open source, but I am thinking about making it open source so that other developers can also contribute in it(espeically data layer). what do you think?
28.
by mzubairtahir 4mo ago
actually that's free by design, it is just broken. fixing it in next sprint. And really thanks for your feedback!!!
29.
Show HN: A GPU/VRAM filter for finding LLMs that will run on your hardware(whichllmmodel.com)
2 points by mzubairtahir 4mo ago|12 comments
30.
App to find best model by filtering AI models(which-llm-model.netlify.app)
2 points by mzubairtahir 4mo ago|0 comments

More ›