darkolorin

6 ms·

1.
Show HN: We made LM studio alternative based on own engine(trymirai.com)
3 points by darkolorin 1y ago|0 comments
2.
by darkolorin 1y ago
Basically “faster” means better performance e.g. tokens/s without loosing quality (benchmarks scores for models). So when we say faster we provide more tokens per second than llama cpp. That means we effectively utilize hardware API av
3.
Show HN: We made our own inference engine for Apple Silicon(github.com)
186 points by darkolorin 1y ago|46 comments
4.
MBA Harvard Feels Undervalued(old.reddit.com)
8 points by darkolorin 1y ago|1 comments
5.
Faster Inference Than MLX(trymirai.com)
1 points by darkolorin 2y ago|0 comments
6.
90T/s on my iPhone llama3.2-1B-fp16(reddit.com)
5 points by darkolorin 2y ago|1 comments
7.
by darkolorin 2y ago
I made it! 90 t/s on my iPhone with llama1b fp16 We completely rewrite the inference engine and did some tricks. This is a summarization with llama 3.2 1b float16. So most of the times we do much faster than MLX. lmk in comments if you
8.
ONNX to CoreML(github.com)
1 points by darkolorin 9y ago|0 comments
9.
DIY Prisma app with CoreML(blog.prismalabs.ai)
8 points by darkolorin 9y ago|0 comments
10.
Torch to CoreML(github.com)
3 points by darkolorin 9y ago|0 comments
11.
Learn your style for Prisma(styles.prisma-ai.com)
1 points by darkolorin 10y ago|0 comments
12.
AI goes massive with Prisma(prisma-ai.com)
3 points by darkolorin 10y ago|0 comments
13.
by darkolorin 12y ago
It's my first experience on Medium. I hope community can help me to improve my skills.
14.
Quantum product(medium.com)
2 points by darkolorin 12y ago|1 comments
15.
by darkolorin 12y ago
really great idea, but why morning? %)