wsxiaoys

7 ms·

31.
by wsxiaoys 2y ago
Never imagined our project would make it to the HN front page on Sunday! Tabby has undergone significant development since its launch two years ago [0]. It is now a comprehensive AI developer platform featuring code completion and a codebas
32.
by wsxiaoys 2y ago
Fun fact: We've implemented binary embedding search [1] without the need for a specialized vector database. Instead, dimensional tokens like 'embedding_0_0', 'embedding_1_0' are created and being built into the tant
33.
Rank Fusion for improved code context in RAG(tabby.tabbyml.com)
3 points by wsxiaoys 2y ago|1 comments
34.
by wsxiaoys 2y ago
TabbyML | https://tabbyml.com | Software Engineer (Rust) / Product Engineer – Full-Time | Remote Tabby strives to become the AI Intelligence Stack for the entire development lifecycle. We are a fully distributed, all-remote
35.
Connect Private GitHub Repository to Tabby(tabby.tabbyml.com)
3 points by wsxiaoys 2y ago|0 comments
36.
by wsxiaoys 3y ago
Checkout tabby: https://github.com/TabbyML/tabby Blog post on repository context: https://tabby.tabbyml.com/blog/2023/10/16/repository-context... (Disclaimer: I started this project
37.
by wsxiaoys 3y ago
Can the diagram being part of the code it self (e.g special comment string on top of certain piece, or in a special metalfiel) It'll be really nice if the code diagram itself could be version tracked together with code.
38.
by wsxiaoys 3y ago
Nice implementation! It should serve as a great reference for a minimal Tabby's backend API. Thank you for sharing it! Yeah - ultimately, it won't be as performant or feature-rich compared to https://github.com/Tab
39.
by wsxiaoys 3y ago
Wow, this is a great topic. I don't really have specific suggestions, but I'd like to contribute some thoughts on the matter. Monetizing anything isn't inherently problematic; the challenge lies in defining what should be pai
40.
Repository context for LLM assisted code completion(tabby.tabbyml.com)
1 points by wsxiaoys 3y ago|0 comments
41.
by wsxiaoys 3y ago
TabbyML | Software Engineer (Rust) | Open Source | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.com/TabbyML/tabby TabbyML is seeking a Soft
42.
Canceling stale workload in AI code completion(tabby.tabbyml.com)
2 points by wsxiaoys 3y ago|0 comments
43.
by wsxiaoys 3y ago
Previously, Tabby ran exclusively on CUDA devices, posing a significant barrier for developers looking to effectively utilize LLMs in their day-to-day coding. The Tabby team made a significant contribution by enhancing support for the StarC
44.
Tabby v0.1.1: Metal inference and StarCoder supports(tabby.tabbyml.com)
4 points by wsxiaoys 3y ago|1 comments
45.
Show HN: Tabby – AI Coding Assistant Runs on Apple M1/M2 GPU(github.com)
3 points by wsxiaoys 3y ago|2 comments
46.
by wsxiaoys 3y ago
For the 1B version of the model, it operates at approximately 100 tokens per second when decoding with Metal on an Apple M2 Max. llama_print_timings: load time = 114.00 ms llama_print_timings: sample time = 0.00 ms /
47.
llama.cpp now supports StarCoder model series(github.com)
6 points by wsxiaoys 3y ago|1 comments
48.
OctoPack: Instruction Tuning Code Large Language Models(github.com)
1 points by wsxiaoys 3y ago|1 comments
49.
by wsxiaoys 3y ago
Paper: https://arxiv.org/abs/2308.07124 Highlights: This paper demonstrates the instruct fine-tuning code for Language Model Models (LLMs) using public Github commit data. The proposed method achieves the highest Human
50.
by wsxiaoys 3y ago
Check out https://github.com/TabbyML/tabby , which is fully self-hostable and comes with niche features. On M1/M2, it offers a convenient single binary deployment, thanks to Rust. You can find the latest release at
51.
CTranslate2: An efficient inference engine for Transformer models(github.com)
2 points by wsxiaoys 3y ago|1 comments
52.
by wsxiaoys 3y ago
A less hyped inference engine with INT8/FP16 inference supports on both CPU / GPU (cuda). Model supports list: GPT-2, GPT-J, GPT-NeoX, OPT, BLOOM, LLAMA, T5, WHISPER ( Found this library during my research on alternatives to trito
53.
by wsxiaoys 3y ago
TabbyML | Full Stack Engineer / Machine Learning Engineer | REMOTE Self-hosted AI coding assistant. An opensource / on-prem alternative to GitHub Copilot. Project: https://github.com/TabbyML/tabby Show HN pos
54.
by wsxiaoys 4y ago
Nice work! Added to https://github.com/wsxiaoys/awesome-ai-coding
55.
by wsxiaoys 4y ago
Thank you, I was inspired by the brilliant ideas presented in the employer handbooks of Posthog and GitLab, as acknowledged in the career page.
56.
by wsxiaoys 4y ago
There it is: https://marketplace.visualstudio.com/items?itemName=TabbyML....
57.
by wsxiaoys 4y ago
Thanks, I'm just so into the puns: Tab-by-ML / TabbyML / Tabby
58.
by wsxiaoys 4y ago
Linked my replies to others' questions: [1], [2] [1] https://news.ycombinator.com/item?id=35471882 [2] https://news.ycombinator.com/item?id=35471390 I hope these can be of help and answer your question
59.
by wsxiaoys 4y ago
Tabby's philosophy is to achieve a completion rate comparable to Codex/Copilot by using a model size of less than 1B, with support for BF16/FP16 that reduces VRAM requirements to 2G or less. This may seem impossible, given th
60.
by wsxiaoys 4y ago
Tabby is tested against various open-source models based on GPT-J/GPT-NeoX, including https://huggingface.co/CarperAI/FIM-NeoX-1.3B and https://huggingface.co/Salesforce/codegen-350M-multi . I

More ›