underlines

7 ms·

31.
by underlines 1y ago
5070Ti user here: We are 150 people in a SME and most of our projects NDA for gov & defense clients absolutely forbid us to use any cloud based IDE tools like GitHub Copilot etc. Would love for this project to provide a BYOK and even Br
32.
by underlines 1y ago
yes, every major llm company did it: illegally using annas archive, the pile, common crawl, their own crawl, books2, libgen etc. and embed it into high dimensional space and do next token prediction on it.
33.
by underlines 1y ago
afaik, guessing anything not 00000 or 11111 at first step will lead to an optimum strategy of 3 steps. because you introduce possible "right digit at wrong place" as a third state. guessing 00000 or 11111 removes that third state
34.
by underlines 1y ago
In evolution there is no metric, that's a human made concept. In evolution the thing that kills you also evolves. The "metric" evolves.
35.
by underlines 1y ago
Our family had a computer since 1990 when I was 4yo. As a kid in school we had typing lessons on a typewriter in 2001 (despite having iMacs in the classroom). I specifically tried to type as fast as possible in order to leave typing class e
36.
by underlines 1y ago
vibe coding oriented builders, where you draft an app idea and it gives you a prototype? I'd say Firebase Studio and OpenHands
37.
by underlines 1y ago
Thanks. I added codex. Though, since I specifically mentioned agentic, I wanted to exclude non-agentic tools like prompt builders and context managers that you linked. :) Reason being: my idea of agents is to generalize well enough, so the
38.
by underlines 1y ago
We need an Eval Leaderboard for LLM assisted Agentic IDEs. The space is getting crowded: New Editors: - Firebase Studio - Zed - OpenHands (OSS Devin Clone) VS Code Forks: - Cursor - Windsurf Editor - Void VS Code Extensions: - Gemini Code A
39.
by underlines 1y ago
I wonder why most agentic patterns don't use multiple different retrieval strategies simultaneously and why most of them don't use CodeGraph 1 during discovery phase. Embeddings aren't enough, Agent induced function/clas
40.
by underlines 1y ago
Don't forget https://ollama.com/library/deepcoder which ranks really well for its size
41.
by underlines 1y ago
That's the normal way at least where I live (Switzerland) and I am shocked people are being disposed off like that in the states. Is this even legal there? We usually get 1-3 months notice period, then continue to work for these 3 mont
42.
by underlines 1y ago
I really loved Phind and always think of it as the OG perplexity / RAG search engine. Sadly stopped my subscription, when you removed the ability to weight my own domains... Otherwise the fine-tune for your output format for technical
43.
by underlines 2y ago
reminds me of a mix between ishkur's guide to EDM and whosampled... :) in Flash.
44.
by underlines 2y ago
that env parameter is brand new, did you update ollama?
45.
by underlines 2y ago
if you can prefill the form field with post parameters and send that URL to someone else, then you can steal their login cookies etc. Even though the same user who submits the input sees the response, XSS can be exploited: 1. stored XSS (in
46.
by underlines 2y ago
I already did: When I was computer science apprentice in Switzerland in the late 00s, my mate introduced me to Thai culture, as he was half Thai. I planned to be different from all the passport bros and weirdos and made a plan: Finishing my
47.
by underlines 2y ago
I use my Sony a7iv as a webcam. Plug the USB C in and it is recognized as a webcam. I got asked a lot im teams calls what webcam I use
48.
by underlines 2y ago
For 2 years I built RAG apps for clients. They are not Code-Assistants but everytime I see code assistants solely relying on embeddings to find the right pieces as context, it feels wrong to me: Code is very well structured. Based on a star
49.
by underlines 2y ago
llama 3.2 3b, qwen2.5 3B quantized to 4bit runs CPU inference quite fast. You can get a beefier VM and still save a ton of money. Depending on the context token length of this soluion, it's either fast or slow. If it's below 1024
50.
by underlines 2y ago
hint: 8 days ago txtai released their arxiv embeddings https://huggingface.co/NeuML/txtai-arxiv
51.
by underlines 2y ago
they didn't
52.
by underlines 2y ago
Can you try increasing compute in the problem search space, not in the training space? What this means is, give it more compute to think during inference by not forcing any model to "only output the answer in algebraic notation" b
53.
by underlines 2y ago
the company i work for and actually most Swiss IT contractors have harsh rules, and more than half of our projects, we aren't allowed to use Github Copilot or pasting stuff to any LLM API. For that matter I built a vLLM based local GPU
54.
by underlines 2y ago
I use quantized LLMs in production and can't say I ever found the models to be less censored. For unlearning reinforced behaviour, the abliteration [1] technique seems to be much more powerful. 1 https://huggingface.co/
55.
by underlines 2y ago
- LLaMA-Omni https://github.com/ictnlp/LLaMA-Omni a speech-language model built on Llama-3.1-8B-Instruct for simultaneous generation of text and speech - moshi https://github.com/kyutai-labs/moshi
56.
by underlines 2y ago
The company who didn't hire you will soon use your tool because they feel remorse for not hiring you, and now they have to "deal with it"
57.
by underlines 2y ago
vLLM is simple to set up, use docker and make sure your backend (ubuntu or WSL ubuntu or whatever) has GPU support installed.
58.
by underlines 2y ago
Here's a resounding 'slap' delivered by one physicist to his peers: https://www.youtube.com/watch?v=cBIvSGLkwJY
59.
by underlines 2y ago
You either do local inference or get Azure OpenAI to have your own private gpt-4o or whatever. :)
60.
by underlines 2y ago
I specifically just switched back from chrome to Firefox after about 10 years, because there were still no native hierarchical tab solutions in chrome. FF + sideberry for every day use and rabbit holing.

More ›