ianpurton

11 ms·

91.
by ianpurton 3y ago
You can use reddit to find open source reddit clones https://www.reddit.com/r/opensource/comments/vog8mg/is_there... But like other posters have already said you would need a strategy to get people to us
92.
by ianpurton 3y ago
I'm the author of a guide to web development with rust https://rust-on-nails.com/ It gives you an idea of what a full stack in Rust can look like.
93.
by ianpurton 3y ago
I have a dockerfile here https://github.com/purton-tech/rust-llm-guide/tree/main/llm-... for running mpt-7b docker run -it --rm ghcr.io/purton-tech/mpt-7b-chat It's a big download due to t
94.
by ianpurton 3y ago
Reddit wants to charge for it's API. Some users are annoyed as they are using 3rd party apps to help with moderation. They can protest by making subreddits private. But Reddit has been a clunky, ugly, painful user experience for many y
95.
by ianpurton 3y ago
> and would market it more aggressively, You could set up a landing page and test your marketing, if you get the traction you hope for, build the product, if not then let it die.
96.
by ianpurton 3y ago
Docker images run native on Linux. The virtual part is just to get Docker working on MacOs/Windows
97.
by ianpurton 3y ago
> I’m not smart enough to figure out docker confiuration, so instead I compile my web application into a self contained statically linked binary executable file. Good luck getting that to run in different environments because static or n
98.
by ianpurton 3y ago
So Rolls Royce want to build small modular reactors https://www.rolls-royce.com/innovation/small-modular-reactor... It will be interesting to see if the smaller scale can avoid some of the issues mentioned in the artic
99.
by ianpurton 3y ago
ONNX doesn't support the same level of quantization as GGML. So basically GGML will run on hardware with less memory.
100.
by ianpurton 3y ago
Assuming you have 24GB of VRAM, then you should be able to run something like 7 billion parameters i.e. MPT-7b and quantized perhaps you can get up to 13 billion. Note: I have no practical experience of this, just reading around.
101.
by ianpurton 3y ago
You can compress LLM models and run them in less ram. This matters because most people don't have access to powerful GPU clusters.
102.
by ianpurton 3y ago
You might want to try some of the discord channels connected to some of the repos. i.e. GPT4All https://github.com/nomic-ai/gpt4all scroll down for the discord link.
103.
by ianpurton 3y ago
I can already imagine people lining up to get the best time on strava.
104.
by ianpurton 3y ago
Don't worry all the panels will be stolen soon anyway.
105.
by ianpurton 3y ago
It's too late, it's out there now. It's just a matter of time before we see a HN Launch for a startup that's going to disrupt the medical industry with LLM.
106.
by ianpurton 3y ago
How does the MLIR that Mojo generates differ from https://openxla.github.io/iree/ Or does Mojo sit on top of iree? Will the inference engine support multi GPU setups?
107.
by ianpurton 3y ago
To get an idea where WebGPU is heading a couple of projects worth looking at. - The Bevy game engine, using WebGPU on the backend. https://bevyengine.org/ - Wonnx, A WebGPU inference engine for running AI compute on the ser
108.
by ianpurton 3y ago
> GPU in other ways, such as training ML models and then using them via an inference engine all powered by your local GPU? Have a look at wonnix https://github.com/webonnx/wonnx A WebGPU-accelerated ONNX inference r
109.
by ianpurton 3y ago
> We are currently focused on completing the training process on the entire RedPajama dataset. So that's 1.2 trillion tokens. Nice.
110.
by ianpurton 3y ago
Monolith is not a best practice. With most web applications you'll end up with a web part and at some point some crob jobs. In this case they also have a service that processes a queue. They should in be in the same repo, that's a
111.
by ianpurton 3y ago
I mainly test with a combination of unit tests and using selenium https://github.com/stevepryde/thirtyfour for integration tests I wrote it up here https://rust-on-nails.com/docs/continuous-integra
112.
by ianpurton 3y ago
One of the libraries from the article which I have experience with is https://dioxuslabs.com/ It has a server side rendering mode, which for most projects will be all you need. So then if you follow the Islands Architecture
113.
by ianpurton 3y ago
Question. I can see in the code the WGSL that's needed to implement inference on the GPU. https://github.com/0hq/WebGPT/blob/main/kernels.js Could this code also be used to train models or only for
114.
by ianpurton 3y ago
I use zola a static site generator and deploy the pages (for free) to cloudflare pages. So there's no impact on my servers. For a product you will get a lot of people from HN reading the landing page but relatively few registrations.
115.
by ianpurton 4y ago
Practice generating traffic. An example could be a blog. Start with 1 article and promote it. This is something you could do today, then you'll have an idea what it's like to do marketing.
116.
by ianpurton 4y ago
> I do not allow my team to work remotely from wherever they want and require them to come to the office. Why?
117.
by ianpurton 4y ago
It's renewable if Greenpeace can somehow release the CO2 from our childrens lungs.
118.
by ianpurton 4y ago
Germany is running on coal. It's by far the worst example of energy vs pollution in Europe.
119.
by ianpurton 4y ago
A quick search paints a different picture > Germany produced 674.8 million metric tons of carbon dioxide (MtCO2) in 2021 - an increase of roughly 5.5 percent compared with the previous year.
120.
by ianpurton 4y ago
If you pefer to see it in code there's a succint gpt implementation here https://github.com/LaurentMazare/tch-rs/blob/main/examples/m...

More ›