ingenieroariel

8 ms·

1.
by ingenieroariel 3mo ago
I wrote: "we should all be buying a fully loaded Mac Studio (128GB of ram, 20 CPU cores, a lot of GPU and Neural cores.)" April, 2023 We are both late and early. https://news.ycombinator.com/item?id=35527692
2.
by ingenieroariel 8mo ago
With Apple devices you get very fast predictions once it gets going but it is inferior to nvidia precisely during prefetch (processing prompt/context) before it really gets going. For our code assistant use cases the local inference on
3.
by ingenieroariel 8mo ago
I like Nix as well, you can use this one liner in OSX or Linux to try out arcan/durden/cat9, as it matures you can expect arcan applications to be made available the way html pages/apps and this kind of nix derivation would l
4.
Arcan-A12: Weaving a Different Web(divergent-desktop.org)
73 points by ingenieroariel 8mo ago|19 comments
5.
Arcan Explained – A browser for different webs(arcan-fe.com)
2 points by ingenieroariel 8mo ago|0 comments
6.
by ingenieroariel 11mo ago
To add to lproven's point. An article called "A Spreadsheet and a Debugger walk into a Shell" [0] by Bjorn (letoram) is a good showcase of an alternative to cells in a Jupyter notebook (Excel like cells!). Another alternative
7.
by ingenieroariel 1y ago
The scipy/numpy to matlab is a good example. In my opinion it is on its way but in many places the timing is more like 2010-2013 where a lot of people knew python was the future but universities still used only Matlab.
8.
by ingenieroariel 1y ago
I think the answer depends on the country: In places where the government uses QGIS it is like Blender. In places where ESRI has a stronghold it is like LibreOffice.
9.
by ingenieroariel 2y ago
Mark Knol is a great generative coding artist: https://github.com/markknol/ Chris Randall is pretty awesome too: https://www.instagram.com/chris.randall.art/
10.
by ingenieroariel 2y ago
Hey AJ, this is almost on topic, do you know of a more up to date version of the dataset you used on the blog post release for H3 v4.0.0 [1]? They stopped updating in Oct 2023. Thanks! [1] https://data.humdata.org/dataset&#x
11.
by ingenieroariel 2y ago
It is a gui framework that allows you create terminals where you can detach any running process into another terminal. Since it is a complete toolkit, you can have detachable applications where you send both code and state to a server and r
12.
Arcan 0.7 – The All Tomato(arcan-fe.com)
77 points by ingenieroariel 2y ago|9 comments
13.
by ingenieroariel 2y ago
I did not believe you and just typed it on OSX, half a minute later the app was ready for me to use. nix run nixpkgs#pyspread [0/1 built, 3/113/132 copied (1311.8/1721.6 MiB), 280.4/300.7 MiB DL] fetching llvm-16.
14.
by ingenieroariel 2y ago
I'll let Kyle chime in but I tested it a few months ago with millions of polygons on an M2 16GB of RAM laptop and it worked very well. There is a library by the same author called lonboard that provides the JS bits inside JupyterLab.
15.
by ingenieroariel 2y ago
When you queried their 'Open Data' datasets and linked with your own it was absurdly cheap for some time. Granted we used our hacking skills to make sure the really big queries ran in the free tier and only smaller datasets got in
16.
by ingenieroariel 2y ago
One way to wrap your head around it is apt/systemd in a pip-like config file.
17.
by ingenieroariel 2y ago
Check out devenv.sh from the Cachix people, it allows you to list stuff like pip for any language, including services / postgresql extensions: { pkgs, ... }: { services.postgres = { enable = true; package = pkgs.postgre
18.
by ingenieroariel 2y ago
Imagine if we had said the same about Nginx. Let's evaluate things on technical merits, specially if they are using open source licenses we understand. In this case GPL v3.
19.
by ingenieroariel 2y ago
I recently learnt about this: https://nlnet.nl/project/libnix/ A project funded by the EU to bring Nix to Windows. (edit: typo and clarity)
20.
by ingenieroariel 2y ago
I went through a similar phase with a process that started with global OSM and Whosonfirst to process a pipeline. Google costs kept going up (7k a month with airflow + bigquery) and I was able to replace it with a one time $7k hardware purc
21.
by ingenieroariel 2y ago
The use case was a client creating electrification plans based on structures from satellite data. We were able to get rid of gdal/pandas/networkx and several other dependencies and ended up with a fast python based process that co
22.
by ingenieroariel 2y ago
Thanks for updating the blog post too with the datasette screen recording, the speed difference is quite noticeable. Adding it here since a few people were wondering about it in the comments, but feel free to check the original article for
23.
by ingenieroariel 2y ago
There are separate static builds for aarch64 and x86_64, those are put into a "fat binary" that runs on current generation hardware/software combos (osx with aarch64, win with x86_64 and linux with both). Just building for tw
24.
by ingenieroariel 2y ago
The reality is a bit different, the work on Python 3.6 was checked into the Cosmopolitan repo and I have been able to use it for production workloads that are in pure python. [0] As Cosmopolitan Libc has evolved, it has been possible to com
25.
by ingenieroariel 3y ago
My interpretation: - Worst case: as good as 3.5 - Common case: way better than 3.5 - Best case: as good as 4.0
26.
by ingenieroariel 3y ago
TLDR: A model that could be described as "3.8 level" that is good at math and openly available with a custom license. It is as fast as 34B model, but uses as much memory as a 132B model. A mixture of 16 experts, activates 4 at a t
27.
by ingenieroariel 3y ago
I just did: ./mixtral-8x7b-instruct-v0.1.Q8_0.llamafile --cli -t 16 -n 200 -p "In terms of Lasso" I got 15 tokens per second for prompt evaluation and 8 tokens per second for regular eval. The same hardware can run things muc
28.
by ingenieroariel 3y ago
I have. On a Mac Studio with NixOS based Asahi Linux and 128Gb of RAM, mixtral 8x7b uses 49GB of RAM. At the same time I load airflow tasks that deal with world wide datasets (using ~60GB on 16 parallel streams with the performance cores) f
29.
by ingenieroariel 3y ago
Guix uses Nix under the hood (learned this when trying to compile it). Perhaps learning Nix first will let the grandparent be more effective in Guix later.
30.
by ingenieroariel 3y ago
Since this uses cosmopolitan and the build script already downloads portable binaries from https://cosmo.zip has there any thought been given to wrap other portable binaries in scrapscript / download them? Small, pure, func

More ›