morphle

10 ms·

121.
by morphle 2y ago
I discussed all the points you ask about in my HN postings last month, but never in enough detail so you must ask me to specify and that's when people hire me. As you can see from this comments thread, most people, especially programme
122.
by morphle 2y ago
> No one who claims this ever posts a benchmark I meant to explain why no one ever posts a benchmark, it's expensive as hell to do a professional benchmark against accepted standards. Its several days work, very expensive rental of
123.
by morphle 2y ago
What will you pay me for the benchmarks, for the professional knowledge and analysis? I can post benchmarks for these Mac machines and clusters of Studios and M4 Mac Minis (see my other HN posts last month, the largest Mac cluster I can ben
124.
by morphle 2y ago
Bouvet island Gravett Island [1] Rottum Rottumerplaat [2,3] Mysterious Island [4] Lost Island [5,6] [1] https://memory-alpha.fandom.com/wiki/Gravett_Island [2] Dutch writers visit deserted island https://nos
125.
by morphle 2y ago
I went to Paris around 1992 to visit an ancient library where they had centuries old maps of obscure, remote and 'lost' islands. The experience of searching through the old Atlasses and roaming the buildings was almost as interest
126.
by morphle 2y ago
You are aware your webserver is online but with a placeholder page? I also have such a website online since 1993. I sometimes forget to check it for several years. I'm thinking about putting KAOS and other screensavers on my webserver
127.
by morphle 2y ago
Those are my thoughts too.
128.
by morphle 2y ago
Thx! I can now go trace Reinoud Lamberts himself through his parents address in the PostMan source download from that archived webpage. It's been 32 years since he had his Silicon Graphics workstation (on which he wrote his KAOS and Po
129.
by morphle 2y ago
Could you share the url to this page? I tried searching for it but could not find it.
130.
by morphle 2y ago
I watched one of these movies after reading this discussion on HN. It was blocked halfway thru the movie "not available in this region" (European IP address).
131.
by morphle 2y ago
Email in my profile. 100 Gps plus rack is 5 times the cost of 10 Gbps. You'll need 100 Gbps routers and smartnics too.
132.
by morphle 2y ago
Yep, that's the right stuff. Now simply cross-connect all the free PCIe lanes of all thread rippers and you have a nice cluster for LLMs.
133.
by morphle 2y ago
I don't know what their policy is now, but they talk about it in the Hot Chips 2024 presentation. I myself just have proof of a single customer having their own private Cerebras rack. There are rumors about several more customers with
134.
by morphle 2y ago
both. The cloud model is also for renting models across several Cerebras Wafer Scale Integrations.
135.
by morphle 2y ago
I'd love to visit your house then. You have 768-1400 GB DRAM with 6000 GB/s memory bandwidth? Nice house. In my house I currently have almost 900 GB/S memory bandwidth in aggregate but only 132 GB total DRAM.
136.
by morphle 2y ago
Cerebras already does this.
137.
by morphle 2y ago
Spot on! I concur most European business and public sector institutions would be eager to rent this because they are not allowed by law to use US datacenters like AWS or Azure.
138.
by morphle 2y ago
I broke down the first $30K investment cost for release of the online API product, that does not need further software development, sales or support. You would be wise to do the software development I mentioned, do more sales and support th
139.
by morphle 2y ago
You buy the hardware (48 servers), rent part of a colocation rack with a 10 Gbps or 100 Gbps internet transit link, get a payment processor, make a webpage and GitHub demo with the API. Break down: $3000 labour, $20.5K hardware, $800 monthl
140.
by morphle 2y ago
I think the important metric will be if we can compete against the price of AWS or Microsoft in running large LLMs, not their time to market. Competing on cost against overpriced hyperscalers is not very hard, and $30K is a small investment
141.
by morphle 2y ago
As this is HN, I'm curious if there is anyone here on HN who is interested in starting a business hosting these large open source LLM's? I just finished a test of running this Deepseek-R1 768 GB model locally on a cluster of compu
142.
by morphle 2y ago
If you use any of these be prepared for them taking down your websites the moment you pop up on their radar monitors, for example when you get traffic. Actually, that applies to any server, (web)hosting, datacenter rack, internet connection
143.
by morphle 2y ago
Neocities does not allow you to run any code, just static html serving
144.
by morphle 2y ago
Same here. I tried all the forms offered om that website to create an account and they all ended on different errors.
145.
by morphle 2y ago
NP. Email me (see profile) or post a video conference link.
146.
by morphle 2y ago
As a pioneer ISP with datacenters since 1987 I can endorse your request on both webhostingtalk and NANOG mailing list. We could also email 200 expert volunteers directly, many are owners and top sysadmins of datacenters who helped Ukraine d
147.
by morphle 2y ago
Go to NANOG mailing list if you want to talk to bigger ISPs and Datacenter owners and Tier 1 providers.
148.
by morphle 2y ago
>so you save a TON of money there Yes, that is a fair speculation, but it is not really true: everyone can save a lot, not just me. I rent out this knowledge to my customers, so they can save tons as well. You can test this out by actual
149.
by morphle 2y ago
$3.19 or 3,04 Euro excluding VAT per month for all website server, data and labour costs (1-7) over several years, including running the big LLM (as tested, with some large LLM's and MLX/EXO you might need dual 64GB servers[2], do
150.
by morphle 2y ago
Squeak Smalltalk has several automatic runtime optimizations and compilers like JIT, parallel load balancing compiler [1], adaptive compiler [2] and a metacircular simulator and byte code virtual machine written in itself that allows you to

More ›