lumost

54 ms·

871.
by lumost 3y ago
One of the big reasons custom hardware solutions struggle. IMO - you’d have better luck as a hardware vendor implementing an LLM toolchain and bypassing a general purpose DL framework. At the very least you should be able to post impressive
872.
by lumost 3y ago
Profits accumulate to asset holders, and individuals have a fundamental cap on how much they can rationally spend. If individual asset holders have too much capital - then there won't be enough spending to keep the economy moving, resu
873.
by lumost 3y ago
The US effectively uses government debt to avoid large asset holders from eating up the entire money supply. Using deficit spending to redistribute funds works when the money hits the right places, and is horrendously inefficient otherwise.
874.
by lumost 3y ago
Something that has never sit right with me. Why do we not have clear evidence of past major civilizations in the main habitation zones of modern North America? Shouldn’t we see ancient cities in New England, the PNW, Bay Area, and southeast
875.
by lumost 3y ago
Messing with the money supply hits it’s natural end? Leave interest rates low - inflation burns up asset prices. Run high? Asset prices fall as NPV values future cash flows less. At some point we have to fix structural economic problems wit
876.
by lumost 3y ago
I’m curious, in the US - k-12 educators are not known to be paid well. In many cases they simply can not afford market rate housing in 2023. Assuredly this contributes to the high cost of childcare in the US. Is the situation similar in Ger
877.
by lumost 3y ago
To add to this, if you do make enough to overcome said hurdles - you are likely in a hyper competitive job. Two great incomes don’t help much if both parties have to regularly put in more than 40 hours/week.
878.
by lumost 3y ago
I work on a Postgres fork in my day to day job. Something I’ve found incredibly useful is how adept gpt-4 is with the Postgres code base. So much so that I can ask questions like “show me the definition of to_char” or “explain the fields of
879.
by lumost 3y ago
My latter point was on the long-term stability of the status quo. In my view, the end-state of squeezing the middle class in a modern society may be a fertility crises as individuals choose not to have children. With modern birth control, t
880.
by lumost 3y ago
IMO the US and many other developed countries are now carrying a large structural imbalance between the upper and middle/lower wealth brackets. This will either be corrected by new growth, or zero-sum rebalancing via inflation. Current
881.
by lumost 3y ago
Most "production" ML models of the last 10 years were only a few millions of parameters owing to limited training data and simplistic tasks. While BERT and similar models raised the parameter count substantially, my anecdotal expe
882.
by lumost 3y ago
I think folks are underestimating how far we have to go on inference performance. Even ignoring LLM’s like phi-1.5. PyTorch was meant to be easy to use first, and fast second. This turned out to be the winning combo for adhoc science worklo
883.
by lumost 3y ago
What we choose to value as society is entirely subjective. While supply and demand influence the change in the mid point of the bid/ask spread - it doesn’t set the absolute clearing price.
884.
by lumost 3y ago
It is unnecessary to have a manned CAS fighter doing strafing runs. A cheap Drone in the 1-5MM range could do the job better. Or rely on high altitude/stealth precision bombing. The A-10 was built for a war in Europe that never came. Y
885.
by lumost 3y ago
This ship was a converted battleship hull which would have otherwise been the third Yamamoto/Musashi. Somewhat of a Franken ship without a clear mission.
886.
by lumost 3y ago
The biggest lesson of ww2 is that once a major industrial war starts - the only end is mutual exhaustion. Japan would always have needed to defeat the US industrial base. Even if Pearl Harbor had less to an immediate occupation of Hawaii an
887.
by lumost 3y ago
My understanding is that robotics were being heavily developed in the US in the 80s/90s to improve costs. Then outsourcing took the wind out of the sails for robotics. Maybe the tech was to far out, or maybe we would have had vastly mo
888.
by lumost 3y ago
Is the looting behavior just a response to US industrial policy? US policy has made US manufacturing tenuous for decades. Meanwhile US policy has also provided the means and mechanisms to ship manufacturing abroad. Given the above, isn’t th
889.
by lumost 3y ago
My 2 cents, this is like the early days of PCs or the internet. It's obvious to all that there is immense value, but it's unclear where that value is going to stick. Compaq ended up going bust after figuring out how to get around
890.
by lumost 3y ago
“Builds a training framework which works out of the box”. This is the hard part. Nvidia has built thousands of optimizations into cudnn/cuda. They contribute to all of the major frameworks and perform substantial research internally. I
891.
by lumost 3y ago
I'd beg to differ, migrations are extraordinarily expensive in Tech. If you have a sky scraper, you don't tear it down and rebuild it when materials become 10% stronger. Big tech firms generally maintain market position for decade
892.
by lumost 3y ago
Even with unlimited budget and talent, overcoming 25 years of success is ... difficult. Nvidia employs it's own top-tier folks and now has massive margins to invest. If your goal is to sell an AI product to end-customers, choosing to p
893.
by lumost 3y ago
I'd be curious if one could use CRISPR to reprogram cancer cells to the point that the immune system starts killing them again. Or did this work not have any targeting?
894.
by lumost 3y ago
Considering the above scenario where real estate is gaining at 75k per year. A wealthy individual could easily leaver themselves to 75*5 = 375k/yr. Using the starting cost of a home at 600k, this would equate to an average rate of retu
895.
by lumost 3y ago
A lot of software business models may have been overly influenced by interest rates the last few years. At a low interest rate, the time value of capital is low - a company can defer revenue almost indefinitely with minimal cost. Hence, a s
896.
by lumost 3y ago
This entirely depends on how common rescinded/delayed offers are. We're seeing a general normalization of the following behaviors at major tech employers. - Rescinded offers - Delayed start dates Unfortunately, people's abili
897.
by lumost 3y ago
Coincidentally, or not? A research team just started a 90 day effort to train a 1.1 billion parameter llama model on 3 trillion tokens. https://github.com/jzhang38/TinyLlama
898.
by lumost 3y ago
If you have enough assets not to simply invest in the general market. Then there is also an opportunity cost to not having the funds to buy into "unique" opportunities. Whether they be distressed assets, innovative ideas - or si
899.
by lumost 3y ago
The US immigration system for skilled labor is fundamentally broken. We give out student visas openly, incentivizing universities to bring on large numbers of international students at full rate vs. discounted local students. We then do not
900.
by lumost 3y ago
Big thing you would expect if it’s due to general plastic/pollution prevalence is obesity in pets/wild animals.

More ›