ivalm

23 ms·

181.
by ivalm 4y ago
I guess I just felt an objection about “[oss] running circles around OpenAI.” The reality is that the core technology is still very unapproachable (making these models). OSS solved like 1% of the total problem/difficulty. My biggest ho
182.
by ivalm 4y ago
People have decent oss solutions for running inference. There are currently no high quality oss code for training and the best checkpoints are still unavailable (gpt3.5+4/palm/claude)… There are only a few hundred folks who have a
183.
US Says All SVB Deposits Safe, Creates New Backstop for Banks(bloomberg.com)
40 points by ivalm 4y ago|55 comments
184.
by ivalm 4y ago
I mean sure, but when it transacts it will be marked to market, it won't be just valued at the original hold to maturity so fed will take a loss. Also, fed is trying to shrink its balance sheet, presumably.
185.
by ivalm 4y ago
If you mark to market the assets are less than liabilities. It’s unlikely government will keep to maturity a bunch of 30 year mortgages. At the same time, we should just make FDIC limit infinite and make depositors whole.
186.
by ivalm 4y ago
Depositors aren’t being zeroed out, they will just maybe take a haircut. I do hope FDIC finds a way to unfreeze at least meaningful fraction by tomorrow so payroll/etc can be met.
187.
by ivalm 4y ago
Realistically, this bank run occurred because the depositors were highly correlated. Other banks do not have such a correlated depositor base.
188.
by ivalm 4y ago
Depositors are (senior) creditors and take on credit risk. Similar to bond holders.
189.
by ivalm 4y ago
Depositors are senior creditors. Junior creditors should be wiped first, but if there isn’t enough money to pay senior creditors then it makes sense they will get back less than par.
190.
by ivalm 4y ago
Context limit is a property of the model and set at training time. Computational complexity is quadratic with context length. You can potentially recursively summarize/create index to breakdown larger texts into smaller chunks.
191.
by ivalm 4y ago
That is not true. They initially had some withdrawals that they hoped to raise for, then it spiraled and they had to mark-to-market a larger portion of their portfolio which made them insolvent. Right now they are insolvent (they are also i
192.
by ivalm 4y ago
It started as a liquidity crisis (do they had to start selling or raise capital), it turned into a solvency crisis (they had to sell even more therefore marking assets as available for sale which made them marked to market). Right now S
193.
by ivalm 4y ago
But that’s not an option if you have to pay out now .
194.
by ivalm 4y ago
No, SVB was solvent as long as their assets didn’t have to marked to market, once there was a bank run they became insolvent. If the SVB assets are liquidated they will not cover the deposits.
195.
by ivalm 4y ago
Oh for sure. LPs would wire money to SVB and that money may be frozen/will be returned at less than par. Loss of relationship will also hurt. But for the biggest funds LPs are like pension funds, and that money will be available. One
196.
by ivalm 4y ago
Yes, the companies will be screwed but that’s not what I meant. What I meant by VCs have a tiny fraction of their fund as cash is that cash is held by LPs and is called upon only when the VC funds a startup. When a VC raises a $1B fund they
197.
by ivalm 4y ago
Presumably VCs have only a tiny fraction of their fund as available as cash, so I guess it won’t be too brutal.
198.
by ivalm 4y ago
As a public good you want all money to be invested. Money that is under lock and key is dead money. So having the bank lend your money IS a societal good. That it generates cash flow is just a bonus.
199.
by ivalm 4y ago
You’re right, but it is also the answer as to why the boring treasuries Silvergate held got devalued.
200.
by ivalm 4y ago
Presumably because then they would have to charge you a percentage of your money for storage and people don’t want to pay the bank.
201.
by ivalm 4y ago
> a lot of the form libraries out there triggered huge numbers of rerenders and caused perf issues Something I don’t quite get, doesn’t useRef just solve the re-render issue?
202.
by ivalm 4y ago
Core of office 365 (word/power point/excel) is pretty good! To be seen if this more excel or teams.
203.
by ivalm 4y ago
Chinchilla paper proposes the following empirical scaling power law Loss= (N0/N)^a+(D0/D)^b Where N is number of parameters, D is number of examples, a,b are exponents. N0,D0 are scaling factors.
204.
by ivalm 4y ago
It’s not just rescaling, overall production is not constant and is dependent on interest rates/economic activity/etc. eg after COVID there was all kinds of weird price dynamics due to supply/demand mismatches.
205.
by ivalm 4y ago
And the monkeys thought, “how could a human be dangerous?” “Would they clobber us with stones? Surely we are stronger!” The problem is that the toolset available to someone who is much more intellectually capable is beyond what we can think
206.
by ivalm 4y ago
Why would these super advanced aliens need Tesla? They can just target whatever themselves.
207.
by ivalm 4y ago
I originally didn’t think it’s a big effect but apparently per sqft new construction sfh in CA is $500 and in TX is $100. That’s insnane (so 2000sqft new construction costing $1M vs $200k).
208.
by ivalm 4y ago
But at least in hcol areas the cost of the house is in land value, so if that goes down you can pay more for labor and materials while charge less for the finished product. That $2M 1800sqft house is not priced on labor and materials.
209.
by ivalm 4y ago
There kind of is, but it does help to decouple nlu, dm, and nlg
210.
by ivalm 4y ago
Do you know of a good example you could link?

More ›