rakejake

11 ms·

31.
by rakejake 1y ago
Digesting a big code base in a new job. Claude and Gemini have been very useful in helping me come up to speed on a code base written in Go (a language I have used before but not for many years). Figuring out where the business logic lies,
32.
by rakejake 1y ago
If Google can fend off the US DoJ, I think they're going to be just fine.
33.
by rakejake 1y ago
Gemini is apparently doing pretty well. 400 monthly active users on their app and they recently increased the prices for their API. Sundar Pichai has taken a lot of heat in the past couple years (and for good reason) but distribution is one
34.
by rakejake 1y ago
Absolutely!
35.
by rakejake 1y ago
My Carnatic Raga classifier is progressing very well. I am now training a classifier to identify 142 ragas. A bit of background: I have been working on a Raga classifier since November of last year - I started with just 2 ragas and a couple
36.
by rakejake 1y ago
Or humans with their consciousness uploaded to a silicon or other substrate. Of course, this is in the realm of science fiction but so is interstellar travel. Greg Egan's Diaspora has a fantastic treatment of interstellar travel - it i
37.
by rakejake 1y ago
Greg Egan's work has its share of humans but also some extremely imaginative aliens. I am not sure who can relate to the aliens in Wang's Carpets. Greg Egan is a very good example of a novelist who is a GOAT but will be dismissed
38.
by rakejake 1y ago
Reading the description of Sid Meier's Alpha Centauri, I realize the animation series "Scavengers Reign" has a very similar setting (human colonists crash land on a planet that seems to be sentient). I'll use this opport
39.
by rakejake 1y ago
Probably a corollary of the fact that most usecases can be served by an RDBMS running on a decently specced machine, or on different machines by sharding intelligently. The number of usecases for actual distributed DBs and transactions is p
40.
by rakejake 1y ago
Quite a few sections of C++ can be classified as "pretty basic C++". None of the rules are complicated in isolation but that doesn't necessarily make it easy to reason about it.
41.
by rakejake 1y ago
IMHO Inheritance (especially the C++ flavored inheritance with its access specifiers and myriad rules) has always scared me. It makes a codebase confusing and hard to reason with. I feel the eschewing of inheritance by languages such as Go
42.
by rakejake 1y ago
Amen.
43.
by rakejake 2y ago
Interesting. So they convolve the k,v, q vectors? I have been trying the opposite. I have been working on a classification problem on audio data (with context size somewhere between 1000 and 3000 with potential to expand later). I have been
44.
by rakejake 2y ago
Burmese Days is my favorite Orwell. It captures the state of the colonies under British rule extremely well - the British new-arrivals who are derisive and at best ignorant of the local customs, the British who've grown up in the colon
45.
by rakejake 2y ago
I think the "arcane knowledge" is true for LLMs (billions). But there are lots of people who train models in the open in the hundreds of millions realm, but never below. Maybe transformers simply don't work as well below a si
46.
by rakejake 2y ago
Nowadays, even the definition of an "epoch" is not well defined. Traditionally it meant a pass over the entire training set, but datasets are so massive today that many now define an epoch as X steps - where a step is a minibatch
47.
by rakejake 2y ago
A 7k param LSTM is very tiny. Not sure if LSTMs would even work at that scale although someone with more theoretical knowledge can correct me on this. As an aside, I'm trying to train transformers for some classification tasks on audi
48.
by rakejake 2y ago
The article is co-written by a member of Kerala's Planning Board and heavily oversells the state. I'd say Kerala is nowhere near rich so even the title is technically incorrect.
49.
by rakejake 2y ago
Whatever it is I am not buying it. Kerala is notoriously an incredibly hard place to do business in, so a line like this needs some real hard stats to back it up.
50.
by rakejake 2y ago
The article is a classic submarine[0] for Kerala. "The state has one of the highest concentrations of startups". I laughed out loud at this one. Of all the half-truths peddled in that article, this was easily the most hilarious an
51.
by rakejake 2y ago
FWIW I am not American or even from the west. At a nation-state level, the west (US) shared knowledge with the intention of offshoring production for cheaper goods, not out of the kindness of their hearts. They still protect key technologie
52.
by rakejake 2y ago
That is because they want to undercut the US and prevent them from making money. It remains to be seen if they'll be as benevolent in making tech open-source if they are the clear winners. Frankly, I don't see why they will.
53.
by rakejake 2y ago
"decision-makers can remain irrational longer than you can remain solvent" - Very correct. Whether or not AI actually comes for your job, the fact that enough people at the top think so is enough to cause trouble.
54.
by rakejake 2y ago
Same here. Even in tools that I'm very proficient in, I struggle to think of things I want to build. Like @JohnFen says, it's not a problem in itself although I feel bad sometimes looking at cool stuff other people built - "w
55.
by rakejake 2y ago
People are products of their environment. There are people with mettle/grit and then people who are more sensitive to perturbations of fate. The society they live in sets the base level of grittiness that you can expect any average per
56.
by rakejake 2y ago
Right. A good chunk of the "old guard" is now gone - Ilya to SSI, Mira and a bunch of others to a new venture called Thinking Machines, Alec Radford etc. Remains to be seen if OpenAI will be the leader or if other players catch up
57.
by rakejake 2y ago
My usage has come down to mostly Claude (until I run out of free tier quota) and then Gemini. Claude is the best for code and Gemini 2.0 Flash is good enough while also being free (well considering how much data G has hoovered up over the y
58.
by rakejake 2y ago
Funnily enough, I'm putting the 7950X to some use in the Carnatic Raga detector project since a lot of audio operations are heavy on CPU. But that last one nearly killed me. I'll have to go to Gemini or GPT for some therapy after
59.
by rakejake 2y ago
** Roast *** * You've spent more time talking about your Carnatic raga detector than actually building it – at this rate, LLMs will be composing ragas before your detector can identify them. * You bought a 7950X processor but can'
60.
by rakejake 2y ago
Working on a Carnatic Raga Detector. Longtime pet project of mine and I'm currently unemployed so no time constraints. Still, progress has been pretty slow due to various reasons but I haven't given up this time so I guess that&#x

More ›