whoistraitor

5 ms·

1.
by whoistraitor 1y ago
Yeh it’s strange it includes cockney so prominently. It isn’t really very present unless you spend time around the various gentlemen frequenting sports pubs and pie and mash shops in east London, or if you take a black cab very often. I’d s
2.
by whoistraitor 2y ago
It’s remarkable we’ve hit a threshold where so much can be done with synthetic data. The reasoning race seems an utterly solvable problem now (thanks mostly to the verifiability of results). I guess the challenge then becomes non-reasoning
3.
by whoistraitor 2y ago
IMO first-or-not is moot. It’s estimated that around one billion people speak English to a reasonably fluent level. Included in that is many of the commonwealth countries in which English often holds second spot as a lingua franca (eg. Indi
4.
by whoistraitor 2y ago
Perplexity is listed, but do they actually abide by llms.txt? And how can we prove they do? Is it all good faith? I wish there were a better way.
5.
by whoistraitor 2y ago
The general message here seems to be that inference-time brute-forcing works as long as you have a good search and evaluation strategy. We’ve seemingly hit a ceiling on the base LLM forward-pass capability so any further wins are going to b
6.
by whoistraitor 2y ago
Curious: what kind of problem domain to you work on? I use LLMs every day on pretty hard problems and they are always net positive. But I imagine they’re not well trained on material related to your work if you don’t find them useful.
7.
by whoistraitor 2y ago
It is probably the most reliable yeh, tho spending time here I’ve grown increasingly aware that the great firewall is more than aware of this vpn traffic, even if it’s wrapped up to look like normal traffic. They periodically will seem to ‘
8.
by whoistraitor 2y ago
Don’t know what OP might suggest but my first take is: never allow unstructured output from one LLM (or random human) of N privilege as input to another of >N privilege. Eg, use typed tool/function calling abstractions or similar to
9.
by whoistraitor 2y ago
Ah apologies I misread the architecture. But it does fit the spirit of finding disproportionately higher performance in smaller networks. Still promises of finding smaller sub networks. Running on mediocre mobile devices doesn’t seem a drea
10.
by whoistraitor 2y ago
Cool! Seems we’re moving closer and closer to realizing the Lottery Ticket Hypothesis https://arxiv.org/abs/1803.03635
11.
by whoistraitor 2y ago
Ie. A form of perverse incentive or the cobra effect. Endemic to capitalism, especially in infrastructure.
12.
by whoistraitor 2y ago
You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.
13.
by whoistraitor 2y ago
What I’d love to see is a rundown of new efficiencies in generative AI. With things like quantization and specialized transformer hardware, the costs will hopefully be less shocking in the future. And fwiw, I don’t find the article’s stats
14.
by whoistraitor 2y ago
I would say actually in the vast majority of cases of accessibility interventions, it benefits everyone. Everyone is, at various points in their lives, a varying degree of disabled (defined in terms of functional deficits). Whether injured,
15.
by whoistraitor 2y ago
Indeed. I’ve heard first hand accounts that would make it impossible for me to trust him. He’s very good at the game. But I’d not want to touch him with a barge pole.