All I think when I see this is "this intelligence wasted on finance and ads."
Can you imagine human potential if it was somehow applied to crop harvesting efficiency, new medicines, etc?
Not everything has to be perfectly efficient but it just saddens me to see all these great minds doing what, adversarially harvesting margin from the works of others?
> Can you imagine human potential if it was somehow applied to crop harvesting efficiency, new medicines, etc?
If these sectors offered competitive salaries - sure, talent would flock to them. As a former chemist, I struggled to find a job that didn't pay scraps, no matter the industry - from big pharma to advanced materials. Eventually, I just gave up and went into the IT, which is 3x-10x better paid (at the very least).
We let the market dictate how society's resources are allocated. And we see, as a result, how the market is actually not at all interested in the satisfaction and well-being of the people in society.
We don't have any reliable and scalable way of doing this allocation, though, so it's a bit like saying that all the resources are wasted being locked up in asteroids.
Don't we already harvest more food than humans could ever eat, and have a huge pharmaceutical industry? I get what you're saying but these two examples seem counterproductive imho.
Which begs the question: what would actually be a good field to apply human potential towards? I agree that finance, sales and ads are very low on that list.
It’s been a few years since I looked deeply into it, but I think we produce enough to have everyone survive but not necessarily thrive. At the time, it came out to something like 1700 kcal per person. Even if we did have enough, the next problem is logistics of allocating that food to everyone who needs it.
I would imagine that increasing crop yields would do social good primarily via decreasing the amount of cultivated farm land, especially since we're well past Jevons paradox territory with calorie intake I imagine.
While the pharmaceutical industry is large, the marginal researcher does still seem to have a pretty positive impact from an outside view.
The most positive use of human time probably looks something like antiwar advocacy, but I don't really think that most quants have the social skills for that tbh.
As someone who has worked in the industry, I've yet to see any compelling argument that high frequency quants are making any meaningful contribution to society. Maybe on the low frequency end, but slightly higher market liquidity doesn't serve that large a social good imo.
High frequency quants almost certainly don't directly provide a massive social good, but they're one of the many facilitators enabling the smooth functioning of markets that do.
But FWIW, the comment I was replying didn't seem to be specifically critical of high frequency quants. Dismissing the entire field as something that doesn't contribute to society is beyond absurd.
The context of the comment being a Jane Street blog post is why I singled out HFT.
I think we're probably roughly in alignment w.r.t. other forms of finance, but the market liquidity gained by a marginal HFT employee almost certainly isn't worth the marginal cost imo. Even in finance, you could do a lot better by expending that human capital into optimising the structure of the markets themselves (there's lots of research on how hideously inefficient the TSE is because of its coarse tick sizes, for example; but vested interests get in the way of fixing that).
If markets were regulated to trade in coordinated 1s auctions, instead of nanosecond precision first-come-first-served matching of orders, markets would function just as well without needing a ton of what the HFT crowd does. It's a massive waste of brilliant minds.
I didn’t read the OP as being entirely dismissive, but rather making a point about relative impact.
You could make the case that a neurosurgeon is contributing to the field by being a full-time reviewer of a research journal; like a quant, they are providing utility by assisting in the flow of information. But I suspect there are many people like me who think they would have a bigger impact by putting on scrubs and working in an operating room.
There's that, but the market in the West was already over-saturated with HFT arbitrage. What's hot is growing markets that get a little less attention. The big Jane Street maneuver in India made a lot of noise recently. They've been "banned" for "market manipulation", but that was one of their biggest play to date.
It's not wasted. Society can pay for the talent it wants, and they don't want to pay for this. Instead this talent helps to grow the overall wealth on in the world, letting us pay for the stuff we want.
I'm sure people (society) wants cheap food, free universal healthcare, free public transport, so why don't we have these things?
Under capitalism each of these individual systems needs to turn a profit to be deemed worthwhile instead of treating the system as a whole and taking into account the economic externalities and benefits to the entire system.
The methodical approach Alex took here is fascinating - it mirrors real-world AI system debugging when production models behave unexpectedly. The key insight about treating the network as a constraint solver rather than trying to trace circuits by hand is brilliant. In production AI systems, we often face similar challenges where the "learned" behavior isn't actually learned but engineered, and you have to reverse engineer the underlying logic. The parallel carry adder implementation in neural net layers is particularly clever - it shows how you can embed deterministic computation in what looks like a black box ML model. This kind of mechanistic interpretability is becoming crucial as we deploy more complex AI agents in real systems.
TFA details a solution, it's pretty interesting. Basically the problem was to reverse engineer an absurdly obfuscated and slightly defect MD5 algorithm.
Can you imagine human potential if it was somehow applied to crop harvesting efficiency, new medicines, etc?
Not everything has to be perfectly efficient but it just saddens me to see all these great minds doing what, adversarially harvesting margin from the works of others?
If these sectors offered competitive salaries - sure, talent would flock to them. As a former chemist, I struggled to find a job that didn't pay scraps, no matter the industry - from big pharma to advanced materials. Eventually, I just gave up and went into the IT, which is 3x-10x better paid (at the very least).
What they could achieve in spending their attention on real problem would be massive.
Which begs the question: what would actually be a good field to apply human potential towards? I agree that finance, sales and ads are very low on that list.
While the pharmaceutical industry is large, the marginal researcher does still seem to have a pretty positive impact from an outside view.
The most positive use of human time probably looks something like antiwar advocacy, but I don't really think that most quants have the social skills for that tbh.
How is finance not exactly that?
But FWIW, the comment I was replying didn't seem to be specifically critical of high frequency quants. Dismissing the entire field as something that doesn't contribute to society is beyond absurd.
I think we're probably roughly in alignment w.r.t. other forms of finance, but the market liquidity gained by a marginal HFT employee almost certainly isn't worth the marginal cost imo. Even in finance, you could do a lot better by expending that human capital into optimising the structure of the markets themselves (there's lots of research on how hideously inefficient the TSE is because of its coarse tick sizes, for example; but vested interests get in the way of fixing that).
Do you think without HFT markets stop functioning properly?
What if they are one of the contributors of highly inflated valuations?
You could make the case that a neurosurgeon is contributing to the field by being a full-time reviewer of a research journal; like a quant, they are providing utility by assisting in the flow of information. But I suspect there are many people like me who think they would have a bigger impact by putting on scrubs and working in an operating room.
The markets have shown themselves to be an excellent way of applying human potential to things like crop harvesting efficiency, new medicines.
Under capitalism each of these individual systems needs to turn a profit to be deemed worthwhile instead of treating the system as a whole and taking into account the economic externalities and benefits to the entire system.
At this point tech is probably worse than finance, at least in finance they dont pretend to be saving the world no matter what the giant squid says.
Feels to me like it’s similar to dumping a binary with an image, the format being entirely custom.
And/or trying to decode a language or cipher, trying to recognize patterns.
https://x.com/1914ad/status/2026757796390449382
Haven't read it yet but seems spicey