I have not been paying much attention to the whole circular deal thing that NVIDIA is supposedly doing. As in, they invest in their clients, who buy their products.
Can anyone who actually understands finance explain to me if:
1. Those accusations are true, and if they are actually a bad thing?
2. This claimed $673B in sales, how much of it comes from NVIDIA's own money, invested into their clients? Is there any way to know that?
This would require data centre cap-ex north of 1T and revenues from non AI companies in the same order of magnitude. Is it realistic to scale up data centre roll-outs? Are regular companies ready to re-allocate 1T? And this all happens in an environment where rates go up and many of the companies are not profitable?
> Small models are rapidly growing in capability, require less compute to train and serve
According to Jevons' paradox a reduction in resource requirements (improved resource efficiency for the same payoff) leads to an increase in demand. This stops working when demand for compute is completely exhausted, but we are very far from that. There are even some very silly predictions floating around (see the latest Dwarkesh Patel podcast) that say compute will soon be most of the economy, even dictating market interest rates. Now, that has to be wrong, but the directional outlook is closer to correct than "very small and efficient models mean there will be ~0 demand for HPC-like compute".
I don’t think this line of thinking is particularly robust because it ignores how AI is being used and where the resource usage is coming from.
Right now there are a small number of very very resource intensive use cases that are being subsidized by OpenAI and Anthropic. There are people generating millions of lines of code because it’s basically free at the point of use, despite the code producing very little value. Anthropic and OpenAI frequently “reset” customer limits to allow them to use even more resources at no additional cost.
The majority of use cases across business are not generating millions of lines of code per employee. The majority of businesses need just a little bit of automation to radically improve the way they operate. A software engineer making endless projects because it’s free to do so might use hundreds of billions of tokens per year, but an entire manufacturing business could be revolutionized with a few million tokens per year.
I think 2 things can be true:
1. There is very little penetration of AI across the economy and huge room to grow in the number of businesses deriving economic value from AI
2. The compute usage today is vastly overrepresented by usage outliers who are not paying the cost of their usage and will stop when forced to pay the cost
We could see AI usage 10x while seeing compute decrease 10x if the type of usage shifts. Most businesses just need smarter macros.
Yeah, I think there's a tendency to underestimate how much demand is still gated behind cost constraints. The market for this is HUGE.
The PC era, call it 1975-2005, was one of the greatest wealth creation events in history, was characterized by the cost of the underlying commodity dropping mercilessly for the whole time. Each time it did, the space of problem you could solve with a PC would increase, to the point that by the end, they were both replacing mainframes and powering users who do nothing but chat and post cat pictures.
Could there be a correction in the short run? Quite possibly. I think an underestimated last mile problem is just the massive weight of bureaucracy and human process inertia. But in the long run, cheap, efficient intelligence is a new engineering capability that we've just begun to even explore.
Every quarter I see a similar analysis, similar projection. Yet, they keep posting these insane numbers. Everyone knows it’s a bubble, the problem is determining the top. Nvidia is continuously showing the top is far far higher than everyone imagines.
I don't get why people say Nvidia is a bubble. They are selling products now, not in the future! If AI market collapses (I doubt it will happen), they will still be selling GPUs. They will make less money, but that is expected
the bubble doesnt mean they are worthless only that after a pop the value of stock will drop significantly. it is out of their control if people overvalue the stock, and thats what creates the bubble which will eventually need to pop for self correction - but might trigger a massive oversale bringing the stock below actual value and causing all sorts of problems that will challenge the solvency of the company (basically challenging their liquid funds vs how much debt that they backed to their stock value). if they survive that then a bounce back is expected and buying while they were low would get you profit again. if they overleveraged themselves during the bubble bc they bought into the hype themselves, then they could face serious financial troubles and be susceptible to getting bought out.
Bubble means inflated not fake, i.e when they make less money their stock will crash and bubble will pop, which is what people buying the stock today are concerned with , is this going to hold
>Small models are rapidly growing in capability, require less compute to train and serve
Must be very clear that China’s undercut strategy, which is a well-known and studied tactic that they’ve used for a long time, it is absolutely dominating this point.
Right now you can LLM, code, make songs, images, and esp video on gaming hardware in your PC that would’ve been absolutely datacenter shit last year.
So the question will be does the scaling continue to benefit efficiency or ability?
If ability (needs datacenter storage and performance), how much better can the code get? How much more realistic in the images videos get? There are definitely strides to be made everywhere, but man, just like the bottleneck wasn’t coding, I’m not sure the creation bottleneck is rendering.
I couldn’t find the 1000b number, but if that is “ai buildout capex” that means you think that 67% of every dollar spent on building data centers, training models, and running inference, is going directly to nvidia.
Which is just silly on the face of it. Data centers need concrete, copper, DRAM, SSDs, and labour. That alone will cost more than 33%.
Yeah but remember 1) stuff gets more expensive the more it's "processed"/further up the chain. It's hard to think of something further up the value chain than a modern gpu server. Just look at one input, asml machines. 2) a lot of dram, labor etc is also baked into the gpus.
Their profits are incredible too, they have 62% net margin! Last quarter $60b profit on $96b revenue. Since the "AI bubble going to pop" terrible takes 2 years ago, NVDA has made $300b in profits.
There's a specific type of person who makes a repeated joke like "sell shovels in a gold rush" - they think they have made the most insightful comment possible.
Margin is insane. They made roughly double net income, pure profit, what Apple did (even if you take out the ~8B in paper gains from their investments in other AI shops) on 13B less revenue.
As someone who uses AI all day it all makes sense. However, if AI is going to have serious impact white collar jobs as some people predict, the demand will decline. People without jobs won't pay for expensive subscriptions or API prices and the economy will be in recession.
For me the important question is where the economy will be in the next 5 years. Because if the economy is doing well, I have no doubt the AI demand will continue to sky rocket. I don't think it matters to Nvidia how uses their compute, closed or open models. The win either way.
The financial press regurgitates it and in return they get ad spend and exclusive stories.
It’s mutual dependency unfortunately, and will remain that way whilst there are shareholders and investors who own the publications and seek only ongoing returns
Do not short it. I repeat, do not do this! Do not play the game of capitalism against expert capitalists who have spent the last few decades rigging the game more an more in their own favor. In very rare cases may be lucky but only for a short while. The more trades you make the more the odds stack against you, and you will loose everything.
In a game where the odds are stacked against you, the only winning move is not to play.
> The more trades you make the more the odds stack against you, and you will loose everything.
In general this is true. Participation is not rigged with eg VTI/ITOT and VXUS/IXUS and a long enough time horizon.
There is no case where one cannot participate - doing nothing means inflation will eat away at assets.
I have a very brutish 50/50 international/US split (was 30% international before 2024 when Trump promised to destroy the US economy and started to act on that...). Each quarterly equity vest I put more in, and realize capital "losses" while buying the near equivalent security when there is an opportunity to do so.
It’s a shitty advice (the one about not playing, not the one about not buying shorts). The winning move is to have diversified longs with long horizon. That’s all it takes to participate in profits from “rigged” system.
I disagree. The winning move is to organize, and stand as workers in solidarity against the owning classes, engage in direct action (including boycotts and strikes) until the ruling class changes the rules in our favor, or better yet, abolishes this godforsaken economic system of capitalism in favor of a system that rewards workers and not our exploiters.
Right answer, but the anti-captialist reasoning is rubbish. The simple reason why you do not want to short a stock is that it can go up infinitely, and nVidia has a four year history of going up. There is also good reason to think nVidia will hit the numbers, both because AI is booming and because nVidia is conservative in its forcasts.
No capitalist conspiracy theory is needed, save the conspiracy theories for the Trumpers.
TBF there are absolutely horrible platforms like Robinhood that aren't far off what the above poster alluded to. At one point payment for order flow was the majority of their revenue or near it!
The boring staid firms like Fidelity/Vanguard have vastly superior products not designed to incentivize gambling
It's all factored in! The unimaginably vastness of the cosmos: Past, future, at astronomical through Planck scales. You have no agency; free will is an emergent phenomenon. You are not smarter than all those quants with their Ivy league degrees and 7 figure salaries, surely; the only winning move is not to play.
In the last week I’ve had a madman yell A.I. ‘facts’ at me as he tells me how to do my job. I’ve had employees forward A.I. generated text instead of doing the work properly and had a former employee send A.I. generated letters pleading for a job.
As you say, you have not stop caring. But its not necessarily easy to get to that point.
Can anyone who actually understands finance explain to me if:
1. Those accusations are true, and if they are actually a bad thing?
2. This claimed $673B in sales, how much of it comes from NVIDIA's own money, invested into their clients? Is there any way to know that?
1. Small models are rapidly growing in capability, require less compute to train and serve
2. There are more suppliers now, both in China & the US (OpenAI even have their own inferencing hardware now)
3. Memory still constrains how much they can ship in the short term
According to Jevons' paradox a reduction in resource requirements (improved resource efficiency for the same payoff) leads to an increase in demand. This stops working when demand for compute is completely exhausted, but we are very far from that. There are even some very silly predictions floating around (see the latest Dwarkesh Patel podcast) that say compute will soon be most of the economy, even dictating market interest rates. Now, that has to be wrong, but the directional outlook is closer to correct than "very small and efficient models mean there will be ~0 demand for HPC-like compute".
Right now there are a small number of very very resource intensive use cases that are being subsidized by OpenAI and Anthropic. There are people generating millions of lines of code because it’s basically free at the point of use, despite the code producing very little value. Anthropic and OpenAI frequently “reset” customer limits to allow them to use even more resources at no additional cost.
The majority of use cases across business are not generating millions of lines of code per employee. The majority of businesses need just a little bit of automation to radically improve the way they operate. A software engineer making endless projects because it’s free to do so might use hundreds of billions of tokens per year, but an entire manufacturing business could be revolutionized with a few million tokens per year.
I think 2 things can be true:
1. There is very little penetration of AI across the economy and huge room to grow in the number of businesses deriving economic value from AI
2. The compute usage today is vastly overrepresented by usage outliers who are not paying the cost of their usage and will stop when forced to pay the cost
We could see AI usage 10x while seeing compute decrease 10x if the type of usage shifts. Most businesses just need smarter macros.
The PC era, call it 1975-2005, was one of the greatest wealth creation events in history, was characterized by the cost of the underlying commodity dropping mercilessly for the whole time. Each time it did, the space of problem you could solve with a PC would increase, to the point that by the end, they were both replacing mainframes and powering users who do nothing but chat and post cat pictures.
Could there be a correction in the short run? Quite possibly. I think an underestimated last mile problem is just the massive weight of bureaucracy and human process inertia. But in the long run, cheap, efficient intelligence is a new engineering capability that we've just begun to even explore.
Source(s)?
Must be very clear that China’s undercut strategy, which is a well-known and studied tactic that they’ve used for a long time, it is absolutely dominating this point.
Right now you can LLM, code, make songs, images, and esp video on gaming hardware in your PC that would’ve been absolutely datacenter shit last year.
So the question will be does the scaling continue to benefit efficiency or ability?
If ability (needs datacenter storage and performance), how much better can the code get? How much more realistic in the images videos get? There are definitely strides to be made everywhere, but man, just like the bottleneck wasn’t coding, I’m not sure the creation bottleneck is rendering.
It's obviously hard to understand to people bad at everything.
Same with ASMl who are the sole company behind their machines.
As could millions of other companies.
This is an unprecedented circular debt gamble. The market price is not based on affordability but distorted by the seller.
Which is just silly on the face of it. Data centers need concrete, copper, DRAM, SSDs, and labour. That alone will cost more than 33%.
Surely the land is a double digit percentage of their budget? I know they build in the middle of nowhere, but even then.
Or from individuals and smaller companies?
For me the important question is where the economy will be in the next 5 years. Because if the economy is doing well, I have no doubt the AI demand will continue to sky rocket. I don't think it matters to Nvidia how uses their compute, closed or open models. The win either way.
It’s mutual dependency unfortunately, and will remain that way whilst there are shareholders and investors who own the publications and seek only ongoing returns
In a game where the odds are stacked against you, the only winning move is not to play.
This is a financial advice.
In general this is true. Participation is not rigged with eg VTI/ITOT and VXUS/IXUS and a long enough time horizon.
There is no case where one cannot participate - doing nothing means inflation will eat away at assets.
I have a very brutish 50/50 international/US split (was 30% international before 2024 when Trump promised to destroy the US economy and started to act on that...). Each quarterly equity vest I put more in, and realize capital "losses" while buying the near equivalent security when there is an opportunity to do so.
(it is sage advice, but reminded me of nuclear war)
Instead of blaming others, improve yourself and your station.
Life is too short to spend it putting up road blocks. Create a new, shorter circuit path instead.
Yeah bro, just learn to code.
No capitalist conspiracy theory is needed, save the conspiracy theories for the Trumpers.
The boring staid firms like Fidelity/Vanguard have vastly superior products not designed to incentivize gambling
But most of us would be better off not gambling on high risk bets like shorting NVDA.
As you say, you have not stop caring. But its not necessarily easy to get to that point.