- Emergent Behavior
- Posts
- The Ghost of Chips
The Ghost of Chips
Past, Present and Future
š· Subscribe to get breakdowns of the most important developments in AI in your inbox every morning.
Hereās today at a glance:
šļø EB-1: Jensenmath
EB-1, our very first podcast, dropped last week. Before I continue, the rules of the game are:
Pods that CHART stay alive
Pods that get a Follow on Apple Podcasts CHART
So FIRST, CLICK on the link below (opens up your Apple Podcasts app), and click ā+Followā (in the upper right-hand corner)
Then go ahead and listen to the podcast any way you want to on your preferred app, capiche mon ami?
Listen on
We Covered
OpenAIās $7 trillion YOLO fundraising
Nvidiaās market position and its competitors
Nvidiaās promised 4x annual performance improvement
ASMLās monopoly position
Who
Dylan Patel (LinkedIn), founder of Semi Analysis, a semiconductor and AI research and consulting firm with analysts in the US, Taiwan, Japan, and Singapore.
When
Feb 15, 2024
Background
Dylan is one of the best-informed people in AI and semiconductors, and responsible for several of the major stories in the field over the last year, such as:
The GPU Rich/GPU Poor meme
Google Gemini Eats The World ā Gemini Smashes GPT-4 By 5X
The GPU-Poors, MosaicML, Together, and Hugging face
Broken Open-Source
Compute Resources That Make Everyone Look GPU-Poor
Google Cloud TPU winsā Dylan Patel (@dylan522p)
12:29 AM ā¢ Aug 28, 2023
Google Has No Moat memo
Google "We Have No Moat, And Neither Does OpenAI"
Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI
This is the opinion of one Googler, we do not agree, simply sharing.
$GOOGL $MSFT $META $AI $NVDA $AMZN $AAPLā Dylan Patel (@dylan522p)
10:10 AM ā¢ May 4, 2023
Breaking the comprehensive details of the GPT-4 architecture
Demystifying GPT-4: The engineering tradeoffs that led OpenAI to their architecture.
GPT-4 model architecture, training infrastructure, inference infrastructure, parameter count, training dataset composition, token count, layer count, parallelism, visionā Dylan Patel (@dylan522p)
7:25 PM ā¢ Jul 10, 2023
Ate first met Dylan through false accusations:
This bro did an industrial espionage on TSMC and posted the pics š
The internet man.. is an amazing place
ā Ate-a-Pi (@8teAPi)
12:39 AM ā¢ May 14, 2023
Which Dylan easily refuted:
And hence began a curmudgeonly relationship of tweets and secret DMs (the best kind). Which naturally let to this pod.
š Enjoying this edition of Emergent Behavior? Send this web link with a friend to help spread the word of technological progress and positive AI to the world!
Or send them the below subscription link:
šŖ Intel Made A Good Chip
Stability AI shares the performance of Intelās Gaudi chip across its clusters, and it finally looks competitive.
Thatās double the image training throughput of a H100. With an at minimum 33% lower cost than using H100s based on Databricks survey of the public cloud in January.
For inference, the cost advantage is even more pronounced, with almost a 50% cost advantage.
And of course, Gaudi 3 is coming in 2024.
All of which, must be making Jensen increasingly nervous. He says even free AI chips from his competitors can't beat Nvidia's GPUs,
Translation: Jensen is worried about NVIDIA GPUs getting undercut by custom AI training/inference chips. Itās happening!
tomshardware.com/pc-components/ā¦
ā Delip Rao e/Ļ (@deliprao)
3:32 PM ā¢ Mar 11, 2024
Now, please note that none of this is financial advice. Warren Buffet brain would say āBuy Intel,ā while Charlie Munger brain would say āBuy Nvidia," which just goes to show how bad all financial advice out there is.
Because truly, in an AGI world, the only thing worth anything is human relationships and health. So go out there and touch some grass on a walk with your family.
šļø Things Happen
GPT-5 now leaked
Donāt be pys-opped by Claude
š¼ļø AI Artwork Of The Day
2035: Antartica ise is melting at an alarming rate. Scientists are making strange discoveries in the melting icecapsā¦- u/BuckChintheRealtor on r/midjourney
Thatās it for today! Become a subscriber for daily breakdowns of whatās happening in the AI world:
Reply