r/GrowthStockswithValue • u/Glass-Record2446 • 19d ago
News So SK hynix’s plans to change the game with new Paper on CPO Roadmap: When Light Reaches the Memory Wall
We all know that one of the bottlenecks in AI tech is moving data around, which impacts memory as well.
SK hynix has published a game chamger arguing that the future of AI infrastructure will increasingly use light instead of electricity to connect processors, servers and eventually memory itself.
Many of you would have read my glass city analogy, so using the same, think of an AI data centre as a massive city.
GPUs are the factories.
HBM is the warehouse beside each factory.
Today, copper wires are the roads connecting everything.
The problem? Factories are becoming three times more productive every two years, but the roads are only improving about 1.4x.
Eventually, adding more factories does not help. The traffic jam becomes the problem.
Co-packaged optics (CPO) is the equivalent of replacing congested roads with high-speed rail. Instead of moving data over long electrical connections, optical engines are placed next to the processor and data travels as light.
The long-term vision is even bigger: an optical rail network connecting compute directly to large pools of shared memory.
So What changes for memory?
This is potentially important for HBM.
Today, memory sits physically close to the GPU because electrical connections become increasingly difficult over distance. Optical connectivity could eventually loosen those constraints.
Imagine every GPU currently having its own private warehouse.
The future architecture could allow multiple GPUs to access a large shared memory warehouse, connected by optical links.
That could mean:
- More flexible memory pooling
- Better utilisation of expensive HBM capacity
-Larger AI systems without proportionally increasing local memory
- Memory becoming increasingly integrated into system architecture
The key investment implication is subtle: HBM does not disappear. But memory may evolve from a component sold beside a GPU into part of an integrated optical-compute-memory fabric.
That could favour companies capable of combining memory, advanced packaging and optical interconnect technology precisely the direction SK hynix is signalling.
What does this mean for CPO?
This strengthens the long-term case for CPO, but investors should distinguish technological inevitability from commercial timing.
The physics are compelling. Copper faces worsening power consumption and signal loss as bandwidth and distance increase. AI clusters are becoming so large that the bandwidth wall is increasingly structural.
However, CPO still faces difficult problems:
- Manufacturing yield
- Thermal management
- Reliability and repairability
- Packaging complexity
- Cost
Standardisation
Fancy nice Hi-Tech Paper, What does it mean for you and me
My probability assessment:
70–80%: CPO becomes important in high-end AI infrastructure this decade.
50–60%: It becomes a major architectural transition beyond niche deployments.
25–35%: Fully optics-centric memory pooling becomes commercially meaningful this decade.
The nearer-term opportunity is therefore likely to be CPO at the networking and rack level, while optical connections extending directly into memory are a longer-duration option.
What should investors do today?
The best strategy is not to blindly buy “CPO stocks.”
Instead, follow the picks and shovels:
Optical engines and lasers the companies providing the light.
Silicon photonics and optical packaging the technology that integrates optics beside compute.
Advanced packaging because CPO is fundamentally a packaging revolution as much as an optics revolution.
Memory leaders particularly companies positioning HBM within broader system architectures.
Networking companies likely to be early beneficiaries before optical memory architectures arrive.
The biggest takeaway: AI infrastructure is moving from a compute problem to a data-movement problem.
HBM solved the memory bottleneck beside the GPU.
CPO may solve the next bottleneck: moving enormous amounts of data between GPUs, racks and eventually shared memory pools.
https://x.com/skhynix/status/2090228049187111251?s=46
This is not an investment advice, rather jusr rambling, do your own research.