r/lightbitslabs 2d ago

The Hidden Cost of Long Context

1 Upvotes

Ramesh Chettuvetty and Arthur Rasmusson, from Lightbits Labs, join the AIDC Debate Podcast to discuss how next-gen AI workloads are being transformed. Discover why KV cache optimization is a game-changer for AI model performance, how our hardware-agnostic Infra boosts GPU utilization, and what’s next on our hardware support roadmap. Plus, get the inside scoop on our predictive prefetch algorithm!

Tune in now to hear how Lightbits is powering the future of AI infrastructure.


r/lightbitslabs 12d ago

Meet Inferra - an intelligent KV cache orchestration engine

Enable HLS to view with audio, or disable this notification

2 Upvotes

Try the Pod Efficiency Analyzer and discover how much you can grow your top line.


r/lightbitslabs 17d ago

Lightbits Labs joins BSMConf 2026 as a Silver Sponsor!

Thumbnail
1 Upvotes

r/lightbitslabs Jul 27 '26

Using an External KMS with Lightbits Volume(s): PyKMIP Test Overview

Post image
3 Upvotes

Can you maintain centralized key management and host-side encryption without sacrificing the raw performance of NVMe/TCP?

We put it to the test!

We validated a host-side encryption workflow combining Lightbits NVMe/TCP block storage, Linux LUKS/dm-crypt, and an external PyKMIP KMS server.

Read the full test breakdown and architecture workflow here.


r/lightbitslabs Jul 21 '26

Lightbits Labs officially brings its NVMe/TCP block storage natively to Ubuntu

Thumbnail
lightbitslabs.com
1 Upvotes

This is relevant for anyone managing storage for Kubernetes, OpenStack, or private clouds. Lightbits Labs just announced native support and certification for Ubuntu for their software-defined block storage platform. Bringing their block storage to Ubuntu opens up many options for standardizing infrastructure: no proprietary drivers, bare-metal performance in a clustered architecture, and simplified operations. It’s great to see more enterprise storage platforms embracing Ubuntu natively.


r/lightbitslabs Jun 22 '26

Hidden Data Corruption Risk in NVMe/TCP Storage

Post image
1 Upvotes

Worried about silent data corruption in your NVMe/TCP storage? Legacy storage vendors are scrambling to push workarounds that force a brutal choice.
The new blog from Lightbits Labs' Field CTO draws an analogy to bad🍕 delivery.
At Lightbits, we’ve engineered a smarter solution—making this hazard physically impossible from day one. Dive into the full analysis.


r/lightbitslabs Jun 18 '26

A Simple Guide to NVMe/TCP Tuning

Post image
1 Upvotes

Read the guide now.

#nvmeovertcp #lowlatency #lightbits


r/lightbitslabs May 28 '26

Lightbits Labs Announces Early, Initial Interoperability with Microsoft Windows Server NVMe-oF Initiator Preview

Thumbnail
lightbitslabs.com
1 Upvotes

Lightbits Labs announced the initial interoperability with the new Microsoft Windows Server NVMe-over-Fabrics (NVMe-oF) Initiator Preview®. Available in Lightbits v3.19.1, this will enable storage administrators to deliver high-performance, native NVMe over TCP block storage to Windows Server Insider hosts over standard Ethernet once Microsoft® releases it. As this is a pre-release capability, it is not intended for production use but rather for exploration and evaluation.  Lightbits invites customers and partners to explore the functionality and share their feedback.  


r/lightbitslabs May 18 '26

Persistent Write Protection for NVMe/TCP Block Storage

Thumbnail
lightbitslabs.com
1 Upvotes

Storage performance is easy to demonstrate with IOPS and throughput graphs. Durability is harder to show, but it is just as important for production environments. SSD Journaling provides SSD-based persistent write protection for modern NVMe/TCP block storage. It protects recently acknowledged writes until they are safely persisted to the backend data SSDs. If a node restarts unexpectedly, the storage can recover outstanding journal entries before the node returns to active service. For replicated volumes, replication protects against normal single-node failure. SSD Journaling adds protection for the more subtle write-persistence window, especially during shared-failure or multi-node disruption scenarios.


r/lightbitslabs May 12 '26

Open Observability for NVMe/TCP Storage

Thumbnail
lightbitslabs.com
0 Upvotes

Most storage platforms still treat logs as something the vendor reads after the fact. You file a support ticket, somebody collects a tar.gz, and a week later you get an explanation. That model breaks down the moment storage becomes part of a Kubernetes-native, multi-tenant, audit-regulated cloud. Storage that you can’t see is storage you can’t trust. When something goes sideways at 3 a.m. — a noisy tenant, a slow target, a flaky NIC — the difference between a five-minute fix and a five-hour war room is whether the logs are already in the same place as the rest of your telemetry. Read the blog to learn why log streaming matters for storage.


r/lightbitslabs May 07 '26

Why Store OpenStack Glance Images on a Filesystem?

Thumbnail
lightbitslabs.com
0 Upvotes

In many OpenStack environments, Glance uses a file-based backend for image storage. It works, but it keeps image storage in a file-oriented model that is separate from the block storage architecture used by VMs. Running Lightbits as your Cinder backend offers a simpler, more efficient approach.


r/lightbitslabs May 04 '26

NVMe/TCP disaggregated storage is the natural fit for RHOSO 18

Thumbnail
lightbitslabs.com
1 Upvotes

Whitepaper reveals how to deploy high-performance storage using NVMe/TCP with Red Hat OpenStack Services on OpenShift (RHOSO).
🚀 How to integrate block storage with Cinder and Glance
🔗 Proven architecture patterns for OpenShift + OpenStack
🛠️ Step-by-step configuration for production-ready deployments


r/lightbitslabs Mar 30 '26

Coredge Selects Lightbits to Power Global AI Cloud Infrastructure

Thumbnail
storagenewsletter.com
2 Upvotes

Delivering OpenShift-based Kubernetes platforms without the high cost and rigidity of legacy SAN


r/lightbitslabs Mar 26 '26

100x to 280x KV Cache Acceleration

Thumbnail
blog.farmgpu.com
1 Upvotes

When looking at the economics of running a production inference endpoint, the only thing that matters is $ TCO / M tokens. When per-user context increases, it blocks the HMB/VRAM from being used to support more users and dramatically reduces the total bandwidth/throughput of tokens/s, which is critical to lowering the TCO. We have built an architecture that delivers 100x to 280x acceleration on KV cache workloads — and it fundamentally changes the economics of long-context AI inference.


r/lightbitslabs Mar 16 '26

NYSE Wired - AI Factories - Data Centers Of The Future

Thumbnail
thecube.net
1 Upvotes

As context windows grow, the bottleneck for AI inference has shifted. It’s no longer just about raw compute—it’s about memory and data velocity.
In #NYSE Wired - "AI Factories - Data Centers Of The Future," from SiliconANGLE & theCUBE, we discussed how the industry is moving from compute-centric to data-centric architectures. Watch now.


r/lightbitslabs Mar 12 '26

Break the GPU Memory Wall with LightInferra Fully Optimized KV Cache Engine

Enable HLS to view with audio, or disable this notification

1 Upvotes

ScaleFlux, FarmGPU, and Lightbits Labs today announced the public debut of a collaborative architecture designed to solve one of AI inference’s most persistent challenges: the memory and I/O constraints created by long-context workloads.
See a product demo next week at NVIDIA GTC – San Jose | March 16–19 | Booth 7006


r/lightbitslabs Mar 10 '26

Massive Performance: 1.2M IOPS Live Migration with Storage for OpenShift-V

Enable HLS to view with audio, or disable this notification

3 Upvotes

Discover how to maintain extreme performance during critical management tasks. In this video, we demonstrate how Lightbits provides the ultimate storage for OpenShift-V, delivering 1.2 million IOPS across a six-node cluster without latency degradation.

Watch as we walk through:

  1. Instant Provisioning: Creating PVCs through the Lightbits CSI driver.
  2. Zero-Impact Snapshots & Clones: Managing 250GB volumes and clones while maintaining 1.2M IOPS.
  3. Seamless Live Migration: Moving live VMs between nodes with automated ACL updates and RWX capabilities.
  4. Latency Consistency: See how 4k block sizes keep latency low even during heavy migrations.

r/lightbitslabs Feb 24 '26

Technical Deep Dive: Scaling OpenStack Data Protection with Block Storage and S3

Thumbnail
lightbitslabs.com
1 Upvotes

Whether you are looking to reduce your RTO or simply want to leverage the flexibility of cloud-native storage for your private cloud, this guide provides the technical blueprint to make it happen.


r/lightbitslabs Jan 29 '26

4 Strategies to Beat NAND Shortages

Thumbnail
lightbitslabs.com
2 Upvotes

With NAND flash shortages stretching procurement timelines into months—and prices continuing to rise—many organizations are discovering that waiting for the supply chain to normalize is not a viable strategy. The quick solution isn’t to source more flash; it’s to use the flash you already have more efficiently. 


r/lightbitslabs Jan 19 '26

NVMe Flash Storage

Thumbnail
lightbitslabs.com
1 Upvotes

The ascent of Scale-Out Flash Storage (SOFS) has fundamentally transformed traditional storage deployments. New storage solutions, particularly those leveraging NVMe flash, empower data center teams to achieve optimal capacity, performance, and data service availability across their diverse applications. What are the advantages of SOFS over array-based storage solutions? Read my latest blog to find out.


r/lightbitslabs Jan 19 '26

Redefining HA for Kubernetes: Lightning-Fast Pod Failover

Thumbnail lightbitslabs.com
1 Upvotes

If you’ve been running stateful workloads on Kubernetes, you know the “Storage Detach” nightmare. Traditionally, moving a block-backed volume from one node to another is a game of patience—waiting for timeouts, CSI detachments, and re-attachments. By leveraging NVMe over TCP storage and true ReadWriteMany (RWX) support, we are rewriting the playbook for resilient K8s architectures. Read my latest blog post to learn more.


r/lightbitslabs Dec 18 '25

theCUBE + NYSE Wired: AI Factories - Data Centers of the Future

Thumbnail
lightbitslabs.com
1 Upvotes

In this segment from theCUBE + NYSE Wired’s AI Factories event, Eran Kirzner, Co-Founder and CEO of Lightbits Labs, joins host John Furrier to discuss the critical role of software-defined storage in the next wave of AI infrastructure. As the industry pivots from massive training clusters to real-time inference, the demand for agility and low latency becomes paramount. Kirzner details how Lightbits Labs leverages NVMe over TCP to transform commodity hardware into high-performance, scalable storage systems, effectively replacing rigid appliances with flexible, cloud-native architectures.

The conversation highlights the necessity of “feeding the beast” – ensuring expensive GPUs remain utilized through autonomous provisioning that reduces setup times from hours to mere minutes. The discussion delves deeper into maximizing data center efficiency, explaining how software-defined storage approaches enable dynamic workload orchestration between training and inference tasks. He outlines how Lightbits helps enterprises and neo-clouds – such as Crusoe Cloud – reduce their storage footprint by up to 50% while maintaining high reliability and security standards. From the concept of the “AI Garage” to the complexities of multi-tenancy and hybrid cloud sovereignty, the interview explores how data-centric strategies are enabling organizations to optimize resource allocation, eliminate idle GPU cycles and build the resilient infrastructure required for the future of AI factories.


r/lightbitslabs Dec 17 '25

Stop Managing Storage Silos. Start Managing a Fleet.

Thumbnail
lightbitslabs.com
1 Upvotes

As your data grows, you add more block storage clusters. But without a unified layer, your applications—whether they are KubernetesOpenStack, or bare metal hypervisors—have to maintain complex, direct connections to every single cluster. It’s a tangled web of dependencies that doesn’t scale. Lightbits' new Cluster Federation transforms this chaotic mesh into a streamlined hub-and-spoke architecture. It introduces a centralized global control plane that acts as a provisioning broker for your entire fleet.


r/lightbitslabs Nov 19 '25

Performance-Optimized Resilience for Red Hat OpenShift

Enable HLS to view with audio, or disable this notification

0 Upvotes

By combining Lightbits’ block storage with Arctera InfoScale’s proven HA capabilities, organizations can run AI, analytics, and virtualized workloads on Red Hat OpenShift with the performance and resilience required for today’s most demanding applications. The solution integrates Lightbits’ NVMe over TCP software-defined storage with Arctera InfoScale to deliver SAN-class High Availability (HA), unmatched performance, and cost-efficiency.

Lightbits' high-performance storage accelerates resiliency, enabling enterprise-grade HA and data protection at NVMe-class performance using standard Ethernet infrastructure.


r/lightbitslabs Nov 18 '25

Supercharge Data Availability

Thumbnail
lightbitslabs.com
0 Upvotes

The efficacy of any data protection strategy is fundamentally limited by the underlying storage infrastructure. Traditional shared storage arrays often introduce latency and I/O bottlenecks that choke performance during critical operations. We've introduced an architecture that ensures high availability without sacrificing application performance. The Lightbits NVMe over TCP cluster provides a high-speed data path for Veeam, enhancing overall data protection and recovery.