Ceph is amazing. Just don’t ask it to be Lustre

(And Yes, It Can Still Power AI and SAN Workloads) Ceph is one of the most powerful open-source storage platforms available today. It offers object, block, and file storage in a single distributed system, with high availability, strong durability, and the ability to scale on standard hardware.That alone makes Ceph exceptional. But here is the uncomfortable truth: Ceph can scale massively and still be the wrong storage for a specific workload. Understanding why is the difference between a great architecture…

Continue ReadingCeph is amazing. Just don’t ask it to be Lustre

Lustre Storage Service on Oracle OCI: A Game-Changer for High-Performance Data Management

I’m excited to share something really cool with you all! Oracle has just released a new Lustre storage service on their Cloud Infrastructure (OCI), and I think it’s going to change the way we handle large-scale data storage and processing. Whether you’re in HPC or AI/ML development, this new service has some serious potential. What’s Lustre Storage? Lustre is a parallel file system designed for high-performance workloads. It’s perfect for managing and processing massive amounts of data—think huge simulations, big…

Continue ReadingLustre Storage Service on Oracle OCI: A Game-Changer for High-Performance Data Management

Test Lustre Cluster Throughput and High Availability options

  • Post category:Cloud

https://www.youtube.com/watch?v=DdlIhfU2VAU In this video (English subtitled), I demonstrate the aggregate performance of a 4-node Lustre cluster (3 OSS + 1 MDS/MGS) and the block volumes provided by Oracle OCI. Of course, this is a functionality test and not a production POC. In addition to understanding and observing the aggregate performance that only 3 active OSS nodes can deliver, I wanted to test 2 failover systems between OSS1 and OSS2 nodes (OSS3 is unpaired and works without failover). 1 - The…

Continue ReadingTest Lustre Cluster Throughput and High Availability options