# OCP-SVR-CMS-Benchmarks

**Repository Path**: mirrors_opencomputeproject/OCP-SVR-CMS-Benchmarks

## Basic Information

- **Project Name**: OCP-SVR-CMS-Benchmarks
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: GPL-3.0
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-12-13
- **Last Updated**: 2026-03-08

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# OCP SRV CMS Benchmark Suite

## Overview

OCP-SRV-CMS-Benchmarks is a comprehensive benchmarking suite designed to evaluate and analyze the performance of Compute Express Link (CXL) technology. This repository provides a collection of tools, benchmarks, and utilities to assess various aspects of CXL implementations, including latency, bandwidth, and overall system performance.

This repository has several standard benchmarks that have been made to work with DRAM and CXL. Each benchmark stands alone. Read the 'README.md' for each benchmark for instructions.

## Purpose

The primary goals of OCP-SRV-CMS-Benchmarks are:

1. To provide a standardized set of benchmarks for CXL technology
2. To enable researchers, developers, and industry professionals to evaluate CXL performance across different hardware configurations
3. To facilitate the comparison of various CXL implementations and their impact on system performance
4. To support the ongoing development and optimization of CXL technology

## Directory Structure

```bash
OCP-SRV-CMS-Benchmarks/
├── benchmarks/         // All benchmarks
├── lib/                // Helper libraries for the benchmark scripts
├── tools/              // Helper tools for the benchmark suite scripts
├── CONTRIBUTING.md     // How to contribute to this project
├── LICENSE             // License file
└── README.md           // This file
```

## Included Benchmarks

This table shows the list of benchmarks included in this suite:

| Benchmark | Description |
|-----------|-------------|
| cloudsuite3/graph-analytics   | The Graph Analytics benchmark relies on the Spark framework to perform graph analytics on large-scale datasets |
| cloudsuite3/inmem-analytics   | This benchmark uses Apache Spark and runs a collaborative filtering algorithm (alternating least squares, ALS) provided by Spark MLlib in memory on a dataset of user-movie ratings. The metric of interest is the time in seconds for computing movie recommendations. |
| GPU/AMD/rocm_bandwidth_test | EA tool for bandwidth measurements on NVIDIA GPUs |
| GPU/NVIDIA/nvbandwidth | EA tool for bandwidth measurements on NVIDIA GPUs |
| GPU/NVIDIA/cuda_examples | Evaluates the data transfer rates for NVidia GPUs |
| IntelMLC | Runs the Intel Memory Latency Checker (MLC) |
| memcached | Memcached is a general-purpose distributed memory-caching system |
| Qdrant-Synth | Creates synthetic vectors and benchmarks a Qdrant Vector Database running in a Docker Container |
| redis | Redis is a source-available, in-memory storage, used as a distributed, in-memory key–value database, cache and message broker |
| redis-memtier | Run the memtier benchmark against a redis instance |
| stream | The STREAM benchmark is a simple synthetic benchmark program that measures sustainable memory bandwidth (in MB/s) and the corresponding computation rate for simple vector kernels.  |
| tpcc | TPC-C (Transaction Processing Performance Council Benchmark C), is a benchmark used to compare the performance of online transaction processing systems. |

## How to Install OCP-SRV-CMS-Benchmarks

To clone the OCP-SRV-CMS-Benchmarks repository along with its submodules, use the following command:

```bash
git clone --recursive https://github.com/opencomputeproject/OCP-SVR-CMS-Benchmarks.git
```

This will clone the main repository and initialize all submodules, including the AMD Bandwidth, CUDA examples, and NVIDIA Bandwidth Test tools.

## Cloning and Initializing Submodules

If you cloned this repository **without** the `--recursive` flag, the submodules (such as GPU benchmarks) will not be initialized automatically.  
To fetch and initialize all submodules, run the following command from the root of the repository:

```sh
git submodule update --init --recursive
```

This will download all required submodules into their respective directories.

## Updating OCP-SRV-CMS-Benchmarks

To update OCP-SRV-CMS-Benchmarks, use the following command:
```bash
git pull
```

To update the submodules to their latest commits, run:
```bash
git submodule update --remote
```

## Getting Started

- Clone the repository as described above
- Choose a benchmark to run from the `benchmarks/` directory
- Follow the specific instructions for each benchmark in its respective directory

## Contributing
We welcome contributions to OCP-SRV-CMS-Benchmarks! Please read our [CONTRIBUTING.md](./CONTRIBUTING.md) file for guidelines on how to submit issues, feature requests, and pull requests.

## License
OCP-SRV-CMS-Benchmarks is released under the [GPL-3.0 License](./LICENSE.md). ![GitHub License](https://img.shields.io/badge/license-GPL--3.0-orange)
This covers our contributions to the project - scripts, etc. If a benchmark uses a 3rd party utility, most do, then that utility is covered by the authors license.

## Acknowledgments
We want to thank the contributors of the following projects, which are included as submodules in this repository:
- [CUDA Examples](https://github.com/drkennetz/cuda_examples) by drkennetz
- [NVIDIA Bandwidth Test](https://github.com/NVIDIA/nvbandwidth) by NVIDIA
- [AMD ROCm Bandwidth Test](https://github.com/ROCm/rocm_bandwidth_test) by AMD

## Contributors

![Contributors](https://contributors-img.web.app/image?repo=OCP-SRV-CMS-Benchmarks)

## Contact
For questions, suggestions, or support, please open an issue in this repository.