This directory contains multiple test suites for the AIPerf project, organized into multiple categories and supporting infrastructure.

The directory structure is as follows:

tests/
├── aiperf_mock_server/
├── ci/
│   └── test_docs_end_to_end/
├── integration/
└── unit/
    ├── server/
    └── ...

A standalone mock server application used for testing AIPerf against simulated endpoints. This is a separate Python package with its own pyproject.toml and can be installed independently. See aiperf_mock_server/README.md for detailed information.

CI/CD-specific test utilities and scripts. These tests are designed to run exclusively on Gitlab and have access to real GPU servers.

End-to-end tests for the documentation, running the AIPerf commands from the documentation and verifying the output against actual Dynamo and vLLM servers. These tests are designed to run exclusively on Gitlab and have access to real GPU servers.

End-to-end integration tests that verify complete workflows and interactions between components using real aiperf command lines. These tests are designed to run exclusively with the mock server and are executed on GitHub Actions. See integration/README.md for detailed information.

Unit tests for individual modules and components. The directory structure mirrors the src/aiperf/ directory as closely as possible, with each subdirectory containing tests for the corresponding source module.

Unit tests exclusively for the aiperf-mock-server. See aiperf_mock_server/README.md for detailed information.