Merino Testing

Test Strategy

Merino is tested using a combination of functional and performance tests.

Test code resides in the tests directory.

Merino's test strategy requires that we do not go below a minimum test coverage percentage for unit and integration tests. Load tests cannot go below a minimum performance threshold.

Functional tests push test artifacts, in the form of JUnit XMLs and Coverage JSONs to the ETE Test Metric Pipeline for trending and monitoring. Results can be found on the Merino-py Test Metrics Looker Dashboard.

Test documentation resides in the /docs/testing/ directory.

The test strategy is three-tiered, composed of:

• unit - documentation
• integration - documentation
• load - documentation

See documentation and repositories in each given test area for specific details on running and maintaining tests.