Switch to LocalStack to test AWS OpenSearch/Elasticsearch Service

Description

LocalStack is an AWS emulator that runs locally. See here for info about LocalStack:

Reasons to migrate:

  1. To save money. Even with the smallest settings, the cost of running AWS OpenSearch Service is not negligible.

  2. To test more versions. We’ve had to give up on testing Elasticsearch 5.6 on AWS to trim down costs (see above).

  3. To avoid problems with daily snapshots that make all tests fail. We can’t create/delete indexes during a snapshot, and this makes our tests fail, which led us to add “retries” to our test suite. Not great.

  4. To include AWS testing in the main build (for example through a dedicated module, e.g. integration-tests/backend/elasticsearch-aws), which should improve test coverage reporting (currently AWS is tested in a separate job and thus those tests are ignored in test coverage reports).

Activity

Show:
Won't Do

Details

Assignee

Reporter

Components

Priority

Created April 22, 2022 at 8:27 AM
Updated June 13, 2022 at 6:46 AM
Resolved June 13, 2022 at 6:46 AM