Credentials error while mass indexing on AWS ES with static credentials: "The request signature we calculated does not match the signature you provided."

I see you created HSEARCH-4254. Let’s continue the discussion there.

I’m afraid that’s not enough information. I added tests with (very) large documents, in particular one where each document is the whole text of “Great Expectations”, and I did experience similar problems, but I found the cause (at least in that case) and managed to fixe it. See https://github.com/hibernate/hibernate-search/blob/32cc18a8a89995d9ab4deb9174253a368544907f/integrationtest/backend/tck/src/main/java/org/hibernate/search/integrationtest/backend/tck/work/IndexIndexerLargeDocumentsIT.java#L46 .

Please make sure you upgraded to the latest version of both hibernate-backend-elasticsearch-aws and also hibernate-backend-elasticsearch, because one of the bugs was in hibernate-backend-elasticsearch (though it affected only the AWS integration). In general you should always use the same version for all Hibernate Search modules, but who knows…

If the problem remains:

• What are the stack traces exactly, this time? Including all frames and all causes.

• Are you using custom configuration for the HTTP client (ElasticsearchHttpClientConfigurer)?

• Are there any enterprise firewalls between you and AWS that could alter the requests, e.g. by changing or dropping signed headers or slightly altering the content of the request (encoding errors, adding a line break at the end, …)?

• If all else fails, I will need you to pinpoint the exact requests that are failing (by enabling logs), and give me the exact content of the first failing request.

I just pulled 6.0.5Final and tried a reindex on AWS.

Seems to me that the situation improved: the lighter entities now get indexed without any exception. Whenever the mass indexer gets to bigger documents though (eg. file contents), it is still throwing a fair amount of exceptions on credentials.

I know these are just vague feedbacks, but I hope they can help you in some way.

This is my MassIndexer configuration:

Let me know if I can be of any help.

Fixed in 6.0.5.Final, released today:

Oh well, that’s good news for me anyway, heh.

Keep up the good work!