Use the Elasticsearch Scroll API when fetching large result sets
Description
duplicates
Activity
Show:
Duplicate
Assignee
Unassigned
UnassignedReporter
![](https://secure.gravatar.com/avatar/57637a2eb871b34eba14e700c78c6a5d?d=https%3A%2F%2Favatar-management--avatars.us-west-2.prod.public.atl-paas.net%2Finitials%2FSG-6.png)
Components
Priority
Created February 26, 2016 at 5:49 PM
Updated September 5, 2016 at 6:52 PM
Resolved September 5, 2016 at 6:52 PM
Recent versions of Elasticsearch will refuse to run a query whose potential result size is larger than its
setting.
We either need to fetch this value from the ES node on initial connection, or allow the user to configure the same and make sure to use the Scroll API to run queries which could be larger.