REST query not working on list after 5k threshold

Question

The following query works on one site: mysite/_api/lists/getbytitle('Listname')/items?$top=5001&$filter=IndexedCol1 le 'M' and Author/Title eq 'John Doe'&$expand=Author/Title&$select=Author/Title,ID,Title

On a separate site which is identical in every way but the site name and the fact that it has 6,000 items vs the 4,000 in the previous site, I receive the following response:

{"error":{"code":"-2147024809, System.ArgumentException","message":{"lang":"en-US","value":"Value does not fall within the expected range."}}}`

IndexedCol1 represents an indexed column by which I have successfully sorted my views (less than or equal to M and greater than or equal to M). All other fields and filters have been working on this large list when I combined them with the 1IndexedCol1 le 'M' filter. Even substrings and greater than/less than operations work.. How can I resolve this issue with Author/Title that only applies when my list has over 5,000 items?

edit: This seems to apply to ALL user fields. The simplest query still gives me the out of range error: &$expand=Author&$select=Author/Id works just fine, but &$expand=Author&$select=Author/Title,ID,Title and &$expand=Author/Title&$select=Author/Title,ID,Title do not work on one list while they do work on another.

Answer 1

It looks like this is a SharePoint defect affecting all lookup fields. It's linked to having to unique permissions on a list with over 5,000 items.

• REST API - Can't expand Title of lookup columns "System.ArgumentException : Value does not fall within the expected range"

Very disappointing.. :( Oh well, I will change my target list to the User Information List to find the user, grab the ID, and then query my my list based on Author/Id instead of Author/Title. I will leave this question up for a little while to see if anyone has other workarounds.

The workaround was successful btw. It looks like all you can do is to query the list that the lookup belongs to (in this case, the User Information List) once you run into this issue.

Answer 2

There are two known ways to by pass List View threshold

1. By changing resource throttling value in Central Admin - This not recommended approach
2. By creating indexed columns. Using List Settings add fields you are filtering to Indexed Columns.

A list supports 20 indexed columns, so you can try adding more fields to improve the performance.