Oracle pagination query runs longer when OFFSET value is higher

Oracle pagination query runs longer when OFFSET value is higher

-- slower (~10s):

OFFSET 8602 ROWS FETCH NEXT 41 ROWS ONLY

-- faster (~1s):

--OFFSET 0 ROWS FETCH NEXT 41 ROWS ONLY