Uploaded image for project: 'cql2pgjson'
  1. cql2pgjson
  2. CQLPG-88

Implement id > [uuid] for pagination

    XMLWordPrintable

Details

    • Core: Platform - Sprint 61, CP: sprint 63, CP: sprint 64
    • 2
    • Core: Platform

    Description

      Implement > >= < <= when comparing the primary key id field with a constant uuid.

      This will allow to get equally sized chunks of records ordered by id. For example
      cql1: cql.allRecords=1 sortBy id
      cql2: id > [last from cql1] sortBy id
      cql3: id > [last from cql2] sortBy id
      ...
      Each query is invoked with limit=10000.

      Background: This is needed to retrieve all records ordered by id, see discussion on slack in #development: https://folio-project.slack.com/archives/C210RP0T1/p1551337239000400 and https://folio-project.slack.com/archives/C210RP0T1/p1553873612059900

      Implementation is easy because we already have == and <> and right truncation implemented using <, >, >=, >= and only need to add these additional operators.

      Note: This enables chunking for all collection endpoints, and is most relevant for endpoints lacking streaming support. Enabling this chunking for existing non-streaming endpoints requires to update to latest RMB only. In contrast adding streaming support requires coding a new endpoint (or re-writing the existing endpoint, breaking change) and is therefore much more work.

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                julianladisch Julian Ladisch
                julianladisch Julian Ladisch
                Adam Dickmeiss Adam Dickmeiss
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases