Details
-
Task
-
Status: Closed (View Workflow)
-
P3
-
Resolution: Done
-
None
-
-
Falcon Sprint 127, Falcon Sprint 136, Falcon Sprint 137, Falcon Sprint 138
-
5
-
Falcon
Description
Requirements/Scope:
- Extend mod-search.yaml with new API /authorities/ids
- Add unit/integration tests
Acceptance criteria:
- New API for /authorities/ids is exist
- Unit/Integration tests created
Proposed solution:
A possible solution for streaming large volumes of IDs. To begin with, it is worth dividing streaming into two operations. Stream ID from the ES to temporary storage, and the next step is to stream unique IDs to the end-user. As temporary storage, it is most convenient to use the Postgres database.
At the request, it is possible to create a temporary table in which to add the IDs from the ES. To optimize export, name the table with the CQL query hash and reuse it. A periodic job can delete result tables after it is no longer needed.
TestRail: Results
Attachments
Issue Links
- defines
-
MSEARCH-387 Not found when trying to retrieve resource job ids
-
- Closed
-
-
UXPROD-3626 Falcon - Morning Glory R2 2022 Enhancements/Bugfixes/Tech Debt
-
- Closed
-
- has to be done after
-
MSEARCH-210 Authority record search - Determine type of heading
-
- Closed
-
- has to be done before
-
FAT-1634 Implement Karate tests for /resources/ids endpoint
-
- Closed
-
- relates to
-
MSEARCH-187 [SPIKE]: Authority records search with ES
-
- Closed
-
-
MSEARCH-349 Change Instance ids stream API to use jobs
-
- Closed
-
-
MSEARCH-350 Change Holdings ids stream API to use jobs
-
- Closed
-
- mentioned in
-
Page Loading...