Uploaded image for project: 'mod-data-export'
  1. mod-data-export
  2. MDEXP-421

Export job triggered with invalid data stays in status New (and does not fail)

    XMLWordPrintable

Details

    • Firebird Sprint 122
    • 3
    • Firebird

    Description

      Overview:
      If the file that is used to trigger has a supported file extension but stores invalid data, the export should fail. It is not failing anymore. The job does not start at all.

      Steps to Reproduce:

      1. Use attached files to trigger the data export using default job profile

      Expected Results:
      The export job should complete with status Fail
      Actual Results:
      Job triggered with test-failed.csv stays in status New (visible only in backend)

      Additional Information:
      I can recreate the issue in all environments, including Iris bugfest. Here is data-export/job-executions response from folio-snapshot

      {
        "jobExecutions": [
          {
            "id": "9a2a8c74-09e7-4872-a81b-2a51a2a6d6a8",
            "hrId": 1,
            "exportedFiles": [
              {
                "fileId": "a68b157a-5f88-4479-aa66-792e7888a577",
                "fileName": "invalid-uuids2-1.mrc"
              }
            ],
            "jobProfileId": "6f7f3cd7-9f24-42eb-ae91-91af1cd54d0a",
            "jobProfileName": "Default job profile",
            "progress": {
              "exported": 0,
              "failed": 0,
              "total": 2
            },
            "lastUpdatedDate": "2021-07-14T16:24:40.565+00:00",
            "startedDate": "2021-07-14T16:24:40.565+00:00",
            "runBy": {
              "firstName": "DIKU",
              "lastName": "ADMINISTRATOR"
            },
            "status": "IN_PROGRESS"
          },
          {
            "id": "c42818b2-6b0f-44bd-b323-e6f379d3e3f4",
            "hrId": 2,
            "exportedFiles": [
              {
                "fileId": "18b7fb3b-5108-4fbf-8563-0df618b6afb7",
                "fileName": "invalid-uuids-2.mrc"
              }
            ],
            "jobProfileId": "6f7f3cd7-9f24-42eb-ae91-91af1cd54d0a",
            "jobProfileName": "Default job profile",
            "progress": {
              "exported": 17,
              "failed": 252,
              "total": 269
            },
            "completedDate": "2021-07-14T16:57:01.698+00:00",
            "lastUpdatedDate": "2021-07-14T16:57:01.691+00:00",
            "startedDate": "2021-07-14T16:56:59.801+00:00",
            "runBy": {
              "firstName": "DIKU",
              "lastName": "ADMINISTRATOR"
            },
            "status": "COMPLETED_WITH_ERRORS"
          },
          {
            "id": "feed55e0-5c4b-47a3-b286-f284cc8c99c9",
            "hrId": 3,
            "exportedFiles": [
              {
                "fileId": "43ba7669-f028-4b66-b20b-d3d475eaa368",
                "fileName": "invalid-uuids3-3.mrc"
              }
            ],
            "jobProfileId": "6f7f3cd7-9f24-42eb-ae91-91af1cd54d0a",
            "jobProfileName": "Default job profile",
            "progress": {
              "exported": 0,
              "failed": 0,
              "total": 3
            },
            "lastUpdatedDate": "2021-07-14T16:59:38.103+00:00",
            "startedDate": "2021-07-14T16:59:38.103+00:00",
            "runBy": {
              "firstName": "DIKU",
              "lastName": "ADMINISTRATOR"
            },
            "status": "IN_PROGRESS"
          },
          {
            "id": "01a178db-61b6-45ee-8b47-364f20d059a0",
            "hrId": 4,
            "exportedFiles": [
            ],
            "jobProfileId": "6f7f3cd7-9f24-42eb-ae91-91af1cd54d0a",
            "jobProfileName": "Default job profile",
            "status": "NEW"
          }
        ],
        "totalRecords": 4
      

      Additional information:
      The export triggered with the file that contains invalid uuids (invalid-uuids3.csv) took a while to fail but the behavior is as expected.
      For the file that has only some UUIDs that do not have matching instances the behavior is as expected. The export completes with errors and the error log list all uuids that do not have associated records.

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                Oleksandr_Bozhko Oleksandr Bozhko
                magdaz Magda Zacharska
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases