Uploaded image for project: 'mod-oai-pmh'
  1. mod-oai-pmh
  2. MODOAIPMH-259

HTML encoded entities in records make the OAI-PMH requests crash

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • P2
    • Resolution: Done
    • None
    • 3.2.5
    • None
    • Concorde - Sprint 103
    • 2
    • Concorde

    Description

      Overview:
      Steps to Reproduce:

      1. Add the attached records to FOLIO. Note the encoded character in the 505 field:
      2. Get the record from /oai/records. The record is returned, even though not really as expected See attached image

        It seems the Re\u0301gime has been replaced by <U+0301>
      3. Get the record from edge-oai.

      Expected Results:
      The record is retrieved an looks just as it does in /oai/records
      Actual Results:
      A HTTP 504 is returned
      Additional Information:
      URL:
      Interested parties:

      • Instance and SRS Data to test with:*
        SRS record:
      {
          "id": "75fc92ce-fe40-4515-949e-076394aedb7f",
          "deleted": false,
          "snapshotId": "67dfac11-1caf-4470-9ad1-d533f6360bdd",
          "matchedId": "75fc92ce-fe40-4515-949e-076394aedb7f",
          "generation": 0,
          "recordType": "MARC",
          "rawRecord": {
              "id": "75fc92ce-fe40-4515-949e-076394aedb7f",
              "content": "{\"leader\": \"02035cam a22004454a 4500\", \"fields\": [{\"001\": \"2182389\"}, {\"005\": \"20171108132600.0\"}, {\"008\": \"070718t20082008mduab    b    001 0 eng  \"}, {\"010\": {\"subfields\": [{\"a\": \"  2007029526\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"020\": {\"subfields\": [{\"a\": \"9780742534100 (cloth : alk. paper)\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"020\": {\"subfields\": [{\"a\": \"0742534103 (cloth : alk. paper)\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"020\": {\"subfields\": [{\"a\": \"9780742534117 (pbk. : alk. paper)\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"020\": {\"subfields\": [{\"a\": \"0742534111 (pbk. : alk. paper)\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"035\": {\"subfields\": [{\"a\": \"(OCoLC)ocn156874791\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"035\": {\"subfields\": [{\"a\": \"(OCoLC)156874791\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"035\": {\"subfields\": [{\"a\": \"2182389\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"040\": {\"subfields\": [{\"a\": \"DLC\"}, {\"c\": \"DLC\"}, {\"d\": \"BTCTA\"}, {\"d\": \"BAKER\"}, {\"d\": \"C#P\"}, {\"d\": \"YDXCP\"}, {\"d\": \"IXA\"}, {\"d\": \"UtOrBLW\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"043\": {\"subfields\": [{\"a\": \"e-fr---\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"049\": {\"subfields\": [{\"a\": \"ALMM\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"050\": {\"subfields\": [{\"a\": \"DC149\"}, {\"b\": \".N44 2008\"}], \"ind1\": \"0\", \"ind2\": \"0\"}}, {\"082\": {\"subfields\": [{\"a\": \"944.04\"}, {\"2\": \"22\"}], \"ind1\": \"0\", \"ind2\": \"0\"}}, {\"100\": {\"subfields\": [{\"a\": \"Neely, Sylvia.\"}, {\"0\": \"http://id.loc.gov/authorities/names/n90717906\"}], \"ind1\": \"1\", \"ind2\": \" \"}}, {\"245\": {\"subfields\": [{\"a\": \"A concise history of the French Revolution /\"}, {\"c\": \"Sylvia Neely.\"}], \"ind1\": \"1\", \"ind2\": \"2\"}}, {\"264\": {\"subfields\": [{\"a\": \"Lanham :\"}, {\"b\": \"Rowman & Littlefield Publishers,\"}, {\"c\": \"[2008]\"}], \"ind1\": \" \", \"ind2\": \"1\"}}, {\"264\": {\"subfields\": [{\"a\": \"Lanham :\"}, {\"b\": \"Distributed by National Book Network\"}], \"ind1\": \" \", \"ind2\": \"2\"}}, {\"264\": {\"subfields\": [{\"c\": \"008\"}], \"ind1\": \" \", \"ind2\": \"4\"}}, {\"300\": {\"subfields\": [{\"a\": \"xvii, 287 pages :\"}, {\"b\": \"illustrations, maps ;\"}, {\"c\": \"24 cm.\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"336\": {\"subfields\": [{\"a\": \"text\"}, {\"b\": \"txt\"}, {\"2\": \"rdacontent\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"337\": {\"subfields\": [{\"a\": \"unmediated\"}, {\"b\": \"n\"}, {\"2\": \"rdamedia\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"338\": {\"subfields\": [{\"a\": \"volume\"}, {\"b\": \"nc\"}, {\"2\": \"rdacarrier\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"490\": {\"subfields\": [{\"a\": \"Critical issues in history\"}], \"ind1\": \"1\", \"ind2\": \" \"}}, {\"504\": {\"subfields\": [{\"a\": \"Includes bibliographical references (p. 267-274) and index.\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"505\": {\"subfields\": [{\"a\": \"The Ancien Regime, its critics and supporters -- The financial crisis -- The Estates General and the General Assembly -- Creating the new regime -- Polarization and the flight to Varennes -- The failure of constitutional government -- The Convention -- Terror and war -- Thermidor and the Directory.\"}], \"ind1\": \"0\", \"ind2\": \" \"}}, {\"651\": {\"subfields\": [{\"a\": \"France\"}, {\"x\": \"History\"}, {\"y\": \"Revolution, 1789-1799.\"}, {\"0\": \"http://id.loc.gov/authorities/subjects/sh85051319\"}], \"ind1\": \" \", \"ind2\": \"0\"}}, {\"830\": {\"subfields\": [{\"a\": \"Critical issues in history.\"}, {\"0\": \"http://id.loc.gov/authorities/names/n99002874\"}], \"ind1\": \" \", \"ind2\": \"0\"}}, {\"938\": {\"subfields\": [{\"a\": \"Baker & Taylor\"}, {\"b\": \"BKTY\"}, {\"c\": \"24.95\"}, {\"d\": \"18.71\"}, {\"i\": \"0742534103\"}, {\"n\": \"0007433208\"}, {\"s\": \"active\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"938\": {\"subfields\": [{\"a\": \"YBP Library Services\"}, {\"b\": \"YANK\"}, {\"n\": \"2612951\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"938\": {\"subfields\": [{\"a\": \"Baker & Taylor\"}, {\"b\": \"BKTY\"}, {\"c\": \"22.95\"}, {\"d\": \"22.95\"}, {\"i\": \"0742534111\"}, {\"n\": \"0007618566\"}, {\"s\": \"active\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"938\": {\"subfields\": [{\"a\": \"Baker and Taylor\"}, {\"b\": \"BTCP\"}, {\"n\": \"BK0007618566\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"994\": {\"subfields\": [{\"a\": \"C0\"}, {\"b\": \"ALM\"}], \"ind1\": \" \", \"ind2\": \" \"}}, {\"999\": {\"subfields\": [{\"i\": \"482b0d18-39dc-480d-80b4-746e87efd4e8\"}, {\"s\": \"75fc92ce-fe40-4515-949e-076394aedb7f\"}], \"ind1\": \"f\", \"ind2\": \"f\"}}]}"
          },
          "parsedRecord": {
              "id": "75fc92ce-fe40-4515-949e-076394aedb7f",
              "content": {
                  "leader": "02035cam a22004454a 4500",
                  "fields": [
                      {
                          "001": "2182389"
                      },
                      {
                          "005": "20171108132600.0"
                      },
                      {
                          "008": "070718t20082008mduab    b    001 0 eng  "
                      },
                      {
                          "010": {
                              "subfields": [
                                  {
                                      "a": "  2007029526"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "020": {
                              "subfields": [
                                  {
                                      "a": "9780742534100 (cloth : alk. paper)"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "020": {
                              "subfields": [
                                  {
                                      "a": "0742534103 (cloth : alk. paper)"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "020": {
                              "subfields": [
                                  {
                                      "a": "9780742534117 (pbk. : alk. paper)"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "020": {
                              "subfields": [
                                  {
                                      "a": "0742534111 (pbk. : alk. paper)"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "035": {
                              "subfields": [
                                  {
                                      "a": "(OCoLC)ocn156874791"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "035": {
                              "subfields": [
                                  {
                                      "a": "(OCoLC)156874791"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "035": {
                              "subfields": [
                                  {
                                      "a": "2182389"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "040": {
                              "subfields": [
                                  {
                                      "a": "DLC"
                                  },
                                  {
                                      "c": "DLC"
                                  },
                                  {
                                      "d": "BTCTA"
                                  },
                                  {
                                      "d": "BAKER"
                                  },
                                  {
                                      "d": "C#P"
                                  },
                                  {
                                      "d": "YDXCP"
                                  },
                                  {
                                      "d": "IXA"
                                  },
                                  {
                                      "d": "UtOrBLW"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "043": {
                              "subfields": [
                                  {
                                      "a": "e-fr---"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "049": {
                              "subfields": [
                                  {
                                      "a": "ALMM"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "050": {
                              "subfields": [
                                  {
                                      "a": "DC149"
                                  },
                                  {
                                      "b": ".N44 2008"
                                  }
                              ],
                              "ind1": "0",
                              "ind2": "0"
                          }
                      },
                      {
                          "082": {
                              "subfields": [
                                  {
                                      "a": "944.04"
                                  },
                                  {
                                      "2": "22"
                                  }
                              ],
                              "ind1": "0",
                              "ind2": "0"
                          }
                      },
                      {
                          "100": {
                              "subfields": [
                                  {
                                      "a": "Neely, Sylvia."
                                  },
                                  {
                                      "0": "http://id.loc.gov/authorities/names/n90717906"
                                  }
                              ],
                              "ind1": "1",
                              "ind2": " "
                          }
                      },
                      {
                          "245": {
                              "subfields": [
                                  {
                                      "a": "A concise history of the French Revolution /"
                                  },
                                  {
                                      "c": "Sylvia Neely."
                                  }
                              ],
                              "ind1": "1",
                              "ind2": "2"
                          }
                      },
                      {
                          "264": {
                              "subfields": [
                                  {
                                      "a": "Lanham :"
                                  },
                                  {
                                      "b": "Rowman & Littlefield Publishers,"
                                  },
                                  {
                                      "c": "[2008]"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": "1"
                          }
                      },
                      {
                          "264": {
                              "subfields": [
                                  {
                                      "a": "Lanham :"
                                  },
                                  {
                                      "b": "Distributed by National Book Network"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": "2"
                          }
                      },
                      {
                          "264": {
                              "subfields": [
                                  {
                                      "c": "\u00a92008"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": "4"
                          }
                      },
                      {
                          "300": {
                              "subfields": [
                                  {
                                      "a": "xvii, 287 pages :"
                                  },
                                  {
                                      "b": "illustrations, maps ;"
                                  },
                                  {
                                      "c": "24 cm."
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "336": {
                              "subfields": [
                                  {
                                      "a": "text"
                                  },
                                  {
                                      "b": "txt"
                                  },
                                  {
                                      "2": "rdacontent"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "337": {
                              "subfields": [
                                  {
                                      "a": "unmediated"
                                  },
                                  {
                                      "b": "n"
                                  },
                                  {
                                      "2": "rdamedia"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "338": {
                              "subfields": [
                                  {
                                      "a": "volume"
                                  },
                                  {
                                      "b": "nc"
                                  },
                                  {
                                      "2": "rdacarrier"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "490": {
                              "subfields": [
                                  {
                                      "a": "Critical issues in history"
                                  }
                              ],
                              "ind1": "1",
                              "ind2": " "
                          }
                      },
                      {
                          "504": {
                              "subfields": [
                                  {
                                      "a": "Includes bibliographical references (p. 267-274) and index."
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "505": {
                              "subfields": [
                                  {
                                      "a": "The Ancien Re\u0301gime, its critics and supporters -- The financial crisis -- The Estates General and the General Assembly -- Creating the new regime -- Polarization and the flight to Varennes -- The failure of constitutional government -- The Convention -- Terror and war -- Thermidor and the Directory."
                                  }
                              ],
                              "ind1": "0",
                              "ind2": " "
                          }
                      },
                      {
                          "651": {
                              "subfields": [
                                  {
                                      "a": "France"
                                  },
                                  {
                                      "x": "History"
                                  },
                                  {
                                      "y": "Revolution, 1789-1799."
                                  },
                                  {
                                      "0": "http://id.loc.gov/authorities/subjects/sh85051319"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": "0"
                          }
                      },
                      {
                          "830": {
                              "subfields": [
                                  {
                                      "a": "Critical issues in history."
                                  },
                                  {
                                      "0": "http://id.loc.gov/authorities/names/n99002874"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": "0"
                          }
                      },
                      {
                          "938": {
                              "subfields": [
                                  {
                                      "a": "Baker & Taylor"
                                  },
                                  {
                                      "b": "BKTY"
                                  },
                                  {
                                      "c": "24.95"
                                  },
                                  {
                                      "d": "18.71"
                                  },
                                  {
                                      "i": "0742534103"
                                  },
                                  {
                                      "n": "0007433208"
                                  },
                                  {
                                      "s": "active"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "938": {
                              "subfields": [
                                  {
                                      "a": "YBP Library Services"
                                  },
                                  {
                                      "b": "YANK"
                                  },
                                  {
                                      "n": "2612951"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "938": {
                              "subfields": [
                                  {
                                      "a": "Baker & Taylor"
                                  },
                                  {
                                      "b": "BKTY"
                                  },
                                  {
                                      "c": "22.95"
                                  },
                                  {
                                      "d": "22.95"
                                  },
                                  {
                                      "i": "0742534111"
                                  },
                                  {
                                      "n": "0007618566"
                                  },
                                  {
                                      "s": "active"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "938": {
                              "subfields": [
                                  {
                                      "a": "Baker and Taylor"
                                  },
                                  {
                                      "b": "BTCP"
                                  },
                                  {
                                      "n": "BK0007618566"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "994": {
                              "subfields": [
                                  {
                                      "a": "C0"
                                  },
                                  {
                                      "b": "ALM"
                                  }
                              ],
                              "ind1": " ",
                              "ind2": " "
                          }
                      },
                      {
                          "999": {
                              "subfields": [
                                  {
                                      "i": "482b0d18-39dc-480d-80b4-746e87efd4e8"
                                  },
                                  {
                                      "s": "75fc92ce-fe40-4515-949e-076394aedb7f"
                                  }
                              ],
                              "ind1": "f",
                              "ind2": "f"
                          }
                      }
                  ]
              }
          },
          "additionalInfo": {
              "suppressDiscovery": false
          },
          "externalIdsHolder": {
              "instanceId": "482b0d18-39dc-480d-80b4-746e87efd4e8"
          },
          "metadata": {
              "createdDate": "2020-09-03T07:47:40.097",
              "createdByUserId": "d916e883-f8f1-4188-bc1d-f0dce1511b50",
              "updatedDate": "2020-09-03T07:47:40.097",
              "updatedByUserId": "d916e883-f8f1-4188-bc1d-f0dce1511b50"
          },
          "state": "ACTUAL",
          "leaderRecordStatus": "c"
      }
      

      The Instance

      {
          "id": "482b0d18-39dc-480d-80b4-746e87efd4e8",
          "hrid": "2182389",
          "source": "MARC",
          "title": "A concise history of the French Revolution / Sylvia Neely.",
          "indexTitle": "Concise history of the French Revolution /",
          "alternativeTitles": [],
          "editions": [],
          "series": [
              "Critical issues in history."
          ],
          "identifiers": [
              {
                  "value": "2007029526",
                  "identifierTypeId": "c858e4f2-2b6b-4385-842b-60732ee14abb"
              },
              {
                  "value": "9780742534100 (cloth : alk. paper)",
                  "identifierTypeId": "8261054f-be78-422d-bd51-4ed9f33c3422"
              },
              {
                  "value": "0742534103 (cloth : alk. paper)",
                  "identifierTypeId": "8261054f-be78-422d-bd51-4ed9f33c3422"
              },
              {
                  "value": "9780742534117 (pbk. : alk. paper)",
                  "identifierTypeId": "8261054f-be78-422d-bd51-4ed9f33c3422"
              },
              {
                  "value": "0742534111 (pbk. : alk. paper)",
                  "identifierTypeId": "8261054f-be78-422d-bd51-4ed9f33c3422"
              },
              {
                  "value": "(OCoLC)ocn156874791",
                  "identifierTypeId": "439bfbae-75bc-4f74-9fc7-b2a2d47ce3ef"
              },
              {
                  "value": "(OCoLC)156874791",
                  "identifierTypeId": "439bfbae-75bc-4f74-9fc7-b2a2d47ce3ef"
              },
              {
                  "value": "2182389",
                  "identifierTypeId": "7e591197-f335-4afb-bc6d-a6d76ca3bace"
              }
          ],
          "contributors": [
              {
                  "name": "Neely, Sylvia",
                  "contributorNameTypeId": "2b94c631-fca9-4892-a730-03ee529ffe2a",
                  "primary": true
              }
          ],
          "subjects": [
              "France--History--Revolution, 1789-1799"
          ],
          "classifications": [
              {
                  "classificationNumber": "DC149 .N44 2008",
                  "classificationTypeId": "ce176ace-a53e-4b4d-aa89-725ed7b2edac"
              },
              {
                  "classificationNumber": "944.04",
                  "classificationTypeId": "42471af9-7d25-4f3a-bf78-60d29dcf463b"
              }
          ],
          "publication": [
              {
                  "publisher": "Rowman & Littlefield Publishers",
                  "place": "Lanham",
                  "dateOfPublication": "[2008]",
                  "role": "Publication"
              },
              {
                  "publisher": "Distributed by National Book Network",
                  "place": "Lanham",
                  "role": "Distribution"
              },
              {
                  "dateOfPublication": "©2008"
              }
          ],
          "publicationFrequency": [],
          "publicationRange": [],
          "electronicAccess": [],
          "instanceTypeId": "6312d172-f0cf-40f6-b27d-9fa8feaf332f",
          "instanceFormatIds": [
              "8d511d33-5e85-4c5d-9bce-6e3c9cd0c324"
          ],
          "instanceFormats": [],
          "physicalDescriptions": [
              "xvii, 287 pages : illustrations, maps ; 24 cm."
          ],
          "languages": [
              "eng"
          ],
          "notes": [
              {
                  "note": "Includes bibliographical references (p. 267-274) and index",
                  "staffOnly": false,
                  "instanceNoteTypeId": "86b6e817-e1bc-42fb-bab0-70e7547de6c1"
              },
              {
                  "note": "The Ancien Regime, its critics and supporters -- The financial crisis -- The Estates General and the General Assembly -- Creating the new regime -- Polarization and the flight to Varennes -- The failure of constitutional government -- The Convention -- Terror and war -- Thermidor and the Directory",
                  "staffOnly": false,
                  "instanceNoteTypeId": "5ba8e385-0e27-462e-a571-ffa1fa34ea54"
              }
          ],
          "modeOfIssuanceId": "9d18a02f-5897-4c31-9106-c9abb5c7ae8b",
          "discoverySuppress": false,
          "statisticalCodeIds": [],
          "tags": {
              "tagList": []
          },
          "metadata": {
              "createdDate": "2020-09-03T07:47:40.091+0000",
              "createdByUserId": "d916e883-f8f1-4188-bc1d-f0dce1511b50",
              "updatedDate": "2020-11-09T18:56:07.424+0000",
              "updatedByUserId": "2a2ae8b6-770b-40f0-b4d8-74d7c117a75d"
          },
          "holdingsRecords2": [],
          "natureOfContentTermIds": []
      }
      

      TestRail: Results

        Attachments

          Issue Links

            Activity

              People

                Igor_Gorchakov Igor Gorchakov
                ttolstoy Theodor Tolstoy
                Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved:

                  TestRail: Runs

                    TestRail: Cases