Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-14338

Field Mapper throws stage exception on invalid field path

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P2 (Critical with Workaround)
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.20.0
    • Component/s: sdc
    • Labels:
    • Testing Status:
      STF Testing Required
    • Team:
      Data Plane
    • Stage:
      Field Mapper processor
    • STF Test:

      Description

      When making use of the Field Mapper stage to generate a new child field path within a record, if the syntax of that child field path is invalid it generates a stage-level exception which fails the entire pipeline.

      Instead, it should generate a record-level exception and handle the record via the pipeline's configured "Error Record Handling".

      For example, if a Field Mapper is preceded by a parsing stage (Jython eval, Grok parser, etc.) which generates a value like:

      (/invalid.file/path'

      The Field Mapper stage throws a "java.lang.IllegalArgumentException: Invalid fieldPath" stage exception, which fails the entire pipeline. Instead, it should pass this particular record through to the error record handler and allow the pipeline to continue processing.

       

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              konstantin Konstantin Golub
              Reporter:
              mitch Mitch Barnett
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: