Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-7481

Spark Evaluator cluster mode hits NoClassDefFoundError on EscapeUtil

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P1 (Blocker)
    • Resolution: Fixed
    • Affects Version/s: 2.7.0.0
    • Fix Version/s: 3.0.0.0
    • Component/s: None
    • Labels:
      None
    • Doc Impact:
      No
    • Doc Impact Details:
      Spark cluster mode does not currently work when there is a Spark Evaluator in the pipeline.
    • Testing Status:
      Not Required

      Description

      This was broken by SDC-7091 since the common jar is not shipped to the driver. The RecordImpl#get() and RecordImpl#set methods call the EscapeUtil method. Originally this was in the container jar, which is in the classpath for the transformer.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              hshreedharan Hari Shreedharan
            • Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: