Uploaded image for project: 'SDC StreamSets Data Collector'
  1. SDC StreamSets Data Collector
  2. SDC-9081

MapR script: add a fallkback to create a symlink to hadoop-common jar

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Unassigned
    • Priority: P3 (Limited Impact)
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Doc Impact:
      No
    • Testing Status:
      Not Required

      Description

      MapR distribution has a symlink file /opt/mapr/lib/hadoop-common-2.7.0.jar which is pointing to /opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common/hadoop-common-2.7.0-mapr-*.jar. 

      For some reason, some environment don't have this symlink. While setup-mapr script creates symlinks from /opt/mapr/lib, it can't find hadoop-common-2.7.0.jar there so that will cause SDC not loading hadoop-common jar. This problem often appears as

      "NoClassDefFoundError: org/apache/hadoop/io/compress/GzipCode"

      while SDC starts up.

      As a fall back, we should symlink hadoop-common jar from /opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/common.

      Workaround is manually create a symlink or copy the jar to MapR stage lib folder. 

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              junko Junko Urata
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: