Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-10210

Kafka Consumer InterruptedException during pipeline validation

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: P3 (Limited Impact)
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0.0
    • Fix Version/s: None
    • Component/s: kafka
    • Labels:
      None
    • Environment:

      SSDC 3.1.0.0

      Kafka 1.0.0

    • Testing Status:
      Not Required

      Description

      Scenario:

      1) Start SDC

      2) Import pipeline with 3 stages: Kafka multi source origin -> Groovy Evaluator -> ToError

      3) Perform any update of Groove Script in Groovy Evaluator.

      Observation:

      In logs I can see exceptions related to KafkaMultiSource thread being interrupted. Also I can see that Kafka related threads are being created and deleted shortly. But some threads (kafka-coordinator-heartbeat-thread-* in my case) stay alive which is weird since I didn't even start my pipeline.

      For me it looks like after Groovy script change SDC performs pipeline validations which leads to Kafka consumer creation (to check topic existence) and deletion. Since it happens pretty fast some threads do not stop properly.

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            seolse Oleg Sergeev (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated: