Uploaded image for project: 'Public StreamSets Data Collector'
  1. Public StreamSets Data Collector
  2. SDC-9216

Oracle CDC Origin: update commit offset when LogMiner window is moved forward

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: P2 (Critical with Workaround)
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4.0
    • Component/s: None
    • Labels:
    • Doc Impact:
      No
    • Testing Status:
      STF Testing Required

      Description

      Currently, the offset stores the timestamp from the last record. If the pipeline doesn't receive any record for some time, the pipeline is able to process the data while running. However, if restarting the pipeline, it could fail with an error if the logstash retention interval is shorter than the start time of  from the last record

        Attachments

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. SDC-9935 Oracle CDC Origin sometimes calculates logminer window start time incorrectly

          • P1 (Blocker) - This problem will block the release
          • Resolved

            Activity

              People

              Assignee:
              hshreedharan Hari Shreedharan (Inactive)
              Reporter:
              aneta Aneta Cechova
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: