Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-13283

Add reset origin to the HTTP Client polling process mode

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open
    • Priority: P4 (Minor Impact)
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: http
    • Labels:
    • Testing Status:
      Not Required
    • Team:
      Data Plane

      Description

      Poll processing mode for Http Origin re-pull the last page every time if it doesn't receive new data as part of its normal behavior. This request is to add a checkbox to reset origin each time it polls and stops without receiving new data for a while, so it would start from the beginning again instead of the last page.

      Note: Batch processing mode actually does that but it stops the pipeline. Instead, the idea is having a mechanism to do that automatically without stopping the pipeline.

       

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            danilo Danilo Viana
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: