Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-3951

AWS Whole File Format throws Resetting to invalid mark error on Retry

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P1 (Blocker)
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Sprint:
      Sprint 39
    • Doc Impact:
      No

      Description

      The error happens when the S3Client tries to retry after a network glitch. Reported by Josh Andrews https://groups.google.com/a/streamsets.com/forum/?hl=en#!topic/sdc-user/nRXZfa_XIaQ

      Caused by: com.amazonaws.ResetException: Failed to reset the request input stream; If the request involves an input stream, the maximum stream buffer size can be configured via request.getRequestClientOptions().setReadLimit(int)
      at com.amazonaws.http.AmazonHttpClient.resetRequestInputStream(AmazonHttpClient.java:955)
      at com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:783)
      at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:607)
      at com.amazonaws.http.AmazonHttpClient.doExecute(AmazonHttpClient.java:376)
      at com.amazonaws.http.AmazonHttpClient.executeWithTimer(AmazonHttpClient.java:338)
      at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:287)
      at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3674)
      at com.amazonaws.services.s3.AmazonS3Client.doUploadPart(AmazonS3Client.java:2810)
      at com.amazonaws.services.s3.AmazonS3Client.uploadPart(AmazonS3Client.java:2795)
      at com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadPartsInSeries(UploadCallable.java:255)
      at com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInParts(UploadCallable.java:189)
      at com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:121)
      at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:139)
      at com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:47)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      ... 3 more
      Caused by: java.io.IOException: Resetting to invalid mark
      at java.io.BufferedInputStream.reset(BufferedInputStream.java:448)
      at com.amazonaws.internal.SdkBufferedInputStream.reset(SdkBufferedInputStream.java:106)
      at com.amazonaws.internal.SdkFilterInputStream.reset(SdkFilterInputStream.java:102)
      at com.amazonaws.event.ProgressInputStream.reset(ProgressInputStream.java:139)
      at com.amazonaws.internal.SdkFilterInputStream.reset(SdkFilterInputStream.java:102)
      at com.amazonaws.http.AmazonHttpClient.resetRequestInputStream(AmazonHttpClient.java:953)
      ... 17 more

        Attachments

          Activity

            People

            • Assignee:
              santhosh Santhosh Kumar
              Reporter:
              santhosh Santhosh Kumar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: