Uploaded image for project: 'StreamSets Data Collector'
  1. StreamSets Data Collector
  2. SDC-13913

Support 'fixed-type' annotations for Avro objects

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Open
    • Priority: P2 (Critical with Workaround)
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Testing Status:
      STF Testing Required
    • Team:
      Data Plane
    • Stage:
      Hadoop FS destination, Hadoop FS origin, Hadoop FS Standalone origin, Schema Generator processor

      Description

      Avro currently implements both 'bytes-type' and 'fixed-type' annotations[1] for a number of datatypes it supports. At the moment, SDC only supports 'bytes-type' annotation for any datatype, and implements an explicit failure for any others[2].

      We should be supporting both annotation types since we support Avro.

       

      [1] https://avro.apache.org/docs/1.8.1/spec.html#Decimal

      [2] https://github.com/streamsets/datacollector/blob/3.13/commonlib/src/main/java/com/streamsets/pipeline/lib/util/AvroTypeUtil.java#L203-L204 

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            mitch Mitch Barnett
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated: