Class Pipeline.ReadFromKafka

  • All Implemented Interfaces:
    Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    Enclosing class:
    Pipeline

    public static class Pipeline.ReadFromKafka
    extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,​org.apache.beam.sdk.values.PCollection<org.opennms.netmgt.flows.persistence.model.FlowDocument>>
    See Also:
    Serialized Form
    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        name, resourceHints
    • Constructor Summary

      Constructors 
      Constructor Description
      ReadFromKafka​(String bootstrapServers, String topic, Map<String,​Object> kafkaConsumerConfig, org.apache.beam.sdk.io.kafka.TimestampPolicyFactory<byte[],​org.opennms.netmgt.flows.persistence.model.FlowDocument> timestampPolicyFactory)  
    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.values.PCollection<org.opennms.netmgt.flows.persistence.model.FlowDocument> expand​(org.apache.beam.sdk.values.PBegin input)  
      static org.joda.time.Instant getTimestamp​(org.apache.beam.sdk.io.kafka.KafkaRecord<byte[],​org.opennms.netmgt.flows.persistence.model.FlowDocument> record)  
      static org.joda.time.Instant getTimestamp​(org.opennms.netmgt.flows.persistence.model.FlowDocument doc)  
      static long getTimestampMs​(org.opennms.netmgt.flows.persistence.model.FlowDocument doc)  
      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate
    • Constructor Detail

      • ReadFromKafka

        public ReadFromKafka​(String bootstrapServers,
                             String topic,
                             Map<String,​Object> kafkaConsumerConfig,
                             org.apache.beam.sdk.io.kafka.TimestampPolicyFactory<byte[],​org.opennms.netmgt.flows.persistence.model.FlowDocument> timestampPolicyFactory)
    • Method Detail

      • expand

        public org.apache.beam.sdk.values.PCollection<org.opennms.netmgt.flows.persistence.model.FlowDocument> expand​(org.apache.beam.sdk.values.PBegin input)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PBegin,​org.apache.beam.sdk.values.PCollection<org.opennms.netmgt.flows.persistence.model.FlowDocument>>
      • getTimestampMs

        public static long getTimestampMs​(org.opennms.netmgt.flows.persistence.model.FlowDocument doc)
      • getTimestamp

        public static org.joda.time.Instant getTimestamp​(org.apache.beam.sdk.io.kafka.KafkaRecord<byte[],​org.opennms.netmgt.flows.persistence.model.FlowDocument> record)
      • getTimestamp

        public static org.joda.time.Instant getTimestamp​(org.opennms.netmgt.flows.persistence.model.FlowDocument doc)