Class MicroBatchIterator

  • All Implemented Interfaces:
    java.lang.AutoCloseable, java.util.Iterator<org.apache.cassandra.cdc.msg.CdcEvent>

    public class MicroBatchIterator
    extends java.lang.Object
    implements java.util.Iterator<org.apache.cassandra.cdc.msg.CdcEvent>, java.lang.AutoCloseable
    Iterator for reading a single CDC microbatch. Not thread safe, MicroBatchIterator should be initialized and consumed in a single thread.
    • Field Summary

      Fields 
      Modifier and Type Field Description
      protected CdcScannerBuilder builder  
      protected org.apache.cassandra.cdc.scanner.CdcStreamScanner scanner  
      protected org.apache.cassandra.bridge.TokenRange tokenRange  
    • Constructor Summary

      Constructors 
      Constructor Description
      MicroBatchIterator​(org.apache.cassandra.bridge.CdcBridge cdcBridge, int partitionId, org.apache.cassandra.bridge.TokenRange tokenRange, org.apache.cassandra.cdc.state.CdcState startState, org.apache.cassandra.cdc.api.CassandraSource cassandraSource, java.util.function.Supplier<java.util.Set<java.lang.String>> keyspaceSupplier, org.apache.cassandra.cdc.api.CdcOptions cdcOptions, org.apache.cassandra.spark.utils.AsyncExecutor asyncExecutor, CommitLogProvider commitLogProvider, org.apache.cassandra.cdc.stats.ICdcStats stats)  
      MicroBatchIterator​(org.apache.cassandra.bridge.CdcBridge cdcBridge, org.apache.cassandra.cdc.state.CdcState startState, org.apache.cassandra.cdc.api.CassandraSource cassandraSource, java.util.function.Supplier<java.util.Set<java.lang.String>> keyspaceSupplier, org.apache.cassandra.cdc.api.CdcOptions cdcOptions, org.apache.cassandra.spark.utils.AsyncExecutor asyncExecutor, CommitLogProvider commitLogProvider)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      void close()  
      org.apache.cassandra.cdc.state.CdcState endState()  
      boolean hasNext()  
      org.apache.cassandra.cdc.msg.CdcEvent next()  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
      • Methods inherited from interface java.util.Iterator

        forEachRemaining, remove
    • Field Detail

      • tokenRange

        @Nullable
        protected final org.apache.cassandra.bridge.TokenRange tokenRange
      • scanner

        protected final org.apache.cassandra.cdc.scanner.CdcStreamScanner scanner
    • Constructor Detail

      • MicroBatchIterator

        public MicroBatchIterator​(org.apache.cassandra.bridge.CdcBridge cdcBridge,
                                  org.apache.cassandra.cdc.state.CdcState startState,
                                  org.apache.cassandra.cdc.api.CassandraSource cassandraSource,
                                  java.util.function.Supplier<java.util.Set<java.lang.String>> keyspaceSupplier,
                                  org.apache.cassandra.cdc.api.CdcOptions cdcOptions,
                                  org.apache.cassandra.spark.utils.AsyncExecutor asyncExecutor,
                                  CommitLogProvider commitLogProvider)
      • MicroBatchIterator

        public MicroBatchIterator​(org.apache.cassandra.bridge.CdcBridge cdcBridge,
                                  int partitionId,
                                  @Nullable
                                  org.apache.cassandra.bridge.TokenRange tokenRange,
                                  org.apache.cassandra.cdc.state.CdcState startState,
                                  org.apache.cassandra.cdc.api.CassandraSource cassandraSource,
                                  java.util.function.Supplier<java.util.Set<java.lang.String>> keyspaceSupplier,
                                  org.apache.cassandra.cdc.api.CdcOptions cdcOptions,
                                  org.apache.cassandra.spark.utils.AsyncExecutor asyncExecutor,
                                  CommitLogProvider commitLogProvider,
                                  org.apache.cassandra.cdc.stats.ICdcStats stats)
                           throws org.apache.cassandra.spark.data.partitioner.NotEnoughReplicasException
        Throws:
        org.apache.cassandra.spark.data.partitioner.NotEnoughReplicasException
    • Method Detail

      • endState

        public org.apache.cassandra.cdc.state.CdcState endState()
      • hasNext

        public boolean hasNext()
        Specified by:
        hasNext in interface java.util.Iterator<org.apache.cassandra.cdc.msg.CdcEvent>
      • next

        public org.apache.cassandra.cdc.msg.CdcEvent next()
        Specified by:
        next in interface java.util.Iterator<org.apache.cassandra.cdc.msg.CdcEvent>
      • close

        public void close()
        Specified by:
        close in interface java.lang.AutoCloseable