Package org.apache.cassandra.spark.bulkwriter

Class CassandraJobInfo

java.lang.Object

org.apache.cassandra.spark.bulkwriter.CassandraJobInfo

All Implemented Interfaces:

JobInfo

public class CassandraJobInfo
extends java.lang.Object
implements JobInfo

Field Summary

Fields

Modifier and Type	Field	Description
protected BulkSparkConf	conf
protected MultiClusterContainer<java.util.UUID>	restoreJobIds
protected TokenPartitioner	tokenPartitioner

Constructor Summary

Constructors

Constructor	Description
CassandraJobInfo(BroadcastableJobInfo broadcastable)	Reconstruct from BroadcastableJobInfo on executor.
CassandraJobInfo(BulkSparkConf conf, MultiClusterContainer<java.util.UUID> restoreJobIds, TokenPartitioner tokenPartitioner)

Method Summary

Modifier and Type	Method	Description
CoordinatedWriteConf	coordinatedWriteConf()
DigestAlgorithmSupplier	digestAlgorithmSupplier()
int	effectiveSidecarPort()
int	getCommitBatchSize()
int	getCommitThreadsPerInstance()
java.lang.String	getConfiguredJobId()	An optional unique identified supplied in spark configuration
ConsistencyLevel	getConsistencyLevel()
java.lang.String	getLocalDC()
java.util.UUID	getRestoreJobId()	return the identifier of the restore job created on Cassandra Sidecar
java.util.UUID	getRestoreJobId(java.lang.String clusterId)	Returns the restore job identifier on Cassandra Sidecar of the cluster identified by the clusterId The method should be called in the coordinated write code path.
boolean	getSkipClean()
TokenPartitioner	getTokenPartitioner()
double	importCoordinatorTimeoutMultiplier()
int	jobKeepAliveMinutes()
long	jobTimeoutSeconds()
org.apache.cassandra.spark.data.QualifiedTableName	qualifiedTableName()
boolean	skipExtendedVerify()
int	sstableDataSizeInMiB()
DataTransportInfo	transportInfo()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.cassandra.spark.bulkwriter.JobInfo

getId, isCoordinatedWriteEnabled

Field Detail

conf

protected final BulkSparkConf conf

restoreJobIds

protected final MultiClusterContainer<java.util.UUID> restoreJobIds

tokenPartitioner

protected final TokenPartitioner tokenPartitioner

Constructor Detail

CassandraJobInfo

public CassandraJobInfo(BulkSparkConf conf,
                        MultiClusterContainer<java.util.UUID> restoreJobIds,
                        TokenPartitioner tokenPartitioner)

CassandraJobInfo

public CassandraJobInfo(BroadcastableJobInfo broadcastable)

Reconstruct from BroadcastableJobInfo on executor. Reuses conf and restoreJobIds from broadcast, and reconstructs TokenPartitioner from broadcastable partition mappings.

Parameters:

broadcastable - the broadcastable job info from broadcast

Method Detail

getConsistencyLevel

public ConsistencyLevel getConsistencyLevel()

Specified by:

getConsistencyLevel in interface JobInfo

getLocalDC

public java.lang.String getLocalDC()

Specified by:

getLocalDC in interface JobInfo

sstableDataSizeInMiB

public int sstableDataSizeInMiB()

Specified by:

sstableDataSizeInMiB in interface JobInfo

Returns:

the max sstable data file size in mebibytes

getCommitBatchSize

public int getCommitBatchSize()

Specified by:

getCommitBatchSize in interface JobInfo

skipExtendedVerify

public boolean skipExtendedVerify()

Specified by:

skipExtendedVerify in interface JobInfo

getSkipClean

public boolean getSkipClean()

Specified by:

getSkipClean in interface JobInfo

transportInfo

public DataTransportInfo transportInfo()

Specified by:

transportInfo in interface JobInfo

jobKeepAliveMinutes

public int jobKeepAliveMinutes()

Specified by:

jobKeepAliveMinutes in interface JobInfo

Returns:

job keep alive time in minutes

jobTimeoutSeconds

public long jobTimeoutSeconds()

Specified by:

jobTimeoutSeconds in interface JobInfo

Returns:

job timeout in seconds; see WriterOptions.JOB_TIMEOUT_SECONDS

effectiveSidecarPort

public int effectiveSidecarPort()

Specified by:

effectiveSidecarPort in interface JobInfo

Returns:

sidecar service port

importCoordinatorTimeoutMultiplier

public double importCoordinatorTimeoutMultiplier()

Specified by:

importCoordinatorTimeoutMultiplier in interface JobInfo

Returns:

multiplier to calculate the final timeout for import coordinator

coordinatedWriteConf

@Nullable
public CoordinatedWriteConf coordinatedWriteConf()

Specified by:

coordinatedWriteConf in interface JobInfo

Returns:

CoordinatedWriteConf if configured, null otherwise

getCommitThreadsPerInstance

public int getCommitThreadsPerInstance()

Specified by:

getCommitThreadsPerInstance in interface JobInfo

getRestoreJobId

public java.util.UUID getRestoreJobId()

Description copied from interface: JobInfo

return the identifier of the restore job created on Cassandra Sidecar

Specified by:

getRestoreJobId in interface JobInfo

Returns:

time-based uuid

getRestoreJobId

public java.util.UUID getRestoreJobId(@Nullable
                                      java.lang.String clusterId)

Description copied from interface: JobInfo

Returns the restore job identifier on Cassandra Sidecar of the cluster identified by the clusterId The method should be called in the coordinated write code path.

Specified by:

getRestoreJobId in interface JobInfo

Parameters:

clusterId - identifies the Cassandra cluster

Returns:

restore job identifier, a time-based uuid

getConfiguredJobId

public java.lang.String getConfiguredJobId()

Description copied from interface: JobInfo

An optional unique identified supplied in spark configuration

Specified by:

getConfiguredJobId in interface JobInfo

Returns:

a id string or null

getTokenPartitioner

public TokenPartitioner getTokenPartitioner()

Specified by:

getTokenPartitioner in interface JobInfo

digestAlgorithmSupplier

@NotNull
public DigestAlgorithmSupplier digestAlgorithmSupplier()

Specified by:

digestAlgorithmSupplier in interface JobInfo

Returns:

the digest type provider for the bulk job, and used to calculate digests for SSTable components

qualifiedTableName

@NotNull
public org.apache.cassandra.spark.data.QualifiedTableName qualifiedTableName()

Specified by:

qualifiedTableName in interface JobInfo