Packages

package hadoop

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. Protected

Package Members

  1. package parquet

Type Members

  1. case class FileStaging(stagingPath: String, destinationPath: String) extends Product with Serializable
  2. class HadoopFileStorage[P] extends TwoPhaseCommitBatchStorage[PartitionedFileRecordBatch[P, FileRecordBatch], MultiFileStaging]

    A Hadoop compatible file system based storage, most likely used for storing to HDFS.

    A Hadoop compatible file system based storage, most likely used for storing to HDFS. Stores files and commits offsets to Kafka in a two-phase transaction. The prepare/commit phases for storing a file consist of first uploading it to a staging path and later atomically moving it to the final destination path.

  3. case class MultiFileStaging(fileStagings: Seq[FileStaging]) extends Product with Serializable

Value Members

  1. object HadoopFileStorage
  2. object MultiFileStaging extends Serializable

Ungrouped