package parquet
Type Members
- abstract class AvroParquetFileBuilder[R] extends BaseFileBuilder[R]
Base class for Avro based parquet file builders.
Base class for Avro based parquet file builders.
- R
type of the records being added.
- class DerivedAvroParquetFileBuilder[R] extends AvroParquetFileBuilder[R]
Parquet writer that derives the Avro schema and encoder at compile time from the record type.
- class GenericAvroParquetFileBuilder extends AvroParquetFileBuilder[GenericRecord]
A generic avro parquet writer that uses a user provider schema and accepts generic Avro records.
- case class ParquetConfig(compression: Option[Compression] = None, rowGroupSize: Option[Long] = None, pageSize: Option[Int] = None, pageRowCountLimit: Option[Int] = None, dictionaryPageSize: Option[Int] = None, writerVersion: Option[WriterVersion] = None, enableDictionaryEncoding: Option[Boolean] = None, enableBloomFilter: Option[Boolean] = None, enableByteStreamSplit: Option[Boolean] = None) extends Product with Serializable
- class ProtoParquetFileBuilder[R <: Message] extends BaseFileBuilder[R]
A parquet file writer that writes protobuf encoded messages.