class DerivedAvroParquetFileBuilder[R] extends AvroParquetFileBuilder[R]
Parquet writer that derives the Avro schema and encoder at compile time from the record type.
- Alphabetic
- By Inheritance
- DerivedAvroParquetFileBuilder
- AvroParquetFileBuilder
- BaseFileBuilder
- FileBuilder
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new DerivedAvroParquetFileBuilder(config: ParquetConfig = ParquetConfig())(implicit arg0: Encoder[R], arg1: Decoder[R], arg2: SchemaFor[R])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def build(): Option[File]
Builds a data file from all the added records and flushes it to disk.
Builds a data file from all the added records and flushes it to disk. The builder instance can no longer be used after calling this method.
- returns
The resulting file if any records were added, None otherwise.
- Definition Classes
- AvroParquetFileBuilder → BaseFileBuilder → FileBuilder
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- def createFile(): File
- Attributes
- protected
- Definition Classes
- AvroParquetFileBuilder → BaseFileBuilder
- def discard(): Unit
Discards the file currently being built and closes the builder.
Discards the file currently being built and closes the builder.
- Definition Classes
- AvroParquetFileBuilder → BaseFileBuilder → FileBuilder
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- lazy val file: File
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def getDataSize: Long
Gets the current size of the data added to the file.
Gets the current size of the data added to the file.
- Definition Classes
- AvroParquetFileBuilder → FileBuilder
- def getRecordCount: Long
Gets the count of records currently written to the file.
Gets the count of records currently written to the file.
- Definition Classes
- BaseFileBuilder → FileBuilder
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- var isClosed: Boolean
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val parquetWriter: ParquetWriter[GenericRecord]
- Attributes
- protected
- Definition Classes
- AvroParquetFileBuilder
- var recordsWritten: Long
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def write(record: R): Unit
Adds a record to the file.
Adds a record to the file.
- Definition Classes
- DerivedAvroParquetFileBuilder → BaseFileBuilder → FileBuilder