class ProtoParquetFileBuilder[R <: Message] extends BaseFileBuilder[R]
A parquet file writer that writes protobuf encoded messages.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- ProtoParquetFileBuilder
- BaseFileBuilder
- FileBuilder
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Instance Constructors
- new ProtoParquetFileBuilder(config: ParquetConfig)(implicit arg0: ClassTag[R])
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def build(): Option[File]
Builds a data file from all the added records and flushes it to disk.
Builds a data file from all the added records and flushes it to disk. The builder instance can no longer be used after calling this method.
- returns
The resulting file if any records were added, None otherwise.
- Definition Classes
- ProtoParquetFileBuilder → BaseFileBuilder → FileBuilder
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- def createFile(): File
- Attributes
- protected
- Definition Classes
- ProtoParquetFileBuilder → BaseFileBuilder
- def discard(): Unit
Discards the file currently being built and closes the builder.
Discards the file currently being built and closes the builder.
- Definition Classes
- ProtoParquetFileBuilder → BaseFileBuilder → FileBuilder
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- lazy val file: File
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def getDataSize: Long
Gets the current size of the data added to the file.
Gets the current size of the data added to the file.
- Definition Classes
- ProtoParquetFileBuilder → FileBuilder
- def getRecordCount: Long
Gets the count of records currently written to the file.
Gets the count of records currently written to the file.
- Definition Classes
- BaseFileBuilder → FileBuilder
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- var isClosed: Boolean
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- var recordsWritten: Long
- Attributes
- protected
- Definition Classes
- BaseFileBuilder
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def write(record: R): Unit
Adds a record to the file.
Adds a record to the file.
- Definition Classes
- ProtoParquetFileBuilder → BaseFileBuilder → FileBuilder