org.apache.spark.sql.parquet

Class CatalystStructConverter

Object

parquet.io.api.Converter

parquet.io.api.GroupConverter

org.apache.spark.sql.parquet.CatalystConverter

org.apache.spark.sql.parquet.CatalystGroupConverter

org.apache.spark.sql.parquet.CatalystStructConverter

public class CatalystStructConverter
extends CatalystGroupConverter

This converter is for multi-element groups of primitive or complex types that have repetition level optional or required (so struct fields).

Constructor Summary

Constructors

Constructor and Description
CatalystStructConverter(StructField[] schema, int index, CatalystConverter parent)

Method Summary

Methods

Modifier and Type	Method and Description
void	end()

Methods inherited from class org.apache.spark.sql.parquet.CatalystGroupConverter

getConverter, getCurrentRecord, size, start

Methods inherited from class org.apache.spark.sql.parquet.CatalystConverter

ARRAY_CONTAINS_NULL_BAG_SCHEMA_NAME, ARRAY_ELEMENTS_SCHEMA_NAME, MAP_KEY_SCHEMA_NAME, MAP_SCHEMA_NAME, MAP_VALUE_SCHEMA_NAME, THRIFT_ARRAY_ELEMENTS_SCHEMA_NAME_SUFFIX

Methods inherited from class parquet.io.api.GroupConverter

asGroupConverter, isPrimitive

Methods inherited from class parquet.io.api.Converter

asPrimitiveConverter

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CatalystStructConverter

public CatalystStructConverter(StructField[] schema,
                       int index,
                       CatalystConverter parent)

Method Detail

end

public void end()

Overrides:

end in class CatalystGroupConverter