org.apache.spark.sql.avro

Class AvroUtils.AvroSchemaHelper

Object

org.apache.spark.sql.avro.AvroUtils.AvroSchemaHelper

Enclosing class:

AvroUtils

public static class AvroUtils.AvroSchemaHelper
extends Object

Wraps an Avro Schema object so that field lookups are faster.

param: avroSchema The schema in which to search for fields. Must be of type RECORD. param: avroPath The seq of parent field names leading to avroSchema. param: positionalFieldMatch If true, perform field matching in a positional fashion (structural comparison between schemas, ignoring names); otherwise, perform field matching using field names.

Constructor Summary

Constructors

Constructor and Description
AvroSchemaHelper(org.apache.avro.Schema avroSchema, scala.collection.Seq<String> avroPath, boolean positionalFieldMatch)

Method Summary

Modifier and Type	Method and Description
scala.Option<org.apache.avro.Schema.Field>	getAvroField(String fieldName, int catalystPos) Get the Avro field corresponding to the provided Catalyst field name/position, if any.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AvroSchemaHelper

public AvroSchemaHelper(org.apache.avro.Schema avroSchema,
                        scala.collection.Seq<String> avroPath,
                        boolean positionalFieldMatch)

Method Detail

getAvroField

public scala.Option<org.apache.avro.Schema.Field> getAvroField(String fieldName,
                                                               int catalystPos)

Get the Avro field corresponding to the provided Catalyst field name/position, if any.