org.apache.spark.sql

Class UserDefinedPythonFunction

Object

org.apache.spark.sql.UserDefinedPythonFunction

All Implemented Interfaces:

java.io.Serializable, scala.Equals, scala.Product

public class UserDefinedPythonFunction
extends Object
implements scala.Product, scala.Serializable

A user-defined Python function. To create one, use the pythonUDF functions in functions. This is used by Python API.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
UserDefinedPythonFunction(String name, byte[] command, java.util.Map<String,String> envVars, java.util.List<String> pythonIncludes, String pythonExec, java.util.List<Broadcast<org.apache.spark.api.python.PythonBroadcast>> broadcastVars, Accumulator<java.util.List<byte[]>> accumulator, DataType dataType)

Method Summary

Methods

Modifier and Type	Method and Description
Accumulator<java.util.List<byte[]>>	accumulator()
Column	apply(scala.collection.Seq<Column> exprs) Returns a Column that will evaluate to calling this UDF with the given input.
java.util.List<Broadcast<org.apache.spark.api.python.PythonBroadcast>>	broadcastVars()
byte[]	command()
DataType	dataType()
java.util.Map<String,String>	envVars()
String	name()
String	pythonExec()
java.util.List<String>	pythonIncludes()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

UserDefinedPythonFunction

public UserDefinedPythonFunction(String name,
                         byte[] command,
                         java.util.Map<String,String> envVars,
                         java.util.List<String> pythonIncludes,
                         String pythonExec,
                         java.util.List<Broadcast<org.apache.spark.api.python.PythonBroadcast>> broadcastVars,
                         Accumulator<java.util.List<byte[]>> accumulator,
                         DataType dataType)

Method Detail

name

public String name()

command

public byte[] command()

envVars

public java.util.Map<String,String> envVars()

pythonIncludes

public java.util.List<String> pythonIncludes()

pythonExec

public String pythonExec()

broadcastVars

public java.util.List<Broadcast<org.apache.spark.api.python.PythonBroadcast>> broadcastVars()

accumulator

public Accumulator<java.util.List<byte[]>> accumulator()

dataType

public DataType dataType()

apply

public Column apply(scala.collection.Seq<Column> exprs)

Returns a Column that will evaluate to calling this UDF with the given input.