


Only Column but also other types such as a native string. This function APIs usually have methods with Column signature only because it can support not To invoke it, use expr("regr_count(圜ol, xCol)"). Regr_count is an example of a function that is built-in but not defined here, because it is In this case, Spark itself will ensure isnan exists when it analyzes the query.

You can also use expr("isnan(m圜ol)") function to invoke the This way the programming language's compiler ensures isnanĮxists and is of the proper form. You can find the entire list of functionsĪs an example, isnan is a function that is defined here. You can still access them (and all the functions defined here) using the functions.expr() APIĪnd calling them through a SQL expression string. Spark also includes more built-in functions that are less common and are not defined here. Using functions defined here providesĪ little bit more compile-time safety to make sure the function exists. Commonly used functions available for DataFrame operations.
