S4 class that represents a AFTSurvivalRegressionModel
S4 class that represents a BisectingKMeansModel
S4 class that represents a DecisionTreeClassificationModel
S4 class that represents a DecisionTreeRegressionModel
S4 class that represents a FMClassificationModel
S4 class that represents a FMRegressionModel
S4 class that represents a FPGrowthModel
S4 class that represents a GBTClassificationModel
S4 class that represents a GBTRegressionModel
S4 class that represents a GaussianMixtureModel
S4 class that represents a generalized linear model
S4 class that represents an IsotonicRegressionModel
S4 class that represents a LinearRegressionModel
S4 class that represents an LinearSVCModel
S4 class that represents an LogisticRegressionModel
S4 class that represents a MultilayerPerceptronClassificationModel
S4 class that represents a NaiveBayesModel
S4 class that represents a PowerIterationClustering
S4 class that represents a RandomForestClassificationModel
S4 class that represents a RandomForestRegressionModel
S4 class that represents a SparkDataFrame
S4 class that represents a StreamingQuery
Add a tag to be assigned to all the jobs started by this thread.
Calculates the approximate quantiles of numerical columns of a SparkDataFrame
Download data from a SparkDataFrame into a R data.frame
Cancel active jobs for the specified group
Cancel active jobs that have the specified tag.
Casts the column to a different data type.
Clear current job group ID and its description
Collects all the elements of a SparkDataFrame and coerces them into an R data.frame.
S4 class that represents a SparkDataFrame column
Aggregate functions for Column operations
Avro processing functions for Column operations
Collection functions for Column operations
Date time arithmetic functions for Column operations
Date time functions for Column operations
Miscellaneous functions for Column operations
Non-aggregate functions for Column operations
A set of operations working with SparkDataFrame columns
Creates a temporary view using the given name.
Creates a table based on the dataset in a data source
Create o.a.s.sql.expressions.LambdaFunction corresponding to transformation described by func. Used by higher order functions.
Computes a pair-wise frequency table of the given columns
Checks if the database with the specified name exists.
Returns the dimensions of SparkDataFrame
Drops the temporary view with the given view name in the catalog.
Return the first row of a SparkDataFrame
Finding frequent items for columns, possibly with false positives
Checks if the function with the specified name exists.
Get the database with the specified name
Get the function with the specified name
Get the tags that are currently set to be assigned to all the jobs started by this thread.
Get a local property set in this thread, or 'NULL' if it is missing. See 'setLocalProperty'.
Compute histogram statistics for given column
Download and Install Apache Spark to a Local Directory
Invokes higher order function expression identified by name, (relative to o.a.s.sql.catalyst.expressions)
Returns a list of columns for the given table/view in the specified database
Returns a list of functions registered in the specified database
Returns a list of tables or views in the specified database
A set of SparkDataFrame functions working with NA values
Returns the number of columns in a SparkDataFrame
Returns the number of rows in a SparkDataFrame
Pivot a column of the GroupedData and perform the specified aggregation.
Create a SparkDataFrame representing the database table accessible via JDBC URL
Create a SparkDataFrame from a JSON file.
Load a fitted MLlib model from the input path.
Create a SparkDataFrame from an ORC file.
Create a SparkDataFrame from a Parquet file.
Create a SparkDataFrame from a text file.
Recovers all the partitions in the directory of a table and update the catalog
Invalidates and refreshes all the cached data and metadata for SparkDataFrame containing path
Invalidates and refreshes all the cached data and metadata of the given table
Remove a tag previously added to be assigned to all the jobs started by this thread. Noop if such a tag was not added earlier.
Returns a stratified sample without replacement
Save the contents of the SparkDataFrame to a data source as a table
Set the behavior of job cancellation from jobs started in this thread.
Set a human readable description of the current job.
Assigns a group ID to all the jobs started by this thread until the group ID is set to a different value or cleared.
Set a local property that affects jobs submitted from this thread, such as the Spark fair scheduler pool.
Add a file or directory to be downloaded with this Spark job on every node.
Alternating Least Squares (ALS) for Collaborative Filtering
Decision Tree Model for Regression and Classification
Multivariate Gaussian Mixture Model (GMM)
Gradient Boosted Tree Model for Regression and Classification
Get the absolute path of a file added through spark.addFile.
Get the root directory that contains files added through spark.addFile.
Run a function over a list of elements, distributing the computations with Spark
Random Forest Model for Regression and Classification
Accelerated Failure Time (AFT) Survival Regression Model
Get Runtime Config from the current active SparkSession
(Deprecated) Initialize a new Spark Context
Get the existing SparkSession or initialize a new SparkSession.
Stop the Spark Session and Spark Context
Get the URL of the SparkUI instance for the current active SparkSession
Get version of Spark on which this application is running
(Deprecated) Initialize a new HiveContext
(Deprecated) Initialize a new SQLContext
Compactly display the structure of a dataset
Checks if the table with the specified name exists.
Create a SparkDataFrame from a SparkSQL table or view
Take the first NUM rows of a SparkDataFrame and return the results as a R data.frame
Return a new SparkDataFrame containing the union of rows
Return a new SparkDataFrame containing the union of rows.
Return a new SparkDataFrame containing the union of rows, matched by column names
Unpivot a DataFrame from wide format to long format.
Create o.a.s.sql.expressions.UnresolvedNamedLambdaVariable, convert it to o.s.sql.Column and wrap with R Column. Used by higher order functions.
Evaluate a R expression in an environment constructed from a SparkDataFrame
Save the contents of SparkDataFrame to a data source.
Save the content of SparkDataFrame to an external database table via JDBC.
Save the contents of SparkDataFrame as a JSON file
Save the contents of SparkDataFrame as an ORC file, preserving the schema.
Save the contents of SparkDataFrame as a Parquet file, preserving the schema.
Write the streaming SparkDataFrame to a data source.
Save the content of SparkDataFrame in a text file at the specified path.