Home

Snapshots

Changelog

Highlights

sparklyr

R Interface to Apache Spark

R interface to Apache Spark, a fast and general engine for big data processing, see <http://spark.apache.org>. This package supports connecting to local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end, and provides an interface to Spark's built-in machine learning algorithms.

Tests Vignettes

Available Snapshots

This version of sparklyr can be found in the following snapshots:

Dependencies

Imports/Depends/LinkingTo/Enhances (20)
  • R
  • config >= 0.2
  • DBI >= 1.0.0
  • dbplyr >= 2.5.0
  • dplyr >= 1.0.9
  • generics
  • globals
  • glue
  • httr >= 1.2.1
  • jsonlite >= 1.4
  • openssl >= 0.8
  • purrr
  • rlang >= 0.1.4
  • rstudioapi >= 0.10
  • tidyr >= 1.2.0
  • tidyselect
  • uuid
  • vctrs
  • withr
  • xml2
    • Suggests (18)
  • arrow >= 0.17.0
  • broom
  • diffobj
  • foreach
  • ggplot2
  • iterators
  • janeaustenr
  • Lahman
  • mlbench
  • nycflights13
  • R6
  • r2d3
  • RCurl
  • reshape2
  • shiny >= 1.0.1
  • parsnip
  • testthat
  • rprojroot

    • Version History