Package: catalog 0.1.1

catalog: Access the 'Spark Catalog' API via 'sparklyr'

Gain access to the 'Spark Catalog' API making use of the 'sparklyr' API. 'Catalog' <https://spark.apache.org/docs/2.4.3/api/java/org/apache/spark/sql/catalog/Catalog.html> is the interface for managing a metastore (aka metadata catalog) of relational entities (e.g. database(s), tables, functions, table columns and temporary views).

Authors:Nathan Eastwood [aut, cre]

catalog_0.1.1.tar.gz
catalog_0.1.1.zip(r-4.5)catalog_0.1.1.zip(r-4.4)catalog_0.1.1.zip(r-4.3)
catalog_0.1.1.tgz(r-4.5-any)catalog_0.1.1.tgz(r-4.4-any)catalog_0.1.1.tgz(r-4.3-any)
catalog_0.1.1.tar.gz(r-4.5-noble)catalog_0.1.1.tar.gz(r-4.4-noble)
catalog_0.1.1.tgz(r-4.4-emscripten)catalog_0.1.1.tgz(r-4.3-emscripten)
catalog.pdf |catalog.html
catalog/json (API)
NEWS

# Install 'catalog' in R:
install.packages('catalog', repos = c('https://nathaneastwood.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/nathaneastwood/catalog/issues

Pkgdown site:https://nathaneastwood.github.io

On CRAN:

Conda:

sparksparklyrsparklyr-extension

3.63 score 4 stars 16 scripts 1.3k downloads 1 mentions 21 exports 39 dependencies

Last updated 3 years agofrom:3421fdfcfe. Checks:9 OK. Indexed: yes.

TargetResultLatest binary
Doc / VignettesOKMar 09 2025
R-4.5-winOKMar 09 2025
R-4.5-macOKMar 09 2025
R-4.5-linuxOKMar 09 2025
R-4.4-winOKMar 09 2025
R-4.4-macOKMar 09 2025
R-4.4-linuxOKMar 09 2025
R-4.3-winOKMar 09 2025
R-4.3-macOKMar 09 2025

Exports:cache_tableclear_cachecreate_tablecurrent_databasedatabase_existsdrop_global_temp_viewdrop_temp_viewfunction_existsget_functionget_tableis_cachedlist_columnslist_databaseslist_functionslist_tablesrecover_partitionsrefresh_by_pathrefresh_tableset_current_databasetable_existsuncache_table

Dependencies:askpassblobclicodetoolsconfigcpp11curlDBIdbplyrdplyrfansigenericsglobalsgluehttrjsonlitelifecyclemagrittrmimeopensslpillarpkgconfigpurrrR6rlangrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml

Readme and manuals

Help Manual

Help pageTopics
Cache And Uncache Tablescache_table clear_cache is_cached uncache_table
Create A Tablecreate_table
Get The Current Databasecurrent_database
Check If A Database Existsdatabase_exists
Temporary Viewdrop_global_temp_view drop_temp_view
Check If A Function Existsfunction_exists
Get A Functionget_function
Get A Tableget_table
List Columnslist_columns
List Databaseslist_databases
List Functionslist_functions
List Tables In A Spark Connectionlist_tables
Refreshing Datarecover_partitions refresh refresh_by_path refresh_table
Set The Current Databaseset_current_database
Check If A Table Existstable_exists