Package: catalog 0.1.1

catalog: Access the 'Spark Catalog' API via 'sparklyr'

Gain access to the 'Spark Catalog' API making use of the 'sparklyr' API. 'Catalog' <https://spark.apache.org/docs/2.4.3/api/java/org/apache/spark/sql/catalog/Catalog.html> is the interface for managing a metastore (aka metadata catalog) of relational entities (e.g. database(s), tables, functions, table columns and temporary views).

Authors:Nathan Eastwood [aut, cre]

catalog_0.1.1.tar.gz
catalog_0.1.1.zip(r-4.5)catalog_0.1.1.zip(r-4.4)catalog_0.1.1.zip(r-4.3)
catalog_0.1.1.tgz(r-4.4-any)catalog_0.1.1.tgz(r-4.3-any)
catalog_0.1.1.tar.gz(r-4.5-noble)catalog_0.1.1.tar.gz(r-4.4-noble)
catalog_0.1.1.tgz(r-4.4-emscripten)catalog_0.1.1.tgz(r-4.3-emscripten)
catalog.pdf |catalog.html
catalog/json (API)
NEWS

# Install 'catalog' in R:
install.packages('catalog', repos = c('https://nathaneastwood.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/nathaneastwood/catalog/issues

On CRAN:

sparksparklyrsparklyr-extension

3.58 score 3 stars 15 scripts 1.7k downloads 1 mentions 21 exports 39 dependencies

Last updated 2 years agofrom:3421fdfcfe. Checks:OK: 7. Indexed: yes.

TargetResultDate
Doc / VignettesOKNov 09 2024
R-4.5-winOKNov 09 2024
R-4.5-linuxOKNov 09 2024
R-4.4-winOKNov 09 2024
R-4.4-macOKNov 09 2024
R-4.3-winOKNov 09 2024
R-4.3-macOKNov 09 2024

Exports:cache_tableclear_cachecreate_tablecurrent_databasedatabase_existsdrop_global_temp_viewdrop_temp_viewfunction_existsget_functionget_tableis_cachedlist_columnslist_databaseslist_functionslist_tablesrecover_partitionsrefresh_by_pathrefresh_tableset_current_databasetable_existsuncache_table

Dependencies:askpassblobclicodetoolsconfigcpp11curlDBIdbplyrdplyrfansigenericsglobalsgluehttrjsonlitelifecyclemagrittrmimeopensslpillarpkgconfigpurrrR6rlangrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml

Readme and manuals

Help Manual

Help pageTopics
Cache And Uncache Tablescache_table clear_cache is_cached uncache_table
Create A Tablecreate_table
Get The Current Databasecurrent_database
Check If A Database Existsdatabase_exists
Temporary Viewdrop_global_temp_view drop_temp_view
Check If A Function Existsfunction_exists
Get A Functionget_function
Get A Tableget_table
List Columnslist_columns
List Databaseslist_databases
List Functionslist_functions
List Tables In A Spark Connectionlist_tables
Refreshing Datarecover_partitions refresh refresh_by_path refresh_table
Set The Current Databaseset_current_database
Check If A Table Existstable_exists