Package: catalog 0.1.1
catalog: Access the 'Spark Catalog' API via 'sparklyr'
Gain access to the 'Spark Catalog' API making use of the 'sparklyr' API. 'Catalog' <https://spark.apache.org/docs/2.4.3/api/java/org/apache/spark/sql/catalog/Catalog.html> is the interface for managing a metastore (aka metadata catalog) of relational entities (e.g. database(s), tables, functions, table columns and temporary views).
Authors:
catalog_0.1.1.tar.gz
catalog_0.1.1.zip(r-4.5)catalog_0.1.1.zip(r-4.4)catalog_0.1.1.zip(r-4.3)
catalog_0.1.1.tgz(r-4.4-any)catalog_0.1.1.tgz(r-4.3-any)
catalog_0.1.1.tar.gz(r-4.5-noble)catalog_0.1.1.tar.gz(r-4.4-noble)
catalog_0.1.1.tgz(r-4.4-emscripten)catalog_0.1.1.tgz(r-4.3-emscripten)
catalog.pdf |catalog.html✨
catalog/json (API)
NEWS
| # Install 'catalog' in R: |
| install.packages('catalog', repos = c('https://nathaneastwood.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/nathaneastwood/catalog/issues
sparksparklyrsparklyr-extension
Last updated 2 years agofrom:3421fdfcfe. Checks:OK: 7. Indexed: yes.
| Target | Result | Date |
|---|---|---|
| Doc / Vignettes | OK | Oct 10 2024 |
| R-4.5-win | OK | Oct 10 2024 |
| R-4.5-linux | OK | Oct 10 2024 |
| R-4.4-win | OK | Oct 10 2024 |
| R-4.4-mac | OK | Oct 10 2024 |
| R-4.3-win | OK | Oct 10 2024 |
| R-4.3-mac | OK | Oct 10 2024 |
Exports:cache_tableclear_cachecreate_tablecurrent_databasedatabase_existsdrop_global_temp_viewdrop_temp_viewfunction_existsget_functionget_tableis_cachedlist_columnslist_databaseslist_functionslist_tablesrecover_partitionsrefresh_by_pathrefresh_tableset_current_databasetable_existsuncache_table
Dependencies:askpassblobclicodetoolsconfigcpp11curlDBIdbplyrdplyrfansigenericsglobalsgluehttrjsonlitelifecyclemagrittrmimeopensslpillarpkgconfigpurrrR6rlangrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Cache And Uncache Tables | cache_table clear_cache is_cached uncache_table |
| Create A Table | create_table |
| Get The Current Database | current_database |
| Check If A Database Exists | database_exists |
| Temporary View | drop_global_temp_view drop_temp_view |
| Check If A Function Exists | function_exists |
| Get A Function | get_function |
| Get A Table | get_table |
| List Columns | list_columns |
| List Databases | list_databases |
| List Functions | list_functions |
| List Tables In A Spark Connection | list_tables |
| Refreshing Data | recover_partitions refresh refresh_by_path refresh_table |
| Set The Current Database | set_current_database |
| Check If A Table Exists | table_exists |
