Release Notes ============= v2.11.6 ------- * Fixed support for Kitchen Roles v2.11.5 ------- * Updated Order Run Monitor module to optionally accept Run Name attribute v2.11.4 ------- * Lock events-ingestion-client dependency to v1.x v2.11.3 ------- * Update events-ingestion-client dependency to v1.0.0 v2.11.2 ------- * Update events-ingestion-client dependency to v0.0.9 v2.11.1 ------- * Revert Order Run Monitor change to handle ingredients. Instead, disable monitoring for ingredient order runs. v2.11.0 ------- * Add order run external url to published events in the order run monitor * Order Run Monitor now handles ingredients by replacing the ingredient kitchen name in the pipeline_name with the parent kitchen name to associate events with the parent order run. * Update dependency events_ingestion_client to v0.0.8 v2.10.0 ------- * Nodes now always publish a STARTED task event in the OrderRunMonitor * Nodes now report correct elapsed run time in the OrderRunMonitor v2.9.6 ------ * Node start_time was not being updated properly in the OrderRunMonitor v2.9.5 ------ * Handle a platform bug where start_time may be None in the OrderRunMonitor v2.9.4 ------ * Bugfix start_time must be an int, not a string in the OrderRunMonitor v2.9.3 ------ * Bugfix to handle a start_time of 0 (i.e. 01/01/1970) in the OrderRunMonitor v2.9.2 ------ * Bugfix event timestamp in OrderRunMonitor v2.9.1 ------ * Bugfix to add setter to Node status in OrderRunMonitor v2.9.0 ------ * OrderRunMonitor now uses the node's start_time for the event_timestamp (previously it used datetime.now()) * OrderRunMonitor now publishes WARNING, ERROR, and CRITICAL log messages * OrderRunMonitor now publishes test results v2.8.0 ------ * Added testing and docstrings to OrderRunMonitor class * Order run id being used as the run_tag to events ingestion API requests in OrderRunMonitor * Added get_node_files method to Recipe class * Exposed events-ingestion-api host parameter in OrderRunMonitor class constructor v2.7.0 ------ * Added OrderRunMonitor class that publishes order run events to the Events Ingestion API. v2.6.0 ------ * Added DataKitchen API class for performing CRUD operations on vault. v2.5.0 ------ * Add retry decorator for retrying API requests that return an HTTP 50X error * Expose optional arguments in the DK Client get_order_run_details method * Add parent kitchen name and is ingredient kitchen methods to Kitchen class v2.4.1 ------ * Downgrade sqlalchemy dependency to 1.4.27 to resolve conflict when installing DKUtils in Google Composer. v2.4.0 ------ * Add get/add/delete/update kitchen staff/roles functions to DataKitchenClient. * Update docstrings in Recipe class. v2.3.1 ------ * Update paramiko package to v2.10.4 to address vulnerability found in versions <=2.10.1 v2.3.0 ------ * Added new Recipe class to DataKitchenClient * Added create and delete recipes to Recipe class * Added get, update, and delete recipe files to Recipe class v2.2.0 ------- * Added new Kitchen class to DataKitchenClient * Added create and delete kitchens to Kitchen class * Added get, create, and delete alerts to Kitchen class v2.1.0 ------- * Add additional parameter to constructor for DataKitchenClient to indicate username and password are API Token v2.0.0 ------- * Add DataFrameWrapper Class that facilitates running a query in a database via a Pandas Dataframe and then writing the data to files. v1.12.1 ------- * Add filename and cid when creating message with attachments v1.12.0 ------- * Add function create_message in sender module for creating email messages * Add SMTP_Sender class for sending email messages via SMTP v1.11.0 ------- * Updated Documentation and added a Jupyter notebook with DataKitchenClient examples * Added delete_order_run and get_kitchens to DataKitchenClient v1.10.0 ------- * Added stop_on_error argument to DataKitchenClient's create_and_monitor_orders and resume_and_monitor_orders methods. v1.9.0 ------ * Add DataKitchenClient methods to get and delete orders in a kitchen. * Add DataKitchenClient method to get recipe contents. * Add functions for extracting tests and test metadata from recipes. v1.8.2 ------ * Fix a problem in the GMailClient that was causing excel spreadsheets sent as attachments to be corrupted. v1.8.1 ------ * Update setup.py and docs in preparation for move to public repository v1.8.0 ------ * Add gmail_api v1.7.1 ------ * Standardize logging * Remove redundant log message in DataKithenClient _api_request * Do not log response content when validating or refreshing a token - these exceptions are already handled properly v1.7.0 ------ * Log response content when a request to the DataKitchen REST API fails v1.6.0 ------- * Add run_subscription_job function v1.5.0 ------- * Add create_veeva_network_subscription_client function v1.4.0 ------- * Add api for veeva network v1.3.3 ------- * Upgrade pandas requirement to >=1.1.2 to fix test failure v1.3.2 ------- * Fix bug in add_kitchen_staff v1.3.1 ------- * Properly add dependencies to setup.py so they are installed when this package is pip installed v1.3.0 ------- * Added set_logging_level function v1.2.0 ------- * Added get_globals_config function v1.1.0 ------- * Added Alteryx Gallery API client v1.0.1 ------ * Bugfix RemoteClient bulk upload to resolve remote path issue v1.0.0 ------ * Add bulk download method to RemoteClient * Move remote path from RemoteClient constructor to bulk upload & download methods v0.16.0 ------- * Add option to stream logs to RemoteClient commands execution v0.15.0 ------- * Change URL used by get_recipes function v0.14.0 ------- * Added RemoteClient module which can be used execute commands and upload files to a server using ssh v0.13.0 ------- * Add DataKitchenClient function get_variations v0.12.0 ------- * Add DataKitchenClient function get_order_status v0.11.0 ------- * Add additional check to validate kitchen, recipe, orders combination * Add function get_recipes v0.10.2 ------- * Added additional check to validate_globals to check that values that should be changed have been v0.10.1 ------- * Added JIRA API client v0.10.0 ------- * PACKAGE REMOVED FROM PYPI - DUPLICATE OF v0.9.0 v0.9.0 ------ * Add function get_override_names_that_do_not_exist * Add function get_override_names_that_exist * Added parameter to get_overrides to facilitate the retrieval of a subset of overrides v0.8.2 ------ * Explicitly invoke tilde expansion when deriving the path to a user's dk context v0.8.1 ------ * Fixed incorrect formatting in release notes below for v0.8.0 v0.8.0 ------ * Added function to support updating kitchen staff * Added factory method to create DataKitchenClient using context created by DKCloudCommand v0.7.1 ------ * Made some minor documentation changes * Added __str__ method to DictionaryComparator v0.7.0 ------ * Added functions to support retrieving, updating and comparing kitchen overrides v0.6.1 ------ * Documented development process for updating and deploying this DKUtils library v0.6.0 ------ * Added StreamSets DataCollector client v0.5.0 ------ * Added create/resume and monitor orders methods to DataKitchen API Client * Waits for the orders to complete or for a specified timeout duration (whichever comes first) * Number of maximum concurrently running orders can be specified v0.4.0 ------ * Added generalized API request method to DataKitchen API Client * Added skip_token_verification function to validations * Updated existing API methods to use new generalized API Request method v0.3.0 ------ * Added update kitchen vault method to DataKitchen API Client * Added get_utc_timestamp function to return current UTC time in milliseconds since epoch which is the same format used for order run timings field v0.2.0 ------ * Add resume order run method to DataKitchen API Client v0.1.0 ------ * Added DataKitchen API Client * Added get order run status * Added monitor order runs * Added get order run details function v0.0.4 ------ * Add function for retrieving order runs details * Update documentation with release notes and a guide v0.0.3 ------ * Bugfix global variable validation v0.0.2 ------ * Update WaitLoop to input a max duration as opposed to a datetime v0.0.1 ------ * Initial release