Metadata-Version: 2.1
Name: dbnd-airflow-export
Version: 0.43.5
Summary: Machine Learning Orchestration
Home-page: https://github.com/databand-ai/dbnd
Author: Evgeny Shulman
Author-email: evgeny.shulman@databand.ai
Maintainer: Evgeny Shulman
Maintainer-email: evgeny.shulman@databand.ai
License: UNKNOWN
Project-URL: Documentation, https://dbnd.readme.io/
Project-URL: Bug-Tracker, https://github.com/databand-ai/dbnd/issues
Project-URL: Source-Code, https://github.com/databand-ai/dbnd
Keywords: orchestration,data,machinelearning
Platform: any
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Natural Language :: English
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Description-Content-Type: text/markdown
Provides-Extra: tests
License-File: LICENSE

# Dbnd Airflow Export plugin

## The plugin

`dbnd-airflow-export-plugin` is a plugin for Airflow system, enables you to fetch data from Airflow database and DAG folder.
This Airflow side module is one of two components allows you to observe your Airflow data with `Databand` system.

### What does it do?

The plugin exposes a REST Api within `GET` `/export_data` which, expects `since` (utc).
This api returns json with all the relevant information scraped from airflow system.

### Configuring Airflow instance
To improve performance and reduce the runtime overhead on airflow database, we advise to add an index on end_date column to task_instance and dag_run tables i.e.

```
   CREATE INDEX dbnd_ti_end_date_ind ON task_instance (end_date);
   CREATE INDEX dbnd_dr_end_date_ind ON dag_run (end_date);
```

### Installation

In order to install `dbnd-airflow-export-plugin` we are using Airflow plugin system.

```bash
pip install databand[airflow-export]
```


