## PySpark development setup

### Prerequisites

```
JDK 9.0.1
Python 3.6
Pytest 4.3.1
Spark 2.2.1
Airflow 1.10.4

pip install -r requirements.txt
```

### Running the tests

```
python -m pytest tests/test_ExtractCCLinks.py
```

