# Results: spaCy
```
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/d820d71083f6444b8c6e872a9202d60d'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.27 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m /code/gobbli/model/spacy/model.py:176: UserWarning: The spaCy model doesn't batch validation data, so the validation batch size parameter will be ignored.
[2m[36m(pid=1338)[0m   "The spaCy model doesn't batch validation data, so the validation "
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 497.69 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.514052705431368e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.8767999999991232
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 2.5458573666213624e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/967e970f21e84bfaacb64586b1cd54f0'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.29 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 355.70 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.464429555397828e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.8805999999991193
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 2.4804763286397245e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/44fcc0f4c2ac4ea2a447be386b89b2be'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.28 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 612.76 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.4999768538359603e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.8765999999991233
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 3.3720109899491034e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/3dc2e292bec84eb1a5f30746b712c7c9'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.33 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 503.30 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.2618286859833461e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.8945999999991053
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 2.94094138047285e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4611dca9050e4c9caa7158d44698c2dd'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.40 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 631.05 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.2499411283783957e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.8945999999991053
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 1.927604680491868e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4a7e424948124b80bdbf09794debddba'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.31 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Training finished in 512.05 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation loss: 1.2148907657660856e-12
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.9015999999990983
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:  Training loss: 2.0593311421521322e-06
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/cc4ec419a05147428f495e2090f4ff08'
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Build finished in 0.28 sec.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Starting prediction.
[2m[36m(pid=1338)[0m INFO:gobbli.experiment.base:Prediction finished in 58.89 sec.
[2m[36m(pid=1338)[0m /usr/local/lib/python3.7/site-packages/ray/pyarrow_files/pyarrow/serialization.py:165: FutureWarning: The SparseDataFrame class is removed from pandas. Accessing it from the top-level namespace will also be removed in the next version
[2m[36m(pid=1338)[0m   if isinstance(obj, pd.SparseDataFrame):

```
|    |   valid_loss |   valid_accuracy |   train_loss | multilabel   | labels         | checkpoint                                                                                                                                                    | node_ip_address   | model_params                                              |
|---:|-------------:|-----------------:|-------------:|:-------------|:---------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------|:----------------------------------------------------------|
|  0 |  1.51405e-12 |           0.8768 |  2.54586e-06 | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/d820d71083f6444b8c6e872a9202d60d/train/beb1652d409e4704a5d099529ef1f36f/output/checkpoint | 172.80.10.2       | {'architecture': 'bow', 'model': 'en_core_web_sm'}        |
|  1 |  1.46443e-12 |           0.8806 |  2.48048e-06 | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/967e970f21e84bfaacb64586b1cd54f0/train/8bc49a908eb04b50ab49d1b45a051685/output/checkpoint | 172.80.10.2       | {'architecture': 'bow', 'model': 'en_core_web_lg'}        |
|  2 |  1.49998e-12 |           0.8766 |  3.37201e-06 | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/44fcc0f4c2ac4ea2a447be386b89b2be/train/d1ea8b4a0c6248c9be838d90ca889030/output/checkpoint | 172.80.10.2       | {'architecture': 'simple_cnn', 'model': 'en_core_web_sm'} |
|  3 |  1.26183e-12 |           0.8946 |  2.94094e-06 | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/3dc2e292bec84eb1a5f30746b712c7c9/train/ba0b0954d8a74327ab1f3fa87964b144/output/checkpoint | 172.80.10.2       | {'architecture': 'simple_cnn', 'model': 'en_core_web_lg'} |
|  4 |  1.24994e-12 |           0.8946 |  1.9276e-06  | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4611dca9050e4c9caa7158d44698c2dd/train/dbe4e49acf804922bbebadfb150c34a5/output/checkpoint | 172.80.10.2       | {'architecture': 'ensemble', 'model': 'en_core_web_sm'}   |
|  5 |  1.21489e-12 |           0.9016 |  2.05933e-06 | False        | ['neg', 'pos'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4a7e424948124b80bdbf09794debddba/train/c2b1b7e41bf3474a944f77430a445b0f/output/checkpoint | 172.80.10.2       | {'architecture': 'ensemble', 'model': 'en_core_web_lg'}   |
```
Metrics:
--------
Weighted F1 Score: 0.8953599330303571
Weighted Precision Score: 0.8953610121241911
Weighted Recall Score: 0.89536
Accuracy: 0.89536

Classification Report:
----------------------
              precision    recall  f1-score   support

         neg       0.00      0.00      0.00         0
         pos       0.00      0.00      0.00         0

   micro avg       0.00      0.00      0.00         0
   macro avg       0.00      0.00      0.00         0
weighted avg       0.00      0.00      0.00         0


```

![Results](spaCy/plot.png)
---