# Results: spaCy
```
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/8e85e163f8e24794a05249f8a1c22b1f'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.27 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m /code/gobbli/model/spacy/model.py:176: UserWarning: The spaCy model doesn't batch validation data, so the validation batch size parameter will be ignored.
[2m[36m(pid=2855)[0m   "The spaCy model doesn't batch validation data, so the validation "
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 451.82 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 1.9811780830796995e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.9856164383559467
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 3.071053097693945e-06
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/eb4e69016774476fb5d0c4f857038d33'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.35 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 345.31 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 2.0433863664807483e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.9852408307554165
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 3.071268050702406e-06
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/a7aeb257ff3d40f2a7376f1861578b8a'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.33 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 582.83 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 3.416400937375125e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.9741051701279333
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 1.0551788246386892e-05
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/273eaa9f33e843c480dde5b790bb6545'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.33 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 474.96 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 2.6411595648296713e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.9798055678300973
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 8.207961189009424e-06
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/3d62e7c8dee048dc8b32aeed954e2576'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.32 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 624.11 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 2.2246003536855062e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.984114007953826
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 9.69575800948224e-06
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4c75225d810c4dcdb9ccd8e3d212637e'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.35 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting training.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Training finished in 488.23 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:RESULTS:
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation loss: 2.4852327982656168e-11
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Validation accuracy: 0.982258064515912
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:  Training loss: 9.746779300873488e-06
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:SpaCyModel initialized with data directory '/data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/e4ece14ec3df42f9b9b43981c0199011'
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting build.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Build finished in 0.33 sec.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Starting prediction.
[2m[36m(pid=2855)[0m INFO:gobbli.experiment.base:Prediction finished in 46.22 sec.
[2m[36m(pid=2855)[0m /usr/local/lib/python3.7/site-packages/ray/pyarrow_files/pyarrow/serialization.py:165: FutureWarning: The SparseDataFrame class is removed from pandas. Accessing it from the top-level namespace will also be removed in the next version
[2m[36m(pid=2855)[0m   if isinstance(obj, pd.SparseDataFrame):

```
|    |   valid_loss |   valid_accuracy |   train_loss | multilabel   | labels                                                                                                                                                                                                                                                                                                                                                                                                    | checkpoint                                                                                                                                                    | node_ip_address   | model_params                                              |
|---:|-------------:|-----------------:|-------------:|:-------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------|:----------------------------------------------------------|
|  0 |  1.98118e-11 |         0.985616 |  3.07105e-06 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/8e85e163f8e24794a05249f8a1c22b1f/train/dc196d85f8034829bd96f0e1d8e2a1f4/output/checkpoint | 172.80.10.2       | {'architecture': 'bow', 'model': 'en_core_web_sm'}        |
|  1 |  2.04339e-11 |         0.985241 |  3.07127e-06 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/eb4e69016774476fb5d0c4f857038d33/train/88d7e57d95b04dabaf6f423e477f3a37/output/checkpoint | 172.80.10.2       | {'architecture': 'bow', 'model': 'en_core_web_lg'}        |
|  2 |  3.4164e-11  |         0.974105 |  1.05518e-05 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/a7aeb257ff3d40f2a7376f1861578b8a/train/4f78bef766e64c479e0d4751880c58bf/output/checkpoint | 172.80.10.2       | {'architecture': 'simple_cnn', 'model': 'en_core_web_sm'} |
|  3 |  2.64116e-11 |         0.979806 |  8.20796e-06 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/273eaa9f33e843c480dde5b790bb6545/train/3f534cf7035c4bca9a13d2bb0dfd6673/output/checkpoint | 172.80.10.2       | {'architecture': 'simple_cnn', 'model': 'en_core_web_lg'} |
|  4 |  2.2246e-11  |         0.984114 |  9.69576e-06 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/3d62e7c8dee048dc8b32aeed954e2576/train/9678c4dd166f409a8c5c5ebc090e27b3/output/checkpoint | 172.80.10.2       | {'architecture': 'ensemble', 'model': 'en_core_web_sm'}   |
|  5 |  2.48523e-11 |         0.982258 |  9.74678e-06 | False        | ['alt.atheism', 'comp.graphics', 'comp.os.ms-windows.misc', 'comp.sys.ibm.pc.hardware', 'comp.sys.mac.hardware', 'comp.windows.x', 'misc.forsale', 'rec.autos', 'rec.motorcycles', 'rec.sport.baseball', 'rec.sport.hockey', 'sci.crypt', 'sci.electronics', 'sci.med', 'sci.space', 'soc.religion.christian', 'talk.politics.guns', 'talk.politics.mideast', 'talk.politics.misc', 'talk.religion.misc'] | /data/users/jnance/gobbli/benchmark/benchmark_data/model/SpaCyModel/4c75225d810c4dcdb9ccd8e3d212637e/train/dda04067accd4c8f90c33b60d469519b/output/checkpoint | 172.80.10.2       | {'architecture': 'ensemble', 'model': 'en_core_web_lg'}   |
```
Metrics:
--------
Weighted F1 Score: 0.7366514137849649
Weighted Precision Score: 0.7408625609022476
Weighted Recall Score: 0.7379182156133829
Accuracy: 0.7379182156133829

Classification Report:
----------------------
                          precision    recall  f1-score   support

             alt.atheism       0.00      0.00      0.00         0
           comp.graphics       0.00      0.00      0.00         0
 comp.os.ms-windows.misc       0.00      0.00      0.00         0
comp.sys.ibm.pc.hardware       0.00      0.00      0.00         0
   comp.sys.mac.hardware       0.00      0.00      0.00         0
          comp.windows.x       0.00      0.00      0.00         0
            misc.forsale       0.00      0.00      0.00         0
               rec.autos       0.00      0.00      0.00         0
         rec.motorcycles       0.00      0.00      0.00         0
      rec.sport.baseball       0.00      0.00      0.00         0
        rec.sport.hockey       0.00      0.00      0.00         0
               sci.crypt       0.00      0.00      0.00         0
         sci.electronics       0.00      0.00      0.00         0
                 sci.med       0.00      0.00      0.00         0
               sci.space       0.00      0.00      0.00         0
  soc.religion.christian       0.00      0.00      0.00         0
      talk.politics.guns       0.00      0.00      0.00         0
   talk.politics.mideast       0.00      0.00      0.00         0
      talk.politics.misc       0.00      0.00      0.00         0
      talk.religion.misc       0.00      0.00      0.00         0

               micro avg       0.00      0.00      0.00         0
               macro avg       0.00      0.00      0.00         0
            weighted avg       0.00      0.00      0.00         0


```

![Results](spaCy/plot.png)
---