FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  387.32         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  17.402         	|21             	|  365.44         	|  94.349         	|
run_training_batch                 	|  0.31668        	|1000           	|  316.68         	|  81.761         	|
optimizer_step_with_closure_0      	|  0.3126         	|1000           	|  312.6          	|  80.709         	|
training_step_and_backward         	|  0.23922        	|1000           	|  239.22         	|  61.763         	|
backward                           	|  0.12026        	|1000           	|  120.26         	|  31.049         	|
model_forward                      	|  0.11711        	|1000           	|  117.11         	|  30.235         	|
training_step                      	|  0.11688        	|1000           	|  116.88         	|  30.177         	|
get_train_batch                    	|  0.0099948      	|1021           	|  10.205         	|  2.6347         	|
fetch_next_train_batch             	|  0.0099677      	|1021           	|  10.177         	|  2.6275         	|
on_train_batch_end                 	|  0.0026426      	|1000           	|  2.6426         	|  0.68227        	|
zero_grad                          	|  0.0018129      	|1000           	|  1.8129         	|  0.46807        	|
training_batch_to_device           	|  0.00031059     	|1000           	|  0.31059        	|  0.080188       	|
on_train_batch_start               	|  0.00011486     	|1000           	|  0.11486        	|  0.029654       	|
on_train_end                       	|  0.085304       	|1              	|  0.085304       	|  0.022024       	|
on_after_backward                  	|  3.2024e-05     	|1000           	|  0.032024       	|  0.008268       	|
on_batch_start                     	|  2.2905e-05     	|1000           	|  0.022905       	|  0.0059137      	|
on_pretrain_routine_start          	|  0.02227        	|1              	|  0.02227        	|  0.0057496      	|
on_before_zero_grad                	|  2.1589e-05     	|1000           	|  0.021589       	|  0.0055738      	|
on_batch_end                       	|  2.0144e-05     	|1000           	|  0.020144       	|  0.0052009      	|
on_before_optimizer_step           	|  1.7168e-05     	|1000           	|  0.017168       	|  0.0044325      	|
on_before_backward                 	|  1.5757e-05     	|1000           	|  0.015757       	|  0.004068       	|
on_train_epoch_end                 	|  0.00069053     	|21             	|  0.014501       	|  0.003744       	|
configure_optimizers               	|  0.013785       	|1              	|  0.013785       	|  0.0035591      	|
on_train_epoch_start               	|  0.00046757     	|21             	|  0.009819       	|  0.0025351      	|
training_step_end                  	|  8.2629e-06     	|1000           	|  0.0082629      	|  0.0021333      	|
on_train_start                     	|  0.00081269     	|1              	|  0.00081269     	|  0.00020982     	|
on_epoch_end                       	|  1.6392e-05     	|21             	|  0.00034423     	|  8.8873e-05     	|
on_epoch_start                     	|  1.4502e-05     	|21             	|  0.00030455     	|  7.8629e-05     	|
setup                              	|  3.5865e-05     	|1              	|  3.5865e-05     	|  9.2597e-06     	|
on_configure_sharded_model         	|  3.5146e-05     	|1              	|  3.5146e-05     	|  9.0741e-06     	|
on_fit_end                         	|  3.0249e-05     	|1              	|  3.0249e-05     	|  7.8098e-06     	|
on_before_accelerator_backend_setup	|  2.4615e-05     	|1              	|  2.4615e-05     	|  6.3551e-06     	|
on_fit_start                       	|  2.1219e-05     	|1              	|  2.1219e-05     	|  5.4784e-06     	|
teardown                           	|  1.9759e-05     	|1              	|  1.9759e-05     	|  5.1014e-06     	|
on_pretrain_routine_end            	|  1.1591e-05     	|1              	|  1.1591e-05     	|  2.9926e-06     	|
configure_sharded_model            	|  1.0932e-05     	|1              	|  1.0932e-05     	|  2.8224e-06     	|
prepare_data                       	|  9.9521e-06     	|1              	|  9.9521e-06     	|  2.5695e-06     	|
configure_callbacks                	|  8.9835e-06     	|1              	|  8.9835e-06     	|  2.3194e-06     	|
on_train_dataloader                	|  6.5062e-06     	|1              	|  6.5062e-06     	|  1.6798e-06     	|
on_val_dataloader                  	|  5.5302e-06     	|1              	|  5.5302e-06     	|  1.4278e-06     	|
