FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  333.12         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.264         	|21             	|  320.55         	|  96.227         	|
run_training_batch                 	|  0.30759        	|1000           	|  307.59         	|  92.337         	|
optimizer_step_with_closure_0      	|  0.30563        	|1000           	|  305.63         	|  91.746         	|
training_step_and_backward         	|  0.2338         	|1000           	|  233.8          	|  70.185         	|
backward                           	|  0.11756        	|1000           	|  117.56         	|  35.289         	|
model_forward                      	|  0.11477        	|1000           	|  114.77         	|  34.452         	|
training_step                      	|  0.11459        	|1000           	|  114.59         	|  34.399         	|
get_train_batch                    	|  0.0042603      	|1021           	|  4.3498         	|  1.3058         	|
fetch_next_train_batch             	|  0.0042404      	|1021           	|  4.3294         	|  1.2996         	|
on_train_batch_end                 	|  0.0014868      	|1000           	|  1.4868         	|  0.44631        	|
zero_grad                          	|  0.0014517      	|1000           	|  1.4517         	|  0.43577        	|
training_batch_to_device           	|  0.00027117     	|1000           	|  0.27117        	|  0.081403       	|
on_train_batch_start               	|  0.00010724     	|1000           	|  0.10724        	|  0.032192       	|
on_train_end                       	|  0.024643       	|1              	|  0.024643       	|  0.0073976      	|
on_pretrain_routine_start          	|  0.023002       	|1              	|  0.023002       	|  0.0069051      	|
on_batch_start                     	|  2.0259e-05     	|1000           	|  0.020259       	|  0.0060815      	|
on_after_backward                  	|  1.6002e-05     	|1000           	|  0.016002       	|  0.0048038      	|
on_batch_end                       	|  1.4451e-05     	|1000           	|  0.014451       	|  0.0043381      	|
on_before_zero_grad                	|  1.2933e-05     	|1000           	|  0.012933       	|  0.0038822      	|
on_before_optimizer_step           	|  1.1587e-05     	|1000           	|  0.011587       	|  0.0034782      	|
on_before_backward                 	|  1.1253e-05     	|1000           	|  0.011253       	|  0.0033779      	|
on_train_epoch_end                 	|  0.00044924     	|21             	|  0.0094341      	|  0.002832       	|
on_train_epoch_start               	|  0.00044248     	|21             	|  0.0092921      	|  0.0027894      	|
configure_optimizers               	|  0.0076804      	|1              	|  0.0076804      	|  0.0023056      	|
training_step_end                  	|  6.665e-06      	|1000           	|  0.006665       	|  0.0020008      	|
on_train_start                     	|  0.0012878      	|1              	|  0.0012878      	|  0.00038657     	|
on_epoch_start                     	|  1.1423e-05     	|21             	|  0.00023989     	|  7.2013e-05     	|
on_epoch_end                       	|  1.0733e-05     	|21             	|  0.00022538     	|  6.7658e-05     	|
on_fit_end                         	|  2.6751e-05     	|1              	|  2.6751e-05     	|  8.0304e-06     	|
on_before_accelerator_backend_setup	|  2.1176e-05     	|1              	|  2.1176e-05     	|  6.3568e-06     	|
setup                              	|  2.0613e-05     	|1              	|  2.0613e-05     	|  6.1878e-06     	|
on_pretrain_routine_end            	|  1.7322e-05     	|1              	|  1.7322e-05     	|  5.1999e-06     	|
on_configure_sharded_model         	|  1.7037e-05     	|1              	|  1.7037e-05     	|  5.1144e-06     	|
on_fit_start                       	|  1.6801e-05     	|1              	|  1.6801e-05     	|  5.0435e-06     	|
teardown                           	|  1.0643e-05     	|1              	|  1.0643e-05     	|  3.1949e-06     	|
prepare_data                       	|  8.608e-06      	|1              	|  8.608e-06      	|  2.584e-06      	|
on_val_dataloader                  	|  6.437e-06      	|1              	|  6.437e-06      	|  1.9323e-06     	|
configure_callbacks                	|  5.99e-06       	|1              	|  5.99e-06       	|  1.7982e-06     	|
configure_sharded_model            	|  5.983e-06      	|1              	|  5.983e-06      	|  1.796e-06      	|
on_train_dataloader                	|  5.877e-06      	|1              	|  5.877e-06      	|  1.7642e-06     	|
