FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  339.23         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.545         	|21             	|  326.45         	|  96.231         	|
run_training_batch                 	|  0.31182        	|1000           	|  311.82         	|  91.919         	|
optimizer_step_with_closure_0      	|  0.3089         	|1000           	|  308.9          	|  91.059         	|
training_step_and_backward         	|  0.23673        	|1000           	|  236.73         	|  69.784         	|
backward                           	|  0.11974        	|1000           	|  119.74         	|  35.297         	|
model_forward                      	|  0.11543        	|1000           	|  115.43         	|  34.028         	|
training_step                      	|  0.11523        	|1000           	|  115.23         	|  33.968         	|
get_train_batch                    	|  0.0046721      	|1021           	|  4.7702         	|  1.4062         	|
fetch_next_train_batch             	|  0.0046505      	|1021           	|  4.7482         	|  1.3997         	|
on_train_batch_end                 	|  0.0019312      	|1000           	|  1.9312         	|  0.56929        	|
zero_grad                          	|  0.0015294      	|1000           	|  1.5294         	|  0.45085        	|
training_batch_to_device           	|  0.00030693     	|1000           	|  0.30693        	|  0.090477       	|
on_train_batch_start               	|  0.00010882     	|1000           	|  0.10882        	|  0.032077       	|
on_pretrain_routine_start          	|  0.025536       	|1              	|  0.025536       	|  0.0075275      	|
on_train_end                       	|  0.024265       	|1              	|  0.024265       	|  0.0071528      	|
on_after_backward                  	|  2.2971e-05     	|1000           	|  0.022971       	|  0.0067716      	|
on_batch_start                     	|  1.9216e-05     	|1000           	|  0.019216       	|  0.0056645      	|
on_before_zero_grad                	|  1.4685e-05     	|1000           	|  0.014685       	|  0.0043289      	|
on_batch_end                       	|  1.4607e-05     	|1000           	|  0.014607       	|  0.004306       	|
on_before_optimizer_step           	|  1.19e-05       	|1000           	|  0.0119         	|  0.0035078      	|
on_before_backward                 	|  1.1826e-05     	|1000           	|  0.011826       	|  0.0034862      	|
on_train_epoch_end                 	|  0.00046492     	|21             	|  0.0097632      	|  0.002878       	|
on_train_epoch_start               	|  0.00043467     	|21             	|  0.0091281      	|  0.0026908      	|
configure_optimizers               	|  0.0090731      	|1              	|  0.0090731      	|  0.0026746      	|
training_step_end                  	|  7.7543e-06     	|1000           	|  0.0077543      	|  0.0022858      	|
on_train_start                     	|  0.0014247      	|1              	|  0.0014247      	|  0.00041998     	|
on_epoch_end                       	|  1.2414e-05     	|21             	|  0.00026069     	|  7.6847e-05     	|
on_epoch_start                     	|  1.124e-05      	|21             	|  0.00023605     	|  6.9584e-05     	|
setup                              	|  3.0325e-05     	|1              	|  3.0325e-05     	|  8.9393e-06     	|
on_fit_end                         	|  2.6261e-05     	|1              	|  2.6261e-05     	|  7.7413e-06     	|
on_before_accelerator_backend_setup	|  2.1874e-05     	|1              	|  2.1874e-05     	|  6.4481e-06     	|
on_pretrain_routine_end            	|  2.18e-05       	|1              	|  2.18e-05       	|  6.4263e-06     	|
on_configure_sharded_model         	|  1.9029e-05     	|1              	|  1.9029e-05     	|  5.6094e-06     	|
on_fit_start                       	|  1.7835e-05     	|1              	|  1.7835e-05     	|  5.2575e-06     	|
teardown                           	|  1.404e-05      	|1              	|  1.404e-05      	|  4.1388e-06     	|
prepare_data                       	|  9.072e-06      	|1              	|  9.072e-06      	|  2.6743e-06     	|
configure_sharded_model            	|  7.474e-06      	|1              	|  7.474e-06      	|  2.2032e-06     	|
on_train_dataloader                	|  7.265e-06      	|1              	|  7.265e-06      	|  2.1416e-06     	|
configure_callbacks                	|  6.604e-06      	|1              	|  6.604e-06      	|  1.9468e-06     	|
on_val_dataloader                  	|  6.101e-06      	|1              	|  6.101e-06      	|  1.7985e-06     	|
