FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  510.9          	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  7.7737         	|63             	|  489.74         	|  95.859         	|
run_training_batch                 	|  0.37452        	|1000           	|  374.52         	|  73.307         	|
optimizer_step_with_closure_0      	|  0.37146        	|1000           	|  371.46         	|  72.708         	|
training_step_and_backward         	|  0.26725        	|1000           	|  267.25         	|  52.309         	|
model_forward                      	|  0.13581        	|1000           	|  135.81         	|  26.583         	|
training_step                      	|  0.13562        	|1000           	|  135.62         	|  26.546         	|
backward                           	|  0.12996        	|1000           	|  129.96         	|  25.437         	|
get_train_batch                    	|  0.024272       	|1063           	|  25.802         	|  5.0502         	|
fetch_next_train_batch             	|  0.024245       	|1063           	|  25.773         	|  5.0446         	|
on_train_batch_end                 	|  0.0021978      	|1000           	|  2.1978         	|  0.43019        	|
zero_grad                          	|  0.0014394      	|1000           	|  1.4394         	|  0.28173        	|
training_batch_to_device           	|  0.00027126     	|1000           	|  0.27126        	|  0.053095       	|
on_train_batch_start               	|  9.7108e-05     	|1000           	|  0.097108       	|  0.019007       	|
on_train_end                       	|  0.050573       	|1              	|  0.050573       	|  0.0098987      	|
on_train_epoch_end                 	|  0.0004167      	|63             	|  0.026252       	|  0.0051384      	|
on_after_backward                  	|  2.4406e-05     	|1000           	|  0.024406       	|  0.0047771      	|
on_train_epoch_start               	|  0.00038396     	|63             	|  0.02419        	|  0.0047347      	|
on_pretrain_routine_start          	|  0.023045       	|1              	|  0.023045       	|  0.0045106      	|
on_batch_start                     	|  2.2042e-05     	|1000           	|  0.022042       	|  0.0043143      	|
on_before_zero_grad                	|  1.8568e-05     	|1000           	|  0.018568       	|  0.0036343      	|
on_batch_end                       	|  1.7575e-05     	|1000           	|  0.017575       	|  0.00344        	|
on_before_optimizer_step           	|  1.3708e-05     	|1000           	|  0.013708       	|  0.0026831      	|
on_before_backward                 	|  1.3027e-05     	|1000           	|  0.013027       	|  0.0025497      	|
configure_optimizers               	|  0.010362       	|1              	|  0.010362       	|  0.0020282      	|
training_step_end                  	|  7.1304e-06     	|1000           	|  0.0071304      	|  0.0013957      	|
on_train_start                     	|  0.0020388      	|1              	|  0.0020388      	|  0.00039906     	|
on_epoch_end                       	|  1.2011e-05     	|63             	|  0.00075667     	|  0.00014811     	|
on_epoch_start                     	|  1.1523e-05     	|63             	|  0.00072593     	|  0.00014209     	|
on_fit_start                       	|  4.776e-05      	|1              	|  4.776e-05      	|  9.3482e-06     	|
on_before_accelerator_backend_setup	|  4.3973e-05     	|1              	|  4.3973e-05     	|  8.607e-06      	|
on_fit_end                         	|  3.005e-05      	|1              	|  3.005e-05      	|  5.8818e-06     	|
on_configure_sharded_model         	|  2.9979e-05     	|1              	|  2.9979e-05     	|  5.8679e-06     	|
setup                              	|  2.2946e-05     	|1              	|  2.2946e-05     	|  4.4913e-06     	|
on_pretrain_routine_end            	|  1.758e-05      	|1              	|  1.758e-05      	|  3.4409e-06     	|
teardown                           	|  1.552e-05      	|1              	|  1.552e-05      	|  3.0377e-06     	|
on_train_dataloader                	|  1.1908e-05     	|1              	|  1.1908e-05     	|  2.3308e-06     	|
prepare_data                       	|  1.0144e-05     	|1              	|  1.0144e-05     	|  1.9855e-06     	|
on_val_dataloader                  	|  9.3486e-06     	|1              	|  9.3486e-06     	|  1.8298e-06     	|
configure_callbacks                	|  8.3502e-06     	|1              	|  8.3502e-06     	|  1.6344e-06     	|
configure_sharded_model            	|  6.631e-06      	|1              	|  6.631e-06      	|  1.2979e-06     	|
