FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  351.3          	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  13.286         	|25             	|  332.16         	|  94.55          	|
run_training_batch                 	|  0.27902        	|1000           	|  279.02         	|  79.423         	|
optimizer_step_with_closure_0      	|  0.27577        	|1000           	|  275.77         	|  78.498         	|
training_step_and_backward         	|  0.21346        	|1000           	|  213.46         	|  60.763         	|
backward                           	|  0.10703        	|1000           	|  107.03         	|  30.466         	|
model_forward                      	|  0.10497        	|1000           	|  104.97         	|  29.879         	|
training_step                      	|  0.10477        	|1000           	|  104.77         	|  29.824         	|
get_train_batch                    	|  0.0099173      	|1025           	|  10.165         	|  2.8936         	|
fetch_next_train_batch             	|  0.0098916      	|1025           	|  10.139         	|  2.8861         	|
on_train_batch_end                 	|  0.0024147      	|1000           	|  2.4147         	|  0.68737        	|
zero_grad                          	|  0.0014357      	|1000           	|  1.4357         	|  0.40869        	|
training_batch_to_device           	|  0.00027871     	|1000           	|  0.27871        	|  0.079336       	|
on_train_batch_start               	|  9.4977e-05     	|1000           	|  0.094977       	|  0.027036       	|
on_train_end                       	|  0.041881       	|1              	|  0.041881       	|  0.011921       	|
on_after_backward                  	|  2.6499e-05     	|1000           	|  0.026499       	|  0.0075429      	|
on_pretrain_routine_start          	|  0.02348        	|1              	|  0.02348        	|  0.0066836      	|
on_batch_start                     	|  2.3062e-05     	|1000           	|  0.023062       	|  0.0065647      	|
on_batch_end                       	|  1.7386e-05     	|1000           	|  0.017386       	|  0.0049489      	|
on_before_zero_grad                	|  1.7172e-05     	|1000           	|  0.017172       	|  0.004888       	|
on_before_backward                 	|  1.3816e-05     	|1000           	|  0.013816       	|  0.0039329      	|
on_before_optimizer_step           	|  1.3132e-05     	|1000           	|  0.013132       	|  0.0037381      	|
on_train_epoch_end                 	|  0.00047513     	|25             	|  0.011878       	|  0.0033812      	|
on_train_epoch_start               	|  0.00042313     	|25             	|  0.010578       	|  0.0030111      	|
configure_optimizers               	|  0.010158       	|1              	|  0.010158       	|  0.0028915      	|
training_step_end                  	|  6.8655e-06     	|1000           	|  0.0068655      	|  0.0019543      	|
on_train_start                     	|  0.0011397      	|1              	|  0.0011397      	|  0.00032443     	|
on_epoch_end                       	|  1.1998e-05     	|25             	|  0.00029995     	|  8.5382e-05     	|
on_epoch_start                     	|  1.1552e-05     	|25             	|  0.0002888      	|  8.2209e-05     	|
on_fit_start                       	|  3.794e-05      	|1              	|  3.794e-05      	|  1.08e-05       	|
on_fit_end                         	|  3.1529e-05     	|1              	|  3.1529e-05     	|  8.9749e-06     	|
setup                              	|  3.0288e-05     	|1              	|  3.0288e-05     	|  8.6217e-06     	|
on_configure_sharded_model         	|  2.9119e-05     	|1              	|  2.9119e-05     	|  8.2888e-06     	|
on_before_accelerator_backend_setup	|  2.5969e-05     	|1              	|  2.5969e-05     	|  7.3922e-06     	|
on_pretrain_routine_end            	|  1.69e-05       	|1              	|  1.69e-05       	|  4.8106e-06     	|
teardown                           	|  1.5944e-05     	|1              	|  1.5944e-05     	|  4.5386e-06     	|
prepare_data                       	|  1.1723e-05     	|1              	|  1.1723e-05     	|  3.3371e-06     	|
configure_sharded_model            	|  1.1161e-05     	|1              	|  1.1161e-05     	|  3.177e-06      	|
on_val_dataloader                  	|  9.3598e-06     	|1              	|  9.3598e-06     	|  2.6643e-06     	|
configure_callbacks                	|  7.3891e-06     	|1              	|  7.3891e-06     	|  2.1033e-06     	|
on_train_dataloader                	|  6.8564e-06     	|1              	|  6.8564e-06     	|  1.9517e-06     	|
