FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  539.43         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  1.0327         	|500            	|  516.33         	|  95.716         	|
run_training_batch                 	|  0.36531        	|1000           	|  365.31         	|  67.722         	|
optimizer_step_with_closure_0      	|  0.36262        	|1000           	|  362.62         	|  67.222         	|
training_step_and_backward         	|  0.27446        	|1000           	|  274.46         	|  50.879         	|
model_forward                      	|  0.16846        	|1000           	|  168.46         	|  31.229         	|
training_step                      	|  0.16829        	|1000           	|  168.29         	|  31.198         	|
backward                           	|  0.10466        	|1000           	|  104.66         	|  19.401         	|
get_train_batch                    	|  0.029015       	|1500           	|  43.522         	|  8.068          	|
fetch_next_train_batch             	|  0.028982       	|1500           	|  43.473         	|  8.0591         	|
on_train_batch_end                 	|  0.0013227      	|1000           	|  1.3227         	|  0.2452         	|
zero_grad                          	|  0.0013144      	|1000           	|  1.3144         	|  0.24367        	|
training_batch_to_device           	|  0.00060679     	|1000           	|  0.60679        	|  0.11249        	|
on_train_epoch_start               	|  0.00027505     	|500            	|  0.13753        	|  0.025494       	|
on_train_epoch_end                 	|  0.00025812     	|500            	|  0.12906        	|  0.023925       	|
on_train_batch_start               	|  0.00010396     	|1000           	|  0.10396        	|  0.019272       	|
on_batch_start                     	|  3.4186e-05     	|1000           	|  0.034186       	|  0.0063374      	|
on_train_end                       	|  0.023872       	|1              	|  0.023872       	|  0.0044254      	|
on_pretrain_routine_start          	|  0.022398       	|1              	|  0.022398       	|  0.0041521      	|
on_before_zero_grad                	|  2.057e-05      	|1000           	|  0.02057        	|  0.0038133      	|
on_batch_end                       	|  1.3639e-05     	|1000           	|  0.013639       	|  0.0025283      	|
on_before_optimizer_step           	|  1.2909e-05     	|1000           	|  0.012909       	|  0.0023931      	|
on_after_backward                  	|  1.1502e-05     	|1000           	|  0.011502       	|  0.0021322      	|
on_before_backward                 	|  1.0746e-05     	|1000           	|  0.010746       	|  0.001992       	|
configure_optimizers               	|  0.0084704      	|1              	|  0.0084704      	|  0.0015702      	|
training_step_end                  	|  7.7579e-06     	|1000           	|  0.0077579      	|  0.0014382      	|
on_epoch_start                     	|  1.1583e-05     	|500            	|  0.0057916      	|  0.0010736      	|
on_epoch_end                       	|  1.0133e-05     	|500            	|  0.0050665      	|  0.00093922     	|
on_train_start                     	|  0.00072914     	|1              	|  0.00072914     	|  0.00013517     	|
on_before_accelerator_backend_setup	|  2.2943e-05     	|1              	|  2.2943e-05     	|  4.2532e-06     	|
on_fit_end                         	|  2.2773e-05     	|1              	|  2.2773e-05     	|  4.2216e-06     	|
on_fit_start                       	|  1.7192e-05     	|1              	|  1.7192e-05     	|  3.187e-06      	|
setup                              	|  1.4608e-05     	|1              	|  1.4608e-05     	|  2.708e-06      	|
on_configure_sharded_model         	|  1.4527e-05     	|1              	|  1.4527e-05     	|  2.693e-06      	|
teardown                           	|  1.1301e-05     	|1              	|  1.1301e-05     	|  2.095e-06      	|
on_pretrain_routine_end            	|  1.0399e-05     	|1              	|  1.0399e-05     	|  1.9277e-06     	|
prepare_data                       	|  7.8049e-06     	|1              	|  7.8049e-06     	|  1.4469e-06     	|
configure_callbacks                	|  4.889e-06      	|1              	|  4.889e-06      	|  9.0632e-07     	|
configure_sharded_model            	|  4.669e-06      	|1              	|  4.669e-06      	|  8.6553e-07     	|
on_val_dataloader                  	|  4.338e-06      	|1              	|  4.338e-06      	|  8.0417e-07     	|
on_train_dataloader                	|  4.258e-06      	|1              	|  4.258e-06      	|  7.8935e-07     	|
