FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  389.97         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  14.634         	|25             	|  365.84         	|  93.812         	|
run_training_batch                 	|  0.35336        	|1000           	|  353.36         	|  90.612         	|
optimizer_step_with_closure_0      	|  0.35073        	|1000           	|  350.73         	|  89.938         	|
training_step_and_backward         	|  0.27193        	|1000           	|  271.93         	|  69.73          	|
model_forward                      	|  0.16098        	|1000           	|  160.98         	|  41.279         	|
training_step                      	|  0.16084        	|1000           	|  160.84         	|  41.244         	|
backward                           	|  0.10963        	|1000           	|  109.63         	|  28.113         	|
get_train_batch                    	|  0.0042434      	|1025           	|  4.3494         	|  1.1153         	|
fetch_next_train_batch             	|  0.0042258      	|1025           	|  4.3315         	|  1.1107         	|
zero_grad                          	|  0.0012926      	|1000           	|  1.2926         	|  0.33147        	|
on_train_batch_end                 	|  0.0011921      	|1000           	|  1.1921         	|  0.30569        	|
training_batch_to_device           	|  0.00023938     	|1000           	|  0.23938        	|  0.061384       	|
on_train_batch_start               	|  8.9273e-05     	|1000           	|  0.089273       	|  0.022892       	|
on_train_end                       	|  0.023644       	|1              	|  0.023644       	|  0.0060632      	|
on_pretrain_routine_start          	|  0.023265       	|1              	|  0.023265       	|  0.0059658      	|
on_batch_start                     	|  1.5397e-05     	|1000           	|  0.015397       	|  0.0039482      	|
on_before_zero_grad                	|  1.3648e-05     	|1000           	|  0.013648       	|  0.0034998      	|
on_batch_end                       	|  1.3232e-05     	|1000           	|  0.013232       	|  0.003393       	|
on_after_backward                  	|  1.112e-05      	|1000           	|  0.01112        	|  0.0028515      	|
on_before_optimizer_step           	|  1.04e-05       	|1000           	|  0.0104         	|  0.002667       	|
on_before_backward                 	|  1.0387e-05     	|1000           	|  0.010387       	|  0.0026634      	|
configure_optimizers               	|  0.0084113      	|1              	|  0.0084113      	|  0.0021569      	|
on_train_epoch_end                 	|  0.00029802     	|25             	|  0.0074506      	|  0.0019106      	|
on_train_epoch_start               	|  0.00029587     	|25             	|  0.0073967      	|  0.0018967      	|
training_step_end                  	|  6.0832e-06     	|1000           	|  0.0060832      	|  0.0015599      	|
on_train_start                     	|  0.00069124     	|1              	|  0.00069124     	|  0.00017726     	|
on_epoch_end                       	|  1.0691e-05     	|25             	|  0.00026728     	|  6.8538e-05     	|
on_epoch_start                     	|  1.0279e-05     	|25             	|  0.00025698     	|  6.5898e-05     	|
on_fit_end                         	|  2.2462e-05     	|1              	|  2.2462e-05     	|  5.76e-06       	|
on_before_accelerator_backend_setup	|  2.1731e-05     	|1              	|  2.1731e-05     	|  5.5725e-06     	|
on_fit_start                       	|  1.6892e-05     	|1              	|  1.6892e-05     	|  4.3316e-06     	|
on_configure_sharded_model         	|  1.5289e-05     	|1              	|  1.5289e-05     	|  3.9206e-06     	|
setup                              	|  1.3976e-05     	|1              	|  1.3976e-05     	|  3.5839e-06     	|
teardown                           	|  1.1872e-05     	|1              	|  1.1872e-05     	|  3.0444e-06     	|
on_pretrain_routine_end            	|  9.537e-06      	|1              	|  9.537e-06      	|  2.4456e-06     	|
prepare_data                       	|  8.065e-06      	|1              	|  8.065e-06      	|  2.0681e-06     	|
configure_callbacks                	|  7.915e-06      	|1              	|  7.915e-06      	|  2.0296e-06     	|
configure_sharded_model            	|  4.8799e-06     	|1              	|  4.8799e-06     	|  1.2514e-06     	|
on_val_dataloader                  	|  4.228e-06      	|1              	|  4.228e-06      	|  1.0842e-06     	|
on_train_dataloader                	|  4.1679e-06     	|1              	|  4.1679e-06     	|  1.0688e-06     	|
