VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  465.38         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.8057         	|63             	|  428.76         	|  92.131         	|
run_training_batch                 	|  0.29241        	|1000           	|  292.41         	|  62.832         	|
optimizer_step_with_closure_0      	|  0.28923        	|1000           	|  289.23         	|  62.15          	|
training_step_and_backward         	|  0.22378        	|1000           	|  223.78         	|  48.086         	|
backward                           	|  0.11122        	|1000           	|  111.22         	|  23.9           	|
model_forward                      	|  0.11091        	|1000           	|  110.91         	|  23.833         	|
training_step                      	|  0.11072        	|1000           	|  110.72         	|  23.792         	|
get_train_batch                    	|  0.029412       	|1063           	|  31.265         	|  6.7181         	|
fetch_next_train_batch             	|  0.029388       	|1063           	|  31.24          	|  6.7127         	|
run_validate_evaluation            	|  7.867          	|1              	|  7.867          	|  1.6904         	|
evaluation_step_and_end            	|  0.10213        	|48             	|  4.9024         	|  1.0534         	|
validation_step                    	|  0.10203        	|48             	|  4.8973         	|  1.0523         	|
on_train_batch_end                 	|  0.0021064      	|1000           	|  2.1064         	|  0.45262        	|
zero_grad                          	|  0.0016097      	|1000           	|  1.6097         	|  0.34589        	|
get_validate_batch                 	|  0.015158       	|49             	|  0.74274        	|  0.1596         	|
fetch_next_validate_batch          	|  0.015135       	|49             	|  0.74163        	|  0.15936        	|
training_batch_to_device           	|  0.00024685     	|1000           	|  0.24685        	|  0.053042       	|
on_train_batch_start               	|  0.0001008      	|1000           	|  0.1008         	|  0.021659       	|
on_train_end                       	|  0.087404       	|1              	|  0.087404       	|  0.018781       	|
on_after_backward                  	|  2.5174e-05     	|1000           	|  0.025174       	|  0.0054093      	|
on_pretrain_routine_start          	|  0.022385       	|1              	|  0.022385       	|  0.0048099      	|
on_batch_start                     	|  2.1828e-05     	|1000           	|  0.021828       	|  0.0046904      	|
on_train_epoch_end                 	|  0.00034009     	|63             	|  0.021425       	|  0.0046038      	|
on_train_epoch_start               	|  0.0003276      	|63             	|  0.020639       	|  0.0044348      	|
on_before_zero_grad                	|  1.7591e-05     	|1000           	|  0.017591       	|  0.00378        	|
on_before_backward                 	|  1.5947e-05     	|1000           	|  0.015947       	|  0.0034266      	|
on_batch_end                       	|  1.5564e-05     	|1000           	|  0.015564       	|  0.0033443      	|
configure_optimizers               	|  0.015187       	|1              	|  0.015187       	|  0.0032633      	|
evaluation_batch_to_device         	|  0.00027503     	|48             	|  0.013202       	|  0.0028367      	|
on_before_optimizer_step           	|  1.3075e-05     	|1000           	|  0.013075       	|  0.0028095      	|
training_step_end                  	|  7.2712e-06     	|1000           	|  0.0072712      	|  0.0015624      	|
on_validation_model_eval           	|  0.0047647      	|1              	|  0.0047647      	|  0.0010238      	|
on_validation_batch_end            	|  3.9345e-05     	|48             	|  0.0018886      	|  0.00040581     	|
on_epoch_end                       	|  1.2462e-05     	|64             	|  0.00079758     	|  0.00017138     	|
on_validation_batch_start          	|  1.6575e-05     	|48             	|  0.0007956      	|  0.00017096     	|
on_train_start                     	|  0.00073919     	|1              	|  0.00073919     	|  0.00015883     	|
on_epoch_start                     	|  1.1367e-05     	|64             	|  0.00072752     	|  0.00015633     	|
on_validation_start                	|  0.00068633     	|1              	|  0.00068633     	|  0.00014748     	|
validation_step_end                	|  8.632e-06      	|48             	|  0.00041433     	|  8.9031e-05     	|
on_validation_end                  	|  0.00014857     	|1              	|  0.00014857     	|  3.1925e-05     	|
on_fit_end                         	|  9.6478e-05     	|1              	|  9.6478e-05     	|  2.0731e-05     	|
teardown                           	|  3.967e-05      	|2              	|  7.9339e-05     	|  1.7048e-05     	|
on_before_accelerator_backend_setup	|  3.2822e-05     	|2              	|  6.5643e-05     	|  1.4105e-05     	|
on_configure_sharded_model         	|  2.5204e-05     	|2              	|  5.0409e-05     	|  1.0832e-05     	|
setup                              	|  2.4505e-05     	|2              	|  4.901e-05      	|  1.0531e-05     	|
on_val_dataloader                  	|  1.6105e-05     	|2              	|  3.2211e-05     	|  6.9213e-06     	|
on_validation_epoch_end            	|  2.8757e-05     	|1              	|  2.8757e-05     	|  6.1793e-06     	|
on_fit_start                       	|  2.5166e-05     	|1              	|  2.5166e-05     	|  5.4076e-06     	|
configure_callbacks                	|  1.1873e-05     	|2              	|  2.3747e-05     	|  5.1027e-06     	|
prepare_data                       	|  1.0507e-05     	|2              	|  2.1014e-05     	|  4.5155e-06     	|
on_validation_epoch_start          	|  1.53e-05       	|1              	|  1.53e-05       	|  3.2876e-06     	|
configure_sharded_model            	|  7.6294e-06     	|2              	|  1.5259e-05     	|  3.2788e-06     	|
on_pretrain_routine_end            	|  1.4968e-05     	|1              	|  1.4968e-05     	|  3.2163e-06     	|
on_train_dataloader                	|  6.6981e-06     	|1              	|  6.6981e-06     	|  1.4393e-06     	|
