VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  442.45         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.4278         	|63             	|  404.95         	|  91.526         	|
run_training_batch                 	|  0.28089        	|1000           	|  280.89         	|  63.485         	|
optimizer_step_with_closure_0      	|  0.27766        	|1000           	|  277.66         	|  62.755         	|
training_step_and_backward         	|  0.2123         	|1000           	|  212.3          	|  47.982         	|
model_forward                      	|  0.10758        	|1000           	|  107.58         	|  24.314         	|
training_step                      	|  0.10739        	|1000           	|  107.39         	|  24.271         	|
backward                           	|  0.10317        	|1000           	|  103.17         	|  23.318         	|
get_train_batch                    	|  0.029206       	|1063           	|  31.046         	|  7.0168         	|
fetch_next_train_batch             	|  0.029182       	|1063           	|  31.021         	|  7.0111         	|
run_validate_evaluation            	|  7.2839         	|1              	|  7.2839         	|  1.6463         	|
evaluation_step_and_end            	|  0.10248        	|48             	|  4.9192         	|  1.1118         	|
validation_step                    	|  0.10238        	|48             	|  4.9141         	|  1.1107         	|
on_train_batch_end                 	|  0.0021485      	|1000           	|  2.1485         	|  0.4856         	|
zero_grad                          	|  0.0015133      	|1000           	|  1.5133         	|  0.34202        	|
get_validate_batch                 	|  0.01349        	|49             	|  0.66099        	|  0.14939        	|
fetch_next_validate_batch          	|  0.013466       	|49             	|  0.65985        	|  0.14914        	|
training_batch_to_device           	|  0.00024834     	|1000           	|  0.24834        	|  0.056129       	|
on_train_batch_start               	|  9.4704e-05     	|1000           	|  0.094704       	|  0.021405       	|
on_train_end                       	|  0.060444       	|1              	|  0.060444       	|  0.013661       	|
on_pretrain_routine_start          	|  0.029408       	|1              	|  0.029408       	|  0.0066467      	|
on_after_backward                  	|  2.5806e-05     	|1000           	|  0.025806       	|  0.0058325      	|
configure_optimizers               	|  0.022367       	|1              	|  0.022367       	|  0.0050554      	|
on_batch_start                     	|  2.1988e-05     	|1000           	|  0.021988       	|  0.0049697      	|
on_train_epoch_end                 	|  0.0003418      	|63             	|  0.021534       	|  0.0048669      	|
on_train_epoch_start               	|  0.00031673     	|63             	|  0.019954       	|  0.00451        	|
on_before_zero_grad                	|  1.7569e-05     	|1000           	|  0.017569       	|  0.003971       	|
on_batch_end                       	|  1.5537e-05     	|1000           	|  0.015537       	|  0.0035117      	|
evaluation_batch_to_device         	|  0.000315       	|48             	|  0.01512        	|  0.0034173      	|
on_before_backward                 	|  1.3179e-05     	|1000           	|  0.013179       	|  0.0029787      	|
on_before_optimizer_step           	|  1.2579e-05     	|1000           	|  0.012579       	|  0.0028431      	|
training_step_end                  	|  7.2215e-06     	|1000           	|  0.0072215      	|  0.0016322      	|
on_validation_model_eval           	|  0.0039387      	|1              	|  0.0039387      	|  0.00089022     	|
on_validation_batch_end            	|  4.0046e-05     	|48             	|  0.0019222      	|  0.00043445     	|
on_train_start                     	|  0.0011212      	|1              	|  0.0011212      	|  0.00025341     	|
on_validation_batch_start          	|  1.7423e-05     	|48             	|  0.0008363      	|  0.00018902     	|
on_epoch_end                       	|  1.1485e-05     	|64             	|  0.00073504     	|  0.00016613     	|
on_epoch_start                     	|  1.0613e-05     	|64             	|  0.00067925     	|  0.00015352     	|
on_validation_start                	|  0.00053152     	|1              	|  0.00053152     	|  0.00012013     	|
validation_step_end                	|  8.5913e-06     	|48             	|  0.00041238     	|  9.3205e-05     	|
on_validation_end                  	|  0.00015818     	|1              	|  0.00015818     	|  3.5751e-05     	|
on_before_accelerator_backend_setup	|  2.9524e-05     	|2              	|  5.9048e-05     	|  1.3346e-05     	|
setup                              	|  2.9187e-05     	|2              	|  5.8373e-05     	|  1.3193e-05     	|
on_fit_end                         	|  5.6747e-05     	|1              	|  5.6747e-05     	|  1.2826e-05     	|
teardown                           	|  2.4594e-05     	|2              	|  4.9189e-05     	|  1.1117e-05     	|
on_configure_sharded_model         	|  2.406e-05      	|2              	|  4.812e-05      	|  1.0876e-05     	|
on_fit_start                       	|  4.3664e-05     	|1              	|  4.3664e-05     	|  9.8688e-06     	|
on_validation_epoch_end            	|  2.9394e-05     	|1              	|  2.9394e-05     	|  6.6436e-06     	|
configure_sharded_model            	|  1.4004e-05     	|2              	|  2.8009e-05     	|  6.3304e-06     	|
configure_callbacks                	|  9.4883e-06     	|2              	|  1.8977e-05     	|  4.289e-06      	|
on_val_dataloader                  	|  9.0506e-06     	|2              	|  1.8101e-05     	|  4.0912e-06     	|
on_pretrain_routine_end            	|  1.5514e-05     	|1              	|  1.5514e-05     	|  3.5064e-06     	|
prepare_data                       	|  7.3044e-06     	|2              	|  1.4609e-05     	|  3.3018e-06     	|
on_validation_epoch_start          	|  1.2288e-05     	|1              	|  1.2288e-05     	|  2.7773e-06     	|
on_train_dataloader                	|  7.106e-06      	|1              	|  7.106e-06      	|  1.6061e-06     	|
