VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  713.3          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.9571         	|167            	|  660.84         	|  92.646         	|
run_training_batch                 	|  0.27956        	|1000           	|  279.56         	|  39.193         	|
optimizer_step_with_closure_0      	|  0.27683        	|1000           	|  276.83         	|  38.81          	|
training_step_and_backward         	|  0.21118        	|1000           	|  211.18         	|  29.606         	|
model_forward                      	|  0.11106        	|1000           	|  111.06         	|  15.57          	|
training_step                      	|  0.11087        	|1000           	|  110.87         	|  15.543         	|
backward                           	|  0.098589       	|1000           	|  98.589         	|  13.822         	|
get_train_batch                    	|  0.071291       	|1167           	|  83.196         	|  11.664         	|
fetch_next_train_batch             	|  0.071263       	|1167           	|  83.164         	|  11.659         	|
run_validate_evaluation            	|  17.306         	|1              	|  17.306         	|  2.4262         	|
evaluation_step_and_end            	|  0.11113        	|125            	|  13.891         	|  1.9475         	|
validation_step                    	|  0.11104        	|125            	|  13.88          	|  1.9459         	|
on_train_batch_end                 	|  0.001842       	|1000           	|  1.842          	|  0.25823        	|
zero_grad                          	|  0.0014966      	|1000           	|  1.4966         	|  0.20982        	|
get_validate_batch                 	|  0.0073818      	|126            	|  0.93011        	|  0.1304         	|
fetch_next_validate_batch          	|  0.0073599      	|126            	|  0.92735        	|  0.13001        	|
training_batch_to_device           	|  0.00035957     	|1000           	|  0.35957        	|  0.05041        	|
on_train_batch_start               	|  0.00010009     	|1000           	|  0.10009        	|  0.014031       	|
on_train_epoch_start               	|  0.00033855     	|167            	|  0.056538       	|  0.0079264      	|
on_train_epoch_end                 	|  0.00033765     	|167            	|  0.056387       	|  0.0079051      	|
on_train_end                       	|  0.047464       	|1              	|  0.047464       	|  0.0066542      	|
configure_optimizers               	|  0.038656       	|1              	|  0.038656       	|  0.0054194      	|
evaluation_batch_to_device         	|  0.00025345     	|125            	|  0.031682       	|  0.0044416      	|
on_batch_start                     	|  2.9369e-05     	|1000           	|  0.029369       	|  0.0041174      	|
on_pretrain_routine_start          	|  0.022998       	|1              	|  0.022998       	|  0.0032242      	|
on_after_backward                  	|  2.1478e-05     	|1000           	|  0.021478       	|  0.0030111      	|
on_before_zero_grad                	|  1.7873e-05     	|1000           	|  0.017873       	|  0.0025058      	|
on_batch_end                       	|  1.5293e-05     	|1000           	|  0.015293       	|  0.002144       	|
on_before_optimizer_step           	|  1.3134e-05     	|1000           	|  0.013134       	|  0.0018414      	|
on_before_backward                 	|  1.1859e-05     	|1000           	|  0.011859       	|  0.0016625      	|
training_step_end                  	|  6.8478e-06     	|1000           	|  0.0068478      	|  0.00096003     	|
on_validation_batch_end            	|  3.5083e-05     	|125            	|  0.0043853      	|  0.0006148      	|
on_validation_model_eval           	|  0.0037829      	|1              	|  0.0037829      	|  0.00053034     	|
on_epoch_end                       	|  1.2602e-05     	|168            	|  0.0021171      	|  0.00029681     	|
on_epoch_start                     	|  1.1816e-05     	|168            	|  0.0019851      	|  0.0002783      	|
on_validation_batch_start          	|  1.5115e-05     	|125            	|  0.0018893      	|  0.00026487     	|
on_train_start                     	|  0.0017157      	|1              	|  0.0017157      	|  0.00024053     	|
validation_step_end                	|  7.6372e-06     	|125            	|  0.00095465     	|  0.00013384     	|
on_validation_start                	|  0.00046646     	|1              	|  0.00046646     	|  6.5395e-05     	|
on_validation_end                  	|  0.00015705     	|1              	|  0.00015705     	|  2.2018e-05     	|
on_fit_end                         	|  0.00011272     	|1              	|  0.00011272     	|  1.5803e-05     	|
on_before_accelerator_backend_setup	|  3.5388e-05     	|2              	|  7.0777e-05     	|  9.9225e-06     	|
on_configure_sharded_model         	|  2.5503e-05     	|2              	|  5.1007e-05     	|  7.1508e-06     	|
setup                              	|  2.4958e-05     	|2              	|  4.9915e-05     	|  6.9978e-06     	|
teardown                           	|  2.2205e-05     	|2              	|  4.4409e-05     	|  6.2259e-06     	|
on_fit_start                       	|  4.2217e-05     	|1              	|  4.2217e-05     	|  5.9186e-06     	|
on_validation_epoch_end            	|  3.2311e-05     	|1              	|  3.2311e-05     	|  4.5299e-06     	|
on_pretrain_routine_end            	|  3.1078e-05     	|1              	|  3.1078e-05     	|  4.357e-06      	|
configure_callbacks                	|  1.2376e-05     	|2              	|  2.4753e-05     	|  3.4702e-06     	|
prepare_data                       	|  9.7901e-06     	|2              	|  1.958e-05      	|  2.745e-06      	|
on_val_dataloader                  	|  8.3316e-06     	|2              	|  1.6663e-05     	|  2.3361e-06     	|
configure_sharded_model            	|  7.6862e-06     	|2              	|  1.5372e-05     	|  2.1551e-06     	|
on_validation_epoch_start          	|  1.1086e-05     	|1              	|  1.1086e-05     	|  1.5543e-06     	|
on_train_dataloader                	|  6.4671e-06     	|1              	|  6.4671e-06     	|  9.0665e-07     	|
