VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1358.3         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.5978         	|500            	|  1298.9         	|  95.627         	|
run_training_batch                 	|  0.24571        	|1000           	|  245.71         	|  18.09          	|
optimizer_step_with_closure_0      	|  0.24363        	|1000           	|  243.63         	|  17.937         	|
get_train_batch                    	|  0.14556        	|1500           	|  218.34         	|  16.075         	|
fetch_next_train_batch             	|  0.14552        	|1500           	|  218.29         	|  16.071         	|
training_step_and_backward         	|  0.1825         	|1000           	|  182.5          	|  13.436         	|
model_forward                      	|  0.096775       	|1000           	|  96.775         	|  7.1247         	|
training_step                      	|  0.096574       	|1000           	|  96.574         	|  7.11           	|
backward                           	|  0.084311       	|1000           	|  84.311         	|  6.2072         	|
run_validate_evaluation            	|  30.266         	|1              	|  30.266         	|  2.2282         	|
evaluation_step_and_end            	|  0.083279       	|313            	|  26.066         	|  1.9191         	|
validation_step                    	|  0.083218       	|313            	|  26.047         	|  1.9177         	|
on_train_batch_end                 	|  0.0016976      	|1000           	|  1.6976         	|  0.12498        	|
zero_grad                          	|  0.001376       	|1000           	|  1.376          	|  0.1013         	|
get_validate_batch                 	|  0.0034899      	|314            	|  1.0958         	|  0.080676       	|
fetch_next_validate_batch          	|  0.0034739      	|314            	|  1.0908         	|  0.080308       	|
training_batch_to_device           	|  0.00071359     	|1000           	|  0.71359        	|  0.052536       	|
on_train_epoch_end                 	|  0.00031989     	|500            	|  0.15994        	|  0.011775       	|
on_train_epoch_start               	|  0.0002944      	|500            	|  0.1472         	|  0.010837       	|
on_train_batch_start               	|  0.00012582     	|1000           	|  0.12582        	|  0.0092633      	|
evaluation_batch_to_device         	|  0.00017974     	|313            	|  0.056259       	|  0.0041419      	|
on_batch_start                     	|  4.7207e-05     	|1000           	|  0.047207       	|  0.0034755      	|
on_train_end                       	|  0.043553       	|1              	|  0.043553       	|  0.0032064      	|
on_before_zero_grad                	|  2.2299e-05     	|1000           	|  0.022299       	|  0.0016417      	|
on_pretrain_routine_start          	|  0.021915       	|1              	|  0.021915       	|  0.0016135      	|
on_after_backward                  	|  1.7899e-05     	|1000           	|  0.017899       	|  0.0013178      	|
on_batch_end                       	|  1.6199e-05     	|1000           	|  0.016199       	|  0.0011926      	|
on_before_optimizer_step           	|  1.2613e-05     	|1000           	|  0.012613       	|  0.00092861     	|
on_before_backward                 	|  1.2411e-05     	|1000           	|  0.012411       	|  0.00091375     	|
configure_optimizers               	|  0.010875       	|1              	|  0.010875       	|  0.00080068     	|
training_step_end                  	|  8.2989e-06     	|1000           	|  0.0082989      	|  0.00061098     	|
on_validation_batch_end            	|  2.0962e-05     	|313            	|  0.0065611      	|  0.00048304     	|
on_epoch_end                       	|  1.0708e-05     	|501            	|  0.0053648      	|  0.00039496     	|
on_epoch_start                     	|  1.0388e-05     	|501            	|  0.0052045      	|  0.00038316     	|
on_validation_model_eval           	|  0.004562       	|1              	|  0.004562       	|  0.00033586     	|
on_validation_batch_start          	|  1.1366e-05     	|313            	|  0.0035574      	|  0.00026191     	|
validation_step_end                	|  5.4535e-06     	|313            	|  0.0017069      	|  0.00012567     	|
on_train_start                     	|  0.0010489      	|1              	|  0.0010489      	|  7.7225e-05     	|
on_validation_start                	|  0.00059988     	|1              	|  0.00059988     	|  4.4165e-05     	|
on_validation_end                  	|  0.00013994     	|1              	|  0.00013994     	|  1.0303e-05     	|
teardown                           	|  3.4203e-05     	|2              	|  6.8406e-05     	|  5.0362e-06     	|
on_fit_start                       	|  4.7456e-05     	|1              	|  4.7456e-05     	|  3.4938e-06     	|
on_before_accelerator_backend_setup	|  2.121e-05      	|2              	|  4.242e-05      	|  3.123e-06      	|
on_configure_sharded_model         	|  1.9132e-05     	|2              	|  3.8264e-05     	|  2.8171e-06     	|
setup                              	|  1.8985e-05     	|2              	|  3.797e-05      	|  2.7954e-06     	|
on_validation_epoch_end            	|  3.4925e-05     	|1              	|  3.4925e-05     	|  2.5712e-06     	|
on_val_dataloader                  	|  1.4883e-05     	|2              	|  2.9767e-05     	|  2.1915e-06     	|
on_fit_end                         	|  2.9657e-05     	|1              	|  2.9657e-05     	|  2.1834e-06     	|
prepare_data                       	|  6.9793e-06     	|2              	|  1.3959e-05     	|  1.0277e-06     	|
configure_callbacks                	|  5.94e-06       	|2              	|  1.188e-05      	|  8.7463e-07     	|
on_pretrain_routine_end            	|  1.1807e-05     	|1              	|  1.1807e-05     	|  8.6928e-07     	|
configure_sharded_model            	|  5.6596e-06     	|2              	|  1.1319e-05     	|  8.3335e-07     	|
on_validation_epoch_start          	|  1.0012e-05     	|1              	|  1.0012e-05     	|  7.3708e-07     	|
on_train_dataloader                	|  6.2846e-06     	|1              	|  6.2846e-06     	|  4.6268e-07     	|
