VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  772.31         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.6174         	|200            	|  723.47         	|  93.677         	|
run_training_batch                 	|  0.29699        	|1000           	|  296.99         	|  38.455         	|
optimizer_step_with_closure_0      	|  0.29298        	|1000           	|  292.98         	|  37.935         	|
training_step_and_backward         	|  0.22626        	|1000           	|  226.26         	|  29.296         	|
model_forward                      	|  0.11558        	|1000           	|  115.58         	|  14.966         	|
training_step                      	|  0.11536        	|1000           	|  115.36         	|  14.937         	|
backward                           	|  0.109          	|1000           	|  109.0          	|  14.114         	|
get_train_batch                    	|  0.073194       	|1200           	|  87.832         	|  11.373         	|
fetch_next_train_batch             	|  0.07316        	|1200           	|  87.792         	|  11.368         	|
run_validate_evaluation            	|  16.267         	|1              	|  16.267         	|  2.1063         	|
evaluation_step_and_end            	|  0.098147       	|139            	|  13.642         	|  1.7665         	|
validation_step                    	|  0.098029       	|139            	|  13.626         	|  1.7643         	|
on_train_batch_end                 	|  0.0025682      	|1000           	|  2.5682         	|  0.33254        	|
zero_grad                          	|  0.0016224      	|1000           	|  1.6224         	|  0.21007        	|
get_validate_batch                 	|  0.006173       	|140            	|  0.86423        	|  0.1119         	|
fetch_next_validate_batch          	|  0.006149       	|140            	|  0.86086        	|  0.11147        	|
training_batch_to_device           	|  0.00048278     	|1000           	|  0.48278        	|  0.062511       	|
configure_optimizers               	|  0.37829        	|1              	|  0.37829        	|  0.048982       	|
on_train_end                       	|  0.11593        	|1              	|  0.11593        	|  0.015011       	|
on_train_batch_start               	|  0.00010853     	|1000           	|  0.10853        	|  0.014052       	|
on_train_epoch_end                 	|  0.00033354     	|200            	|  0.066709       	|  0.0086376      	|
on_train_epoch_start               	|  0.00032207     	|200            	|  0.064414       	|  0.0083404      	|
on_after_backward                  	|  4.6575e-05     	|1000           	|  0.046575       	|  0.0060307      	|
evaluation_batch_to_device         	|  0.00028067     	|139            	|  0.039014       	|  0.0050516      	|
on_batch_start                     	|  3.2868e-05     	|1000           	|  0.032868       	|  0.0042558      	|
on_pretrain_routine_start          	|  0.022852       	|1              	|  0.022852       	|  0.002959       	|
on_before_zero_grad                	|  2.1309e-05     	|1000           	|  0.021309       	|  0.0027592      	|
on_batch_end                       	|  1.698e-05      	|1000           	|  0.01698        	|  0.0021986      	|
on_before_optimizer_step           	|  1.5155e-05     	|1000           	|  0.015155       	|  0.0019622      	|
on_before_backward                 	|  1.4006e-05     	|1000           	|  0.014006       	|  0.0018135      	|
training_step_end                  	|  9.1151e-06     	|1000           	|  0.0091151      	|  0.0011802      	|
on_validation_batch_end            	|  3.9431e-05     	|139            	|  0.0054809      	|  0.00070967     	|
on_validation_model_eval           	|  0.0050047      	|1              	|  0.0050047      	|  0.00064802     	|
on_epoch_start                     	|  1.3173e-05     	|201            	|  0.0026477      	|  0.00034283     	|
on_epoch_end                       	|  1.2384e-05     	|201            	|  0.0024891      	|  0.0003223      	|
on_validation_batch_start          	|  1.7275e-05     	|139            	|  0.0024013      	|  0.00031092     	|
validation_step_end                	|  9.391e-06      	|139            	|  0.0013054      	|  0.00016902     	|
on_train_start                     	|  0.001101       	|1              	|  0.001101       	|  0.00014256     	|
on_validation_start                	|  0.00064281     	|1              	|  0.00064281     	|  8.3233e-05     	|
on_validation_end                  	|  0.00027274     	|1              	|  0.00027274     	|  3.5315e-05     	|
teardown                           	|  3.6383e-05     	|2              	|  7.2766e-05     	|  9.4219e-06     	|
on_configure_sharded_model         	|  2.5832e-05     	|2              	|  5.1664e-05     	|  6.6896e-06     	|
on_before_accelerator_backend_setup	|  2.405e-05      	|2              	|  4.8101e-05     	|  6.2282e-06     	|
setup                              	|  2.3444e-05     	|2              	|  4.6888e-05     	|  6.0712e-06     	|
on_fit_start                       	|  4.0358e-05     	|1              	|  4.0358e-05     	|  5.2256e-06     	|
on_validation_epoch_end            	|  3.3325e-05     	|1              	|  3.3325e-05     	|  4.3149e-06     	|
on_fit_end                         	|  2.7668e-05     	|1              	|  2.7668e-05     	|  3.5825e-06     	|
on_val_dataloader                  	|  1.2119e-05     	|2              	|  2.4239e-05     	|  3.1385e-06     	|
configure_sharded_model            	|  1.0214e-05     	|2              	|  2.0428e-05     	|  2.645e-06      	|
on_pretrain_routine_end            	|  1.7289e-05     	|1              	|  1.7289e-05     	|  2.2386e-06     	|
configure_callbacks                	|  7.0417e-06     	|2              	|  1.4083e-05     	|  1.8236e-06     	|
prepare_data                       	|  6.3553e-06     	|2              	|  1.2711e-05     	|  1.6458e-06     	|
on_validation_epoch_start          	|  1.0384e-05     	|1              	|  1.0384e-05     	|  1.3446e-06     	|
on_train_dataloader                	|  8.5309e-06     	|1              	|  8.5309e-06     	|  1.1046e-06     	|
