VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  652.49         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.6222         	|167            	|  604.9          	|  92.707         	|
run_training_batch                 	|  0.24487        	|1000           	|  244.87         	|  37.528         	|
optimizer_step_with_closure_0      	|  0.24277        	|1000           	|  242.77         	|  37.207         	|
training_step_and_backward         	|  0.18202        	|1000           	|  182.02         	|  27.896         	|
model_forward                      	|  0.094362       	|1000           	|  94.362         	|  14.462         	|
training_step                      	|  0.094188       	|1000           	|  94.188         	|  14.435         	|
backward                           	|  0.086315       	|1000           	|  86.315         	|  13.228         	|
get_train_batch                    	|  0.065654       	|1167           	|  76.618         	|  11.742         	|
fetch_next_train_batch             	|  0.065627       	|1167           	|  76.587         	|  11.738         	|
run_validate_evaluation            	|  16.773         	|1              	|  16.773         	|  2.5706         	|
evaluation_step_and_end            	|  0.10745        	|125            	|  13.431         	|  2.0584         	|
validation_step                    	|  0.10738        	|125            	|  13.422         	|  2.0571         	|
on_train_batch_end                 	|  0.0016234      	|1000           	|  1.6234         	|  0.2488         	|
zero_grad                          	|  0.0013141      	|1000           	|  1.3141         	|  0.2014         	|
get_validate_batch                 	|  0.0070127      	|126            	|  0.8836         	|  0.13542        	|
fetch_next_validate_batch          	|  0.0069949      	|126            	|  0.88135        	|  0.13507        	|
training_batch_to_device           	|  0.00047341     	|1000           	|  0.47341        	|  0.072553       	|
on_train_batch_start               	|  9.5454e-05     	|1000           	|  0.095454       	|  0.014629       	|
on_train_epoch_start               	|  0.00032193     	|167            	|  0.053763       	|  0.0082395      	|
on_train_epoch_end                 	|  0.00030242     	|167            	|  0.050504       	|  0.0077402      	|
on_train_end                       	|  0.043251       	|1              	|  0.043251       	|  0.0066286      	|
on_batch_start                     	|  3.0241e-05     	|1000           	|  0.030241       	|  0.0046347      	|
evaluation_batch_to_device         	|  0.00019945     	|125            	|  0.024932       	|  0.003821       	|
on_pretrain_routine_start          	|  0.021669       	|1              	|  0.021669       	|  0.003321       	|
on_after_backward                  	|  1.8783e-05     	|1000           	|  0.018783       	|  0.0028787      	|
on_before_zero_grad                	|  1.5803e-05     	|1000           	|  0.015803       	|  0.002422       	|
on_batch_end                       	|  1.4399e-05     	|1000           	|  0.014399       	|  0.0022067      	|
on_before_optimizer_step           	|  1.3076e-05     	|1000           	|  0.013076       	|  0.002004       	|
on_before_backward                 	|  1.1496e-05     	|1000           	|  0.011496       	|  0.0017619      	|
configure_optimizers               	|  0.008433       	|1              	|  0.008433       	|  0.0012924      	|
training_step_end                  	|  6.3838e-06     	|1000           	|  0.0063838      	|  0.00097837     	|
on_validation_model_eval           	|  0.0038464      	|1              	|  0.0038464      	|  0.00058949     	|
on_validation_batch_end            	|  2.7053e-05     	|125            	|  0.0033817      	|  0.00051827     	|
on_epoch_end                       	|  1.1295e-05     	|168            	|  0.0018975      	|  0.00029081     	|
on_epoch_start                     	|  1.0915e-05     	|168            	|  0.0018338      	|  0.00028104     	|
on_validation_batch_start          	|  1.2116e-05     	|125            	|  0.0015145      	|  0.00023211     	|
on_train_start                     	|  0.0015003      	|1              	|  0.0015003      	|  0.00022993     	|
validation_step_end                	|  5.9532e-06     	|125            	|  0.00074415     	|  0.00011405     	|
on_validation_start                	|  0.000452       	|1              	|  0.000452       	|  6.9273e-05     	|
on_validation_end                  	|  0.00014074     	|1              	|  0.00014074     	|  2.1569e-05     	|
on_fit_end                         	|  9.1743e-05     	|1              	|  9.1743e-05     	|  1.406e-05      	|
on_before_accelerator_backend_setup	|  3.8072e-05     	|2              	|  7.6145e-05     	|  1.167e-05      	|
teardown                           	|  2.2182e-05     	|2              	|  4.4364e-05     	|  6.7992e-06     	|
on_configure_sharded_model         	|  2.1689e-05     	|2              	|  4.3377e-05     	|  6.6479e-06     	|
setup                              	|  2.1476e-05     	|2              	|  4.2953e-05     	|  6.5828e-06     	|
on_validation_epoch_end            	|  2.8878e-05     	|1              	|  2.8878e-05     	|  4.4259e-06     	|
configure_callbacks                	|  1.2103e-05     	|2              	|  2.4205e-05     	|  3.7096e-06     	|
prepare_data                       	|  9.1158e-06     	|2              	|  1.8232e-05     	|  2.7941e-06     	|
on_fit_start                       	|  1.6671e-05     	|1              	|  1.6671e-05     	|  2.5549e-06     	|
configure_sharded_model            	|  7.337e-06      	|2              	|  1.4674e-05     	|  2.2489e-06     	|
on_val_dataloader                  	|  7.147e-06      	|2              	|  1.4294e-05     	|  2.1907e-06     	|
on_pretrain_routine_end            	|  1.2565e-05     	|1              	|  1.2565e-05     	|  1.9258e-06     	|
on_validation_epoch_start          	|  1.1474e-05     	|1              	|  1.1474e-05     	|  1.7585e-06     	|
on_train_dataloader                	|  6.3647e-06     	|1              	|  6.3647e-06     	|  9.7544e-07     	|
