VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  632.07         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.5028         	|167            	|  584.96         	|  92.547         	|
run_training_batch                 	|  0.26649        	|1000           	|  266.49         	|  42.162         	|
optimizer_step_with_closure_0      	|  0.26281        	|1000           	|  262.81         	|  41.579         	|
training_step_and_backward         	|  0.19628        	|1000           	|  196.28         	|  31.054         	|
model_forward                      	|  0.099924       	|1000           	|  99.924         	|  15.809         	|
training_step                      	|  0.099747       	|1000           	|  99.747         	|  15.781         	|
backward                           	|  0.094847       	|1000           	|  94.847         	|  15.006         	|
get_train_batch                    	|  0.060903       	|1167           	|  71.074         	|  11.245         	|
fetch_next_train_batch             	|  0.060876       	|1167           	|  71.043         	|  11.24          	|
run_validate_evaluation            	|  15.954         	|1              	|  15.954         	|  2.5241         	|
evaluation_step_and_end            	|  0.10638        	|125            	|  13.298         	|  2.1038         	|
validation_step                    	|  0.10631        	|125            	|  13.289         	|  2.1025         	|
on_train_batch_end                 	|  0.0018793      	|1000           	|  1.8793         	|  0.29733        	|
zero_grad                          	|  0.0014797      	|1000           	|  1.4797         	|  0.2341         	|
get_validate_batch                 	|  0.0059766      	|126            	|  0.75305        	|  0.11914        	|
fetch_next_validate_batch          	|  0.0059581      	|126            	|  0.75072        	|  0.11877        	|
training_batch_to_device           	|  0.00047188     	|1000           	|  0.47188        	|  0.074656       	|
on_train_batch_start               	|  9.8415e-05     	|1000           	|  0.098415       	|  0.01557        	|
on_train_epoch_start               	|  0.00033684     	|167            	|  0.056252       	|  0.0088997      	|
on_train_epoch_end                 	|  0.00031691     	|167            	|  0.052924       	|  0.0083732      	|
on_train_end                       	|  0.04266        	|1              	|  0.04266        	|  0.0067493      	|
evaluation_batch_to_device         	|  0.00024619     	|125            	|  0.030773       	|  0.0048686      	|
on_batch_start                     	|  2.6821e-05     	|1000           	|  0.026821       	|  0.0042434      	|
on_pretrain_routine_start          	|  0.021995       	|1              	|  0.021995       	|  0.0034798      	|
on_batch_end                       	|  1.958e-05      	|1000           	|  0.01958        	|  0.0030978      	|
on_after_backward                  	|  1.7517e-05     	|1000           	|  0.017517       	|  0.0027713      	|
on_before_zero_grad                	|  1.6049e-05     	|1000           	|  0.016049       	|  0.0025391      	|
on_before_optimizer_step           	|  1.2262e-05     	|1000           	|  0.012262       	|  0.00194        	|
on_before_backward                 	|  1.1291e-05     	|1000           	|  0.011291       	|  0.0017864      	|
configure_optimizers               	|  0.010787       	|1              	|  0.010787       	|  0.0017066      	|
on_validation_model_eval           	|  0.0079764      	|1              	|  0.0079764      	|  0.0012619      	|
training_step_end                  	|  6.7765e-06     	|1000           	|  0.0067765      	|  0.0010721      	|
on_validation_batch_end            	|  2.6334e-05     	|125            	|  0.0032917      	|  0.00052078     	|
on_epoch_start                     	|  1.0882e-05     	|168            	|  0.0018282      	|  0.00028925     	|
on_epoch_end                       	|  1.0656e-05     	|168            	|  0.0017901      	|  0.00028322     	|
on_train_start                     	|  0.00177        	|1              	|  0.00177        	|  0.00028004     	|
on_validation_batch_start          	|  1.1887e-05     	|125            	|  0.0014859      	|  0.00023508     	|
validation_step_end                	|  6.0297e-06     	|125            	|  0.00075371     	|  0.00011924     	|
on_validation_start                	|  0.00061575     	|1              	|  0.00061575     	|  9.7418e-05     	|
on_validation_end                  	|  0.00013896     	|1              	|  0.00013896     	|  2.1985e-05     	|
setup                              	|  2.7231e-05     	|2              	|  5.4462e-05     	|  8.6164e-06     	|
on_fit_end                         	|  5.1005e-05     	|1              	|  5.1005e-05     	|  8.0695e-06     	|
on_before_accelerator_backend_setup	|  2.5073e-05     	|2              	|  5.0146e-05     	|  7.9336e-06     	|
on_configure_sharded_model         	|  2.2172e-05     	|2              	|  4.4344e-05     	|  7.0157e-06     	|
teardown                           	|  2.1543e-05     	|2              	|  4.3087e-05     	|  6.8168e-06     	|
on_fit_start                       	|  4.065e-05      	|1              	|  4.065e-05      	|  6.4313e-06     	|
on_validation_epoch_end            	|  2.5937e-05     	|1              	|  2.5937e-05     	|  4.1035e-06     	|
configure_callbacks                	|  9.7333e-06     	|2              	|  1.9467e-05     	|  3.0798e-06     	|
configure_sharded_model            	|  7.1507e-06     	|2              	|  1.4301e-05     	|  2.2626e-06     	|
prepare_data                       	|  6.8815e-06     	|2              	|  1.3763e-05     	|  2.1775e-06     	|
on_val_dataloader                  	|  6.5845e-06     	|2              	|  1.3169e-05     	|  2.0835e-06     	|
on_validation_epoch_start          	|  1.1874e-05     	|1              	|  1.1874e-05     	|  1.8786e-06     	|
on_pretrain_routine_end            	|  1.1289e-05     	|1              	|  1.1289e-05     	|  1.7861e-06     	|
on_train_dataloader                	|  7.9889e-06     	|1              	|  7.9889e-06     	|  1.2639e-06     	|
