VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  581.95         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  8.0883         	|63             	|  509.56         	|  87.561         	|
run_training_batch                 	|  0.37245        	|1000           	|  372.45         	|  64.002         	|
optimizer_step_with_closure_0      	|  0.36986        	|1000           	|  369.86         	|  63.556         	|
training_step_and_backward         	|  0.26485        	|1000           	|  264.85         	|  45.511         	|
model_forward                      	|  0.1377         	|1000           	|  137.7          	|  23.663         	|
training_step                      	|  0.13753        	|1000           	|  137.53         	|  23.632         	|
backward                           	|  0.12567        	|1000           	|  125.67         	|  21.594         	|
run_validate_evaluation            	|  30.95          	|1              	|  30.95          	|  5.3184         	|
get_train_batch                    	|  0.028858       	|1063           	|  30.676         	|  5.2713         	|
fetch_next_train_batch             	|  0.028835       	|1063           	|  30.651         	|  5.267          	|
evaluation_step_and_end            	|  0.22126        	|125            	|  27.657         	|  4.7525         	|
validation_step                    	|  0.22115        	|125            	|  27.643         	|  4.7501         	|
on_train_batch_end                 	|  0.0017905      	|1000           	|  1.7905         	|  0.30768        	|
zero_grad                          	|  0.0014521      	|1000           	|  1.4521         	|  0.24953        	|
get_validate_batch                 	|  0.0065018      	|126            	|  0.81923        	|  0.14077        	|
fetch_next_validate_batch          	|  0.006476       	|126            	|  0.81598        	|  0.14022        	|
training_batch_to_device           	|  0.00025321     	|1000           	|  0.25321        	|  0.043512       	|
on_train_batch_start               	|  9.467e-05      	|1000           	|  0.09467        	|  0.016268       	|
on_train_end                       	|  0.043536       	|1              	|  0.043536       	|  0.0074811      	|
evaluation_batch_to_device         	|  0.00030258     	|125            	|  0.037822       	|  0.0064993      	|
on_batch_start                     	|  2.355e-05      	|1000           	|  0.02355        	|  0.0040467      	|
on_train_epoch_start               	|  0.00036869     	|63             	|  0.023228       	|  0.0039914      	|
on_pretrain_routine_start          	|  0.022515       	|1              	|  0.022515       	|  0.0038689      	|
on_train_epoch_end                 	|  0.00035591     	|63             	|  0.022422       	|  0.0038529      	|
on_after_backward                  	|  2.0399e-05     	|1000           	|  0.020399       	|  0.0035054      	|
on_before_zero_grad                	|  1.6377e-05     	|1000           	|  0.016377       	|  0.0028142      	|
on_batch_end                       	|  1.5752e-05     	|1000           	|  0.015752       	|  0.0027068      	|
on_before_optimizer_step           	|  1.381e-05      	|1000           	|  0.01381        	|  0.002373       	|
on_before_backward                 	|  1.2359e-05     	|1000           	|  0.012359       	|  0.0021237      	|
configure_optimizers               	|  0.011474       	|1              	|  0.011474       	|  0.0019717      	|
training_step_end                  	|  6.521e-06      	|1000           	|  0.006521       	|  0.0011205      	|
on_validation_batch_end            	|  4.5907e-05     	|125            	|  0.0057384      	|  0.00098607     	|
on_validation_model_eval           	|  0.00446        	|1              	|  0.00446        	|  0.0007664      	|
on_train_start                     	|  0.002236       	|1              	|  0.002236       	|  0.00038423     	|
on_validation_batch_start          	|  1.6651e-05     	|125            	|  0.0020814      	|  0.00035766     	|
validation_step_end                	|  8.9342e-06     	|125            	|  0.0011168      	|  0.0001919      	|
on_epoch_end                       	|  1.1889e-05     	|64             	|  0.00076087     	|  0.00013075     	|
on_epoch_start                     	|  1.1767e-05     	|64             	|  0.00075306     	|  0.0001294      	|
on_validation_start                	|  0.00061003     	|1              	|  0.00061003     	|  0.00010483     	|
on_validation_end                  	|  0.00017317     	|1              	|  0.00017317     	|  2.9758e-05     	|
on_fit_start                       	|  0.00013087     	|1              	|  0.00013087     	|  2.2488e-05     	|
on_fit_end                         	|  7.6048e-05     	|1              	|  7.6048e-05     	|  1.3068e-05     	|
setup                              	|  3.1162e-05     	|2              	|  6.2324e-05     	|  1.071e-05      	|
on_before_accelerator_backend_setup	|  3.0665e-05     	|2              	|  6.1329e-05     	|  1.0539e-05     	|
teardown                           	|  2.8575e-05     	|2              	|  5.715e-05      	|  9.8204e-06     	|
on_configure_sharded_model         	|  2.5198e-05     	|2              	|  5.0396e-05     	|  8.6599e-06     	|
on_validation_epoch_end            	|  3.8616e-05     	|1              	|  3.8616e-05     	|  6.6357e-06     	|
on_val_dataloader                  	|  1.1562e-05     	|2              	|  2.3125e-05     	|  3.9737e-06     	|
prepare_data                       	|  1.1559e-05     	|2              	|  2.3117e-05     	|  3.9724e-06     	|
configure_callbacks                	|  9.8608e-06     	|2              	|  1.9722e-05     	|  3.3889e-06     	|
configure_sharded_model            	|  8.0178e-06     	|2              	|  1.6036e-05     	|  2.7555e-06     	|
on_validation_epoch_start          	|  1.2049e-05     	|1              	|  1.2049e-05     	|  2.0705e-06     	|
on_pretrain_routine_end            	|  1.03e-05       	|1              	|  1.03e-05       	|  1.77e-06       	|
on_train_dataloader                	|  5.7388e-06     	|1              	|  5.7388e-06     	|  9.8614e-07     	|
