VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  443.33         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.2376         	|63             	|  329.97         	|  74.43          	|
run_training_batch                 	|  0.30679        	|1000           	|  306.79         	|  69.201         	|
optimizer_step_with_closure_0      	|  0.30414        	|1000           	|  304.14         	|  68.605         	|
training_step_and_backward         	|  0.22868        	|1000           	|  228.68         	|  51.583         	|
model_forward                      	|  0.14142        	|1000           	|  141.42         	|  31.899         	|
training_step                      	|  0.14128        	|1000           	|  141.28         	|  31.867         	|
backward                           	|  0.085964       	|1000           	|  85.964         	|  19.391         	|
run_validate_evaluation            	|  70.436         	|1              	|  70.436         	|  15.888         	|
evaluation_step_and_end            	|  0.21966        	|313            	|  68.754         	|  15.508         	|
validation_step                    	|  0.21961        	|313            	|  68.737         	|  15.505         	|
get_train_batch                    	|  0.0073027      	|1063           	|  7.7628         	|  1.751          	|
fetch_next_train_batch             	|  0.0072839      	|1063           	|  7.7428         	|  1.7465         	|
zero_grad                          	|  0.0012753      	|1000           	|  1.2753         	|  0.28765        	|
on_train_batch_end                 	|  0.001203       	|1000           	|  1.203          	|  0.27135        	|
get_validate_batch                 	|  0.0018972      	|314            	|  0.59571        	|  0.13437        	|
fetch_next_validate_batch          	|  0.0018829      	|314            	|  0.59125        	|  0.13336        	|
training_batch_to_device           	|  0.00022085     	|1000           	|  0.22085        	|  0.049816       	|
on_train_batch_start               	|  9.0671e-05     	|1000           	|  0.090671       	|  0.020452       	|
evaluation_batch_to_device         	|  0.00022201     	|313            	|  0.06949        	|  0.015675       	|
on_train_end                       	|  0.02524        	|1              	|  0.02524        	|  0.0056932      	|
on_pretrain_routine_start          	|  0.023144       	|1              	|  0.023144       	|  0.0052205      	|
on_train_epoch_end                 	|  0.00030403     	|63             	|  0.019154       	|  0.0043204      	|
on_train_epoch_start               	|  0.00028704     	|63             	|  0.018083       	|  0.004079       	|
on_batch_start                     	|  1.5648e-05     	|1000           	|  0.015648       	|  0.0035298      	|
on_before_zero_grad                	|  1.3676e-05     	|1000           	|  0.013676       	|  0.0030849      	|
on_batch_end                       	|  1.3045e-05     	|1000           	|  0.013045       	|  0.0029424      	|
on_after_backward                  	|  1.1375e-05     	|1000           	|  0.011375       	|  0.0025659      	|
on_before_optimizer_step           	|  1.071e-05      	|1000           	|  0.01071        	|  0.0024159      	|
on_before_backward                 	|  1.0515e-05     	|1000           	|  0.010515       	|  0.0023718      	|
configure_optimizers               	|  0.0087906      	|1              	|  0.0087906      	|  0.0019829      	|
on_validation_batch_end            	|  2.0574e-05     	|313            	|  0.0064395      	|  0.0014525      	|
training_step_end                  	|  6.0194e-06     	|1000           	|  0.0060194      	|  0.0013578      	|
on_validation_model_eval           	|  0.0045212      	|1              	|  0.0045212      	|  0.0010198      	|
on_validation_batch_start          	|  9.9069e-06     	|313            	|  0.0031009      	|  0.00069945     	|
validation_step_end                	|  5.2693e-06     	|313            	|  0.0016493      	|  0.00037202     	|
on_train_start                     	|  0.00074935     	|1              	|  0.00074935     	|  0.00016903     	|
on_epoch_end                       	|  1.1316e-05     	|64             	|  0.00072419     	|  0.00016335     	|
on_epoch_start                     	|  1.0654e-05     	|64             	|  0.00068185     	|  0.0001538      	|
on_validation_start                	|  0.00031794     	|1              	|  0.00031794     	|  7.1717e-05     	|
on_validation_end                  	|  0.0001047      	|1              	|  0.0001047      	|  2.3616e-05     	|
on_before_accelerator_backend_setup	|  1.8334e-05     	|2              	|  3.6668e-05     	|  8.271e-06      	|
teardown                           	|  1.7278e-05     	|2              	|  3.4555e-05     	|  7.7944e-06     	|
on_validation_epoch_end            	|  3.3182e-05     	|1              	|  3.3182e-05     	|  7.4847e-06     	|
setup                              	|  1.4597e-05     	|2              	|  2.9195e-05     	|  6.5854e-06     	|
on_configure_sharded_model         	|  1.4102e-05     	|2              	|  2.8203e-05     	|  6.3616e-06     	|
on_fit_end                         	|  2.0088e-05     	|1              	|  2.0088e-05     	|  4.5312e-06     	|
on_fit_start                       	|  1.7733e-05     	|1              	|  1.7733e-05     	|  3.9999e-06     	|
prepare_data                       	|  6.728e-06      	|2              	|  1.3456e-05     	|  3.0352e-06     	|
on_val_dataloader                  	|  6.071e-06      	|2              	|  1.2142e-05     	|  2.7388e-06     	|
on_pretrain_routine_end            	|  9.979e-06      	|1              	|  9.979e-06      	|  2.2509e-06     	|
configure_sharded_model            	|  4.9185e-06     	|2              	|  9.8371e-06     	|  2.2189e-06     	|
on_validation_epoch_start          	|  9.808e-06      	|1              	|  9.808e-06      	|  2.2123e-06     	|
configure_callbacks                	|  4.7835e-06     	|2              	|  9.567e-06      	|  2.158e-06      	|
on_train_dataloader                	|  4.458e-06      	|1              	|  4.458e-06      	|  1.0056e-06     	|
