VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  425.74         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.7944         	|63             	|  365.05         	|  85.745         	|
run_training_batch                 	|  0.23276        	|1000           	|  232.76         	|  54.672         	|
optimizer_step_with_closure_0      	|  0.23091        	|1000           	|  230.91         	|  54.238         	|
training_step_and_backward         	|  0.17094        	|1000           	|  170.94         	|  40.151         	|
model_forward                      	|  0.085724       	|1000           	|  85.724         	|  20.135         	|
training_step                      	|  0.08557        	|1000           	|  85.57          	|  20.099         	|
backward                           	|  0.083886       	|1000           	|  83.886         	|  19.704         	|
run_validate_evaluation            	|  30.714         	|1              	|  30.714         	|  7.2143         	|
get_train_batch                    	|  0.027153       	|1063           	|  28.863         	|  6.7796         	|
fetch_next_train_batch             	|  0.027132       	|1063           	|  28.841         	|  6.7744         	|
evaluation_step_and_end            	|  0.08437        	|313            	|  26.408         	|  6.2028         	|
validation_step                    	|  0.084308       	|313            	|  26.388         	|  6.1983         	|
on_train_batch_end                 	|  0.0014652      	|1000           	|  1.4652         	|  0.34415        	|
zero_grad                          	|  0.0013022      	|1000           	|  1.3022         	|  0.30588        	|
get_validate_batch                 	|  0.0038056      	|314            	|  1.195          	|  0.28068        	|
fetch_next_validate_batch          	|  0.0037894      	|314            	|  1.1899         	|  0.27948        	|
training_batch_to_device           	|  0.00027383     	|1000           	|  0.27383        	|  0.064318       	|
on_train_batch_start               	|  9.1432e-05     	|1000           	|  0.091432       	|  0.021476       	|
evaluation_batch_to_device         	|  0.0002595      	|313            	|  0.081224       	|  0.019079       	|
on_train_end                       	|  0.044084       	|1              	|  0.044084       	|  0.010355       	|
on_pretrain_routine_start          	|  0.022969       	|1              	|  0.022969       	|  0.0053951      	|
on_train_epoch_start               	|  0.00033302     	|63             	|  0.02098        	|  0.004928       	|
on_train_epoch_end                 	|  0.00032036     	|63             	|  0.020183       	|  0.0047407      	|
on_batch_start                     	|  1.9282e-05     	|1000           	|  0.019282       	|  0.0045291      	|
configure_optimizers               	|  0.016588       	|1              	|  0.016588       	|  0.0038963      	|
on_after_backward                  	|  1.554e-05      	|1000           	|  0.01554        	|  0.0036501      	|
on_batch_end                       	|  1.3929e-05     	|1000           	|  0.013929       	|  0.0032717      	|
on_before_zero_grad                	|  1.306e-05      	|1000           	|  0.01306        	|  0.0030676      	|
on_before_backward                 	|  1.142e-05      	|1000           	|  0.01142        	|  0.0026823      	|
on_before_optimizer_step           	|  1.0969e-05     	|1000           	|  0.010969       	|  0.0025765      	|
on_validation_batch_end            	|  2.3073e-05     	|313            	|  0.007222       	|  0.0016963      	|
training_step_end                  	|  5.9597e-06     	|1000           	|  0.0059597      	|  0.0013998      	|
on_validation_model_eval           	|  0.0037368      	|1              	|  0.0037368      	|  0.00087772     	|
on_validation_batch_start          	|  1.1757e-05     	|313            	|  0.0036801      	|  0.0008644      	|
validation_step_end                	|  5.8531e-06     	|313            	|  0.001832       	|  0.00043031     	|
on_train_start                     	|  0.0011503      	|1              	|  0.0011503      	|  0.00027018     	|
on_epoch_end                       	|  1.1287e-05     	|64             	|  0.00072237     	|  0.00016967     	|
on_epoch_start                     	|  1.0458e-05     	|64             	|  0.00066928     	|  0.00015721     	|
on_validation_start                	|  0.00046778     	|1              	|  0.00046778     	|  0.00010988     	|
on_validation_end                  	|  0.00016063     	|1              	|  0.00016063     	|  3.7731e-05     	|
teardown                           	|  3.9498e-05     	|2              	|  7.8997e-05     	|  1.8555e-05     	|
setup                              	|  3.4351e-05     	|2              	|  6.8702e-05     	|  1.6137e-05     	|
on_fit_end                         	|  5.7938e-05     	|1              	|  5.7938e-05     	|  1.3609e-05     	|
on_before_accelerator_backend_setup	|  2.6949e-05     	|2              	|  5.3898e-05     	|  1.266e-05      	|
on_configure_sharded_model         	|  2.2728e-05     	|2              	|  4.5456e-05     	|  1.0677e-05     	|
on_fit_start                       	|  4.2373e-05     	|1              	|  4.2373e-05     	|  9.9529e-06     	|
on_validation_epoch_end            	|  3.6275e-05     	|1              	|  3.6275e-05     	|  8.5205e-06     	|
prepare_data                       	|  9.2378e-06     	|2              	|  1.8476e-05     	|  4.3397e-06     	|
configure_callbacks                	|  7.9237e-06     	|2              	|  1.5847e-05     	|  3.7223e-06     	|
on_val_dataloader                  	|  7.7775e-06     	|2              	|  1.5555e-05     	|  3.6537e-06     	|
on_pretrain_routine_end            	|  1.4365e-05     	|1              	|  1.4365e-05     	|  3.3741e-06     	|
configure_sharded_model            	|  6.7092e-06     	|2              	|  1.3418e-05     	|  3.1518e-06     	|
on_validation_epoch_start          	|  8.9835e-06     	|1              	|  8.9835e-06     	|  2.1101e-06     	|
on_train_dataloader                	|  6.1523e-06     	|1              	|  6.1523e-06     	|  1.4451e-06     	|
