VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  570.85         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  7.9635         	|63             	|  501.7          	|  87.887         	|
run_training_batch                 	|  0.37996        	|1000           	|  379.96         	|  66.561         	|
optimizer_step_with_closure_0      	|  0.37611        	|1000           	|  376.11         	|  65.886         	|
training_step_and_backward         	|  0.27202        	|1000           	|  272.02         	|  47.653         	|
model_forward                      	|  0.13573        	|1000           	|  135.73         	|  23.777         	|
training_step                      	|  0.13553        	|1000           	|  135.53         	|  23.741         	|
backward                           	|  0.13482        	|1000           	|  134.82         	|  23.617         	|
run_validate_evaluation            	|  30.324         	|1              	|  30.324         	|  5.3121         	|
get_train_batch                    	|  0.026089       	|1063           	|  27.733         	|  4.8582         	|
fetch_next_train_batch             	|  0.026066       	|1063           	|  27.708         	|  4.8539         	|
evaluation_step_and_end            	|  0.22124        	|125            	|  27.655         	|  4.8446         	|
validation_step                    	|  0.22114        	|125            	|  27.643         	|  4.8424         	|
on_train_batch_end                 	|  0.0020286      	|1000           	|  2.0286         	|  0.35537        	|
zero_grad                          	|  0.0014447      	|1000           	|  1.4447         	|  0.25309        	|
get_validate_batch                 	|  0.0061048      	|126            	|  0.76921        	|  0.13475        	|
fetch_next_validate_batch          	|  0.0060829      	|126            	|  0.76645        	|  0.13427        	|
training_batch_to_device           	|  0.00025362     	|1000           	|  0.25362        	|  0.044429       	|
on_train_batch_start               	|  9.5985e-05     	|1000           	|  0.095985       	|  0.016815       	|
on_train_end                       	|  0.043798       	|1              	|  0.043798       	|  0.0076725      	|
evaluation_batch_to_device         	|  0.00026265     	|125            	|  0.032832       	|  0.0057514      	|
on_pretrain_routine_start          	|  0.022613       	|1              	|  0.022613       	|  0.0039614      	|
on_train_epoch_end                 	|  0.00034383     	|63             	|  0.021662       	|  0.0037946      	|
on_train_epoch_start               	|  0.00034309     	|63             	|  0.021615       	|  0.0037864      	|
on_after_backward                  	|  2.1383e-05     	|1000           	|  0.021383       	|  0.0037458      	|
on_batch_start                     	|  2.0181e-05     	|1000           	|  0.020181       	|  0.0035353      	|
training_step_end                  	|  1.9796e-05     	|1000           	|  0.019796       	|  0.0034679      	|
on_before_zero_grad                	|  1.5756e-05     	|1000           	|  0.015756       	|  0.0027601      	|
on_batch_end                       	|  1.5126e-05     	|1000           	|  0.015126       	|  0.0026497      	|
on_before_optimizer_step           	|  1.2974e-05     	|1000           	|  0.012974       	|  0.0022727      	|
on_before_backward                 	|  1.2229e-05     	|1000           	|  0.012229       	|  0.0021423      	|
configure_optimizers               	|  0.010329       	|1              	|  0.010329       	|  0.0018093      	|
on_validation_batch_end            	|  3.6652e-05     	|125            	|  0.0045814      	|  0.00080257     	|
on_validation_model_eval           	|  0.0041293      	|1              	|  0.0041293      	|  0.00072337     	|
on_validation_batch_start          	|  1.4887e-05     	|125            	|  0.0018609      	|  0.00032599     	|
on_train_start                     	|  0.0016265      	|1              	|  0.0016265      	|  0.00028493     	|
validation_step_end                	|  8.1054e-06     	|125            	|  0.0010132      	|  0.00017749     	|
on_epoch_start                     	|  1.1594e-05     	|64             	|  0.000742       	|  0.00012998     	|
on_epoch_end                       	|  1.1444e-05     	|64             	|  0.00073239     	|  0.0001283      	|
on_validation_start                	|  0.00057386     	|1              	|  0.00057386     	|  0.00010053     	|
on_validation_end                  	|  0.00016328     	|1              	|  0.00016328     	|  2.8603e-05     	|
on_before_accelerator_backend_setup	|  2.3306e-05     	|2              	|  4.6613e-05     	|  8.1656e-06     	|
on_configure_sharded_model         	|  2.3152e-05     	|2              	|  4.6303e-05     	|  8.1114e-06     	|
teardown                           	|  2.2682e-05     	|2              	|  4.5365e-05     	|  7.9469e-06     	|
on_fit_start                       	|  4.4478e-05     	|1              	|  4.4478e-05     	|  7.7916e-06     	|
setup                              	|  2.1622e-05     	|2              	|  4.3243e-05     	|  7.5753e-06     	|
on_validation_epoch_end            	|  3.3814e-05     	|1              	|  3.3814e-05     	|  5.9236e-06     	|
on_val_dataloader                  	|  1.304e-05      	|2              	|  2.6081e-05     	|  4.5688e-06     	|
on_fit_end                         	|  2.2104e-05     	|1              	|  2.2104e-05     	|  3.8722e-06     	|
configure_callbacks                	|  7.2327e-06     	|2              	|  1.4465e-05     	|  2.534e-06      	|
configure_sharded_model            	|  6.9952e-06     	|2              	|  1.399e-05      	|  2.4508e-06     	|
on_pretrain_routine_end            	|  1.2873e-05     	|1              	|  1.2873e-05     	|  2.255e-06      	|
prepare_data                       	|  6.3842e-06     	|2              	|  1.2768e-05     	|  2.2368e-06     	|
on_validation_epoch_start          	|  1.1925e-05     	|1              	|  1.1925e-05     	|  2.0889e-06     	|
on_train_dataloader                	|  6.6943e-06     	|1              	|  6.6943e-06     	|  1.1727e-06     	|
