VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  425.36         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.807          	|63             	|  365.84         	|  86.008         	|
run_training_batch                 	|  0.23195        	|1000           	|  231.95         	|  54.53          	|
optimizer_step_with_closure_0      	|  0.23005        	|1000           	|  230.05         	|  54.084         	|
training_step_and_backward         	|  0.17073        	|1000           	|  170.73         	|  40.138         	|
model_forward                      	|  0.085749       	|1000           	|  85.749         	|  20.159         	|
training_step                      	|  0.085592       	|1000           	|  85.592         	|  20.122         	|
backward                           	|  0.083704       	|1000           	|  83.704         	|  19.678         	|
run_validate_evaluation            	|  30.152         	|1              	|  30.152         	|  7.0885         	|
get_train_batch                    	|  0.02819        	|1063           	|  29.966         	|  7.0449         	|
fetch_next_train_batch             	|  0.028168       	|1063           	|  29.943         	|  7.0395         	|
evaluation_step_and_end            	|  0.08362        	|313            	|  26.173         	|  6.1532         	|
validation_step                    	|  0.083556       	|313            	|  26.153         	|  6.1484         	|
on_train_batch_end                 	|  0.001461       	|1000           	|  1.461          	|  0.34347        	|
zero_grad                          	|  0.0012506      	|1000           	|  1.2506         	|  0.29401        	|
get_validate_batch                 	|  0.003073       	|314            	|  0.96493        	|  0.22685        	|
fetch_next_validate_batch          	|  0.0030565      	|314            	|  0.95975        	|  0.22563        	|
training_batch_to_device           	|  0.00023059     	|1000           	|  0.23059        	|  0.05421        	|
on_train_batch_start               	|  9.0845e-05     	|1000           	|  0.090845       	|  0.021357       	|
evaluation_batch_to_device         	|  0.00020593     	|313            	|  0.064455       	|  0.015153       	|
on_train_end                       	|  0.045168       	|1              	|  0.045168       	|  0.010619       	|
on_pretrain_routine_start          	|  0.022238       	|1              	|  0.022238       	|  0.0052281      	|
on_train_epoch_start               	|  0.00032384     	|63             	|  0.020402       	|  0.0047965      	|
on_train_epoch_end                 	|  0.00031599     	|63             	|  0.019908       	|  0.0046802      	|
on_batch_start                     	|  1.9395e-05     	|1000           	|  0.019395       	|  0.0045596      	|
on_after_backward                  	|  1.6423e-05     	|1000           	|  0.016423       	|  0.003861       	|
on_batch_end                       	|  1.3924e-05     	|1000           	|  0.013924       	|  0.0032735      	|
on_before_zero_grad                	|  1.3594e-05     	|1000           	|  0.013594       	|  0.0031959      	|
on_before_backward                 	|  1.1222e-05     	|1000           	|  0.011222       	|  0.0026381      	|
on_before_optimizer_step           	|  1.0655e-05     	|1000           	|  0.010655       	|  0.0025048      	|
configure_optimizers               	|  0.010419       	|1              	|  0.010419       	|  0.0024494      	|
on_validation_batch_end            	|  2.231e-05      	|313            	|  0.0069831      	|  0.0016417      	|
training_step_end                  	|  6.2229e-06     	|1000           	|  0.0062229      	|  0.001463       	|
on_validation_model_eval           	|  0.003849       	|1              	|  0.003849       	|  0.00090489     	|
on_validation_batch_start          	|  1.1849e-05     	|313            	|  0.0037088      	|  0.00087193     	|
validation_step_end                	|  5.5319e-06     	|313            	|  0.0017315      	|  0.00040706     	|
on_train_start                     	|  0.0011979      	|1              	|  0.0011979      	|  0.00028162     	|
on_epoch_end                       	|  1.1706e-05     	|64             	|  0.0007492      	|  0.00017613     	|
on_epoch_start                     	|  1.1005e-05     	|64             	|  0.0007043      	|  0.00016558     	|
on_validation_start                	|  0.00044957     	|1              	|  0.00044957     	|  0.00010569     	|
on_validation_end                  	|  0.00013507     	|1              	|  0.00013507     	|  3.1755e-05     	|
teardown                           	|  3.5572e-05     	|2              	|  7.1144e-05     	|  1.6726e-05     	|
on_fit_end                         	|  5.4415e-05     	|1              	|  5.4415e-05     	|  1.2793e-05     	|
on_before_accelerator_backend_setup	|  2.5897e-05     	|2              	|  5.1795e-05     	|  1.2177e-05     	|
setup                              	|  2.5551e-05     	|2              	|  5.1102e-05     	|  1.2014e-05     	|
on_configure_sharded_model         	|  2.3464e-05     	|2              	|  4.6927e-05     	|  1.1032e-05     	|
on_fit_start                       	|  4.6104e-05     	|1              	|  4.6104e-05     	|  1.0839e-05     	|
on_validation_epoch_end            	|  3.3055e-05     	|1              	|  3.3055e-05     	|  7.771e-06      	|
prepare_data                       	|  1.0969e-05     	|2              	|  2.1938e-05     	|  5.1576e-06     	|
on_val_dataloader                  	|  8.5719e-06     	|2              	|  1.7144e-05     	|  4.0304e-06     	|
configure_callbacks                	|  7.7765e-06     	|2              	|  1.5553e-05     	|  3.6565e-06     	|
on_validation_epoch_start          	|  1.5385e-05     	|1              	|  1.5385e-05     	|  3.6171e-06     	|
configure_sharded_model            	|  6.4746e-06     	|2              	|  1.2949e-05     	|  3.0443e-06     	|
on_pretrain_routine_end            	|  1.2184e-05     	|1              	|  1.2184e-05     	|  2.8643e-06     	|
on_train_dataloader                	|  7.8231e-06     	|1              	|  7.8231e-06     	|  1.8392e-06     	|
