VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  576.44         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.92539        	|500            	|  462.69         	|  80.267         	|
run_training_batch                 	|  0.31921        	|1000           	|  319.21         	|  55.375         	|
optimizer_step_with_closure_0      	|  0.31652        	|1000           	|  316.52         	|  54.91          	|
training_step_and_backward         	|  0.23847        	|1000           	|  238.47         	|  41.37          	|
model_forward                      	|  0.14739        	|1000           	|  147.39         	|  25.569         	|
training_step                      	|  0.14722        	|1000           	|  147.22         	|  25.54          	|
backward                           	|  0.089693       	|1000           	|  89.693         	|  15.56          	|
run_validate_evaluation            	|  70.447         	|1              	|  70.447         	|  12.221         	|
evaluation_step_and_end            	|  0.21985        	|313            	|  68.812         	|  11.937         	|
validation_step                    	|  0.21979        	|313            	|  68.796         	|  11.935         	|
get_train_batch                    	|  0.028567       	|1500           	|  42.851         	|  7.4337         	|
fetch_next_train_batch             	|  0.028535       	|1500           	|  42.802         	|  7.4253         	|
zero_grad                          	|  0.0013609      	|1000           	|  1.3609         	|  0.23609        	|
on_train_batch_end                 	|  0.0013449      	|1000           	|  1.3449         	|  0.2333         	|
training_batch_to_device           	|  0.00058697     	|1000           	|  0.58697        	|  0.10183        	|
get_validate_batch                 	|  0.0018099      	|314            	|  0.56832        	|  0.098592       	|
fetch_next_validate_batch          	|  0.0017951      	|314            	|  0.56367        	|  0.097785       	|
on_train_epoch_start               	|  0.00028497     	|500            	|  0.14249        	|  0.024718       	|
on_train_epoch_end                 	|  0.00026355     	|500            	|  0.13177        	|  0.02286        	|
on_train_batch_start               	|  0.00010558     	|1000           	|  0.10558        	|  0.018316       	|
evaluation_batch_to_device         	|  0.00022777     	|313            	|  0.071292       	|  0.012368       	|
on_batch_start                     	|  3.6501e-05     	|1000           	|  0.036501       	|  0.0063321      	|
on_train_end                       	|  0.023876       	|1              	|  0.023876       	|  0.0041419      	|
on_pretrain_routine_start          	|  0.02313        	|1              	|  0.02313        	|  0.0040125      	|
on_before_zero_grad                	|  2.0625e-05     	|1000           	|  0.020625       	|  0.0035779      	|
on_batch_end                       	|  1.368e-05      	|1000           	|  0.01368        	|  0.0023732      	|
on_before_optimizer_step           	|  1.2651e-05     	|1000           	|  0.012651       	|  0.0021947      	|
on_after_backward                  	|  1.1529e-05     	|1000           	|  0.011529       	|  0.002          	|
on_before_backward                 	|  1.0907e-05     	|1000           	|  0.010907       	|  0.0018921      	|
configure_optimizers               	|  0.0086275      	|1              	|  0.0086275      	|  0.0014967      	|
training_step_end                  	|  7.2872e-06     	|1000           	|  0.0072872      	|  0.0012642      	|
on_validation_batch_end            	|  1.8915e-05     	|313            	|  0.0059203      	|  0.001027       	|
on_epoch_start                     	|  1.1035e-05     	|501            	|  0.0055285      	|  0.00095907     	|
on_epoch_end                       	|  1.0527e-05     	|501            	|  0.0052739      	|  0.0009149      	|
on_validation_model_eval           	|  0.0039801      	|1              	|  0.0039801      	|  0.00069046     	|
on_validation_batch_start          	|  9.9014e-06     	|313            	|  0.0030991      	|  0.00053763     	|
validation_step_end                	|  5.1202e-06     	|313            	|  0.0016026      	|  0.00027802     	|
on_train_start                     	|  0.00073472     	|1              	|  0.00073472     	|  0.00012746     	|
on_validation_start                	|  0.00033255     	|1              	|  0.00033255     	|  5.7691e-05     	|
on_validation_end                  	|  0.00010759     	|1              	|  0.00010759     	|  1.8665e-05     	|
on_before_accelerator_backend_setup	|  1.9748e-05     	|2              	|  3.9495e-05     	|  6.8516e-06     	|
on_validation_epoch_end            	|  3.1528e-05     	|1              	|  3.1528e-05     	|  5.4694e-06     	|
teardown                           	|  1.5524e-05     	|2              	|  3.1048e-05     	|  5.3862e-06     	|
on_configure_sharded_model         	|  1.4152e-05     	|2              	|  2.8303e-05     	|  4.91e-06       	|
setup                              	|  1.3786e-05     	|2              	|  2.7572e-05     	|  4.7831e-06     	|
on_fit_end                         	|  2.2882e-05     	|1              	|  2.2882e-05     	|  3.9695e-06     	|
on_fit_start                       	|  1.7923e-05     	|1              	|  1.7923e-05     	|  3.1092e-06     	|
on_val_dataloader                  	|  5.8355e-06     	|2              	|  1.1671e-05     	|  2.0247e-06     	|
prepare_data                       	|  5.335e-06      	|2              	|  1.067e-05      	|  1.851e-06      	|
on_pretrain_routine_end            	|  9.858e-06      	|1              	|  9.858e-06      	|  1.7102e-06     	|
configure_callbacks                	|  4.7139e-06     	|2              	|  9.4279e-06     	|  1.6355e-06     	|
on_validation_epoch_start          	|  9.388e-06      	|1              	|  9.388e-06      	|  1.6286e-06     	|
configure_sharded_model            	|  4.5085e-06     	|2              	|  9.0169e-06     	|  1.5642e-06     	|
on_train_dataloader                	|  4.0879e-06     	|1              	|  4.0879e-06     	|  7.0917e-07     	|
