VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  576.0          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  1.0369         	|500            	|  518.43         	|  90.005         	|
run_training_batch                 	|  0.36037        	|1000           	|  360.37         	|  62.564         	|
optimizer_step_with_closure_0      	|  0.35767        	|1000           	|  357.67         	|  62.095         	|
training_step_and_backward         	|  0.26848        	|1000           	|  268.48         	|  46.612         	|
model_forward                      	|  0.16599        	|1000           	|  165.99         	|  28.818         	|
training_step                      	|  0.16582        	|1000           	|  165.82         	|  28.789         	|
backward                           	|  0.10107        	|1000           	|  101.07         	|  17.547         	|
get_train_batch                    	|  0.030215       	|1500           	|  45.322         	|  7.8684         	|
fetch_next_train_batch             	|  0.030181       	|1500           	|  45.272         	|  7.8597         	|
run_validate_evaluation            	|  12.43          	|1              	|  12.43          	|  2.1581         	|
evaluation_step_and_end            	|  0.24944        	|48             	|  11.973         	|  2.0787         	|
validation_step                    	|  0.24939        	|48             	|  11.971         	|  2.0782         	|
zero_grad                          	|  0.0013892      	|1000           	|  1.3892         	|  0.24119        	|
on_train_batch_end                 	|  0.0013409      	|1000           	|  1.3409         	|  0.23279        	|
training_batch_to_device           	|  0.00059927     	|1000           	|  0.59927        	|  0.10404        	|
get_validate_batch                 	|  0.0044204      	|49             	|  0.2166         	|  0.037604       	|
fetch_next_validate_batch          	|  0.004405       	|49             	|  0.21585        	|  0.037473       	|
on_train_epoch_start               	|  0.00027737     	|500            	|  0.13869        	|  0.024077       	|
on_train_epoch_end                 	|  0.00027429     	|500            	|  0.13715        	|  0.02381        	|
on_train_batch_start               	|  0.00010557     	|1000           	|  0.10557        	|  0.018329       	|
on_batch_start                     	|  3.7294e-05     	|1000           	|  0.037294       	|  0.0064746      	|
on_train_end                       	|  0.023666       	|1              	|  0.023666       	|  0.0041087      	|
on_pretrain_routine_start          	|  0.023004       	|1              	|  0.023004       	|  0.0039937      	|
on_before_zero_grad                	|  2.0735e-05     	|1000           	|  0.020735       	|  0.0035999      	|
on_batch_end                       	|  1.3822e-05     	|1000           	|  0.013822       	|  0.0023996      	|
on_after_backward                  	|  1.336e-05      	|1000           	|  0.01336        	|  0.0023194      	|
on_before_optimizer_step           	|  1.3344e-05     	|1000           	|  0.013344       	|  0.0023166      	|
on_before_backward                 	|  1.2006e-05     	|1000           	|  0.012006       	|  0.0020845      	|
evaluation_batch_to_device         	|  0.00022575     	|48             	|  0.010836       	|  0.0018813      	|
configure_optimizers               	|  0.0083652      	|1              	|  0.0083652      	|  0.0014523      	|
training_step_end                  	|  8.1223e-06     	|1000           	|  0.0081223      	|  0.0014101      	|
on_epoch_end                       	|  1.101e-05      	|501            	|  0.0055161      	|  0.00095765     	|
on_epoch_start                     	|  1.0659e-05     	|501            	|  0.0053402      	|  0.00092712     	|
on_validation_model_eval           	|  0.0039066      	|1              	|  0.0039066      	|  0.00067823     	|
on_validation_batch_end            	|  2.1813e-05     	|48             	|  0.001047       	|  0.00018178     	|
on_train_start                     	|  0.00076269     	|1              	|  0.00076269     	|  0.00013241     	|
on_validation_batch_start          	|  1.0333e-05     	|48             	|  0.00049598     	|  8.6107e-05     	|
on_validation_start                	|  0.00030525     	|1              	|  0.00030525     	|  5.2995e-05     	|
validation_step_end                	|  5.1963e-06     	|48             	|  0.00024942     	|  4.3303e-05     	|
on_validation_end                  	|  0.0001073      	|1              	|  0.0001073      	|  1.8629e-05     	|
on_before_accelerator_backend_setup	|  1.874e-05      	|2              	|  3.7481e-05     	|  6.5071e-06     	|
teardown                           	|  1.4647e-05     	|2              	|  2.9294e-05     	|  5.0858e-06     	|
on_configure_sharded_model         	|  1.319e-05      	|2              	|  2.6379e-05     	|  4.5797e-06     	|
setup                              	|  1.2708e-05     	|2              	|  2.5417e-05     	|  4.4127e-06     	|
on_fit_end                         	|  2.1751e-05     	|1              	|  2.1751e-05     	|  3.7762e-06     	|
on_validation_epoch_end            	|  1.9005e-05     	|1              	|  1.9005e-05     	|  3.2995e-06     	|
on_fit_start                       	|  1.6361e-05     	|1              	|  1.6361e-05     	|  2.8404e-06     	|
on_val_dataloader                  	|  5.856e-06      	|2              	|  1.1712e-05     	|  2.0333e-06     	|
on_pretrain_routine_end            	|  1.055e-05      	|1              	|  1.055e-05      	|  1.8316e-06     	|
prepare_data                       	|  5.205e-06      	|2              	|  1.041e-05      	|  1.8073e-06     	|
configure_sharded_model            	|  4.9395e-06     	|2              	|  9.879e-06      	|  1.7151e-06     	|
on_validation_epoch_start          	|  9.708e-06      	|1              	|  9.708e-06      	|  1.6854e-06     	|
configure_callbacks                	|  4.543e-06      	|2              	|  9.0861e-06     	|  1.5774e-06     	|
on_train_dataloader                	|  3.967e-06      	|1              	|  3.967e-06      	|  6.8871e-07     	|
