VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1197.4         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.2958         	|500            	|  1147.9         	|  95.871         	|
run_training_batch                 	|  0.29488        	|1000           	|  294.88         	|  24.628         	|
optimizer_step_with_closure_0      	|  0.29135        	|1000           	|  291.35         	|  24.333         	|
training_step_and_backward         	|  0.22512        	|1000           	|  225.12         	|  18.801         	|
get_train_batch                    	|  0.1002         	|1500           	|  150.3          	|  12.553         	|
fetch_next_train_batch             	|  0.10016        	|1500           	|  150.24         	|  12.547         	|
model_forward                      	|  0.11579        	|1000           	|  115.79         	|  9.6701         	|
training_step                      	|  0.11553        	|1000           	|  115.53         	|  9.6491         	|
backward                           	|  0.10772        	|1000           	|  107.72         	|  8.9967         	|
run_validate_evaluation            	|  7.2755         	|1              	|  7.2755         	|  0.60763        	|
evaluation_step_and_end            	|  0.10506        	|48             	|  5.043          	|  0.42118        	|
validation_step                    	|  0.10494        	|48             	|  5.0371         	|  0.42069        	|
on_train_batch_end                 	|  0.0027319      	|1000           	|  2.7319         	|  0.22816        	|
zero_grad                          	|  0.0015655      	|1000           	|  1.5655         	|  0.13074        	|
training_batch_to_device           	|  0.00080175     	|1000           	|  0.80175        	|  0.06696        	|
get_validate_batch                 	|  0.011604       	|49             	|  0.56859        	|  0.047487       	|
fetch_next_validate_batch          	|  0.011577       	|49             	|  0.56728        	|  0.047378       	|
on_train_epoch_end                 	|  0.00044119     	|500            	|  0.22059        	|  0.018423       	|
on_train_epoch_start               	|  0.0003915      	|500            	|  0.19575        	|  0.016348       	|
on_train_batch_start               	|  0.00011317     	|1000           	|  0.11317        	|  0.0094515      	|
on_batch_start                     	|  5.0667e-05     	|1000           	|  0.050667       	|  0.0042316      	|
on_train_end                       	|  0.044097       	|1              	|  0.044097       	|  0.0036829      	|
on_after_backward                  	|  2.8084e-05     	|1000           	|  0.028084       	|  0.0023455      	|
on_pretrain_routine_start          	|  0.025081       	|1              	|  0.025081       	|  0.0020947      	|
on_before_zero_grad                	|  2.3385e-05     	|1000           	|  0.023385       	|  0.001953       	|
on_batch_end                       	|  1.7241e-05     	|1000           	|  0.017241       	|  0.0014399      	|
on_before_backward                 	|  1.6301e-05     	|1000           	|  0.016301       	|  0.0013614      	|
on_before_optimizer_step           	|  1.6272e-05     	|1000           	|  0.016272       	|  0.001359       	|
evaluation_batch_to_device         	|  0.00030483     	|48             	|  0.014632       	|  0.001222       	|
configure_optimizers               	|  0.0129         	|1              	|  0.0129         	|  0.0010774      	|
training_step_end                  	|  1.1538e-05     	|1000           	|  0.011538       	|  0.00096361     	|
on_epoch_end                       	|  1.2213e-05     	|501            	|  0.0061189      	|  0.00051103     	|
on_epoch_start                     	|  1.1511e-05     	|501            	|  0.0057672      	|  0.00048166     	|
on_validation_model_eval           	|  0.0049337      	|1              	|  0.0049337      	|  0.00041205     	|
on_validation_batch_end            	|  4.4093e-05     	|48             	|  0.0021164      	|  0.00017676     	|
on_train_start                     	|  0.0013544      	|1              	|  0.0013544      	|  0.00011312     	|
on_validation_batch_start          	|  1.8173e-05     	|48             	|  0.0008723      	|  7.2852e-05     	|
on_validation_start                	|  0.00072363     	|1              	|  0.00072363     	|  6.0435e-05     	|
validation_step_end                	|  9.8834e-06     	|48             	|  0.0004744      	|  3.9621e-05     	|
on_validation_end                  	|  0.00018393     	|1              	|  0.00018393     	|  1.5362e-05     	|
teardown                           	|  5.3748e-05     	|2              	|  0.0001075      	|  8.9777e-06     	|
on_fit_end                         	|  6.1756e-05     	|1              	|  6.1756e-05     	|  5.1577e-06     	|
on_before_accelerator_backend_setup	|  2.7541e-05     	|2              	|  5.5082e-05     	|  4.6003e-06     	|
on_val_dataloader                  	|  2.5286e-05     	|2              	|  5.0573e-05     	|  4.2237e-06     	|
on_configure_sharded_model         	|  2.3179e-05     	|2              	|  4.6358e-05     	|  3.8717e-06     	|
on_fit_start                       	|  4.6236e-05     	|1              	|  4.6236e-05     	|  3.8615e-06     	|
setup                              	|  2.083e-05      	|2              	|  4.166e-05      	|  3.4793e-06     	|
on_validation_epoch_end            	|  2.8998e-05     	|1              	|  2.8998e-05     	|  2.4218e-06     	|
configure_callbacks                	|  8.8727e-06     	|2              	|  1.7745e-05     	|  1.4821e-06     	|
prepare_data                       	|  8.5598e-06     	|2              	|  1.712e-05      	|  1.4298e-06     	|
on_pretrain_routine_end            	|  1.5106e-05     	|1              	|  1.5106e-05     	|  1.2616e-06     	|
configure_sharded_model            	|  7.3686e-06     	|2              	|  1.4737e-05     	|  1.2308e-06     	|
on_train_dataloader                	|  1.1448e-05     	|1              	|  1.1448e-05     	|  9.5609e-07     	|
on_validation_epoch_start          	|  1.08e-05       	|1              	|  1.08e-05       	|  9.0196e-07     	|
