VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1495.4         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.8617         	|500            	|  1430.9         	|  95.681         	|
run_training_batch                 	|  0.38918        	|1000           	|  389.18         	|  26.024         	|
optimizer_step_with_closure_0      	|  0.38539        	|1000           	|  385.39         	|  25.771         	|
training_step_and_backward         	|  0.28068        	|1000           	|  280.68         	|  18.769         	|
get_train_batch                    	|  0.11141        	|1500           	|  167.11         	|  11.175         	|
fetch_next_train_batch             	|  0.11137        	|1500           	|  167.05         	|  11.171         	|
model_forward                      	|  0.14893        	|1000           	|  148.93         	|  9.9589         	|
training_step                      	|  0.14871        	|1000           	|  148.71         	|  9.9442         	|
backward                           	|  0.13022        	|1000           	|  130.22         	|  8.708          	|
run_validate_evaluation            	|  30.754         	|1              	|  30.754         	|  2.0565         	|
evaluation_step_and_end            	|  0.21972        	|125            	|  27.465         	|  1.8366         	|
validation_step                    	|  0.2196         	|125            	|  27.45          	|  1.8356         	|
on_train_batch_end                 	|  0.002243       	|1000           	|  2.243          	|  0.14999        	|
zero_grad                          	|  0.0014862      	|1000           	|  1.4862         	|  0.099382       	|
get_validate_batch                 	|  0.0056659      	|126            	|  0.7139         	|  0.047739       	|
fetch_next_validate_batch          	|  0.0056376      	|126            	|  0.71034        	|  0.0475         	|
training_batch_to_device           	|  0.00061357     	|1000           	|  0.61357        	|  0.041029       	|
on_train_epoch_start               	|  0.00037068     	|500            	|  0.18534        	|  0.012394       	|
on_train_epoch_end                 	|  0.00034265     	|500            	|  0.17133        	|  0.011457       	|
on_train_batch_start               	|  0.00011244     	|1000           	|  0.11244        	|  0.0075188      	|
on_batch_start                     	|  4.3093e-05     	|1000           	|  0.043093       	|  0.0028817      	|
on_train_end                       	|  0.042747       	|1              	|  0.042747       	|  0.0028585      	|
evaluation_batch_to_device         	|  0.0002875      	|125            	|  0.035937       	|  0.0024031      	|
on_after_backward                  	|  2.3809e-05     	|1000           	|  0.023809       	|  0.0015921      	|
on_pretrain_routine_start          	|  0.021728       	|1              	|  0.021728       	|  0.001453       	|
on_before_zero_grad                	|  2.1601e-05     	|1000           	|  0.021601       	|  0.0014445      	|
on_batch_end                       	|  1.7904e-05     	|1000           	|  0.017904       	|  0.0011972      	|
on_before_optimizer_step           	|  1.6188e-05     	|1000           	|  0.016188       	|  0.0010825      	|
on_before_backward                 	|  1.5246e-05     	|1000           	|  0.015246       	|  0.0010195      	|
training_step_end                  	|  8.664e-06      	|1000           	|  0.008664       	|  0.00057936     	|
configure_optimizers               	|  0.0085165      	|1              	|  0.0085165      	|  0.0005695      	|
on_epoch_end                       	|  1.2277e-05     	|501            	|  0.0061509      	|  0.00041131     	|
on_validation_batch_end            	|  4.6136e-05     	|125            	|  0.0057669      	|  0.00038564     	|
on_epoch_start                     	|  1.1077e-05     	|501            	|  0.0055494      	|  0.00037109     	|
on_validation_model_eval           	|  0.003823       	|1              	|  0.003823       	|  0.00025564     	|
on_validation_batch_start          	|  1.9295e-05     	|125            	|  0.0024119      	|  0.00016128     	|
on_train_start                     	|  0.0019956      	|1              	|  0.0019956      	|  0.00013345     	|
validation_step_end                	|  1.0958e-05     	|125            	|  0.0013697      	|  9.1593e-05     	|
on_validation_start                	|  0.00037858     	|1              	|  0.00037858     	|  2.5315e-05     	|
on_validation_end                  	|  0.00023611     	|1              	|  0.00023611     	|  1.5788e-05     	|
teardown                           	|  2.6814e-05     	|2              	|  5.3627e-05     	|  3.5861e-06     	|
on_configure_sharded_model         	|  2.4932e-05     	|2              	|  4.9863e-05     	|  3.3343e-06     	|
setup                              	|  2.4344e-05     	|2              	|  4.8688e-05     	|  3.2557e-06     	|
on_before_accelerator_backend_setup	|  2.4076e-05     	|2              	|  4.8151e-05     	|  3.2199e-06     	|
on_validation_epoch_end            	|  3.564e-05      	|1              	|  3.564e-05      	|  2.3832e-06     	|
on_fit_end                         	|  3.4846e-05     	|1              	|  3.4846e-05     	|  2.3302e-06     	|
on_fit_start                       	|  1.874e-05      	|1              	|  1.874e-05      	|  1.2531e-06     	|
on_val_dataloader                  	|  7.3276e-06     	|2              	|  1.4655e-05     	|  9.8e-07        	|
prepare_data                       	|  7.187e-06      	|2              	|  1.4374e-05     	|  9.6119e-07     	|
configure_sharded_model            	|  7.0808e-06     	|2              	|  1.4162e-05     	|  9.4699e-07     	|
configure_callbacks                	|  6.8583e-06     	|2              	|  1.3717e-05     	|  9.1722e-07     	|
on_pretrain_routine_end            	|  1.2765e-05     	|1              	|  1.2765e-05     	|  8.5358e-07     	|
on_validation_epoch_start          	|  8.8438e-06     	|1              	|  8.8438e-06     	|  5.9139e-07     	|
on_train_dataloader                	|  5.8953e-06     	|1              	|  5.8953e-06     	|  3.9422e-07     	|
