VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  449.74         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  14.782         	|25             	|  369.56         	|  82.172         	|
run_training_batch                 	|  0.35699        	|1000           	|  356.99         	|  79.378         	|
optimizer_step_with_closure_0      	|  0.35441        	|1000           	|  354.41         	|  78.804         	|
training_step_and_backward         	|  0.27613        	|1000           	|  276.13         	|  61.399         	|
model_forward                      	|  0.16308        	|1000           	|  163.08         	|  36.261         	|
training_step                      	|  0.16294        	|1000           	|  162.94         	|  36.23          	|
backward                           	|  0.11173        	|1000           	|  111.73         	|  24.843         	|
run_validate_evaluation            	|  35.82          	|1              	|  35.82          	|  7.9647         	|
evaluation_step_and_end            	|  0.25293        	|139            	|  35.157         	|  7.8173         	|
validation_step                    	|  0.25288        	|139            	|  35.15          	|  7.8157         	|
get_train_batch                    	|  0.0042653      	|1025           	|  4.372          	|  0.97212        	|
fetch_next_train_batch             	|  0.0042479      	|1025           	|  4.3541         	|  0.96814        	|
zero_grad                          	|  0.0012999      	|1000           	|  1.2999         	|  0.28903        	|
on_train_batch_end                 	|  0.0011983      	|1000           	|  1.1983         	|  0.26644        	|
get_validate_batch                 	|  0.0025045      	|140            	|  0.35062        	|  0.077962       	|
fetch_next_validate_batch          	|  0.00249        	|140            	|  0.3486         	|  0.077512       	|
training_batch_to_device           	|  0.00024212     	|1000           	|  0.24212        	|  0.053835       	|
on_train_batch_start               	|  9.2443e-05     	|1000           	|  0.092443       	|  0.020555       	|
evaluation_batch_to_device         	|  0.00022882     	|139            	|  0.031806       	|  0.0070721      	|
on_train_end                       	|  0.022862       	|1              	|  0.022862       	|  0.0050834      	|
on_pretrain_routine_start          	|  0.022554       	|1              	|  0.022554       	|  0.0050148      	|
on_batch_start                     	|  1.5156e-05     	|1000           	|  0.015156       	|  0.00337        	|
on_before_zero_grad                	|  1.3792e-05     	|1000           	|  0.013792       	|  0.0030667      	|
on_batch_end                       	|  1.2881e-05     	|1000           	|  0.012881       	|  0.0028641      	|
on_after_backward                  	|  1.176e-05      	|1000           	|  0.01176        	|  0.0026148      	|
on_before_optimizer_step           	|  1.0742e-05     	|1000           	|  0.010742       	|  0.0023885      	|
on_before_backward                 	|  1.0503e-05     	|1000           	|  0.010503       	|  0.0023354      	|
configure_optimizers               	|  0.0087119      	|1              	|  0.0087119      	|  0.0019371      	|
on_train_epoch_end                 	|  0.00030887     	|25             	|  0.0077218      	|  0.001717       	|
on_train_epoch_start               	|  0.00029572     	|25             	|  0.0073931      	|  0.0016439      	|
training_step_end                  	|  5.9127e-06     	|1000           	|  0.0059127      	|  0.0013147      	|
on_validation_model_eval           	|  0.0045493      	|1              	|  0.0045493      	|  0.0010115      	|
on_validation_batch_end            	|  1.9481e-05     	|139            	|  0.0027078      	|  0.00060209     	|
on_validation_batch_start          	|  1.0244e-05     	|139            	|  0.0014239      	|  0.00031661     	|
on_train_start                     	|  0.0006926      	|1              	|  0.0006926      	|  0.000154       	|
validation_step_end                	|  4.6277e-06     	|139            	|  0.00064325     	|  0.00014303     	|
on_validation_start                	|  0.0003455      	|1              	|  0.0003455      	|  7.6822e-05     	|
on_epoch_end                       	|  1.0695e-05     	|26             	|  0.00027807     	|  6.1829e-05     	|
on_epoch_start                     	|  1.0507e-05     	|26             	|  0.00027319     	|  6.0745e-05     	|
on_validation_end                  	|  0.00011887     	|1              	|  0.00011887     	|  2.6432e-05     	|
on_before_accelerator_backend_setup	|  1.883e-05      	|2              	|  3.766e-05      	|  8.3738e-06     	|
teardown                           	|  1.5439e-05     	|2              	|  3.0878e-05     	|  6.8658e-06     	|
on_configure_sharded_model         	|  1.3846e-05     	|2              	|  2.7692e-05     	|  6.1574e-06     	|
setup                              	|  1.357e-05      	|2              	|  2.7141e-05     	|  6.0348e-06     	|
on_fit_end                         	|  2.2302e-05     	|1              	|  2.2302e-05     	|  4.9589e-06     	|
on_validation_epoch_end            	|  1.7783e-05     	|1              	|  1.7783e-05     	|  3.9541e-06     	|
on_fit_start                       	|  1.5349e-05     	|1              	|  1.5349e-05     	|  3.4129e-06     	|
prepare_data                       	|  6.8285e-06     	|2              	|  1.3657e-05     	|  3.0367e-06     	|
on_val_dataloader                  	|  6.577e-06      	|2              	|  1.3154e-05     	|  2.9248e-06     	|
configure_callbacks                	|  5.5504e-06     	|2              	|  1.1101e-05     	|  2.4683e-06     	|
on_pretrain_routine_end            	|  1.0349e-05     	|1              	|  1.0349e-05     	|  2.3011e-06     	|
on_validation_epoch_start          	|  9.9081e-06     	|1              	|  9.9081e-06     	|  2.2031e-06     	|
configure_sharded_model            	|  4.895e-06      	|2              	|  9.7899e-06     	|  2.1768e-06     	|
on_train_dataloader                	|  4.058e-06      	|1              	|  4.058e-06      	|  9.0231e-07     	|
