VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  521.44         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.2037         	|200            	|  440.75         	|  84.524         	|
run_training_batch                 	|  0.36808        	|1000           	|  368.08         	|  70.588         	|
optimizer_step_with_closure_0      	|  0.36538        	|1000           	|  365.38         	|  70.07          	|
training_step_and_backward         	|  0.28525        	|1000           	|  285.25         	|  54.703         	|
model_forward                      	|  0.16769        	|1000           	|  167.69         	|  32.158         	|
training_step                      	|  0.16754        	|1000           	|  167.54         	|  32.13          	|
backward                           	|  0.11622        	|1000           	|  116.22         	|  22.288         	|
run_validate_evaluation            	|  35.808         	|1              	|  35.808         	|  6.8671         	|
evaluation_step_and_end            	|  0.25281        	|139            	|  35.141         	|  6.7391         	|
validation_step                    	|  0.25276        	|139            	|  35.133         	|  6.7377         	|
get_train_batch                    	|  0.016571       	|1200           	|  19.886         	|  3.8136         	|
fetch_next_train_batch             	|  0.016546       	|1200           	|  19.855         	|  3.8077         	|
zero_grad                          	|  0.0013125      	|1000           	|  1.3125         	|  0.25171        	|
on_train_batch_end                 	|  0.0012661      	|1000           	|  1.2661         	|  0.24281        	|
get_validate_batch                 	|  0.0024618      	|140            	|  0.34465        	|  0.066095       	|
fetch_next_validate_batch          	|  0.0024472      	|140            	|  0.34261        	|  0.065705       	|
training_batch_to_device           	|  0.00034015     	|1000           	|  0.34015        	|  0.065233       	|
on_train_batch_start               	|  9.6187e-05     	|1000           	|  0.096187       	|  0.018446       	|
on_train_epoch_start               	|  0.00027332     	|200            	|  0.054664       	|  0.010483       	|
on_train_epoch_end                 	|  0.00024714     	|200            	|  0.049429       	|  0.0094792      	|
evaluation_batch_to_device         	|  0.00025505     	|139            	|  0.035452       	|  0.0067988      	|
on_train_end                       	|  0.02402        	|1              	|  0.02402        	|  0.0046064      	|
on_batch_start                     	|  2.354e-05      	|1000           	|  0.02354        	|  0.0045143      	|
on_pretrain_routine_start          	|  0.022714       	|1              	|  0.022714       	|  0.004356       	|
on_before_zero_grad                	|  1.5896e-05     	|1000           	|  0.015896       	|  0.0030484      	|
on_batch_end                       	|  1.377e-05      	|1000           	|  0.01377        	|  0.0026407      	|
on_before_optimizer_step           	|  1.2512e-05     	|1000           	|  0.012512       	|  0.0023995      	|
on_after_backward                  	|  1.2398e-05     	|1000           	|  0.012398       	|  0.0023776      	|
on_before_backward                 	|  1.1146e-05     	|1000           	|  0.011146       	|  0.0021375      	|
configure_optimizers               	|  0.0086691      	|1              	|  0.0086691      	|  0.0016625      	|
training_step_end                  	|  6.3176e-06     	|1000           	|  0.0063176      	|  0.0012116      	|
on_validation_model_eval           	|  0.0045848      	|1              	|  0.0045848      	|  0.00087925     	|
on_validation_batch_end            	|  2.0487e-05     	|139            	|  0.0028477      	|  0.00054612     	|
on_epoch_end                       	|  1.0903e-05     	|201            	|  0.0021915      	|  0.00042027     	|
on_epoch_start                     	|  1.0869e-05     	|201            	|  0.0021846      	|  0.00041895     	|
on_validation_batch_start          	|  1.0441e-05     	|139            	|  0.0014514      	|  0.00027833     	|
on_train_start                     	|  0.00080282     	|1              	|  0.00080282     	|  0.00015396     	|
validation_step_end                	|  5.3778e-06     	|139            	|  0.00074752     	|  0.00014336     	|
on_validation_start                	|  0.00032339     	|1              	|  0.00032339     	|  6.2017e-05     	|
on_validation_end                  	|  0.00010672     	|1              	|  0.00010672     	|  2.0466e-05     	|
on_before_accelerator_backend_setup	|  1.874e-05      	|2              	|  3.748e-05      	|  7.1877e-06     	|
teardown                           	|  1.559e-05      	|2              	|  3.1179e-05     	|  5.9794e-06     	|
setup                              	|  1.5049e-05     	|2              	|  3.0097e-05     	|  5.7719e-06     	|
on_configure_sharded_model         	|  1.4017e-05     	|2              	|  2.8033e-05     	|  5.376e-06      	|
on_fit_end                         	|  2.1851e-05     	|1              	|  2.1851e-05     	|  4.1905e-06     	|
on_validation_epoch_end            	|  1.7472e-05     	|1              	|  1.7472e-05     	|  3.3507e-06     	|
on_fit_start                       	|  1.7413e-05     	|1              	|  1.7413e-05     	|  3.3394e-06     	|
on_pretrain_routine_end            	|  1.3756e-05     	|1              	|  1.3756e-05     	|  2.6381e-06     	|
on_val_dataloader                  	|  5.8405e-06     	|2              	|  1.1681e-05     	|  2.2401e-06     	|
prepare_data                       	|  5.676e-06      	|2              	|  1.1352e-05     	|  2.177e-06      	|
configure_callbacks                	|  5.6205e-06     	|2              	|  1.1241e-05     	|  2.1557e-06     	|
configure_sharded_model            	|  5.3505e-06     	|2              	|  1.0701e-05     	|  2.0522e-06     	|
on_validation_epoch_start          	|  1.0159e-05     	|1              	|  1.0159e-05     	|  1.9482e-06     	|
on_train_dataloader                	|  4.0381e-06     	|1              	|  4.0381e-06     	|  7.7441e-07     	|
