VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  743.95         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  4.1533         	|167            	|  693.61         	|  93.233         	|
run_training_batch                 	|  0.24488        	|1000           	|  244.88         	|  32.916         	|
optimizer_step_with_closure_0      	|  0.24268        	|1000           	|  242.68         	|  32.621         	|
training_step_and_backward         	|  0.18171        	|1000           	|  181.71         	|  24.425         	|
model_forward                      	|  0.094052       	|1000           	|  94.052         	|  12.642         	|
training_step                      	|  0.09388        	|1000           	|  93.88          	|  12.619         	|
backward                           	|  0.086365       	|1000           	|  86.365         	|  11.609         	|
get_train_batch                    	|  0.067876       	|1167           	|  79.211         	|  10.647         	|
fetch_next_train_batch             	|  0.067849       	|1167           	|  79.18          	|  10.643         	|
run_validate_evaluation            	|  16.663         	|1              	|  16.663         	|  2.2397         	|
evaluation_step_and_end            	|  0.10712        	|125            	|  13.39          	|  1.7999         	|
validation_step                    	|  0.10705        	|125            	|  13.381         	|  1.7986         	|
on_train_batch_end                 	|  0.0016263      	|1000           	|  1.6263         	|  0.2186         	|
zero_grad                          	|  0.0012631      	|1000           	|  1.2631         	|  0.16979        	|
get_validate_batch                 	|  0.0059368      	|126            	|  0.74804        	|  0.10055        	|
fetch_next_validate_batch          	|  0.0059182      	|126            	|  0.74569        	|  0.10023        	|
training_batch_to_device           	|  0.00039597     	|1000           	|  0.39597        	|  0.053225       	|
on_train_batch_start               	|  0.00016978     	|1000           	|  0.16978        	|  0.022822       	|
on_batch_start                     	|  9.2553e-05     	|1000           	|  0.092553       	|  0.012441       	|
on_train_end                       	|  0.064197       	|1              	|  0.064197       	|  0.0086292      	|
on_train_epoch_start               	|  0.0003085      	|167            	|  0.05152        	|  0.0069251      	|
on_train_epoch_end                 	|  0.00030206     	|167            	|  0.050444       	|  0.0067806      	|
configure_optimizers               	|  0.031918       	|1              	|  0.031918       	|  0.0042904      	|
evaluation_batch_to_device         	|  0.00023182     	|125            	|  0.028977       	|  0.003895       	|
on_pretrain_routine_start          	|  0.021299       	|1              	|  0.021299       	|  0.0028629      	|
on_after_backward                  	|  1.8463e-05     	|1000           	|  0.018463       	|  0.0024817      	|
on_before_zero_grad                	|  1.5879e-05     	|1000           	|  0.015879       	|  0.0021345      	|
on_batch_end                       	|  1.3994e-05     	|1000           	|  0.013994       	|  0.0018811      	|
on_before_optimizer_step           	|  1.1483e-05     	|1000           	|  0.011483       	|  0.0015436      	|
on_before_backward                 	|  1.1239e-05     	|1000           	|  0.011239       	|  0.0015107      	|
training_step_end                  	|  6.3863e-06     	|1000           	|  0.0063863      	|  0.00085843     	|
on_validation_model_eval           	|  0.0039134      	|1              	|  0.0039134      	|  0.00052603     	|
on_validation_batch_end            	|  2.7711e-05     	|125            	|  0.0034638      	|  0.0004656      	|
on_epoch_start                     	|  1.1158e-05     	|168            	|  0.0018746      	|  0.00025198     	|
on_epoch_end                       	|  1.0698e-05     	|168            	|  0.0017973      	|  0.00024159     	|
on_train_start                     	|  0.0016766      	|1              	|  0.0016766      	|  0.00022537     	|
on_validation_batch_start          	|  1.2935e-05     	|125            	|  0.0016169      	|  0.00021734     	|
validation_step_end                	|  6.2911e-06     	|125            	|  0.00078639     	|  0.0001057      	|
on_validation_start                	|  0.00047372     	|1              	|  0.00047372     	|  6.3676e-05     	|
on_validation_end                  	|  0.00016971     	|1              	|  0.00016971     	|  2.2813e-05     	|
on_fit_end                         	|  0.00010226     	|1              	|  0.00010226     	|  1.3745e-05     	|
on_before_accelerator_backend_setup	|  2.96e-05       	|2              	|  5.92e-05       	|  7.9576e-06     	|
setup                              	|  2.815e-05      	|2              	|  5.63e-05       	|  7.5677e-06     	|
on_configure_sharded_model         	|  2.3441e-05     	|2              	|  4.6883e-05     	|  6.3019e-06     	|
on_fit_start                       	|  4.4839e-05     	|1              	|  4.4839e-05     	|  6.0272e-06     	|
teardown                           	|  2.1799e-05     	|2              	|  4.3597e-05     	|  5.8602e-06     	|
on_validation_epoch_end            	|  3.8661e-05     	|1              	|  3.8661e-05     	|  5.1967e-06     	|
configure_callbacks                	|  1.2668e-05     	|2              	|  2.5336e-05     	|  3.4056e-06     	|
prepare_data                       	|  9.1959e-06     	|2              	|  1.8392e-05     	|  2.4722e-06     	|
on_val_dataloader                  	|  7.771e-06      	|2              	|  1.5542e-05     	|  2.0891e-06     	|
configure_sharded_model            	|  6.6608e-06     	|2              	|  1.3322e-05     	|  1.7907e-06     	|
on_pretrain_routine_end            	|  1.1697e-05     	|1              	|  1.1697e-05     	|  1.5723e-06     	|
on_validation_epoch_start          	|  1.0287e-05     	|1              	|  1.0287e-05     	|  1.3828e-06     	|
on_train_dataloader                	|  5.642e-06      	|1              	|  5.642e-06      	|  7.5838e-07     	|
