VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  556.09         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.88603        	|500            	|  443.01         	|  79.665         	|
run_training_batch                 	|  0.2927         	|1000           	|  292.7          	|  52.635         	|
optimizer_step_with_closure_0      	|  0.29004        	|1000           	|  290.04         	|  52.157         	|
training_step_and_backward         	|  0.2199         	|1000           	|  219.9          	|  39.544         	|
model_forward                      	|  0.13422        	|1000           	|  134.22         	|  24.136         	|
training_step                      	|  0.13405        	|1000           	|  134.05         	|  24.106         	|
backward                           	|  0.084295       	|1000           	|  84.295         	|  15.158         	|
run_validate_evaluation            	|  70.233         	|1              	|  70.233         	|  12.63          	|
evaluation_step_and_end            	|  0.21936        	|313            	|  68.659         	|  12.347         	|
validation_step                    	|  0.2193         	|313            	|  68.642         	|  12.344         	|
get_train_batch                    	|  0.028758       	|1500           	|  43.138         	|  7.7573         	|
fetch_next_train_batch             	|  0.028726       	|1500           	|  43.09          	|  7.7486         	|
zero_grad                          	|  0.0013541      	|1000           	|  1.3541         	|  0.24349        	|
on_train_batch_end                 	|  0.0013087      	|1000           	|  1.3087         	|  0.23535        	|
training_batch_to_device           	|  0.00059476     	|1000           	|  0.59476        	|  0.10695        	|
get_validate_batch                 	|  0.0018257      	|314            	|  0.57326        	|  0.10309        	|
fetch_next_validate_batch          	|  0.0018121      	|314            	|  0.569          	|  0.10232        	|
on_train_epoch_end                 	|  0.00026865     	|500            	|  0.13433        	|  0.024155       	|
on_train_epoch_start               	|  0.00026846     	|500            	|  0.13423        	|  0.024138       	|
on_train_batch_start               	|  0.00010764     	|1000           	|  0.10764        	|  0.019357       	|
evaluation_batch_to_device         	|  0.0002192      	|313            	|  0.068609       	|  0.012338       	|
on_batch_start                     	|  3.6256e-05     	|1000           	|  0.036256       	|  0.0065197      	|
on_pretrain_routine_start          	|  0.025152       	|1              	|  0.025152       	|  0.004523       	|
on_train_end                       	|  0.023547       	|1              	|  0.023547       	|  0.0042344      	|
on_before_zero_grad                	|  1.9832e-05     	|1000           	|  0.019832       	|  0.0035663      	|
on_batch_end                       	|  1.3456e-05     	|1000           	|  0.013456       	|  0.0024197      	|
on_before_optimizer_step           	|  1.2196e-05     	|1000           	|  0.012196       	|  0.0021931      	|
on_after_backward                  	|  1.1489e-05     	|1000           	|  0.011489       	|  0.002066       	|
on_before_backward                 	|  1.0682e-05     	|1000           	|  0.010682       	|  0.0019208      	|
configure_optimizers               	|  0.0085354      	|1              	|  0.0085354      	|  0.0015349      	|
training_step_end                  	|  7.2554e-06     	|1000           	|  0.0072554      	|  0.0013047      	|
on_validation_batch_end            	|  1.9574e-05     	|313            	|  0.0061267      	|  0.0011017      	|
on_epoch_start                     	|  1.0438e-05     	|501            	|  0.0052292      	|  0.00094035     	|
on_epoch_end                       	|  1.0118e-05     	|501            	|  0.005069       	|  0.00091154     	|
on_validation_model_eval           	|  0.0042251      	|1              	|  0.0042251      	|  0.00075978     	|
on_validation_batch_start          	|  1.0124e-05     	|313            	|  0.0031687      	|  0.00056981     	|
validation_step_end                	|  5.0555e-06     	|313            	|  0.0015824      	|  0.00028455     	|
on_train_start                     	|  0.00071384     	|1              	|  0.00071384     	|  0.00012837     	|
on_validation_start                	|  0.00033947     	|1              	|  0.00033947     	|  6.1045e-05     	|
on_validation_end                  	|  0.00011208     	|1              	|  0.00011208     	|  2.0155e-05     	|
on_before_accelerator_backend_setup	|  1.808e-05      	|2              	|  3.6159e-05     	|  6.5023e-06     	|
teardown                           	|  1.6315e-05     	|2              	|  3.2631e-05     	|  5.8679e-06     	|
on_validation_epoch_end            	|  3.1839e-05     	|1              	|  3.1839e-05     	|  5.7255e-06     	|
setup                              	|  1.5148e-05     	|2              	|  3.0296e-05     	|  5.448e-06      	|
on_configure_sharded_model         	|  1.348e-05      	|2              	|  2.696e-05      	|  4.8481e-06     	|
on_fit_end                         	|  2.2112e-05     	|1              	|  2.2112e-05     	|  3.9763e-06     	|
on_fit_start                       	|  1.7923e-05     	|1              	|  1.7923e-05     	|  3.223e-06      	|
on_val_dataloader                  	|  5.791e-06      	|2              	|  1.1582e-05     	|  2.0828e-06     	|
prepare_data                       	|  5.7005e-06     	|2              	|  1.1401e-05     	|  2.0502e-06     	|
configure_callbacks                	|  4.8585e-06     	|2              	|  9.7171e-06     	|  1.7474e-06     	|
configure_sharded_model            	|  4.8439e-06     	|2              	|  9.6879e-06     	|  1.7421e-06     	|
on_pretrain_routine_end            	|  9.638e-06      	|1              	|  9.638e-06      	|  1.7332e-06     	|
on_validation_epoch_start          	|  9.178e-06      	|1              	|  9.178e-06      	|  1.6504e-06     	|
on_train_dataloader                	|  4.128e-06      	|1              	|  4.128e-06      	|  7.4232e-07     	|
