VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  444.47         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.2561         	|63             	|  331.13         	|  74.5           	|
run_training_batch                 	|  0.30789        	|1000           	|  307.89         	|  69.272         	|
optimizer_step_with_closure_0      	|  0.30516        	|1000           	|  305.16         	|  68.656         	|
training_step_and_backward         	|  0.22835        	|1000           	|  228.35         	|  51.375         	|
model_forward                      	|  0.14193        	|1000           	|  141.93         	|  31.933         	|
training_step                      	|  0.1418         	|1000           	|  141.8          	|  31.902         	|
backward                           	|  0.085071       	|1000           	|  85.071         	|  19.14          	|
run_validate_evaluation            	|  70.294         	|1              	|  70.294         	|  15.815         	|
evaluation_step_and_end            	|  0.21946        	|313            	|  68.69          	|  15.454         	|
validation_step                    	|  0.2194         	|313            	|  68.674         	|  15.451         	|
get_train_batch                    	|  0.0073091      	|1063           	|  7.7696         	|  1.748          	|
fetch_next_train_batch             	|  0.0072904      	|1063           	|  7.7497         	|  1.7436         	|
zero_grad                          	|  0.001319       	|1000           	|  1.319          	|  0.29676        	|
on_train_batch_end                 	|  0.0011937      	|1000           	|  1.1937         	|  0.26857        	|
get_validate_batch                 	|  0.0018377      	|314            	|  0.57705        	|  0.12983        	|
fetch_next_validate_batch          	|  0.0018239      	|314            	|  0.57271        	|  0.12885        	|
training_batch_to_device           	|  0.00022529     	|1000           	|  0.22529        	|  0.050686       	|
on_train_batch_start               	|  9.1654e-05     	|1000           	|  0.091654       	|  0.020621       	|
evaluation_batch_to_device         	|  0.00022671     	|313            	|  0.07096        	|  0.015965       	|
on_train_end                       	|  0.024878       	|1              	|  0.024878       	|  0.0055971      	|
on_pretrain_routine_start          	|  0.022733       	|1              	|  0.022733       	|  0.0051145      	|
on_train_epoch_start               	|  0.00030589     	|63             	|  0.019271       	|  0.0043357      	|
on_train_epoch_end                 	|  0.00029095     	|63             	|  0.01833        	|  0.0041239      	|
on_batch_start                     	|  1.7487e-05     	|1000           	|  0.017487       	|  0.0039343      	|
on_before_zero_grad                	|  1.3487e-05     	|1000           	|  0.013487       	|  0.0030344      	|
on_batch_end                       	|  1.2973e-05     	|1000           	|  0.012973       	|  0.0029187      	|
on_after_backward                  	|  1.1214e-05     	|1000           	|  0.011214       	|  0.002523       	|
on_before_backward                 	|  1.0264e-05     	|1000           	|  0.010264       	|  0.0023092      	|
on_before_optimizer_step           	|  1.0014e-05     	|1000           	|  0.010014       	|  0.0022529      	|
configure_optimizers               	|  0.0081779      	|1              	|  0.0081779      	|  0.0018399      	|
on_validation_batch_end            	|  1.9606e-05     	|313            	|  0.0061366      	|  0.0013807      	|
training_step_end                  	|  5.8534e-06     	|1000           	|  0.0058534      	|  0.0013169      	|
on_validation_model_eval           	|  0.0040926      	|1              	|  0.0040926      	|  0.00092078     	|
on_validation_batch_start          	|  1.024e-05      	|313            	|  0.003205       	|  0.00072109     	|
validation_step_end                	|  4.8715e-06     	|313            	|  0.0015248      	|  0.00034306     	|
on_train_start                     	|  0.0007199      	|1              	|  0.0007199      	|  0.00016197     	|
on_epoch_end                       	|  1.0692e-05     	|64             	|  0.00068428     	|  0.00015395     	|
on_epoch_start                     	|  1.0453e-05     	|64             	|  0.00066896     	|  0.00015051     	|
on_validation_start                	|  0.00033043     	|1              	|  0.00033043     	|  7.4343e-05     	|
on_validation_end                  	|  0.00010571     	|1              	|  0.00010571     	|  2.3783e-05     	|
on_before_accelerator_backend_setup	|  1.7288e-05     	|2              	|  3.4576e-05     	|  7.7791e-06     	|
teardown                           	|  1.5334e-05     	|2              	|  3.0668e-05     	|  6.8999e-06     	|
on_validation_epoch_end            	|  3.0127e-05     	|1              	|  3.0127e-05     	|  6.7782e-06     	|
setup                              	|  1.4477e-05     	|2              	|  2.8955e-05     	|  6.5145e-06     	|
on_configure_sharded_model         	|  1.3551e-05     	|2              	|  2.7102e-05     	|  6.0976e-06     	|
on_fit_end                         	|  2.3555e-05     	|1              	|  2.3555e-05     	|  5.2996e-06     	|
on_fit_start                       	|  1.6371e-05     	|1              	|  1.6371e-05     	|  3.6833e-06     	|
on_val_dataloader                  	|  5.9365e-06     	|2              	|  1.1873e-05     	|  2.6713e-06     	|
prepare_data                       	|  5.8865e-06     	|2              	|  1.1773e-05     	|  2.6488e-06     	|
configure_sharded_model            	|  5.0045e-06     	|2              	|  1.0009e-05     	|  2.2519e-06     	|
on_pretrain_routine_end            	|  9.9089e-06     	|1              	|  9.9089e-06     	|  2.2294e-06     	|
configure_callbacks                	|  4.684e-06      	|2              	|  9.3679e-06     	|  2.1077e-06     	|
on_validation_epoch_start          	|  9.248e-06      	|1              	|  9.248e-06      	|  2.0807e-06     	|
on_train_dataloader                	|  4.0079e-06     	|1              	|  4.0079e-06     	|  9.0173e-07     	|
