VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  456.12         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.2769         	|63             	|  395.44         	|  86.698         	|
run_training_batch                 	|  0.26119        	|1000           	|  261.19         	|  57.264         	|
optimizer_step_with_closure_0      	|  0.25767        	|1000           	|  257.67         	|  56.492         	|
training_step_and_backward         	|  0.19772        	|1000           	|  197.72         	|  43.349         	|
backward                           	|  0.10814        	|1000           	|  108.14         	|  23.71          	|
model_forward                      	|  0.088264       	|1000           	|  88.264         	|  19.351         	|
training_step                      	|  0.088105       	|1000           	|  88.105         	|  19.316         	|
run_validate_evaluation            	|  30.486         	|1              	|  30.486         	|  6.6837         	|
get_train_batch                    	|  0.027894       	|1063           	|  29.651         	|  6.5007         	|
fetch_next_train_batch             	|  0.027871       	|1063           	|  29.627         	|  6.4956         	|
evaluation_step_and_end            	|  0.083994       	|313            	|  26.29          	|  5.7639         	|
validation_step                    	|  0.08393        	|313            	|  26.27          	|  5.7595         	|
on_train_batch_end                 	|  0.001879       	|1000           	|  1.879          	|  0.41195        	|
zero_grad                          	|  0.001283       	|1000           	|  1.283          	|  0.28128        	|
get_validate_batch                 	|  0.0031598      	|314            	|  0.99216        	|  0.21752        	|
fetch_next_validate_batch          	|  0.0031427      	|314            	|  0.98681        	|  0.21635        	|
training_batch_to_device           	|  0.00023068     	|1000           	|  0.23068        	|  0.050575       	|
on_train_batch_start               	|  9.0544e-05     	|1000           	|  0.090544       	|  0.019851       	|
evaluation_batch_to_device         	|  0.00019158     	|313            	|  0.059966       	|  0.013147       	|
on_train_end                       	|  0.045225       	|1              	|  0.045225       	|  0.0099152      	|
on_pretrain_routine_start          	|  0.021411       	|1              	|  0.021411       	|  0.0046942      	|
on_train_epoch_start               	|  0.00031943     	|63             	|  0.020124       	|  0.0044121      	|
on_train_epoch_end                 	|  0.00031678     	|63             	|  0.019957       	|  0.0043755      	|
on_batch_start                     	|  1.9728e-05     	|1000           	|  0.019728       	|  0.0043252      	|
on_after_backward                  	|  1.7236e-05     	|1000           	|  0.017236       	|  0.0037789      	|
on_batch_end                       	|  1.5644e-05     	|1000           	|  0.015644       	|  0.0034298      	|
on_before_zero_grad                	|  1.4158e-05     	|1000           	|  0.014158       	|  0.003104       	|
configure_optimizers               	|  0.012981       	|1              	|  0.012981       	|  0.0028459      	|
on_before_optimizer_step           	|  1.1535e-05     	|1000           	|  0.011535       	|  0.002529       	|
on_before_backward                 	|  1.1431e-05     	|1000           	|  0.011431       	|  0.0025061      	|
on_validation_batch_end            	|  2.3545e-05     	|313            	|  0.0073697      	|  0.0016157      	|
training_step_end                  	|  6.6372e-06     	|1000           	|  0.0066372      	|  0.0014552      	|
on_validation_model_eval           	|  0.0045359      	|1              	|  0.0045359      	|  0.00099446     	|
on_validation_batch_start          	|  1.1621e-05     	|313            	|  0.0036374      	|  0.00079746     	|
validation_step_end                	|  5.7833e-06     	|313            	|  0.0018102      	|  0.00039687     	|
on_train_start                     	|  0.0012633      	|1              	|  0.0012633      	|  0.00027698     	|
on_epoch_start                     	|  1.161e-05      	|64             	|  0.00074304     	|  0.0001629      	|
on_epoch_end                       	|  1.1033e-05     	|64             	|  0.00070611     	|  0.00015481     	|
on_validation_start                	|  0.00067836     	|1              	|  0.00067836     	|  0.00014873     	|
on_validation_end                  	|  0.00014084     	|1              	|  0.00014084     	|  3.0878e-05     	|
teardown                           	|  3.6754e-05     	|2              	|  7.3507e-05     	|  1.6116e-05     	|
setup                              	|  3.0314e-05     	|2              	|  6.0627e-05     	|  1.3292e-05     	|
on_before_accelerator_backend_setup	|  2.4478e-05     	|2              	|  4.8956e-05     	|  1.0733e-05     	|
on_configure_sharded_model         	|  2.3161e-05     	|2              	|  4.6322e-05     	|  1.0156e-05     	|
on_fit_start                       	|  4.2344e-05     	|1              	|  4.2344e-05     	|  9.2835e-06     	|
on_fit_end                         	|  3.3941e-05     	|1              	|  3.3941e-05     	|  7.4413e-06     	|
on_validation_epoch_end            	|  3.0139e-05     	|1              	|  3.0139e-05     	|  6.6078e-06     	|
on_val_dataloader                  	|  1.2368e-05     	|2              	|  2.4736e-05     	|  5.4231e-06     	|
prepare_data                       	|  8.5505e-06     	|2              	|  1.7101e-05     	|  3.7492e-06     	|
configure_callbacks                	|  8.1677e-06     	|2              	|  1.6335e-05     	|  3.5814e-06     	|
configure_sharded_model            	|  6.835e-06      	|2              	|  1.367e-05      	|  2.997e-06      	|
on_pretrain_routine_end            	|  1.2172e-05     	|1              	|  1.2172e-05     	|  2.6687e-06     	|
on_validation_epoch_start          	|  1.1398e-05     	|1              	|  1.1398e-05     	|  2.4988e-06     	|
on_train_dataloader                	|  5.7127e-06     	|1              	|  5.7127e-06     	|  1.2525e-06     	|
