VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  661.65         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.6678         	|167            	|  612.51         	|  92.574         	|
run_training_batch                 	|  0.24602        	|1000           	|  246.02         	|  37.183         	|
optimizer_step_with_closure_0      	|  0.24392        	|1000           	|  243.92         	|  36.866         	|
training_step_and_backward         	|  0.18209        	|1000           	|  182.09         	|  27.521         	|
model_forward                      	|  0.094447       	|1000           	|  94.447         	|  14.274         	|
training_step                      	|  0.094272       	|1000           	|  94.272         	|  14.248         	|
backward                           	|  0.086277       	|1000           	|  86.277         	|  13.04          	|
get_train_batch                    	|  0.07058        	|1167           	|  82.367         	|  12.449         	|
fetch_next_train_batch             	|  0.07049        	|1167           	|  82.262         	|  12.433         	|
run_validate_evaluation            	|  16.777         	|1              	|  16.777         	|  2.5356         	|
evaluation_step_and_end            	|  0.10697        	|125            	|  13.371         	|  2.0209         	|
validation_step                    	|  0.1069         	|125            	|  13.362         	|  2.0195         	|
on_train_batch_end                 	|  0.0016594      	|1000           	|  1.6594         	|  0.2508         	|
zero_grad                          	|  0.0013405      	|1000           	|  1.3405         	|  0.2026         	|
get_validate_batch                 	|  0.0071553      	|126            	|  0.90156        	|  0.13626        	|
fetch_next_validate_batch          	|  0.0071373      	|126            	|  0.8993         	|  0.13592        	|
training_batch_to_device           	|  0.00043078     	|1000           	|  0.43078        	|  0.065107       	|
on_train_batch_start               	|  9.7475e-05     	|1000           	|  0.097475       	|  0.014732       	|
on_train_epoch_end                 	|  0.00032884     	|167            	|  0.054916       	|  0.0082999      	|
on_train_epoch_start               	|  0.00032646     	|167            	|  0.054518       	|  0.0082398      	|
on_train_end                       	|  0.046744       	|1              	|  0.046744       	|  0.0070647      	|
on_batch_start                     	|  4.3535e-05     	|1000           	|  0.043535       	|  0.0065797      	|
evaluation_batch_to_device         	|  0.00024718     	|125            	|  0.030898       	|  0.0046698      	|
on_pretrain_routine_start          	|  0.022349       	|1              	|  0.022349       	|  0.0033778      	|
on_after_backward                  	|  1.8318e-05     	|1000           	|  0.018318       	|  0.0027685      	|
on_before_zero_grad                	|  1.5441e-05     	|1000           	|  0.015441       	|  0.0023337      	|
on_batch_end                       	|  1.4331e-05     	|1000           	|  0.014331       	|  0.0021659      	|
on_before_optimizer_step           	|  1.1927e-05     	|1000           	|  0.011927       	|  0.0018027      	|
on_before_backward                 	|  1.1829e-05     	|1000           	|  0.011829       	|  0.0017877      	|
configure_optimizers               	|  0.010432       	|1              	|  0.010432       	|  0.0015767      	|
training_step_end                  	|  6.672e-06      	|1000           	|  0.006672       	|  0.0010084      	|
on_validation_model_eval           	|  0.0038658      	|1              	|  0.0038658      	|  0.00058427     	|
on_validation_batch_end            	|  2.6709e-05     	|125            	|  0.0033386      	|  0.00050459     	|
on_epoch_end                       	|  1.0821e-05     	|168            	|  0.0018179      	|  0.00027475     	|
on_epoch_start                     	|  1.0388e-05     	|168            	|  0.0017451      	|  0.00026376     	|
on_train_start                     	|  0.0015814      	|1              	|  0.0015814      	|  0.00023901     	|
on_validation_batch_start          	|  1.2587e-05     	|125            	|  0.0015734      	|  0.0002378      	|
validation_step_end                	|  6.6529e-06     	|125            	|  0.00083162     	|  0.00012569     	|
on_validation_start                	|  0.00047932     	|1              	|  0.00047932     	|  7.2443e-05     	|
on_validation_end                  	|  0.00018492     	|1              	|  0.00018492     	|  2.7949e-05     	|
on_fit_end                         	|  5.4793e-05     	|1              	|  5.4793e-05     	|  8.2813e-06     	|
on_before_accelerator_backend_setup	|  2.4877e-05     	|2              	|  4.9755e-05     	|  7.5198e-06     	|
setup                              	|  2.4597e-05     	|2              	|  4.9194e-05     	|  7.4351e-06     	|
teardown                           	|  2.448e-05      	|2              	|  4.896e-05      	|  7.3996e-06     	|
on_configure_sharded_model         	|  2.2052e-05     	|2              	|  4.4104e-05     	|  6.6657e-06     	|
on_fit_start                       	|  4.1395e-05     	|1              	|  4.1395e-05     	|  6.2564e-06     	|
on_validation_epoch_end            	|  2.9773e-05     	|1              	|  2.9773e-05     	|  4.4997e-06     	|
configure_callbacks                	|  9.0413e-06     	|2              	|  1.8083e-05     	|  2.7329e-06     	|
prepare_data                       	|  7.6406e-06     	|2              	|  1.5281e-05     	|  2.3095e-06     	|
on_val_dataloader                  	|  7.6117e-06     	|2              	|  1.5223e-05     	|  2.3008e-06     	|
on_pretrain_routine_end            	|  1.3471e-05     	|1              	|  1.3471e-05     	|  2.0359e-06     	|
configure_sharded_model            	|  6.5658e-06     	|2              	|  1.3132e-05     	|  1.9847e-06     	|
on_validation_epoch_start          	|  1.2318e-05     	|1              	|  1.2318e-05     	|  1.8617e-06     	|
on_train_dataloader                	|  6.0741e-06     	|1              	|  6.0741e-06     	|  9.1802e-07     	|
