VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  473.92         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.437          	|63             	|  405.53         	|  85.57          	|
run_training_batch                 	|  0.2737         	|1000           	|  273.7          	|  57.752         	|
optimizer_step_with_closure_0      	|  0.26941        	|1000           	|  269.41         	|  56.847         	|
training_step_and_backward         	|  0.20301        	|1000           	|  203.01         	|  42.837         	|
model_forward                      	|  0.10699        	|1000           	|  106.99         	|  22.576         	|
training_step                      	|  0.1068         	|1000           	|  106.8          	|  22.535         	|
backward                           	|  0.094446       	|1000           	|  94.446         	|  19.929         	|
run_validate_evaluation            	|  30.612         	|1              	|  30.612         	|  6.4594         	|
get_train_batch                    	|  0.025226       	|1063           	|  26.815         	|  5.6582         	|
fetch_next_train_batch             	|  0.025201       	|1063           	|  26.789         	|  5.6526         	|
evaluation_step_and_end            	|  0.084106       	|313            	|  26.325         	|  5.5548         	|
validation_step                    	|  0.08404        	|313            	|  26.304         	|  5.5504         	|
on_train_batch_end                 	|  0.0022667      	|1000           	|  2.2667         	|  0.47828        	|
zero_grad                          	|  0.0015375      	|1000           	|  1.5375         	|  0.32442        	|
get_validate_batch                 	|  0.0033891      	|314            	|  1.0642         	|  0.22455        	|
fetch_next_validate_batch          	|  0.0033722      	|314            	|  1.0589         	|  0.22343        	|
training_batch_to_device           	|  0.00032003     	|1000           	|  0.32003        	|  0.06753        	|
on_train_batch_start               	|  9.4896e-05     	|1000           	|  0.094896       	|  0.020024       	|
evaluation_batch_to_device         	|  0.00028646     	|313            	|  0.089661       	|  0.018919       	|
on_train_end                       	|  0.049813       	|1              	|  0.049813       	|  0.010511       	|
on_pretrain_routine_start          	|  0.026375       	|1              	|  0.026375       	|  0.0055653      	|
on_after_backward                  	|  2.5215e-05     	|1000           	|  0.025215       	|  0.0053206      	|
on_train_epoch_end                 	|  0.00039293     	|63             	|  0.024754       	|  0.0052234      	|
on_train_epoch_start               	|  0.00036416     	|63             	|  0.022942       	|  0.004841       	|
on_batch_start                     	|  2.1799e-05     	|1000           	|  0.021799       	|  0.0045997      	|
on_before_zero_grad                	|  1.7747e-05     	|1000           	|  0.017747       	|  0.0037447      	|
on_batch_end                       	|  1.5242e-05     	|1000           	|  0.015242       	|  0.0032162      	|
on_before_backward                 	|  1.3338e-05     	|1000           	|  0.013338       	|  0.0028145      	|
configure_optimizers               	|  0.012995       	|1              	|  0.012995       	|  0.002742       	|
on_before_optimizer_step           	|  1.2547e-05     	|1000           	|  0.012547       	|  0.0026475      	|
on_validation_batch_end            	|  2.3922e-05     	|313            	|  0.0074875      	|  0.0015799      	|
training_step_end                  	|  7.0869e-06     	|1000           	|  0.0070869      	|  0.0014954      	|
on_validation_model_eval           	|  0.0051462      	|1              	|  0.0051462      	|  0.0010859      	|
on_validation_batch_start          	|  1.207e-05      	|313            	|  0.003778       	|  0.00079718     	|
validation_step_end                	|  5.5976e-06     	|313            	|  0.001752       	|  0.00036969     	|
on_train_start                     	|  0.0014302      	|1              	|  0.0014302      	|  0.00030179     	|
on_epoch_end                       	|  1.2955e-05     	|64             	|  0.00082914     	|  0.00017495     	|
on_epoch_start                     	|  1.1324e-05     	|64             	|  0.00072476     	|  0.00015293     	|
on_validation_start                	|  0.00070941     	|1              	|  0.00070941     	|  0.00014969     	|
on_validation_end                  	|  0.00019483     	|1              	|  0.00019483     	|  4.111e-05      	|
setup                              	|  3.391e-05      	|2              	|  6.7821e-05     	|  1.4311e-05     	|
on_fit_end                         	|  6.276e-05      	|1              	|  6.276e-05      	|  1.3243e-05     	|
on_before_accelerator_backend_setup	|  3.1016e-05     	|2              	|  6.2032e-05     	|  1.3089e-05     	|
teardown                           	|  2.8397e-05     	|2              	|  5.6794e-05     	|  1.1984e-05     	|
on_val_dataloader                  	|  2.3702e-05     	|2              	|  4.7404e-05     	|  1.0003e-05     	|
on_configure_sharded_model         	|  2.2643e-05     	|2              	|  4.5286e-05     	|  9.5558e-06     	|
on_validation_epoch_end            	|  4.0878e-05     	|1              	|  4.0878e-05     	|  8.6255e-06     	|
on_fit_start                       	|  3.9728e-05     	|1              	|  3.9728e-05     	|  8.383e-06      	|
prepare_data                       	|  1.0323e-05     	|2              	|  2.0646e-05     	|  4.3564e-06     	|
configure_callbacks                	|  9.5163e-06     	|2              	|  1.9033e-05     	|  4.016e-06      	|
on_pretrain_routine_end            	|  1.4681e-05     	|1              	|  1.4681e-05     	|  3.0979e-06     	|
on_validation_epoch_start          	|  1.362e-05      	|1              	|  1.362e-05      	|  2.8738e-06     	|
configure_sharded_model            	|  6.6636e-06     	|2              	|  1.3327e-05     	|  2.8121e-06     	|
on_train_dataloader                	|  8.4508e-06     	|1              	|  8.4508e-06     	|  1.7832e-06     	|
