VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  471.33         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.385          	|63             	|  402.26         	|  85.345         	|
run_training_batch                 	|  0.27011        	|1000           	|  270.11         	|  57.307         	|
optimizer_step_with_closure_0      	|  0.2657         	|1000           	|  265.7          	|  56.373         	|
training_step_and_backward         	|  0.20096        	|1000           	|  200.96         	|  42.637         	|
model_forward                      	|  0.10511        	|1000           	|  105.11         	|  22.3           	|
training_step                      	|  0.10491        	|1000           	|  104.91         	|  22.259         	|
backward                           	|  0.094298       	|1000           	|  94.298         	|  20.007         	|
run_validate_evaluation            	|  30.533         	|1              	|  30.533         	|  6.478          	|
get_train_batch                    	|  0.025465       	|1063           	|  27.07          	|  5.7432         	|
fetch_next_train_batch             	|  0.025442       	|1063           	|  27.045         	|  5.7379         	|
evaluation_step_and_end            	|  0.084316       	|313            	|  26.391         	|  5.5992         	|
validation_step                    	|  0.084246       	|313            	|  26.369         	|  5.5945         	|
on_train_batch_end                 	|  0.0023575      	|1000           	|  2.3575         	|  0.50019        	|
zero_grad                          	|  0.0015202      	|1000           	|  1.5202         	|  0.32254        	|
get_validate_batch                 	|  0.0032108      	|314            	|  1.0082         	|  0.2139         	|
fetch_next_validate_batch          	|  0.0031939      	|314            	|  1.0029         	|  0.21277        	|
training_batch_to_device           	|  0.00025939     	|1000           	|  0.25939        	|  0.055034       	|
on_train_end                       	|  0.13011        	|1              	|  0.13011        	|  0.027605       	|
on_train_batch_start               	|  9.432e-05      	|1000           	|  0.09432        	|  0.020011       	|
evaluation_batch_to_device         	|  0.00024435     	|313            	|  0.076482       	|  0.016227       	|
on_after_backward                  	|  2.597e-05      	|1000           	|  0.02597        	|  0.0055098      	|
on_pretrain_routine_start          	|  0.024662       	|1              	|  0.024662       	|  0.0052325      	|
on_train_epoch_start               	|  0.00036922     	|63             	|  0.023261       	|  0.0049352      	|
on_batch_start                     	|  2.1763e-05     	|1000           	|  0.021763       	|  0.0046173      	|
on_train_epoch_end                 	|  0.00034433     	|63             	|  0.021693       	|  0.0046024      	|
configure_optimizers               	|  0.021137       	|1              	|  0.021137       	|  0.0044846      	|
on_before_zero_grad                	|  1.7749e-05     	|1000           	|  0.017749       	|  0.0037658      	|
on_batch_end                       	|  1.6999e-05     	|1000           	|  0.016999       	|  0.0036065      	|
on_before_backward                 	|  1.4061e-05     	|1000           	|  0.014061       	|  0.0029833      	|
on_before_optimizer_step           	|  1.3149e-05     	|1000           	|  0.013149       	|  0.0027897      	|
on_validation_batch_end            	|  2.4744e-05     	|313            	|  0.007745       	|  0.0016432      	|
training_step_end                  	|  7.5657e-06     	|1000           	|  0.0075657      	|  0.0016052      	|
on_validation_model_eval           	|  0.0050497      	|1              	|  0.0050497      	|  0.0010714      	|
on_validation_batch_start          	|  1.1794e-05     	|313            	|  0.0036914      	|  0.00078318     	|
validation_step_end                	|  6.1873e-06     	|313            	|  0.0019366      	|  0.00041089     	|
on_train_start                     	|  0.0013115      	|1              	|  0.0013115      	|  0.00027825     	|
on_epoch_end                       	|  1.2049e-05     	|64             	|  0.00077111     	|  0.0001636      	|
on_validation_start                	|  0.00075957     	|1              	|  0.00075957     	|  0.00016115     	|
on_epoch_start                     	|  1.1663e-05     	|64             	|  0.00074646     	|  0.00015837     	|
on_validation_end                  	|  0.00017576     	|1              	|  0.00017576     	|  3.7291e-05     	|
setup                              	|  3.5799e-05     	|2              	|  7.1598e-05     	|  1.5191e-05     	|
on_fit_end                         	|  6.4874e-05     	|1              	|  6.4874e-05     	|  1.3764e-05     	|
teardown                           	|  2.7732e-05     	|2              	|  5.5464e-05     	|  1.1767e-05     	|
on_val_dataloader                  	|  2.768e-05      	|2              	|  5.536e-05      	|  1.1745e-05     	|
on_before_accelerator_backend_setup	|  2.3562e-05     	|2              	|  4.7123e-05     	|  9.9978e-06     	|
on_configure_sharded_model         	|  2.3422e-05     	|2              	|  4.6844e-05     	|  9.9386e-06     	|
on_validation_epoch_end            	|  4.3949e-05     	|1              	|  4.3949e-05     	|  9.3244e-06     	|
on_fit_start                       	|  4.092e-05      	|1              	|  4.092e-05      	|  8.6819e-06     	|
configure_callbacks                	|  8.448e-06      	|2              	|  1.6896e-05     	|  3.5847e-06     	|
on_pretrain_routine_end            	|  1.6341e-05     	|1              	|  1.6341e-05     	|  3.467e-06      	|
configure_sharded_model            	|  7.4189e-06     	|2              	|  1.4838e-05     	|  3.1481e-06     	|
prepare_data                       	|  7.3528e-06     	|2              	|  1.4706e-05     	|  3.12e-06       	|
on_validation_epoch_start          	|  8.855e-06      	|1              	|  8.855e-06      	|  1.8787e-06     	|
on_train_dataloader                	|  7.512e-06      	|1              	|  7.512e-06      	|  1.5938e-06     	|
