VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  398.74         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  13.708         	|25             	|  342.7          	|  85.946         	|
run_training_batch                 	|  0.28554        	|1000           	|  285.54         	|  71.612         	|
optimizer_step_with_closure_0      	|  0.28222        	|1000           	|  282.22         	|  70.778         	|
training_step_and_backward         	|  0.21722        	|1000           	|  217.22         	|  54.478         	|
model_forward                      	|  0.10814        	|1000           	|  108.14         	|  27.121         	|
training_step                      	|  0.10795        	|1000           	|  107.95         	|  27.072         	|
backward                           	|  0.10751        	|1000           	|  107.51         	|  26.964         	|
run_validate_evaluation            	|  17.399         	|1              	|  17.399         	|  4.3635         	|
evaluation_step_and_end            	|  0.10136        	|139            	|  14.089         	|  3.5334         	|
validation_step                    	|  0.10123        	|139            	|  14.072         	|  3.529          	|
get_train_batch                    	|  0.012129       	|1025           	|  12.432         	|  3.1178         	|
fetch_next_train_batch             	|  0.012103       	|1025           	|  12.405         	|  3.1111         	|
on_train_batch_end                 	|  0.002514       	|1000           	|  2.514          	|  0.63049        	|
zero_grad                          	|  0.001534       	|1000           	|  1.534          	|  0.38472        	|
get_validate_batch                 	|  0.0055535      	|140            	|  0.77749        	|  0.19499        	|
fetch_next_validate_batch          	|  0.0055264      	|140            	|  0.7737         	|  0.19404        	|
training_batch_to_device           	|  0.00030359     	|1000           	|  0.30359        	|  0.076138       	|
on_train_batch_start               	|  9.7948e-05     	|1000           	|  0.097948       	|  0.024565       	|
on_train_end                       	|  0.045257       	|1              	|  0.045257       	|  0.01135        	|
evaluation_batch_to_device         	|  0.00031671     	|139            	|  0.044022       	|  0.01104        	|
on_after_backward                  	|  2.5695e-05     	|1000           	|  0.025695       	|  0.0064441      	|
on_pretrain_routine_start          	|  0.022749       	|1              	|  0.022749       	|  0.0057053      	|
on_batch_start                     	|  2.2585e-05     	|1000           	|  0.022585       	|  0.0056641      	|
on_before_zero_grad                	|  1.804e-05      	|1000           	|  0.01804        	|  0.0045244      	|
on_batch_end                       	|  1.6585e-05     	|1000           	|  0.016585       	|  0.0041594      	|
on_before_optimizer_step           	|  1.3642e-05     	|1000           	|  0.013642       	|  0.0034213      	|
on_train_epoch_end                 	|  0.00054494     	|25             	|  0.013624       	|  0.0034167      	|
on_before_backward                 	|  1.3551e-05     	|1000           	|  0.013551       	|  0.0033985      	|
on_train_epoch_start               	|  0.00044232     	|25             	|  0.011058       	|  0.0027733      	|
configure_optimizers               	|  0.010981       	|1              	|  0.010981       	|  0.0027538      	|
training_step_end                  	|  7.8043e-06     	|1000           	|  0.0078043      	|  0.0019573      	|
on_validation_model_eval           	|  0.0064387      	|1              	|  0.0064387      	|  0.0016148      	|
on_validation_batch_end            	|  4.5016e-05     	|139            	|  0.0062573      	|  0.0015693      	|
on_validation_batch_start          	|  1.8502e-05     	|139            	|  0.0025718      	|  0.00064498     	|
validation_step_end                	|  1.0198e-05     	|139            	|  0.0014175      	|  0.00035549     	|
on_train_start                     	|  0.0012868      	|1              	|  0.0012868      	|  0.00032273     	|
on_validation_start                	|  0.00063562     	|1              	|  0.00063562     	|  0.00015941     	|
on_epoch_end                       	|  1.2736e-05     	|26             	|  0.00033114     	|  8.3048e-05     	|
on_epoch_start                     	|  1.182e-05      	|26             	|  0.00030731     	|  7.7071e-05     	|
on_validation_end                  	|  0.00020263     	|1              	|  0.00020263     	|  5.0817e-05     	|
on_configure_sharded_model         	|  3.1294e-05     	|2              	|  6.2589e-05     	|  1.5697e-05     	|
on_before_accelerator_backend_setup	|  2.6289e-05     	|2              	|  5.2579e-05     	|  1.3186e-05     	|
setup                              	|  2.4442e-05     	|2              	|  4.8883e-05     	|  1.226e-05      	|
teardown                           	|  2.4387e-05     	|2              	|  4.8773e-05     	|  1.2232e-05     	|
on_fit_start                       	|  4.1012e-05     	|1              	|  4.1012e-05     	|  1.0285e-05     	|
on_validation_epoch_end            	|  3.5677e-05     	|1              	|  3.5677e-05     	|  8.9475e-06     	|
on_val_dataloader                  	|  1.5352e-05     	|2              	|  3.0704e-05     	|  7.7003e-06     	|
on_fit_end                         	|  2.6885e-05     	|1              	|  2.6885e-05     	|  6.7426e-06     	|
configure_sharded_model            	|  1.0804e-05     	|2              	|  2.1609e-05     	|  5.4192e-06     	|
prepare_data                       	|  9.8795e-06     	|2              	|  1.9759e-05     	|  4.9554e-06     	|
on_pretrain_routine_end            	|  1.3679e-05     	|1              	|  1.3679e-05     	|  3.4306e-06     	|
on_validation_epoch_start          	|  1.2221e-05     	|1              	|  1.2221e-05     	|  3.0649e-06     	|
configure_callbacks                	|  5.7733e-06     	|2              	|  1.1547e-05     	|  2.8958e-06     	|
on_train_dataloader                	|  7.9609e-06     	|1              	|  7.9609e-06     	|  1.9965e-06     	|
