VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1433.5         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.7418         	|500            	|  1370.9         	|  95.636         	|
run_training_batch                 	|  0.28698        	|1000           	|  286.98         	|  20.02          	|
optimizer_step_with_closure_0      	|  0.28305        	|1000           	|  283.05         	|  19.746         	|
training_step_and_backward         	|  0.2156         	|1000           	|  215.6          	|  15.041         	|
get_train_batch                    	|  0.12458        	|1500           	|  186.87         	|  13.036         	|
fetch_next_train_batch             	|  0.12454        	|1500           	|  186.81         	|  13.032         	|
model_forward                      	|  0.11013        	|1000           	|  110.13         	|  7.6831         	|
training_step                      	|  0.1099         	|1000           	|  109.9          	|  7.667          	|
backward                           	|  0.1038         	|1000           	|  103.8          	|  7.2414         	|
run_validate_evaluation            	|  30.438         	|1              	|  30.438         	|  2.1234         	|
evaluation_step_and_end            	|  0.083347       	|313            	|  26.088         	|  1.8199         	|
validation_step                    	|  0.083281       	|313            	|  26.067         	|  1.8185         	|
on_train_batch_end                 	|  0.0024503      	|1000           	|  2.4503         	|  0.17094        	|
zero_grad                          	|  0.001623       	|1000           	|  1.623          	|  0.11322        	|
get_validate_batch                 	|  0.0034022      	|314            	|  1.0683         	|  0.074525       	|
fetch_next_validate_batch          	|  0.0033847      	|314            	|  1.0628         	|  0.074143       	|
training_batch_to_device           	|  0.00068225     	|1000           	|  0.68225        	|  0.047595       	|
on_train_epoch_start               	|  0.00038118     	|500            	|  0.19059        	|  0.013296       	|
on_train_epoch_end                 	|  0.00034959     	|500            	|  0.1748         	|  0.012194       	|
on_train_batch_start               	|  0.00011392     	|1000           	|  0.11392        	|  0.0079476      	|
evaluation_batch_to_device         	|  0.0002173      	|313            	|  0.068016       	|  0.0047449      	|
on_batch_start                     	|  4.8858e-05     	|1000           	|  0.048858       	|  0.0034084      	|
on_train_end                       	|  0.044561       	|1              	|  0.044561       	|  0.0031086      	|
on_after_backward                  	|  2.9146e-05     	|1000           	|  0.029146       	|  0.0020333      	|
on_before_zero_grad                	|  2.4075e-05     	|1000           	|  0.024075       	|  0.0016795      	|
on_pretrain_routine_start          	|  0.024065       	|1              	|  0.024065       	|  0.0016788      	|
on_batch_end                       	|  1.8462e-05     	|1000           	|  0.018462       	|  0.0012879      	|
on_before_optimizer_step           	|  1.7837e-05     	|1000           	|  0.017837       	|  0.0012444      	|
on_before_backward                 	|  1.4487e-05     	|1000           	|  0.014487       	|  0.0010107      	|
configure_optimizers               	|  0.011203       	|1              	|  0.011203       	|  0.00078153     	|
training_step_end                  	|  8.8383e-06     	|1000           	|  0.0088383      	|  0.00061658     	|
on_validation_batch_end            	|  2.4393e-05     	|313            	|  0.007635       	|  0.00053263     	|
on_epoch_end                       	|  1.1958e-05     	|501            	|  0.0059908      	|  0.00041793     	|
on_epoch_start                     	|  1.1643e-05     	|501            	|  0.005833       	|  0.00040692     	|
on_validation_model_eval           	|  0.0056154      	|1              	|  0.0056154      	|  0.00039174     	|
on_validation_batch_start          	|  1.218e-05      	|313            	|  0.0038125      	|  0.00026596     	|
validation_step_end                	|  6.1504e-06     	|313            	|  0.0019251      	|  0.0001343      	|
on_train_start                     	|  0.0012692      	|1              	|  0.0012692      	|  8.8543e-05     	|
on_validation_start                	|  0.00092201     	|1              	|  0.00092201     	|  6.4321e-05     	|
on_validation_end                  	|  0.00020732     	|1              	|  0.00020732     	|  1.4463e-05     	|
teardown                           	|  3.0158e-05     	|2              	|  6.0316e-05     	|  4.2078e-06     	|
on_fit_end                         	|  5.4335e-05     	|1              	|  5.4335e-05     	|  3.7905e-06     	|
setup                              	|  2.521e-05      	|2              	|  5.042e-05      	|  3.5174e-06     	|
on_before_accelerator_backend_setup	|  2.3377e-05     	|2              	|  4.6754e-05     	|  3.2617e-06     	|
on_fit_start                       	|  4.6259e-05     	|1              	|  4.6259e-05     	|  3.2271e-06     	|
on_configure_sharded_model         	|  2.1848e-05     	|2              	|  4.3696e-05     	|  3.0483e-06     	|
on_val_dataloader                  	|  1.9864e-05     	|2              	|  3.9728e-05     	|  2.7715e-06     	|
on_validation_epoch_end            	|  3.6962e-05     	|1              	|  3.6962e-05     	|  2.5786e-06     	|
on_pretrain_routine_end            	|  1.9141e-05     	|1              	|  1.9141e-05     	|  1.3353e-06     	|
configure_callbacks                	|  7.6648e-06     	|2              	|  1.533e-05      	|  1.0694e-06     	|
configure_sharded_model            	|  7.3826e-06     	|2              	|  1.4765e-05     	|  1.03e-06       	|
prepare_data                       	|  7.3155e-06     	|2              	|  1.4631e-05     	|  1.0207e-06     	|
on_validation_epoch_start          	|  9.8757e-06     	|1              	|  9.8757e-06     	|  6.8895e-07     	|
on_train_dataloader                	|  8.0206e-06     	|1              	|  8.0206e-06     	|  5.5953e-07     	|
