VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  567.5          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.90846        	|500            	|  454.23         	|  80.041         	|
run_training_batch                 	|  0.30214        	|1000           	|  302.14         	|  53.241         	|
optimizer_step_with_closure_0      	|  0.29945        	|1000           	|  299.45         	|  52.767         	|
training_step_and_backward         	|  0.2259         	|1000           	|  225.9          	|  39.806         	|
model_forward                      	|  0.139          	|1000           	|  139.0          	|  24.494         	|
training_step                      	|  0.13883        	|1000           	|  138.83         	|  24.464         	|
backward                           	|  0.08552        	|1000           	|  85.52          	|  15.07          	|
run_validate_evaluation            	|  70.355         	|1              	|  70.355         	|  12.397         	|
evaluation_step_and_end            	|  0.2197         	|313            	|  68.767         	|  12.118         	|
validation_step                    	|  0.21965        	|313            	|  68.75          	|  12.115         	|
get_train_batch                    	|  0.029351       	|1500           	|  44.026         	|  7.7579         	|
fetch_next_train_batch             	|  0.029319       	|1500           	|  43.979         	|  7.7495         	|
zero_grad                          	|  0.0013449      	|1000           	|  1.3449         	|  0.23699        	|
on_train_batch_end                 	|  0.0013257      	|1000           	|  1.3257         	|  0.2336         	|
training_batch_to_device           	|  0.00059931     	|1000           	|  0.59931        	|  0.1056         	|
get_validate_batch                 	|  0.0018602      	|314            	|  0.58412        	|  0.10293        	|
fetch_next_validate_batch          	|  0.0018452      	|314            	|  0.57938        	|  0.10209        	|
on_train_epoch_start               	|  0.00027894     	|500            	|  0.13947        	|  0.024577       	|
on_train_epoch_end                 	|  0.00027325     	|500            	|  0.13663        	|  0.024075       	|
on_train_batch_start               	|  0.00010803     	|1000           	|  0.10803        	|  0.019036       	|
evaluation_batch_to_device         	|  0.0002256      	|313            	|  0.070613       	|  0.012443       	|
on_batch_start                     	|  3.5699e-05     	|1000           	|  0.035699       	|  0.0062905      	|
on_train_end                       	|  0.02436        	|1              	|  0.02436        	|  0.0042926      	|
on_pretrain_routine_start          	|  0.022998       	|1              	|  0.022998       	|  0.0040525      	|
on_before_zero_grad                	|  2.1112e-05     	|1000           	|  0.021112       	|  0.0037202      	|
on_batch_end                       	|  1.4424e-05     	|1000           	|  0.014424       	|  0.0025418      	|
on_before_optimizer_step           	|  1.1852e-05     	|1000           	|  0.011852       	|  0.0020885      	|
on_after_backward                  	|  1.0717e-05     	|1000           	|  0.010717       	|  0.0018885      	|
on_before_backward                 	|  1.067e-05      	|1000           	|  0.01067        	|  0.0018801      	|
configure_optimizers               	|  0.0078311      	|1              	|  0.0078311      	|  0.0013799      	|
training_step_end                  	|  7.7299e-06     	|1000           	|  0.0077299      	|  0.0013621      	|
on_validation_batch_end            	|  2.1189e-05     	|313            	|  0.0066322      	|  0.0011687      	|
on_epoch_start                     	|  1.0315e-05     	|501            	|  0.005168       	|  0.00091066     	|
on_epoch_end                       	|  9.9674e-06     	|501            	|  0.0049937      	|  0.00087994     	|
on_validation_model_eval           	|  0.0039681      	|1              	|  0.0039681      	|  0.00069922     	|
on_validation_batch_start          	|  1.0204e-05     	|313            	|  0.0031938      	|  0.00056279     	|
validation_step_end                	|  5.0613e-06     	|313            	|  0.0015842      	|  0.00027915     	|
on_train_start                     	|  0.0007603      	|1              	|  0.0007603      	|  0.00013397     	|
on_validation_start                	|  0.00031604     	|1              	|  0.00031604     	|  5.569e-05      	|
on_validation_end                  	|  0.00011021     	|1              	|  0.00011021     	|  1.942e-05      	|
on_before_accelerator_backend_setup	|  1.9361e-05     	|2              	|  3.8723e-05     	|  6.8234e-06     	|
on_validation_epoch_end            	|  3.3463e-05     	|1              	|  3.3463e-05     	|  5.8966e-06     	|
teardown                           	|  1.6095e-05     	|2              	|  3.219e-05      	|  5.6722e-06     	|
setup                              	|  1.4357e-05     	|2              	|  2.8714e-05     	|  5.0598e-06     	|
on_configure_sharded_model         	|  1.369e-05      	|2              	|  2.7381e-05     	|  4.8248e-06     	|
on_fit_end                         	|  2.1701e-05     	|1              	|  2.1701e-05     	|  3.824e-06      	|
on_fit_start                       	|  1.61e-05       	|1              	|  1.61e-05       	|  2.837e-06      	|
on_val_dataloader                  	|  6.3269e-06     	|2              	|  1.2654e-05     	|  2.2298e-06     	|
prepare_data                       	|  6.0155e-06     	|2              	|  1.2031e-05     	|  2.12e-06       	|
configure_sharded_model            	|  4.9545e-06     	|2              	|  9.9089e-06     	|  1.7461e-06     	|
on_pretrain_routine_end            	|  9.908e-06      	|1              	|  9.908e-06      	|  1.7459e-06     	|
on_validation_epoch_start          	|  9.318e-06      	|1              	|  9.318e-06      	|  1.6419e-06     	|
configure_callbacks                	|  4.588e-06      	|2              	|  9.176e-06      	|  1.6169e-06     	|
on_train_dataloader                	|  3.897e-06      	|1              	|  3.897e-06      	|  6.867e-07      	|
