VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  395.96         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  13.833         	|25             	|  345.84         	|  87.342         	|
run_training_batch                 	|  0.29068        	|1000           	|  290.68         	|  73.413         	|
optimizer_step_with_closure_0      	|  0.2877         	|1000           	|  287.7          	|  72.659         	|
training_step_and_backward         	|  0.22325        	|1000           	|  223.25         	|  56.381         	|
backward                           	|  0.11166        	|1000           	|  111.66         	|  28.199         	|
model_forward                      	|  0.11004        	|1000           	|  110.04         	|  27.79          	|
training_step                      	|  0.10985        	|1000           	|  109.85         	|  27.743         	|
run_validate_evaluation            	|  16.96          	|1              	|  16.96          	|  4.2833         	|
evaluation_step_and_end            	|  0.099296       	|139            	|  13.802         	|  3.4858         	|
validation_step                    	|  0.099194       	|139            	|  13.788         	|  3.4822         	|
get_train_batch                    	|  0.010695       	|1025           	|  10.963         	|  2.7687         	|
fetch_next_train_batch             	|  0.010672       	|1025           	|  10.939         	|  2.7626         	|
on_train_batch_end                 	|  0.0019781      	|1000           	|  1.9781         	|  0.49959        	|
zero_grad                          	|  0.0015212      	|1000           	|  1.5212         	|  0.38419        	|
get_validate_batch                 	|  0.0047916      	|140            	|  0.67083        	|  0.16942        	|
fetch_next_validate_batch          	|  0.00477        	|140            	|  0.6678         	|  0.16865        	|
training_batch_to_device           	|  0.00025336     	|1000           	|  0.25336        	|  0.063988       	|
on_train_batch_start               	|  0.0001029      	|1000           	|  0.1029         	|  0.025988       	|
on_train_end                       	|  0.04284        	|1              	|  0.04284        	|  0.010819       	|
evaluation_batch_to_device         	|  0.00023456     	|139            	|  0.032604       	|  0.0082341      	|
on_after_backward                  	|  2.6327e-05     	|1000           	|  0.026327       	|  0.0066489      	|
on_pretrain_routine_start          	|  0.02291        	|1              	|  0.02291        	|  0.0057859      	|
on_batch_start                     	|  2.0835e-05     	|1000           	|  0.020835       	|  0.0052619      	|
on_before_zero_grad                	|  1.7541e-05     	|1000           	|  0.017541       	|  0.00443        	|
on_batch_end                       	|  1.597e-05      	|1000           	|  0.01597        	|  0.0040333      	|
on_before_optimizer_step           	|  1.3613e-05     	|1000           	|  0.013613       	|  0.0034379      	|
on_before_backward                 	|  1.3349e-05     	|1000           	|  0.013349       	|  0.0033713      	|
on_train_epoch_end                 	|  0.00038718     	|25             	|  0.0096795      	|  0.0024446      	|
on_train_epoch_start               	|  0.00037193     	|25             	|  0.0092982      	|  0.0023483      	|
configure_optimizers               	|  0.0081869      	|1              	|  0.0081869      	|  0.0020676      	|
training_step_end                  	|  6.9181e-06     	|1000           	|  0.0069181      	|  0.0017472      	|
on_validation_batch_end            	|  3.6298e-05     	|139            	|  0.0050454      	|  0.0012742      	|
on_validation_model_eval           	|  0.0038132      	|1              	|  0.0038132      	|  0.00096303     	|
on_validation_batch_start          	|  1.5204e-05     	|139            	|  0.0021134      	|  0.00053373     	|
validation_step_end                	|  8.6475e-06     	|139            	|  0.001202       	|  0.00030357     	|
on_train_start                     	|  0.00069766     	|1              	|  0.00069766     	|  0.0001762      	|
on_validation_start                	|  0.0003594      	|1              	|  0.0003594      	|  9.0766e-05     	|
on_epoch_start                     	|  1.1367e-05     	|26             	|  0.00029554     	|  7.4639e-05     	|
on_epoch_end                       	|  1.1241e-05     	|26             	|  0.00029227     	|  7.3813e-05     	|
on_validation_end                  	|  0.00020193     	|1              	|  0.00020193     	|  5.0997e-05     	|
teardown                           	|  2.7742e-05     	|2              	|  5.5484e-05     	|  1.4013e-05     	|
setup                              	|  2.7436e-05     	|2              	|  5.4872e-05     	|  1.3858e-05     	|
on_configure_sharded_model         	|  2.4142e-05     	|2              	|  4.8283e-05     	|  1.2194e-05     	|
on_before_accelerator_backend_setup	|  2.2731e-05     	|2              	|  4.5462e-05     	|  1.1481e-05     	|
on_validation_epoch_end            	|  3.1445e-05     	|1              	|  3.1445e-05     	|  7.9416e-06     	|
on_fit_end                         	|  2.7429e-05     	|1              	|  2.7429e-05     	|  6.9273e-06     	|
configure_sharded_model            	|  9.0953e-06     	|2              	|  1.8191e-05     	|  4.5941e-06     	|
on_fit_start                       	|  1.7604e-05     	|1              	|  1.7604e-05     	|  4.4459e-06     	|
on_val_dataloader                  	|  8.1891e-06     	|2              	|  1.6378e-05     	|  4.1364e-06     	|
on_pretrain_routine_end            	|  1.3011e-05     	|1              	|  1.3011e-05     	|  3.2859e-06     	|
prepare_data                       	|  6.3339e-06     	|2              	|  1.2668e-05     	|  3.1993e-06     	|
configure_callbacks                	|  5.8496e-06     	|2              	|  1.1699e-05     	|  2.9547e-06     	|
on_validation_epoch_start          	|  1.0189e-05     	|1              	|  1.0189e-05     	|  2.5732e-06     	|
on_train_dataloader                	|  6.2529e-06     	|1              	|  6.2529e-06     	|  1.5792e-06     	|
