VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  569.24         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  7.9125         	|63             	|  498.49         	|  87.571         	|
run_training_batch                 	|  0.37642        	|1000           	|  376.42         	|  66.126         	|
optimizer_step_with_closure_0      	|  0.37253        	|1000           	|  372.53         	|  65.444         	|
training_step_and_backward         	|  0.27075        	|1000           	|  270.75         	|  47.563         	|
model_forward                      	|  0.13502        	|1000           	|  135.02         	|  23.719         	|
training_step                      	|  0.13484        	|1000           	|  134.84         	|  23.689         	|
backward                           	|  0.13433        	|1000           	|  134.33         	|  23.598         	|
run_validate_evaluation            	|  30.182         	|1              	|  30.182         	|  5.3021         	|
evaluation_step_and_end            	|  0.22116        	|125            	|  27.645         	|  4.8564         	|
validation_step                    	|  0.22105        	|125            	|  27.632         	|  4.8541         	|
get_train_batch                    	|  0.025802       	|1063           	|  27.427         	|  4.8183         	|
fetch_next_train_batch             	|  0.025778       	|1063           	|  27.402         	|  4.8138         	|
on_train_batch_end                 	|  0.0020344      	|1000           	|  2.0344         	|  0.35739        	|
zero_grad                          	|  0.0013664      	|1000           	|  1.3664         	|  0.24004        	|
get_validate_batch                 	|  0.0060324      	|126            	|  0.76008        	|  0.13353        	|
fetch_next_validate_batch          	|  0.0060085      	|126            	|  0.75707        	|  0.133          	|
training_batch_to_device           	|  0.00024676     	|1000           	|  0.24676        	|  0.043349       	|
on_train_batch_start               	|  9.6604e-05     	|1000           	|  0.096604       	|  0.016971       	|
on_train_end                       	|  0.043801       	|1              	|  0.043801       	|  0.0076946      	|
evaluation_batch_to_device         	|  0.0003008      	|125            	|  0.0376         	|  0.0066053      	|
on_pretrain_routine_start          	|  0.024974       	|1              	|  0.024974       	|  0.0043872      	|
on_train_epoch_start               	|  0.00036406     	|63             	|  0.022936       	|  0.0040292      	|
on_train_epoch_end                 	|  0.00035745     	|63             	|  0.022519       	|  0.003956       	|
on_batch_start                     	|  2.1036e-05     	|1000           	|  0.021036       	|  0.0036955      	|
on_after_backward                  	|  2.039e-05      	|1000           	|  0.02039        	|  0.003582       	|
on_before_zero_grad                	|  1.6335e-05     	|1000           	|  0.016335       	|  0.0028697      	|
on_batch_end                       	|  1.5501e-05     	|1000           	|  0.015501       	|  0.0027232      	|
on_before_optimizer_step           	|  1.2882e-05     	|1000           	|  0.012882       	|  0.0022629      	|
on_before_backward                 	|  1.2106e-05     	|1000           	|  0.012106       	|  0.0021267      	|
configure_optimizers               	|  0.010091       	|1              	|  0.010091       	|  0.0017728      	|
training_step_end                  	|  6.8572e-06     	|1000           	|  0.0068572      	|  0.0012046      	|
on_validation_model_eval           	|  0.0064583      	|1              	|  0.0064583      	|  0.0011345      	|
on_validation_batch_end            	|  3.8367e-05     	|125            	|  0.0047959      	|  0.0008425      	|
on_validation_batch_start          	|  1.5289e-05     	|125            	|  0.0019111      	|  0.00033573     	|
on_train_start                     	|  0.0016187      	|1              	|  0.0016187      	|  0.00028435     	|
validation_step_end                	|  8.3426e-06     	|125            	|  0.0010428      	|  0.0001832      	|
on_epoch_start                     	|  1.1909e-05     	|64             	|  0.00076221     	|  0.0001339      	|
on_epoch_end                       	|  1.1761e-05     	|64             	|  0.00075273     	|  0.00013223     	|
on_validation_start                	|  0.00060939     	|1              	|  0.00060939     	|  0.00010705     	|
on_validation_end                  	|  0.00016563     	|1              	|  0.00016563     	|  2.9097e-05     	|
on_before_accelerator_backend_setup	|  2.3753e-05     	|2              	|  4.7507e-05     	|  8.3456e-06     	|
on_configure_sharded_model         	|  2.316e-05      	|2              	|  4.632e-05      	|  8.1372e-06     	|
teardown                           	|  2.108e-05      	|2              	|  4.2159e-05     	|  7.4062e-06     	|
on_fit_start                       	|  3.878e-05      	|1              	|  3.878e-05      	|  6.8126e-06     	|
setup                              	|  1.6864e-05     	|2              	|  3.3729e-05     	|  5.9252e-06     	|
on_fit_end                         	|  3.0616e-05     	|1              	|  3.0616e-05     	|  5.3784e-06     	|
on_validation_epoch_end            	|  2.9469e-05     	|1              	|  2.9469e-05     	|  5.1769e-06     	|
on_val_dataloader                  	|  1.2507e-05     	|2              	|  2.5013e-05     	|  4.3942e-06     	|
prepare_data                       	|  7.6173e-06     	|2              	|  1.5235e-05     	|  2.6763e-06     	|
configure_callbacks                	|  7.2001e-06     	|2              	|  1.44e-05       	|  2.5297e-06     	|
configure_sharded_model            	|  7.1069e-06     	|2              	|  1.4214e-05     	|  2.497e-06      	|
on_validation_epoch_start          	|  1.3085e-05     	|1              	|  1.3085e-05     	|  2.2987e-06     	|
on_pretrain_routine_end            	|  1.2841e-05     	|1              	|  1.2841e-05     	|  2.2558e-06     	|
on_train_dataloader                	|  6.4746e-06     	|1              	|  6.4746e-06     	|  1.1374e-06     	|
