VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  449.96         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  5.3463         	|63             	|  336.82         	|  74.855         	|
run_training_batch                 	|  0.31359        	|1000           	|  313.59         	|  69.694         	|
optimizer_step_with_closure_0      	|  0.3109         	|1000           	|  310.9          	|  69.096         	|
training_step_and_backward         	|  0.23365        	|1000           	|  233.65         	|  51.926         	|
model_forward                      	|  0.14411        	|1000           	|  144.11         	|  32.027         	|
training_step                      	|  0.14397        	|1000           	|  143.97         	|  31.997         	|
backward                           	|  0.088228       	|1000           	|  88.228         	|  19.608         	|
run_validate_evaluation            	|  70.171         	|1              	|  70.171         	|  15.595         	|
evaluation_step_and_end            	|  0.21923        	|313            	|  68.618         	|  15.25          	|
validation_step                    	|  0.21917        	|313            	|  68.602         	|  15.246         	|
get_train_batch                    	|  0.0073787      	|1063           	|  7.8436         	|  1.7432         	|
fetch_next_train_batch             	|  0.0073601      	|1063           	|  7.8238         	|  1.7388         	|
zero_grad                          	|  0.0012854      	|1000           	|  1.2854         	|  0.28567        	|
on_train_batch_end                 	|  0.0011992      	|1000           	|  1.1992         	|  0.26651        	|
get_validate_batch                 	|  0.0018169      	|314            	|  0.5705         	|  0.12679        	|
fetch_next_validate_batch          	|  0.0018026      	|314            	|  0.56603        	|  0.1258         	|
training_batch_to_device           	|  0.00022345     	|1000           	|  0.22345        	|  0.049659       	|
on_train_batch_start               	|  9.1407e-05     	|1000           	|  0.091407       	|  0.020315       	|
evaluation_batch_to_device         	|  0.00022261     	|313            	|  0.069677       	|  0.015485       	|
on_train_end                       	|  0.024428       	|1              	|  0.024428       	|  0.0054289      	|
on_pretrain_routine_start          	|  0.022531       	|1              	|  0.022531       	|  0.0050073      	|
on_train_epoch_end                 	|  0.00029709     	|63             	|  0.018717       	|  0.0041597      	|
on_train_epoch_start               	|  0.0002952      	|63             	|  0.018598       	|  0.0041332      	|
on_batch_start                     	|  1.6005e-05     	|1000           	|  0.016005       	|  0.003557       	|
on_batch_end                       	|  1.348e-05      	|1000           	|  0.01348        	|  0.0029959      	|
on_before_zero_grad                	|  1.3169e-05     	|1000           	|  0.013169       	|  0.0029268      	|
on_after_backward                  	|  1.1331e-05     	|1000           	|  0.011331       	|  0.0025183      	|
on_before_backward                 	|  1.0453e-05     	|1000           	|  0.010453       	|  0.0023232      	|
on_before_optimizer_step           	|  1.0212e-05     	|1000           	|  0.010212       	|  0.0022696      	|
configure_optimizers               	|  0.0087513      	|1              	|  0.0087513      	|  0.0019449      	|
on_validation_batch_end            	|  1.906e-05      	|313            	|  0.0059658      	|  0.0013259      	|
training_step_end                  	|  5.8037e-06     	|1000           	|  0.0058037      	|  0.0012898      	|
on_validation_model_eval           	|  0.0039647      	|1              	|  0.0039647      	|  0.00088112     	|
on_validation_batch_start          	|  1.0088e-05     	|313            	|  0.0031574      	|  0.00070172     	|
validation_step_end                	|  5.1806e-06     	|313            	|  0.0016215      	|  0.00036037     	|
on_train_start                     	|  0.00074181     	|1              	|  0.00074181     	|  0.00016486     	|
on_epoch_start                     	|  1.0581e-05     	|64             	|  0.00067718     	|  0.0001505      	|
on_epoch_end                       	|  1.0401e-05     	|64             	|  0.00066563     	|  0.00014793     	|
on_validation_start                	|  0.00031489     	|1              	|  0.00031489     	|  6.9983e-05     	|
on_validation_end                  	|  0.0001017      	|1              	|  0.0001017      	|  2.2603e-05     	|
on_before_accelerator_backend_setup	|  1.8811e-05     	|2              	|  3.7622e-05     	|  8.3612e-06     	|
on_validation_epoch_end            	|  3.3213e-05     	|1              	|  3.3213e-05     	|  7.3814e-06     	|
setup                              	|  1.4592e-05     	|2              	|  2.9184e-05     	|  6.4859e-06     	|
teardown                           	|  1.4492e-05     	|2              	|  2.8985e-05     	|  6.4417e-06     	|
on_fit_end                         	|  2.7782e-05     	|1              	|  2.7782e-05     	|  6.1744e-06     	|
on_configure_sharded_model         	|  1.3856e-05     	|2              	|  2.7712e-05     	|  6.1588e-06     	|
on_fit_start                       	|  1.8475e-05     	|1              	|  1.8475e-05     	|  4.1059e-06     	|
prepare_data                       	|  6.763e-06      	|2              	|  1.3526e-05     	|  3.0061e-06     	|
on_val_dataloader                  	|  5.956e-06      	|2              	|  1.1912e-05     	|  2.6474e-06     	|
configure_sharded_model            	|  5.736e-06      	|2              	|  1.1472e-05     	|  2.5496e-06     	|
on_pretrain_routine_end            	|  1.051e-05      	|1              	|  1.051e-05      	|  2.3358e-06     	|
on_validation_epoch_start          	|  9.338e-06      	|1              	|  9.338e-06      	|  2.0753e-06     	|
configure_callbacks                	|  4.5886e-06     	|2              	|  9.1771e-06     	|  2.0396e-06     	|
on_train_dataloader                	|  4.599e-06      	|1              	|  4.599e-06      	|  1.0221e-06     	|
