VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  352.82         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.264         	|21             	|  320.55         	|  90.855         	|
run_training_batch                 	|  0.30759        	|1000           	|  307.59         	|  87.182         	|
optimizer_step_with_closure_0      	|  0.30563        	|1000           	|  305.63         	|  86.625         	|
training_step_and_backward         	|  0.2338         	|1000           	|  233.8          	|  66.267         	|
backward                           	|  0.11756        	|1000           	|  117.56         	|  33.319         	|
model_forward                      	|  0.11477        	|1000           	|  114.77         	|  32.529         	|
training_step                      	|  0.11459        	|1000           	|  114.59         	|  32.478         	|
run_validate_evaluation            	|  13.214         	|1              	|  13.214         	|  3.7454         	|
evaluation_step_and_end            	|  0.09948        	|125            	|  12.435         	|  3.5245         	|
validation_step                    	|  0.099412       	|125            	|  12.427         	|  3.5221         	|
get_train_batch                    	|  0.0042603      	|1021           	|  4.3498         	|  1.2329         	|
fetch_next_train_batch             	|  0.0042404      	|1021           	|  4.3294         	|  1.2271         	|
on_train_batch_end                 	|  0.0014868      	|1000           	|  1.4868         	|  0.4214         	|
zero_grad                          	|  0.0014517      	|1000           	|  1.4517         	|  0.41145        	|
get_validate_batch                 	|  0.0031433      	|126            	|  0.39606        	|  0.11226        	|
fetch_next_validate_batch          	|  0.0031261      	|126            	|  0.39388        	|  0.11164        	|
training_batch_to_device           	|  0.00027117     	|1000           	|  0.27117        	|  0.076859       	|
on_train_batch_start               	|  0.00010724     	|1000           	|  0.10724        	|  0.030395       	|
evaluation_batch_to_device         	|  0.00024021     	|125            	|  0.030026       	|  0.0085104      	|
on_train_end                       	|  0.024643       	|1              	|  0.024643       	|  0.0069847      	|
on_pretrain_routine_start          	|  0.023002       	|1              	|  0.023002       	|  0.0065196      	|
on_batch_start                     	|  2.0259e-05     	|1000           	|  0.020259       	|  0.005742       	|
on_after_backward                  	|  1.6002e-05     	|1000           	|  0.016002       	|  0.0045356      	|
on_batch_end                       	|  1.4451e-05     	|1000           	|  0.014451       	|  0.0040959      	|
on_before_zero_grad                	|  1.2933e-05     	|1000           	|  0.012933       	|  0.0036655      	|
on_before_optimizer_step           	|  1.1587e-05     	|1000           	|  0.011587       	|  0.003284       	|
on_before_backward                 	|  1.1253e-05     	|1000           	|  0.011253       	|  0.0031893      	|
on_train_epoch_end                 	|  0.00044924     	|21             	|  0.0094341      	|  0.0026739      	|
on_train_epoch_start               	|  0.00044248     	|21             	|  0.0092921      	|  0.0026337      	|
configure_optimizers               	|  0.0076804      	|1              	|  0.0076804      	|  0.0021769      	|
training_step_end                  	|  6.665e-06      	|1000           	|  0.006665       	|  0.0018891      	|
on_validation_model_eval           	|  0.0043132      	|1              	|  0.0043132      	|  0.0012225      	|
on_validation_batch_end            	|  2.7587e-05     	|125            	|  0.0034483      	|  0.00097737     	|
on_validation_batch_start          	|  1.2902e-05     	|125            	|  0.0016128      	|  0.00045711     	|
on_train_start                     	|  0.0012878      	|1              	|  0.0012878      	|  0.00036499     	|
validation_step_end                	|  6.9507e-06     	|125            	|  0.00086883     	|  0.00024625     	|
on_validation_start                	|  0.00043106     	|1              	|  0.00043106     	|  0.00012218     	|
on_epoch_start                     	|  1.1395e-05     	|22             	|  0.00025069     	|  7.1054e-05     	|
on_epoch_end                       	|  1.0875e-05     	|22             	|  0.00023925     	|  6.7812e-05     	|
on_validation_end                  	|  0.00013816     	|1              	|  0.00013816     	|  3.9158e-05     	|
on_before_accelerator_backend_setup	|  2.1624e-05     	|2              	|  4.3247e-05     	|  1.2258e-05     	|
setup                              	|  2.1113e-05     	|2              	|  4.2226e-05     	|  1.1968e-05     	|
on_configure_sharded_model         	|  1.8586e-05     	|2              	|  3.7171e-05     	|  1.0535e-05     	|
teardown                           	|  1.7279e-05     	|2              	|  3.4558e-05     	|  9.7949e-06     	|
on_validation_epoch_end            	|  2.9899e-05     	|1              	|  2.9899e-05     	|  8.4743e-06     	|
on_fit_end                         	|  2.6751e-05     	|1              	|  2.6751e-05     	|  7.5821e-06     	|
on_val_dataloader                  	|  8.898e-06      	|2              	|  1.7796e-05     	|  5.044e-06      	|
on_pretrain_routine_end            	|  1.7322e-05     	|1              	|  1.7322e-05     	|  4.9096e-06     	|
prepare_data                       	|  8.6455e-06     	|2              	|  1.7291e-05     	|  4.9008e-06     	|
on_fit_start                       	|  1.6801e-05     	|1              	|  1.6801e-05     	|  4.7619e-06     	|
configure_sharded_model            	|  6.312e-06      	|2              	|  1.2624e-05     	|  3.5781e-06     	|
configure_callbacks                	|  5.7265e-06     	|2              	|  1.1453e-05     	|  3.2462e-06     	|
on_validation_epoch_start          	|  1.0345e-05     	|1              	|  1.0345e-05     	|  2.9321e-06     	|
on_train_dataloader                	|  5.877e-06      	|1              	|  5.877e-06      	|  1.6657e-06     	|
