VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  605.34         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.3294         	|167            	|  556.02         	|  91.852         	|
run_training_batch                 	|  0.24027        	|1000           	|  240.27         	|  39.691         	|
optimizer_step_with_closure_0      	|  0.2381         	|1000           	|  238.1          	|  39.333         	|
training_step_and_backward         	|  0.17887        	|1000           	|  178.87         	|  29.548         	|
model_forward                      	|  0.092247       	|1000           	|  92.247         	|  15.239         	|
training_step                      	|  0.09207        	|1000           	|  92.07          	|  15.21          	|
backward                           	|  0.085285       	|1000           	|  85.285         	|  14.089         	|
get_train_batch                    	|  0.05387        	|1167           	|  62.866         	|  10.385         	|
fetch_next_train_batch             	|  0.053843       	|1167           	|  62.835         	|  10.38          	|
run_validate_evaluation            	|  16.307         	|1              	|  16.307         	|  2.6938         	|
evaluation_step_and_end            	|  0.10763        	|125            	|  13.454         	|  2.2226         	|
validation_step                    	|  0.10756        	|125            	|  13.446         	|  2.2211         	|
on_train_batch_end                 	|  0.0016497      	|1000           	|  1.6497         	|  0.27252        	|
zero_grad                          	|  0.0013046      	|1000           	|  1.3046         	|  0.21551        	|
get_validate_batch                 	|  0.0064641      	|126            	|  0.81448        	|  0.13455        	|
fetch_next_validate_batch          	|  0.0064472      	|126            	|  0.81235        	|  0.1342         	|
training_batch_to_device           	|  0.00033666     	|1000           	|  0.33666        	|  0.055615       	|
on_train_batch_start               	|  9.5996e-05     	|1000           	|  0.095996       	|  0.015858       	|
on_batch_start                     	|  8.6839e-05     	|1000           	|  0.086839       	|  0.014345       	|
on_train_epoch_end                 	|  0.00031914     	|167            	|  0.053297       	|  0.0088044      	|
on_train_epoch_start               	|  0.00030966     	|167            	|  0.051713       	|  0.0085427      	|
on_train_end                       	|  0.043955       	|1              	|  0.043955       	|  0.0072612      	|
evaluation_batch_to_device         	|  0.00020551     	|125            	|  0.025689       	|  0.0042438      	|
on_pretrain_routine_start          	|  0.021581       	|1              	|  0.021581       	|  0.0035651      	|
on_after_backward                  	|  1.946e-05      	|1000           	|  0.01946        	|  0.0032147      	|
on_before_zero_grad                	|  1.6441e-05     	|1000           	|  0.016441       	|  0.0027159      	|
on_batch_end                       	|  1.424e-05      	|1000           	|  0.01424        	|  0.0023524      	|
on_before_backward                 	|  1.1822e-05     	|1000           	|  0.011822       	|  0.001953       	|
on_before_optimizer_step           	|  1.1637e-05     	|1000           	|  0.011637       	|  0.0019223      	|
configure_optimizers               	|  0.010519       	|1              	|  0.010519       	|  0.0017376      	|
training_step_end                  	|  8.0368e-06     	|1000           	|  0.0080368      	|  0.0013276      	|
on_validation_model_eval           	|  0.0046785      	|1              	|  0.0046785      	|  0.00077288     	|
on_validation_batch_end            	|  2.4948e-05     	|125            	|  0.0031185      	|  0.00051516     	|
on_epoch_end                       	|  1.12e-05       	|168            	|  0.0018816      	|  0.00031084     	|
on_epoch_start                     	|  1.0707e-05     	|168            	|  0.0017987      	|  0.00029715     	|
on_train_start                     	|  0.0017369      	|1              	|  0.0017369      	|  0.00028693     	|
on_validation_batch_start          	|  1.2382e-05     	|125            	|  0.0015478      	|  0.00025569     	|
validation_step_end                	|  6.6127e-06     	|125            	|  0.00082658     	|  0.00013655     	|
on_validation_start                	|  0.00068034     	|1              	|  0.00068034     	|  0.00011239     	|
on_validation_end                  	|  0.00017758     	|1              	|  0.00017758     	|  2.9335e-05     	|
on_before_accelerator_backend_setup	|  3.4859e-05     	|2              	|  6.9719e-05     	|  1.1517e-05     	|
setup                              	|  2.6352e-05     	|2              	|  5.2704e-05     	|  8.7064e-06     	|
teardown                           	|  2.3874e-05     	|2              	|  4.7747e-05     	|  7.8876e-06     	|
on_configure_sharded_model         	|  2.3413e-05     	|2              	|  4.6827e-05     	|  7.7356e-06     	|
on_fit_start                       	|  4.334e-05      	|1              	|  4.334e-05      	|  7.1596e-06     	|
on_validation_epoch_end            	|  4.2465e-05     	|1              	|  4.2465e-05     	|  7.015e-06      	|
on_fit_end                         	|  3.7972e-05     	|1              	|  3.7972e-05     	|  6.2728e-06     	|
on_val_dataloader                  	|  1.626e-05      	|2              	|  3.252e-05      	|  5.3722e-06     	|
prepare_data                       	|  9.8888e-06     	|2              	|  1.9778e-05     	|  3.2672e-06     	|
configure_callbacks                	|  9.7854e-06     	|2              	|  1.9571e-05     	|  3.233e-06      	|
configure_sharded_model            	|  7.7076e-06     	|2              	|  1.5415e-05     	|  2.5465e-06     	|
on_pretrain_routine_end            	|  1.4316e-05     	|1              	|  1.4316e-05     	|  2.365e-06      	|
on_validation_epoch_start          	|  1.1347e-05     	|1              	|  1.1347e-05     	|  1.8745e-06     	|
on_train_dataloader                	|  7.1246e-06     	|1              	|  7.1246e-06     	|  1.177e-06      	|
