VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  571.78         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  1.0279         	|500            	|  513.96         	|  89.889         	|
run_training_batch                 	|  0.33806        	|1000           	|  338.06         	|  59.125         	|
optimizer_step_with_closure_0      	|  0.33537        	|1000           	|  335.37         	|  58.653         	|
training_step_and_backward         	|  0.25097        	|1000           	|  250.97         	|  43.892         	|
model_forward                      	|  0.15609        	|1000           	|  156.09         	|  27.299         	|
training_step                      	|  0.15592        	|1000           	|  155.92         	|  27.269         	|
backward                           	|  0.093487       	|1000           	|  93.487         	|  16.35          	|
get_train_batch                    	|  0.030757       	|1500           	|  46.135         	|  8.0687         	|
fetch_next_train_batch             	|  0.030723       	|1500           	|  46.085         	|  8.0599         	|
run_validate_evaluation            	|  12.37          	|1              	|  12.37          	|  2.1634         	|
evaluation_step_and_end            	|  0.24745        	|48             	|  11.878         	|  2.0773         	|
validation_step                    	|  0.2474         	|48             	|  11.875         	|  2.0769         	|
zero_grad                          	|  0.0013568      	|1000           	|  1.3568         	|  0.2373         	|
on_train_batch_end                 	|  0.0013336      	|1000           	|  1.3336         	|  0.23323        	|
training_batch_to_device           	|  0.00063342     	|1000           	|  0.63342        	|  0.11078        	|
get_validate_batch                 	|  0.0044548      	|49             	|  0.21828        	|  0.038176       	|
fetch_next_validate_batch          	|  0.0044397      	|49             	|  0.21754        	|  0.038047       	|
on_train_epoch_start               	|  0.00028413     	|500            	|  0.14207        	|  0.024847       	|
on_train_epoch_end                 	|  0.0002696      	|500            	|  0.1348         	|  0.023575       	|
on_train_batch_start               	|  0.00010845     	|1000           	|  0.10845        	|  0.018967       	|
on_batch_start                     	|  3.5887e-05     	|1000           	|  0.035887       	|  0.0062764      	|
on_train_end                       	|  0.023858       	|1              	|  0.023858       	|  0.0041726      	|
on_pretrain_routine_start          	|  0.022639       	|1              	|  0.022639       	|  0.0039594      	|
on_before_zero_grad                	|  2.1312e-05     	|1000           	|  0.021312       	|  0.0037272      	|
on_batch_end                       	|  1.351e-05      	|1000           	|  0.01351        	|  0.0023627      	|
on_before_backward                 	|  1.3026e-05     	|1000           	|  0.013026       	|  0.0022782      	|
on_after_backward                  	|  1.1802e-05     	|1000           	|  0.011802       	|  0.002064       	|
on_before_optimizer_step           	|  1.18e-05       	|1000           	|  0.0118         	|  0.0020638      	|
evaluation_batch_to_device         	|  0.00022526     	|48             	|  0.010812       	|  0.001891       	|
configure_optimizers               	|  0.0082204      	|1              	|  0.0082204      	|  0.0014377      	|
training_step_end                  	|  8.1383e-06     	|1000           	|  0.0081383      	|  0.0014233      	|
on_epoch_end                       	|  1.1035e-05     	|501            	|  0.0055287      	|  0.00096693     	|
on_epoch_start                     	|  1.0746e-05     	|501            	|  0.005384       	|  0.00094162     	|
on_validation_model_eval           	|  0.0041399      	|1              	|  0.0041399      	|  0.00072403     	|
on_validation_batch_end            	|  2.072e-05      	|48             	|  0.00099454     	|  0.00017394     	|
on_train_start                     	|  0.00072486     	|1              	|  0.00072486     	|  0.00012677     	|
on_validation_batch_start          	|  1.0622e-05     	|48             	|  0.00050988     	|  8.9174e-05     	|
on_validation_start                	|  0.00032123     	|1              	|  0.00032123     	|  5.6181e-05     	|
validation_step_end                	|  4.934e-06      	|48             	|  0.00023683     	|  4.142e-05      	|
on_validation_end                  	|  0.00010519     	|1              	|  0.00010519     	|  1.8396e-05     	|
on_before_accelerator_backend_setup	|  1.9581e-05     	|2              	|  3.9163e-05     	|  6.8493e-06     	|
teardown                           	|  1.5754e-05     	|2              	|  3.1509e-05     	|  5.5107e-06     	|
on_configure_sharded_model         	|  1.366e-05      	|2              	|  2.7321e-05     	|  4.7782e-06     	|
setup                              	|  1.2919e-05     	|2              	|  2.5838e-05     	|  4.5189e-06     	|
on_fit_end                         	|  2.2503e-05     	|1              	|  2.2503e-05     	|  3.9356e-06     	|
on_validation_epoch_end            	|  1.8425e-05     	|1              	|  1.8425e-05     	|  3.2224e-06     	|
on_fit_start                       	|  1.7773e-05     	|1              	|  1.7773e-05     	|  3.1084e-06     	|
on_val_dataloader                  	|  6.001e-06      	|2              	|  1.2002e-05     	|  2.0991e-06     	|
prepare_data                       	|  5.936e-06      	|2              	|  1.1872e-05     	|  2.0763e-06     	|
on_pretrain_routine_end            	|  1.051e-05      	|1              	|  1.051e-05      	|  1.8381e-06     	|
configure_sharded_model            	|  4.7929e-06     	|2              	|  9.5859e-06     	|  1.6765e-06     	|
on_validation_epoch_start          	|  9.4881e-06     	|1              	|  9.4881e-06     	|  1.6594e-06     	|
configure_callbacks                	|  4.6435e-06     	|2              	|  9.287e-06      	|  1.6242e-06     	|
on_train_dataloader                	|  4.348e-06      	|1              	|  4.348e-06      	|  7.6043e-07     	|
