VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  492.03         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  6.9649         	|63             	|  438.79         	|  89.179         	|
run_training_batch                 	|  0.28819        	|1000           	|  288.19         	|  58.572         	|
optimizer_step_with_closure_0      	|  0.28482        	|1000           	|  284.82         	|  57.887         	|
training_step_and_backward         	|  0.22077        	|1000           	|  220.77         	|  44.87          	|
model_forward                      	|  0.10969        	|1000           	|  109.69         	|  22.293         	|
backward                           	|  0.10955        	|1000           	|  109.55         	|  22.266         	|
training_step                      	|  0.10946        	|1000           	|  109.46         	|  22.247         	|
get_train_batch                    	|  0.027085       	|1063           	|  28.791         	|  5.8516         	|
fetch_next_train_batch             	|  0.027059       	|1063           	|  28.764         	|  5.846          	|
run_validate_evaluation            	|  7.8268         	|1              	|  7.8268         	|  1.5907         	|
evaluation_step_and_end            	|  0.098739       	|48             	|  4.7395         	|  0.96325        	|
validation_step                    	|  0.098626       	|48             	|  4.7341         	|  0.96215        	|
on_train_batch_end                 	|  0.002565       	|1000           	|  2.565          	|  0.52131        	|
zero_grad                          	|  0.0014947      	|1000           	|  1.4947         	|  0.30378        	|
get_validate_batch                 	|  0.013439       	|49             	|  0.6585         	|  0.13383        	|
fetch_next_validate_batch          	|  0.013413       	|49             	|  0.65725        	|  0.13358        	|
training_batch_to_device           	|  0.00028152     	|1000           	|  0.28152        	|  0.057215       	|
on_train_batch_start               	|  9.7739e-05     	|1000           	|  0.097739       	|  0.019865       	|
on_train_end                       	|  0.077828       	|1              	|  0.077828       	|  0.015818       	|
on_train_epoch_end                 	|  0.00044211     	|63             	|  0.027853       	|  0.0056609      	|
configure_optimizers               	|  0.027353       	|1              	|  0.027353       	|  0.0055593      	|
on_after_backward                  	|  2.6809e-05     	|1000           	|  0.026809       	|  0.0054487      	|
on_train_epoch_start               	|  0.00041779     	|63             	|  0.026321       	|  0.0053495      	|
on_batch_start                     	|  2.4395e-05     	|1000           	|  0.024395       	|  0.004958       	|
on_pretrain_routine_start          	|  0.022092       	|1              	|  0.022092       	|  0.0044899      	|
on_before_zero_grad                	|  2.0356e-05     	|1000           	|  0.020356       	|  0.0041371      	|
on_batch_end                       	|  1.6641e-05     	|1000           	|  0.016641       	|  0.0033821      	|
evaluation_batch_to_device         	|  0.00029685     	|48             	|  0.014249       	|  0.0028959      	|
on_before_optimizer_step           	|  1.3883e-05     	|1000           	|  0.013883       	|  0.0028215      	|
on_before_backward                 	|  1.3336e-05     	|1000           	|  0.013336       	|  0.0027105      	|
training_step_end                  	|  7.3227e-06     	|1000           	|  0.0073227      	|  0.0014883      	|
on_validation_model_eval           	|  0.004383       	|1              	|  0.004383       	|  0.0008908      	|
on_validation_batch_end            	|  4.1065e-05     	|48             	|  0.0019711      	|  0.00040061     	|
on_train_start                     	|  0.001017       	|1              	|  0.001017       	|  0.00020671     	|
on_validation_batch_start          	|  1.7854e-05     	|48             	|  0.000857       	|  0.00017418     	|
on_epoch_end                       	|  1.2401e-05     	|64             	|  0.00079369     	|  0.00016131     	|
on_epoch_start                     	|  1.1494e-05     	|64             	|  0.00073565     	|  0.00014951     	|
on_validation_start                	|  0.00071338     	|1              	|  0.00071338     	|  0.00014499     	|
validation_step_end                	|  8.4601e-06     	|48             	|  0.00040608     	|  8.2533e-05     	|
on_validation_end                  	|  0.00015306     	|1              	|  0.00015306     	|  3.1108e-05     	|
teardown                           	|  3.9689e-05     	|2              	|  7.9378e-05     	|  1.6133e-05     	|
on_configure_sharded_model         	|  3.1952e-05     	|2              	|  6.3904e-05     	|  1.2988e-05     	|
setup                              	|  2.7893e-05     	|2              	|  5.5786e-05     	|  1.1338e-05     	|
on_before_accelerator_backend_setup	|  2.7836e-05     	|2              	|  5.5673e-05     	|  1.1315e-05     	|
on_fit_start                       	|  4.0136e-05     	|1              	|  4.0136e-05     	|  8.1573e-06     	|
on_fit_end                         	|  3.0512e-05     	|1              	|  3.0512e-05     	|  6.2013e-06     	|
on_validation_epoch_end            	|  2.9407e-05     	|1              	|  2.9407e-05     	|  5.9768e-06     	|
on_val_dataloader                  	|  1.4477e-05     	|2              	|  2.8955e-05     	|  5.8848e-06     	|
configure_sharded_model            	|  9.5684e-06     	|2              	|  1.9137e-05     	|  3.8894e-06     	|
on_pretrain_routine_end            	|  1.9126e-05     	|1              	|  1.9126e-05     	|  3.8871e-06     	|
configure_callbacks                	|  9.411e-06      	|2              	|  1.8822e-05     	|  3.8254e-06     	|
prepare_data                       	|  7.9554e-06     	|2              	|  1.5911e-05     	|  3.2337e-06     	|
on_validation_epoch_start          	|  1.1411e-05     	|1              	|  1.1411e-05     	|  2.3191e-06     	|
on_train_dataloader                	|  7.851e-06      	|1              	|  7.851e-06      	|  1.5957e-06     	|
