VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  380.99         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  13.353         	|25             	|  333.82         	|  87.619         	|
run_training_batch                 	|  0.27448        	|1000           	|  274.48         	|  72.044         	|
optimizer_step_with_closure_0      	|  0.27123        	|1000           	|  271.23         	|  71.191         	|
training_step_and_backward         	|  0.20908        	|1000           	|  209.08         	|  54.878         	|
backward                           	|  0.10424        	|1000           	|  104.24         	|  27.359         	|
model_forward                      	|  0.10338        	|1000           	|  103.38         	|  27.134         	|
training_step                      	|  0.10319        	|1000           	|  103.19         	|  27.085         	|
run_validate_evaluation            	|  17.158         	|1              	|  17.158         	|  4.5036         	|
get_train_batch                    	|  0.014287       	|1025           	|  14.644         	|  3.8437         	|
fetch_next_train_batch             	|  0.014264       	|1025           	|  14.621         	|  3.8376         	|
evaluation_step_and_end            	|  0.099232       	|139            	|  13.793         	|  3.6203         	|
validation_step                    	|  0.099121       	|139            	|  13.778         	|  3.6163         	|
on_train_batch_end                 	|  0.0021176      	|1000           	|  2.1176         	|  0.55581        	|
zero_grad                          	|  0.0014324      	|1000           	|  1.4324         	|  0.37596        	|
get_validate_batch                 	|  0.0065093      	|140            	|  0.9113         	|  0.23919        	|
fetch_next_validate_batch          	|  0.0064854      	|140            	|  0.90796        	|  0.23831        	|
training_batch_to_device           	|  0.00026339     	|1000           	|  0.26339        	|  0.069133       	|
on_train_batch_start               	|  9.546e-05      	|1000           	|  0.09546        	|  0.025055       	|
on_train_end                       	|  0.043318       	|1              	|  0.043318       	|  0.01137        	|
evaluation_batch_to_device         	|  0.00029834     	|139            	|  0.04147        	|  0.010885       	|
on_pretrain_routine_start          	|  0.026559       	|1              	|  0.026559       	|  0.0069709      	|
on_after_backward                  	|  2.6108e-05     	|1000           	|  0.026108       	|  0.0068526      	|
on_batch_start                     	|  2.1286e-05     	|1000           	|  0.021286       	|  0.0055871      	|
on_batch_end                       	|  1.7498e-05     	|1000           	|  0.017498       	|  0.0045928      	|
on_before_zero_grad                	|  1.7135e-05     	|1000           	|  0.017135       	|  0.0044975      	|
on_before_backward                 	|  1.3573e-05     	|1000           	|  0.013573       	|  0.0035625      	|
on_before_optimizer_step           	|  1.3413e-05     	|1000           	|  0.013413       	|  0.0035206      	|
configure_optimizers               	|  0.010187       	|1              	|  0.010187       	|  0.0026739      	|
on_train_epoch_start               	|  0.00036724     	|25             	|  0.0091811      	|  0.0024098      	|
on_train_epoch_end                 	|  0.00035136     	|25             	|  0.0087839      	|  0.0023055      	|
training_step_end                  	|  7.8768e-06     	|1000           	|  0.0078768      	|  0.0020675      	|
on_validation_batch_end            	|  3.9938e-05     	|139            	|  0.0055514      	|  0.0014571      	|
on_validation_model_eval           	|  0.003988       	|1              	|  0.003988       	|  0.0010467      	|
on_validation_batch_start          	|  1.6443e-05     	|139            	|  0.0022856      	|  0.0005999      	|
validation_step_end                	|  9.4031e-06     	|139            	|  0.001307       	|  0.00034306     	|
on_train_start                     	|  0.0011116      	|1              	|  0.0011116      	|  0.00029175     	|
on_validation_start                	|  0.0004782      	|1              	|  0.0004782      	|  0.00012551     	|
on_epoch_end                       	|  1.5098e-05     	|26             	|  0.00039254     	|  0.00010303     	|
on_epoch_start                     	|  1.1407e-05     	|26             	|  0.00029659     	|  7.7848e-05     	|
on_validation_end                  	|  0.00015374     	|1              	|  0.00015374     	|  4.0352e-05     	|
on_configure_sharded_model         	|  2.7821e-05     	|2              	|  5.5643e-05     	|  1.4605e-05     	|
setup                              	|  2.6249e-05     	|2              	|  5.2499e-05     	|  1.3779e-05     	|
on_before_accelerator_backend_setup	|  2.3026e-05     	|2              	|  4.6052e-05     	|  1.2087e-05     	|
teardown                           	|  2.2438e-05     	|2              	|  4.4877e-05     	|  1.1779e-05     	|
on_fit_start                       	|  3.9069e-05     	|1              	|  3.9069e-05     	|  1.0255e-05     	|
on_validation_epoch_end            	|  3.4982e-05     	|1              	|  3.4982e-05     	|  9.1819e-06     	|
on_fit_end                         	|  2.4799e-05     	|1              	|  2.4799e-05     	|  6.5091e-06     	|
configure_sharded_model            	|  1.0858e-05     	|2              	|  2.1717e-05     	|  5.7e-06        	|
prepare_data                       	|  9.5712e-06     	|2              	|  1.9142e-05     	|  5.0244e-06     	|
on_val_dataloader                  	|  7.6648e-06     	|2              	|  1.533e-05      	|  4.0236e-06     	|
on_validation_epoch_start          	|  1.4799e-05     	|1              	|  1.4799e-05     	|  3.8843e-06     	|
on_pretrain_routine_end            	|  1.3879e-05     	|1              	|  1.3879e-05     	|  3.6427e-06     	|
configure_callbacks                	|  6.3768e-06     	|2              	|  1.2754e-05     	|  3.3474e-06     	|
on_train_dataloader                	|  7.1824e-06     	|1              	|  7.1824e-06     	|  1.8852e-06     	|
