VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1270.3         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  2.4511         	|500            	|  1225.6         	|  96.481         	|
run_training_batch                 	|  0.29467        	|1000           	|  294.67         	|  23.197         	|
optimizer_step_with_closure_0      	|  0.29121        	|1000           	|  291.21         	|  22.925         	|
training_step_and_backward         	|  0.22433        	|1000           	|  224.33         	|  17.66          	|
get_train_batch                    	|  0.10165        	|1500           	|  152.48         	|  12.004         	|
fetch_next_train_batch             	|  0.10161        	|1500           	|  152.41         	|  11.998         	|
model_forward                      	|  0.1151         	|1000           	|  115.1          	|  9.0612         	|
training_step                      	|  0.11485        	|1000           	|  114.85         	|  9.0412         	|
backward                           	|  0.1075         	|1000           	|  107.5          	|  8.4626         	|
run_validate_evaluation            	|  8.0691         	|1              	|  8.0691         	|  0.63523        	|
evaluation_step_and_end            	|  0.1038         	|48             	|  4.9826         	|  0.39225        	|
validation_step                    	|  0.10369        	|48             	|  4.9772         	|  0.39182        	|
on_train_batch_end                 	|  0.0027175      	|1000           	|  2.7175         	|  0.21393        	|
zero_grad                          	|  0.0016884      	|1000           	|  1.6884         	|  0.13292        	|
training_batch_to_device           	|  0.0007359      	|1000           	|  0.7359         	|  0.057933       	|
get_validate_batch                 	|  0.014285       	|49             	|  0.69996        	|  0.055104       	|
fetch_next_validate_batch          	|  0.014259       	|49             	|  0.6987         	|  0.055005       	|
on_train_epoch_end                 	|  0.00044061     	|500            	|  0.2203         	|  0.017343       	|
on_train_epoch_start               	|  0.00038145     	|500            	|  0.19073        	|  0.015015       	|
on_train_batch_start               	|  0.00011724     	|1000           	|  0.11724        	|  0.0092296      	|
on_batch_start                     	|  5.4541e-05     	|1000           	|  0.054541       	|  0.0042937      	|
on_train_end                       	|  0.052461       	|1              	|  0.052461       	|  0.00413        	|
on_after_backward                  	|  2.9127e-05     	|1000           	|  0.029127       	|  0.002293       	|
on_before_zero_grad                	|  2.6531e-05     	|1000           	|  0.026531       	|  0.0020887      	|
on_pretrain_routine_start          	|  0.022989       	|1              	|  0.022989       	|  0.0018098      	|
on_batch_end                       	|  1.8548e-05     	|1000           	|  0.018548       	|  0.0014602      	|
configure_optimizers               	|  0.017756       	|1              	|  0.017756       	|  0.0013979      	|
on_before_optimizer_step           	|  1.6542e-05     	|1000           	|  0.016542       	|  0.0013022      	|
on_before_backward                 	|  1.5994e-05     	|1000           	|  0.015994       	|  0.0012591      	|
evaluation_batch_to_device         	|  0.00028745     	|48             	|  0.013797       	|  0.0010862      	|
training_step_end                  	|  1.1656e-05     	|1000           	|  0.011656       	|  0.00091763     	|
on_epoch_end                       	|  1.1807e-05     	|501            	|  0.0059153      	|  0.00046567     	|
on_epoch_start                     	|  1.1699e-05     	|501            	|  0.0058614      	|  0.00046143     	|
on_validation_model_eval           	|  0.0047318      	|1              	|  0.0047318      	|  0.00037251     	|
on_validation_batch_end            	|  4.2934e-05     	|48             	|  0.0020609      	|  0.00016224     	|
on_train_start                     	|  0.0011684      	|1              	|  0.0011684      	|  9.1983e-05     	|
on_validation_start                	|  0.00084408     	|1              	|  0.00084408     	|  6.645e-05      	|
on_validation_batch_start          	|  1.7361e-05     	|48             	|  0.00083331     	|  6.5601e-05     	|
validation_step_end                	|  9.5932e-06     	|48             	|  0.00046047     	|  3.625e-05      	|
on_validation_end                  	|  0.00014684     	|1              	|  0.00014684     	|  1.156e-05      	|
on_fit_end                         	|  9.5148e-05     	|1              	|  9.5148e-05     	|  7.4904e-06     	|
teardown                           	|  4.1171e-05     	|2              	|  8.2342e-05     	|  6.4823e-06     	|
on_before_accelerator_backend_setup	|  3.2663e-05     	|2              	|  6.5327e-05     	|  5.1428e-06     	|
on_fit_start                       	|  4.811e-05      	|1              	|  4.811e-05      	|  3.7874e-06     	|
on_configure_sharded_model         	|  2.3808e-05     	|2              	|  4.7617e-05     	|  3.7486e-06     	|
setup                              	|  2.196e-05      	|2              	|  4.3919e-05     	|  3.4575e-06     	|
on_validation_epoch_end            	|  3.7424e-05     	|1              	|  3.7424e-05     	|  2.9462e-06     	|
on_val_dataloader                  	|  1.634e-05      	|2              	|  3.268e-05      	|  2.5727e-06     	|
configure_callbacks                	|  1.3263e-05     	|2              	|  2.6526e-05     	|  2.0882e-06     	|
prepare_data                       	|  1.0516e-05     	|2              	|  2.1033e-05     	|  1.6558e-06     	|
configure_sharded_model            	|  9.9177e-06     	|2              	|  1.9835e-05     	|  1.5615e-06     	|
on_pretrain_routine_end            	|  1.3415e-05     	|1              	|  1.3415e-05     	|  1.0561e-06     	|
on_validation_epoch_start          	|  1.2197e-05     	|1              	|  1.2197e-05     	|  9.6016e-07     	|
on_train_dataloader                	|  6.3069e-06     	|1              	|  6.3069e-06     	|  4.9651e-07     	|
