VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1706.3         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.2801         	|500            	|  1640.1         	|  96.115         	|
run_training_batch                 	|  0.39946        	|1000           	|  399.46         	|  23.41          	|
optimizer_step_with_closure_0      	|  0.39643        	|1000           	|  396.43         	|  23.233         	|
training_step_and_backward         	|  0.29308        	|1000           	|  293.08         	|  17.176         	|
get_train_batch                    	|  0.12813        	|1500           	|  192.19         	|  11.263         	|
fetch_next_train_batch             	|  0.12809        	|1500           	|  192.13         	|  11.26          	|
model_forward                      	|  0.16294        	|1000           	|  162.94         	|  9.5488         	|
training_step                      	|  0.16272        	|1000           	|  162.72         	|  9.5361         	|
backward                           	|  0.12866        	|1000           	|  128.66         	|  7.5398         	|
run_validate_evaluation            	|  30.728         	|1              	|  30.728         	|  1.8008         	|
evaluation_step_and_end            	|  0.21998        	|125            	|  27.498         	|  1.6115         	|
validation_step                    	|  0.21987        	|125            	|  27.484         	|  1.6107         	|
on_train_batch_end                 	|  0.0020553      	|1000           	|  2.0553         	|  0.12045        	|
zero_grad                          	|  0.0014527      	|1000           	|  1.4527         	|  0.085137       	|
get_validate_batch                 	|  0.0056765      	|126            	|  0.71524        	|  0.041917       	|
fetch_next_validate_batch          	|  0.005652       	|126            	|  0.71216        	|  0.041736       	|
training_batch_to_device           	|  0.00063233     	|1000           	|  0.63233        	|  0.037058       	|
on_train_epoch_start               	|  0.00033275     	|500            	|  0.16638        	|  0.0097505      	|
on_train_epoch_end                 	|  0.00033077     	|500            	|  0.16538        	|  0.0096924      	|
on_train_batch_start               	|  0.00011019     	|1000           	|  0.11019        	|  0.0064577      	|
on_train_end                       	|  0.046268       	|1              	|  0.046268       	|  0.0027115      	|
on_batch_start                     	|  4.4771e-05     	|1000           	|  0.044771       	|  0.0026238      	|
evaluation_batch_to_device         	|  0.00026257     	|125            	|  0.032821       	|  0.0019235      	|
on_after_backward                  	|  2.333e-05      	|1000           	|  0.02333        	|  0.0013673      	|
on_before_zero_grad                	|  2.2768e-05     	|1000           	|  0.022768       	|  0.0013343      	|
on_pretrain_routine_start          	|  0.021675       	|1              	|  0.021675       	|  0.0012702      	|
on_before_backward                 	|  1.7689e-05     	|1000           	|  0.017689       	|  0.0010367      	|
on_batch_end                       	|  1.7568e-05     	|1000           	|  0.017568       	|  0.0010296      	|
on_before_optimizer_step           	|  1.6299e-05     	|1000           	|  0.016299       	|  0.00095522     	|
configure_optimizers               	|  0.010106       	|1              	|  0.010106       	|  0.00059224     	|
training_step_end                  	|  8.2519e-06     	|1000           	|  0.0082519      	|  0.0004836      	|
on_epoch_end                       	|  1.1839e-05     	|501            	|  0.0059311      	|  0.00034759     	|
on_epoch_start                     	|  1.0938e-05     	|501            	|  0.0054799      	|  0.00032115     	|
on_validation_batch_end            	|  3.9832e-05     	|125            	|  0.004979       	|  0.0002918      	|
on_validation_model_eval           	|  0.0037284      	|1              	|  0.0037284      	|  0.0002185      	|
on_train_start                     	|  0.0031432      	|1              	|  0.0031432      	|  0.00018421     	|
on_validation_batch_start          	|  1.7494e-05     	|125            	|  0.0021868      	|  0.00012816     	|
validation_step_end                	|  8.8481e-06     	|125            	|  0.001106       	|  6.4817e-05     	|
on_validation_start                	|  0.00047824     	|1              	|  0.00047824     	|  2.8027e-05     	|
on_validation_end                  	|  0.00016363     	|1              	|  0.00016363     	|  9.5896e-06     	|
setup                              	|  3.5888e-05     	|2              	|  7.1775e-05     	|  4.2064e-06     	|
on_configure_sharded_model         	|  3.5117e-05     	|2              	|  7.0235e-05     	|  4.1161e-06     	|
on_before_accelerator_backend_setup	|  3.2575e-05     	|2              	|  6.515e-05      	|  3.8181e-06     	|
on_fit_end                         	|  6.1566e-05     	|1              	|  6.1566e-05     	|  3.6081e-06     	|
teardown                           	|  2.6543e-05     	|2              	|  5.3085e-05     	|  3.1111e-06     	|
on_fit_start                       	|  5.0016e-05     	|1              	|  5.0016e-05     	|  2.9312e-06     	|
on_validation_epoch_end            	|  3e-05          	|1              	|  3e-05          	|  1.7581e-06     	|
prepare_data                       	|  8.7665e-06     	|2              	|  1.7533e-05     	|  1.0275e-06     	|
configure_sharded_model            	|  8.489e-06      	|2              	|  1.6978e-05     	|  9.9499e-07     	|
on_val_dataloader                  	|  8.3586e-06     	|2              	|  1.6717e-05     	|  9.7971e-07     	|
configure_callbacks                	|  8.2953e-06     	|2              	|  1.6591e-05     	|  9.7229e-07     	|
on_pretrain_routine_end            	|  1.4799e-05     	|1              	|  1.4799e-05     	|  8.6728e-07     	|
on_validation_epoch_start          	|  9.1828e-06     	|1              	|  9.1828e-06     	|  5.3816e-07     	|
on_train_dataloader                	|  6.1784e-06     	|1              	|  6.1784e-06     	|  3.6208e-07     	|
