VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  767.59         	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.5943         	|200            	|  718.86         	|  93.652         	|
run_training_batch                 	|  0.28947        	|1000           	|  289.47         	|  37.712         	|
optimizer_step_with_closure_0      	|  0.28561        	|1000           	|  285.61         	|  37.208         	|
training_step_and_backward         	|  0.22007        	|1000           	|  220.07         	|  28.671         	|
model_forward                      	|  0.11237        	|1000           	|  112.37         	|  14.64          	|
training_step                      	|  0.11215        	|1000           	|  112.15         	|  14.611         	|
backward                           	|  0.10613        	|1000           	|  106.13         	|  13.826         	|
get_train_batch                    	|  0.069228       	|1200           	|  83.073         	|  10.823         	|
fetch_next_train_batch             	|  0.069196       	|1200           	|  83.035         	|  10.818         	|
run_validate_evaluation            	|  17.544         	|1              	|  17.544         	|  2.2856         	|
evaluation_step_and_end            	|  0.10197        	|139            	|  14.174         	|  1.8465         	|
validation_step                    	|  0.10185        	|139            	|  14.157         	|  1.8443         	|
on_train_batch_end                 	|  0.0024687      	|1000           	|  2.4687         	|  0.32162        	|
zero_grad                          	|  0.0015308      	|1000           	|  1.5308         	|  0.19943        	|
get_validate_batch                 	|  0.0070476      	|140            	|  0.98666        	|  0.12854        	|
fetch_next_validate_batch          	|  0.0070225      	|140            	|  0.98316        	|  0.12808        	|
training_batch_to_device           	|  0.00047213     	|1000           	|  0.47213        	|  0.061508       	|
on_train_batch_start               	|  0.00016808     	|1000           	|  0.16808        	|  0.021898       	|
on_train_epoch_start               	|  0.00033389     	|200            	|  0.066778       	|  0.0086998      	|
on_train_epoch_end                 	|  0.00031937     	|200            	|  0.063874       	|  0.0083214      	|
on_train_end                       	|  0.049409       	|1              	|  0.049409       	|  0.0064369      	|
evaluation_batch_to_device         	|  0.00030243     	|139            	|  0.042037       	|  0.0054766      	|
on_batch_start                     	|  3.1764e-05     	|1000           	|  0.031764       	|  0.0041382      	|
on_after_backward                  	|  2.9075e-05     	|1000           	|  0.029075       	|  0.0037879      	|
on_before_zero_grad                	|  2.206e-05      	|1000           	|  0.02206        	|  0.002874       	|
on_pretrain_routine_start          	|  0.022025       	|1              	|  0.022025       	|  0.0028694      	|
configure_optimizers               	|  0.016692       	|1              	|  0.016692       	|  0.0021746      	|
on_batch_end                       	|  1.6027e-05     	|1000           	|  0.016027       	|  0.002088       	|
on_before_optimizer_step           	|  1.5344e-05     	|1000           	|  0.015344       	|  0.0019989      	|
on_before_backward                 	|  1.4559e-05     	|1000           	|  0.014559       	|  0.0018967      	|
training_step_end                  	|  8.8158e-06     	|1000           	|  0.0088158      	|  0.0011485      	|
on_validation_batch_end            	|  4.2187e-05     	|139            	|  0.005864       	|  0.00076395     	|
on_validation_model_eval           	|  0.0048402      	|1              	|  0.0048402      	|  0.00063058     	|
on_validation_batch_start          	|  1.7479e-05     	|139            	|  0.0024296      	|  0.00031652     	|
on_epoch_end                       	|  1.1885e-05     	|201            	|  0.0023889      	|  0.00031123     	|
on_epoch_start                     	|  1.1706e-05     	|201            	|  0.002353       	|  0.00030655     	|
validation_step_end                	|  9.0438e-06     	|139            	|  0.0012571      	|  0.00016377     	|
on_train_start                     	|  0.0011134      	|1              	|  0.0011134      	|  0.00014505     	|
on_validation_start                	|  0.00064236     	|1              	|  0.00064236     	|  8.3686e-05     	|
on_validation_end                  	|  0.00022946     	|1              	|  0.00022946     	|  2.9894e-05     	|
on_fit_end                         	|  9.9588e-05     	|1              	|  9.9588e-05     	|  1.2974e-05     	|
setup                              	|  3.0163e-05     	|2              	|  6.0325e-05     	|  7.8591e-06     	|
on_before_accelerator_backend_setup	|  2.9547e-05     	|2              	|  5.9094e-05     	|  7.6987e-06     	|
on_configure_sharded_model         	|  2.6342e-05     	|2              	|  5.2683e-05     	|  6.8635e-06     	|
on_fit_start                       	|  4.5823e-05     	|1              	|  4.5823e-05     	|  5.9697e-06     	|
on_validation_epoch_end            	|  4.3325e-05     	|1              	|  4.3325e-05     	|  5.6443e-06     	|
teardown                           	|  2.0942e-05     	|2              	|  4.1883e-05     	|  5.4565e-06     	|
on_val_dataloader                  	|  1.4878e-05     	|2              	|  2.9756e-05     	|  3.8765e-06     	|
configure_callbacks                	|  1.4364e-05     	|2              	|  2.8728e-05     	|  3.7426e-06     	|
configure_sharded_model            	|  8.5812e-06     	|2              	|  1.7162e-05     	|  2.2359e-06     	|
prepare_data                       	|  8.2562e-06     	|2              	|  1.6512e-05     	|  2.1512e-06     	|
on_validation_epoch_start          	|  1.5538e-05     	|1              	|  1.5538e-05     	|  2.0243e-06     	|
on_pretrain_routine_end            	|  1.2299e-05     	|1              	|  1.2299e-05     	|  1.6023e-06     	|
on_train_dataloader                	|  5.7463e-06     	|1              	|  5.7463e-06     	|  7.4861e-07     	|
