VALIDATE Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
-------------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  361.2          	|  100 %          	|
-------------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.648         	|21             	|  328.61         	|  90.977         	|
run_training_batch                 	|  0.31377        	|1000           	|  313.77         	|  86.87          	|
optimizer_step_with_closure_0      	|  0.31088        	|1000           	|  310.88         	|  86.07          	|
training_step_and_backward         	|  0.23874        	|1000           	|  238.74         	|  66.098         	|
backward                           	|  0.12107        	|1000           	|  121.07         	|  33.519         	|
model_forward                      	|  0.11611        	|1000           	|  116.11         	|  32.146         	|
training_step                      	|  0.11591        	|1000           	|  115.91         	|  32.091         	|
run_validate_evaluation            	|  13.44          	|1              	|  13.44          	|  3.721          	|
evaluation_step_and_end            	|  0.1003         	|125            	|  12.538         	|  3.4712         	|
validation_step                    	|  0.10021        	|125            	|  12.527         	|  3.4681         	|
get_train_batch                    	|  0.0048121      	|1021           	|  4.9131         	|  1.3602         	|
fetch_next_train_batch             	|  0.0047905      	|1021           	|  4.8911         	|  1.3541         	|
on_train_batch_end                 	|  0.0019403      	|1000           	|  1.9403         	|  0.53718        	|
zero_grad                          	|  0.0015333      	|1000           	|  1.5333         	|  0.42451        	|
get_validate_batch                 	|  0.0034723      	|126            	|  0.43751        	|  0.12113        	|
fetch_next_validate_batch          	|  0.003452       	|126            	|  0.43496        	|  0.12042        	|
training_batch_to_device           	|  0.00029613     	|1000           	|  0.29613        	|  0.081987       	|
on_train_batch_start               	|  0.00011042     	|1000           	|  0.11042        	|  0.03057        	|
evaluation_batch_to_device         	|  0.00027795     	|125            	|  0.034744       	|  0.0096192      	|
on_train_end                       	|  0.027366       	|1              	|  0.027366       	|  0.0075764      	|
on_after_backward                  	|  2.3625e-05     	|1000           	|  0.023625       	|  0.0065407      	|
on_pretrain_routine_start          	|  0.023546       	|1              	|  0.023546       	|  0.0065188      	|
on_batch_start                     	|  2.0143e-05     	|1000           	|  0.020143       	|  0.0055767      	|
on_batch_end                       	|  1.56e-05       	|1000           	|  0.0156         	|  0.004319       	|
on_before_zero_grad                	|  1.4032e-05     	|1000           	|  0.014032       	|  0.0038848      	|
on_before_optimizer_step           	|  1.3052e-05     	|1000           	|  0.013052       	|  0.0036136      	|
on_before_backward                 	|  1.1985e-05     	|1000           	|  0.011985       	|  0.0033182      	|
on_train_epoch_start               	|  0.0004607      	|21             	|  0.0096747      	|  0.0026785      	|
on_train_epoch_end                 	|  0.00044324     	|21             	|  0.009308       	|  0.002577       	|
configure_optimizers               	|  0.0085539      	|1              	|  0.0085539      	|  0.0023682      	|
training_step_end                  	|  6.554e-06      	|1000           	|  0.006554       	|  0.0018145      	|
on_validation_model_eval           	|  0.0050764      	|1              	|  0.0050764      	|  0.0014054      	|
on_validation_batch_end            	|  3.5588e-05     	|125            	|  0.0044484      	|  0.0012316      	|
on_validation_batch_start          	|  1.4437e-05     	|125            	|  0.0018046      	|  0.00049962     	|
on_train_start                     	|  0.0012314      	|1              	|  0.0012314      	|  0.00034092     	|
validation_step_end                	|  7.0157e-06     	|125            	|  0.00087696     	|  0.00024279     	|
on_validation_start                	|  0.00054678     	|1              	|  0.00054678     	|  0.00015138     	|
on_epoch_end                       	|  1.1487e-05     	|22             	|  0.00025272     	|  6.9966e-05     	|
on_epoch_start                     	|  1.0338e-05     	|22             	|  0.00022744     	|  6.2969e-05     	|
on_validation_end                  	|  0.00018061     	|1              	|  0.00018061     	|  5.0003e-05     	|
setup                              	|  2.4161e-05     	|2              	|  4.8322e-05     	|  1.3378e-05     	|
on_before_accelerator_backend_setup	|  2.0939e-05     	|2              	|  4.1878e-05     	|  1.1594e-05     	|
on_configure_sharded_model         	|  2.0495e-05     	|2              	|  4.0989e-05     	|  1.1348e-05     	|
on_validation_epoch_end            	|  3.4681e-05     	|1              	|  3.4681e-05     	|  9.6017e-06     	|
teardown                           	|  1.7254e-05     	|2              	|  3.4509e-05     	|  9.554e-06      	|
on_fit_end                         	|  2.6571e-05     	|1              	|  2.6571e-05     	|  7.3564e-06     	|
on_pretrain_routine_end            	|  1.7578e-05     	|1              	|  1.7578e-05     	|  4.8666e-06     	|
on_fit_start                       	|  1.6417e-05     	|1              	|  1.6417e-05     	|  4.5451e-06     	|
on_val_dataloader                  	|  8.0765e-06     	|2              	|  1.6153e-05     	|  4.4721e-06     	|
prepare_data                       	|  6.2825e-06     	|2              	|  1.2565e-05     	|  3.4787e-06     	|
configure_sharded_model            	|  6.1135e-06     	|2              	|  1.2227e-05     	|  3.3851e-06     	|
on_validation_epoch_start          	|  1.1114e-05     	|1              	|  1.1114e-05     	|  3.077e-06      	|
configure_callbacks                	|  5.4015e-06     	|2              	|  1.0803e-05     	|  2.9909e-06     	|
on_train_dataloader                	|  6.263e-06      	|1              	|  6.263e-06      	|  1.7339e-06     	|
