FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  353.41         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  15.74          	|21             	|  330.53         	|  93.527         	|
run_training_batch                 	|  0.28273        	|1000           	|  282.73         	|  80.0           	|
optimizer_step_with_closure_0      	|  0.2794         	|1000           	|  279.4          	|  79.059         	|
training_step_and_backward         	|  0.2164         	|1000           	|  216.4          	|  61.233         	|
backward                           	|  0.10782        	|1000           	|  107.82         	|  30.509         	|
model_forward                      	|  0.10712        	|1000           	|  107.12         	|  30.311         	|
training_step                      	|  0.10692        	|1000           	|  106.92         	|  30.254         	|
get_train_batch                    	|  0.0092264      	|1021           	|  9.4202         	|  2.6655         	|
fetch_next_train_batch             	|  0.0092005      	|1021           	|  9.3938         	|  2.658          	|
on_train_batch_end                 	|  0.0025197      	|1000           	|  2.5197         	|  0.71298        	|
zero_grad                          	|  0.0014275      	|1000           	|  1.4275         	|  0.40393        	|
training_batch_to_device           	|  0.00027255     	|1000           	|  0.27255        	|  0.07712        	|
on_train_batch_start               	|  9.7152e-05     	|1000           	|  0.097152       	|  0.02749        	|
on_train_end                       	|  0.068326       	|1              	|  0.068326       	|  0.019334       	|
configure_optimizers               	|  0.029308       	|1              	|  0.029308       	|  0.0082929      	|
on_after_backward                  	|  2.4958e-05     	|1000           	|  0.024958       	|  0.0070621      	|
on_pretrain_routine_start          	|  0.024182       	|1              	|  0.024182       	|  0.0068424      	|
on_batch_start                     	|  2.3134e-05     	|1000           	|  0.023134       	|  0.006546       	|
on_before_zero_grad                	|  1.8917e-05     	|1000           	|  0.018917       	|  0.0053526      	|
on_batch_end                       	|  1.6186e-05     	|1000           	|  0.016186       	|  0.0045799      	|
on_before_backward                 	|  1.3735e-05     	|1000           	|  0.013735       	|  0.0038864      	|
on_before_optimizer_step           	|  1.268e-05      	|1000           	|  0.01268        	|  0.003588       	|
on_train_epoch_end                 	|  0.00047083     	|21             	|  0.0098874      	|  0.0027977      	|
on_train_epoch_start               	|  0.00039525     	|21             	|  0.0083002      	|  0.0023486      	|
training_step_end                  	|  7.6943e-06     	|1000           	|  0.0076943      	|  0.0021772      	|
on_train_start                     	|  0.00097241     	|1              	|  0.00097241     	|  0.00027515     	|
on_epoch_end                       	|  1.2257e-05     	|21             	|  0.0002574      	|  7.2832e-05     	|
on_epoch_start                     	|  1.2028e-05     	|21             	|  0.0002526      	|  7.1475e-05     	|
on_fit_start                       	|  4.3863e-05     	|1              	|  4.3863e-05     	|  1.2412e-05     	|
on_before_accelerator_backend_setup	|  3.1581e-05     	|1              	|  3.1581e-05     	|  8.9362e-06     	|
on_fit_end                         	|  2.9236e-05     	|1              	|  2.9236e-05     	|  8.2726e-06     	|
setup                              	|  2.3901e-05     	|1              	|  2.3901e-05     	|  6.7631e-06     	|
on_configure_sharded_model         	|  2.0003e-05     	|1              	|  2.0003e-05     	|  5.66e-06       	|
teardown                           	|  1.6542e-05     	|1              	|  1.6542e-05     	|  4.6807e-06     	|
on_pretrain_routine_end            	|  1.4458e-05     	|1              	|  1.4458e-05     	|  4.091e-06      	|
prepare_data                       	|  1.2971e-05     	|1              	|  1.2971e-05     	|  3.6704e-06     	|
on_train_dataloader                	|  7.7356e-06     	|1              	|  7.7356e-06     	|  2.1888e-06     	|
configure_callbacks                	|  7.3276e-06     	|1              	|  7.3276e-06     	|  2.0734e-06     	|
on_val_dataloader                  	|  6.8694e-06     	|1              	|  6.8694e-06     	|  1.9438e-06     	|
configure_sharded_model            	|  6.767e-06      	|1              	|  6.767e-06      	|  1.9148e-06     	|
