FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  477.04         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  0.90846        	|500            	|  454.23         	|  95.219         	|
run_training_batch                 	|  0.30214        	|1000           	|  302.14         	|  63.337         	|
optimizer_step_with_closure_0      	|  0.29945        	|1000           	|  299.45         	|  62.773         	|
training_step_and_backward         	|  0.2259         	|1000           	|  225.9          	|  47.355         	|
model_forward                      	|  0.139          	|1000           	|  139.0          	|  29.139         	|
training_step                      	|  0.13883        	|1000           	|  138.83         	|  29.103         	|
backward                           	|  0.08552        	|1000           	|  85.52          	|  17.927         	|
get_train_batch                    	|  0.029351       	|1500           	|  44.026         	|  9.229          	|
fetch_next_train_batch             	|  0.029319       	|1500           	|  43.979         	|  9.219          	|
zero_grad                          	|  0.0013449      	|1000           	|  1.3449         	|  0.28193        	|
on_train_batch_end                 	|  0.0013257      	|1000           	|  1.3257         	|  0.27789        	|
training_batch_to_device           	|  0.00059931     	|1000           	|  0.59931        	|  0.12563        	|
on_train_epoch_start               	|  0.00027894     	|500            	|  0.13947        	|  0.029237       	|
on_train_epoch_end                 	|  0.00027325     	|500            	|  0.13663        	|  0.028641       	|
on_train_batch_start               	|  0.00010803     	|1000           	|  0.10803        	|  0.022645       	|
on_batch_start                     	|  3.5699e-05     	|1000           	|  0.035699       	|  0.0074833      	|
on_train_end                       	|  0.02436        	|1              	|  0.02436        	|  0.0051066      	|
on_pretrain_routine_start          	|  0.022998       	|1              	|  0.022998       	|  0.004821       	|
on_before_zero_grad                	|  2.1112e-05     	|1000           	|  0.021112       	|  0.0044256      	|
on_batch_end                       	|  1.4424e-05     	|1000           	|  0.014424       	|  0.0030237      	|
on_before_optimizer_step           	|  1.1852e-05     	|1000           	|  0.011852       	|  0.0024846      	|
on_after_backward                  	|  1.0717e-05     	|1000           	|  0.010717       	|  0.0022466      	|
on_before_backward                 	|  1.067e-05      	|1000           	|  0.01067        	|  0.0022366      	|
configure_optimizers               	|  0.0078311      	|1              	|  0.0078311      	|  0.0016416      	|
training_step_end                  	|  7.7299e-06     	|1000           	|  0.0077299      	|  0.0016204      	|
on_epoch_start                     	|  1.0316e-05     	|500            	|  0.0051578      	|  0.0010812      	|
on_epoch_end                       	|  9.9639e-06     	|500            	|  0.0049819      	|  0.0010443      	|
on_train_start                     	|  0.0007603      	|1              	|  0.0007603      	|  0.00015938     	|
on_before_accelerator_backend_setup	|  2.1981e-05     	|1              	|  2.1981e-05     	|  4.6078e-06     	|
on_fit_end                         	|  2.1701e-05     	|1              	|  2.1701e-05     	|  4.5491e-06     	|
on_fit_start                       	|  1.61e-05       	|1              	|  1.61e-05       	|  3.375e-06      	|
on_configure_sharded_model         	|  1.4687e-05     	|1              	|  1.4687e-05     	|  3.0788e-06     	|
setup                              	|  1.4267e-05     	|1              	|  1.4267e-05     	|  2.9907e-06     	|
teardown                           	|  1.091e-05      	|1              	|  1.091e-05      	|  2.287e-06      	|
on_pretrain_routine_end            	|  9.908e-06      	|1              	|  9.908e-06      	|  2.077e-06      	|
prepare_data                       	|  8.064e-06      	|1              	|  8.064e-06      	|  1.6904e-06     	|
configure_callbacks                	|  4.778e-06      	|1              	|  4.778e-06      	|  1.0016e-06     	|
configure_sharded_model            	|  4.7389e-06     	|1              	|  4.7389e-06     	|  9.934e-07      	|
on_val_dataloader                  	|  4.7289e-06     	|1              	|  4.7289e-06     	|  9.913e-07      	|
on_train_dataloader                	|  3.897e-06      	|1              	|  3.897e-06      	|  8.1691e-07     	|
