FIT Profiler Report

Action                             	|  Mean duration (s)	|Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------
Total                              	|  -              	|_              	|  1726.4         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------
run_training_epoch                 	|  3.4057         	|500            	|  1702.8         	|  98.636         	|
run_training_batch                 	|  0.20197        	|8000           	|  1615.8         	|  93.593         	|
training_step_and_backward         	|  0.19105        	|8000           	|  1528.4         	|  88.529         	|
model_forward                      	|  0.10628        	|8000           	|  850.23         	|  49.249         	|
training_step                      	|  0.10614        	|8000           	|  849.14         	|  49.186         	|
backward                           	|  0.084573       	|8000           	|  676.58         	|  39.191         	|
optimizer_step_with_closure_0      	|  0.2498         	|1000           	|  249.8          	|  14.47          	|
get_train_batch                    	|  0.0067777      	|8500           	|  57.61          	|  3.337          	|
fetch_next_train_batch             	|  0.0067587      	|8500           	|  57.449         	|  3.3277         	|
on_train_batch_end                 	|  0.0010949      	|8000           	|  8.7592         	|  0.50737        	|
training_batch_to_device           	|  0.00023394     	|8000           	|  1.8715         	|  0.10841        	|
zero_grad                          	|  0.0013999      	|1000           	|  1.3999         	|  0.081086       	|
on_train_batch_start               	|  9.1818e-05     	|8000           	|  0.73454        	|  0.042548       	|
on_train_epoch_start               	|  0.00027942     	|500            	|  0.13971        	|  0.0080925      	|
on_batch_start                     	|  1.6889e-05     	|8000           	|  0.13511        	|  0.0078261      	|
on_train_epoch_end                 	|  0.00025882     	|500            	|  0.12941        	|  0.0074959      	|
on_batch_end                       	|  1.3187e-05     	|8000           	|  0.10549        	|  0.0061107      	|
on_before_backward                 	|  1.286e-05      	|8000           	|  0.10288        	|  0.0059592      	|
on_after_backward                  	|  1.2399e-05     	|8000           	|  0.099196       	|  0.0057458      	|
training_step_end                  	|  6.3075e-06     	|8000           	|  0.05046        	|  0.0029229      	|
on_train_end                       	|  0.024139       	|1              	|  0.024139       	|  0.0013983      	|
on_pretrain_routine_start          	|  0.023045       	|1              	|  0.023045       	|  0.0013349      	|
on_before_zero_grad                	|  2.0712e-05     	|1000           	|  0.020712       	|  0.0011997      	|
on_before_optimizer_step           	|  1.6314e-05     	|1000           	|  0.016314       	|  0.00094497     	|
configure_optimizers               	|  0.0082387      	|1              	|  0.0082387      	|  0.00047722     	|
on_epoch_start                     	|  1.0893e-05     	|500            	|  0.0054466      	|  0.00031549     	|
on_epoch_end                       	|  1.0213e-05     	|500            	|  0.0051063      	|  0.00029578     	|
on_train_start                     	|  0.00076058     	|1              	|  0.00076058     	|  4.4056e-05     	|
on_fit_end                         	|  2.2662e-05     	|1              	|  2.2662e-05     	|  1.3127e-06     	|
on_before_accelerator_backend_setup	|  2.0629e-05     	|1              	|  2.0629e-05     	|  1.1949e-06     	|
setup                              	|  2.0488e-05     	|1              	|  2.0488e-05     	|  1.1868e-06     	|
on_configure_sharded_model         	|  1.8184e-05     	|1              	|  1.8184e-05     	|  1.0533e-06     	|
on_fit_start                       	|  1.6691e-05     	|1              	|  1.6691e-05     	|  9.6681e-07     	|
teardown                           	|  1.068e-05      	|1              	|  1.068e-05      	|  6.1864e-07     	|
on_pretrain_routine_end            	|  9.7081e-06     	|1              	|  9.7081e-06     	|  5.6233e-07     	|
prepare_data                       	|  7.4541e-06     	|1              	|  7.4541e-06     	|  4.3177e-07     	|
configure_callbacks                	|  6.2911e-06     	|1              	|  6.2911e-06     	|  3.6441e-07     	|
configure_sharded_model            	|  4.879e-06      	|1              	|  4.879e-06      	|  2.8261e-07     	|
on_val_dataloader                  	|  4.5281e-06     	|1              	|  4.5281e-06     	|  2.6229e-07     	|
on_train_dataloader                	|  4.3381e-06     	|1              	|  4.3381e-06     	|  2.5128e-07     	|
