Struct CompileSpec::TorchFallback ¶
-
Defined in File trtorch.h
Nested Relationships ¶
This struct is a nested type of Struct CompileSpec .
Struct Documentation ¶
-
struct
trtorch:: CompileSpec::TorchFallback
-
A struct to hold fallback info.
Public Functions
-
TorchFallback( ) = default
-
Construct a default Torch Fallback object, fallback will be off.
-
TorchFallback( bool enabled )
-
Construct from a bool.
-
TorchFallback( bool enabled , uint64_t min_size )
-
Constructor for setting min_block_size.
Public Members
-
bool
enabled= false
-
enable the automatic fallback feature
-
uint64_t
min_block_size= 1
-
minimum consecutive operation number that needs to be satisfied to convert to TensorRT
-
std::vector<std::string>
forced_fallback_ops
-
A list of names of operations that will explicitly run in PyTorch.
-
std::vector<std::string>
forced_fallback_modules
-
A list of names of modules that will explicitly run in PyTorch.
-