Toggle Menu
Prev Up Next

# `langchain_community.document_loaders.llmsherpa`.LLMSherpaFileLoader

class langchain_community.document_loaders.llmsherpa.LLMSherpaFileLoader(file_path: Union[str, Path], new_indent_parser: bool = True, apply_ocr: bool = True, strategy: str = 'chunks', llmsherpa_api_url: str = 'https://readers.llmsherpa.com/api/document/developer/parseDocument?renderFormat=all')

  Load Documents using LLMSherpa.

  LLMSherpaFileLoader use LayoutPDFReader, which is part of the LLMSherpa library. This tool is designed to parse PDFs while preserving their layout information, which is often lost when using most PDF to text parsers.

  Examples

  from langchain_community.document_loaders.llmsherpa import LLMSherpaFileLoader

  loader = LLMSherpaFileLoader(

    “example.pdf”, strategy=”chunks”, llmsherpa_api_url=”http://localhost:5010/api/parseDocument?renderFormat=all”,

  ) docs = loader.load()

  Initialize with a file path.

  Methods

  `__init__`(file_path[, new_indent_parser, ...]) | Initialize with a file path.
  `alazy_load`() | A lazy loader for Documents.
  `aload`() | Load data into Document objects.
  `lazy_load`() | Load file.
  `load`() | Load data into Document objects.
  `load_and_split`([text_splitter]) | Load Documents and split into chunks.

  Parameters

    - file_path (Union[str, Path]) –

    - new_indent_parser (bool) –

    - apply_ocr (bool) –

    - strategy (str) –

    - llmsherpa_api_url (str) –

  __init__(file_path: Union[str, Path], new_indent_parser: bool = True, apply_ocr: bool = True, strategy: str = 'chunks', llmsherpa_api_url: str = 'https://readers.llmsherpa.com/api/document/developer/parseDocument?renderFormat=all')

    Initialize with a file path.

    Parameters

      - file_path (Union[str, Path]) –

      - new_indent_parser (bool) –

      - apply_ocr (bool) –

      - strategy (str) –

      - llmsherpa_api_url (str) –

  async alazy_load() → AsyncIterator[Document]

    A lazy loader for Documents.

    Return type

      AsyncIterator[Document]

  async aload() → List[Document]

    Load data into Document objects.

    Return type

      List[Document]

  lazy_load() → Iterator[Document]

    Load file.

    Return type

      Iterator[Document]

  load() → List[Document]

    Load data into Document objects.

    Return type

      List[Document]

  load_and_split(text_splitter: Optional[TextSplitter] = None) → List[Document]

    Load Documents and split into chunks. Chunks are returned as Documents.

    Do not override this method. It should be considered to be deprecated!

    Parameters

      text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.

    Returns

      List of Documents.

    Return type

      List[Document]

# Examples using LLMSherpaFileLoader

- Install package