autorag.nodes.passagecompressor package

Submodules

autorag.nodes.passagecompressor.base module

class autorag.nodes.passagecompressor.base.BasePassageCompressor(project_dir: str, *args, **kwargs)

Bases: BaseModule

cast_to_run(previous_result: DataFrame, *args, **kwargs)

This function is for cast function (a.k.a decorator) only for pure function in the whole node.

class autorag.nodes.passagecompressor.base.LlamaIndexCompressor(project_dir: str, **kwargs)

Bases: BasePassageCompressor

param_list = ['prompt', 'chat_prompt', 'batch']

pure(previous_result: DataFrame, *args, **kwargs)

autorag.nodes.passagecompressor.base.make_llm(llm_name: str, kwargs: Dict) → LLM

autorag.nodes.passagecompressor.longllmlingua module

class autorag.nodes.passagecompressor.longllmlingua.LongLLMLingua(project_dir: str, model_name: str = 'NousResearch/Llama-2-7b-hf', **kwargs)

Bases: BasePassageCompressor

pure(previous_result: DataFrame, *args, **kwargs)

autorag.nodes.passagecompressor.longllmlingua.llmlingua_pure(query: str, contents: List[str], llm_lingua, instructions: str, target_token: int = 300, **kwargs) → str

Return the compressed text.

Parameters:

• query – The query for retrieved passages.

• contents – The contents of retrieved passages.

• llm_lingua – The llm instance, that will be used to compress.

• instructions – The instructions for compression.

• target_token – The target token for compression. Default is 300.

• kwargs – Additional keyword arguments.

Returns:

The compressed text.

autorag.nodes.passagecompressor.pass_compressor module

class autorag.nodes.passagecompressor.pass_compressor.PassCompressor(project_dir: str, *args, **kwargs)

Bases: BasePassageCompressor

pure(previous_result: DataFrame, *args, **kwargs)

autorag.nodes.passagecompressor.refine module

class autorag.nodes.passagecompressor.refine.Refine(project_dir: str, **kwargs)

Bases: LlamaIndexCompressor

autorag.nodes.passagecompressor.run module

autorag.nodes.passagecompressor.tree_summarize module

class autorag.nodes.passagecompressor.tree_summarize.TreeSummarize(project_dir: str, **kwargs)

Bases: LlamaIndexCompressor

Module contents