org.noear.solon.ai.rag.splitter

Class JsonSplitter

java.lang.Object

org.noear.solon.ai.rag.splitter.JsonSplitter

All Implemented Interfaces:

DocumentSplitter

public class JsonSplitter
extends Object
implements DocumentSplitter

Json 文档分割器（将数组数据分割为不同的文档）

Since:

3.1

Author:

noear

Constructor Summary

Constructors

Constructor and Description
JsonSplitter()

Method Summary

Modifier and Type	Method and Description
protected String	buildContent(Map<String,Object> jsonData) 构建内容
protected Map<String,Object>	buildMetadata(Map<String,Object> jsonData) 构建元数据
JsonSplitter	contentSelector(String... keys) 内容选择器
JsonSplitter	metadataMapper(Function<Map<String,Object>,Map<String,Object>> mapper) 元数据映射器（将内容数据转为元数据）
List<Document>	split(List<Document> documents) 分割
protected List<Document>	splitDocument(Document in, List<Document> outs) 分割文档
protected List<Document>	splitJson(String josn) 分割 json text
protected void	splitJsonNode(org.noear.snack.ONode oNode, List<Document> docs) 分割 json node

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.noear.solon.ai.rag.DocumentSplitter

split

Constructor Detail

JsonSplitter

public JsonSplitter()

Method Detail

contentSelector

public JsonSplitter contentSelector(String... keys)

内容选择器

metadataMapper

public JsonSplitter metadataMapper(Function<Map<String,Object>,Map<String,Object>> mapper)

元数据映射器（将内容数据转为元数据）

split

public List<Document> split(List<Document> documents)

Description copied from interface: DocumentSplitter

分割

Specified by:

split in interface DocumentSplitter

Parameters:

documents - 文档

splitDocument

protected List<Document> splitDocument(Document in,
                                       List<Document> outs)

分割文档

splitJson

protected List<Document> splitJson(String josn)

分割 json text

splitJsonNode

protected void splitJsonNode(org.noear.snack.ONode oNode,
                             List<Document> docs)

分割 json node

buildContent

protected String buildContent(Map<String,Object> jsonData)

构建内容

buildMetadata

protected Map<String,Object> buildMetadata(Map<String,Object> jsonData)

构建元数据