ih V d dl Z d dlmZmZmZ d dlZd dlmZ d dlm Z G d de Z
y) N)DictIteratorList)Document)
BaseLoaderc e Zd ZdZddedefdZedeeef fd Zde fdZ
de de e fd Z d
e de e fd Z
d
e d e defd
ZdedefdZededefd ZdedefdZdee fdZde e fdZy) YuqueLoader Load documents from `Yuque`. access_tokenapi_urlc || _ || _ y)zInitialize with Yuque access_token and api_url.
Args:
access_token: Personal access token - see https://www.yuque.com/settings/tokens.
api_url: Yuque API url.
N)r r )selfr r s h/var/www/html/dev/engine/venv/lib/python3.12/site-packages/langchain_community/document_loaders/yuque.py__init__zYuqueLoader.__init__
s ) returnc d| j dS )Nzapplication/json)z Content-Typez X-Auth-Token)r r s r headerszYuqueLoader.headers s / - -
r c T | j d}| j | }|d d S )Nz /api/v2/userurldataidr http_getr r responses r get_user_idzYuqueLoader.get_user_id s2 l+==S=) %%r user_idc T | j d| d}| j | }|d S )Nz/api/v2/users/z/reposr r r )r r r r s r get_bookszYuqueLoader.get_books$ s3 nWIV<==S=) r book_idc | j d| d}| j | }|d D cg c] }|d c}S c c}w )N/api/v2/repos/z/docsr r r r )r r# r r documents r get_document_idsz YuqueLoader.get_document_ids* sE nWIU;==S=)/7/?@8@@@s ; document_idc X | j d| d| }| j | }|d S )Nr% z/docs/r r r )r r# r( r r s r get_documentzYuqueLoader.get_document0 s7 nWIVK=I==S=) r r& c j | j |d }|d |d |d |d d}t || S )Nbodytitle description
created_at
updated_at)r- r. r/ r0 ) page_contentmetadata)parse_document_bodyr )r r& contentr2 s r parse_documentzYuqueLoader.parse_document6 sM **8F+;< g&#M2"<0"<0
Wx@@r r, c b t j dd| }t j dd| }|S )Nz z )resub)r, results r r3 z YuqueLoader.parse_document_bodyA s, .D9 b&1
r r c t j || j }|j |j S )N)r )requestsgetr raise_for_statusjsonr s r r zYuqueLoader.http_getH s. <<T\\:!!#}} r c # K | j }| j | }|D ]F }|d }| j | }|D ]) }| j || }| j | }| + H y w)Nr )r r" r' r* r5 ) r r booksbookr# document_idsr( r& parsed_documents r
get_documentszYuqueLoader.get_documentsN s ""$w' &D4jG 009L +
& ,,WkB"&"5"5h"?%%
& &s A.A0c 4 t | j S )r
)listrE r s r loadzYuqueLoader.loadZ s D&&())r N)zhttps://www.yuque.com)__name__
__module__ __qualname____doc__strr propertyr r intr r r" r' r* r r5 staticmethodr3 r r rE rH r r r r
s & S 3
c3h
&S & d A AS A C c d At A A # # C D
&x 1
&*d8n *r r ) r8 typingr r r r< langchain_core.documentsr )langchain_community.document_loaders.baser r rQ r r rU s% ' ' - @R** R*r