7|h n d dl Z d dlZd dlmZmZmZmZmZ d dlm Z m
Z
d dl m Z d dl
mZ G d de Zy) N)AnyDictListLiteralOptional)#AsyncCallbackManagerForRetrieverRun CallbackManagerForRetrieverRun)Document)
BaseRetrieverc 2 e Zd ZU dZdZeed< dZeed< dZe e ed< dZ
e e ed< d Z e d
ed < d gZ
ee d
ed< dZeed< dZeed< i Ze eeef ed< dZe e ed< dZe e ed< dededee fdZdede dee fdZ dedee fd Z y) AskNewsRetrieverzAskNews retriever.
kr offsetNstart_timestamp
end_timestampnl)r kwmethodAll)r BusinessCrimePoliticsScienceSports
TechnologyMilitaryHealth
EntertainmentFinanceCultureClimate EnvironmentWorld
categoriesF
historicalg ?similarity_score_thresholdkwargs client_id
client_secretquery run_managerreturnc ddl m} || j xs t j
d | j xs t j
d dg } |j j d || j | j | j | j | j | j | j | j dd d
d | j" }| j% | S # t $ r t d w xY w)
zGet documents relevant to a query.
Args:
query: String to find relevant documents for
run_manager: The callbacks handler to use
Returns:
List of relevant documents
r )
AskNewsSDKOAskNews python package not found. Please install it with `pip install asknews`.ASKNEWS_CLIENT_IDASKNEWS_CLIENT_SECRETnewsr) r* scopesboth) r+
n_articlesr r r r% r& r' r doc_start_delimiterdoc_end_delimiter return_type ) asknews_sdkr/ ImportErrorr) osenvironr* r3 search_newsr r r r r% r& r' r r( _extract_documents)selfr+ r, r/ an_clientresponses e/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/retrievers/asknews.py_get_relevant_documentsz(AskNewsRetriever._get_relevant_documents. s . nnG
3F(G ,,S
;R0S8
.9>>--
vv 0 0 ,,;;'+'F'F;; ' &
kk
&&x005 @
s C& &C;c K ddl m} || j xs t j
d | j xs t j
d dg } |j j d
|| j | j | j | j | j | j | j | j dd d
d | j" d { }| j% | S # t $ r t d w xY w7 -w)zAsynchronously get documents relevant to a query.
Args:
query: String to find relevant documents for
run_manager: The callbacks handler to use
Returns:
List of relevant documents
r )AsyncAskNewsSDKr0 r1 r2 r3 r4 r8 r6 r7 ) r+ r9 r r r r% r& r' r r< r: r; Nr= )r> rJ r? r) r@ rA r* r3 rB r r r r r% r& r' r r( rC )rD r+ r, rJ rE rF s rG _aget_relevant_documentsz)AskNewsRetriever._aget_relevant_documentsV s 3 $nnG
3F(G ,,S
;R0S8
4 33
vv 0 0 ,,;;'+'F'F;; ' &
kk
&&x005 @
s( D
C0 CD
DD
0DD
rF c ddl m} |}t j d|j t j
}t
t | D cg c] }t || j |j | j |j | j r"t |j | j nd|j | j d }}|S c c}w )z'Extract documents from an api response.r )SearchResponsez(.*?)N)titlesourceimages) page_contentmetadata)asknews_sdk.dto.newsrM refindall as_stringDOTALLrangelenr
stripas_dictsrN article_urlstr image_url)rD rF rM srmatchesidocss rG rC z#AskNewsRetriever._extract_documents~ s 8 %** 0",, J 3w<(
$QZ - - / [[^ 1 1{{1~11 ""++a."<"< = kk!n 6 6
s BC$) __name__
__module__ __qualname____doc__r int__annotations__r r r r r r r% r r& boolr' floatr( r r] r r) r* r r
rH r rK rC r= rG r
r
s
AsKFCO%)OXc])#'M8C='"&FGJ &&
%
& J (+ +')FHT#s(^ $) #Ix}##'M8C='&1&1*H&1
h &1P&1&1*M&1
h &1P3 4> rk r
)r@ rT typingr r r r r langchain_core.callbacksr r langchain_core.documentsr
langchain_core.retrieversr r
r= rk rG rp s, 5 5 . 3E} Erk