7|hXddlZddlZddlmZmZmZmZmZmZm Z ddl Z ddl m Z ddl mZddlmZddlmZmZddlmZdZej.Gd d Zd eefd Z dd edededed eeeeeefff dZGddeZy)N)AnyDictListMappingOptionalUnioncast)CallbackManagerForLLMRun)LLM)get_from_dict_or_env) ConfigDictmodel_validator)enforce_stop_tokens<c@eZdZUdZeed<eed<ddZeddZy) AviaryBackendzAviary backend. Attributes: backend_url: The URL for the Aviary backend. bearer: The bearer token for the Aviary backend. backend_urlbearerNc*d|ji|_y)N Authorization)rheaderselfs ^/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/aviary.py __post_init__zAviaryBackend.__post_init__s& 4 ctjd}|sJdtjdd}|rd|nd}||jdsdndz }|||S)N AVIARY_URLzAVIARY_URL must be set AVIARY_TOKENzBearer /)osgetenvendswith)cls aviary_url aviary_tokenrs rfrom_envzAviaryBackend.from_envsdYY|, 333zyy4 -97<.)r!4!4S!9crA :v&&r)returnN)r)r) __name__ __module__ __qualname____doc__str__annotations__r classmethodr(rrrrs- K5 ' 'rrr)c tj}|jdz}tj||j t } |j}t|jDcgc](}d|vs|jdjdd*c}}|S#tj$r!}td|d|j|d}~wwxYwcc}w)zList available modelsz-/routes)headerstimeoutError decoding JSON from . Text response: N--r!)rr(rrequestsgetrTIMEOUTjsonJSONDecodeError RuntimeErrortextsortedkeyslstripreplace)backend request_urlresponseresulteks r get_modelsrI,s$$&G%% 2K||KQH 39;;=NaDAI#  tS )NF M  # #' }4Ehmm_ U   Os$ B(2 C<#C(C;CCmodelpromptuse_prompt_formatversionc^tj}|j|jddzdz|zdz}t j ||j ||dt} |jS#tj$r!}td|d|j|d}~wwxYw) z#Get completions from Aviary models.r!r7query)rKrL)r3r;r4r5r6N) rr(rrBr8postrr:r;r<r=r>)rJrKrLrMrCurlrErGs rget_completionsrR=s$$&G    c4 8 83 > H7 RC}} 5F G H }}  # #'u,=hmm_ M  s(A88B, B''B,c eZdZUdZdZeed<dZeeed<dZ eeed<dZ e ed<dZ eeed <e d Zed ededefdZedeeeffdZedefdZ ddedeeedeededef dZy)AviaryabAviary hosted models. Aviary is a backend for hosted models. You can find out more about aviary at http://github.com/ray-project/aviary To get a list of the models supported on an aviary, follow the instructions on the website to install the aviary CLI and then use: `aviary models` AVIARY_URL and AVIARY_TOKEN environment variables must be set. Attributes: model: The name of the model to use. Defaults to "amazon/LightGPT". aviary_url: The URL for the Aviary backend. Defaults to None. aviary_token: The bearer token for the Aviary backend. Defaults to None. use_prompt_format: If True, the prompt template for the model will be ignored. Defaults to True. version: API version to use for Aviary. Defaults to None. Example: .. code-block:: python from langchain_community.llms import Aviary os.environ["AVIARY_URL"] = "" os.environ["AVIARY_TOKEN"] = "" light = Aviary(model='amazon/LightGPT') output = light('How do you make fried rice?') zamazon/LightGPTrJNr&r'TrLrMforbid)extrabefore)modevaluesr)cRt|dd}t|dd}|tjd<|tjd< t}|jd}|r||vrt|d|dd|S#tj j $r}t|d}~wwxYw) z?Validate that api key and python package exists in environment.r&rr'rNrJz does not support model .) r r"environrIr8 exceptionsRequestException ValueErrorr9)r%rYr&r' aviary_modelsrGrJs rvalidate_environmentzAviary.validate_environments*&, M +FNNS $. < %1 >" &LM 7# U-/ |+CF7OCTTUVW W ""33 Q-  s A99B& B!!B&c4|j|jdS)zGet the identifying parameters.) model_namer&)rJr&rs r_identifying_paramszAviary._identifying_paramss**//  rc@d|jjddS)zReturn type of llm.zaviary-r!-)rJrBrs r _llm_typezAviary._llm_types#++C5677rrKstop run_managerkwargsc d|ji}|jr|j|d<td|j|d|}t t |d}|r t ||}|S)a Call out to Aviary Args: prompt: The prompt to pass into the model. Returns: The string generated by the model. Example: .. code-block:: python response = aviary("Tell me a joke.") rLrM)rJrKgenerated_textr1)rLrMrRrJr r.r)rrKrhrirjoutputr>s r_callz Aviary._callst&&t'='=> << $ F9   **   C 012 &tT2D r)NN)r*r+r,r-rJr.r/r&rr'rLboolrMr model_configrr0rrrapropertyrrdrgrr rnr1rrrTrTUs>#E3" $J $"&L(3-&"t"!GXc]!L(#$3$( WS#X%6  8388%):> !!tCy!!67 !  ! !rrT)Tr ) dataclassesr"typingrrrrrrr r8langchain_core.callbacksr #langchain_core.language_models.llmsr langchain_core.utilsr pydanticr rlangchain_community.llms.utilsrr: dataclassrr.rIrofloatintrRrTr1rrr|s BBB=350>  '''6DI(#      #uS%_% %& 0pSpr