7|h>ddlZddlZddlmZmZmZmZmZmZddl Z ddl m Z ddl m Z ddlmZddlmZej$eZGdde Zy) N)AnyDictListMappingOptionalSet)CallbackManagerForLLMRun)LLM)Field)enforce_stop_tokensc eZdZUdZdZeed< eddZe ed< dZ e e ed < d Z e e ed < d Ze e ed < dZeed< dZe eed< gZe eeed< dZe e ed< dZe e ed< dZeed< gZeeed< dZeed< deddffd ZedefdZedeefdZde eeffdZ!ede"eeffd Z# d$d!ede eed"e e$dedef d#Z%xZ&S)%Yuan2unYuan2.0 language models. Example: .. code-block:: python yuan_llm = Yuan2( infer_api="http://127.0.0.1:8000/yuan", max_tokens=1024, temp=1.0, top_p=0.9, top_k=40, ) print(yuan_llm) print(yuan_llm.invoke("你是谁？")) zhttp://127.0.0.1:8000/yuan infer_apii max_token)alias max_tokensgffffff?tempg?top_prtop_kF do_sampleechostop@ repeat_last_ngzG?repeat_penalty streaminghistory use_historykwargsreturnNc t|di||jxsddkDr1|jxsddkDrtj dd|_yyy)zInitialize the Yuan2 class.rzGtop_p and top_k cannot be set simultaneously. set top_k to 0 instead...N)super__init__rrloggerwarning)selfr __class__s ]/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/yuan2.pyr$zYuan2.__init__IsT "6" JJO!q djjoA%: NN, DJ &; cy)NzYuan2.0r"r's r) _llm_typezYuan2._llm_typeTsr*c hdS)N>rrrrrr"r"r*r)_model_param_nameszYuan2._model_param_namesXs   r*c |j|j|j|j|j|j |j |jdS)Nrrrrrrrrr1r,s r)_default_paramszYuan2._default_paramsbsH//"11IIZZZZ++  r*cd|ji|j|jjDcic]\}}||j vs||c}}Scc}}w)zGet the identifying parameters.model)r-r2__dict__itemsr/)r'kvs r)_identifying_paramszYuan2._identifying_paramsnsl T^^ ""$ "&!4!4!6A!t?V?V?X:X1  s A A prompt run_managerc |jr7|jj|dj|j}n|}ddi}t j d|dg|j |j|j|j|jd}tjd| tj|j||}tjd ||j&d k7rt%d | |j } | ddk7rt%d| dd| ddd| vr.t)| dddk\r| dddd} nt%dt%d | t/| |} |jr|jj| tjd|j| S#tj j"$r} t%d | d } ~ wwxYw#tj j*$r } t%d| d|j,d } ~ wwxYw)uxCall out to a Yuan2.0 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = yuan_llm.invoke("你能做什么?") zz Content-Typezapplication/json000)idques) ques_listtokens_to_generate temperaturerrrzYuan2.0 prompt:)headersdatazError raised by inference api: NzYuan2.0 response: zFailed with response: errCode0zFailed with error code [z], error message: [ exceptionMsg]resDataoutputranszNo output found in response.zNo resData found in response.z:Error raised during decoding response from inference api: z . Response: z history: )rrappendjoinjsondumpsrrrrrr%debugrequestsputr exceptionsRequestException ValueError status_codelenJSONDecodeErrortextr ) r'r:rr;rinputrCrDresponseeresp generate_texts r)_callz Yuan2._callysO,    LL   'JJt||,EE!#56zz%*E:;&*oo#yy!^^      &. D||DNNG$OH  )(45   3 &5hZ@A A ==?DI#% .tI.?@''+N';&qcBC C D0""22 LQCP'}}o/  s13"G A-HH/G==HI"H==I)NN)'__name__ __module__ __qualname____doc__rstr__annotations__r rintrrfloatrrrboolrrrrrrrrrr$propertyr- staticmethodrr/rr2rr9r r` __classcell__)r(s@r)rrs 2Is1D 4J4D(5/. E8E? .E8C=.It!D(4. % "D(49 "@#%M8C=%&*NHUO*2It/GT#Y%K'   3 C    c3h   WS#X%6  %):> TTtCy!T67 T  T Tr*r)rOloggingtypingrrrrrrrRlangchain_core.callbacksr #langchain_core.language_models.llmsr pydanticr langchain_community.llms.utilsr getLoggerrar%rr"r*r)rts@ ::=3>   8 $~C~r*