7|hddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZddlmZddlmZej*eZdd iZd Zd e d efd ZGdde Zy)N)AnyListOptionalUnion)CallbackManagerForLLMRun)LLM) AIMessage BaseMessageFunctionMessage HumanMessage SystemMessage)Field)enforce_stop_tokensz Content-Typezapplication/jsonmessagereturnc&t|trd|jd}|St|trd|jd}|St|trd|jd}|St|t rd|jd}|St d|)Nuser)rolecontent assistantsystemfunctionzGot unknown type ) isinstancer rr r r ValueError)r message_dicts `/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/chatglm3.py_convert_message_to_dictrs'<( &7??C   GY ' +H   G] + (W__E  G_ - *wG  ,WI677c feZdZUdZeddZeed<dZeed< dZ e e ed < d Z e ed < d Zeed < dZeed< eeZeeed< dZeed< dZeedfed<eZe ed<edefdZede fdZedefdZdede fdZ d dede eede e!dedef dZ"y)!ChatGLM3zChatGLM3 LLM service.z chatglm3-6bmodel)defaultalias model_namez)http://127.0.0.1:8000/v1/chat/completions endpoint_urlN model_kwargsi N max_tokensg? temperaturegffffff?top_p)default_factoryprefix_messagesF streaming http_clienttimeoutrcy)N chat_glm_3)selfs r _llm_typezChatGLM3._llm_type:src|j|j|j|j|jd}i||j xsiS)z,Get the parameters used to invoke the model.)r"r)r(r*stream)r%r)r(r*r-r')r3paramss r_invocation_paramszChatGLM3._invocation_params>sM__++//ZZnn  7&6T..4"66rc^ddl}|jxs|j|jS)Nr)r/)httpxr.Clientr/)r3r:s rclientzChatGLM3.clientJs%E5<< <#EErpromptc |j}|jt|gz}|jd|Dcgc] }t |c}i|Scc}w)N)rmessages)r8r,r updater)r3r=r7r?ms r _get_payloadzChatGLM3._get_payloadPsY((''<+G*HH (KQ5a8K   LsA stop run_managerkwargsc ddl}|j|}tjd| |jj |j t|}tjd||jdk7rtd| |j} t| tr0d } | | vr| | } t| r(| dd d } ntd | td | | t# |}  S#|j$r}td|d}~wwxYw#tj$r }td|d|j d}~wwxYw)axCall out to a ChatGLM3 LLM inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. Example: .. code-block:: python response = chatglm_llm.invoke("Who are you?") rNzChatGLM3 payload: )headersjsonz$Error raised by inference endpoint: zChatGLM3 response: zFailed with response: choicesrrzNo content in response : zUnexpected response type: z?Error raised during decoding response from inference endpoint: z . Response: )r:rBloggerdebugr<postr&HEADERS NetworkErrorr status_coderHrdictlenJSONDecodeErrortextr) r3r=rCrDrEr:payloadresponseeparsed_response content_keysrJrTs r_callzChatGLM3._callZs* ##F+ )'34 I{{''!!7(H  *8*56   3 &5hZ@A A &mmoO/40( ?2-l;G7|&qz)4Y?$'@@Q%RSS #=o=N!OPP  &tT2D ?!! ICA3GH H I,## QRSQTU'}}o/  s0,C?AD$?D!DD!$E7EE)NN)#__name__ __module__ __qualname____doc__rr%str__annotations__r&r'rrQr(intr)floatr*listr,rr r-boolr.rrDEFAULT_TIMEOUTr/propertyr4r8r<rBrrZr2rrr!r!%sMMAJACL#C#'L(4.'1J1K-E50).t)DOT+&D,It/$(KsDy!("GS" 3 7D 7 7FFF 34%):> ==tCy!=67 =  = =rr!)rHloggingtypingrrrrlangchain_core.callbacksr#langchain_core.language_models.llmsrlangchain_core.messagesr r r r r pydanticrlangchain_community.llms.utilsr getLoggerr[rKrNrerQrr!r2rrrosl --=3>   8 $ - . k d rsrr