7|h8dZddlmZddlZddlZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZddlmZddlZddlmZddlmZmZdd lmZmZdd lmZmZm Z m!Z!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(dd l)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/e rddl0m1Z1m2Z2m3Z3m4Z4ddl5m6Z6ejne8Z9eGddZ:ddZ;ddZ< d dZ=d!dZ>d"dZ?edddGdde*eZ@y)#z1Wrapper around Google VertexAI chat-based models.) annotationsN) dataclassfield) TYPE_CHECKINGAnyDictIteratorListOptionalUnioncast)urlparse) deprecated)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun) BaseChatModelgenerate_from_stream) AIMessageAIMessageChunk BaseMessage HumanMessage SystemMessage)ChatGenerationChatGenerationChunk ChatResult)pre_init)_VertexAICommonis_codey_modelis_gemini_model)load_image_from_gcsraise_vertex_import_error) ChatMessage ChatSessionCodeChatSessionInputOutputTextPair)Contentc<eZdZUdZeeZded<dZded<y) _ChatHistoryz/Represents a context and a history of messages.)default_factoryzList['ChatMessage']historyN Optional[str]context) __name__ __module__ __qualname____doc__rlistr*__annotations__r,g/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/chat_models/vertexai.pyr(r(6s9#(#>G >!G]!r4r(cddlm}gd}}t|D]\}}tt|j }|dk(rt |tr|}8t |tr&||j d}|j|nt |tr&||j d}|j|tdt|d|d t|| }|S) aParse a sequence of messages into history. Args: history: The list of messages to re-create the history of the chat. Returns: A parsed chat history. Raises: ValueError: If a sequence of message has a SystemMessage not at the first place. r)r"Nbot)contentauthoruserUnexpected message with type  at the position .)r,r*)vertexai.language_modelsr" enumerater strr8 isinstancerrappendr ValueErrortyper() r*r"vertex_messagesr,imessager8vertex_message chat_historys r5_parse_chat_historyrJ>s5!4WO(  7sGOO, 6j-8G  +(ON  " "> 2  .(PN  " "> 2/W >OPQsRST   IL r4c t|}t|j|jgS#t$r"}t j d|Yd}~yd}~wwxYw)NzUnable to parse URL: F)rallschemenetloc Exceptionloggerdebug)sresultes r5_is_urlrU^sO!FMM6==122  ,QC01s+. AAAc ddlm}m m d fd }g}t |D]\}}|dk(rt |t r tdt |trd}n.t |trd}ntdt|d|d |j}t |tr|g}|D cgc] } ||  } } ||| } |j| |Scc} w) Nr)r&ImagePartct|trj|St|tst dt |d|ddk(rj|dS|ddk(r|dd}|j drt|}n|j d rZtjd |}|r|jd }n t d jtj|}nit|rAtj |}|j#j|j$}nj'|}n t d j)|S)Nz0Message's content is expected to be a dict, got !rDtext image_urlurlzgs://)pathprojectz data:image/zdata:image/\w{2,4};base64,(.*)zdInvalid image uri. It should be in the format data:image/;base64,.z,Only text and image_url types are supported!)rAr@ from_textrrCrD startswithr researchgroup from_bytesbase64 b64decoderUrequestsgetraise_for_statusr8load_from_file from_image)partr^imageencodedresponserWrXr_s r5_convert_to_promptz6_parse_chat_history_gemini.._convert_to_promptlsW dC >>$' '$%B4:,aP  <6 !>>$v,/ / &\[ ( $U+Dw'+wG/!yy)JDQ%mmA.G$Q(()9)9')BC#<<-))+(()9)9:,,T2KL Lu%%r4z%SystemMessages are not yet supported!modelr:r;r<r=)roleparts)rnzUnion[str, Dict]returnrX)"vertexai.preview.generative_modelsr&rWrXr?rArrCrrrDr8r@rB)r*r_r&rrrErFrGrt raw_contentrnrurHrWrXs ` @@r5_parse_chat_history_geminirygsHG!&FO(/ 7 6j-8DE E  +D  .D/W >OPQsRST oo k3 '&-K6ABd#D)BB d%8~.#/$ Cs-Ccddlm}t|dzdk7rtdt|dg}d}t |D]\}}|dzdk(r7t |t stdt|d|d|j}|dzd k(sNt |tstd t|d|d|||j }|j||S) Nr)r%z8Expect examples to have an even amount of messages, got r=z;Expected the first message in a part to be from human, got z for the z th message.r`z9Expected the second message in a part to be from AI, got ) input_text output_text) r>r%lenrCr?rArrDr8rrB)examplesr% example_pairsr|rFexamplepairs r5_parse_examplesrs< 8}qAFs8}oUV W  MJ)' 7 q5A:g|4 QG}oYqc>!J q5A:gy1 OG}oYqc>'%7??D   &#'$ r4c||s td|d}t|tstd|jd|S)zMGet the human message at the end of a list of input messages to a chat model.z:You should provide at least one message to start the chat!z3Last message in the list should be from human, got r=)rCrArrD)messagesquestions r5 _get_questionrsI UVV|H h -A(--PQ R   Or4z0.0.12z1.0z&langchain_google_vertexai.ChatVertexAI)sinceremovalalternative_importceZdZUdZdZded< dZded<eddZedd Z e dd Z d dd Z d dd Z d dd Z ddZy) ChatVertexAIz+`Vertex AI` Chat large language models API.z chat-bisonr@ model_nameNzOptional[List[BaseMessage]]rcy)NTr3)selfs r5is_lc_serializablezChatVertexAI.is_lc_serializablesr4c gdS)z*Get the namespace of the langchain object.) langchain chat_modelsvertexair3)clss r5get_lc_namespacezChatVertexAI.get_lc_namespaces 87r4ct|d}|j| ddlm}m}|rddlm}|r|d|d<|St|dr}n}|j|d|d<|S#t$r tYTwxYw)z7Validate that the python package exists in environment.rr) ChatModel CodeChatModel)GenerativeModel)rclient) r_try_init_vertexair>rrrwr ImportErrorr!rfrom_pretrained)rvalues is_geminirrr model_clss r5validate_environmentz!ChatVertexAI.validate_environments$F<$89  v& ( I .&:NOF8  f\23) % (88 9MNF8   ( % ' (sA00BBc  ||n |j}|r!|j|f||d|}t|St|}|jd|dd|} i} d| vr| j d| d<|j rWt||j} | j } |jj| } | j| | }nmt|dd }|jd xs |j}|rt|| d <|j |fi| } | j|j"fi| }|j$Dcgc]"}t't)|j*  $}}t-| Scc}w)a>Generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. stream: Whether to use the streaming endpoint. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. N)stop run_managerFrstreamcandidate_countr_r*generation_configrrr8rG generationsr3) streaming_streamrr_prepare_paramspop_is_gemini_modelryr_r start_chat send_messagerJrjrr _start_chatr8 candidatesrrr[r)rrrrrkwargs should_stream stream_iterrparams msg_paramshistory_geminirGchatrqr*rrrs r5 _generatezChatVertexAI._generates.#)"4$.. &$,,#@FK( 4 4 *%%%H4HH  &,2JJ7H,IJ( )  7$,,WN$((*G;;)).)AD((F(KH)(3B-8Gzz*->H%4X%>z"#4##G6v6D(t(()9)9HZHH((  9QVV#< =  k22  s 'FcKd|vr&|jdtjd|jdd|i|}i}d|vr|jd|d<|jr_t ||j }|j}|jj|} | j||d{} nst|} t|dd } |jd d} | rt| |d <|j| fi|} | j| jfi|d{} | j Dcgc]"}t#t%|j&  $}}t)| S77Icc}ww)aAsynchronously generate next turn in the conversation. Args: messages: The history of the conversation as a list of messages. Code chat does not support context. stop: The list of stop words (optional). run_manager: The CallbackManager for LLM run, it's not used at the moment. Returns: The ChatResult that contains outputs generated by the model. Raises: ValueError: if the last message in the list is not from human. rz8ChatVertexAI does not currently support async streaming.rrrrrNrrrrrr3)rrPwarningrrryr_rrsend_message_asyncrrJrjrrr8rrrr[r)rrrrrrrrrGrrqrr*rrrs r5 _ageneratezChatVertexAI._agenerate2s* v  JJx NNU V%%%:4:6:  &,2JJ7H,IJ( )  7$,,WN$((*G;;)).)AD!44WPV4WWH$X.H)(3B-8Gzz*d3H%4X%>z"#4##G6v6D4T44X5E5ETTTH((  9QVV#< =  k22XU s7B>FE<A3F4E>5F'F.F>FFc+hK|jd |dd|}|jrXt||j}|j }|j j |}|j|d|} nkt|} t|dd} |jdd} | rt| |d<|j| fi|}|j| jfi|} | D]E} tt!| j" }|r|j%| j"| |Gyw) NTrrr)rrrrrr)chunkr3)rrryr_rrrrrrJrjrrsend_message_streamingr8rrr[on_llm_new_token)rrrrrrrrGr responsesrr*rrqrs r5rzChatVertexAI._streamds1&%%G4GG  7$,,WN$((*G;;)).)AD))*I%X.H)(3B-8Gzz*d3H%4X%>z"#4##G6v6D333H4D4DOOI! H'x}}0UVE,,X]]%,HK  sD0D2c |js3|jjd|j|jd|S|jjdd|ji|S)N)r,message_historyrr3)rrrr,r*)rr*rs r5rzChatVertexAI._start_chatse"")4;;))LR *4;;))T'//TVT Tr4)rvbool)rvz List[str])rrrvr)NNN) rList[BaseMessage]rOptional[List[str]]r"Optional[CallbackManagerForLLMRun]rzOptional[bool]rrrvr)NN) rrrrrz'Optional[AsyncCallbackManagerForLLMRun]rrrvr) rrrrrrrrrvzIterator[ChatGenerationChunk])r*r(rrrvz#Union[ChatSession, CodeChatSession])r-r.r/r0rr2r classmethodrrrrrrrrr3r4r5rrs@ 6"J",0H)0884%):>!% 43#43"438 43  43  43 43r%)?C 03#03"03= 03  03  03j%):> #"8    ' :U#U/2U ,Ur4r)r*rrvr()rRr@rvr)r*rr_r+rvzList['Content'])rrrvzList['InputOutputTextPair'])rrrvr)Ar0 __future__rrgloggingrc dataclassesrrtypingrrrr r r r r urllib.parserrilangchain_core._api.deprecationrlangchain_core.callbacksrr*langchain_core.language_models.chat_modelsrrlangchain_core.messagesrrrrrlangchain_core.outputsrrrlangchain_core.utilsr!langchain_community.llms.vertexairrr&langchain_community.utilities.vertexair r!r>r"r#r$r%rwr& getLoggerr-rPr(rJrUryrrrr3r4r5rs7"  (RRR!6SR)   ;   8 $ "" "@; ;)6;;|<   ? uU?MuU  uUr4