7|h:ddlZddlZddlmZmZmZmZmZmZm Z ddl m Z ddl m Z ddlmZddlmZmZmZddlmZmZmZddlmZmZej6eZe d d d Gd deZy)N)AnyDictIteratorListMappingOptionalUnion) deprecated)CallbackManagerForLLMRun)BaseLLM) GenerationGenerationChunk LLMResult)convert_to_secret_strget_from_dict_or_envpre_init) ConfigDict SecretStrz0.0.18z1.0zlangchain_ibm.WatsonxLLM)sinceremovalalternative_importc eZdZUdZdZeed< dZeed< dZeed< dZ eed< dZ e e ed< dZ e e ed < dZe e ed < dZe e ed < dZe e ed < dZe e ed < dZe e ed< dZe eed< dZeeefed< dZeed< dZeed<edZedefdZede eeffdZ!e"de de fdZ#ede$eeffdZ%edefdZ&e' d,de e(e eefde eeffdZ)d,de e(ede eeffd Z*de(ede+fd!Z,d"e eefde-fd#Z. d-d$ede e(ed%e e/d&edef d'Z0 d.d(e(ede e(ed%e e/d)e ed&ede+f d*Z1 d-d$ede e(ed%e e/d&ede2e-f d+Z3y)/ WatsonxLLMa- IBM watsonx.ai large language models. To use, you should have ``ibm_watsonx_ai`` python package installed, and the environment variable ``WATSONX_APIKEY`` set with your API key, or pass it as a named parameter to the constructor. Example: .. code-block:: python from ibm_watsonx_ai.metanames import GenTextParamsMetaNames parameters = { GenTextParamsMetaNames.DECODING_METHOD: "sample", GenTextParamsMetaNames.MAX_NEW_TOKENS: 100, GenTextParamsMetaNames.MIN_NEW_TOKENS: 1, GenTextParamsMetaNames.TEMPERATURE: 0.5, GenTextParamsMetaNames.TOP_K: 50, GenTextParamsMetaNames.TOP_P: 1, } from langchain_community.llms import WatsonxLLM watsonx_llm = WatsonxLLM( model_id="google/flan-ul2", url="https://us-south.ml.cloud.ibm.com", apikey="*****", project_id="*****", params=parameters, ) model_id deployment_id project_idspace_idNurlapikeytokenpasswordusername instance_idversionparamsverifyF streaming watsonx_modelforbid)extrareturncy)NF)clss b/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/watsonxllm.pyis_lc_serializablezWatsonxLLM.is_lc_serializablefscdddddddS)N WATSONX_URLWATSONX_APIKEY WATSONX_TOKENWATSONX_PASSWORDWATSONX_USERNAMEWATSONX_INSTANCE_ID)rr r!r"r#r$r.selfs r0 lc_secretszWatsonxLLM.lc_secretsjs !&$**0   r2valuesc tt|dd|d<d|jddjvrtt|dd|d<nD|dsKdtj vr9|d s4d tj vr"|dsdtj vr t d |dsdtj vrtt|dd|d<n|d sd tj vr3tt|d d |d <tt|d d |d <nI|dsdtj vr2tt|dd|d<tt|d d |d <|drdtj vrtt|dd|d< ddlm}|dr|djnd|dr|djnd|dr|djnd|d r|d jnd|d r|d jnd|dr|djnd|dr|djndd}|jDcic] \}}| || }}}||d|d||d|d|d|d}||d<|Scc}}w#t$r tdwxYw)zCValidate that credentials and python package exists in environment.rr4z cloud.ibm.comrr r5r!r6r"r7zDid not find 'token', 'password' or 'apikey', please add an environment variable `WATSONX_TOKEN`, 'WATSONX_PASSWORD' or 'WATSONX_APIKEY' which contains it, or pass 'token', 'password' or 'apikey' as a named parameter.r#r8r$r9r)ModelInferenceNr%)rr r!r"r#r$r%rrr&rrr')rr credentialsr&rrr'r)zdCould not import ibm_watsonx_ai python package. Please install it with `pip install ibm_watsonx_ai`.) rrgetget_secret_valueosenviron ValueError ibm_watsonx_ai.foundation_modelsr?items ImportError)r/r=r?r@keyvaluecredentials_without_none_valuer)s r0validate_environmentzWatsonxLLM.validate_environmentus3.  > u  fjj3DDF F4$VX7GH F8  7O#2::5z*&bjj8x($BJJ6 -Orzz$A"7(/J#w #'9RZZ'G%:(=OP&z"&;(=OP&z"!%5%C#8(;KL$x &;(=OP&z"-(,A,S(=(@UV)}%1  G->-@.)sEEDUU . *.+ +$_5:h'!,/ +h'M'4F? # ). G  s%C J(' J"2J"7)J("J((J=cv|j|j|j|j|jdS)zGet the identifying parameters.rrr&rrrNr:s r0_identifying_paramszWatsonxLLM._identifying_paramss3 !//kk//   r2cy)zReturn type of llm.zIBM watsonx.air.r:s r0 _llm_typezWatsonxLLM._llm_types r2responsec|dddSd}d}dtdtttfdtfd}|D]4}|j d}|s||d|dz }||d |dz }6||dS) Nr)generated_token_countinput_token_countrIresultr,c.|j|dxsdS)Nr)rA)rIrVs r0get_count_valuez8WatsonxLLM._extract_token_usage..get_count_values::c1%* *r2resultsrUrT)strrrintrA)rRrUrTrXresrYs r0_extract_token_usagezWatsonxLLM._extract_token_usages  -.QG G ! + +d38n + + Cggi(G!_5H'RS*%UU!%+WQZ*%  &;!2  r2stopcL|jri|jni}|||d<|S)Nstop_sequences)r&)r;r^r&s r0_get_chat_paramszWatsonxLLM._get_chat_paramss-48KKDKKR  '+F# $ r2c:g}|D]]}|jd}|s|djd}t|djdd|i}|j|g_|j|}||j|j d}t ||S) z2Create the LLMResult from the choices and prompts.rYr stop_reasongenerated_text finish_reasontextgeneration_info) token_usagerr generations llm_output)rAr appendr]rrr) r;rRrkr\rYregenfinal_token_usagerls r0_create_llm_resultzWatsonxLLM._create_llm_result s  *Cggi(G ' } =   (89%4m$D""C5) *!55h?, !// [ZHHr2stream_responsec |ds tdSt|dddt|ddjdd|j|jd  S) z0Convert a stream response to a generation chunk.rYrrgrrdrcN)rr)rerlrf)rdictrArr)r;rqs r0$_stream_response_to_generation_chunkz/WatsonxLLM._stream_response_to_generation_chunksn y)"+ + +A./?@ -i8;?? tT $ %)%7%7  r2prompt run_managerkwargsc h|jd|g||d|}|jddjS)aCall the IBM watsonx.ai inference endpoint. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. run_manager: Optional callback manager. Returns: The string generated by the model. Example: .. code-block:: python response = watsonx_llm.invoke("What is a molecule") )promptsr^rwrr.) _generaterkrg)r;rvr^rwrxrVs r0_callzWatsonxLLM._call1sH&  H4[ DJ !!!$Q',,,r2rzstreamc |j|}||n |j}|rt|dkDrtd|t d}|j |df||d|} | D] } || }|| z }|Jt |jtr*|jjd} t|gg| St|gg S|jj|| } |j| S) aCall the IBM watsonx.ai inference endpoint which then generate the response. Args: prompts: List of strings (prompts) to pass into the model. stop: Optional list of stop words to use when generating. run_manager: Optional callback manager. Returns: The full LLMResult output. Example: .. code-block:: python response = watsonx_llm.generate(["What is a molecule"]) r^z6WatsonxLLM currently only supports single prompt, got rrsr)r^rwrlrj)rk)rvr&)rar(lenrEr_stream isinstancerhrtpoprr)generaterp) r;rzr^rwr}rxr& should_stream generation stream_iterchunkrlrRs r0r{zWatsonxLLM._generateIs((&&D&1"("4$.. 7|a LWIV)b1J&$,, !%;BHK% (%!&J%'J  ( ) ))*44d;'77;;LI  zl^ SS:,8 8))22'&2QH**84 4r2c+K|j|}|jj|d|D]6}|j|}|r|j |j ||8yw)a4Call the IBM watsonx.ai inference endpoint which then streams the response. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. run_manager: Optional callback manager. Returns: The iterator which yields generation chunks. Example: .. code-block:: python response = watsonx_llm.stream("What is a molecule") for chunk in response: print(chunk, end='') # noqa: T201 rT)rv raw_responser&)rN)rar)generate_text_streamruon_llm_new_tokenrg)r;rvr^rwrxr& stream_resprs r0rzWatsonxLLM._streamvsy*&&D&1--BBVC  K==kJE,,UZZu,EK sA+A-)N)NN)NNN)4__name__ __module__ __qualname____doc__rrZ__annotations__rrrrrrr r!r"r#r$r%r&rtr'r boolr(r)rr model_config classmethodr1propertyrr<rrLrrOrQ staticmethodrr]rarrprrur r|r{rrr.r2r0rrsK>HcM3(J*Hc(#C) #1"&FHY &4!%E8I %3$(Hhy!(6$(Hhy!(6'+K)$+9#'GXi '5!FHTN!;!FE#t) !0 It1M3L4 DcN  c$c4ccJ WS#X%6   3  37 4S#X/0 c3h  2Xd3i%8DcN I4:I)I( c3h   *%):> --tCy!-67 -  - -6%):>!% +5c+5tCy!+567 +5  +5  +5 +5`%):> tCy!67    / " r2r)loggingrCtypingrrrrrrr langchain_core._api.deprecationr langchain_core.callbacksr #langchain_core.language_models.llmsr langchain_core.outputsr rrlangchain_core.utilsrrrpydanticrr getLoggerrloggerrr.r2r0rsi FFF6=7IIVV*   8 $ E6PAAAr2