7|hr!jddlZddlmZmZmZmZmZmZddlm Z ddl m Z ddl m Z mZGdde Zy)N)AnyDictListMappingOptionalUnion)CallbackManagerForLLMRun)LLM)Field SecretStrc eZdZUdZeed<eed<dZeeed<dZ eeed<dZ ee ed<e e Zeeefed <e d d d Ze ed <edefdZ ddedeeedeededef dZedeeeffdZdefdZy) PredibaseaUse your Predibase models with Langchain. To use, you should have the ``predibase`` python package installed, and have your Predibase API key. The `model` parameter is the Predibase "serverless" base_model ID (see https://docs.predibase.com/user-guide/inference/models for the catalog). An optional `adapter_id` parameter is the Predibase ID or HuggingFace ID of a fine-tuned LLM adapter, whose base model is the `model` parameter; the fine-tuned adapter must be compatible with its base model; otherwise, an error is raised. If the fine-tuned adapter is hosted at Predibase, then `adapter_version` in the adapter repository must be specified. An optional `predibase_sdk_version` parameter defaults to latest SDK version. modelpredibase_api_keyNpredibase_sdk_version adapter_idadapter_version)default_factory model_kwargsg?)max_new_tokens temperaturedefault_options_for_generationreturncy)N predibaseselfs a/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/predibase.py _llm_typezPredibase._llm_type(spromptstop run_managerkwargsc 4i|j|jxsi|xsi}|jr ddlm}ddlm}ddlm}m } ddl m } m } ddl m} ddlm} ||j"j%dd }|| }|j+d|j,}|j.rY |j1|j.|j2d}|j5|j7||}|j8S|j7||}|j8Sddlm}dt<j>d<||j"j%}ddl }ddl!m"}ddl#m$}ddl%m&}|jNjQ|j,}|j.rs |j2rD|j.d|j2}|jSdd |j6d(||d|}n7 |j6d(||j.d!d"|}n |j6d(d%|i|}|jV}|S#t&$r}t'd |d}~wt($r}t)d |d}~wwxYw#|$r#|j+d|j.}YwxYw#|$r}t)d|d |d}~wwxYw#|$r}t)d#|j.d$|d}~wwxYw#|jT$r}t)d&|j,d'|d}~wwxYw))Nr)PredibaseClient) get_session)ServerResponseErrorSession)HuggingFaceLLM LLMDeployment)GeneratedResponse)Modelz https://api.app.predibase.com/v1zserving.app.predibase.com)tokengatewayserving_endpoint)sessionzZCould not import Predibase Python package. Please install it with `pip install predibase`.z-Your API key is not correct. Please try againzpb://deployments/)uri)nameversionmodel_idzhf://)r)r#options)rzhttps://api.app.predibase.comPREDIBASE_GATEWAY) api_token)Client)GenerationError)Response)deployment_ref/r:)r#rzAn adapter with the ID "zE" cannot be found in the Predibase repository of fine-tuned adapters.hub)r#radapter_sourcezEither an adapter with the ID "z" cannot be found in a HuggingFace repository, or it is incompatible with the base model (please make sure that the adapter configuration is consistent). r#zAn LLM with the deployment ID "z" cannot be found at Predibase (please refer to "https://docs.predibase.com/user-guide/inference/models" for the list of supported models). r),rr_is_deprecated_sdk_versionrr( predibase.pqlr)predibase.pql.apir*r+ predibase.resource.llm.interfacer,r-predibase.resource.llm.responser.predibase.resource.modelr/rget_secret_value ImportError ValueErrorr rr get_modelr with_adaptergenerateresponserosenvironrequests lorax.clientr; lorax.errorsr< lorax.typesr= deploymentsclientpopJSONDecodeErrorgenerated_text) rr#r$r%r&r8r(r)r*r+r,r-r.r/r3pcebase_llm_deployment adapter_modelresultrrrQ LoraxClientr<r= lorax_client pb_adapter_idrNgejde response_texts r _callzPredibase._call,s1 111   &B1 |1   * * , Y55N:#.00AAC>%@$ '6g&F24' |4282  J$&LL!__ $ 4 4!%%1%M-99 9NWW!#X?? " -55!#6?? "'*I &'(,,==?  60($-$9$9$@$@::%A% ?? ##(,'8$:N:N9O%P   4|44 %#0 " H 4|44 %#'??', "  H 0<00!!// _ !F Y !PQWXX Y(+J$&FFt6G/HF$IMJ`'$4]OD:='$;DOO;LM  ++  7 |D   s~AI7(I:*J% K#K) I7 I I7& I22I7:$J"!J"%J?*J::J?K&K!!K&)L8LLc"id|jiS)zGet the identifying parameters.r)rrs r _identifying_paramszPredibase._identifying_paramss t001  r"c ddl}ddlm}ddlm}|j d}|j xs|}|j |}||kDxsd|v S#t $r}t d|d}~wwxYw)Nr) __version__)Versionz2024.4.8)version_stringz+devzkCould not import Predibase Python package. Please install it with `pip install semantic_version predibase`.)semantic_versionpredibase.versionrisemantic_version.baserjrrI)rrlcurrent_versionrjsdk_semver_deprecatedactual_current_versionsdk_semver_currentr[s r rBz$Predibase._is_deprecated_sdk_versions  # H 5-=-E-E).F. !+/*D*D*W "*:*B*B5+C+ $&;;644  S  sAA A, A''A,)NN)__name__ __module__ __qualname____doc__str__annotations__r rrrrintr dictrrrrpropertyr!rr rerrgboolrBrr"r rr s" J  +/8C=/ $J $%)OXc])#(#>L$sCx.>+0! ,"D3 %):> PPtCy!P67 P  P Pd WS#X%6  Dr"r)rOtypingrrrrrrlangchain_core.callbacksr #langchain_core.language_models.llmsr pydanticr r rrr"r rs% <<=3%QQr"