7|hc8ddlZddlZddlmZddlmZmZmZmZm Z m Z m Z ddl Z ddl Z ddlmZmZddlmZddlmZmZddlmZddlmZmZmZdd lmZdd lmZGd d e Z Gd deZ!y)N)ThreadPoolExecutor)AnyDictListMappingOptionalSequence TypedDict)AsyncCallbackManagerForLLMRunCallbackManagerForLLMRun)BaseLLM) Generation LLMResultget_from_dict_or_env) ConfigDictFieldmodel_validator)Self)enforce_stop_tokensceZdZUdZeed<y) TrainResultz Train result.lossN)__name__ __module__ __qualname____doc__float__annotations__c/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/gradient_ai.pyrrs  Kr!rc eZdZUdZeddZeed< dZe eed< dZ e eed< dZ e e ed < d Z eed < dZe ej ed < ed dZedededefdZeddefdZedeeeffdZedefdZdeedeeefdeeeffdZdedeeefdeeeffdZ d'dede e!ede e"dedef d Z# d'dede e!ede e$dedef d!Z% d'd"e!ede e!ede e"dede&f d#Z' d'd"e!ede e!ede e$dede&f d$Z(deedede)fd%Z*deedede)fd&Z+y)( GradientLLMaGradient.ai LLM Endpoints. GradientLLM is a class to interact with LLMs on gradient.ai To use, set the environment variable ``GRADIENT_ACCESS_TOKEN`` with your API token and ``GRADIENT_WORKSPACE_ID`` for your gradient workspace, or alternatively provide them as keywords to the constructor of this class. Example: .. code-block:: python from langchain_community.llms import GradientLLM GradientLLM( model="99148c6d-c2a0-4fbe-a4a7-e7c05bdb8a09_base_ml_model", model_kwargs={ "max_generated_token_count": 128, "temperature": 0.75, "top_p": 0.95, "top_k": 20, "stop": [], }, gradient_workspace_id="12345614fc0_workspace", gradient_access_token="gradientai-access_token", ) model)alias min_lengthmodel_idNgradient_workspace_idgradient_access_token model_kwargszhttps://api.gradient.ai/apigradient_api_url aiosessionTforbid)populate_by_nameextrabefore)modevaluesreturncft|dd|d<t|dd|d<t|dd|d<|S)z?Validate that api key and python package exists in environment.r+GRADIENT_ACCESS_TOKENr*GRADIENT_WORKSPACE_IDr-GRADIENT_API_URLr)clsr4s r"validate_environmentz GradientLLM.validate_environmentRsZ +? +-D+ &'+? +-D+ &'&: &(:& !" r!afterc ddl}|j t |j dkr td|jt |j dkr td|jr|j}d|jdd cxkrd kstd td d|jd d cxkrd kstd td d|jdd k\r tdd|jdd k\r td|S#t$rtjdY=t$rYHwxYw)zPost init validation.rNzdDeprecationWarning: `GradientLLM` will use `pip install gradientai` in future releases of langchain. z0env variable `GRADIENT_ACCESS_TOKEN` must be setz0env variable `GRADIENT_WORKSPACE_ID` must be set temperatureg?z-`temperature` must be in the range [0.0, 1.0]top_pz'`top_p` must be in the range [0.0, 1.0]top_kz`top_k` must be positivemax_generated_token_countz,`max_generated_token_count` must be positive) gradientai ImportErrorloggingwarning Exceptionr+len ValueErrorr*r,get)selfrEkws r" post_initzGradientLLM.post_initcsT    % % -T5O5O1PSU1UOP P  % % -T5O5O1PST1TOP P   ""B}c27a7 !PQQ8 !PQQw,11 !JKK2 !JKKBFF7C(( !;<<BFF6:: !OPP ;  OOL    sD""EEEcJ|jxsi}id|jid|iS)zGet the identifying parameters.r-r,)r,r-)rM _model_kwargss r"_identifying_paramszGradientLLM._identifying_paramss>))/R  !4#8#89 }-  r!cy)zReturn type of llm.gradientr )rMs r" _llm_typezGradientLLM._llm_typesr!inputskwargsc L|jxsi}i||}|jdd}t|jd|jdd|j |j dddt|td|Dntd t||D  S) Build the kwargs for the Post request, used by sync Args: prompt (str): prompt used in query kwargs (dict): model kwargs in payload Returns: Dict[str, Union[str,dict]]: _description_ multipliersN/models/z /fine-tuneBearer application/json authorizationzx-gradient-workspace-idacceptz content-typec3$K|]}d|i yw)rVNr ).0inputs r" z=GradientLLM._kwargs_post_fine_tune_request..s!"%esc30K|]\}}|d|idyw) multiplier)rVfineTuningParametersNr )rbrcrfs r"rdz=GradientLLM._kwargs_post_fine_tune_request..s-.E: ', ,j5s)samplesurlheadersjson) r,rLdictr-r)r+r*tuplezip)rMrVrWrQ_paramsrZs r"_kwargs_post_fine_tune_requestz*GradientLLM._kwargs_post_fine_tune_requests))/R -]-f-kk-6 (()$-- K#*4+E+E*F!G.2.H.H-I, 2  #* &, 25V[1I  r!promptcT|jxsi}i||}t|jd|jdd|j|j dddt||j dd|j dd|j d d|j d d  S) rYr[z /completer\r]r^rDNr@rCrB)querymaxGeneratedTokenCountr@topKtopPri)r,rmr-r)r+r*rL)rMrrrWrQrps r"_kwargs_post_requestz GradientLLM._kwargs_post_requests))/R -]-f-(()$-- J#*4+E+E*F!G.2.H.H-I, 2  '.{{3NPT'U#KK t<[[$/[[$/   r!stop run_managerc d tjdi|j||}|jdk7r%t d|jd|j  |jd}| t||}|S#tj j$r}t d|d}~wwxYw)aCall to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. 5Gradient returned an unexpected response with status : 2RequestException while calling Gradient Endpoint: NgeneratedOutputr ) requestspostrx status_coderItext exceptionsRequestExceptionrlr)rMrrryrzrWresponseers r"_callzGradientLLM._calls  V}}Qt'@'@'PQH##s*K++,Bx}}o?+}}01  &tT2D ""33 VPQRPSTU U VsAA??B/B**B/c K|jstj4d{}|jdi|j ||4d{}|j dk7r%t d|j d|j|jd{d}dddd{dddd{n|jjdi|j ||4d{}|j dk7r%t d|j d|j|jd{d}dddd{| t|}S7F777#1d{7swYxYw7#1d{7swYCxYw77_7N#1d{7swY^xYww)aAsync Call to Gradients API `model/{id}/complete`. Args: prompt: The prompt to pass into the model. stop: Optional list of stop words to use when generating. Returns: The string generated by the model. N)rrrWr|r}r~rr ) r.aiohttp ClientSessionrrxstatusrIrrlr)rMrrryrzrWsessionrrs r"_acallzGradientLLM._acalls ,,. F F''7<<//vf/MFF#-'S'/r(--B#+--/13DEDFF F F F,t++++6&+I B B??c)#O#??+2hmm_>'mmo-/@A B B  &tT2D 3 FF2FFFF F F F F B. B B B Bs%F>E-F>(FE0FAE7E3 E7' F2E53F7 F>F 6F>9F#:F>=AF)F%F) F>F'F>0F3E75F7F =F>F F F>F F F F>%F)'F>)F;/F2 0F;7F>promptsc >dtdttffd }t|dkrt t ||}nBt tdt|5}t |j ||}dddtS#1swYxYw)*Run the LLM on the given prompt and input.rrr5c Ftjd|dgS)N)rrryrzrr )rr)rrrWrzrMrys r"_inner_generatez.GradientLLM._generate.._inner_generate=s7#%DkMS r!rAN generations) strrrrJlistmaprminr)rMrryrzrWrrps` ``` r" _generatezGradientLLM._generate3s C D,<   w<1 s?G<=K#C3w<$89 DQ"155'#BC  D[11 D Ds #BBc Kg}tj|Dcgc]}|j|f||d|c}d{D]}|jt |g t |Scc}w76w)r)ryrzNrr)asynciogatherrappendrr)rMrryrzrWrrr generations r" _ageneratezGradientLLM._agenerateNs '& FQ;Q&Q!   >J    ;< =  >[11  sA5A.A5A37A5c l tjdi|j||}|jdk7r%t d|jd|j  |j}|d|dz }t|S#tj j$r}t d|d}~wwxYw) Nr|r}r~rsumLossnumberOfTrainableTokensrr ) rrrqrrIrrrrlr)rMrVrWrr response_jsonrs r"train_unsupervisedzGradientLLM.train_unsupervised`s V}}55ffEH##s*K++,Bx}}o?+!  Y'-8Q*RR%% ""33 VPQRPSTU U VsABB3 B..B3c K|jstj4d{}|jdi|j ||4d{}|j dk7r%t d|j d|j|jd{}|d|dz }dddd{dddd{n|jjdi|j ||4d{}|j dk7r%t d|j d|j|jd{}|d|dz }dddd{tS7P7(77#1d{7swYxYw7#1d{7swY?xYw77c7J#1d{7swYZxYww)Nr|r}r~rrrr ) r.rrrrqrrIrrlr)rMrVrWrrrrs r"atrain_unsupervisedzGradientLLM.atrain_unsupervisedus ,,.  ''7<<99&&I  #-'S'/r(--B+3--/$9M%i0'(ABC     ,t++55ffE  ??c)#O#??+2hmm_>'/mmo 5 !),}=V/WW  %%9  %:         !6    s%GE7G'FE:FAFE=F. F9E?:F> G F 5G?F-GAF3 F/ F3 G&F1'G:F=F?FF F F FGF*F! F*&G/F31G3G9F< :GG)NN),rrrrrr)rrr*rr+r,rmr-r.rrr model_configr classmethodrrr;rrOpropertyrrRrUr rqrxrr rr rrrrrrrr r!r"r$r$s6A6Hc6;+/8C=/*+/8C=/ $(L(4.'19c926J../6IL (# $ 3 $ '""4"#"H WS#X%6  3- sm- -4S#X->- c - ^  #*38#4 c  F%):>  tCy! 67    J%)?C **tCy!*;< *  * *^%):> 2c2tCy!267 2  2  2<%)?C 2c2tCy!2;< 2  2  2$& &&  &*"& "&"&  "&r!r$)"rrGconcurrent.futuresrtypingrrrrrr r rrlangchain_core.callbacksr r #langchain_core.language_models.llmsr langchain_core.outputsrrlangchain_core.utilsrpydanticrrrtyping_extensionsrlangchain_community.llms.utilsrrr$r r!r"rsS1JJJ88577">) |&'|&r!