i{dZddlZddlZddlmZmZmZmZmZm Z ddl Z ddl m Z ddl mZddlmZddlmZddlmZmZd d lmZmZmZmZmZd Zerdd lmZneZGd dZ y)z Base Vertex, Google AI Studio LLM Class Handles Authentication and generating request urls for Vertex AI and Google AI Studio N) TYPE_CHECKINGAnyDictLiteralOptionalTuple)verbose_logger)asyncify)AsyncHTTPHandler)get_secret_str)VERTEX_CREDENTIALS_TYPESVertexPartnerProvider)_get_gemini_url_get_vertex_urlall_gemini_url_modesget_vertex_base_model_nameget_vertex_base_urlzqGoogle Cloud SDK not found. Install it with: pip install 'litellm[google]' or pip install google-cloud-aiplatform) CredentialsceZdZd:fd ZdeededefdZdeedeedee effd Z d Z d Z d Z d ZdZdefdZdeedeedefdZe d;dedededeededeedefdZdeedeedeedededeededefdZde ddfdZdeedeededdeeeffdZdedefdZ ddeedeed.edeeeffd/Z!deedeededdeeeffd0Z"d!eed1eedefd2Z#ed3edeefd4Z$ed3edeefd5Z%ed3edeefd6Z&ed3edeefd7Z'ed3edeefd8Z(ed3edeefd9Z)xZ*S)? VertexBasereturnNcvt|d|_d|_d|_i|_d|_d|_yN)super__init__ access_token refresh_token _credentials_credentials_project_mapping project_id async_handler)self __class__s w/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/vertex_llm_base.pyrzVertexBase.__init__&sD +/,0?C  )*.9= vertex_regionmodelcddl}|jdsd|n|}|jj|i}|jd}|r? %6!7!!;$(++$55&&8!%%a( )++ - -r& credentialsr!c|t|trtjd|tjd|tj j |t j tj j |rtjt|}ntj|}n6t|tr|}n#tdjt!|d|vr|ddk(r|j#di}t|tr|j#dd nd }t|trHd |vrDd d lm}|j)|}|r|j+||d g}nm|j-|d g}nX|j/|d g}nCd|vr+|ddk(r#|j1|d g}|!|j2}n|j5|d g}|(t7|dd}n|j9d g\}} || }|j;||s tdt|tst=dt!|||fS#t$rtdj|wxYw)Nz*Vertex: Loading vertex credentials from %szVVertex: checking if credentials is a valid path, os.path.exists(%s)=%s, current dir %sz:Unable to load vertex credentials from environment. Got={}zInvalid credentials type: {}typeexternal_accountcredential_sourceenvironment_idawsr)VertexAIAwsWifAuthz.https://www.googleapis.com/auth/cloud-platform) aws_paramsscopesr?authorized_userr!Could not resolve project_idz(Expected project_id to be a str but got ) isinstancestrr debugospathexistsgetcwdjsonloadopenloads Exceptionformatdict ValueErrorr7r/(litellm.llms.vertex_ai.vertex_ai_aws_wifr=extract_aws_paramscredentials_from_explicit_aws(_credentials_from_identity_pool_with_aws_credentials_from_identity_pool!_credentials_from_authorized_userquota_project_id!_credentials_from_service_accountgetattr_credentials_from_default_auth refresh_auth TypeError) r#r5r!json_objr9r:r=r>credscreds_project_ids r% load_authzVertexBase.load_authOs  "+s+$$@+$$lGGNN;/IIK  ww~~k2#'99T+->#?#'::k#:K.& 299${:KL !hv&6:L&L$,LL1Db$I!""3T:&))*:B? nc2u7N"4!F!Fx!PJ! 2 P P$'1$T#U!Q! !% M M$$T#U!N! !@@ PQAE 8#(8>LM?%..>>LM? !$UL$? &*&I&IHI'J' #E#!-  % ;< <*c*:4 ;K:LM j  a!#T[['s 2AI!!$Jc ddlm}|jj |}|r)t |dr|jr|j|}|S#t$rttwxYw)Nr) identity_poolrequires_scopes) google.authrc ImportErrorGOOGLE_IMPORT_ERROR_MESSAGEr from_infohasattrrd with_scopes)r#r^r?rcr_s r%rVz*VertexBase._credentials_from_identity_poolsi ; 1))33H= ge%67EN=OQ  K  sA B 2BB rcft|trtj|n|}||f}d}t j d|||j vrt j d|d|j |}t j d|t|tr|\}}n|}|jxs t|dd}t j d|n]t j d|d  |j|| \}}|td j|||f|j |<t j d ||7|5t|tr%|}||f} | |j vr||f|j | <| td|j r; t j d||j#|||f|j |<|j&t|j&ts$tdj|j&| td|j&|fS#t$r(} t jd t| | d} ~ wwxYw#t$r0} dt| vr|s|j%|||| cYd} ~ S| d} ~ wwxYw)a Get access token and project id 1. Check if credentials are already in self._credentials_project_mapping 2. If not, load credentials and add to self._credentials_project_mapping 3. Check if loaded credentials have expired 4. If expired, refresh credentials 5. Return access token and project id Args: credentials: The credentials to use for authentication project_id: The Google Cloud project ID _retry_reauth: Internal flag to prevent infinite recursion during reauthentication Returns: Tuple of (access_token, project_id) Nz,Checking cached credentials for project_id: z)Cached credentials found for project_id: .zcached_entry: %sr!z+Using cached credentials for project_id: %sz/Credential cache key not found for project_id: z, loading new credentialsrznFailed to load vertex credentials. Check to see if credentials containing partial/invalid information. Error: zZCould not resolve credentials - either dynamically or from environment, for project_id: {}z'Validating credentials for project_id: z"Credentials are None after loadingz0Credentials expired, refreshing for project_id: zReauthentication is needed)r5r!rrzFCould not resolve credentials token. Got None or non-string token - {}rB)rCrPrJdumpsr rEr tuplerXrZrarN exceptionrDrQrOexpiredr\rtoken) r#r5r!rcache_credentialsrr cached_entrycredential_project_ideresolved_cache_keys r%rzVertexBase.get_access_token s;4(2+t'DDJJ{ #+ !2:>:> ::, G  4#D#D D  ;JGO $  $ NN= )r&litellm_paramsc|jddxs1|jddxstjxs tdS)Nrvertex_ai_projectVERTEXAI_PROJECT)popr,rr rs r%get_vertex_ai_projectz VertexBase.get_vertex_ai_projectsN   / 6 2!!"5t< 2%% 201  r&ch|jddxs|jddxs tdS)Nrvertex_ai_credentialsVERTEXAI_CREDENTIALS)rr rs r%get_vertex_ai_credentialsz$VertexBase.get_vertex_ai_credentialss>   3T : 6!!"94@ 645 r&c|jddxs>|jddxs*tjxstdxs tdS)Nrvertex_ai_locationVERTEXAI_LOCATIONVERTEX_LOCATION)rr,rr rs r%get_vertex_ai_locationz!VertexBase.get_vertex_ai_locations^   0$ 7 1!!"6= 1&& 112 1/0  r&c|jdxs0|jdxstjxs tdS)a Safely get Vertex AI project without mutating the litellm_params dict. Unlike get_vertex_ai_project(), this does NOT pop values from the dict, making it safe to call multiple times with the same litellm_params. Args: litellm_params: Dictionary containing Vertex AI parameters Returns: Vertex AI project ID or None rrr)r/r,rr rs r%safe_get_vertex_ai_projectz%VertexBase.safe_get_vertex_ai_projectsJ   / 0 2!!"56 2%% 201  r&cd|jdxs|jdxs tdS)a Safely get Vertex AI credentials without mutating the litellm_params dict. Unlike get_vertex_ai_credentials(), this does NOT pop values from the dict, making it safe to call multiple times with the same litellm_params. Args: litellm_params: Dictionary containing Vertex AI parameters Returns: Vertex AI credentials or None rrr)r/r rs r%safe_get_vertex_ai_credentialsz)VertexBase.safe_get_vertex_ai_credentialss:   3 4 6!!"9: 645 r&c|jdxs=|jdxs*tjxstdxs tdS)a Safely get Vertex AI location without mutating the litellm_params dict. Unlike get_vertex_ai_location(), this does NOT pop values from the dict, making it safe to call multiple times with the same litellm_params. Args: litellm_params: Dictionary containing Vertex AI parameters Returns: Vertex AI location/region or None rrrr)r/r,rr rs r%safe_get_vertex_ai_locationz&VertexBase.safe_get_vertex_ai_locationsZ   0 1 1!!"67 1&& 112 1/0  r&)rNr)NNNNF)FchatF)F)+__name__ __module__ __qualname__rrrDr4r rrrarVrUrWrYr[rr staticmethodrboolrrr\rrrPrrrrrNrrrrrrrrrr __classcell__)r$s@r%rr%s^ >.x}.S.S.:d!#$<=d!KSTW=d! sCxd!N    2S    8@   #' MMM'M M  M 3- M MM<*!#*"#*! *  * ' *** *X'''67SM% 3  sCx&$$ $(,)-AE(-H 3-H !H ! H  H  H c]H H }H ! H "#H %W_%=>H "&H  x}c! "H j7<%+(-> > c]> ! > ! > "# > %%=>> > %%LM> 3-> &.d^> #> "&>  x}c! "> @/67/SM/$ /  / sCx /j$ G.67G.SMG. G. sCx G.R67SM% 3  sCx, #C= 9A$    d x}   $ 8C=   t     4 HSM  ( t    & D Xc]  r&r)!__doc__rJrFtypingrrrrrrr,litellm._loggingr #litellm.litellm_core_utils.asyncifyr &litellm.llms.custom_httpx.http_handlerr litellm.secret_managers.mainr litellm.types.llms.vertex_air r common_utilsrrrrrrggoogle.auth.credentialsrGoogleCredentialsObjectrr~r&r%rsX  EE+8C7X- N!    r&