i8jdZddlZddlZddlmZmZmZmZmZddl m Z Gdde Z GddZ y) a Databricks integration utilities for LiteLLM. This module provides authentication, telemetry, and security utilities for the Databricks LLM provider integration. Authentication priority: 1. OAuth M2M (DATABRICKS_CLIENT_ID + DATABRICKS_CLIENT_SECRET) - Recommended for production 2. PAT (DATABRICKS_API_KEY) - Supported for development 3. Databricks SDK automatic auth - Fallback (uses unified auth) N)AnyDictLiteralOptionalTuple)BaseLLMExceptionc eZdZy)DatabricksExceptionN)__name__ __module__ __qualname__u/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/databricks/common_utils.pyr r srr ceZdZdZej dej dfej dej dfej dej dfej dej dfej dej dfej d ej dfgZed e d e fd Z ed e e e fd e e e ffdZ eddee d e fdZdee d e fdZde de de d e fdZdee dee d eed ee effdZ ddee dee deddeed eedee d ee effdZy)DatabricksBasezk Base class for Databricks integration with authentication, telemetry, and security utilities. z(Bearer\s+)[A-Za-z0-9\-_\.]+z \1[REDACTED]z(Authorization:\s*)[^\s,}]+z (api[_-]?key["\s:=]+)[^\s,}"\']+z&(client[_-]?secret["\s:=]+)[^\s,}"\']+z(dapi[a-zA-Z0-9]{32,})z[REDACTED_PAT]z%(access[_-]?token["\s:=]+)[^\s,}"\']+datareturnc |yt|tr*|}|jD]\}}|j||}|St|trZi}|j D]C\}}|j t fddDrd||<0|j|||<E|St|tr|Dcgc]}|j|c}S|Scc}w)a Redact sensitive information (tokens, secrets) from data before logging. Handles strings, dicts, and lists recursively. Keys containing sensitive terms (authorization, api_key, token, secret, password, credential) are fully redacted. Args: data: String, dict, or other data structure to redact Returns: Redacted version of the data safe for logging Nc3&K|]}|v ywNr).0 sensitive lower_keys r z7DatabricksBase.redact_sensitive_data..Ms" & *&s) authorizationapi_keyapikeytokensecretpassword credential [REDACTED]) isinstancestrSENSITIVE_PATTERNSsubdictitemsloweranyredact_sensitive_datalist) clsrresultpattern replacementredactedkeyvalueitemrs @rr,z$DatabricksBase.redact_sensitive_data1s < dC F(+(>(>$ [&9)?M dD !H"jjl UIIK  &  %1HSM$'$=$=e$DHSM!+"O dD !@DEC--d3E E Fs=Cheadersc|siSi}hd}|jD]<\}}|j|vr t|dkDr |ddd||<2d||<8|||<>|S)aR Create a copy of headers with sensitive values redacted for safe logging. Shows first 8 characters of sensitive values for debugging purposes, with the rest redacted. Args: headers: HTTP headers dictionary Returns: New dictionary with sensitive headers redacted >api-key x-api-keyx-databricks-tokenr Nz ...[REDACTED]r#)r)r*len)r.r6r2sensitive_headersr3r4s rredact_headers_for_loggingz)DatabricksBase.redact_headers_for_loggingcsxI "--/JCyy{//u:?',Rayk$?HSM$0HSM % *rNcustom_user_agentc$ ddlm}|rr|j}d|vr#|j ddj}n|}|r7|j ddj ddj r|d|Sd |S#t$rd}YwxYw) a' Build the User-Agent string for Databricks API calls. If a custom user agent is provided, the partner name (part before /) is extracted and prefixed to the litellm user agent with an underscore. The custom version is ignored; LiteLLM's version is always used. Args: custom_user_agent: Optional custom user agent string (e.g., "mycompany/1.0.0") Returns: User-Agent string in format: - Default: "litellm/{version}" - With custom: "{partner}_litellm/{version}" Examples: - None -> "litellm/1.79.1" - "mycompany/1.0.0" -> "mycompany_litellm/1.79.1" - "partner_product/2.0.0" -> "partner_product_litellm/1.79.1" - "acme" -> "acme_litellm/1.79.1" r)versionz0.0.0/_-z _litellm/zlitellm/)litellm._versionrB Exceptionstripsplitreplaceisalnum)r@rB partner_names r_build_user_agentz DatabricksBase._build_user_agents.  0  1 7 7 9 ''066s;A>DDF 0  ((b199#rBJJL&y ::'##) G sB BBapi_basec|) ddlm}|}|jjd}|S|S#t$rt ddwxYw)zx Get the Databricks API base URL. If not provided, attempts to get it from the Databricks SDK. r)WorkspaceClient/serving-endpointsz~Either set the DATABRICKS_API_BASE and DATABRICKS_API_KEY environment variables, or install the databricks-sdk Python library. status_codemessage)databricks.sdkrQconfighost ImportErrorr )selfrOrQdatabricks_clients r _get_api_basezDatabricksBase._get_api_basesh   :$3$5!/66;;<&>&C&C%DDV#WH&,,99;(A4@@W$ $ %H  s A"A--B endpoint_type)chat_completions embeddingscustom_endpointcFddlm}tjd}tjd} |tjd}|r<| r:|r8|j d|j ||| } |xsi}d| |d<d |d <n=|;|s9|d ur t d d |j d|j|||\}}|&|r t d d|j|||\}}|dj|d d}n$|"|jddj|i|d||d<|j||d<|j d|j||dk(r|d urdj|}||fS|dk(r|d urdj|}||fS)a! Validate and configure the Databricks environment. Authentication priority: 1. OAuth M2M (DATABRICKS_CLIENT_ID + DATABRICKS_CLIENT_SECRET) - Recommended 2. PAT (DATABRICKS_API_KEY) - Supported for development 3. Databricks SDK automatic auth - Fallback (uses unified auth) Args: api_key: Personal access token (PAT) api_base: Databricks workspace URL with /serving-endpoints endpoint_type: Type of endpoint (chat_completions or embeddings) custom_endpoint: Whether using a custom endpoint URL headers: Existing headers dict custom_user_agent: Optional custom user agent to prefix Returns: Tuple of (api_base, headers) with authentication configured r)verbose_loggerDATABRICKS_CLIENT_IDDATABRICKS_CLIENT_SECRETDATABRICKS_API_BASEz-Using OAuth M2M authentication for DatabrickszBearer AuthorizationrwrdTrSzMissing API Key - A call is being made to LLM Provider but no key is set either in the environment variables ({LLM_PROVIDER}_API_KEY) or via paramsrTz'Using Databricks SDK for authentication)rOrr6zMissing API Base - A call is being made to LLM Provider but no api base is set either in the environment variables ({LLM_PROVIDER}_API_KEY) or via paramsz Bearer {})rrdz User-AgentzDatabricks request headers: rz{}/chat/completionsrz {}/embeddings) litellm._loggingrosgetenvdebugrur r}formatupdaterNr?) r[rrOr~rr6r@rr^r_ris rdatabricks_validate_environmentz.DatabricksBase.databricks_validate_environment5s8 4II45  "<=   yy!67H 8  !P Q44Xy-XLmG)0'?GO $&8GN # _W$&) #r $$%NO$($D$D%w%E%!'  ) #x %)$D$D%w%E%!' ?!,!3!3G!< 2G "1C1CG1LMN  )0 ':GO $!% 6 67H I  *4+J+J7+S*T U  . .?$3N,33H=H  l *d/J&--h7H  rr)r r r __doc__recompile IGNORECASEr& classmethodrr,rr%r? staticmethodrrNr]rur(rr}rboolrrrrrrs0 3R]] C_U 2BMM BOT BJJ:BMM J  BJJ@"-- P   -r}} =?PQ BJJ? O  $////b!c3h!DcN!!F,$Xc],$c,$,$\hsm.8*8*8* 8* 8*t,},08 ,HPQU, sDy ,j,0^!#^!3-^!?@ ^! "$ ^! $ ^!$C=^! sDy ^!rr) rrrtypingrrrrr)litellm.llms.base_llm.chat.transformationrr rrrrrs4  66F * {!{!r