izdZddlmZmZmZmZddlmZddlm Z m Z ddl m Z ddl mZerddlmZGd d eZy ) zQ Translate from OpenAI's `/v1/chat/completions` to VLLM's `/v1/chat/completions` ) TYPE_CHECKINGListOptionalTuple)OPENAI_CHAT_COMPLETION_PARAMS)get_secret_boolget_secret_str)LiteLLM_Params)OpenAIGPTConfig)AllMessageValuesceZdZdedeffd Zdededededef dZde ed e ede e ee effd Z dd e ede edeeffd Z e dd e ede efd Ze dd e efdZe ddede ed e ede eee ee effdZdededded ededef dZdededded ededef dZxZS)LiteLLMProxyChatConfigmodelreturncPt||}|jt|SN)superget_supported_openai_paramsextendr)selfr params_list __class__s /Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/litellm_proxy/chat/transformation.pyrz2LiteLLMProxyChatConfig.get_supported_openai_paramss'g9%@ 89non_default_paramsoptional_params drop_paramsc|j|}|jD]*\}}|dk(r||jdid<!||vs&|||<,|S)Nthinking extra_body)ritems setdefault)rrrrrsupported_openai_paramsparamvalues r_map_openai_paramsz)LiteLLMProxyChatConfig._map_openai_paramssf#'"B"B5"I.446LE5 "KP**<>$F  $ $ ,rcddl}d}|jdr|jddd}|jj ||\}}||||fS)a Force use litellm proxy for all models Issue: https://github.com/BerriAI/litellm/issues/10559 Expected behavior: - custom_llm_provider will be 'litellm_proxy' - api_base = api_base OR LITELLM_PROXY_API_BASE - api_key = api_key OR LITELLM_PROXY_API_KEY Use case: - When using Google ADK, users want a flag to dynamically enable sending the request to litellm proxy or not - Allow the model name to be passed in original format and still use litellm proxy: "gemini/gemini-1.5-pro", "openai/gpt-4", "mistral/llama-2-70b-chat" etc. Return model, custom_llm_provider, dynamic_api_key, api_base rN litellm_proxyr1/)r(r))r: startswithsplitrr/)rr(r)r:custom_llm_providers r*litellm_proxy_get_custom_llm_provider_infozALiteLLMProxyChatConfig.litellm_proxy_get_custom_llm_provider_infoTsr* -   , -KKQ'*E  * * , Q Qw R    )7H<} >7?} > c >BXc]BhsmBB37 0.MQ!=!=&sm!==Ec]!= sC# 5 6!=!=F    )*               )*           rrN)__doc__typingrrrrlitellm.constantsrlitellm.secret_managers.mainrr litellm.types.routerr openai.chat.gpt_transformationr litellm.types.llms.openair rrIrrr]s287;H/=:C _C r