i2dZddlmZmZmZmZmZmZmZm Z m Z m Z m Z ddl Z ddlmZddlmZddlmZddlZddlmZddlmZdd lmZdd lmZmZmZm Z dd l!m"Z"m#Z#d d l$m%Z%Gdde%Z&GddeZ'y)zQ Translate from OpenAI's `/v1/chat/completions` to Groq's `/v1/chat/completions` ) Any CoroutineListLiteralOptionalTupleUnioncastoverloadIterator AsyncIteratorN)$OpenAIChatCompletionStreamingHandler) OpenAIError) BaseModel)verbose_logger)Loggingget_secret_str)AllMessageValuesChatCompletionAssistantMessageChatCompletionToolParam$ChatCompletionToolParamFunctionChunk) ModelResponseModelResponseStream)OpenAILikeChatConfigc>eZdZUdZeeed<dZeee e fed<dZ ee ed<dZ ee ed<dZeeed<dZeeed<dZeeed<dZeee e fed <dZeeed <dZeeed <dZee ed <dZee ed <dZeee e fed< d5deedeee e fdee dee deedeedeed eee e fd eed eed ee d ee deee e fddfdZedee fdZefdZ d6deee ee efdedeede fdZ!de de ffd Z"e#de$e%de de&dde'e e e$e%ffdZ(e# d6de$e%de de&dde$e%fdZ( d6de$e%de dedee$e%e'e e e$e%ffffd Z(d ee d!ee de)ee ee ffd"Z*d#e defd$Z+d%e fd&Z, d7d'e d#e de d(ed)ede f fd* Z- d8de d+e.j^d,ed-e0d.e de$e%d#e d/e d0e d!ee deedeffd1 Z1d2ee de&d3fd4Z2xZ3S)9GroqChatConfigNfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_presponse_formattools tool_choicereturnctj}|jD]%\}}|dk7s |t|j||'y)Nself)localscopyitemssetattr __class__)r.rr r!r"r#r$r%r&r'r(r)r*r+locals_keyvalues v/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/groq/chat/transformation.py__init__zGroqChatConfig.__init__9sA (--/!--/JCf}!2U3*cy)Ngroq)r.s r7custom_llm_providerz"GroqChatConfig.custom_llm_providerNsr9c t|SN)super get_config)clsr3s r7rAzGroqChatConfig.get_configRsw!##r9Fstreaming_response sync_stream json_modect|||S)N)rCrDrE)"GroqChatCompletionStreamingHandler)r.rCrDrEs r7get_model_response_iteratorz*GroqChatConfig.get_model_response_iteratorVs 21#  r9modelc,t||} |jd t j ||j r|jd|S#t$rY@wxYw#t$r#}tjd|Yd}~|Sd}~wwxYw)N max_retriesrIr=reasoning_effortz,Error checking if model supports reasoning: ) r@get_supported_openai_paramsremove ValueErrorlitellmsupports_reasoningr=append Exceptionrdebug)r.rI base_paramser3s r7rNz*GroqChatConfig.get_supported_openai_paramsbsg9%@     } - U))1I1I""#56    U  #OPQs!S T T Us(A2A' A$#A$' B0BBmessagesis_asyncTcyr?r<r.rXrIrYs r7_transform_messagesz"GroqChatConfig._transform_messagesss r9cyr?r<r[s r7r\z"GroqChatConfig._transform_messagesys r9cNt|D]q\}} t|tr|j}n|}|j ddk(}|sAt d}|j D] \} } |  | || <|||<s|rt |!||dSt |!||dS)Nrole assistant)r_T)rXrIrYF) enumerate isinstancer model_dumpgetrr1r@r\) r.rXrIrYidxmessage_messageassistant_message new_messagekvr3s r7r\z"GroqChatConfig._transform_messagess&h/LC '9-"--/" ( V 4 C  <+N $NN,DAq})* A-!, 0 7.!/ 7.!/ r9api_baseapi_keycN|xstdxsd}|xs td}||fS)N GROQ_API_BASEzhttps://api.groq.com/openai/v1 GROQ_API_KEYr)r.rlrmdynamic_api_keys r7$_get_openai_compatible_provider_infoz3GroqChatConfig._get_openai_compatible_provider_infos=  0o. 0/  "C^N%C((r9optional_paramsc(|jdyy)zH Groq doesn't support 'response_format' while streaming r)TF)rd)r.rss r7_should_fake_streamz"GroqChatConfig._should_fake_streams   0 1 =r9 json_schemac2tdtd|S)a3 Handles creating a tool call for getting responses in JSON format. Args: json_schema (Optional[dict]): The JSON schema the response should be in Returns: AnthropicMessagesTool: The tool call to send to Anthropic API to get responses in JSON format functionjson_tool_call)name parameterstyperx)rr)r.rvs r7*_create_json_tool_call_for_response_formatz9GroqChatConfig._create_json_tool_call_for_response_formats"'9%&  r9non_default_params drop_params-replace_max_completion_tokens_with_max_tokensc|jd}|j|rd|d<|t|trd}d|vr|d}n d|vr|dd} |rt j |ds[d |vrt j d |d |d d ddid}|j|} | g|d <||d<d|d<|jddt |)||||}|S)Nr)T fake_streamresponse_schemarvschemar;rLr*z Groq model 'as' does not support native structured outputs. LiteLLM uses a tool-calling workaround for structured outputs on this model, which is incompatible with user-provided tools. Either use a model that supports native structured outputs (e.g., gpt-oss-120b, llama-4, kimi-k2), or remove the tools parameter. See: https://console.groq.com/docs/structured-outputs#supported-models)rfrI llm_providerrxrzryr|)rvr+rE) rdrurbdictrQsupports_response_schemaBadRequestErrorr~popr@map_openai_params) r.rrsrIrr_response_formatrv _tool_choice_toolr3s r7rz GroqChatConfig.map_openai_paramssQ.112CD  # #$6 7-1OM *  'J7G,N*.K $44./@A "22.}=hG  &77V "44%55&25':e%e #()/  !+%+-=$>$L!KK$/LE16wOG,5AOM237OK0&**)4 '3   r9 raw_responsemodel_response logging_obj request_datalitellm_paramsencodingc t |||||||||| | |  }|jt|d} t |d| |S)N) rIrrrrrXrsrrrmrE service_tier)original_service_tier)r@transform_response_map_groq_service_tiergetattrr2)r.rIrrrrrXrsrrrmrEmapped_service_tierr3s r7rz!GroqChatConfig.transform_response ss3%)#%+)4    ' '").."I (   0CDr9rautodefaultflexc8|y|dvryttd|S)z@ Ensure groq service tier is OpenAI compatible. rr)r r)r.rs r7rz%GroqChatConfig._map_groq_service_tier0s- ! ( (C CG568MNNr9) NNNNNNNNNNNNN)F)FF)NN)4__name__ __module__ __qualname__rrint__annotations__r r strrr!listr"r#r$r%r&r'r(r)r*r+r8propertyr= classmethodrAr r rboolrrHrNr rrrrr\rrrrur~rhttpxResponseLiteLLMLoggingObjrr __classcell__r3s@r7rr*s'+x}+04M8E#t),-4 $Ix~$!%J% $J $Ax}&*hsm*'+D(5d# $+!%K#%E8C=&*OXd^* E8D> .2K%T *+2,048$(%)$(*.+/%)#*. $264#C=4 c4i 014D> 4 TN 4 SM 4 C=4#3-4uS$Y'(4c]4}4"$4~4eCI./4 4*Xc]$$%*  !(3-s1C]"RS    D>   " -. 7: FMdm 3T"233 4   $)  '(  %.      NS-.7:FJ t$%yc4@P;Q1Q'RR S8 )   )08  ) x}hsm+ , )4D  4">C B BB B  B 8< B B^"&$(""nn"& " ' "  "'(""""#"D>" "H O%-c] O * + Or9rc(eZdZdedeffd ZxZS)rGchunkr,c(|jd}|r,t|jd|jd||jdg}|D]-}|jdi}d|vs|jd|d</t||S) Nerrorcoderf) status_coderfbodychoicesdelta reasoningreasoning_content)rdrrr@ chunk_parser)r.rrrchoicerr3s r7rz/GroqChatCompletionStreamingHandler.chunk_parser?s '" !IIf-uyy7KRW  ))Ir*FJJw+Ee#-2YY{-C)* w#E**r9)rrrrrrrrs@r7rGrG>s+$++>++r9rG)(__doc__typingrrrrrrr r r r r r+litellm.llms.openai.chat.gpt_transformationr litellm.llms.openai.common_utilsrpydanticrrQlitellm._loggingr*litellm.litellm_core_utils.litellm_loggingrrlitellm.secret_managers.mainrlitellm.types.llms.openairrrrlitellm.types.utilsrropenai_like.chat.transformationrrrGr<r9r7rsn     9+S7 CCQO)QOh+)M+r9