imFdZddlmZmZmZmZmZmZddlm Z m Z m Z ddl m Z ddlmZmZddlmZddlmZddlmZd d lmZGd d ZGd dZGdde Zy)z Arize Phoenix prompt manager that integrates with LiteLLM's prompt management system. Fetches prompt versions from Arize Phoenix and provides workspace-based access control. )AnyDictListOptionalTupleUnion) DictLoader Environmentselect_autoescape)CustomPromptManagement)PromptManagementBasePromptManagementClient)AllMessageValues) PromptSpec)StandardCallbackDynamicParams)ArizePhoenixClientc ReZdZdZ d dedeeeefdeeefdeefdZ dZ y) ArizePhoenixPromptTemplatezA Represents a prompt template loaded from Arize Phoenix. N template_idmessagesmetadatamodelcp||_||_||_|xs|jd|_|jd|_|jd|_|jd|_|jdi|_|jdd|_ |jdd |_ y) N model_namemodel_provider temperature max_tokensinvocation_parameters descriptiontemplate_formatMUSTACHE) rrrgetrrrrrr r")selfrrrrs /Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/integrations/arize/arize_phoenix_prompt_manager.py__init__z#ArizePhoenixPromptTemplate.__init__s'    8hll<8 &ll+;<#<< 6",,|4%-\\2I2%N"#<< r:'||,=zJc<d|jd|jdS)NzArizePhoenixPromptTemplate(id='z ', model='z'))rrr%s r&__repr__z#ArizePhoenixPromptTemplate.__repr__-s%-d.>.>-?z$**UW X r(N) __name__ __module__ __qualname____doc__strrrrrr'r+r(r&rrsZ $ KKtCH~&KsCx. K } K$ r(rceZdZdZ ddeedeedeefdZdeddfd Zd eee fdede fd Z dd ed eeee fde e fdZd edee fdZde efdZy)ArizePhoenixTemplateManageram Manager for loading and rendering prompt templates from Arize Phoenix. Supports: - Fetching prompt versions from Arize Phoenix API - Workspace-based access control through Arize Phoenix permissions - Mustache/Handlebars-style templating (using Jinja2) - Model configuration and invocation parameters - Multi-message chat templates Napi_keyapi_base prompt_idc 0||_||_||_i|_t |j|j|_t titddgdddddd |_ |jr|j|jyy) N)r5r6htmlxmlz{{z}}z{%z%}z{#z#})loader autoescapevariable_start_stringvariable_end_stringblock_start_stringblock_end_stringcomment_start_stringcomment_end_string) r5r6r7promptsr arize_clientr r r jinja_env_load_prompt_from_arize)r%r5r6r7s r&r'z$ArizePhoenixTemplateManager.__init__?s    ">@ .LL4== %b>(&%9"& $#!!%#   >>  ( ( 8 r(prompt_version_idreturnc |jj|}|r"|j||}||j|<yt d|d#t $r}t d|d|d}~wwxYw)z2Load a specific prompt version from Arize Phoenix.zPrompt version ' ' not foundzFailed to load prompt version 'z' from Arize Phoenix: N)rDget_prompt_version_parse_prompt_datarC ValueError Exception)r%rG prompt_datatemplatees r&rFz3ArizePhoenixTemplateManager._load_prompt_from_arize]s ++>>?PQK22;@QR2: ./ #34E3Fk!RSS 12C1DDZ[\Z]^  s>AA A/A**A/datac |jdi}|jdg}|jdi}i}d|vr|d}n6d|vr|d}n,|jD]\}}t|ts|}n|jd|jd|jdd |jd |jd d ||jd |jdd} t ||| S)zBParse Arize Phoenix prompt data and extract messages and metadata.rPrropenai anthropicrrr r! template_typer"r#rr)rrr rVr"rrr)rrr)r$items isinstancedictr) r%rRrG template_datarinvocation_paramsprovider_paramskeyvaluers r&rLz.ArizePhoenixTemplateManager._parse_prompt_datamsR0  $$Z4!HH% ..$D ###r(prompt_variablescp|jj|}|std|d|jj||xsi}|j|j |j d}|j}i}d|vr|d}n d|vr|d}|jD]\}} ||vs | ||<||fS)a Get a prompt template and render it with variables. Args: prompt_id: The ID of the prompt version prompt_variables: Variables to substitute in the template Returns: Tuple of (rendered_messages, metadata) zPrompt template 'rJ)rrrrTrU) rrurMrsrrrrrW) r%r7rrPrkrr[r\r]r^s r&get_prompt_templatez-ArizePhoenixPromptManager.get_prompt_templates&&33I>0 ;GH H!//?? '-2  ^^#//"-- %:: ( (/9O - -/ 1 1 ,     1 1 7 7?sC ^+ + ,s$AA4& A44 B7=/B2,B72B7c6|jjS)z!Get list of available prompt IDs.)rryr*s r&get_available_promptsz/ArizePhoenixPromptManager.get_available_promptsbs""1133r(cD|jrd|_|jyy)z"Reload prompts from Arize Phoenix.N)r7rrr*s r&reload_promptsz(ArizePhoenixPromptManager.reload_promptsfs >>#'D    r( prompt_specdynamic_callback_paramscy)z Determine if prompt management should run based on the prompt_id. For Arize Phoenix, we always return True and handle the prompt loading in the _compile_prompt_helper method. Tr2)r%r7rrs r&should_run_prompt_managementz6ArizePhoenixPromptManager.should_run_prompt_managementlsr( prompt_labelprompt_versionc`| td ||jjvr|jj||j ||\}}|j d} i} dD]} | |vs|| | | <t ||| | dS#t$r} td|d| d} ~ wwxYw)aM Compile an Arize Phoenix prompt template into a PromptManagementClient structure. This method: 1. Loads the prompt version from Arize Phoenix 2. Renders it with the provided variables 3. Returns formatted chat messages 4. Extracts model and optional parameters from metadata N6prompt_id is required for Arize Phoenix prompt managerrr)r7prompt_templateprompt_template_modelprompt_template_optional_paramscompleted_messageszError compiling prompt 'z': )rMrrCrFrr$rrN) r%r7rrrrrrkrtemplate_modeloptional_paramsrrQs r&_compile_prompt_helperz0ArizePhoenixPromptManager._compile_prompt_helperzs$  UV V" K 3 3 ; ;;##;;IF261I1I+2 .  -009N!OO+->       ##%)(C2W  r(rzr,)NNNN)rHN)NN)NNNFF) r-r.r/r0rr1r'propertyrr4rrrrrrrrrrrrrboolrrYintrrrr __classcell__)rs@r&r|r|s_2"&"&#' K# K3- KC= K#$ ;$$6:-+-+#4S>2-+ t$%tCH~5 6 -+f?C37#'599,#9,'(9, d38nc&9 :; 9, !c3h0 9, C= 9,#4S>29, t$%xS#X'?? @9,v4tCy4 C= j) "?   ('+(,6KC=6Kj)6K#4. 6K "? 6K sm 6K! 6K 6Kz-1&*(, C= #4. "?  j)  sm  !    @-1&*(,6;@E  '( !  C=  #4.  "? j) sm !  &.d^ 08~  sD)*D0 1 r(r|N)r0typingrrrrrrjinja2r r r -litellm.integrations.custom_prompt_managementr +litellm.integrations.prompt_management_baser rlitellm.types.llms.openair"litellm.types.prompts.init_promptsrlitellm.types.utilsrarize_phoenix_clientrrr4r|r2r(r&rsT ;:==P79=4  :M)M)`e 6e r(