i= dZddlZddlZddlZddlZddlZddlmZmZm Z m Z m Z ddl Z ddl mZddlmZddlmZddlmZddlmZmZdd lmZe d Ze d Zd efd Zded efdZded e efdZ ded efdZ!GddeZ"y)z Callback to log events to a Generic API Endpoint - Creates a StandardLoggingPayload - Adds to batch queue - Flushes based on CustomBatchLogger settings N)DictListLiteralOptionalUnion)verbose_logger)uuid)CustomBatchLogger safe_dumps)get_async_httpx_clienthttpxSpecialProvider)StandardLoggingPayload)llm_api_successllm_api_failure json_arrayndjsonsinglereturncf tjjtjjtd}t |d5}t j|cdddS#1swYyxYw#t$r-}tjdt|icYd}~Sd}~wwxYw)z Load the generic_api_compatible_callbacks.json file Returns: Dict: Dictionary of compatible callbacks configuration z%generic_api_compatible_callbacks.jsonrNz5Error loading generic_api_compatible_callbacks.json: ) ospathjoindirname__file__openjsonload Exceptionrwarningstr) json_pathfes /Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/integrations/generic_api/generic_api_callback.pyload_compatible_callbacksr(s GGLL GGOOH %'N )S !Q99Q<" ! ! CCF8 L  s<A A:A.$ A:.A73A:7A:: B0"B+%B0+B0 callback_namect}||vS)z Check if a callback_name exists in the compatible callbacks list Args: callback_name: Name of the callback to check Returns: bool: True if callback_name exists in the compatible callbacks, False otherwise )r(r)compatible_callbackss r'is_callback_compatibler-3s56 0 00c8t}|j|S)z Get the configuration for a specific callback Args: callback_name: Name of the callback to get config for Returns: Optional[Dict]: Configuration dict for the callback, or None if not found )r(getr+s r'get_callback_configr1As56  # #M 22r.valuec:d}d}tj|||S)a  Replace {{environment_variables.VAR_NAME}} patterns with actual environment variable values Args: value: String that may contain {{environment_variables.VAR_NAME}} patterns Returns: str: String with environment variables substituted z(\{\{environment_variables\.([A-Z_]+)\}\}cP|jd}tj|dS)N)grouprgetenv)match env_var_names r'replace_env_varz1substitute_env_variables..replace_env_var[s {{1~ yyr**r.)resub)r2patternr;s r'substitute_env_variablesr?Os#:G+ 66'?E 22r.c eZdZ d deedeedeeedeedeef fd Z ddeefdZ dZ d Z d Z d efd ZxZS)GenericAPILoggerendpointheaders event_typesr) log_formatc |rt|rtjd|t|}|r||d|vrt |d}d|vr4|xsi}|dj D]\}} ||vs t | ||<| d|vr|d}|#d|vr|d}ntj d|dttj |_ |xstjd }| td |j||_||_||_||_||d vrtd |d|xsd|_tjd|j$d|j d|jd|j"d|j& t)j*|_t/ |`di|d|j,it)j2|j5g|_y)a Initialize the GenericAPILogger Args: endpoint: Optional[str] = None, headers: Optional[dict] = None, event_types: Optional[List[API_EVENT_TYPES]] = None, callback_name: Optional[str] = None - If provided, loads config from generic_api_compatible_callbacks.json log_format: Optional[LOG_FORMAT_TYPES] = None - Format for log output: "json_array" (default), "ndjson", or "single" z$Loading configuration for callback: NrBrCrDrEzcallback_name 'z4' not found in generic_api_compatible_callbacks.json) llm_providerGENERIC_LOGGER_ENDPOINTzaendpoint not set for GenericAPILogger, GENERIC_LOGGER_ENDPOINT not found in environment variablesrzInvalid log_format: z2. Must be one of: 'json_array', 'ndjson', 'single'rz)in init GenericAPILogger, callback_name: z , endpoint z , headers z, event_types: z, log_format: flush_lock)r-rdebugr1r?itemsr"r rLoggingCallbackasync_httpx_clientrr8 ValueError _get_headersrCrBrDr)rEasyncioLockrIsuper__init__ create_taskperiodic_flush log_queue) selfrBrCrDr)rEkwargscallback_configkeyr2 __class__s r'rTzGenericAPILogger.__init__cs\, %m4$$:=/J#6m"D#'J/,I#;OJ6>doo>D//12DFr.cddi}tjd}|rU |jd}|D]=}d|vs|jdd\}}|j||j<? tjr|jtj|r|j||S#t$r+}t j dt|Yd}~sd}~wwxYw) z Get headers for the Generic API Logger Returns: Dict: Headers for the Generic API Logger Args: headers: Optional[dict] = None z Content-Typezapplication/jsonGENERIC_LOGGER_HEADERS,=r5z2Error parsing headers from environment variables: N) rr8splitstripr!rr"r#litellmgeneric_logger_headersupdate) rXrC headers_dict env_headers header_itemsitemr[r2r&s r'rPzGenericAPILogger._get_headerss . ii 89  *005 (Dd{%)ZZQ%7 U49KKM SYY[1)  ) )    > > ?     ( &&HQQ sB58B55 C)>!C$$C)cbK|jd|jvry tjd||jdd}tj dur1|j ||||}|jj|n|jj|t|j|jk\r|jd{yy7#t$r@}tjdt|dtj Yd}~yd}~wwxYww) a! Async Log success events to Generic API Endpoint - Creates a StandardLoggingPayload - Adds to batch queue - Flushes based on CustomBatchLogger settings Raises: Raises a NON Blocking verbose_logger.exception if an error occurs Nr9Generic API Logger - Enters logging function for model %sstandard_logging_objectTrY response_obj start_timeend_timeGeneric API Logger Error -  rDrrKr0rcgeneric_api_use_v1_get_v1_logging_payloadrWappendlen batch_sizeasync_send_batchr! exceptionr# traceback format_excrXrYrnrorpstandard_logging_payloadpayloadr&s r'async_log_success_eventz(GenericAPILogger.async_log_success_events    ',=TEUEU,U    KV (.zz2KT'R $))T166!!-)% 7 %%g.%%&>?4>>"doo5++---6-   $ $-c!fXR 8L8L8N7OP    AD/B;C#C!C#D/!C## D,,6D'"D/'D,,D/cbK|jd|jvry tjd||jdd}tj dur1|j ||||}|jj|n|jj|t|j|jk\r|jd{yy7#t$r@}tjdt|dtj Yd}~yd}~wwxYww) z Async Log failure events to Generic API Endpoint - Creates a StandardLoggingPayload - Adds to batch queue NrrkrlTrmrqrrrsr}s r'async_log_failure_eventz(GenericAPILogger.async_log_failure_events    ',=TEUEU,U    KV (.zz2KT'R $))T166!!-)% 7 %%g.%%&>?4>>"doo5++---6-   $ $-c!fXR 8L8L8N7OP   rcK |js |jjytjdt |jd|j d|j dk(rg}|jD]N}|j j|j|jt|}|j|Ptj|ddid{}t|D]V\}}t|t rtj"d |d |2tjd |d |j$Xn|j d k(rt|j}nJ|j dk(r#dj'd|jD}nt)d|j |j j|j|j|d{}tjd|jd |j$d|j |jjy7j7^#t $r@} tj"dt+| dt-j.Yd} ~ dd} ~ wwxYw#|jjwxYww)a$ Sends the batch of messages to Generic API Endpoint Supports three formats: - json_array: Sends all logs as a JSON array (default) - ndjson: Sends logs as newline-delimited JSON - single: Sends each log as individual HTTP request in parallel Nz$Generic API Logger - about to flush z events in 'z' formatr)urlrCdatareturn_exceptionsTz'Generic API Logger - Error sending log z: zGeneric API Logger - sent log z , status: rrrrc32K|]}t|ywNr ).0logs r' z4GenericAPILogger.async_send_batch..bs$OZ_szUnknown log_format: z#Generic API Logger - sent batch to z , format: z)Generic API Logger Error sending batch - )rWclearrrKrwrErNpostrBrCr rvrQgather enumerate isinstancer!rz status_coderrOr#r{r|) rXtasks log_entrytask responsesidxresultrresponser&s r'ryz!GenericAPILogger.async_send_batch3sw; #>>r NN "o  6s4>>7J6K" $$9$--I'334Jt>OQ NN "OQ.   $ $;CF82iFZFZF\E]^    NN "skK IKB?I+I,D I9I:AI:KII J##6JJ&J##J&&KKrchtjd||jdi}|jdixsi}|jd}|jdd}|jdi} |jdd } |jd d } |d } |jd tt j } | | | |||jdd|jdd| ||| ||d }|j D]\}} t|||<|S#t$rY$wxYw)z Maintained for backwards compatibility with old logging payload Returns a dict of the payload to send to the Generic API Endpoint z=GenericAPILogger Logging - Enters logging function for model litellm_paramsmetadatamessages response_costgoptional_params call_typezlitellm.completion cache_hitFusageidmodelr6user) rrr startTimeendTimerrmodelParametersrrrrcost)rrKr0r#r uuid4rLr!)rXrYrnrorprrrrrrrrrrr[r2s r'ruz(GenericAPILogger._get_v1_logging_payloadysK KF8 T  $4b9   z2 . 4" ::j)zz/3/ **%6;JJ{,@A JJ{E2 W%   dC $5 6""#ZZ,JJvr*. $  ""--/JC "5z *   sD%% D10D1)NNNNNr)__name__ __module__ __qualname__rr#dictrAPI_EVENT_TYPESLOG_FORMAT_TYPESrTrPrrryru __classcell__)r\s@r'rArAbs#'"&7;'+15 XG3-XG$XGd?34 XG  } XG -. XGt&HTN&P)V!FD#L3 3r.rA)#__doc__rQrrr<r{typingrrrrrrclitellm._loggingr litellm._uuidr (litellm.integrations.custom_batch_loggerr *litellm.litellm_core_utils.safe_json_dumpsr &litellm.llms.custom_httpx.http_handlerr rlitellm.types.utilsrrrr(r#boolr-r1r?rArJr.r'rs 77+FA7>?;<4( 1# 1$ 1 3s 3x~ 33C3C3&J(Jr.