֓jUdZddlmZddlZddlZddlZddlmZddlm Z m Z m Z m Z m Z mZejeZdZded<d Zd ed <d Zd ed <dZded<dZded<eej3j4j4j4j4j4dz dz dz ez Zded<ehdZded<GddeZdd d1dZ d2dZ!d3d Z" d4d!Z# d5d"Z$ d6d#Z%d$Z&d%ed&<d7d'Z'ehd(Z(ded)<ehd*Z)ded+< d8d,Z* d9d-Z+ d:d.Z,deeed/ d;d0Z-y)intMAX_COMPLETION_TOKENS_DEFAULTTIMEOUT_SECONDS_DEFAULTshot_aware_bg_render_plan_v2RESPONSE_SCHEMA_NAMEz3.202607231435PROMPT_VERSIONprompts_baseshot_aware_bg_render_planr_PROMPT_PACK_DIR>notallOfanyOfoneOfformatmaximumminimumpatterncontainsmaxItemsminItems maxLength minLength multipleOf maxContains minContains uniqueItemsexclusiveMaximumexclusiveMinimumpatternPropertiesFrozenSet[str]_OPENAI_UNSUPPORTED_SCHEMA_KEYSc eZdZUdZdZded<y)"ShotAwareBgRenderPlanProviderErrorutFail-closed signal for the W20B planner provider path. W20F10 (Codex 조건 5): retry 경로에서 실제 completion 호출이 2회였던 실패는 ``completion_call_count`` 속성으로 실비용을 보존한다 — caller (build_render_plan_for_fp 실패 감사)가 real_api_call_counts.llm 에 반영. 미설정=1 (기존 단일 호출 semantics). r completion_call_countN)__name__ __module__ __qualname____doc__r1__annotations__q/Users/manta/Documents/Projects/TheRoad-I1/backend/app/modules/pipeline/shot_aware_bg_render_plan_llm_provider.pyr/r/_s"#3"r8r/r0completion_callsc*t|}||_|SN)r/r1)msgr;errs r9_provider_errorr@ks -S 1C 0C Jr8ct|tri}|jD]\}}|tvrt |||<|j ddk(r>t|j dtrt |dj|d<|St|t r|Dcgc] }t |c}S|Scc}w)aBDeep-copy + recursive strip of OpenAI strict-mode unsupported keys. Returns a fresh tree; the input is not mutated. Additionally enforces the OpenAI Structured Outputs strict-mode contract that **every object property must be listed in ``required``**. The original prompt-pack schema marks some fields optional (e.g. ``selected_refs.items.space_description``, ``camera_decision.framing_notes``) so local jsonschema validation can accept LLM responses that omit them. The request-side sanitized copy must close that gap so strict mode does not reject the ``response_format`` before the model is even invoked. The fill keeps the original ``properties`` insertion order (Python dict ordering is the language guarantee since 3.7) so the request payload is deterministic across runs. typeobject propertiesrequired) isinstancedictitemsr-"_sanitize_schema_for_openai_strictgetlistkeys)schemaoutkeyvalueitems r9rIrIxs$&$  ,,.JC559%@CH) 776?h &: GGL !4, #3|#4#9#9#;Substitute the user_template placeholders with structured JSON blocks. The substitutions carry no scenario-specific tokens — every block is a verbatim ``json.dumps(..., sort_keys=True)`` of upstream data. W20F8: ``camera_candidates_block`` 별도 섹션에 per-unit camera/look_at candidate set 만 verbatim 추출. LLM 이 exact-copy 위반으로 coordinate 를 invent 하지 않도록 prompt 안에서 후보 set 을 두 번 노출 (geometry_block 안 + 별도 W20F8 섹션). **이 중복은 의도된 것이라 prompt-diet 대상이 아니다.** 2026-08-03 prompt-diet 2단계: ``per_bg_render_facts_by_bg_id`` 는 바로 아래 ``per_bg_facts_block`` 으로 따로 실리는데 ``dossier_block`` 안에도 그대로 들어 있어 같은 JSON 이 한 콜에 두 번 나갔다. 템플릿의 두 섹션(``## Base location dossier`` / ``## Per-BG render facts``)이 이미 분리돼 있고 dossier 섹션이 facts 포함을 말하지 않으므로, dossier 사본에서만 그 키를 빼도 전달 내용의 손실이 없다. per_bg_render_facts_by_bg_idper_bgcamera_cell_candidates_per_unit look_at_cell_candidates_per_unitrorpT sort_keys)fp_idreadback_status dossier_blockgeometry_blockcamera_candidates_blockper_bg_facts_blockshot_staging_blockcandidate_catalog_block)rJrFrGrHrr_dumpsrK) rWrtrudossiergeometryshot_readinesscandidate_catalog per_bg_factskvdossier_for_blockper_bg_stagingcamera_candidatess r9_build_user_promptrsC8Mr&&'EFL"L gt $%]]_ ,TQ22 qD_ +2 %*//9?RN^ !B C Ir^ !C D J    'jj!2dCzz(d; $ +< M::ldC::nE $ " #t!    sEcd|dd|dgS)Nsystem)rolecontentuserr7rV user_prompts r9_build_messagesrsm4K0 r8cF|xsijdxsi}|xsijdxsi}tj||dd}tj|jdxsid}djd|xsgDxsd }d |d |d |d S)uuW20F9 — camera validator-fail targeted repair prompt. Codex 명시 (2026-05-28): retry 입력 = validator diagnostic + camera candidate block + 기존 graph/reference 보존, camera_decision 의 camera_cell/look_at_cell/lens/fov 만 후보 set 에서 verbatim copy 로 고쳐라. empty/parse/shape/graph/anchor/ref/dedup retry 금지 — 본 helper 는 caller 가 camera-only failure 분류한 후에만 호출된다. Output 은 schema 동일 (전체 graph 다시 emit) — LLM 이 camera_decision 만 바꿔서 동일 graph 를 다시 emit 한다. 2026-08-03 prompt-diet 1단계: 말미에 붙이던 ``## Original input bundle (for context)`` + 최초 user prompt 전문을 제거했다. 이 분기는 ``_is_camera_only_failure`` 가 camera 축을 뺀 11개 검증축 전부 통과를 요구하므로 graph/anchor/reference 는 이미 확정돼 있고, 고쳐야 할 카메라 좌표는 아래 candidate 배열 안에서만 고른다 — 원문 번들이 기여할 자리가 없다. 실측 절감 = 그 콜의 user 대부분 (최대 콜 기준 114k 중 원문 재첨부분). rorprqTrrgraph c3&K|] }d| ywz- Nr7.0ds r9 z3_build_camera_repair_user_prompt..CsH.FRs8.F- (none)u# W20F9 — camera validator repair Your previous response was structurally correct (DAG / anchor / references / graph completeness / rationale all passed), but the code-side validator rejected one or more `camera_decision.camera_cell` / `look_at_cell` entries because the coordinate is NOT a member of the supplied candidate set. ## Validator diagnostics (camera_in_candidates only) z< ## Camera coordinate candidates (verbatim copy required) z ## Previous graph you emitted (PRESERVE everything except camera_decision.camera_cell / look_at_cell / lens_enum / fov_deg) u/ ## What to emit Re-emit the SAME JSON object matching the schema, with the SAME graph node ordering, the SAME `is_dwelling_identity_anchor`, the SAME `mode`, the SAME `reference_decision`, the SAME `render_guidance`, and the SAME `rationale`. ONLY fix the `camera_decision` fields (camera_unit / camera_cell / look_at_unit / look_at_cell / lens_enum / fov_deg) so that: - `camera_cell` is a verbatim integer-pair copy of one entry in `camera_cell_candidates_per_unit[camera_unit]`. - `look_at_cell` is a verbatim integer-pair copy of one entry in `look_at_cell_candidates_per_unit[camera_unit]`. - `lens_enum` and `fov_deg` follow the system prompt rule 6. Do NOT change any other field. Do NOT invent any new node. Do NOT compute or interpolate a coordinate — use ONLY values from the candidate arrays above. )rJr_r|join)previous_parsedcamera_diagnosticsr~ cam_cands look_candsrxprev_graph_block diag_blocks r9 _build_camera_repair_user_promptrs2R$$%FGM2I.b%%&HIORJ"jj/80:  zzG$*dH.@.FB.FHHVJJ C ,G " #$P  ( (r8) required_shape_okgraph_completeness_oknode_index_order_okdag_okmax_refs_per_bg_oktwo_refs_distinct_spaces_oksame_fp_only_okanchor_exactly_one_ok anchor_in_clean_candidate_set_okrationale_and_mode_ok#synthetic_readback_production_clearzTuple[str, ...]_W20F9_REPAIR_KEYS_MUST_PASScl|jddurytD]}|j|dusyy)uNW20F9: retry 가능 조건 = camera_in_candidates 만 fail + 다른 모두 ok.camera_in_candidates_okFT)rJr) validatorsrs r9_is_camera_only_failurerss:~~/0= ) >>! D (* r8>rrr_W20F10_EXEMPT_EMPTY_NODES>rrr_W20F10_EXEMPT_NONEMPTY_NODESc||zsy|stnt}d}|jD]-\}}t|ts|dk(r||vr|durd}(|dus-y|S)u&W20F10: 교정 retry 가능 조건 — validator boolean+노드 구조로 판정. diagnostic 문자열 검색 금지(Codex 조건 1). 상류 renderable/clean-anchor 후보가 비어 있거나 **교집합이 0**이면(그래프=renderable 전수 ∧ anchor ∈ clean set 을 동시에 만족할 노드가 존재 불가) LLM 이 복구할 수 없으므로 즉시 fail-closed (Codex TEST-GAP-3 경계). camera_in_ candidates_ok 는 면제 집합에 없으므로 camera 실패가 섞이면 False — W20F9 와 상호 배타. Fall_validators_passedT)rrrHrFbool)rnodesrenderable_bg_idsclean_anchor_candidate_bg_idsexemptany_exempt_failedrOrPs r9_is_graph_anchor_only_failurers  = =*/" *  &&( U%&  ) )  &=~$(!   ) r8c Rddl}djd|xsgDxsd}|tjt |dtjt |d||d|j d d jt |jzd zfd |S) uW20F10 교정 입력 조립 — 팩 스템({{token}} 치환, 하드 프롬프팅 금지). 치환은 **템플릿 원문 단일 패스** 정규식 callback (Codex 리뷰 NARROW-2: 순차 str.replace 는 먼저 삽입된 데이터(이전 LLM 응답 등) 속의 후속 토큰을 재치환해 '이전 응답 전문' 을 변조한다 — 삽입 값은 다시 스캔되지 않아야 byte-preserved). patch 가 아니라 전체 schema 문서 재반환 계약은 스템이 소유. rNrc3&K|] }d| ywrr7rs r9rz9_build_graph_anchor_repair_user_prompt..s,Q"QC,rrTrr)diagnostics_blockrenderable_bg_ids_blockclean_anchor_candidates_blockprevious_response_blockoriginal_user_promptz\{\{(|z)\}\}c,|jdS)Nr0)group)mmappings r9z8_build_graph_anchor_repair_user_prompt..s'!''!*%r8)rerr_r|sortedsubmapescape) repair_templaterprevious_content diagnosticsrrrrrs @r9&_build_graph_anchor_repair_user_promptrs"&,", (#':: $ %$7)- 0 1T*C#3 4G 66388C 7344x?% r8cdtd|ddS)N json_schemaT)namestrictrM)rBr)rsanitized_schemas r9_build_response_formatrs(&  r8)rmodeltimeout_secondsmax_completion_tokensc Zt|tr|std|dt|ts"tdt |j dt|ts"tdt |j dt|ts"tdt |j d|g}t|t s"tdt |j ddd lm}|s td t} ddl } dd lm }  t| j|} | std|d | j|dxsg}d|vrtd|d|j!d}t|tr|r|nd}t#| d||||||}t%| d|}t'| d}t)|} | |||||d}t+|d!dxsg}|s td"|d}t+|d#d}| td$t+|d%d}|rtd&t|dd't+|d(d}|s td)t+|d*d}|d+k7rtd,|d- t-j.|}t|ts"td/t |j d ddl} |j7| dj9|dd4lm }m!}tE|j!d5xsijG} |xsij!d6}!t|!t tHfrtEd7|!D}"n7tEd8|xsij!d9xsijKD}"tEd:|j!d;xsij!d<xsgD}#|j!d=xsij!d>xsg}$|||$| |||"|#?}%|%d@su|%j!dAxsg}&tM|%r7|&D'cgc]}'dB|'vs dC|'vsdD|'vsdE|'vr|'}(}'tO||(|F})t%| d|)}* | ||*|||d}+t+|+d!dxsg},|,s tdH|,d}-t+|-d#d}.|. tdIt+|.d%d}/|/rtdJt|/dd't+|.d(d}0|0s tdKt+|-d*d}1|1d+k7rtdL|1d- t-j.|0}2t|2ts"tdNt |2j d |j7| dj9|2|2j!d=xsij!d>xsg}3|||3| |||"|#?}4|4d@stM|4rT||3|P\}5}6|6rE|||5| |||"|#?}7|7d@r1|5|2d=d><dQd|6ddRtQ|6tQ|6dRkD|(ddSdT|2dU<|2SdVjS|4j!dAxsgddW}8tdX|8dQdQ|(ddSdY|2dU<|2StU|%|$|"|#ZrtW| d[|t|t |&|"|#\})t%| d|)}* | ||*|||d}9t+|9d!dxsg}:|:s tYd`d^_|:d};t+|;d#d}<|< tYdad^_t+||>s tYdcd^_t+|;d*d}?|?d+k7rtYdd|?d-d^_ t-j.|>}@t@ts$tYdft @j dd^_ |j7| dj9@@j!d=xsij!d>xsg}A|||A| |||"|#?}B|Bd@s7dVjSBj!dAxsgddW}CtYdh|Cd^_dQdQt |&ddSdi@dj<|@SdVjS|&ddk}Dtdl|DddW|S#t$r*} td t | j d | | d} ~ wwxYw#t$r*} tdt | j d | | d} ~ wwxYw#t$r*} tdt | j d | | d} ~ wwxYw#t$r*} td t | j d | | d} ~ wwxYw#t0t2f$r*} td.t | j d | | d} ~ wwxYw#t$r*} td0t | j d | | d} ~ wwxYw#|j:$r*} td1t| j<dd2| d} ~ wt$r*} td3t | j d | | d} ~ wwxYwcc}'w#t$r*} tdGt | j d | | d} ~ wwxYw#t0t2f$r*} tdMt | j d | | d} ~ wwxYw#|j:$r*} tdOt| j<dd2| d} ~ wwxYw#t$r,} tYd]t | j d | d^_| d} ~ wwxYw#t0t2f$r,} tYdet | j d | d^_| d} ~ wwxYw#|j:$r,} tYdgt| j<dd2d^_| d} ~ wwxYw)muReal-LLM planner via a single ``litellm.completion`` call. Returns the parsed graph/output dict ready for ``build_render_plan_for_fp`` consumption. Fail-closed at every preflight joint — the completion call counter stays 0 whenever this function fails before issuing the network call. Flow: 1. Arg-shape guards (no env / network access). 2. Env preflight: ``OPENAI_API_KEY`` non-empty. 3. Prompt pack preflight: load system / user_template / schema; fail-closed on missing / empty / malformed. 4. Lazy ``import litellm``. 5. Litellm capability preflight: ``supports_response_schema(model)`` True AND ``response_format`` listed in ``get_supported_openai_params(model, custom_llm_provider="openai")``. 6. Assemble messages (system + structured user prompt with the JSON-dumped upstream blocks). 7. Single ``litellm.completion`` call. Strict ``json_schema`` response_format using the SANITIZED schema, ``num_retries=0``, no temperature, ``max_completion_tokens`` + ``timeout`` locked to module-level defaults. 8. Response guards: non-empty choices, message present, no truthy refusal, non-empty content, ``finish_reason == "stop"`` exactly. 9. Parse JSON content; reject non-object roots. 10. Local ``jsonschema.Draft202012Validator`` against the ORIGINAL pack schema (keeps minLength / minItems / etc. enforcement). 11. Production ``validate_llm_output`` — DAG / refs / camera / anchor / same-fp / rationale; fail-closed on diagnostics. Returns the parsed dict on full success; raises ``ShotAwareBgRenderPlanProviderError`` on any failure. z$fp_id must be non-empty string (got rUzdossier must be dict (got zgeometry must be dict (got z!shot_readiness must be dict (got Nz$candidate_catalog must be list (got r)has_openai_keyz9OPENAI_API_KEY missing or empty; refusing to call litellm)llm_completionzlitellm import failed: rT)rz)litellm.supports_response_schema raised: zmodel zH does not advertise response_schema support in litellm; refusing to callopenai)rcustom_llm_providerz,litellm.get_supported_openai_params raised: response_formatzK does not list response_format in supported openai params; refusing to callruunknownrW)rWrtrur}r~rrrVrrMr)rmessagesrtimeoutr num_retrieszlitellm.completion raised: choiceszresponse.choices is emptymessagez&response.choices[0].message is missingrefusalzLLM emitted a refusal: rz,response.choices[0].message.content is empty finish_reasonstopz*finish_reason must be 'stop' exactly (got z$); length/content_filter fail closedz$response content is not valid JSON: z+response content is not a JSON object (got zjsonschema import failed: z$local jsonschema validation failed: i,zlocal jsonschema setup failed: )snap_camera_cells_to_candidatesvalidate_llm_outputrmrc3BK|]}t|ts|ywr=rFr )rbs r9rz=litellm_shot_aware_bg_render_plan_provider..s& %!As);A~sc3hK|]*\}}t|tr|jdr|,yw)okN)rFrGrJ)rbgidentrys r9rz=litellm_shot_aware_bg_render_plan_provider..s6&   e%&599T?  s02rnc3DK|]}t|tr|r|ywr=r)rbids r9rz=litellm_shot_aware_bg_render_plan_provider..s- >   c3 C  s anchor_selection_metadatacandidate_bg_idsrr)rtrsame_fp_bg_idsr~rurrrr camera_cell look_at_cell lens_enumfov_deg)rrr~zgproduction validate_llm_output failed (camera-only first pass); W20F9 retry litellm.completion raised: z%W20F9 retry response.choices is emptyz2W20F9 retry response.choices[0].message is missingz#W20F9 retry LLM emitted a refusal: z8W20F9 retry response.choices[0].message.content is emptyz.W20F9 retry finish_reason must be 'stop' (got z$W20F9 retry content not valid JSON: z+W20F9 retry content not a JSON object (got z0W20F9 retry local jsonschema validation failed: )rr~r0 ) camera_validator_retry_attempted camera_validator_retry_succeededcamera_candidate_snap_repairs#camera_candidate_snap_repairs_total'camera_candidate_snap_repairs_truncatedfirst_pass_camera_diagnostics_w20f9_retry_metadataz; iz9W20F9 retry production validate_llm_output still failed: )rrr)rrrrX)rrrrrrziproduction validate_llm_output failed (graph/anchor first pass); W20F10 retry litellm.completion raised: r:z&W20F10 retry response.choices is emptyz3W20F10 retry response.choices[0].message is missingz$W20F10 retry LLM emitted a refusal: z9W20F10 retry response.choices[0].message.content is emptyz/W20F10 retry finish_reason must be 'stop' (got z%W20F10 retry content not valid JSON: z,W20F10 retry content not a JSON object (got z1W20F10 retry local jsonschema validation failed: z:W20F10 retry production validate_llm_output still failed: )&graph_anchor_validator_retry_attempted&graph_anchor_validator_retry_succeededfirst_pass_diagnostics_graph_anchor_retry_metadataz'production validate_llm_output failed: )-rFr r/rGrBr2rKapp.core.openai_keysrrklitellmrr]rsupports_response_schemaget_supported_openai_paramsrJrrrIrgetattrr_r`rarb jsonschemaDraft202012ValidatorvalidateValidationErrorr.app.modules.pipeline.shot_aware_bg_render_planrr frozensetrLtuplerHrrlenrrrr@)Ertr}r~rrrrrrpackr_llm_completionrj supports_oksupported_paramsreadback_status_rawrurrrrresponserchoicer>rrrparsedrrrrrenderable_rawrrrr diag_listr cam_diagsrepair_user_promptrepair_messagesretry_response retry_choices retry_choice retry_msg retry_refusal retry_content retry_finish retry_parsed retry_nodesretry_validators snapped_nodes snap_repairssnapped_validators retry_diag ga_response ga_choices ga_choicega_msg ga_refusal ga_content ga_finish ga_parsedga_nodes ga_validatorsga_diagdiagsE r9*litellm_shot_aware_bg_render_plan_providerrCs` eS !025)1 =   gt $0(g)?)?(@ B   h %0)$x.*A*A)B! D   nd +0(112! 5    ' .0*+445Q 8  4  0 G   D 7;;%;HI 0UI3 4     / / 0    000UI8 9  #,,'89 )3 /4G   %?+'%+K?+H:$x.I,)O "+#"7  h 406BG 0 '  QZF &)T *C {0 4  c9d+G0%c'l4C&8%; <  c9d+G 0 :  FOT:M08C E  G$ fd #0L))*! -   ''X7@@H 3 4 :@@BN %*//0CDN.4-0%& %&  &&  %2**84:eg &  5> >[[4 5 ; @ @"    > 5!ZZ &B + +G 4 :E$%'+&CJ - .NN=17R ": .$$a!Q&%*"a' A~ 9 "B &#,!"  ."?3.O !0,$3+*? ! "$$NItDJM 8;)+L i>I 8H$Iy$?M89=)$3/24$Iy$?M 8N#<$GLv%8D#&&JL #zz-8 lD18 .778; //X?HHV(++G4:??HNBK2!-! /"3.K  $$;<++;<2Q)H3/M<$-@"'"/+9%-,;.? = .*..EF=JL1':DEDE$0"$5GJ$0H"%( $5$:AJ3B EL)@A$0/!YY$((7=23 9)l,56451:3B5L0 1   ( /*G  "H $%C D%0!$W O"3.K " ."?3.O -,$3+*? !  !i>D"J%<%&#1 IY 48F~%I%&!D9J%::t,/1%& !D9J%%&  ?DAIF"%E m#GI%&   JJz2 i.% O445Q8%& //N(9%" g.4"99'BHbH/-! /"3.KM!!89))!%%m4:3&&i)%& ;<:;*.y/#2*>9I4 5  yy2A'05d4Cj\ B   MO 0%d3i&8&8%9C5 A   07Cy!!""SE +  " 0:Cy!!""SE +  b 0)$s)*<*<)=Ru E  J z "02Cy!!""SE +   0(c););(>i i>%i99i>j:%j55j:=k6 %k11k69 l.'l))l.1m,'m''m,/n*>'n%%n*)r>r r;r returnr/)rMrrDr)rDDict[str, Any])rWr rtr rur r}rEr~rErrEr List[Any]rDr )rVr rr rDzList[Dict[str, Any]])rrEr List[str]r~rErDr )rrErDr) rrErrFrr,rr,rDr)rr rr rr rrGrr,rr,rDr )rrErDrE)rtr r}rEr~rErrErzOptional[List[Any]]rr rr rr rDrE).r5 __future__rr_loggingospathlibrtypingrrrrr r getLoggerr2loggerr r6rrrr__file__resolveparentrrr-r]r/r@rIrkrrrrrrrrrrrCr7r8r9rRs$J#  >>   8 $2s1%*s*"":c:'& N##**1188??78:HI$3< = 3  # #*+ #&'D<~99 9 9  9  9#9!9 9x(+C#C"C C  CL 1o .78.N 1:;1~"" "& " $2 "  "J### #  # & #$2# #L '  0.2&2!>@  @ @  @  # @  + @  @ @ @ @ r8