j nddlZddlmZmZmZmZddlZddlmZ ddl m Z GddejZ y)N)AnyListOptionalUnion) score_resultc eZdZdZ d deededeeddfdZejde d e de e jee jffd Zde d e de e jee jffd Zy) BaseMetricaW Abstract base class for all metrics. When creating a new metric, you should inherit from this class and implement the abstract methods. Args: name: The name of the metric. If not provided, uses the class name as default. track: Whether to track the metric. Defaults to True. project_name: Optional project name to track the metric in for the cases when there is no parent span/trace to inherit project name from. Example: >>> from opik.evaluation.metrics import base_metric, score_result >>> >>> class MyCustomMetric(base_metric.BaseMetric): >>> def __init__(self, name: str, track: bool = True): >>> super().__init__(name=name, track=track) >>> >>> def score(self, input: str, output: str, **ignored_kwargs: Any): >>> # Add your logic here >>> >>> return score_result.ScoreResult( >>> value=0, >>> name=self.name, >>> reason="Optional reason for the score" >>> ) Nnametrack project_namereturnc`||n|jj|_||_t j }|s | t d|rc|jdurPtj|j|}||j|_ ||j|_ yyy)Nz8project_name can be set only when `track` is set to TrueF)r r ) __class____name__r r opik_config OpikConfig ValueError!check_for_known_misconfigurationsopikscoreascore)selfr r r configtrack_decorators |/Users/manta/Documents/Projects/TheRoad-I1/backend/.venv/lib/python3.12/site-packages/opik/evaluation/metrics/base_metric.py__init__zBaseMetric.__init__%s !,D$..2I2I  '')1WX X V==?5H"jjdiilSO(4DJ)$++6DKI5argskwargsct)zA Public method that can be called independently. )NotImplementedErrorrrr s rrzBaseMetric.score8s "##rc.K|j|i|Sw)zG Async public method that can be called independently. )rr#s rrzBaseMetric.ascoreAs tzz4*6**s)NTN)r __module__ __qualname____doc__rstrboolrabcabstractmethodrrr ScoreResultrrrrrr r s:#&* 7sm77sm 7  7& $$$'$ |''l.F.F)GG H$$++$'+ |''l.F.F)GG H+rr )r*typingrrrrr opik.configrrmetricsrABCr r-rrr2s' -- !">+>+r