KKiSrSSKrSSKrSSKJr SSKJr SSKJrJ r SSK J r SSK J r SSKJr \R "\5r"S S \5r"S S \5rg) zEvaluators for parsing strings.N)Callable)eq)Anycast)parse_json_markdown)override)StringEvaluatorc^\rSrSrSrS\SS4U4Sjjr\\S\ 4Sj55r \\S\ 4Sj55r \\S\ 4S j55r \S \ S \S\4S j5rS rU=r$)JsonValidityEvaluatora2Evaluate whether the prediction is valid JSON. This evaluator checks if the prediction is a valid JSON string. It does not require any input or reference. Attributes: requires_input: Whether this evaluator requires an input string. Always False. requires_reference: Whether this evaluator requires a reference string. Always False. evaluation_name: The name of the evaluation metric. Always "json". Examples: >>> evaluator = JsonValidityEvaluator() >>> prediction = '{"name": "John", "age": 30, "city": "New York"}' >>> evaluator.evaluate(prediction) {'score': 1} >>> prediction = '{"name": "John", "age": 30, "city": "New York",}' >>> evaluator.evaluate(prediction) {'score': 0, 'reasoning': 'Expecting property name enclosed in double quotes'} _returnNc ">[TU]5 g)z%Initialize the JsonValidityEvaluator.N)super__init__)selfr __class__s k/var/www/html/dynamic-report/venv/lib/python3.13/site-packages/langchain_classic/evaluation/parsing/base.pyrJsonValidityEvaluator.__init__*s cgNFrs rrequires_input$JsonValidityEvaluator.requires_input.rcgrrrs rrequires_reference(JsonValidityEvaluator.requires_reference3rrcg)N json_validityrrs revaluation_name%JsonValidityEvaluator.evaluation_name8r predictionkwargsc [U[RS9 SS0$![RanS[ U5S.sSnA$SnAf[ a-n[ RS5 S[ U5S.sSnA$SnAff=f)aEvaluate the prediction string. Args: prediction: The prediction string to evaluate. **kwargs: Additional keyword arguments (not used). Returns: `dict` containing the evaluation score. The score is `1` if the prediction is valid JSON, and `0` otherwise. If the prediction is not valid JSON, the dictionary also contains a `reasoning` field with the error message. )parserr)score reasoningNz*Passing JSON failed with unexpected error.r*)rjsonloadsJSONDecodeErrorstr Exception_logger exception)rr&r'es r_evaluate_strings'JsonValidityEvaluator._evaluate_strings=so( 5  4:: > | ## 5SV4 4 5   J KSV4 4 5s+A? AA? A?"A:4A?:A?r)__name__ __module__ __qualname____firstlineno____doc__rrpropertyrboolrrr0r#dictr5__static_attributes__ __classcell__rs@rr r s0CD  D   rr c ^\rSrSrSrSS\S-S\SS4U4Sjjjr\\ S\ 4Sj55r \\ S\ 4S j55r \\ S\ 4S j55rS \S\\-S-\-\ -\-\ -4S jr\ SS \ S\ S-S\S\4Sjj5rSrU=r$)JsonEqualityEvaluator[a'Json Equality Evaluator. Evaluate whether the prediction is equal to the reference after parsing both as JSON. This evaluator checks if the prediction, after parsing as JSON, is equal to the reference, which is also parsed as JSON. It does not require an input string. Attributes: requires_input: Whether this evaluator requires an input string. Always False. requires_reference: Whether this evaluator requires a reference string. Always True. evaluation_name: The name of the evaluation metric. Always "parsed_equality". Examples: >>> evaluator = JsonEqualityEvaluator() >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 1}') {'score': True} >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 2}') {'score': False} >>> evaluator = JsonEqualityEvaluator(operator=lambda x, y: x["a"] == y["a"]) >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 1}') {'score': True} >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 2}') {'score': False} Noperatorr rc J>[TU]5 U=(d [Ulg)zInitialize the JsonEqualityEvaluator. Args: operator: A custom operator to compare the parsed JSON objects. Defaults to equality (`eq`). N)rrrrE)rrEr rs rrJsonEqualityEvaluator.__init__|s  B rcgrrrs rr$JsonEqualityEvaluator.requires_inputrrcg)NTrrs rr(JsonEqualityEvaluator.requires_referencesrcg)N json_equalityrrs rr#%JsonEqualityEvaluator.evaluation_namer%rstringcF[U[5(a [U5$U$N) isinstancer0r)rrOs r _parse_json!JsonEqualityEvaluator._parse_jsons! fc " "&v. . rr& referencer'c URU5nUR[SU55n[U[5(a/[U[5(dSS0$[ USS9n[ USS9nSUR XE50$)zEvaluate the prediction string. Args: prediction: The prediction string to evaluate. reference: The reference string to compare against. **kwargs: Additional keyword arguments (not used). Returns: `dict` containing the evaluation score. r0r*rc[U5$rQr0xs r9JsonEqualityEvaluator._evaluate_strings..s#a&r)keyc[U5$rQrXrYs rr[r\sAr)rSrrRlistsortedrE)rr&rUr'parsedlabels rr5'JsonEqualityEvaluator._evaluate_stringss}"!!*-  eY!78 eT " "fd++|#F(89F5&67Ev566r)rErQ)r7r8r9r:r;rrrr<rr=rrr0r#r>r_floatintrSr5r?r@rAs@rrCrC[s @'D'c'd''  D  t e #d *S 03 6!%77:7 7  77rrC)r;r-loggingcollections.abcrrErtypingrrlangchain_core.utils.jsonrtyping_extensionsr#langchain_classic.evaluation.schemar getLoggerr7r2r rCrrrrmsM% $9&?   H %GOGTZ7OZ7r