Skip to content

Commit

Permalink
add logic documentation for fuzzy_match
Browse files Browse the repository at this point in the history
  • Loading branch information
sjadler2004 committed Oct 20, 2023
1 parent fa959ca commit 16aa8c7
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions evals/elsuite/basic/fuzzy_match.py
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,10 @@


class FuzzyMatch(evals.Eval):
"""
For a model completion `a` and a reference list of correct answers `B`, the following eval
implements `any([(a in b or b in a) for b in B])`, as mentioned in `eval-templates.md`.
"""
def __init__(
self,
completion_fns: list[CompletionFn],
Expand Down

0 comments on commit 16aa8c7

Please sign in to comment.