[_common.py:105] Backing off create_retrying(...) for 1.3s (False)

[Khyathianeesha]

Describe the bug

os.environ["OPENAI_API_KEY"] = api_key

!oaieval gpt-3.5-turbo match_mmlu_elementary_mathematics --log_to_file logFile_1.txt

I am getting below error:
[2024-12-04 09:57:28,694] [oaieval.py:215] �[1;35mRun started: 241204042728KEBZL4AE�[0m [2024-12-04 09:57:28,781] [data.py:94] Fetching c:\Users\g.khyathi.aneesha\TO Repos\GenAIOpenEvals\evals-main\examples\..\evals\registry\data\mmlu\elementary_mathematics\few_shot.jsonl [2024-12-04 09:57:28,787] [data.py:94] Fetching c:/Users/g.khyathi.aneesha/TO Repos/GenAIOpenEvals/evals-main/examples/../evals/registry/data/mmlu/elementary_mathematics/samples.jsonl [2024-12-04 09:57:28,795] [eval.py:36] Evaluating 15 samples [2024-12-04 09:57:28,800] [eval.py:144] Running in threaded mode with 10 threads! [2024-12-04 09:57:54,820] [_common.py:105] Backing off create_retrying(...) for 0.8s (False) [2024-12-04 09:57:54,893] [_common.py:105] Backing off create_retrying(...) for 0.9s (False) [2024-12-04 09:57:54,946] [_common.py:105] Backing off create_retrying(...) for 0.2s (False) [2024-12-04 09:57:54,952] [_common.py:105] Backing off create_retrying(...) for 0.5s (False) [2024-12-04 09:57:55,018] [_common.py:105] Backing off create_retrying(...) for 0.3s (False) [2024-12-04 09:57:55,043] [_common.py:105] Backing off create_retrying(...) for 0.8s (False)

To Reproduce

1. Try executing mmlu.ipynb example in examples folder
2. set api_key (os.environ["OPENAI_API_KEY"] = api_key)
3. Run each code block
4. getting error while executing "!oaieval gpt-3.5-turbo match_mmlu_elementary_mathematics"

Code snippets

No response

OS

Windows

Python version

Python 3.12.7

Library version

evals 3.0.1.post1