Package versions missing in next_sentence

[bkbroz]

When trying to run:

python train.py task=open_webtext_gpt2 device=gpu

I get the following error:

Traceback (most recent call last):
File "/workspace/gfn-lm-tuning/next_sentence/train.py", line 19, in
from lightning_data import PromptDataModule
File "/workspace/gfn-lm-tuning/next_sentence/lightning_data.py", line 2, in
from torchdata.datapipes.map import MapDataPipe
File "/usr/local/lib/python3.10/dist-packages/torchdata/datapipes/init.py", line 11, in
from . import iter, map, utils
File "/usr/local/lib/python3.10/dist-packages/torchdata/datapipes/iter/init.py", line 79, in
from torchdata.datapipes.iter.util.cacheholder import (
File "/usr/local/lib/python3.10/dist-packages/torchdata/datapipes/iter/util/cacheholder.py", line 24, in
from torch.utils._import_utils import dill_available
ModuleNotFoundError: No module named 'torch.utils._import_utils'

I think this is due to a dependency issue, since the packages in the requirements.txt doesn't have the version numbers.
Please run
pip freeze > requirements.txt

[MJ10]

Hi @bkbroz sorry for the delayed response. Here is the requirements.txt
requirements.txt