Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

calib_dataloader created fail #91

Open
relaxtheo opened this issue Oct 22, 2024 · 2 comments
Open

calib_dataloader created fail #91

relaxtheo opened this issue Oct 22, 2024 · 2 comments

Comments

@relaxtheo
Copy link

I am trying the vlm_ptq by following the readme in vlm_ptq folder, and when I call a command "scripts/huggingface_example.sh --type llava --model llava-1.5-7b-hf --quant fp8 --tp 8", (--deployment commented) following error message is reported:

Traceback (most recent call last):
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 404, in
main(args)
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 222, in main
calib_dataloader = dataset_utils.get_dataset_dataloader(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 124, in get_dataset_dataloader
dataset = _get_dataset_samples(dataset_name, num_samples=num_samples)
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 65, in _get_dataset_samples
dataset = load_dataset(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 2076, in load_dataset
builder_instance = load_dataset_builder(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 1833, in load_dataset_builder
builder_instance: DatasetBuilder = builder_cls(
TypeError: 'NoneType' object is not callable

What's the problem for this issue? I have no idea for it, hope somebody can give some advice, thank you

@kevalmorabia97
Copy link
Collaborator

Have you tried re-running the update example with latest modelopt 0.19.0 to see if the issue persists?

@cjluo-omniml
Copy link
Collaborator

This looks like a datasets issue. Have you tried upgrade the package?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants