You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying the vlm_ptq by following the readme in vlm_ptq folder, and when I call a command "scripts/huggingface_example.sh --type llava --model llava-1.5-7b-hf --quant fp8 --tp 8", (--deployment commented) following error message is reported:
Traceback (most recent call last):
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 404, in
main(args)
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 222, in main
calib_dataloader = dataset_utils.get_dataset_dataloader(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 124, in get_dataset_dataloader
dataset = _get_dataset_samples(dataset_name, num_samples=num_samples)
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 65, in _get_dataset_samples
dataset = load_dataset(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 2076, in load_dataset
builder_instance = load_dataset_builder(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 1833, in load_dataset_builder
builder_instance: DatasetBuilder = builder_cls(
TypeError: 'NoneType' object is not callable
What's the problem for this issue? I have no idea for it, hope somebody can give some advice, thank you
The text was updated successfully, but these errors were encountered:
I am trying the vlm_ptq by following the readme in vlm_ptq folder, and when I call a command "scripts/huggingface_example.sh --type llava --model llava-1.5-7b-hf --quant fp8 --tp 8", (--deployment commented) following error message is reported:
Traceback (most recent call last):
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 404, in
main(args)
File "/WS/ModelOptWS/TensorRT-Model-Optimizer/vlm_ptq/../llm_ptq/hf_ptq.py", line 222, in main
calib_dataloader = dataset_utils.get_dataset_dataloader(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 124, in get_dataset_dataloader
dataset = _get_dataset_samples(dataset_name, num_samples=num_samples)
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/modelopt/torch/utils/dataset_utils.py", line 65, in _get_dataset_samples
dataset = load_dataset(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 2076, in load_dataset
builder_instance = load_dataset_builder(
File "/WS/conda/envs/vlm_ptq/lib/python3.10/site-packages/datasets/load.py", line 1833, in load_dataset_builder
builder_instance: DatasetBuilder = builder_cls(
TypeError: 'NoneType' object is not callable
What's the problem for this issue? I have no idea for it, hope somebody can give some advice, thank you
The text was updated successfully, but these errors were encountered: