Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

E1203 08:43:48.414558 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version. #1495

Open
wenxinmomo opened this issue Dec 3, 2024 · 14 comments
Open

E1203 08:43:48.414558 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version. #1495

wenxinmomo opened this issue Dec 3, 2024 · 14 comments
Assignees
@YanhuiDua

Comments

@wenxinmomo
Copy link

出现这个提示，我不确定出现这个提示是会真正运行在了NPU上，是否有影响。

期待解答

会连续出现三个：
E1203 08:43:48.096444 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
E1203 08:43:48.414558 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
E1203 08:43:48.896029 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
@wenxinmomo
Copy link
Author

安装了pip list | grep paddle
paddle-custom-npu 0.0.0
paddle2onnx 1.3.1
paddleocr 2.9.1
paddlepaddle 3.0.0.dev20241130
rapidocr-paddle 1.4.0

@onecatcn
Copy link

onecatcn commented Dec 3, 2024 •
edited
Loading

能介绍一下你是按照哪个文档进行安装的吗？就是具体用的哪个镜像&安装指令

我们文档中有一些问题（部分文档的内容过时）了，建议使用这个文档安装镜像：https://github.com/PaddlePaddle/PaddleX/blob/release/3.0-beta/docs/tutorials/INSTALL_OTHER_DEVICES.md

然后使用官网首页的安装命令：https://www.paddlepaddle.org.cn/

@wenxinmomo
Copy link
Author

您好，我用的编译安装npu插件。但没有用官方镜像，我的镜像不方便更换。
https://www.paddlepaddle.org.cn/documentation/docs/zh/guides/hardware_support/npu/install_cn.html

同时：使用健康检查命令，如果是一张卡能成功，如果是8张卡会卡着，或者直接报错

python -c "import paddle; paddle.utils.run_check()"

python -c "import paddle; paddle.utils.run_check()"
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
I1204 01:01:52.890079 49291 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:01:52.890146 49291 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:01:53.574843 49291 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:01:53.580070 49291 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:01:53.580289 49291 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:01:53.580330 49291 init.cc:242] CustomDevice: npu, visible devices count: 8
Running verify PaddlePaddle program ... 
I1204 01:01:54.393211 49291 pir_interpreter.cc:1508] New Executor is Running ...
I1204 01:01:54.397958 49291 pir_interpreter.cc:1531] pir interpreter is running by multi-thread mode ...
PaddlePaddle works well on 1 npu.
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle/utils/cpp_extension/extension_utils.py:686: UserWarning: No ccache found. Please be aware that recompiling all source files may be required. You can download and install ccache from: https://github.com/ccache/ccache/blob/master/doc/INSTALL.md
  warnings.warn(warning_message)
I1204 01:02:04.883134 50327 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.883193 50327 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:04.952832 50326 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.952888 50326 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:04.970635 50325 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:04.970678 50325 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.007840 50323 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.007879 50323 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.078065 50321 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.078107 50321 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.078111 50322 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.078145 50322 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.113888 50328 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.113945 50328 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.175523 50324 init.cc:236] ENV [CUSTOM_DEVICE_ROOT]=/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device
I1204 01:02:05.175580 50324 init.cc:145] Try loading custom device libs from: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.547490 50327 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.552218 50327 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.552425 50327 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.552465 50327 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.598837 50326 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.598837 50325 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.603399 50326 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.603423 50325 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.603617 50326 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.603637 50325 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.603654 50326 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.603668 50325 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.606782 50323 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.609606 50323 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.609797 50323 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.609830 50323 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.643714 50322 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.646311 50322 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.646483 50322 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.646512 50322 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.657361 50321 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.659858 50321 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.660022 50321 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.660049 50321 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.764190 50328 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.768668 50328 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.768872 50328 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.768909 50328 init.cc:242] CustomDevice: npu, visible devices count: 8
I1204 01:02:05.816929 50324 custom_device.cc:1099] Succeed in loading custom runtime in lib: /root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device/libpaddle-custom-npu.so
I1204 01:02:05.821298 50324 custom_kernel.cc:63] Succeed in loading 358 custom kernel(s) from loaded lib(s), will be used like native ones.
I1204 01:02:05.821498 50324 init.cc:157] Finished in LoadCustomDevice with libs_path: [/root/miniconda3/envs/MinerU/lib/python3.10/site-packages/paddle_custom_device]
I1204 01:02:05.821539 50324 init.cc:242] CustomDevice: npu, visible devices count: 8
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================
======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_enable_pir_in_executor', current_value=True, default_value=False)
=======================================================================

@wenxinmomo
Copy link
Author

我测试下来，虽然出现E1203 08:43:48.096444 27598 analysis_config.cc:163] Please use PaddlePaddle with GPU version.
但速度也确实提升了的，但在一个地方，NPU比CPU还慢，执行Paddle类text_detector。

您那边方便看下吗，最终目的是要执行text_detector时要快一些。非常感谢！

@wenxinmomo
Copy link
Author

我知道这个日志的原因了，不在您这，在rapid_table那里。现在的问题是text_detector速度慢有解决方法吗

@xuanyuanminzheng
Copy link
Contributor

xuanyuanminzheng commented Dec 4, 2024 •
edited
Loading

我知道这个日志的原因了，不在您这，在rapid_table那里。现在的问题是text_detector速度慢有解决方法吗

具体用的是哪个模型呢？ 有没有配置过如下环境变量？

export FLAGS_npu_storage_format=0

export FLAGS_use_stride_kernel=0

export FLAGS_allocator_strategy=auto_growth

export FLAGS_npu_scale_aclnn=True

export FLAGS_npu_split_aclnn=True

export FLAGS_npu_jit_compile=false

@wenxinmomo
Copy link
Author

您好，用的是：ch_PP-OCRv4_det_infer、ch_PP-OCRv4_rec_infer

之前只有了一个环境变量：export FLAGS_npu_jit_compile=false。
又用您提供的环境变量测试了下，速度没有变化

@xuanyuanminzheng
Copy link
Contributor

麻烦再问一下具体的使用场景，都使用的是推理是吗？另外是使用ppocr拉起的吗？

@wenxinmomo
Copy link
Author

都是推理
在ARM架构，910B的环境下。
使用PaddleOCR类初始化模型，然后
执行PaddleOCR.text_detector()，速度比CPU还慢。text_recognizer很快。
CPU一张图片大概0.5s
NPU一张图片，2s-1s左右

已经使用环境变量： export FLAGS_npu_jit_compile=0

@xiaoguoguo626807
Copy link
Collaborator

NPU上kernel第一次运行就是很慢，测速的话建议先warmup再循环多次测平均速度，环境变量加这2个就够了export FLAGS_npu_jit_compile=0
export FLAGS_use_stride_kernel=0

@wenxinmomo
Copy link
Author

已经计算了平均的时间，确实2s-1s不等，而CPU平均0.8s。
请问您那测试过text_detector嘛，确实有些慢

@wenxinmomo
Copy link
Author

CANN：8.0.RC2

@wangna11BD
Copy link
Contributor

对同一张图像进行循环测速，速度会正常起来，多张图像循环还是会变慢
参考相关issue https://github.com/PaddlePaddle/Paddle/issues/68107、https://github.com/PaddlePaddle/PaddleX/issues/1929

@wenxinmomo
Copy link
Author

对同一张图像进行循环测速，速度会正常起来，多张图像循环还是会变慢 参考相关issue https://github.com/PaddlePaddle/Paddle/issues/68107、https://github.com/PaddlePaddle/PaddleX/issues/1929

你好，404

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@YanhuiDua YanhuiDua

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@onecatcn @YanhuiDua @xuanyuanminzheng @wangna11BD @xiaoguoguo626807 @wenxinmomo