Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate why ls with wandbfsspec takes longer than with fsspec #1

Open
alvarobartt opened this issue Jul 11, 2022 · 0 comments
Open
Assignees

Comments

@alvarobartt
Copy link
Owner

When we run pytest tests/ --durations 0 -s we see the following output:

===================================================================== test session starts =====================================================================
platform linux -- Python 3.9.13, pytest-7.1.2, pluggy-1.0.0
rootdir: /workspaces/wandbfsspec
collected 5 items                                                                                                                                             

tests/test_core.py .....

====================================================================== slowest durations ======================================================================
0.65s call     tests/test_core.py::TestWandbFileSystem::test_ls
0.56s call     tests/test_core.py::TestWandbFileSystem::test_modified
0.16s call     tests/test_core.py::TestWandbFileSystem::test_open
0.15s call     tests/test_core.py::TestWandbFileSystem::test_ls_from_fsspec
0.15s call     tests/test_core.py::TestWandbFileSystem::test_open_from_fsspec

(10 durations < 0.005s hidden.  Use -vv to show these durations.)
====================================================================== 5 passed in 2.14s ======================================================================

where the elapsed time to run ls over the same directory with fsspec is much faster than the one with wandbfsspec.

@alvarobartt alvarobartt self-assigned this Jul 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant