Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement remote computation #71

Open
6 tasks done
paskino opened this issue Nov 10, 2021 · 2 comments · May be fixed by #73
Open
6 tasks done

Implement remote computation #71

paskino opened this issue Nov 10, 2021 · 2 comments · May be fixed by #73
Assignees
@paskino
Labels
remote execution
Milestone
Next version

Comments

@paskino
Copy link
Contributor

paskino commented Nov 10, 2021 •
edited
Loading

To enable remote computation we need to:

  • select remote file
  • download it
  • start a session on the downloaded files
  • Save pointcloud and DVC run configuration to file and transfer it to the remote
  • Start computation on remote
  • Retrieve the results

The first 2 items are implemented in https://github.com/paskino/CIL-work/blob/master/RemoteViewer/TwoLinkedViewersCentralWidgetCompare.py

Last item is done for SLURM remotes in https://github.com/paskino/brem/blob/main/examples/run_dvc_gui.py
@paskino paskino self-assigned this Nov 10, 2021
@paskino paskino linked a pull request Nov 11, 2021 that will close this issue
Draft
@paskino
Copy link
Contributor Author

paskino commented Nov 23, 2021 •
edited
Loading

Once this is done we should downsample the data on the remote, and only transfer the downsampled version.

@lauramurgatroyd
Copy link
Member

  • need to crop the file remotely - for registration

@paskino paskino added this to the version 22.1 milestone May 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@paskino paskino

Labels
remote execution
Projects
iDVC Planning
Status: No status
Milestone
Next version
Development

Successfully merging a pull request may close this issue.

Remote devel TomographicImaging/iDVC
3 participants
@paskino @lauramurgatroyd @DanicaSTFC