Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write docs #7

Open
15 of 50 tasks
riga opened this issue Dec 4, 2016 · 2 comments
Open
15 of 50 tasks

Write docs #7

riga opened this issue Dec 4, 2016 · 2 comments
Assignees
Milestone

Comments

@riga
Copy link
Owner

riga commented Dec 4, 2016

Write doc strings and the structure for the doc pages.

Pages

  • Tasks
  • Targets
  • Workflows
  • Sandboxing
  • Configuration
  • Commandline Interface

API

  • cli
  • job
    • base
    • dashboard
  • sandbox
    • base
    • bash
    • docker
    • singularity
  • target
    • base
    • file
    • local
    • remote
    • collection
    • formatter
  • task
    • base
  • workflow
    • base
    • local
    • remote
  • config
  • decorator
  • parameter
  • logger
  • parser
  • patches
  • util

Contrib

  • arc
  • cms
  • dropbox
  • git
  • glite
  • htcondor
  • keras
  • lsf
  • matplotlib
  • mercurial
  • numpy
  • root
  • tasks
  • tensorflow
  • wlcg
@riga riga self-assigned this Dec 4, 2016
@riga riga added this to the v0.1 milestone Aug 5, 2019
@riga riga modified the milestones: v0.1, v0.2 Dec 9, 2020
@choucavalier
Copy link
Contributor

Note: In the documentation of Workflows, the concept of a "proxy" task is never really explained. Why do we need a proxy task? I read this 10 times and I still don't fully understand how workflows and proxy tasks work, nor when they should be used.

@riga
Copy link
Owner Author

riga commented Aug 26, 2023

Workflow proxies are a way to tell luigi not to use the run(), output() and requires() methods defined in the task itself by the user when branch is -1. In this case, all calls are forwarded to the workflow proxy's methods, which can do something completely different, depending on their workflow type.

Local workflows would just run their branches, whereas remote workflows (slurm, htcondor, etc.) would wrap them into jobs and submit them.


Side note: I'm currently writing a paper on law, which is why I'm closing some loose ends these days. I will eventually also finish the docs and add actual tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants