Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DiracFiles #181

Open
mesmith75 opened this issue Mar 20, 2019 · 2 comments
Open

DiracFiles #181

mesmith75 opened this issue Mar 20, 2019 · 2 comments

Comments

@mesmith75
Copy link
Contributor

For some reason new members are using LocalFile for their tuple outputs when running on the grid. The advice for many years has been to store job output on the grid.

This needs to be made clear in the starterkit.

@alexpearce
Copy link
Member

We do say in the More Ganga lesson:

To avoid filling up the filespace, it is wise to put the large files produced by your job somewhere with lots of storage - the grid.

But we do say in the "Storing large files on EOS" lesson

To retrieve a job outputfile, one can use two types of files:

  • LocalFile: the standard one with the output file directly downloaded to the gangadir.
  • DiracFile: the output file is stored directly on the grid and be accessed through the XRootD protocol.

We could add a caveat here (or in both places) to highlight that LocalFile is intended only for small (< 10 MB?) files.

@chrisburr
Copy link
Member

This lesson uses a LocalFile with the grid. I guess people might copy from there without realising.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants