Skip to content

Commit

Permalink
creators/Workflow_Parameterization_for_HPC - added warning about the …
Browse files Browse the repository at this point in the history
…file system plugin for the time being
  • Loading branch information
cmeesters committed Feb 8, 2024
1 parent 7630d79 commit 6fbe27b
Showing 1 changed file with 13 additions and 12 deletions.
25 changes: 13 additions & 12 deletions slides/creators/Workflow_Parameterization_for_HPC.tex
Original file line number Diff line number Diff line change
Expand Up @@ -144,24 +144,25 @@ \subsection{Global Workflow Configuration}
local-storage-prefix: /localscratch/$SLURM_JOB_ID
\end{lstlisting}
\end{onlyenv}
%TODO remove this part, once the snakemake release is ready

\begin{onlyenv}<5| handout:0>
\begin{hint}{Note:}
The current \Snakemake{} development will bring a feature to annotate files for their I/O pattern, such that only specific files will undergo the stage-in/-out process.
\end{hint}
\end{onlyenv}
\begin{onlyenv}<6| handout:1>
You may copy this setup from \texttt{\configparam{pathtosetup}/config.yaml} to the \altverb{\~/.config/snakemake}-folder - unless your local admins provide a cluster-wide configuration.
%TODO remove this part, once the snakemake release is ready
\begin{warning}
Currently, we are working on way to annotate susceptible I/O pattern, the highlighted parts are not yet functional.
\end{warning}
%You may copy this setup from \texttt{\configparam{pathtosetup}/config.yaml} to the \altverb{\~/.config/snakemake}-folder - unless your local admins provide a cluster-wide configuration.
\begin{lstlisting}[language=Bash, style=Shell]
__use_yte__: true
executor: slurm
latency-wait: 60
default-storage-provider: fs
shared-fs-usage:
- persistence
- sources
- source-cache
local-storage-prefix: /localscratch/$SLURM_JOB_ID
@latency-wait: 60@
@default-storage-provider: fs@
@shared-fs-usage:@
@ - persistence@
@ - sources@
@ - source-cache@
@local-storage-prefix: /localscratch/$SLURM_JOB_ID@
\end{lstlisting}
\end{onlyenv}
\end{frame}

0 comments on commit 6fbe27b

Please sign in to comment.