-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
53 changed files
with
173 additions
and
57 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -4,7 +4,7 @@ | |
| <meta charset="utf-8"> | ||
| <meta name="viewport" content="width=device-width,initial-scale=1"> | ||
| <title>Documentation for Researchers :: DDM Documentation</title> | ||
| <meta name="generator" content="Antora 3.1.8"> | ||
| <meta name="generator" content="Antora 3.1.9"> | ||
| <link rel="stylesheet" href="../../_/css/site.css"> | ||
| <script>var uiRootPath = '../../_'</script> | ||
| <link rel="icon" href="../../_/img/ddl_favicon_black.svg" type="image/x-icon"> | ||
|
|
@@ -680,11 +680,97 @@ <h5 id="_extraction_rules"><a class="anchor" href="#_extraction_rules"></a>Extra | |
| </dd> | ||
| <dt class="hdlist1">Extraction Operator</dt> | ||
| <dd> | ||
| <p>Defines the main logic of the extraction step. If empty, this indicates | ||
| that you want to keep the field in the donated data. For all non-regex operations, | ||
| if an operations evaluates to True, the row will be deleted from the donated data | ||
| (further explanations on the separate rules will follow).</p> | ||
| <p>Defines the main logic of the extraction step.</p> | ||
| </dd> | ||
| </dl> | ||
| </div> | ||
| <div class="exampleblock"> | ||
| <div class="content"> | ||
| <div class="paragraph"> | ||
| <p><strong>Overview of available extraction operators</strong></p> | ||
| </div> | ||
| <table class="tableblock frame-all grid-all stretch"> | ||
| <colgroup> | ||
| <col style="width: 33.3333%;"> | ||
| <col style="width: 33.3333%;"> | ||
| <col style="width: 33.3334%;"> | ||
| </colgroup> | ||
| <thead> | ||
| <tr> | ||
| <th class="tableblock halign-left valign-top">Extraction Operator</th> | ||
| <th class="tableblock halign-left valign-top">Description</th> | ||
| <th class="tableblock halign-left valign-top">Note</th> | ||
| </tr> | ||
| </thead> | ||
| <tbody> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Keep Field</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Keep this field in the uploaded data.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">–</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Equal (==)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> equals the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for strings, integers, and dates<sup>1</sup>.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Not Equal (!=)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> does not equal the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for strings, integers, and dates<sup>1</sup>.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Greater than (>)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> is greater than the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for integers and dates<sup>1</sup>. String values are skipped and the row will be kept in the data.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Smaller than (<)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> is smaller than the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for integers and dates<sup>1</sup>. String values are skipped and the row will be kept in the data.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Greater than or equal (>=)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> is greater than or equal to the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for integers and dates<sup>1</sup>. String values are skipped and the row will be kept in the data.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Smaller than or equal (⇐)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> is smaller than or equal to the <code>comparison value</code>.</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Works for integers and dates<sup>1</sup>. String values are skipped and the row will be kept in the data.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete match (regex)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete parts of the value contained in the given <code>field</code> that match the given <code>regular expression (regex)</code> | ||
| (e.g., if the <code>regular expression (regex)</code> = "^Watched " and a field contains the value "Watched video XY" the following | ||
| value will be kept in the uploaded data: "video XY").</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">All field values are converted to strings before this operation is applied.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Replace match (regex)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Replace parts of the value contained in the given <code>field</code> that match the given <code>regular expression (regex)</code> | ||
| (e.g., if the <code>regular expression (regex)</code> = "<span class="\w-\.">@([\w-]</span>\.)+[\w-]{2,4}" and | ||
| the <code>replacement value</code> = "<em>anonymized</em>" and a field contains the value "some text <a href="mailto:[email protected]">[email protected]</a>" the following | ||
| value will be kept in the uploaded data: "some text <em>anonymized</em>").</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">All field values are converted to strings before this operation is applied.</p></td> | ||
| </tr> | ||
| <tr> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row when match (regex)</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">Delete row/entry if the value contained in the given <code>field</code> matches the given <code>regular expression (regex)</code> (e.g., if | ||
| <code>regular expression (regex)</code> = "^Watched " and a field contains the value "Watched video XY" | ||
| the row/entry will be deleted from the uploaded data).</p></td> | ||
| <td class="tableblock halign-left valign-top"><p class="tableblock">All field values are converted to strings before this operation is applied.</p></td> | ||
| </tr> | ||
| </tbody> | ||
| </table> | ||
| <div class="paragraph"> | ||
| <p><span class="small"><sup>1</sup>Dates are inferred from string values if they are formatted according to ISO, RFC2822, or HTTP standards, | ||
| and only if both the field value and the comparison value follow the same format. | ||
| Otherwise, the entry will be treated as a regular string.</span></p> | ||
| </div> | ||
| </div> | ||
| </div> | ||
| <div class="dlist"> | ||
| <dl> | ||
| <dt class="hdlist1">Comparison Value</dt> | ||
| <dd> | ||
| <p>The value against which the data contained in the indicated field will be compared according to the selected comparison logic.</p> | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.