Skip to content

Commit

Permalink
Add NeoLoad integration (DataDog#1587)
Browse files Browse the repository at this point in the history 
* Add NeoLoad integration

* Update neoload/README.md

Co-authored-by: Bryce Eadie <[email protected]>

* NeoLoad Integration should be installed manually

Change-Id: I01a07bc38ded25dfd18df3fa98e233702af383fd

* Update neoload/README.md

Co-authored-by: emarsha94 <[email protected]>

* Apply suggestions from code review

Co-authored-by: bgoldberg122 <[email protected]>

* Use latest version of documentation

Change-Id: If0c4cbe43f98da12d90fe1ff1ec6bf8858c18a97

* Update neoload/CHANGELOG.md

Co-authored-by: emarsha94 <[email protected]>

Co-authored-by: Bryce Eadie <[email protected]>
Co-authored-by: emarsha94 <[email protected]>
Co-authored-by: bgoldberg122 <[email protected]>
  • Loading branch information
@guillaumebert @buraizu
@emarsha94 @bgoldberg122
4 people authored Dec 12, 2022
1 parent e52b324 commit 5baebf9
Show file tree
Hide file tree
Showing 9 changed files with 445 additions and 0 deletions.
4 changes: 4 additions & 0 deletions .github/CODEOWNERS
View file
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -81,6 +81,7 @@
/logzio/ @DataDog/agent-integrations
/n2ws/ @eliadeini [email protected]
/neo4j/ @davidfauth [email protected]
/neoload/ @Neotys-Labs/r-d
/neutrona/ @DavidFlamini [email protected]
/nextcloud/ @eplanet
/nn_sdwan/ @nikhilguptanetnologyio @habibmadaninetnologyio
Expand Down Expand Up @@ -331,6 +332,9 @@
/neo4j/*metadata.csv @davidfauth [email protected] @DataDog/documentation
/neo4j/manifest.json @davidfauth [email protected] @DataDog/documentation
/neo4j/README.md @davidfauth [email protected] @DataDog/documentation
/neoload/*metadata.csv @Neotys-Labs/r-d @DataDog/documentation
/neoload/manifest.json @Neotys-Labs/r-d @DataDog/documentation
/neoload/README.md @Neotys-Labs/r-d @DataDog/documentation
/neutrona/*metadata.csv @DavidFlamini [email protected] @DataDog/documentation
/neutrona/manifest.json @DavidFlamini [email protected] @DataDog/documentation
/neutrona/README.md @DavidFlamini [email protected] @DataDog/documentation
Expand Down
5 changes: 5 additions & 0 deletions neoload/CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# CHANGELOG - NeoLoad Integration

## 1.0.0 / 2022-12-13

* [Added] Initial NeoLoad Integration Tile
43 changes: 43 additions & 0 deletions neoload/README.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
# NeoLoad integration

## Overview

[Tricentis NeoLoad][1] simplifies and scales performance testing for APIs and microservices, as well as end-to-end application testing through protocol and browser-based capabilities.

With the NeoLoad integration, you can track NeoLoad test performance metrics to:

- Correlate application performance with load testing metrics in NeoLoad.
- Analyze and visualize NeoLoad metrics in Datadog like throughput, errors, and performance using the out-of-the-box dashboard or [Metrics Explorer][7].

## Setup

### Configuration

For detailed instructions on NeoLoad configuration, follow the [NeoLoad documentation][2]. Since NeoLoad version 9.1, you can choose which metrics to send in the **Push Counters** configuration of the Datadog Connector in NeoLoad.

Install the NeoLoad integration in Datadog to add the default NeoLoad dashboard to your dashboard list.


## Data Collected

### Metrics

See [metadata.csv][3] for a list of metrics provided by this integration.

### Events

All NeoLoad performance tests events are sent to your [Datadog Events Explorer][4].
NeoLoad sends events to the Datadog API when a performance test starts and ends.
Set the option in the **Push Counters** configuration of the Datadog Connector in NeoLoad. Available since NeoLoad 9.1.

## Troubleshooting

Need help? Contact [Datadog support][5] or [Tricentis NeoLoad support][6].

[1]: https://www.tricentis.com/products/performance-testing-neoload
[2]: https://documentation.tricentis.com/neoload/latest/en/content/reference_guide/datadog.htm
[3]: https://github.com/DataDog/integrations-extras/blob/master/neoload/metadata.csv
[4]: https://docs.datadoghq.com/events/
[5]: https://docs.datadoghq.com/help/
[6]: https://support-hub.tricentis.com/
[7]: /metric/explorer
304 changes: 304 additions & 0 deletions neoload/assets/dashboards/neoload_overview.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,304 @@
{
"title": "NeoLoad",
"description": "NeoLoad dashboard for analyzing performance tests",
"widgets": [{
"id": 7213586869898414,
"definition": {
"type": "image",
"url": "https://be.tricentis.com/media-assets/2022/07/PL-NeoLoad-1.png",
"url_dark_theme": "https://be-test.tricentis.com/media-assets/2022/10/[email protected]",
"sizing": "none",
"margin": "sm",
"has_background": false,
"has_border": false,
"vertical_align": "center",
"horizontal_align": "left"
},
"layout": {
"x": 0,
"y": 0,
"width": 4,
"height": 2
}
}, {
"id": 793579956743484,
"definition": {
"title": "NeoLoad Virtual Users ",
"title_size": "16",
"title_align": "left",
"show_legend": true,
"legend_layout": "auto",
"legend_columns": ["avg", "min", "max", "value", "sum"],
"type": "timeseries",
"requests": [{
"formulas": [{
"alias": "NeoLoad user load",
"style": {
"palette_index": 1,
"palette": "classic"
},
"formula": "query1"
}
],
"response_format": "timeseries",
"queries": [{
"query": "sum:NeoLoad.Controller.User.Load{$test-result-name,$test-result-id,$test-id,$test-name}",
"data_source": "metrics",
"name": "query1"
}
],
"style": {
"palette": "dog_classic",
"line_type": "solid",
"line_width": "normal"
},
"display_type": "bars"
}
],
"events": [{
"q": "source:my_apps"
}
],
"custom_links": [{
"override_label": "events",
"is_hidden": false
}
]
},
"layout": {
"x": 4,
"y": 0,
"width": 6,
"height": 2
}
}, {
"id": 7101843706787120,
"definition": {
"title": "Performance Engineering Events",
"title_size": "16",
"title_align": "left",
"type": "event_timeline",
"query": "$test-result-name $test-result-id $test-name $test-id",
"tags_execution": "and"
},
"layout": {
"x": 0,
"y": 2,
"width": 4,
"height": 2
}
}, {
"id": 7686753511996862,
"definition": {
"title": "NeoLoad req/s",
"title_size": "16",
"title_align": "left",
"show_legend": true,
"legend_layout": "auto",
"legend_columns": ["avg", "min", "max", "value", "sum"],
"type": "timeseries",
"requests": [{
"formulas": [{
"formula": "query2",
"style": {
"palette_index": 4,
"palette": "green"
}
}
],
"response_format": "timeseries",
"queries": [{
"query": "avg:NeoLoad.Request.PerSecond{$test-result-name,$test-result-id,$test-id,$test-name}",
"data_source": "metrics",
"name": "query2"
}
],
"style": {
"palette": "dog_classic",
"line_type": "solid",
"line_width": "normal"
},
"display_type": "bars"
}
]
},
"layout": {
"x": 4,
"y": 2,
"width": 3,
"height": 3
}
}, {
"id": 3881498452398372,
"definition": {
"title": "NeoLoad requests errors",
"title_size": "16",
"title_align": "left",
"show_legend": true,
"legend_layout": "auto",
"legend_columns": ["avg", "min", "max", "value", "sum"],
"type": "timeseries",
"requests": [{
"formulas": [{
"formula": "query1",
"style": {
"palette_index": 5,
"palette": "warm"
}
}
],
"response_format": "timeseries",
"queries": [{
"query": "sum:NeoLoad.Request.Errors{$test-result-name,$test-result-id,$test-id,$test-name}",
"data_source": "metrics",
"name": "query1"
}
],
"style": {
"palette": "dog_classic",
"line_type": "solid",
"line_width": "normal"
},
"display_type": "bars"
}
],
"custom_links": [{
"override_label": "events",
"is_hidden": false
}
]
},
"layout": {
"x": 7,
"y": 2,
"width": 3,
"height": 3
}
}, {
"id": 7759398302419378,
"definition": {
"title": "Performance Engineering Events",
"title_size": "16",
"title_align": "left",
"type": "event_stream",
"query": "$test-result-name $test-result-id $test-name $test-id",
"event_size": "l"
},
"layout": {
"x": 0,
"y": 4,
"width": 4,
"height": 5
}
}, {
"id": 8389637738594750,
"definition": {
"title": "NeoLoad Transactions/s",
"title_size": "16",
"title_align": "left",
"show_legend": true,
"legend_layout": "auto",
"legend_columns": ["avg", "min", "max", "value", "sum"],
"type": "timeseries",
"requests": [{
"formulas": [{
"formula": "query1",
"style": {
"palette_index": 8,
"palette": "dd20"
}
}
],
"response_format": "timeseries",
"queries": [{
"query": "avg:NeoLoad.Transaction.PerSecond{$test-result-name,$test-result-id,$test-id,$test-name}",
"data_source": "metrics",
"name": "query1"
}
],
"style": {
"palette": "dog_classic",
"line_type": "solid",
"line_width": "normal"
},
"display_type": "bars"
}
]
},
"layout": {
"x": 4,
"y": 5,
"width": 3,
"height": 3
}
}, {
"id": 5712085288055526,
"definition": {
"title": "NeoLoad network throughput",
"title_size": "16",
"title_align": "left",
"show_legend": true,
"legend_layout": "auto",
"legend_columns": ["avg", "min", "max", "value", "sum"],
"type": "timeseries",
"requests": [{
"formulas": [{
"formula": "query2",
"style": {
"palette_index": 4,
"palette": "cool"
}
}
],
"response_format": "timeseries",
"queries": [{
"query": "sum:NeoLoad.Controller.Throughput{$test-result-name,$test-result-id,$test-id,$test-name}",
"data_source": "metrics",
"name": "query2"
}
],
"style": {
"palette": "dog_classic",
"line_type": "solid",
"line_width": "normal"
},
"display_type": "bars"
}
]
},
"layout": {
"x": 7,
"y": 5,
"width": 3,
"height": 3
}
}
],
"template_variables": [{
"name": "test-result-name",
"prefix": "test-result-name",
"available_values": [],
"default": "*"
}, {
"name": "test-result-id",
"prefix": "test-result-id",
"available_values": [],
"default": "*"
}, {
"name": "test-name",
"prefix": "test-name",
"available_values": [],
"default": "*"
}, {
"name": "test-id",
"prefix": "test-id",
"available_values": [],
"default": "*"
}
],
"layout_type": "ordered",
"is_read_only": false,
"notify_list": [],
"reflow_type": "fixed",
"id": "wez-hb9-wqn"
}
Loading

0 comments on commit 5baebf9

Please sign in to comment.