You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/changelog/product-updates.mdx
+22-19Lines changed: 22 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,28 +7,29 @@ description: "New updates and improvements"
7
7
### New API and SDK
8
8
9
9
We've released the alpha of our new Scorecard SDKs, featuring streamlined API endpoints for creating, listing, and updating system configurations, as well as programmatic experiment execution. With this alpha, you can integrate scoring runs directly into your development and CI workflows, configure systems as code, and fully automate your evaluation pipeline without manual steps.
10
-
Our pre-release Python SDK is at version 2.0.0-alpha.0 and our Javascript SDK is at version 1.0.0-alpha.1.
10
+
Our pre-release Python SDK is at version 2.0.0-alpha.0 and our Javascript SDK is at version 1.0.0-alpha.1.
11
+
12
+

11
13
12
14
### New Quickstarts and Documentation
13
15
14
16
To support the SDK alpha, we've launched comprehensive SDK reference docs and concise quickstart guides that show you how to:
15
-
- Install and initialize the TypeScript or Python SDK.
16
-
- Create and manage system configurations in code.
17
-
- Run your first experiment programmatically.
18
-
- Retrieve and interpret run results within your applications.
19
-
- Follow these step-by-step walkthroughs to get your first experiment up and running in under five minutes.
20
-
21
-
### Bug fixes and improvements
22
17
23
-
-[Performance] Reduced page load times and improved responsiveness when handling large run results for the run history table.
24
-
-[UI] Removed metric-specific scoring progress, scoring and execution start and end times, and improved project names wrap across all screen sizes.
25
-
-[Testsets] Resolved bug with new CSV upload flow
26
-
-[Testsets] Added back Move testset to project
27
-
-[Testsets] Archived testsets are hidden correctly, keeping your workspace clutter‑free.
28
-
-[Reliability] Improved API reliability and workflow robustness: fixed run creation schema errors, streamlined testcase creation/duplication/deletion flows, and added inline schema validation to prevent submission errors
18
+
- Install and initialize the TypeScript or Python SDK.
19
+
- Create and manage system configurations in code.
20
+
- Run your first experiment programmatically.
21
+
- Retrieve and interpret run results within your applications.
22
+
- Follow these step-by-step walkthroughs to get your first experiment up and running in under five minutes.
23
+
24
+
### Bug fixes and improvements
25
+
-**[Performance]** Reduced page load times and improved responsiveness when handling large run results for the run history table.
26
+
-**[UI]** Removed metric-specific scoring progress, scoring and execution start and end times, and improved project names wrap across all screen sizes.
27
+
-**[Testsets]**Resolved bug with new CSV upload flow
28
+
-**[Testsets]**Added back Move testset to project
29
+
-**[Testsets]** Archived testsets are hidden correctly, keeping your workspace clutter‑free.
30
+
-**[Reliability]** Improved API reliability and workflow robustness: fixed run creation schema errors, streamlined testcase creation/duplication/deletion flows, and added inline schema validation to prevent submission errors
29
31
</Update>
30
32
31
-
32
33
<Updatelabel="April 18, 2025">
33
34
### Run insights
34
35
@@ -47,21 +48,23 @@ Our pre-release Python SDK is at version 2.0.0-alpha.0 and our Javascript SDK is
47
48
- Navigation has improved with linked testset titles and run/testcase summaries directly accessible from the cards.
48
49
49
50

50
-

51
51
52
+
53
+

52
54
53
55
### 🗂️ Improved schema management
54
56
55
-
Schemas are now defined and managed per testset, rather than at the project level—giving teams more flexibility and control.
57
+
Schemas are now defined and managed per testset, rather than at the project level—giving teams more flexibility and control.
56
58
57
59
- The schema editor has been redesigned, allowing teams to update schemas independently for each testset.
58
60
- Schema changes now reflect immediately in the testcase table to help users see their impact in real time.
59
61
- Users can view and copy raw schema JSON for integration with their own tools or SDKs.
60
62
- We’ve also improved messaging in the schema editor to clarify the distinction between inputs and labels.
61
63
62
64

63
-

64
65
66
+
67
+

65
68
66
69
### Bug fixes and improvements
67
70
@@ -165,4 +168,4 @@ Schemas are now defined and managed per testset, rather than at the project leve
165
168
- Modern, cleaner design
166
169
167
170
This change will help us better serve our users with clearer, more organized documentation.
0 commit comments