Fix logging the number of generated samples for each leaf node

We were logging the length of our `generated_data` list instead of the number of newly generated samples in each leaf node, causing confusion as this is typically 1, 2, 3, etc instead of 50, 500, 1000, etc that users would expect. Fixes #227 Signed-off-by: Ben Browning <[email protected]>
instructlab · Dec 10, 2024 · 20808b5 · 20808b5
1 parent dcbabc5
commit 20808b5
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/src/instructlab/sdg/generate_data.py b/src/instructlab/sdg/generate_data.py
@@ -426,8 +426,8 @@ def generate_data(
             continue
         generated_data.append(new_generated_data)
 
-        logger.info("Generated %d samples", len(generated_data))
-        logger.debug("Generated data: %s", generated_data)
+        logger.info("Generated %d samples", len(new_generated_data))
+        logger.debug("Generated data: %s", new_generated_data)
 
         if is_knowledge:
             # generate mmlubench data for the current leaf node