Halumem bugfix #75
Merged
Halumem bugfix #75
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ation - Integrated tqdm library for progress tracking - Added progress bar display for user sessions processing - Implemented session-by-session progress updates with custom description - Maintained existing session processing logic while adding visual feedback - Preserved all original functionality including logging and data handling
…ocessing - Increased max_rps from 9 to 20 in default config - Removed tqdm progress bar for session processing - Implemented asyncio semaphore for session concurrency control - Added parallel processing of sessions within each user - Updated logging to show session count per user - Changed user processing from concurrent to sequential - Added completion tracking with progress indicators - Modified output formatting for better readability
- Lowered max_rps from 20 to 2 to prevent rate limiting issues - Reduced rps_window from 10 to 1 for stricter request throttling - Updated default configuration values for better performance stability
…oncurrency control - Add new analyze_dataset_stats.py script for comprehensive HaluMem dataset analysis - Include statistics for user sessions, dialogues, content lengths and chunk distributions - Replace rate limiting with concurrency control in BaseLLM using semaphore mechanism - Update configuration to use max_concurrency instead of max_rps and rps_window - Modify dialogue formatting to include only user messages in evaluation - Add percentile calculations and detailed content size distribution metrics - Implement session splitting logic based on character length thresholds - Provide per-user statistics and summary tables for dataset analysis - Refactor BaseLLM to use internal _chat_impl and _stream_chat_impl methods - Remove rate limiting locks and timestamps from LLM initialization - Add command-line interface for dataset statistics analysis tool
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.