v3.5.1.103 to prod #535
Merged
v3.5.1.103 to prod #535
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Updated reparse command to leverage backup/restore command
…3004-clean-and-reparse-cmd
- Added final backup check just in case - Added password to cmd shell context - Updated index naming convention and logging
…Django command. - Added continue message to repasrse command - lint
- Updated clearing logic on sorted cases to maintain state better for deletes - updated test
- moved all code into exception handling on the restore function - Added acceptable choices for quarter - Genericized exception handling - updated string formatting
…tech/TANF-app into 3004-clean-and-reparse-cmd
…tech/TANF-app into 3004-clean-and-reparse-cmd
…ks concurrently - using correct db name
- Added coverage test for header - fixed validator lambda func call
- Fixed minor logic error
* 3050 checking for None values * linting and cleaning * clean up test * 3059 refactored the logic * 3059 small clean up * linting
Update Indicator Message
Co-authored-by: andrew-jameson <[email protected]>
* 2960 Added taskfile for common tasks * 2960 additional commands * 2960 added linting for frontend * Fixes and improvement * 2960 remove frontend-pip lock * revised README file
* Adding action during deploy * Bad branch name, quick merge. (#3069) * - Initial commit for duplicate record manager for TANF section 1 records * - more efficient error generation * - Added a way to track precedence in the error messages to avoid generating less meaningful messages - Updated error generation * - Fix lint - Add docstrings * - Added support to delete deplicate records * - add support for bulk/raw delete * - Update deletes on rollbacks to raw delete since it wont hurt anything * - Updated elastic and django to support raw/bulk deleting * - Updating rollback test since it is very relevant now that we are doing raw deletes * - raise log level * - Update test * - remove import * - Update error generation to use record and schema - rename var * - Update error precedence logic * - fix lint * - use correct method * - remove extra call to bulk create errors * - move duplicate manager into case consistency validator - Starting to remove SortedRecordSchemaPairs from case consistency validator - updating to support in memory record removal if they havent been serialized * - update add_record logic to include rpt_month_year * - Move SortedRecordSchema pairs to util - Update case consistency validator to not use OG SortedRecordSchemaPairs - Update dup logic to not consider records on the same line * - remove unused import * - Update class to store records based on hash pending the section type * - Update parse to leverage new data structure * - clearing after bulk create * - Rename to be more accurate - Add method to generate bulk create dictionary - Stub function for removing cases * - Updated class name - basing off of doc instead of schema * - Adding infrastructure to remove records from memory or the DB pending their state * - fix logic issue * - fix logic error * - added back list of cases * - fixed test_add_record * - Fix all case consistency tests * - Fix most lint errors * - remove print * - update rollback logic - fix most parse tests * - Update duplicate error messages - Added logging - Updated tests * - functionized dup manager a bit - updated validator to query errors from dup manager - added test for s1 duplicate detection * - Add test for S1 partial duplicate detection * - fix lint * - Add section 2 tests * - Fix reference error * - order by id * - parametrizing batch size - initial integration tests * - move creation logic in parse.py - add container to monitor what cases have serialized records - add test for in memory and DB based record removal with dupes detected * - added section 2 duplicate tests * - Test for partial duplicates - test doesnt behave as I would expect * - fix lint * - Fixed logic error where last case in file wouldnt be removed if it has cat4 errors * - Update SortedRecords to leverage an unsorted container to make bulk createing faster. Dont have to iterate/generate the required structure * - naming and doc string updates * - renaming functions - removing unnecessary members * - update doc strings * - Add test for family affiliation negating partial duplicity * - Updated to support duplicate checking on section 3/4 * - fix lint * - Update docstring * - Update to allow all record types to have duplicate detection * - add duplicate detection unit tests for all program types and record types * - fix lint * - Add cases for ssp * - Move parser fixtures to their own conftest.py * - Move conftest.py to the test folder * - removing whitespace * - Remove 'test' from fixture names * - Fix failing tests due to merge * - Update message for failing test * - Remove Vars from compose file - Remove unnecessary checks from cat4 validator - Updated error counts after removing check * - fixed test * - linting * - move partial hash checking logic to schema/fields * - Move fixtures to conftest.py * - Fix failing tests * - fixed tests * Revert "- move partial hash checking logic to schema/fields" This reverts commit ab379ce. * - Better way to do partial hash checking - Still in schema * - Moved hash generation into schema - updated tests and factories to now support agnostic hash generation * - Updated error message - fixed incorrect indentation on error counting * - move fixtures to conftest * add radio button for jurisdiction type * - fix lint * - fixed tests from merge conflict * add tests * - Update error creation logging to track all errors - Updated queries to most correct syntax for aggregates function - Updated tests * - lint * - move fixture * - Updated aggregates query to take into account cat4 errors * - lint * - import as Query * - moved fixture to correct location * - Updated cat4 duplicate errors to include fields that are duplicated * - fix lint * - update tests * - update from merge conflict * - Add additional exclusion criteria for necessary tests - add missing fixture decorators * - renamed parameters and classes to make more sense with their duties. - Added much more detailed descriptions where information surrounding duplicate detection can be confused. * - implement TODOs that came out of OH * - remove todo - add warning labels to shared object * - fix lint * - adding some generic parsing flow docs * update error string * fix tests * - Added useful debug logging to partial hash functions * - Updated duplicate detection to allow "partial duplicates" of s3 and s4 files - Added tests for partial dup s3/s4 * - updated file status to be consistent with expectations * - Updated stt filter to display stt name instead of code to make it easier to filter * - Remove custom filter in favor of dependency - Update STTFilter to leverage dependency filter * - update doc string * - fix lint * - Updated case_consistency validator to track which case has been validated to identify which case might need to be removed - decoupled dup manager and case consistency val error counts - Added more descriptive logging * - Update tests * - Add edge case cat4 test - unblock util function that was causing errors * - Updated manager to correctly delete serialized records - Updated DFS to correctly count total records and total records created - Updated cat4 test case to be more extensive * - Updated test * - fix lint * - Add elastic specific exception handling * - add extra case to file for duplicate detection * - Added creation of LogEntry objects in exception blocks * - Updated fiscal year filter to not list `All` twice - Updated STT filter lookup options * - fix lint * - Add line number to duplicate error ParserError objects * - Remove dup test class - Updated to use correct error generator * - fix lint * - Updated based on review feedback * - Update tests * - fix lint * don't show jurisdiction type for acf users * Create sprint-99-summary.md (#3038) * Create sprint-99-summary.md * Update docs/Sprint-Review/sprint-99-summary.md Co-authored-by: Lauren Frohlich <[email protected]> --------- Co-authored-by: Lauren Frohlich <[email protected]> * Create sprint-100-summary.md (#3039) * Create sprint-100-summary.md * Update docs/Sprint-Review/sprint-100-summary.md Co-authored-by: Lauren Frohlich <[email protected]> * Update docs/Sprint-Review/sprint-100-summary.md Co-authored-by: Lauren Frohlich <[email protected]> * Update docs/Sprint-Review/sprint-100-summary.md Co-authored-by: Lauren Frohlich <[email protected]> --------- Co-authored-by: Lauren Frohlich <[email protected]> Co-authored-by: Andrew <[email protected]> * #3021 Adds FAQ update & release notes (#3040) * Adds FAQ update & release notes * Update product-updates/knowledge-center/index.html Co-authored-by: Alex P. <[email protected]> * Update index.html * Adds request access updates * Update product-updates/knowledge-center/index.html Co-authored-by: Alex P. <[email protected]> * Whitespace change to re-trigger full pipeline Whitespace change to re-trigger full pipeline --------- Co-authored-by: Alex P. <[email protected]> Co-authored-by: Andrew <[email protected]> * 2693 cat2 messaging cleanup (#2963) * clean option string util * add friendly name and item num to cat 2 * fix linting * fix a couple tests * add parens to friendly names * lint * fix tests * fix more tests * fix merge duplication * fix tests * lint * fix tets * udpate required validator * Merge branch 'develop' into 2693-cat2-messaging-cleanup * fix tests * fix test * fix tests * fix lint --------- Co-authored-by: Alex P <[email protected]> Co-authored-by: Eric Lipe <[email protected]> * 2687 Added email text for sendgrid (#3050) * 2687 Added email text for sendgrid * 2687 linting --------- Co-authored-by: Alex P <[email protected]> Co-authored-by: Andrew <[email protected]> * - Added missing territories * adding placeholder for action to table * Frontpage link * Update TDP-environments-README.md --------- Co-authored-by: Eric Lipe <[email protected]> Co-authored-by: Jan Timpe <[email protected]> Co-authored-by: jtimpe <[email protected]> Co-authored-by: Eric Lipe <[email protected]> Co-authored-by: Alex P <[email protected]> Co-authored-by: robgendron <[email protected]> Co-authored-by: Lauren Frohlich <[email protected]> Co-authored-by: Miles Reiter <[email protected]> Co-authored-by: raftmsohani <[email protected]> * swapping lines, readying for deploy * YAML spacing. * bypassing PR checks for faster turnaround * Pointing to blank revision, fixed to generic/latest * Dynamic filenames for testing differing environments. * moving badges out of table for sizing, hopefully * Newlines * appending git info to frontend base page * Feat/1620 merge pg upgrade (#3072) * - Upgraded local to postrgres 15.7 * - updating version on terraform * - disabling tests for now * - adding timeouts to TF for safety * - Deleting DB from TF state * - re-add DB * - remove deployment until DB is ready * - updated apt.yml to have pg15 client - updated deploy to only run apt commands * - re-enable deply dev * - UPdate client version - re-enable migrations * - really disable tests --------- Co-authored-by: Eric Lipe <[email protected]> Co-authored-by: andrew-jameson <[email protected]> * removing comment * undoing mass line comments * Update .circleci/build-and-test/workflows.yml * Apply suggestions from code review Co-authored-by: Alex P. <[email protected]> --------- Co-authored-by: andrew-jameson <[email protected]> Co-authored-by: Eric Lipe <[email protected]> Co-authored-by: Jan Timpe <[email protected]> Co-authored-by: jtimpe <[email protected]> Co-authored-by: Eric Lipe <[email protected]> Co-authored-by: Alex P <[email protected]> Co-authored-by: robgendron <[email protected]> Co-authored-by: Lauren Frohlich <[email protected]> Co-authored-by: Miles Reiter <[email protected]> Co-authored-by: raftmsohani <[email protected]>
* Update team-meetings.md * Update team-meetings.md * Update team-meetings.md --------- Co-authored-by: Miles Reiter <[email protected]>
Co-authored-by: Miles Reiter <[email protected]> Co-authored-by: Alex P. <[email protected]> Co-authored-by: Andrew <[email protected]>
* Create sprint-103-summary.md * Update docs/Sprint-Review/sprint-103-summary.md Co-authored-by: Alex P. <[email protected]> * whitespace to retrigger pipeline whitespace to retrigger pipeline --------- Co-authored-by: Alex P. <[email protected]> Co-authored-by: Andrew <[email protected]>
Release/v3.5.1 sprint 103
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary of Changes
Release notes: https://github.com/raft-tech/TANF-app/releases/tag/v3.5.1-Sprint-103
Features
Bug Fixes
DevOps
Documentation