Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DB queries >2K per view #471

Open
2 tasks
Tracked by #465
jon-nfc opened this issue Jan 14, 2025 · 2 comments
Open
2 tasks
Tracked by #465

DB queries >2K per view #471

jon-nfc opened this issue Jan 14, 2025 · 2 comments
Assignees
@jon-nfc
Labels
task::refactor type::task Issue Type
Milestone
Next Release

Comments

@jon-nfc
Copy link
Member

jon-nfc commented Jan 14, 2025

As each view is run, authorization is conducted.

Details

Authorization is required, however when concurrent requests come in, the request time increases to beyond expectaations (>2s).

Screenshot from 2025-01-15 00-21-04

currently there are in excess of >2k database queries per view.

Tasks

  • Refactor DB queries to use prefetch_related as appropriate.

  • test amount of DB queries per view
    investigate if this can be tested
@jon-nfc jon-nfc added this to the Next Release milestone Jan 14, 2025
@jon-nfc jon-nfc moved this to Planning in Centurion ERP Jan 14, 2025
@jon-nfc jon-nfc self-assigned this Jan 16, 2025
@jon-nfc jon-nfc moved this from Planning to In progress in Centurion ERP Jan 16, 2025
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): prefetch team related fields
c40ecdd 
ref: #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): prefetch team related fields
a1f5f90 
ref: #471 #473
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings
0d692c7 
ref: #469 #471
@jon-nfc jon-nfc mentioned this issue Jan 16, 2025
Closed
2 tasks
@jon-nfc
Copy link
Member Author

jon-nfc commented Jan 16, 2025

Post changes:

Image

  • left graph: pre changes
  • Right graph: post changes

Test ran was 1vu, 100x requests per url for each URL in alphabetical order.

jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): prefetch team related fields
033ac30 
ref: #471 #473
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings
e4ecc07 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
test: Initial k6s individual page speed test cases
c1d9791 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
test: Initial k6s individual page speed test cases
c2ea176 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
test: Initial k6s individual page speed test cases
4314ec6 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): prefetch team related fields
5f5c911 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings during perm check
3cee11a 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings during model fetch
4e8bb88 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): prefetch team related fields
bd07c83 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
fix(access): cached orgs is an int list
fefde28 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings during perm check
7f16a06 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
refactor(access): cache app settings during model fetch
9d776e1 
ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
chore(access): Add trace output for tests that pass locally and fail …
1b34bd7 
…on GH actions

ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
chore(access): Add trace output for tests that pass locally and fail …
76daec3 
…on GH actions

ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
chore(access): Add trace output for tests that pass locally and fail …
cb5eab3 
…on GH actions

ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
chore(access): Add trace output for tests that pass locally and fail …
e3b275c 
…on GH actions

ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
chore(access): Add trace output for tests that pass locally and fail …
e7f7800 
…on GH actions

ref: #469 #471
jon-nfc added a commit that referenced this issue Jan 16, 2025
@jon-nfc
docs(access): add page_speed test to contributing
aa69163 
ref: #469 #471
@jon-nfc
Copy link
Member Author

jon-nfc commented Jan 16, 2025

Results

Deployed to staging to tet production config

Image

ALL requests < 600ms

Image

DB operations dropped significantly. <800

more improvements can and will be done in the future.

@jon-nfc jon-nfc mentioned this issue Jan 18, 2025
Closed
15 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jon-nfc jon-nfc

Labels
task::refactor type::task Issue Type
Projects
Centurion ERP
Status: In progress
Milestone
Next Release
Development

No branches or pull requests
1 participant
@jon-nfc