Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable unattented recovery from zero replicas #30

Merged
merged 7 commits into from
Jul 14, 2020
Merged

Enable unattented recovery from zero replicas #30

merged 7 commits into from
Jul 14, 2020

Commits on Apr 29, 2020

  1. Had a case now where a mariadb cluster failed to recover because 

    mariadb-0 crashlooped while there were no mariadb-1 or mariadb-2:
WSREP: gcs/src/gcs.cpp:gcs_open():1458: Failed to open channel 'my_wsrep_cluster' at 'gcomm://mariadb-0.mariadb,mariadb-1.mariadb,mariadb-2.mariadb': -110 (Connection timed out)
    @solsson
    solsson committed Apr 29, 2020
    Configuration menu
    Copy the full SHA
    9fff459 View commit details
    Browse the repository at this point in the history

  2. Supports any of the startup modes as "auto"

    @solsson
    solsson committed Apr 29, 2020
    Configuration menu
    Copy the full SHA
    c9f2585 View commit details
    Browse the repository at this point in the history

  3. The way we detect presence of peers actually require OrderedReady

    @solsson
    solsson committed Apr 29, 2020
    Configuration menu
    Copy the full SHA
    fabc7e8 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2020

  1. Fixes the most apparent flaw that triggers #31 split brain

    @solsson
    solsson committed Jun 4, 2020
    Configuration menu
    Copy the full SHA
    c3353a9 View commit details
    Browse the repository at this point in the history

  2. There's an outer if that guards against this condition

    @solsson
    solsson committed Jun 4, 2020
    Configuration menu
    Copy the full SHA
    4966a39 View commit details
    Browse the repository at this point in the history

  3. We sort of have our own OrderedReady now; allowing Init:CrashLoopBackOff 

    at fresh apply and scale from 0 directly to >1 we'll handle pod churn better now.
To reduce Init:Error events we could:
- Try to reduce time to readiness
- Add waits upon detection of missing peers, before exiting
- Retry within the script for pod indexes >0
    @solsson
    solsson committed Jun 4, 2020
    Configuration menu
    Copy the full SHA
    fedf5f0 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2020

  1. Mariadb 10.2.32

    @solsson
    solsson committed Jul 14, 2020
    Configuration menu
    Copy the full SHA
    128baa4 View commit details
    Browse the repository at this point in the history