Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC-456] Added a note for preventing backup failure on cloud VM restart. #23845

Merged
merged 8 commits into from
Oct 29, 2024

Conversation

aishwarya24
Copy link
Collaborator

@netlify /preview/yugabyte-platform/manage-deployments/remove-nodes/

@aishwarya24 aishwarya24 added the area/documentation Documentation needed label Sep 9, 2024
@aishwarya24 aishwarya24 self-assigned this Sep 9, 2024
Copy link

netlify bot commented Sep 9, 2024

Deploy Preview for infallible-bardeen-164bc9 ready!

Name Link
🔨 Latest commit 735613d
🔍 Latest deploy log https://app.netlify.com/sites/infallible-bardeen-164bc9/deploys/6721438e31d81e00081b67e8
😎 Deploy Preview https://deploy-preview-23845--infallible-bardeen-164bc9.netlify.app/preview/yugabyte-platform/manage-deployments/remove-nodes/
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@@ -94,6 +94,12 @@ In general, you shouldn't stop more than one node at a time. For example, two st

You can restart the node's processes by navigating to **Universes**, selecting your universe, then selecting **Nodes**, and then clicking **Actions > Start Processes** corresponding to the node. This returns the node to the Live state.

{{< warning title="Prevent back up failure due to NFS unmount on cloud VM restart" >}}
When a cloud VM is restarted, the NFS mount may get unmounted if its entry is not present in `/etc/fstab`. This configuration oversight can lead to back up failures, causing errors during [backup](../../back-up-restore-universes/back-up-universe-data/) or [restoration](../../back-up-restore-universes/restore-universe-data/) processes.
Copy link
Contributor

@ddhodge ddhodge Sep 12, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
When a cloud VM is restarted, the NFS mount may get unmounted if its entry is not present in `/etc/fstab`. This configuration oversight can lead to back up failures, causing errors during [backup](../../back-up-restore-universes/back-up-universe-data/) or [restoration](../../back-up-restore-universes/restore-universe-data/) processes.
To avoid potential backup and restore errors, make sure the NFS mount is added to `/etc/fstab`. When a cloud VM is restarted, the NFS mount may get unmounted if its entry is not in `/etc/fstab`. This can lead to backup failures, and errors during [backup](../../back-up-restore-universes/back-up-universe-data/) or [restore](../../back-up-restore-universes/restore-universe-data/).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NFS config page doesn't say anything about this
https://docs.yugabyte.com/preview/yugabyte-platform/back-up-restore-universes/configure-backup-storage/#network-file-system
When creating NFS storage config, is this entry supposed to be added automatically? And if so why would it disappear?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NFS volumes are mounted on all the VMs. This mount could go away if the VM is restarted unless the mount is added to /etc/fstab. This should be done in order to make the volume auto-remount when the VM is restarted.

For Dwight's question: is this entry supposed to be added automatically ?
No, this is something that the user has to take care of on all the VMs.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kv83821-yb In YBA, I add NFS backup config via the UI as described in my link. At this point, I'm expected to tunnel to each node and manually add the mount to /etc/fstab/? This seems impractical.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kv83821-yb I see adding to fstab is included in manual provisioning
https://docs.yugabyte.com/preview/yugabyte-platform/prepare/server-nodes-software/software-on-prem-manual/#pre-provision-nodes-manually
But should we mention it when creating NFS backup config

@ddhodge ddhodge merged commit 52181a1 into yugabyte:master Oct 29, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/documentation Documentation needed
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants