Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fdbbackup segfaults on v7.1.63 (works on v7.1.61) #11615

Open
funkypenguin opened this issue Aug 28, 2024 · 1 comment
Open

fdbbackup segfaults on v7.1.63 (works on v7.1.61) #11615

funkypenguin opened this issue Aug 28, 2024 · 1 comment

Comments

@funkypenguin
Copy link

Hey all,

Since upgrading to v7.1.63, our backups have been failing, like this:

bash-4.2$ /usr/bin/fdbbackup abort -t hourly-${HOUR_OF_DAY} -C /etc/foundationdb/fdb.cluster --knob_http_request_aws_v4_header=false
SIGNAL: Segmentation fault (11)
Trace: addr2line -e fdbbackup.debug -p -C -f -i 0x7f46c7a24630 0xb66891 0x6152b0 0x5f8706 0x7f46c7669555
Segmentation fault (core dumped)
bash-4.2$ fdbbackup --version
FoundationDB 7.1 (v7.1.63)
source version 1accd8c90b87c4d193b269a9d71434cf9865f04d
protocol fdb00b071010000
bash-4.2$

However, on v7.1.61:

bash-4.2$ /usr/bin/fdbbackup abort -t hourly-${HOUR_OF_DAY} -C /etc/foundationdb/fdb.cluster --knob_http_request_aws_v4_header=false
ERROR: A backup was not running on tag `hourly-'
Fatal Error: Backup unneeded request
bash-4.2$ fdbbackup --version
FoundationDB 7.1 (v7.1.61)
source version 262c6fe778ad229cbb58bfcd6d337bb0b4227622
protocol fdb00b071010000
bash-4.2$

Could this be a new failure introduced in v7.1.63?

Can I safely downgrade my production cluster from v7.1.63 to v7.1.61, until this is resolved?

Thanks!
D

@jzhou77
Copy link
Contributor

jzhou77 commented Aug 28, 2024

Yes, this is a regression in 7.1.63 and we have a fix #11591.

You can safely downgrade to 7.1.61. And since the bug is in fdbbackup, not in fdbserver, so replacing the fdbbackup (and other binary with different names such as backup_agent, dr_agent) with the 7.1.61 version should solve the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants