This is the multi-page printable view of this section.
Click here to print.
Return to the regular view of this page.
Altinity Backup for ClickHouse
Altinity Backup for ClickHouse Release Notes
Most recent releases organized by major release and release date:
2022-07-28 Altinity Backup for ClickHouse 1.5.0
1 - Altinity Backup for ClickHouse 1.5.0
IMPROVEMENTS
- Try to improve implementation
check_replicas_before_attach
configuration to avoid concurrent ATTACH PART
execution during restore command on multi-shard cluster, fix 474
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.5.0
2 - Altinity Backup for ClickHouse 1.4.8
IMPROVEMENTS
- Add check_replicas_before_attach configuration to avoid concurrent ATTACH PART execution during restore command on multi-shard cluster, fix 474
allow backup list when clickhouse server offline, fix 476
BUG FIXES
- Resolve {uuid} macros during restore for ReplicatedMergeTree table and ClickHouse server 22.5+, fix 466
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.8
3 - Altinity Backup for ClickHouse 1.4.9
BUG FIXES
Fix download behavior for parts which contains special characters in name, fix 462
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.9
4 - Altinity Backup for ClickHouse 1.4.7
IMPROVEMENTS
- PROPERLY restore to default disk if disks not found on destination clickhouse server, fix 457
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.7
5 - Altinity Backup for ClickHouse 1.4.6
BUG FIXES
- Fix infinite loop error can’t acquire semaphore during Download: context canceled, and error can’t acquire semaphore during Upload: context canceled all 1.4.x users recommends upgrade to 1.4.6
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.6
6 - Altinity Backup for ClickHouse 1.4.5
IMPROVEMENTS
- Add
CLICKHOUSE_FREEZE_BY_PART_WHERE
option which allow freeze by part with WHERE condition, thanks @vahid-sohrabloo
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.5
7 - Altinity Backup for ClickHouse 1.4.3
IMPROVEMENTS
- Add API_INTEGRATION_TABLES_HOST option to allow use DNS name in integration tables system.backup_list, system.backup_actions
BUG FIXES
- Fix upload_by_part: false max file size calculation, fix 454
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.3
8 - Altinity Backup for ClickHouse 1.4.4
IMPROVEMENTS
- Download and restore to default disk if disks not found on destination clickhouse server, fix 457
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.4
9 - Altinity Backup for ClickHouse 1.4.2
BUG FIXES
- Fix
--partitions
parameter parsing, fix 425
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.2
10 - Altinity Backup for ClickHouse 1.4.1
BUG FIXES
- Fix upload data go routines waiting, expect the same upload speed as 1.3.2.
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.1
11 - Altinity Backup for ClickHouse 1.4.0
IMPROVEMENTS
- Add
S3_ALLOW_MULTIPART_DOWNLOAD
to config, to improve download speed, fix 431.
- Add support backup/restore user defined functions, fix 420.
- Add
clickhouse_backup_number_backups_remote
, clickhouse_backup_number_backups_local
, clickhouse_backup_number_backups_remote_expected
,clickhouse_backup_number_backups_local_expected
prometheus metric, fix 437.
- Add ability to apply system.macros values to path field in all types of remote_storage, fix 438.
- Use all disks for upload and download for mutli-disk volumes in parallel when
upload_by_part
: true fix 400.
BUG FIXES
- fix wrong warning for .gz, .bz2, .br archive extensions during download, fix 441.
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.0
12 - Altinity Backup for ClickHouse 1.3.2
IMPROVEMENTS
- Add TLS certificates and TLS CA support for clickhouse connections, fix 410.
- Switch to go 1.18.
- Add clickhouse version 22.3 to integration tests.
- Add
S3_MAX_PARTS_COUNT
and AZBLOB_MAX_PARTS_COUNT
for properly calculate buffer sizes during upload and download.
- Add multithreading GZIP implementation.
BUG FIXES
- fix 406, properly handle path for S3, GCS for case when it begins from “/”.
fix 409, avoid delete partially uploaded backups via backups_keep_remote option.
fix 422, avoid cache broken (partially uploaded) remote backup metadata.
fix 404, properly calculate S3_PART_SIZE
to avoid freeze after 10000 multi parts uploading, properly handle error when upload and download go-routine failed to avoid pipe stuck.
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.3.2
13 - Altinity Backup for ClickHouse 1.3.1
IMPROVEMENTS
- Fix 387, improve documentation related to memory and CPU usage
BUG FIXES
- fix 392, correct download for recursive sequence of diff backups when DOWNLOAD_BY_PART true
- fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don’t contain INFORMATION_SCHEMA pattern
- fix 388, improve restore ON CLUSTER for VIEW with TO clause
- fix 385, properly handle multiple incremental backup sequences + BACKUPS_TO_KEEP_REMOTE
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.3.1
14 - Altinity Backup for ClickHouse 1.2.3
HOT FIXES
- Fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don’t contain INFORMATION_SCHEMA pattern
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.2.3
15 - Altinity Backup for ClickHouse 1.3.0
Improvements
- Add API_ALLOW_PARALLEL to support multiple parallel execution calls for, WARNING, control command names don’t try to execute multiple same commands and be careful, it could allocate much memory during upload / download, fix #332
- Add support for –partitions on create, upload, download, restore CLI commands and API endpoint fix #378 properly implementation of #356
- Add implementation –diff-from-remote for upload command and properly handle required on download command, fix #289
- Add print-config cli command fix #366
- Add UPLOAD_BY_PART (default: true) option for improve upload/download concurrency fix #324
- Add ARM support for Docker images and pre-compiled binary files, fix #312
- KeepRemoteBackups should respect differential backups, fix #111
- Add SFTP_DEBUG option, fix #335
- Add ability to restore schema ON CLUSTER, fix #145
- Add support encrypted disk (include s3 encrypted disks), fix #260
- API Server optimization for speed of last_backup_size_remote metric calculation to make it async during REST API startup and after download/upload, fix #309
- Improve list remote speed via local metadata cache in $TEMP/.Altinity Backup for ClickHouse.$REMOTE_STORAGE, fix #318
- Add CLICKHOUSE_IGNORE_NOT_EXISTS_ERROR_DURING_FREEZE option, fix #319
- Add support for PROJECTION, fix #320
- Return clean cli command and API POST /backup/clean endpoint, fix #379
Bug Fixes
- fix #300, allow GCP properly work with empty GCP_PATH value
- fix #340, properly handle errors on S3 during Walk() and delete old backup
- fix #331, properly restore tables where have table name with the same name as database name
- fix #311, properly run Altinity Backup for ClickHouse inside docker container via entrypoint
- fix #317, properly upload large files to Azure Blob Storage
- fix #220, properly handle total_bytes for uint64 type
- fix #304, properly handle archive extension during download instead of use config settings
- fix #375, properly REMOTE_STORAGE=none error handle
- fix #379, will try to clean shadow if create fail during moveShadow
- more precise calculation backup size during upload, for backups created with –partitions, fix bug after #356
- fix restore –rm behavior for 20.12+ for tables which have dependent objects (like dictionary)
- fix concurrency by FTP creation directories during upload, reduce connection pool usage properly handle –schema parameter for show local backup size after download
- fix restore bug for WINDOW VIEW, thanks @zvonand
Experimental
- Try to add experimental support for backup MaterializedMySQL and MaterializedPostgeSQL tables, restore MySQL tables not impossible now without replace table_name.json to Engine=MergeTree, PostgreSQL not supported now, see ClickHouse/ClickHouse#32902
Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.3.0