Altinity Backup for ClickHouse™

Altinity Backup for ClickHouse™ Release Notes

Most recent releases organized by major release and release date:

  • 2022-06-08 Altinity Backup for ClickHouse™ 1.4.2
  • 2022-05-31 Altinity Backup for ClickHouse™ 1.4.1
  • 2022-05-25 Altinity Backup for ClickHouse™ 1.4.0
  • 2022-04-18 Altinity Backup for ClickHouse™ 1.3.2
  • 2022-02-17 Altinity Backup for ClickHouse™ 1.3.1
  • 2022-02-15 Altinity Backup for ClickHouse™ 1.2.3
  • 2022-02-08 Altinity Backup for ClickHouse™ 1.3.0

      Altinity Backup for ClickHouse™ 1.4.2

      Released: 2022-06-08

      BUG FIXES

      • fix –partitions parameter parsing, fix 425

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.2

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.4.1

      Released: 2022-05-31

      BUG FIXES

      • fix upload data go routines waiting, expect the same upload speed as 1.3.2.

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.1

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.4.0

      Released: 2022-05-25

      IMPROVEMENTS

      • add S3_ALLOW_MULTIPART_DOWNLOAD to config, to improve download speed, fix 431.
        add support backup/restore user defined functions, fix 420.
      • add clickhouse_backup_number_backups_remote, clickhouse_backup_number_backups_local, clickhouse_backup_number_backups_remote_expected,clickhouse_backup_number_backups_local_expected prometheus metric, fix 437.
      • add ability to apply system.macros values to path field in all types of remote_storage, fix 438.
      • use all disks for upload and download for mutli-disk volumes in parallel when upload_by_part: true fix 400.

      BUG FIXES

      • fix wrong warning for .gz, .bz2, .br archive extensions during download, fix 441.

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.4.0

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.3.2

      Released: 2022-04-18

      IMPROVEMENTS

      • add TLS certificates and TLS CA support for clickhouse connections, fix 410.
      • switch to go 1.18.
      • add clickhouse version 22.3 to integration tests.
      • add S3_MAX_PARTS_COUNT and AZBLOB_MAX_PARTS_COUNT for properly calculate buffer sizes during upload and download.
      • add multithreading GZIP implementation.

      BUG FIXES

      • fix 406, properly handle path for S3, GCS for case when it begins from “/”.
        fix 409, avoid delete partially uploaded backups via backups_keep_remote option.
        fix 422, avoid cache broken (partially uploaded) remote backup metadata.
        fix 404, properly calculate S3_PART_SIZE to avoid freeze after 10000 multi parts uploading, properly handle error when upload and download go-routine failed to avoid pipe stuck.

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/v1.3.2

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.3.1

      Released: 2022-02-17

      IMPROVEMENTS

      • fix 387, improve documentation related to memory and CPU usage

      BUG FIXES

      • fix 392, correct download for recursive sequence of diff backups when DOWNLOAD_BY_PART true
      • fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don’t contain INFORMATION_SCHEMA pattern
      • fix 388, improve restore ON CLUSTER for VIEW with TO clause
      • fix 385, properly handle multiple incremental backup sequences + BACKUPS_TO_KEEP_REMOTE

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.3.1

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.2.3

      Released: 2022-02-15

      HOT FIXES

      • fix 390, respect skip_tables patterns during restore and skip all INFORMATION_SCHEMA related tables even skip_tables don’t contain INFORMATION_SCHEMA pattern

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.2.3

       

      Return to the top.

      Altinity Backup for ClickHouse™ 1.3.0

      Released: 2022-02-08

      Improvements

      • Add API_ALLOW_PARALLEL to support multiple parallel execution calls for, WARNING, control command names don’t try to execute multiple same commands and be careful, it could allocate much memory during upload / download, fix #332
      • Add support for –partitions on create, upload, download, restore CLI commands and API endpoint fix #378 properly implementation of #356
      • Add implementation –diff-from-remote for upload command and properly handle required on download command, fix #289
      • Add print-config cli command fix #366
      • Add UPLOAD_BY_PART (default: true) option for improve upload/download concurrency fix #324
      • Add ARM support for Docker images and pre-compiled binary files, fix #312
      • KeepRemoteBackups should respect differential backups, fix #111
      • Add SFTP_DEBUG option, fix #335
      • Add ability to restore schema ON CLUSTER, fix #145
      • Add support encrypted disk (include s3 encrypted disks), fix #260
      • API Server optimization for speed of last_backup_size_remote metric calculation to make it async during REST API startup and after download/upload, fix #309
      • Improve list remote speed via local metadata cache in $TEMP/.Altinity Backup for ClickHouse.$REMOTE_STORAGE, fix #318
      • Add CLICKHOUSE_IGNORE_NOT_EXISTS_ERROR_DURING_FREEZE option, fix #319
      • Add support for PROJECTION, fix #320
      • Return clean cli command and API POST /backup/clean endpoint, fix #379

      Bug Fixes

      • fix #300, allow GCP properly work with empty GCP_PATH value
      • fix #340, properly handle errors on S3 during Walk() and delete old backup
      • fix #331, properly restore tables where have table name with the same name as database name
      • fix #311, properly run Altinity Backup for ClickHouse inside docker container via entrypoint
      • fix #317, properly upload large files to Azure Blob Storage
      • fix #220, properly handle total_bytes for uint64 type
      • fix #304, properly handle archive extension during download instead of use config settings
      • fix #375, properly REMOTE_STORAGE=none error handle
      • fix #379, will try to clean shadow if create fail during moveShadow
      • more precise calculation backup size during upload, for backups created with –partitions, fix bug after #356
      • fix restore –rm behavior for 20.12+ for tables which have dependent objects (like dictionary)
      • fix concurrency by FTP creation directories during upload, reduce connection pool usage properly handle –schema parameter for show local backup size after download
      • fix restore bug for WINDOW VIEW, thanks @zvonand

      Experimental

      • Try to add experimental support for backup MaterializedMySQL and MaterializedPostgeSQL tables, restore MySQL tables not impossible now without replace table_name.json to Engine=MergeTree, PostgreSQL not supported now, see ClickHouse/ClickHouse#32902

      Download at: https://github.com/Altinity/clickhouse-backup/releases/tag/1.3.0

       

      Return to the top.
    Last modified 2022.06.08