ScyllaDB Enterprise 2021.1.7

The ScyllaDB team announces ScyllaDB Enterprise 2021.1.7, a bug-fix production-ready ScyllaDB Enterprise patch release for ScyllaDB Enterprise 2021.1. ScyllaDB Enterprise customers are encouraged to upgrade to ScyllaDB Enterprise 2021.1.7 in coordination with the ScyllaDB support team.

ScyllaDB Enterprise 2021.1.7 brings focus on bug fixes, stabilization and tooling improvement. More below.

Tools Update

Scrub is a nodetool command and a REST API for deserialization and reserializion of sstables to the latest version, resolving corruptions if any) the given keyspace.  Scrub has the following modes:

  • ABORT (default) – abort scrub if corruption is detected;
  • SKIP (same as `skip_corrupted=true`) skip over corrupt data, omitting them from the output;
  • SEGREGATE – segregate data into multiple sstables if needed, such that each sstable contains data with valid order;
  • VALIDATE – read (no rewrite) and validate data, logging any problems found. #7736

The following bugs are fixed in scrub operation:

  • Scrub compaction: segregate mode: unbounded number of buckets can cause OOM #9400
  • Scrub always segregates, regardless of mode #9541
  • Scrub compaction filters out sstables that are being compacted #9256
  • Better handling of non-UTF-8 strings of corrupt partition keys to the log
  • Don’t purge tombstones in scrub

Active Client Table

System.clients is a CQL table that provides real-time information on CQL clients connected to the ScyllaDB cluster.

In this release, the following columns are added to the clients table:

  • connection_stage
  • driver_name
  • driver_version
  • protocol_version

It also improves:

  • client_type – distinguishes CQL from thrift just in case
  • username – now it displays the correct username if `PasswordAuthenticator` is configured.

Nodetool Stop

Reshard and reshape start automatically on boot or refresh, if needed. This release supports the new “nodetool stop RESHAPE” command

nodetool stop now supports the following compaction types: COMPACTION, CLEANUP, SCRUB, UPGRADE and RESHAPE For example: nodetool stop SCRUB.

Related Links

A list of stability improvements and bug fixes below, each with open source reference, is available:

  • Encryption at rest: Handle key lines without block/padding info when using local_file_provider
  • Encryption at rest: KMIP key creation needs to verify/set same defaults as actual (openssl) keys
  • CQL: idx_token of global secondary indexes is sorted incorrectly #7443
  • Stability: Single-element tuple restriction causes a crash when mixed with non-tuple #7710
  • CQL: min/max aggregate functions are broken for timeuuid #7729
  • Stability: During bootstrap, decommission, compaction, and reshape ScyllaDB will separate data belonging to different windows (in Time Window Compaction Strategy) into different sstables (to preserve the compaction strategy invariant). However, it did not do so for memtable flush, requiring a reshape if the node was restarted. It will now flush a single memtable into multiple sstables, if needed. #4617
  • Stability: Failed SELECT with tuple of reversed-ordered frozen collections #7902
    Stability: using escaped curly braces in format strings cause logger error #8436
    Stability: badly formatted log in a case of bootstrap with repair #8503
    Stability: rapidjson’s, used for JSON parsing, default allocator does not handle allocation failures properly #8521
    Stability: exception phased_barrier::advance_and_await is not handled #8636
    Stability: Segmentation fault when applying mutation in truncate_base_during_mv_insert_test_without_auto_snapshot #8749
    Stability: bytes_ostream::write stalls 55ms #8897
    Stability: Long stalls when destroying repair_meta #8926
    Performance: Querier cache is not used when paging on coordinator side #9127
    Stability: heap-use-after-free in date_tiered_manifest::get_now #9138
    Stability: scylla aborts when resharding is stopped due to shutdown #9158
    Stability: Possible race condition between table stopping and compaction #9448
    UX: large data warnings do not contains the sstable name #9524
    EC2 Cloud Formation: Security Groups found with CIDR open to world on ingress scylla-machine-image#211

29 Nov 2021