ScyllaDB Enterprise 2021.1.7

The ScyllaDB team announces ScyllaDB Enterprise 2021.1.7, a bug-fix production-ready ScyllaDB Enterprise patch release for ScyllaDB Enterprise 2021.1. ScyllaDB Enterprise customers are encouraged to upgrade to ScyllaDB Enterprise 2021.1.7 in coordination with the ScyllaDB support team.

ScyllaDB Enterprise 2021.1.7 brings focus on bug fixes, stabilization and tooling improvement. More below.

Tools Update

Scrub is a nodetool command and a REST API for deserialization and reserializion of sstables to the latest version, resolving corruptions if any) the given keyspace.  Scrub has the following modes:

• ABORT (default) – abort scrub if corruption is detected;
• SKIP (same as `skip_corrupted=true`) skip over corrupt data, omitting them from the output;
• SEGREGATE – segregate data into multiple sstables if needed, such that each sstable contains data with valid order;
• VALIDATE – read (no rewrite) and validate data, logging any problems found. #7736

The following bugs are fixed in scrub operation:

• Scrub compaction: segregate mode: unbounded number of buckets can cause OOM #9400
• Scrub always segregates, regardless of mode #9541
• Scrub compaction filters out sstables that are being compacted #9256
• Better handling of non-UTF-8 strings of corrupt partition keys to the log
• Don’t purge tombstones in scrub

Active Client Table

System.clients is a CQL table that provides real-time information on CQL clients connected to the ScyllaDB cluster.

In this release, the following columns are added to the clients table:

• connection_stage
• driver_name
• driver_version
• protocol_version

It also improves:

• client_type – distinguishes CQL from thrift just in case
• username – now it displays the correct username if `PasswordAuthenticator` is configured.
  #7349

Nodetool Stop

Reshard and reshape start automatically on boot or refresh, if needed. This release supports the new “nodetool stop RESHAPE” command

nodetool stop now supports the following compaction types: COMPACTION, CLEANUP, SCRUB, UPGRADE and RESHAPE For example: nodetool stop SCRUB.

Related Links

• Get ScyllaDB Enterprise 2021.1.7 (customers only, or 30-day evaluation)
• Upgrade from 2020.1.x to 2021.1.y
• Upgrade from ScyllaDB Open Source 4.3 to ScyllaDB Enterprise 2021.1
• Submit a ticket

A list of stability improvements and bug fixes below, each with open source reference, is available:

• Encryption at rest: Handle key lines without block/padding info when using local_file_provider
• Encryption at rest: KMIP key creation needs to verify/set same defaults as actual (openssl) keys
• CQL: idx_token of global secondary indexes is sorted incorrectly #7443
• Stability: Single-element tuple restriction causes a crash when mixed with non-tuple #7710
• CQL: min/max aggregate functions are broken for timeuuid #7729
• Stability: During bootstrap, decommission, compaction, and reshape ScyllaDB will separate data belonging to different windows (in Time Window Compaction Strategy) into different sstables (to preserve the compaction strategy invariant). However, it did not do so for memtable flush, requiring a reshape if the node was restarted. It will now flush a single memtable into multiple sstables, if needed. #4617
• Stability: Failed SELECT with tuple of reversed-ordered frozen collections #7902
  Stability: using escaped curly braces in format strings cause logger error #8436
  Stability: badly formatted log in a case of bootstrap with repair #8503
  Stability: rapidjson’s, used for JSON parsing, default allocator does not handle allocation failures properly #8521
  Stability: exception phased_barrier::advance_and_await is not handled #8636
  Stability: Segmentation fault when applying mutation in truncate_base_during_mv_insert_test_without_auto_snapshot #8749
  Stability: bytes_ostream::write stalls 55ms #8897
  Stability: Long stalls when destroying repair_meta #8926
  Performance: Querier cache is not used when paging on coordinator side #9127
  Stability: heap-use-after-free in date_tiered_manifest::get_now #9138
  Stability: scylla aborts when resharding is stopped due to shutdown #9158
  Stability: Possible race condition between table stopping and compaction #9448
  UX: large data warnings do not contains the sstable name #9524
  EC2 Cloud Formation: Security Groups found with CIDR open to world on ingress scylla-machine-image#211

29 Nov 2021