v2021.09.30

2021-09-30 Release Notes

New Functionality

• Strings regex support (Issues #894, #910, #911, #917) using re2 library.
  • Adds findall, find_locations, match functions with regex support
  • Adds regex support for contains, endswith, startswith, flatten, peel, rpeel
• Issue #822 : Adds hdf5 save/load functionality for Categoricals
• Issue #919 : Hashing for general arrays

Benchmarking updates

• Results for scalability & sorts benchmakr runs were added to the runs directory
  • 6bc8dd7 Add 06/21/21 hero sort runs for HPE Apollo
  • e4d4978 Add 06/07/21 scalablity results for HPE Apollo
  • 22890ef Add 04/06/21 scalability results for Cray XC and HPE Apollo
• Issue #930 speed up answer creation for flatten benchmark

Chapel related support/improvements

• Support for Chapel v1.25.0 by updating GenSymIO to use new subprocess.exitCode (see PR#916)
• Use of interleave-memory if available (see PR#913)
• PR#935 memTrack/memThreshold configuration change for performance improvement

Misc

• Issue #904 Fixes issue with tmp dir on test systems where /tmp may not be mounted.
• Issue #924 Avoid using pyzmq 22.3.0

August 20, 2021 Release

Merge pull request #896 from glitch/887-derive-offsets

Closes #887 : Implements an option to derive SegString offsets/segments array

August 06, 2021 Release

Bugfix #883
Faster array transfers and more!

Faster client-server transfers, fault-tolerant IO, improved error handling

Highlights:

• #880 and #870 together speed up .to_ndarray() by 20x (to 410 MiB/s) and ak.array() by 7x (to 175 MiB/s)
• #821 introduces a fault-tolerant invocation of ak.read_all()
• #857 improves the granularity and helpfulness of error messages for I/O
• #872 corrects error handling on item assignment and fixes silent failures described in #869

new version tag for versioner fix '-' replacement PR

Merge pull request #868 from glitch/867-version-string-manipulation

Closes #867: Remove dash character replacement in version stringf

makefile fix for python3 run of versioner

Merge pull request #863 from glitch/862-Makefile-versioneer

Closes #862: Explict python3 for versioneer and adding 'make version' target

new versioning started

Merge pull request #851 from glitch/508_versioneer

Issue #508: Adding versioneer to project for version management.

incorporated new additions like strings, logging, and more

Merge pull request #212 from mhmerrill/split-out-logging

Split out logging and new version number

v2019.11.12

Update VERSION

v0.0.9-2019-10-21: Merge pull request #145 from mhmerrill/pdarray-index-enhancement

Pdarray index enhancement