Changelog: slk_helpers v1.9.3#

Update from slk_helpers v1.9.0 to v1.9.3

see here for changes from slk_helpers v1.8.10 to v1.9.0

see here for changes from slk_helpers v1.8.2 to v1.8.10

see here for changes from slk_helpers v1.7.4 to v1.8.2

see here for changes from slk_helpers v1.7.1 to v1.7.4

see here for changes from slk_helpers v1.6.0 to v1.7.1

see here for changes from slk_helpers v1.5.8 to v1.6.0

see here for changes from slk_helpers v1.5.7 to v1.5.7

see here for changes from slk_helpers v1.2.x to v1.5.7

Please have a look here for a detailed description of the new features and here for an incremental changelog.

Major changes#

  • new commands is_on_tape and gen_search_query

Changes that might break established workflows#

  • diagnostic verbose output is printed to stderr instead of stdout so that the normal output can be captured easier

  • job_status: new job stati FAILED and SUCCESSFUL replace old status COMPLETED

  • job_status: returns exit code 1 if a job has status FAILED, ABORTED or ABORTING

All fixes and new features#

  • search_limited: did not recognize certain failed searches in the past

  • iscached:

    • no error thrown anymore when resource ids are inserted which represent namespaces

    • correct output is printed when only one file was provided and -v or -vv is set

    • fixed issue when checking caching status of 0 byte files

  • job_status:

    • new job stati FAILED and SUCCESSFUL replace old status COMPLETED; COMPLETED might still be used

    • returns exit code 1 if a job has status FAILED, ABORTED or ABORTING

  • new command is_on_tape:

    • same as iscached but checks if files are on tape

    • files, which are on tape and in the cache, are considered as being on tape

    • this is NOT the inverse of iscached => a file can be on tape and in the cache

  • new command gen_search_query:

    • generates a JSON search query which can be run by slk search

    • accepts search conditions/fields like netcdf.Project='abc', resources.birth_time='2023-01-01T13:00:00' or path=/arch/bm0146/k204221

    • search conditions/fields are linked via and

    • user can provide another existing search query via --search--query which is linked via and to the other inputA

    • understands comparison operators =, <, >, <= and >=

  • optional verbose and summary output is now printed to stderr instead of stdout

    • hsm2json: verbose output printed to stderr (but summary not)

    • gfbt / group_files_by_tape: print verbose output (diagnostic purpose) to stderr

    • search_limited: search status

  • these commands can handle searches of which one or more resources were deleted

    • iscached

    • is_on_tape

    • has_no_flag_partial

    • hsm2json

    • gfbt / group_files_by_tape

  • list_search may list already deleted files (not checked for performance reasons)

Known issues#

  • list_search may list already deleted files (not checked for performance reasons)

Changelog slk_helpers v1.9.0   Changelog slk_helpers v1.9.5