Pull request #1482: PIPE-2423: correct a bug where `iter1.model.ttx` could mistakenly be copied into `iter2.model` if `iter1.model` and `iter1.model.ttx` co-exist (e.g.Merge in PIPE/pipeline from PIPE-2423-fix-multiterm-imaging-iteration-product-copy to main
* commit 'e9816f8a92329f0337dafbf18c4501c2b952317d':
PIPE-2423: rename `HPG` to `AWPHPG` in VLASS mode names for consistency with the existing naming pattern.
PIPE-2423: avoid redundant .model* file copying between iterations.
PIPE-2423: refactored the logic for selecting the "vlass mode" to improv...
Pull request #1512: PIPE-2579/PIPE-2581/PIPE-2583 qa criteria for hifv_syspower, hifv_solint and hifv_checkflagMerge in PIPE/pipeline from PIPE-2579-hifv_syspower-qa-criteria to main
* commit '999bc52e10a9166330d6c1988c603f531ecf7fb0':
PIPE-2583: updated solint short and long message
PIPE-2583: updated solint QA score criteria
PIPE-2579/PIPE-2583: Refactored MS object retrieval and get_logger import
PIPE-2579: updated syspower score calculation
PIPE-2581: changed scoring mechanism, if > 75% d...
Pull request #1510: PIPE-2400 reduce memory usage of extern sdcalatmcorr.pyMerge in PIPE/pipeline from PIPE-2400-reduce-memory-usage-of-extern-sdcalatmcorr.py to main
* commit '39140314bb1eed1fc78bd743338b818032464683':
Fixed typo and grammatical issues in the log and comment
add agentflagger to __tools list
Remove unused imports
PIPE-2400 fully migrate to row by row data read
Use pipeline logging instead of print
Memory optimization
sdatmcor outputs ta...
PIPE-2423: refactored the logic for selecting the "vlass mode" to improve readability and maintainability; also added 'VLASS-SE-CONT-AWP' as a more user-friendly alias for the existing 'VLASS-SE-CONT-AWP-P032' mode.
PIPE-2423: correct a bug where `iter1.model.ttx` could mistakenly be copied into `iter2.model` if `iter1.model` and `iter1.model.ttx` co-exist (e.g.for specmode='mvc').
Pull request #1521: PIPE-2631: update hif_correctedampflag to no longer use MaskedArray where not necessary, to avoid Numpy warnings.Merge in PIPE/pipeline from PIPE-2631_numpy_warning_hif_correctedampflag to main
* commit 'b65db850ce78678e14adcc93b60edfa574ce1591':
PIPE-2631: update hif_correctedampflag to no longer use MaskedArray where not necessary, to avoid Numpy warnings.
Pull request #1388: PIPE-730/PIPE-2307: added processing environment information to AQUA report; refactoring compute az el for ms into the ms domain objectMerge in PIPE/pipeline from PIPE-2307-refactoring-compute_az_el_for_ms-into-the-ms-domain-object to main
* commit '5a75c7c253a08a96ea3f9abd10d9ec8f7d3d6eb5': (34 commits)
PIPE-730: added image datatype
PIPE-730: changed channel width for not equally spaced channels to absolute difference
PIPE-730: changed sc.exposure_time to sc.time_on_source, and default ChannelWidth for not equally spa...
Pull request #1532: PIPE-2642: update JobRequest to use `inspect` public APIs for Python 3.12 compatibility improvement; remove the reference of deprecated `almatasks`.Merge in PIPE/pipeline from PIPE-2642-update-jobrequest-to-use-inspect-public-apis-for-python-3.12-adaptation to main
* commit '372c4d7a22dee397ba5e2ecba7cb4c477c9b0bb1':
PIPE-2642: update JobRequest to use `inspect` public APIs for Python 3.12 compatibility improvement; remove the reference of deprecated `almatasks`.
Pull request #1504: PIPE-2607: use raw strings for LaTeX syntax in plotting labels to avoid "DeprecationWarning: invalid escape sequence".Merge in PIPE/pipeline from PIPE-1836-clean-up-deprecation-warnings to main
* commit '73d3dadce2c4abe97fbc68dab7830ca203db5723':
PIPE-2607: minior update to use f-string.
PIPE-2607: use raw strings for LaTeX syntax in plotting labels to avoid "DeprecationWarning: invalid escape sequence".
Pull request #1530: PIPE-2640: update the "ProcedureTitle" field for some VLA/SS recipes to maintain the consistency.Merge in PIPE/pipeline from PIPE-2640-correct-the-proceduretitle-field-in-some-vla-ss-recipes to main
* commit '34e2fbf7c70838b0f06a63d3c641abb8fdd6cdd8':
PIPE-2331: convert old recipe script for testing and update `tests/readme.md`.
PIPE-2331: move old VLA script recipes into `recipes/tests`.
PIPE-2640: update the "ProcedureTitle" field for some VLA/SS recipes to maintain the consistency.
Pull request #1520: PIPE-2630: hifv_hanning template fails to render on pre-smoothed data setMerge in PIPE/pipeline from PIPE-2630-hifv_hanning-template-fails-to-render-on-pre-smoothed-data-set to main
* commit 'f13c7b124f89d9dc512c89fe69eb5da97f271eb9':
PIPE-2630: removed redundant conditional check for table_rows and changed early exit in make_hanning_table function to a continue in case of multiple results
PIPE-2630: added conditional to check for smoothed_spws in renderer.py a...
PIPE-2630: removed redundant conditional check for table_rows and changed early exit in make_hanning_table function to a continue in case of multiple results
Pull request #1474: PIPE-2097: Use actual pblimit ratio for statistics if it is lower than the previous fixed factor of 1.05.Merge in PIPE/pipeline from PIPE-2097_Fix_annulus_statistics_limits to main
* commit '104b0e93e3d3de51e63bb4a4d9f5617d1e0708d1':
PIPE-2097: Choose slightly lower min pb value for MOM8 FC statistics to make sure there is a sufficient number of pixels.
PIPE-2097: Use actual pblimit ratio for statistics if it is lower than the previous fixed factor of 1.05.
Pull request #1502: PIPE-2616: update SPW name matching logic (by comparing shared ending substrings), to handle mixed use cases involving old and new SPW naming patterns.Merge in PIPE/pipeline from PIPE-2616-pl-should-support-processing-for-mouses-which-contain-ebs-with-both-the-old-and-new-spw to main
* commit 'ceb7d6ea10524aac3d3afa8f56f96b2a0d56cd3e':
PIPE-2616: revert the changes made to `sessionutils.remap_spw_int|str` from c4e48e1e950.
PIPE-2616: refactor SPW name matching and eliminate virtual-spw-based mapping in cal-pipeline.
PIPE-2616: limit `s...
Pull request #1469: PIPE-1760: make hifa_bandpassflag warnings hifa_bandpass QA scoresMerge in PIPE/pipeline from PIPE-1760-move-hifabandpass-qa-messages to main
* commit '0edc42b130b7bc5f65eb4fdd3a1162c7d5370afb':
PIPE-1760: fix 'unknown origin' message for good bandpass QA scores
PIPE-1760: update for review comments
PIPE-1760: update QA implementation to PIPE-2442 updates
Pull request #1519: PIPE-2268: hifa_timegaincal: exclude irrelevant intents from CalAppsMerge in PIPE/pipeline from PIPE-2268_hifa_timegaincal_exclude_irrelevant_intents_from_calapps to main
* commit '5e53328ccd9406b1f941799ef5c053842afbd478':
PIPE-2268: update phasecal and ampcal steps in hifa_timegaincal to register final CalApplication only for intents that are present in the MS.
PIPE-1770: fix QA score overwrite bug in hifa_applycal summarisationSummarisation of hifa_applycal QA scores would incorrectly handle scores
with the same data selection. This patch fixes the issue so that all
scores with a given data selection are considered by adding them all to
a list, rather than the previous behaviour where the list was repeatedly
overwritten with list containing the score in scope.
PIPE-1770: rescore before aggregation to prevent metric erasureFixes a bug where incorrect scores were being assigned in the new QA
scoring routines due to metric type erasure from score aggregation,
which was being run before rescoring routines.
PIPE-1770: fix summarisation of gt90deg_offset outliersFixes an issue with >90 deg offset outliers which were being incorrectly
omitted during summarisation of their associated QA scores.
PIPE-1770: QAScores for no outliers should not return cached valueFixes a bug where running QAScoreEvalFunc for a no-outlier QAScore
returned the cached value from a previous QAScoreEvalFunc call.
PIPE-1770: make QAScoreEvalFunc handle all possible intentsExpanded `INTENT_MINSCORE` to include additional intents with a sanity
check to ensure all intents are covered, avoiding potential KeyErrors
during runtime.
PIPE-1770: omit amp_freq_sym_off for gt90deg metricsOmits printing of amp_freq_sym_off in outlier text file when the outlier
comes from a 'phase offset > 90 deg' metric.
PIPE-1770: format values in outliers text fileStandardises formatting of outliers text file so that numpy types are
removed and values are always sorted.
PIPE-1770: do not generate banner scores by defaultMakes the generation of BANNER scores optional and disabled by default,
as BANNER scores are not raised to the top of the list making them
confusing to interpret. Also adds a PIPE356_MODES preset to enable the
generation of BANNER scores.
PIPE-1770: fix ampphase_vs_freq_qa regression testsFixes regression tests for ampphase_vs_freq_qa.py - though it is not
clear that the remaining test validates anything useful.
Rui Xue
Ajay Vibhute
Takeshi Nakazato