Pipeline
  1. Pipeline

pipeline

Public
AuthorCommitMessageCommit dateIssues
Rui XueRui Xue
8d5e59df9e4MPull request #1825: PIPE-2947: Improve `_savgol_filter_nan` to pad NaNs around masked regionsMerge in PIPE/pipeline from PIPE-2947-savgol-filter-nan-version2 to main * commit '1364dd8064999cc14aa5c71df7c178e6dc5928a2': PIPE-2947: Make `_savgol_filter_nan` signature compatible with `savgol_filter` PIPE-2947: Improve _savgol_filter_nan to pad NaNs around masked regionsPIPE-2947
Ajay VibhuteAjay Vibhute
747bb8a0485MPull request #1664: PIPE-2582: updated QA criteria for semiFinalBPdcalsMerge in PIPE/pipeline from PIPE-2582-hifv_semifinalbpdcals-qa-criteria to main * commit '9b09ac10aa3c105cbc95aee66acc0e6dfab10eaf': PIPE-2582: Changes suggested in PR review PIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flagged PIPE-2582: Skipping the spectral line SPW fully flagged warning if the offending antenna is fully flagged PIPE-2582: passi...PIPE-2582
Rui XueRui Xue
058d8aeea34MPull request #1810: PIPE-3085: reduce MS open callsMerge in PIPE/pipeline from PIPE-3085-improve-the-freq-frame--chan-conversion-speed-within-fluxcalflag to main * commit 'ad315c171f1d6b940df0fe50f4c392b23effb04e': PIPE-3085: Replace singleton ms tool with MSReader; add type hints PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale` PIPE-3085: Reduce MS open overhead in `hif_applycal` weblog rende...PIPE-3085
Rui XueRui Xue
ad315c171f1PIPE-3085: Replace singleton ms tool with MSReader; add type hintsPIPE-3085
Rui XueRui Xue
1364dd80649PIPE-2947: Make `_savgol_filter_nan` signature compatible with `savgol_filter`Promote `polyorder` from **kwargs to an explicit parameter, matching savgol_filter's positional signature. Update call site keyword order to reflect the new signature.PIPE-2947
Ajay VibhuteAjay Vibhute
9b09ac10aa3PIPE-2582: Changes suggested in PR reviewPIPE-2582
Luke MaudLuke Maud
ef7a76e314fMPull request #1775: PIPE-3016 polarization calibration recipes second hifa bandpass after hifa lockrefant should notMerge in PIPE/pipeline from PIPE-3016-polarization-calibration-recipes-second-hifa_bandpass-after-hifa_lockrefant-should-not to main * commit '73c2dd1ef7a52b32229634b19b59610cd75013d2': PIPE-3016 edit to move table unregister to within merge to context at end of stage run PIPE-3016: minor codestyle changes. PIPE-3016 typos and better commentary PIPE-3016 add parameter to unregister the...PIPE-3016
Luca Di Mascolo Luca Di Mascolo
0e80eb93ef9MPull request #1820: PIPE-2209: replace call to deprecated AntennaArray.baselinesMerge in PIPE/pipeline from PIPE-2209-eliminate-antennaarray.baselines-deprecation-warning to main * commit '67aeda9c8e55a6aed96d04b61dc934e82d2960ed': PIPE-2209: remove deprecated `baselines`/`_baselines` in AntennaArray PIPE-2209: remove debugging leftover PIPE-2209: replace call to deprecated AntennaArray.baselinesPIPE-2209
Rui XueRui Xue
143268e351aMPull request #1818: PIPE-3089: Fix caltable filename inconsistency between serial and parallel modesMerge in PIPE/pipeline from PIPE-3089-caltable-filenames-might-differ-between-serial-and-parallel-modes-for-some-alma-cal-tasks to main * commit '5a560095bf4b576af51b2d4a67e4fa35279b7235': PIPE-3089: set NamingTemplate.task on MPI/Dask workersPIPE-3089
Takeshi NakazatoTakeshi Nakazato
7b4dd9b34afMPull request #1802: PIPE-2967 hsd k2jycal backup url for jy k db queryMerge in PIPE/pipeline from PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-query to main * commit 'aedad0e415d5cf24d1920ae51eae2aabaad2c2b8': revert max casa version PIPE-2967 removed unnecessary rstrip operation PIPE-2967 safely remove trailing newline PIPE-2967 replace "hosts" in the variable names with "urls" reverse the order of log records to be displayed with original order imp...PIPE-2967
Hajime EzawaHajime Ezawa
69c74d46d6eMPull request #1797: PIPE-2958 hsd imaging implement qa score based on the ratio of observed image rms to the theoreticalMerge in PIPE/pipeline from PIPE-2958-hsd_imaging-implement-qa-score-based-on-the-ratio-of-observed-image-rms-to-the-theoretical to main * commit 'a0a1a262c66310e2ba8aa7111c0e10841400bb14': PIPE-2958: improved the code for the thresholds of the relevant qascore PIPE-2958: fix incomplete f-strings, remove unnecessary str() conversion PIPE-2958: further correction PIPE-2958: correct an a...PIPE-2958
Shawn BoothShawn Booth
b76d81a947bMPull request #1764: PIPE-3002: importdata weblog might not render correctly if a polcal field selected for a parallactic angle plot is present in one EB but not the other, within a single sessionMerge in PIPE/pipeline from PIPE-3002-importdata-weblog-might-not-render-correctly-if-a-polcal-field-selected-for-a-parallactic to main * commit 'b3cdb891bd8c5b1b00db9fa2bc02d97a6e7f86c4': PIPE-3002: renamed variable inside list comprehension to prevent shadowing and confusion with the outside variable of the same name; added same safeguard in hifv/importdata/renderer as in hifa added cond...PIPE-3002
Shawn BoothShawn Booth
16312f0381aMPull request #1800: PIPE-3079: Documentation: Context Use Cases and ImprovementsMerge in PIPE/pipeline from context-use-cases to main * commit 'd996090a04c869254ff5b3b5974206bbf57692c6': PIPE-3079: consolidated implementation notes to reduce redundancy PIPE-3079: removed sections 3 and 4 and appendix A; added clarification stating these use cases are retrospective PIPE-3079: removed hanging header section PIPE-3079: updated document language to be more reflective ...PIPE-3079
Shawn BoothShawn Booth
d996090a04cPIPE-3079: consolidated implementation notes to reduce redundancyPIPE-3079
Shawn BoothShawn Booth
71d45c1fc13PIPE-3079: removed sections 3 and 4 and appendix A; added clarification stating these use cases are retrospectivePIPE-3079
Takeshi NakazatoTakeshi Nakazato
aedad0e415dMMerge branch 'main' into PIPE-2967-hsd_k2jycal-backup-url-for-jy-k-db-queryPIPE-2967
Hajime EzawaHajime Ezawa
a0a1a262c66PIPE-2958: improved the code for the thresholds of the relevant qascorePIPE-2958
Takeshi NakazatoTakeshi Nakazato
674acc5fa30revert max casa version
Rui XueRui Xue
6f549f5f134MPull request #1813: PIPE-3078: Remove clean mask deletion between `.iter1` and `.iter2` in continuum TARGET imagingMerge in PIPE/pipeline from PIPE-3078-vla-imaging-pipeline-deletes-mask-between-iter1-and-iter2 to main * commit '0d7c97da2e9984319ed164cc3493c19cf09afb57': PIPE-3078: Remove clean mask deletion between `.iter1` and `.iter2` in continuum TARGET imagingPIPE-3078
Shawn BoothShawn Booth
313fa38dc4cPIPE-3079: removed hanging header sectionPIPE-3079
Luca Di MascoloLuca Di Mascolo
67aeda9c8e5PIPE-2209: remove deprecated `baselines`/`_baselines` in AntennaArrayPIPE-2209
Luke MaudLuke Maud
af37277de39MPull request #1819: PIPE-1868 change wvrgcalflag score such that aca data with insufficient pm antennas for a solutionMerge in PIPE/pipeline from PIPE-1868-change-wvrgcalflag-score-such-that-aca-data-with-insufficient-pm-antennas-for-a-solution to main * commit 'e43129fe6475b7b3ba6183b8de5cf33d50a47ef0': PIPE-1868: Add PHgood and BPgood flags to WvrgcalResult; update score calculation in WvrgcalflagQAHandler PIPE-1868 adding score update to blue 0.67 for good bandpass pre-WVR phase RMS PIPE-1868 update ...PIPE-1868
Rui XueRui Xue
e43129fe647PIPE-1868: Add PHgood and BPgood flags to WvrgcalResult; update score calculation in WvrgcalflagQAHandlerPIPE-1868
Rui XueRui Xue
0b088c3f601PIPE-2947: Improve _savgol_filter_nan to pad NaNs around masked regionsPIPE-2947
Ajay VibhuteAjay Vibhute
1752ede6e78MPull request #1815: PIPE-3068: clone PIPE-3040/PIPE-2461/PIPE-3091 changes to the main branchMerge in PIPE/pipeline from PIPE-3068-clone-pipe-3040-and-pipe-2461-changes-to-the-main-branch to main * commit 'c9ec29a7bedff884fee0f6ff2b1429b8c5ad3bac': (45 commits) PIPE-3068: moving __future__ import to top of imaging.py PIPE-3091: updated comments for vlass fits keywords PIPE-3068: adding changes from PIPE-3060 and PIPE-3051 PIPE-3068: adding documentation for vlass fits header k...8 Jira issues
Ajay VibhuteAjay Vibhute
c9ec29a7bedPIPE-3068: moving __future__ import to top of imaging.pyPIPE-3068
Ajay VibhuteAjay Vibhute
8550343130fPIPE-3091: updated comments for vlass fits keywordsPIPE-3091
Rui XueRui Xue
454b91e80c6PIPE-3085: Extend MS open optimization to `correctedampflag`, `rawflagchans`, `gcorfluxscale`Hoist casa_tools.MSReader outside the inner loops in three additional tasks, following the same pattern established for hif_applycal weblog rendering: - hif_correctedampflag: open once for the intent × field × spw loop in _run_flagging_iteration; thread ms_handle through _evaluate_heuristic → _evaluate_heuristic_for_baseline_set → mstools.read_channel_averaged_data_from_ms. - hif_rawflag...PIPE-3085
Rui XueRui Xue
7673073843cPIPE-3085: Reduce MS open overhead in `hif_applycal` weblog renderingReduce the cost of opening measurement sets in get_brightest_field() by reusing a single MS handle across all (field, spw) iterations instead of opening and closing the MS once per combination. On lazy-import data sets, where the DATA column is ASDM-backed, this cuts the applycal post-processing time significantly (observed ~50 min saving on a 2496-call dataset). - renderer.py: open MS once wi...PIPE-3085
Luca Di MascoloLuca Di Mascolo
b9348f477aePIPE-2209: remove debugging leftoverPIPE-2209
Luke MaudLuke Maud
45f518c53daPIPE-1868 adding score update to blue 0.67 for good bandpass pre-WVR phase RMSPIPE-1868
Luca Di MascoloLuca Di Mascolo
a71c2a5c4d6PIPE-2209: replace call to deprecated AntennaArray.baselinesPIPE-2209
Rui XueRui Xue
5a560095bf4PIPE-3089: set NamingTemplate.task on MPI/Dask workersNamingTemplate.task is set by basetask.execute() only when is_top_level_task() is True, which is always False on MPI servers. This caused worker-side data product filenames to lack the task name prefix, breaking any logic relying on filename content (e.g. the amplitude caltable lookup in hifa_gfluxscale). In Tier0PipelineTask.get_executable(), resolve the Pipeline task name from task_registry ...PIPE-3089
Ajay VibhuteAjay Vibhute
bdeb273c720PIPE-3068: adding changes from PIPE-3060 and PIPE-30513 Jira issues
Shawn BoothShawn Booth
b3cdb891bd8PIPE-3002: renamed variable inside list comprehension to prevent shadowing and confusion with the outside variable of the same name; added same safeguard in hifv/importdata/renderer as in hifaPIPE-3002
Ajay VibhuteAjay Vibhute
23f5af91074MPIPE-3068: resolved merge conflictsPIPE-3068
Ajay VibhuteAjay Vibhute
04c27dccc0cPIPE-3068: adding documentation for vlass fits header keywordsPIPE-3068
Rui XueRui Xue
0d7c97da2e9PIPE-3078: Remove clean mask deletion between `.iter1` and `.iter2` in continuum TARGET imagingPIPE-3078
Luke MaudLuke Maud
94eaf9ae7e1PIPE-1868 update loggingPIPE-1868
Luke MaudLuke Maud
a805a837a05PIPE-1868 wvrgcal score to yellow inc ms name in QAPIPE-1868
Ajay VibhuteAjay Vibhute
459606c4cccPIPE-2582: present warning if spw is fully flagged, or mulitple antennas are fully flaggedPIPE-2582
Rui XueRui Xue
50fed352aa4PIPE-3085: hifa_fluxcalflag - cache SPW freq grids and use searchsorted in _get_chanrangeOpen the MS once per prepare() call instead of once per line candidate, and cache the cvelfreqs result per (vis, fieldid, spwid, refframe) via a new _get_spw_freqs helper. Replace the O(N) linear channel scan with np.searchsorted for O(log N) boundary lookup. Also convert %-style LOG calls to lazy-format style and raise ValueError instead of Exception.PIPE-3085
Shawn BoothShawn Booth
bc7209a88e1PIPE-3079: updated document language to be more reflective of current behavior and removed suggestions related to an unrelated future design; migrated GAP scenarios to observations and limitations, removing specific implementation suggestionsPIPE-3079
Takeshi NakazatoTakeshi Nakazato
ec08870085bPIPE-2967 removed unnecessary rstrip operationPIPE-2967
Takeshi NakazatoTakeshi Nakazato
e4a4a28cdfbPIPE-2967 safely remove trailing newlinePIPE-2967
Takeshi NakazatoTakeshi Nakazato
6f33a5ba730PIPE-2967 replace "hosts" in the variable names with "urls"PIPE-2967
Rui XueRui Xue
15bb0dc4b15MPull request #1806: PIPE-2738: Update RTD setupMerge in PIPE/pipeline from PIPE-2738-update-readthedocs-yaml to main * commit 'f2cc52c1605ce1c02653e06d845bc3581eeaad47': PIPE-2738: Update ReadTheDocs configuration to use Python 3.12 and Pixi for building documentationPIPE-2738
Ajay VibhuteAjay Vibhute
84c7162aa60MPIPE-2582:resolved conflictsPIPE-2582
Rui XueRui Xue
f2cc52c1605PIPE-2738: Update ReadTheDocs configuration to use Python 3.12 and Pixi for building documentationCo-authored-by: Copilot <copilot@github.com>PIPE-2738
Luke MaudLuke Maud
73c2dd1ef7aMPIPE-3016: update merge conflic after PIPE-2903 merged back to branch and fixed lock_refant.py2 Jira issues