Pipeline / pipeline / b455d4974cf

Commits

Rui Xue authored b455d4974cf Merge 13 Mar 2025

Pull request #1434: PIPE-2398: port release 2024.1.1 features/bugfixes back to the pipeline main branch

Merge in PIPE/pipeline from PIPE-2398-port-release-2024.1.1-features-bugfixes-back-to-the-pipeline-main-branch to main

* commit '6ad8e8d845c4b457b787dd40631cac11f8d2c25c': (93 commits)
  PIPE-2497: exclude all line channel ranges from continuum imaging by arranging their stages after continuum subtraction.
  PIPE-2497: attempt line flagging for all input visibilities, regardless of whether the datatype is "CONTLINE" or "CONT".
  PIPE-2500: generate the selfcal target list using regcal metadata; set message logging level to WARNING when skipping application due to existing selfcal data column.
  PIPE-2498: prevent numpy scalar dtype representation of spwmap in the hif_selfcal QA weblog.
  PIPE-2494: handle edge cases where an entire scan is dropped in a "scan_inf" trial solution gain table.
  PIPE-2446: fix a minor parsing issue introduced in 6c50b21d0b2e3058dbb424c7c34f3e3989555d0d.
  PIPE-2001: update the condition of generating optional per-solint summary tables.
  PIPE-2446: present pre-drop gain flagging fraction plots; rearrange the summary table layout.
  PIPE-2447: minor update to the description text of optional solution flag frac vs. baseline length plots.
  PIPE-2398: consolidate the _make_list method between SDExportData and its base class.
  PIPE-2398: minor codesyle updates.
  PIPE-2398: reverse custom changes made for PIPE-2460 and PIPE-2469 on the `release/2024.1.1` branch.
  PIPE-2001: update docstrings for three task input classes.
  PIPE-1878: minor docstring update for the `get_nfrms_multiplier` method in the imaging heuristics base class.
  PIPE-1878: add missing optional arguments to the `nsigma` method in vlass_quicklook imaging heuristics class.
  PIPE-2001: update `recipes/tests/readme.md`
  PIPE-1984/PIPE-2298: refined inline comments and improved CLI docstring.
  PIPE-2447: add explanatory text for plots of flagged fraction vs. baseline.
  PIPE-2193: add support for 'combinespwpol' fallback mode in the weblog.
  PIPE-2446: add explanatory text for "pre-drop" vs. "post-drop" gain tables; add new columns on the pre-drop stats on the selfcal per-solint QA subpages.
  ...

pipeline/h/cli/h_exportdata.py

Modified

1 1	import sys
2 2
3 3	from . import utils
4 4
5 5
6 6	# docstring and type hints: inherits from h.tasks.exportdata.exportdata.ExportDataInputs.__init__
7 7	@utils.cli_wrapper
8 -	def h_exportdata(vis=None, session=None, imaging_products_only=None, exportmses=None, pprfile=None, calintents=None,
8 +	def h_exportdata(vis=None, session=None, imaging_products_only=None, exportmses=None, tarms=None, pprfile=None, calintents=None,
9 9	calimages=None, targetimages=None, products_dir=None):
10 -
11 -	"""Prepare interferometry data for export
10 +	"""Prepare interferometry data for export.
12 11
13 12	The hif_exportdata task exports the data defined in the pipeline context
14 13	and exports it to the data products directory, converting and or
15 14	packing it as necessary.
16 15
17 16	The current version of the task exports the following products
18 17
19 18	- an XML file containing the pipeline processing request
20 -	- a tar file per ASDM / MS containing the final flags version
19 +	- a tar file per ASDM / MS containing the final flags version (exportmses=False)
20 +	- or, a tar file or MeasurementSets per EB (exportmses=True)
21 21	- a text file per ASDM / MS containing the final calibration apply list
22 22	- a FITS image for each selected calibrator source image
23 23	- a FITS image for each selected science target source image
24 24	- a tar file per session containing the caltables for that session
25 25	- a tar file containing the file web log
26 26	- a text file containing the final list of CASA commands
27 27
28 -	Returns
29 -
30 -	The results object for the pipeline task is returned.
31 28
32 29	Returns:
33 30	The results object for the pipeline task is returned.
34 31
35 32	Examples:
36 33	1. Export the pipeline results for a single session to the data products
37 34	directory
38 35
39 36	>>> !mkdir ../products
40 37	>>> hif_exportdata (products_dir='../products')
41 38
42 39	2. Export the pipeline results to the data products directory specify that
43 40	only the gain calibrator images be saved.
44 41
45 42	>>> !mkdir ../products
46 43	>>> hif_exportdata (products_dir='../products', calintents='PHASE')
47 44
48 45	"""
49 -
50 46	##########################################################################
51 47	# #
52 48	# CASA task interface boilerplate code starts here. No edits should be #
53 49	# needed beyond this point. #
54 50	# #
55 51	##########################################################################
56 52
57 53	# create a dictionary containing all the arguments given in the
58 54	# constructor
59 55	all_inputs = vars()

pipeline

Commits

Jira Issues

Add shortcut