2024-12-12 14:08:02,305 - wsc_run_gdm_sar.py - INFO - workflow invoque with /usr/contrib/cycle/gdm-sar-uga-qualif/ws/wsc_run_gdm_sar.py -c isdeform -t 1b1ccb1f-32ab-429c-a765-c21c5964e70a -v 4 -e source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh; 
2024-12-12 14:08:02,305 - wsc_run_gdm_sar.py - INFO - -------------> start workflow
2024-12-12 14:08:02,306 - wsc_run_gdm_sar.py - DEBUG - swath final is iw2_iw3
2024-12-12 14:08:02,307 - wsc_run_gdm_sar.py - INFO - -------------> start workflow
2024-12-12 14:08:02,307 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start DOWNLOAD', 'status': 'running', 'step': 'download', 'progress': 9}
2024-12-12 14:08:02,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:08:02,614 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:08:02,616 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:08:02,617 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:08:02,617 - wsc_run_gdm_sar.py - INFO - get dem cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv<<
2024-12-12 14:08:02,617 - wsc_run_gdm_sar.py - INFO - -------------- starting step 1: download ---------- 
2024-12-12 14:08:02,617 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:08:02,617 - wf_scheduler - INFO - launching cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:08:02,617 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=2,walltime=09:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4 ", "name": "1-0_download_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt"}'
2024-12-12 14:08:02,618 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=09:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4 ", "name": "1-0_download_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt"}' *****
2024-12-12 14:08:02,943 - wf_task - INFO - run with pid 1605012
2024-12-12 14:09:02,943 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:10:03,022 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:11:03,098 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:12:03,182 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:13:03,260 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:14:03,341 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:15:03,416 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:16:03,525 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:17:03,597 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605012
2024-12-12 14:17:03,685 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4  is 0
2024-12-12 14:17:03,685 - wf_scheduler - INFO - done with cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;   wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -j 7 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605012
2024-12-12 14:17:03,685 - wf_scheduler - INFO - launching cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:17:03,685 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=2,walltime=01:30:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv", "name": "1-1_dem_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt"}'
2024-12-12 14:17:03,685 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:30:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv", "name": "1-1_dem_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt"}' *****
2024-12-12 14:17:03,957 - wf_task - INFO - run with pid 1605016
2024-12-12 14:18:03,958 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605016
2024-12-12 14:18:04,051 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv is 0
2024-12-12 14:18:04,051 - wf_scheduler - INFO - done with cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/DEM --safe /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605016
2024-12-12 14:18:04,054 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt
2024-12-12 14:18:04,063 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt
2024-12-12 14:18:04,067 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:18:04,068 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:04,069 - wsc_run_gdm_sar.py - INFO - -------------> start mkworkdir 
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - %%%%% running task workdir polarisation=vv on swath iw2
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - get process task: nsbas  cmd = >>nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 workdir polarisation=vv<<
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - %%%%% running task workdir polarisation=vv on swath iw3
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - get process task: nsbas  cmd = >>nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 workdir polarisation=vv<<
2024-12-12 14:18:04,070 - wsc_run_gdm_sar.py - INFO - -------------- starting step 1: download ---------- 
2024-12-12 14:18:04,070 - wf_scheduler - INFO - Async scheduler: running 
	command=nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 workdir polarisation=vv, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 workdir polarisation=vv, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:18:04,070 - wf_scheduler - INFO - launching cmd 1/2: nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 workdir polarisation=vv
2024-12-12 14:18:04,070 - wf_task - INFO - running nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 workdir polarisation=vv
2024-12-12 14:18:04,070 - wf_task - DEBUG - process-task: running command nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 workdir polarisation=vv (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:04,071 - wf_scheduler - INFO - launching cmd 2/2: nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 workdir polarisation=vv
2024-12-12 14:18:04,071 - wf_task - INFO - running nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 workdir polarisation=vv
2024-12-12 14:18:04,071 - wf_task - DEBUG - process-task: running command nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 workdir polarisation=vv (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:04,072 - wf_scheduler - DEBUG - status=['Running', 'Running']
2024-12-12 14:18:14,073 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:18:14,073 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated']
2024-12-12 14:18:14,073 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:18:14,073 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:14,076 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-0_download.txt
2024-12-12 14:18:14,085 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/1-1_get_dem.txt
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - updating procfile /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing profile keys:  atmo -> ERAW, unw_method -> mpd, polarisation -> vv
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing lat bounds to 35.34487405959578, 35.84487405959578
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing polarisation bounds to vv
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing atmo paramater to ERAW
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing rint and runw by 4 and 8
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - No constrain on Skip value, as Rlooks_int != Rlooks_unw
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - changing unw_method by mpd
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - Seed point not given by user
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - setting CheckUnwFrac to yes
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - Individual configuration for franck.thollard@univ-grenoble-alpes.fr done
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - DEBUG - expert_param_list are ['PowerMode', 'cluster=isdeform']
2024-12-12 14:18:14,090 - wsc_run_gdm_sar.py - INFO - expert mode cluster as isdeform
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - updating procfile /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing profile keys:  atmo -> ERAW, unw_method -> mpd, polarisation -> vv
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing lat bounds to 35.34487405959578, 35.84487405959578
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing polarisation bounds to vv
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing atmo paramater to ERAW
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing rint and runw by 4 and 8
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - No constrain on Skip value, as Rlooks_int != Rlooks_unw
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - changing unw_method by mpd
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - Seed point not given by user
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - setting CheckUnwFrac to yes
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - Individual configuration for franck.thollard@univ-grenoble-alpes.fr done
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - DEBUG - expert_param_list are ['PowerMode', 'cluster=isdeform']
2024-12-12 14:18:14,093 - wsc_run_gdm_sar.py - INFO - expert mode cluster as isdeform
2024-12-12 14:18:14,095 - wsc_run_gdm_sar.py - INFO - ---------------> start burst_select 
2024-12-12 14:18:14,095 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start make_slc', 'status': 'running', 'step': 'burst_select', 'progress': 18}
2024-12-12 14:18:14,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:18:14,369 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:18:14,371 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:18:14,371 - wsc_run_gdm_sar.py - INFO - %%%%% running task burst_select on swath iw2
2024-12-12 14:18:14,371 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 2 burst_select<<
2024-12-12 14:18:14,371 - wsc_run_gdm_sar.py - INFO - %%%%% running task burst_select on swath iw3
2024-12-12 14:18:14,372 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 2 burst_select<<
2024-12-12 14:18:14,372 - wsc_run_gdm_sar.py - INFO - -------------- starting step 2: burst_select ---------- 
2024-12-12 14:18:14,372 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 2 burst_select, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 2 burst_select, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:18:14,372 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 2 burst_select
2024-12-12 14:18:14,372 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 2 burst_select", "name": "2-0_burst_select_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt"}'
2024-12-12 14:18:14,372 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 2 burst_select", "name": "2-0_burst_select_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt"}' *****
2024-12-12 14:18:14,681 - wf_task - INFO - run with pid 1605017
2024-12-12 14:18:14,681 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 2 burst_select
2024-12-12 14:18:14,681 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 2 burst_select", "name": "2-0_burst_select_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt"}'
2024-12-12 14:18:14,681 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 2 burst_select", "name": "2-0_burst_select_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt"}' *****
2024-12-12 14:18:14,985 - wf_task - INFO - run with pid 1605018
2024-12-12 14:18:14,985 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605017
2024-12-12 14:18:15,083 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605018
2024-12-12 14:18:15,134 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting']
2024-12-12 14:18:25,134 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:18:25,135 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605017
2024-12-12 14:18:25,212 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605018
2024-12-12 14:18:25,264 - wf_scheduler - DEBUG - status=['Running', 'Running']
2024-12-12 14:18:35,264 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:18:35,265 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605017
2024-12-12 14:18:35,368 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605018
2024-12-12 14:18:35,413 - wf_scheduler - DEBUG - status=['Running', 'Running']
2024-12-12 14:18:45,413 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:18:45,413 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605017
2024-12-12 14:18:45,497 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605018
2024-12-12 14:18:45,569 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated']
2024-12-12 14:18:45,570 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605017
2024-12-12 14:18:45,621 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605018
2024-12-12 14:18:45,721 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:18:45,721 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:45,724 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt
2024-12-12 14:18:45,728 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt
2024-12-12 14:18:45,731 - wsc_run_gdm_sar.py - INFO - get   cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -m slice23 -v 4<<
2024-12-12 14:18:45,731 - wsc_run_gdm_sar.py - INFO - -------------- starting step 2: burst_select ---------- 
2024-12-12 14:18:45,731 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -m slice23 -v 4, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:18:45,731 - wf_scheduler - INFO - launching cmd 1/1: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -m slice23 -v 4
2024-12-12 14:18:45,732 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -m slice23 -v 4", "name": "2-1_burst_select_check_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-1_burst_select_check_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-1_burst_select_check_iw2_iw3.txt"}'
2024-12-12 14:18:45,732 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -m slice23 -v 4", "name": "2-1_burst_select_check_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-1_burst_select_check_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-1_burst_select_check_iw2_iw3.txt"}' *****
2024-12-12 14:18:46,015 - wf_task - INFO - run with pid 1605019
2024-12-12 14:18:46,015 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605019
2024-12-12 14:18:46,103 - wf_scheduler - DEBUG - status=['Waiting']
2024-12-12 14:18:56,103 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1
2024-12-12 14:18:56,103 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605019
2024-12-12 14:18:56,189 - wf_scheduler - DEBUG - status=['Terminated']
2024-12-12 14:18:56,189 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605019
2024-12-12 14:18:57,420 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:18:57,420 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:18:57,423 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw2.txt
2024-12-12 14:18:57,426 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-0_burst_select_iw3.txt
2024-12-12 14:18:57,428 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/2-1_burst_select_check_iw2_iw3.txt
2024-12-12 14:18:57,430 - wsc_run_gdm_sar.py - INFO - ---------------> start slice 
2024-12-12 14:18:57,431 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start slice', 'status': 'running', 'step': 'make_slc', 'progress': 27}
2024-12-12 14:18:57,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:18:57,684 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:18:57,686 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:18:57,686 - wsc_run_gdm_sar.py - INFO - %%%%% running task slice23 on swath iw2
2024-12-12 14:18:57,686 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 slice23<<
2024-12-12 14:18:57,686 - wsc_run_gdm_sar.py - INFO - %%%%% running task slice23 on swath iw3
2024-12-12 14:18:57,686 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 slice23<<
2024-12-12 14:18:57,687 - wsc_run_gdm_sar.py - INFO - -------------- starting step 3: make_slc ---------- 
2024-12-12 14:18:57,687 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 slice23, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 slice23, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:18:57,687 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 slice23
2024-12-12 14:18:57,687 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 slice23", "name": "3_slice23_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw2.txt"}'
2024-12-12 14:18:57,687 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 slice23", "name": "3_slice23_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw2.txt"}' *****
2024-12-12 14:18:57,985 - wf_task - INFO - run with pid 1605020
2024-12-12 14:18:57,985 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 slice23
2024-12-12 14:18:57,986 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 slice23", "name": "3_slice23_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw3.txt"}'
2024-12-12 14:18:57,986 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 slice23", "name": "3_slice23_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw3.txt"}' *****
2024-12-12 14:18:58,290 - wf_task - INFO - run with pid 1605021
2024-12-12 14:18:58,290 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605020
2024-12-12 14:18:58,382 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605021
2024-12-12 14:18:58,432 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting']
2024-12-12 14:28:58,432 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:28:58,433 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605020
2024-12-12 14:28:58,546 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605021
2024-12-12 14:28:58,592 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated']
2024-12-12 14:28:58,596 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605020
2024-12-12 14:28:58,659 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605021
2024-12-12 14:28:58,705 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:28:58,705 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:28:58,711 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw2.txt
2024-12-12 14:28:58,722 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/3_slice23_iw3.txt
2024-12-12 14:28:58,730 - wsc_run_gdm_sar.py - INFO - ---------------> start simulation 
2024-12-12 14:28:58,731 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start simulation', 'status': 'running', 'step': 'simulation', 'progress': 36}
2024-12-12 14:28:58,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:28:58,998 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - %%%%% running task simulation23 on swath iw2
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 simulation23<<
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - %%%%% running task simulation23 on swath iw3
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 simulation23<<
2024-12-12 14:28:59,000 - wsc_run_gdm_sar.py - INFO - -------------- starting step 4: simulation ---------- 
2024-12-12 14:28:59,001 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 simulation23, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 simulation23, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:28:59,001 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 simulation23
2024-12-12 14:28:59,001 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=02:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 simulation23", "name": "4_simulation23_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw2.txt"}'
2024-12-12 14:28:59,001 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=02:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 simulation23", "name": "4_simulation23_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw2.txt"}' *****
2024-12-12 14:28:59,300 - wf_task - INFO - run with pid 1605030
2024-12-12 14:28:59,301 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 simulation23
2024-12-12 14:28:59,301 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=02:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 simulation23", "name": "4_simulation23_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw3.txt"}'
2024-12-12 14:28:59,301 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=02:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 simulation23", "name": "4_simulation23_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw3.txt"}' *****
2024-12-12 14:28:59,606 - wf_task - INFO - run with pid 1605031
2024-12-12 14:28:59,606 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605030
2024-12-12 14:28:59,692 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605031
2024-12-12 14:28:59,739 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting']
2024-12-12 14:38:59,740 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:38:59,740 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605030
2024-12-12 14:38:59,831 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605031
2024-12-12 14:38:59,873 - wf_scheduler - DEBUG - status=['Running', 'Running']
2024-12-12 14:48:59,873 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:48:59,873 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605030
2024-12-12 14:48:59,968 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605031
2024-12-12 14:49:00,023 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated']
2024-12-12 14:49:00,023 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605030
2024-12-12 14:49:00,064 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605031
2024-12-12 14:49:00,153 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:49:00,153 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:49:00,158 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw2.txt
2024-12-12 14:49:00,195 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/4_simulation23_iw3.txt
2024-12-12 14:49:00,229 - wsc_run_gdm_sar.py - INFO - ---------------> start interfero_spectraldiversity 
2024-12-12 14:49:00,230 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start interfero_spectraldiversity', 'status': 'running', 'step': 'interfero_spectraldiversity', 'progress': 45}
2024-12-12 14:49:00,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:49:00,500 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:49:00,501 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:49:00,502 - wsc_run_gdm_sar.py - INFO - %%%%% running task interfero_spectraldiversity on swath iw2
2024-12-12 14:49:00,502 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 interfero_spectraldiversity<<
2024-12-12 14:49:00,502 - wsc_run_gdm_sar.py - INFO - %%%%% running task interfero_spectraldiversity on swath iw3
2024-12-12 14:49:00,502 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 interfero_spectraldiversity<<
2024-12-12 14:49:00,502 - wsc_run_gdm_sar.py - INFO - -------------- starting step 5: interfero_spectraldiversity ---------- 
2024-12-12 14:49:00,502 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 interfero_spectraldiversity, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 interfero_spectraldiversity, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:49:00,502 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 interfero_spectraldiversity
2024-12-12 14:49:00,502 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw2.txt"}'
2024-12-12 14:49:00,503 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw2.txt"}' *****
2024-12-12 14:49:00,809 - wf_task - INFO - run with pid 1605034
2024-12-12 14:49:00,810 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 interfero_spectraldiversity
2024-12-12 14:49:00,810 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw3.txt"}'
2024-12-12 14:49:00,810 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw3.txt"}' *****
2024-12-12 14:49:01,105 - wf_task - INFO - run with pid 1605035
2024-12-12 14:49:01,105 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605034
2024-12-12 14:49:01,182 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605035
2024-12-12 14:49:01,234 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting']
2024-12-12 14:59:01,234 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2
2024-12-12 14:59:01,235 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605034
2024-12-12 14:59:01,319 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605035
2024-12-12 14:59:01,368 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated']
2024-12-12 14:59:01,368 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605034
2024-12-12 14:59:01,414 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605035
2024-12-12 14:59:01,461 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 14:59:01,461 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 14:59:01,466 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw2.txt
2024-12-12 14:59:01,534 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/5_interfero_spectraldiversity_iw3.txt
2024-12-12 14:59:01,598 - wsc_run_gdm_sar.py - INFO - -----------> start merge if needed
2024-12-12 14:59:01,599 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start merge', 'status': 'running', 'step': 'merge', 'progress': 54}
2024-12-12 14:59:01,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 14:59:02,030 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 14:59:02,031 - wsc_run_gdm_sar.py - INFO - -----------> merge is needed
2024-12-12 14:59:02,031 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 14:59:02,032 - wsc_run_gdm_sar.py - INFO - %%%%% running task merge on swath iw23
2024-12-12 14:59:02,032 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw23 12 merge<<
2024-12-12 14:59:02,032 - wsc_run_gdm_sar.py - INFO - -------------- starting step 6: merge ---------- 
2024-12-12 14:59:02,032 - wf_scheduler - INFO - Async scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw23 12 merge, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 14:59:02,032 - wf_scheduler - INFO - launching cmd 1/1: source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw23 12 merge
2024-12-12 14:59:02,032 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw23 12 merge", "name": "6_merge_iw23_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/6_merge_iw23.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/6_merge_iw23.txt"}'
2024-12-12 14:59:02,032 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:00:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw23 12 merge", "name": "6_merge_iw23_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/6_merge_iw23.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/6_merge_iw23.txt"}' *****
2024-12-12 14:59:02,331 - wf_task - INFO - run with pid 1605037
2024-12-12 14:59:02,331 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605037
2024-12-12 14:59:02,421 - wf_scheduler - DEBUG - status=['Waiting']
2024-12-12 15:09:02,421 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1
2024-12-12 15:09:02,422 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605037
2024-12-12 15:09:02,493 - wf_scheduler - DEBUG - status=['Terminated']
2024-12-12 15:09:02,493 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605037
2024-12-12 15:09:02,546 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:09:02,546 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:09:02,551 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/6_merge_iw23.txt
2024-12-12 15:09:02,568 - wsc_run_gdm_sar.py - INFO - -------------> start atmo filter unwrap 
2024-12-12 15:09:02,569 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start filter_unwrap', 'status': 'running', 'step': 'filter_unwrap', 'progress': 63}
2024-12-12 15:09:02,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:09:02,860 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:09:02,862 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:09:02,862 - wsc_run_gdm_sar.py - INFO - %%%%% running task caui on swath iw2_iw3
2024-12-12 15:09:02,862 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui<<
2024-12-12 15:09:02,862 - wsc_run_gdm_sar.py - INFO - -------------- starting step 7: filter_unwrap ---------- 
2024-12-12 15:09:02,862 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:09:02,862 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:09:02,863 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=17:30:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui", "name": "7_caui_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/7_caui_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/7_caui_iw2_iw3.txt"}'
2024-12-12 15:09:02,863 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=17:30:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui", "name": "7_caui_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/7_caui_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/7_caui_iw2_iw3.txt"}' *****
2024-12-12 15:09:03,184 - wf_task - INFO - run with pid 1605038
2024-12-12 15:10:03,184 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605038
2024-12-12 15:11:03,275 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605038
2024-12-12 15:12:03,352 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605038
2024-12-12 15:13:03,436 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605038
2024-12-12 15:14:03,524 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605038
2024-12-12 15:14:03,617 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui is 0
2024-12-12 15:14:03,617 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605038
2024-12-12 15:14:03,617 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:14:03,617 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:14:03,623 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/7_caui_iw2_iw3.txt
2024-12-12 15:14:03,644 - wsc_run_gdm_sar.py - DEBUG - number of interfero 12
2024-12-12 15:14:03,644 - wsc_run_gdm_sar.py - INFO - -------------> start cleaning if requested
2024-12-12 15:14:03,645 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start cleaning_before_ts', 'status': 'running', 'step': 'timeseries', 'progress': 72}
2024-12-12 15:14:03,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:14:03,892 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:14:03,893 - wsc_run_gdm_sar.py - INFO - -------------> cleaning coreg, INTERFERO_sd and interferograms before merging
2024-12-12 15:14:03,894 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:14:03,894 - wsc_run_gdm_sar.py - INFO - %%%%% running task cleaning_before_ts on swath iw2
2024-12-12 15:14:03,894 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v<<
2024-12-12 15:14:03,894 - wsc_run_gdm_sar.py - INFO - %%%%% running task cleaning_before_ts on swath iw3
2024-12-12 15:14:03,894 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v<<
2024-12-12 15:14:03,895 - wsc_run_gdm_sar.py - INFO - -------------- starting step 8: timeseries ---------- 
2024-12-12 15:14:03,895 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:14:03,895 - wf_scheduler - INFO - launching cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:14:03,895 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt"}'
2024-12-12 15:14:03,895 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt"}' *****
2024-12-12 15:14:05,356 - wf_task - INFO - run with pid 1605039
2024-12-12 15:15:05,357 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605039
2024-12-12 15:15:05,453 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v is 0
2024-12-12 15:15:05,453 - wf_scheduler - INFO - done with cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605039
2024-12-12 15:15:05,453 - wf_scheduler - INFO - launching cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:15:05,453 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v", "name": "8_cleaning_before_ts_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt"}'
2024-12-12 15:15:05,454 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v", "name": "8_cleaning_before_ts_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt"}' *****
2024-12-12 15:15:05,772 - wf_task - INFO - run with pid 1605040
2024-12-12 15:16:05,772 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605040
2024-12-12 15:16:05,846 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v is 0
2024-12-12 15:16:05,846 - wf_scheduler - INFO - done with cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605040
2024-12-12 15:16:05,847 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:16:05,847 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:16:05,853 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt
2024-12-12 15:16:05,855 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt
2024-12-12 15:16:05,858 - wsc_run_gdm_sar.py - INFO - -------------> start time series if needed
2024-12-12 15:16:05,860 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start timeseries', 'status': 'running', 'step': 'timeseries', 'progress': 72}
2024-12-12 15:16:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:16:06,092 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:16:06,093 - wsc_run_gdm_sar.py - INFO - -------------> doing timeseries
2024-12-12 15:16:06,094 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:16:06,094 - wsc_run_gdm_sar.py - INFO - %%%%% running task time_serie on swath iw2_iw3
2024-12-12 15:16:06,094 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie<<
2024-12-12 15:16:06,095 - wsc_run_gdm_sar.py - INFO - -------------- starting step 8: timeseries ---------- 
2024-12-12 15:16:06,095 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:16:06,095 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:16:06,095 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=03:45:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie", "name": "8_time_serie_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt"}'
2024-12-12 15:16:06,095 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=03:45:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie", "name": "8_time_serie_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt"}' *****
2024-12-12 15:16:06,404 - wf_task - INFO - run with pid 1605041
2024-12-12 15:17:06,405 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605041
2024-12-12 15:17:06,515 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie is 0
2024-12-12 15:17:06,515 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsbas.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 time_serie, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605041
2024-12-12 15:17:06,515 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:17:06,515 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:17:06,520 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt
2024-12-12 15:17:06,521 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt
2024-12-12 15:17:06,522 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt
2024-12-12 15:17:06,526 - wsc_run_gdm_sar.py - INFO - -------------> start cleaning if requested
2024-12-12 15:17:06,526 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start time_serie', 'status': 'running', 'step': 'timeseries', 'progress': 72}
2024-12-12 15:17:06,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:17:06,765 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:17:06,766 - wsc_run_gdm_sar.py - INFO - -------------> cleaning merged interferograms directories with unwrapping and geocoding
2024-12-12 15:17:06,766 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:17:06,767 - wsc_run_gdm_sar.py - INFO - %%%%% running task cleaning_after_ts on swath iw2_iw3
2024-12-12 15:17:06,767 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v<<
2024-12-12 15:17:06,767 - wsc_run_gdm_sar.py - INFO - -------------- starting step 8: timeseries ---------- 
2024-12-12 15:17:06,767 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:17:06,767 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:17:06,767 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v", "name": "8_cleaning_after_ts_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_after_ts_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_after_ts_iw2_iw3.txt"}'
2024-12-12 15:17:06,767 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:53:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v", "name": "8_cleaning_after_ts_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_after_ts_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_after_ts_iw2_iw3.txt"}' *****
2024-12-12 15:17:07,076 - wf_task - INFO - run with pid 1605042
2024-12-12 15:18:07,077 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605042
2024-12-12 15:18:07,166 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v is 0
2024-12-12 15:18:07,166 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_clean_coreg_int.py -u /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605042
2024-12-12 15:18:07,166 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:18:07,166 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:18:07,170 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw2.txt
2024-12-12 15:18:07,171 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_before_ts_iw3.txt
2024-12-12 15:18:07,172 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_time_serie_iw2_iw3.txt
2024-12-12 15:18:07,174 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/8_cleaning_after_ts_iw2_iw3.txt
2024-12-12 15:18:07,176 - wsc_run_gdm_sar.py - INFO - -------------> start populate and make products 
2024-12-12 15:18:07,177 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'Start publish', 'status': 'running', 'step': 'make_data', 'progress': 81}
2024-12-12 15:18:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:18:07,399 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:18:07,400 - wsc_run_gdm_sar.py - DEBUG - populate ctip calcall+ts and ltip InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw
2024-12-12 15:18:07,401 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:18:07,401 - wsc_run_gdm_sar.py - DEBUG - get nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA<<
2024-12-12 15:18:07,401 - wsc_run_gdm_sar.py - INFO - -------------- starting step 9: make_data ---------- 
2024-12-12 15:18:07,401 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:18:07,401 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:18:07,401 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA", "name": "9-0_populate_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt"}'
2024-12-12 15:18:07,402 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA", "name": "9-0_populate_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt"}' *****
2024-12-12 15:18:07,733 - wf_task - INFO - run with pid 1605043
2024-12-12 15:19:07,734 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:20:07,833 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:21:07,914 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:22:08,004 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:23:08,101 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:24:08,170 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:25:08,243 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:26:08,316 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:27:08,387 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:28:08,467 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605043
2024-12-12 15:28:08,563 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA is 0
2024-12-12 15:28:08,563 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 12 calcall+ts epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605043
2024-12-12 15:28:08,563 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:28:08,563 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:28:08,585 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt
2024-12-12 15:28:08,616 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'select products', 'status': 'running', 'step': 'make_data', 'progress': 81}
2024-12-12 15:28:08,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:28:08,888 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:28:08,889 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours
2024-12-12 15:28:08,889 - wsc_run_gdm_sar.py - INFO - get nsbas  cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask<<
2024-12-12 15:28:08,889 - wsc_run_gdm_sar.py - INFO - -------------- starting step 9: make_data ---------- 
2024-12-12 15:28:08,889 - wf_scheduler - INFO - Sequential scheduler: running 
	command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:28:08,889 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:28:08,889 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs
	data=b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "9-1_make_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-1_make_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-1_make_iw2_iw3.txt"}'
2024-12-12 15:28:08,889 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "9-1_make_iw2_iw3_1b1ccb1f-32ab-429c-a765-c21c5964e70a", "workdir": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-1_make_iw2_iw3.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-1_make_iw2_iw3.txt"}' *****
2024-12-12 15:28:09,208 - wf_task - INFO - run with pid 1605044
2024-12-12 15:29:09,208 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1605044
2024-12-12 15:29:09,273 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask is 0
2024-12-12 15:29:09,273 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform_qualif.sh;  nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a -w iw2_iw3 -d /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=1605044
2024-12-12 15:29:09,273 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:29:09,273 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:29:09,275 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-0_populate_iw2_iw3.txt
2024-12-12 15:29:09,290 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs/9-1_make_iw2_iw3.txt
2024-12-12 15:29:09,346 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'format products', 'status': 'running', 'step': 'make_data', 'progress': 81}
2024-12-12 15:29:09,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:29:09,580 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:29:09,580 - wsc_run_gdm_sar.py - INFO - Starting building job summary...
2024-12-12 15:29:13,017 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw3/20190722/geomap_quad_4rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,047 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2/20190722/geomap_quad_4rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,068 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190710/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,069 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190710/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,069 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190710/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,070 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190716/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,070 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190716/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,070 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190716/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,071 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190722/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,071 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190722/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,071 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190704_20190722/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,073 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190716/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,073 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190716/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,073 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190716/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,074 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190722/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,074 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190722/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,074 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190722/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,075 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190728/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,076 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190728/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,076 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190710_20190728/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,077 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190722/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,077 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190722/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,077 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190722/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,078 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190728/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,078 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190728/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,078 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190728/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,080 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190803/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,080 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190803/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,080 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190716_20190803/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,081 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190728/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,081 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190728/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,082 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190728/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,083 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190803/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,083 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190803/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,083 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190722_20190803/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,084 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190728_20190803/geomap_quad_8rlks.trans'), ignoring it's size.
2024-12-12 15:29:13,084 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190728_20190803/geomap_quad_8rlks.trans.rsc'), ignoring it's size.
2024-12-12 15:29:13,084 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_8rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/INTERFERO/int_20190728_20190803/geomap_quad_8rlks.trans.rsc.hst'), ignoring it's size.
2024-12-12 15:29:13,219 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190710_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190710_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,219 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190710_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190710_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,219 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190716_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190716_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,219 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190716_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190716_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190722_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190722_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190704-20190722_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190704-20190722_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190716_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190716_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190716_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190716_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190722_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190722_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190722_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190722_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190728_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190728_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190710-20190728_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190710-20190728_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190722_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190722_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190722_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190722_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190728_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190728_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190728_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190728_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190803_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190803_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190716-20190803_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190716-20190803_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190722-20190728_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190722-20190728_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190722-20190728_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190722-20190728_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190722-20190803_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190722-20190803_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190722-20190803_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190722-20190803_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190728-20190803_pre_inv.unw is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190728-20190803_pre_inv.unw'), ignoring it's size.
2024-12-12 15:29:13,220 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/20190728-20190803_pre_inv.unw.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/TIME_SERIES/LN_DATA/20190728-20190803_pre_inv.unw.rsc'), ignoring it's size.
2024-12-12 15:29:13,225 - wsc_run_gdm_sar.py - INFO - Building job summary done!
2024-12-12 15:29:13,230 - nsb_build_synthesis - INFO - writing to /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/0_synthesis.html
2024-12-12 15:29:13,230 - nsb_build_synthesis - INFO - launched as  /mnt/contrib/cycle/gdm-sar-uga-qualif/ws/nsb_build_synthesis.py -o /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/0_synthesis.html -c /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/0_summary.json -w /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product -v 4
2024-12-12 15:29:13,230 - nsb_build_synthesis - DEBUG - getting orbit types
2024-12-12 15:29:13,230 - nsb_build_synthesis - DEBUG - getting info from summary
2024-12-12 15:29:13,230 - nsb_build_synthesis - DEBUG - getting info from summary --> Done
2024-12-12 15:29:13,233 - nsb_build_synthesis - DEBUG - building step_time_plot
2024-12-12 15:29:13,233 - nsb_build_synthesis - DEBUG - processing token: 1b1ccb1f-32ab-429c-a765-c21c5964e70a
2024-12-12 15:29:13,234 - nsb_build_synthesis - DEBUG - data collection done, preparing plot
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - after subplot
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - step_stats keys ['1-0', '1-1', '2-0', '2-1', '3', '4', '5', '6', '7', '8', '9-0', '9-1']
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - after sort
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - 1: before loop
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,325 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=download, minutes=8
2024-12-12 15:29:13,370 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,370 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=dem, minutes=1
2024-12-12 15:29:13,371 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,371 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_iw2, minutes=1
2024-12-12 15:29:13,371 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_iw3, minutes=1
2024-12-12 15:29:13,372 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,372 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_check_iw2_iw3, minutes=1
2024-12-12 15:29:13,373 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,373 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=slice23_iw2, minutes=3
2024-12-12 15:29:13,374 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=slice23_iw3, minutes=3
2024-12-12 15:29:13,374 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,374 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=simulation23_iw2, minutes=14
2024-12-12 15:29:13,375 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=simulation23_iw3, minutes=14
2024-12-12 15:29:13,376 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,376 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=interfero_spectraldiversity_iw2, minutes=8
2024-12-12 15:29:13,377 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=interfero_spectraldiversity_iw3, minutes=7
2024-12-12 15:29:13,377 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,377 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=merge_iw23, minutes=1
2024-12-12 15:29:13,378 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,378 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=caui_iw2_iw3, minutes=4
2024-12-12 15:29:13,379 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,379 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=cleaning_before_ts_iw2, minutes=1
2024-12-12 15:29:13,379 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=cleaning_before_ts_iw3, minutes=1
2024-12-12 15:29:13,380 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=time_serie_iw2_iw3, minutes=1
2024-12-12 15:29:13,381 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=cleaning_after_ts_iw2_iw3, minutes=1
2024-12-12 15:29:13,381 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,381 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=populate_iw2_iw3, minutes=9
2024-12-12 15:29:13,382 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num}
2024-12-12 15:29:13,382 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=make_iw2_iw3, minutes=1
2024-12-12 15:29:13,383 - nsb_build_synthesis - DEBUG - 2: after loop
2024-12-12 15:29:13,402 - nsb_build_synthesis - DEBUG - 3: computes nb minutes max_minutes={max_minutes}
2024-12-12 15:29:13,463 - nsb_build_synthesis - DEBUG - 4: after max_minutes
2024-12-12 15:29:13,560 - nsb_build_synthesis - DEBUG - 5: before save fig 1
2024-12-12 15:29:13,791 - nsb_build_synthesis - DEBUG - 6: before save fig 2
2024-12-12 15:29:13,907 - nsb_build_synthesis - DEBUG - 6: build_step_time_plot DONE
2024-12-12 15:29:13,907 - nsb_build_synthesis - DEBUG - building step_time_plot --> DONE
2024-12-12 15:29:13,912 - nsb_build_synthesis - INFO - DONE with ret_code 0
2024-12-12 15:29:13,912 - wsc_run_gdm_sar.py - INFO - build_synthesis done: going to publish step
2024-12-12 15:29:13,912 - wsc_run_gdm_sar.py - INFO - task created [<nsbworkflows.task.ProcessTask object at 0x15346092a110>, <nsbworkflows.task.ProcessTask object at 0x1534608fba10>]
2024-12-12 15:29:13,912 - wsc_run_gdm_sar.py - INFO - scheduled created
2024-12-12 15:29:13,912 - wsc_run_gdm_sar.py - INFO - notifying
2024-12-12 15:29:13,912 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'publish products', 'status': 'running', 'step': 'publish', 'progress': 90}
2024-12-12 15:29:13,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443
2024-12-12 15:29:14,151 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None
2024-12-12 15:29:14,151 - wsc_run_gdm_sar.py - INFO - running publish
2024-12-12 15:29:14,151 - wsc_run_gdm_sar.py - INFO - -------------- starting step 10: publish ---------- 
2024-12-12 15:29:14,151 - wf_scheduler - INFO - Sequential scheduler: running 
	command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
	command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:29:14,151 - wf_scheduler - INFO - launching cmd 0/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:29:14,151 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:29:14,151 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:29:14,327 - wf_task - INFO - ret_code for rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ is 0
2024-12-12 15:29:14,327 - wf_scheduler - INFO - done with cmd 0/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=3299862
2024-12-12 15:29:14,327 - wf_scheduler - INFO - launching cmd 1/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=None
2024-12-12 15:29:14,327 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:29:14,327 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:30:32,812 - wf_task - INFO - ret_code for rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ is 0
2024-12-12 15:30:32,812 - wf_scheduler - INFO - done with cmd 1/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/, workdir=/data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a id=3299869
2024-12-12 15:30:32,812 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/
2024-12-12 15:30:32,812 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a/logs formater.osug:/data/gdm-sar-uga/1b1ccb1f-32ab-429c-a765-c21c5964e70a/ (from directory /data/ist-calcul17/local/gdm-sar/1b1ccb1f-32ab-429c-a765-c21c5964e70a)
2024-12-12 15:30:32,817 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': '1b1ccb1f-32ab-429c-a765-c21c5964e70a', 'log': 'workflow done', 'status': 'terminated', 'step': 'publish', 'progress': 90}
2024-12-12 15:30:32,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443