2025-01-13 17:38:25,128 - wsc_run_gdm_sar.py - INFO - workflow invoque with /usr/contrib/cycle/gdm-sar-uga/ws/wsc_run_gdm_sar.py -c isdeform -t 93434689-5a76-4e79-b141-e15f5dc9d693 -v 4 -e source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; 2025-01-13 17:38:25,128 - wsc_run_gdm_sar.py - INFO - -------------> start workflow 2025-01-13 17:38:25,130 - wsc_run_gdm_sar.py - DEBUG - swath final is iw1_iw2 2025-01-13 17:38:25,130 - wsc_run_gdm_sar.py - INFO - -------------> start workflow 2025-01-13 17:38:25,132 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start DOWNLOAD', 'status': 'running', 'step': 'download', 'progress': 9} 2025-01-13 17:38:25,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 17:38:25,421 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 17:38:25,423 - wsc_run_gdm_sar.py - INFO - asf download then peps in case of 2025-01-13 17:38:25,424 - wsc_run_gdm_sar.py - INFO - asf+peps download cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 <<< 2025-01-13 17:38:25,424 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:38:25,425 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:38:25,425 - wsc_run_gdm_sar.py - INFO - get dem cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv<< 2025-01-13 17:38:25,425 - wsc_run_gdm_sar.py - INFO - -------------- starting step 1: download ---------- 2025-01-13 17:38:25,425 - wf_scheduler - INFO - Sequential scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:38:25,425 - wf_scheduler - INFO - launching cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:38:25,425 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=10:49:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 ", "name": "1-0_download_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt"}' 2025-01-13 17:38:25,426 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=10:49:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 ", "name": "1-0_download_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt"}' ***** 2025-01-13 17:38:25,770 - wf_task - INFO - run with pid 1644437 2025-01-13 17:39:25,771 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644437 2025-01-13 17:40:26,242 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644437 2025-01-13 17:41:26,338 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644437 2025-01-13 17:42:26,454 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644437 2025-01-13 17:42:26,537 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 is 0 2025-01-13 17:42:26,537 - wf_scheduler - INFO - done with cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadAsf.py -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -j 7 -v 4 || source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wsc_downloadPepsData.py -wd /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/configs/nsbas_config.json -j 3 -v 4 , workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644437 2025-01-13 17:42:26,537 - wf_scheduler - INFO - launching cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:42:26,537 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=01:49:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv", "name": "1-1_dem_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt"}' 2025-01-13 17:42:26,537 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:49:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv", "name": "1-1_dem_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt"}' ***** 2025-01-13 17:42:26,845 - wf_task - INFO - run with pid 1644438 2025-01-13 17:43:26,846 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644438 2025-01-13 17:43:26,946 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv is 0 2025-01-13 17:43:26,946 - wf_scheduler - INFO - done with cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/DEM --safe /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/SAFE -p vv, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644438 2025-01-13 17:43:26,950 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt 2025-01-13 17:43:26,960 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt 2025-01-13 17:43:26,965 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 17:43:26,965 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:43:26,967 - wsc_run_gdm_sar.py - INFO - -------------> start mkworkdir 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - %%%%% running task workdir polarisation=vv on swath iw1 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - get process task: nsbas cmd = >>nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 workdir polarisation=vv<< 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - %%%%% running task workdir polarisation=vv on swath iw2 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - get process task: nsbas cmd = >>nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 workdir polarisation=vv<< 2025-01-13 17:43:26,968 - wsc_run_gdm_sar.py - INFO - -------------- starting step 1: download ---------- 2025-01-13 17:43:26,968 - wf_scheduler - INFO - Async scheduler: running command=nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 workdir polarisation=vv, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 workdir polarisation=vv, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:43:26,968 - wf_scheduler - INFO - launching cmd 1/2: nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 workdir polarisation=vv 2025-01-13 17:43:26,968 - wf_task - INFO - running nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 workdir polarisation=vv 2025-01-13 17:43:26,968 - wf_task - DEBUG - process-task: running command nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 workdir polarisation=vv (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:43:26,970 - wf_scheduler - INFO - launching cmd 2/2: nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 workdir polarisation=vv 2025-01-13 17:43:26,970 - wf_task - INFO - running nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 workdir polarisation=vv 2025-01-13 17:43:26,970 - wf_task - DEBUG - process-task: running command nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 workdir polarisation=vv (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:43:26,971 - wf_scheduler - DEBUG - status=['Running', 'Running'] 2025-01-13 17:43:36,972 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 17:43:36,972 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated'] 2025-01-13 17:43:36,972 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 17:43:36,972 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:43:36,976 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-0_download.txt 2025-01-13 17:43:36,985 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/1-1_get_dem.txt 2025-01-13 17:43:36,989 - wsc_run_gdm_sar.py - INFO - updating procfile /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing profile keys: atmo -> no, unw_method -> mpd, polarisation -> vv 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing lat bounds to 28.319533670346228, 29.219941291844172 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing polarisation bounds to vv 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing atmo paramater to no 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing rint and runw by 2 and 4 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - No constrain on Skip value, as Rlooks_int != Rlooks_unw 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - changing unw_method by mpd 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - Seed point not given by user 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - setting CheckUnwFrac to yes 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - Individual configuration for marie-pierre.doin@univ-grenoble-alpes.fr done 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - DEBUG - expert_param_list are ['filterstyle=SWg', 'PowerMode'] 2025-01-13 17:43:36,990 - wsc_run_gdm_sar.py - INFO - expert mode filterstyle as SWg 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - updating procfile /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing profile keys: atmo -> no, unw_method -> mpd, polarisation -> vv 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing lat bounds to 28.319533670346228, 29.219941291844172 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing polarisation bounds to vv 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing atmo paramater to no 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing rint and runw by 2 and 4 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - No constrain on Skip value, as Rlooks_int != Rlooks_unw 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - changing unw_method by mpd 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - Seed point not given by user 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - setting CheckUnwFrac to yes 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - Individual configuration for marie-pierre.doin@univ-grenoble-alpes.fr done 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - DEBUG - expert_param_list are ['filterstyle=SWg', 'PowerMode'] 2025-01-13 17:43:36,993 - wsc_run_gdm_sar.py - INFO - expert mode filterstyle as SWg 2025-01-13 17:43:36,995 - wsc_run_gdm_sar.py - INFO - ---------------> start burst_select 2025-01-13 17:43:36,996 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start make_slc', 'status': 'running', 'step': 'burst_select', 'progress': 18} 2025-01-13 17:43:36,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 17:43:37,250 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 17:43:37,252 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:43:37,252 - wsc_run_gdm_sar.py - INFO - %%%%% running task burst_select on swath iw1 2025-01-13 17:43:37,252 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 2 burst_select<< 2025-01-13 17:43:37,252 - wsc_run_gdm_sar.py - INFO - %%%%% running task burst_select on swath iw2 2025-01-13 17:43:37,252 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 2 burst_select<< 2025-01-13 17:43:37,253 - wsc_run_gdm_sar.py - INFO - -------------- starting step 2: burst_select ---------- 2025-01-13 17:43:37,253 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 2 burst_select, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 2 burst_select, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:43:37,253 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 2 burst_select 2025-01-13 17:43:37,253 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 2 burst_select", "name": "2-0_burst_select_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt"}' 2025-01-13 17:43:37,253 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 2 burst_select", "name": "2-0_burst_select_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt"}' ***** 2025-01-13 17:43:37,563 - wf_task - INFO - run with pid 1644439 2025-01-13 17:43:37,563 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 2 burst_select 2025-01-13 17:43:37,563 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 2 burst_select", "name": "2-0_burst_select_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt"}' 2025-01-13 17:43:37,563 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 2 burst_select", "name": "2-0_burst_select_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt"}' ***** 2025-01-13 17:43:37,879 - wf_task - INFO - run with pid 1644440 2025-01-13 17:43:37,879 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644439 2025-01-13 17:43:37,963 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644440 2025-01-13 17:43:38,011 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting'] 2025-01-13 17:43:48,011 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 17:43:48,011 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644439 2025-01-13 17:43:48,112 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644440 2025-01-13 17:43:48,165 - wf_scheduler - DEBUG - status=['Running', 'Running'] 2025-01-13 17:43:58,166 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 17:43:58,166 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644439 2025-01-13 17:43:58,248 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644440 2025-01-13 17:43:58,294 - wf_scheduler - DEBUG - status=['Running', 'Running'] 2025-01-13 17:44:08,295 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 17:44:08,295 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644439 2025-01-13 17:44:08,385 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644440 2025-01-13 17:44:08,445 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated'] 2025-01-13 17:44:08,445 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644439 2025-01-13 17:44:08,501 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644440 2025-01-13 17:44:08,559 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 17:44:08,559 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:44:08,565 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt 2025-01-13 17:44:08,568 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt 2025-01-13 17:44:08,572 - wsc_run_gdm_sar.py - INFO - get cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -m slice12 -v 4<< 2025-01-13 17:44:08,572 - wsc_run_gdm_sar.py - INFO - -------------- starting step 2: burst_select ---------- 2025-01-13 17:44:08,572 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -m slice12 -v 4, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:44:08,572 - wf_scheduler - INFO - launching cmd 1/1: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -m slice12 -v 4 2025-01-13 17:44:08,572 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -m slice12 -v 4", "name": "2-1_burst_select_check_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-1_burst_select_check_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-1_burst_select_check_iw1_iw2.txt"}' 2025-01-13 17:44:08,572 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; wf_check_commons_date.py -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -m slice12 -v 4", "name": "2-1_burst_select_check_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-1_burst_select_check_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-1_burst_select_check_iw1_iw2.txt"}' ***** 2025-01-13 17:44:08,902 - wf_task - INFO - run with pid 1644441 2025-01-13 17:44:08,902 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644441 2025-01-13 17:44:08,991 - wf_scheduler - DEBUG - status=['Waiting'] 2025-01-13 17:44:18,992 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2025-01-13 17:44:18,992 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644441 2025-01-13 17:44:19,085 - wf_scheduler - DEBUG - status=['Waiting'] 2025-01-13 17:44:29,085 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2025-01-13 17:44:29,086 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644441 2025-01-13 17:44:29,191 - wf_scheduler - DEBUG - status=['Terminated'] 2025-01-13 17:44:29,191 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644441 2025-01-13 17:44:30,484 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 17:44:30,484 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:44:30,489 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw1.txt 2025-01-13 17:44:30,492 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-0_burst_select_iw2.txt 2025-01-13 17:44:30,494 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/2-1_burst_select_check_iw1_iw2.txt 2025-01-13 17:44:30,497 - wsc_run_gdm_sar.py - INFO - ---------------> start slice 2025-01-13 17:44:30,498 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start slice', 'status': 'running', 'step': 'make_slc', 'progress': 27} 2025-01-13 17:44:30,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 17:44:30,757 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 17:44:30,759 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:44:30,759 - wsc_run_gdm_sar.py - INFO - %%%%% running task slice12 on swath iw1 2025-01-13 17:44:30,760 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 slice12<< 2025-01-13 17:44:30,760 - wsc_run_gdm_sar.py - INFO - %%%%% running task slice12 on swath iw2 2025-01-13 17:44:30,760 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 slice12<< 2025-01-13 17:44:30,760 - wsc_run_gdm_sar.py - INFO - -------------- starting step 3: make_slc ---------- 2025-01-13 17:44:30,760 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 slice12, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 slice12, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:44:30,760 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 slice12 2025-01-13 17:44:30,760 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 slice12", "name": "3_slice12_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw1.txt"}' 2025-01-13 17:44:30,760 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 slice12", "name": "3_slice12_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw1.txt"}' ***** 2025-01-13 17:44:31,106 - wf_task - INFO - run with pid 1644442 2025-01-13 17:44:31,106 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 slice12 2025-01-13 17:44:31,106 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 slice12", "name": "3_slice12_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw2.txt"}' 2025-01-13 17:44:31,106 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=01:13:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 slice12", "name": "3_slice12_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw2.txt"}' ***** 2025-01-13 17:44:31,448 - wf_task - INFO - run with pid 1644443 2025-01-13 17:44:31,448 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644442 2025-01-13 17:44:31,552 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644443 2025-01-13 17:44:31,600 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting'] 2025-01-13 17:54:31,601 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 17:54:31,601 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644442 2025-01-13 17:54:33,080 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644443 2025-01-13 17:54:33,163 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated'] 2025-01-13 17:54:33,164 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644442 2025-01-13 17:54:33,216 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644443 2025-01-13 17:54:33,328 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 17:54:33,328 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 17:54:33,332 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw1.txt 2025-01-13 17:54:33,343 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/3_slice12_iw2.txt 2025-01-13 17:54:33,350 - wsc_run_gdm_sar.py - INFO - ---------------> start simulation 2025-01-13 17:54:33,351 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start simulation', 'status': 'running', 'step': 'simulation', 'progress': 36} 2025-01-13 17:54:33,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 17:54:33,600 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 17:54:33,602 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 17:54:33,602 - wsc_run_gdm_sar.py - INFO - %%%%% running task simulation12 on swath iw1 2025-01-13 17:54:33,602 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 simulation12<< 2025-01-13 17:54:33,602 - wsc_run_gdm_sar.py - INFO - %%%%% running task simulation12 on swath iw2 2025-01-13 17:54:33,603 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 simulation12<< 2025-01-13 17:54:33,603 - wsc_run_gdm_sar.py - INFO - -------------- starting step 4: simulation ---------- 2025-01-13 17:54:33,603 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 simulation12, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 simulation12, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 17:54:33,603 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 simulation12 2025-01-13 17:54:33,603 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=02:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 simulation12", "name": "4_simulation12_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw1.txt"}' 2025-01-13 17:54:33,603 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=02:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 simulation12", "name": "4_simulation12_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw1.txt"}' ***** 2025-01-13 17:54:33,905 - wf_task - INFO - run with pid 1644445 2025-01-13 17:54:33,905 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 simulation12 2025-01-13 17:54:33,905 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=02:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 simulation12", "name": "4_simulation12_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw2.txt"}' 2025-01-13 17:54:33,905 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=02:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 simulation12", "name": "4_simulation12_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw2.txt"}' ***** 2025-01-13 17:54:34,217 - wf_task - INFO - run with pid 1644446 2025-01-13 17:54:34,217 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644445 2025-01-13 17:54:34,295 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644446 2025-01-13 17:54:34,338 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting'] 2025-01-13 18:04:34,339 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 18:04:34,339 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644445 2025-01-13 18:04:34,446 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644446 2025-01-13 18:04:34,498 - wf_scheduler - DEBUG - status=['Running', 'Running'] 2025-01-13 18:14:34,499 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 18:14:34,499 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644445 2025-01-13 18:14:34,579 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644446 2025-01-13 18:14:34,624 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated'] 2025-01-13 18:14:34,624 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644445 2025-01-13 18:14:34,670 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644446 2025-01-13 18:14:34,719 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 18:14:34,719 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 18:14:34,725 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw2.txt 2025-01-13 18:14:34,754 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/4_simulation12_iw1.txt 2025-01-13 18:14:34,781 - wsc_run_gdm_sar.py - INFO - ---------------> start interfero_spectraldiversity 2025-01-13 18:14:34,782 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start interfero_spectraldiversity', 'status': 'running', 'step': 'interfero_spectraldiversity', 'progress': 45} 2025-01-13 18:14:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 18:14:35,069 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 18:14:35,071 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 18:14:35,071 - wsc_run_gdm_sar.py - INFO - %%%%% running task interfero_spectraldiversity on swath iw1 2025-01-13 18:14:35,072 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 interfero_spectraldiversity<< 2025-01-13 18:14:35,072 - wsc_run_gdm_sar.py - INFO - %%%%% running task interfero_spectraldiversity on swath iw2 2025-01-13 18:14:35,072 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 interfero_spectraldiversity<< 2025-01-13 18:14:35,072 - wsc_run_gdm_sar.py - INFO - -------------- starting step 5: interfero_spectraldiversity ---------- 2025-01-13 18:14:35,072 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 interfero_spectraldiversity, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 interfero_spectraldiversity, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 18:14:35,072 - wf_scheduler - INFO - launching cmd 1/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 interfero_spectraldiversity 2025-01-13 18:14:35,072 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=05:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw1.txt"}' 2025-01-13 18:14:35,072 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=05:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw1.txt"}' ***** 2025-01-13 18:14:35,399 - wf_task - INFO - run with pid 1644447 2025-01-13 18:14:35,399 - wf_scheduler - INFO - launching cmd 2/2: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 interfero_spectraldiversity 2025-01-13 18:14:35,399 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=05:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw2.txt"}' 2025-01-13 18:14:35,399 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=05:25:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw2.txt"}' ***** 2025-01-13 18:14:35,714 - wf_task - INFO - run with pid 1644448 2025-01-13 18:14:35,714 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644447 2025-01-13 18:14:35,806 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644448 2025-01-13 18:14:35,849 - wf_scheduler - DEBUG - status=['Waiting', 'Waiting'] 2025-01-13 18:24:35,850 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 18:24:35,850 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644447 2025-01-13 18:24:36,804 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644448 2025-01-13 18:24:36,895 - wf_scheduler - DEBUG - status=['Running', 'Running'] 2025-01-13 18:34:36,896 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/2 2025-01-13 18:34:36,896 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644447 2025-01-13 18:34:36,994 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644448 2025-01-13 18:34:37,080 - wf_scheduler - DEBUG - status=['Terminated', 'Terminated'] 2025-01-13 18:34:37,080 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644447 2025-01-13 18:34:37,138 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644448 2025-01-13 18:34:37,196 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 18:34:37,196 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 18:34:37,202 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw1.txt 2025-01-13 18:34:37,250 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/5_interfero_spectraldiversity_iw2.txt 2025-01-13 18:34:37,296 - wsc_run_gdm_sar.py - INFO - -----------> start merge if needed 2025-01-13 18:34:37,297 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start merge', 'status': 'running', 'step': 'merge', 'progress': 54} 2025-01-13 18:34:37,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 18:34:37,546 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 18:34:37,548 - wsc_run_gdm_sar.py - INFO - -----------> merge is needed 2025-01-13 18:34:37,548 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 18:34:37,549 - wsc_run_gdm_sar.py - INFO - %%%%% running task merge on swath iw12 2025-01-13 18:34:37,549 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw12 12 merge<< 2025-01-13 18:34:37,549 - wsc_run_gdm_sar.py - INFO - -------------- starting step 6: merge ---------- 2025-01-13 18:34:37,549 - wf_scheduler - INFO - Async scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw12 12 merge, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 18:34:37,549 - wf_scheduler - INFO - launching cmd 1/1: source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw12 12 merge 2025-01-13 18:34:37,549 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=00:55:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw12 12 merge", "name": "6_merge_iw12_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/6_merge_iw12.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/6_merge_iw12.txt"}' 2025-01-13 18:34:37,549 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=00:55:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw12 12 merge", "name": "6_merge_iw12_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/6_merge_iw12.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/6_merge_iw12.txt"}' ***** 2025-01-13 18:34:37,904 - wf_task - INFO - run with pid 1644449 2025-01-13 18:34:37,905 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644449 2025-01-13 18:34:37,996 - wf_scheduler - DEBUG - status=['Waiting'] 2025-01-13 18:44:37,996 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2025-01-13 18:44:37,997 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644449 2025-01-13 18:44:38,094 - wf_scheduler - DEBUG - status=['Terminated'] 2025-01-13 18:44:38,094 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644449 2025-01-13 18:44:38,145 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 18:44:38,145 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 18:44:38,150 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/6_merge_iw12.txt 2025-01-13 18:44:38,165 - wsc_run_gdm_sar.py - INFO - -------------> start atmo filter unwrap 2025-01-13 18:44:38,165 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start filter_unwrap', 'status': 'running', 'step': 'filter_unwrap', 'progress': 63} 2025-01-13 18:44:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 18:44:38,406 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 18:44:38,407 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 18:44:38,408 - wsc_run_gdm_sar.py - INFO - %%%%% running task caui on swath iw1_iw2 2025-01-13 18:44:38,408 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui<< 2025-01-13 18:44:38,408 - wsc_run_gdm_sar.py - INFO - -------------- starting step 7: filter_unwrap ---------- 2025-01-13 18:44:38,408 - wf_scheduler - INFO - Sequential scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 18:44:38,408 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 18:44:38,408 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=27:01:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui", "name": "7_caui_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/7_caui_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/7_caui_iw1_iw2.txt"}' 2025-01-13 18:44:38,409 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=27:01:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui", "name": "7_caui_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/7_caui_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/7_caui_iw1_iw2.txt"}' ***** 2025-01-13 18:44:38,718 - wf_task - INFO - run with pid 1644450 2025-01-13 18:45:38,719 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:46:38,881 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:47:38,958 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:48:39,163 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:49:39,253 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:50:39,329 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:51:39,408 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:52:39,479 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:53:39,560 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:54:39,728 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:55:39,808 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:56:39,888 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:57:39,980 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:58:40,055 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 18:59:40,597 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 19:00:40,662 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644450 2025-01-13 19:00:40,744 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui is 0 2025-01-13 19:00:40,744 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsbas.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 caui, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644450 2025-01-13 19:00:40,744 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:00:40,744 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:00:40,749 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/7_caui_iw1_iw2.txt 2025-01-13 19:00:40,770 - wsc_run_gdm_sar.py - DEBUG - number of interfero 6 2025-01-13 19:00:40,770 - wsc_run_gdm_sar.py - INFO - -------------> start cleaning if requested 2025-01-13 19:00:40,771 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start cleaning_before_ts', 'status': 'running', 'step': 'timeseries', 'progress': 72} 2025-01-13 19:00:40,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:00:41,072 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:00:41,073 - wsc_run_gdm_sar.py - INFO - -------------> cleaning coreg, INTERFERO_sd and interferograms before merging 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - %%%%% running task cleaning_before_ts on swath iw1 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v<< 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - %%%%% running task cleaning_before_ts on swath iw2 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - get oartask: nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v<< 2025-01-13 19:00:41,074 - wsc_run_gdm_sar.py - INFO - -------------- starting step 8: timeseries ---------- 2025-01-13 19:00:41,074 - wf_scheduler - INFO - Sequential scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:00:41,074 - wf_scheduler - INFO - launching cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:00:41,075 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=06:46:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v", "name": "8_cleaning_before_ts_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw1.txt"}' 2025-01-13 19:00:41,075 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:46:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v", "name": "8_cleaning_before_ts_iw1_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw1.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw1.txt"}' ***** 2025-01-13 19:00:42,075 - wf_task - INFO - run with pid 1644451 2025-01-13 19:01:42,075 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644451 2025-01-13 19:01:42,352 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v is 0 2025-01-13 19:01:42,352 - wf_scheduler - INFO - done with cmd 0/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644451 2025-01-13 19:01:42,353 - wf_scheduler - INFO - launching cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:01:42,353 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=06:46:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw2.txt"}' 2025-01-13 19:01:42,353 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:46:00", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw2.txt"}' ***** 2025-01-13 19:01:42,663 - wf_task - INFO - run with pid 1644452 2025-01-13 19:02:42,663 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644452 2025-01-13 19:02:42,747 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v is 0 2025-01-13 19:02:42,747 - wf_scheduler - INFO - done with cmd 1/2: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_clean_coreg_int.py -c -s -i -t /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/nsbas.proc -v, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644452 2025-01-13 19:02:42,747 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:02:42,747 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:02:42,753 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw1.txt 2025-01-13 19:02:42,754 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/8_cleaning_before_ts_iw2.txt 2025-01-13 19:02:42,757 - wsc_run_gdm_sar.py - INFO - -------------> start time series if needed 2025-01-13 19:02:42,757 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start timeseries', 'status': 'running', 'step': 'timeseries', 'progress': 72} 2025-01-13 19:02:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:02:43,066 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:02:43,067 - wsc_run_gdm_sar.py - INFO - -------------> skipping timeseries 2025-01-13 19:02:43,067 - wsc_run_gdm_sar.py - INFO - -------------> start cleaning if requested 2025-01-13 19:02:43,068 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start time_serie', 'status': 'running', 'step': 'timeseries', 'progress': 72} 2025-01-13 19:02:43,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:02:43,303 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:02:43,304 - wsc_run_gdm_sar.py - INFO - -------------> skipping cleaning 2025-01-13 19:02:43,304 - wsc_run_gdm_sar.py - INFO - -------------> start populate and make products 2025-01-13 19:02:43,304 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'Start publish', 'status': 'running', 'step': 'make_data', 'progress': 81} 2025-01-13 19:02:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:02:43,552 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:02:43,553 - wsc_run_gdm_sar.py - DEBUG - populate ctip calcall and ltip InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw 2025-01-13 19:02:43,554 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 19:02:43,554 - wsc_run_gdm_sar.py - DEBUG - get nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA<< 2025-01-13 19:02:43,554 - wsc_run_gdm_sar.py - INFO - -------------- starting step 9: make_data ---------- 2025-01-13 19:02:43,554 - wf_scheduler - INFO - Sequential scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:02:43,554 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:02:43,554 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA", "name": "9-0_populate_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt"}' 2025-01-13 19:02:43,555 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA", "name": "9-0_populate_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt"}' ***** 2025-01-13 19:02:43,862 - wf_task - INFO - run with pid 1644453 2025-01-13 19:03:43,863 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:04:43,956 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:05:44,040 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:06:44,117 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:07:44,215 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:08:44,306 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:09:44,654 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644453 2025-01-13 19:09:44,723 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA is 0 2025-01-13 19:09:44,723 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_populate_product.sh /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 12 calcall epos -v ln -id GDMSARUGA, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644453 2025-01-13 19:09:44,723 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:09:44,723 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:09:44,729 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt 2025-01-13 19:09:44,743 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'select products', 'status': 'running', 'step': 'make_data', 'progress': 81} 2025-01-13 19:09:44,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:09:45,025 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:09:45,026 - wsc_run_gdm_sar.py - INFO - Computing on ist-oar, walltime ceiling of 480 hours 2025-01-13 19:09:45,026 - wsc_run_gdm_sar.py - INFO - get nsbas cmd = >>source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask<< 2025-01-13 19:09:45,027 - wsc_run_gdm_sar.py - INFO - -------------- starting step 9: make_data ---------- 2025-01-13 19:09:45,027 - wf_scheduler - INFO - Sequential scheduler: running command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:09:45,027 - wf_scheduler - INFO - launching cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:09:45,027 - wf_task - DEBUG - oar request: http://localhost:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "9-1_make_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-1_make_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-1_make_iw1_iw2.txt"}' 2025-01-13 19:09:45,027 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12", "command": "source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "9-1_make_iw1_iw2_93434689-5a76-4e79-b141-e15f5dc9d693", "workdir": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693", "project": "f-isdeform", "property": "network_address=\'ist-calcul17.u-ga.fr\'", "stdout": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-1_make_iw1_iw2.txt", "stderr": "/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-1_make_iw1_iw2.txt"}' ***** 2025-01-13 19:09:45,342 - wf_task - INFO - run with pid 1644454 2025-01-13 19:10:45,343 - wf_task - DEBUG - requesting : http://localhost:6668/oarapi/jobs/1644454 2025-01-13 19:10:45,415 - wf_task - INFO - ret_code for source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask is 0 2025-01-13 19:10:45,416 - wf_scheduler - INFO - done with cmd 0/1: command=source /usr/contrib/cycle/nsbas_env/env_isdeform.sh; nsb_make_data.py -s /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 -w iw1_iw2 -d /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,CosNEU_radar_runw,CosNEU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=1644454 2025-01-13 19:10:45,416 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:10:45,416 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:10:45,420 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-0_populate_iw1_iw2.txt 2025-01-13 19:10:45,431 - wsc_run_gdm_sar.py - INFO - checking /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs/9-1_make_iw1_iw2.txt 2025-01-13 19:10:45,453 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'format products', 'status': 'running', 'step': 'make_data', 'progress': 81} 2025-01-13 19:10:45,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:10:45,698 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:10:45,699 - wsc_run_gdm_sar.py - INFO - Starting building job summary... 2025-01-13 19:10:48,805 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_2rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1/20241208/geomap_quad_2rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,826 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_2rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw2/20241208/geomap_quad_2rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,850 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20241220/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,850 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20241220/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,850 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20241220/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,852 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250101/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,853 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250101/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,853 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250101/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,855 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250113/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,855 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250113/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,855 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241208_20250113/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,857 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250101/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,857 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250101/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,857 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250101/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,859 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250113/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,859 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250113/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,859 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20241220_20250113/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,861 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20250101_20250113/geomap_quad_4rlks.trans'), ignoring it's size. 2025-01-13 19:10:48,861 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20250101_20250113/geomap_quad_4rlks.trans.rsc'), ignoring it's size. 2025-01-13 19:10:48,861 - wsc_run_gdm_sar.py - WARNING - File /home/isterrem/geomap_quad_4rlks.trans.rsc.hst is not accessible ([Errno 2] No such file or directory: '/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/INTERFERO/int_20250101_20250113/geomap_quad_4rlks.trans.rsc.hst'), ignoring it's size. 2025-01-13 19:10:48,898 - wsc_run_gdm_sar.py - INFO - Building job summary done! 2025-01-13 19:10:48,903 - nsb_build_synthesis - INFO - writing to /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/0_synthesis.html 2025-01-13 19:10:48,903 - nsb_build_synthesis - INFO - launched as /mnt/contrib/cycle/gdm-sar-uga/ws/nsb_build_synthesis.py -o /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/0_synthesis.html -c /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/0_summary.json -w /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product -v 4 2025-01-13 19:10:48,903 - nsb_build_synthesis - DEBUG - getting orbit types 2025-01-13 19:10:48,904 - nsb_build_synthesis - DEBUG - getting info from summary 2025-01-13 19:10:48,905 - nsb_build_synthesis - DEBUG - getting info from summary --> Done 2025-01-13 19:10:48,909 - nsb_build_synthesis - DEBUG - building step_time_plot 2025-01-13 19:10:48,909 - nsb_build_synthesis - DEBUG - processing token: 93434689-5a76-4e79-b141-e15f5dc9d693 2025-01-13 19:10:48,910 - nsb_build_synthesis - DEBUG - data collection done, preparing plot 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - after subplot 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - step_stats keys ['1-0', '1-1', '2-0', '2-1', '3', '4', '5', '6', '7', '8', '9-0', '9-1'] 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - after sort 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - 1: before loop 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:48,990 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=download, minutes=3 2025-01-13 19:10:49,010 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,010 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=dem, minutes=1 2025-01-13 19:10:49,012 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,012 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_iw1, minutes=1 2025-01-13 19:10:49,014 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_iw2, minutes=1 2025-01-13 19:10:49,016 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,016 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=burst_select_check_iw1_iw2, minutes=1 2025-01-13 19:10:49,017 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,017 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=slice12_iw1, minutes=1 2025-01-13 19:10:49,018 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=slice12_iw2, minutes=1 2025-01-13 19:10:49,019 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,019 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=simulation12_iw1, minutes=16 2025-01-13 19:10:49,019 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=simulation12_iw2, minutes=16 2025-01-13 19:10:49,020 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,020 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=interfero_spectraldiversity_iw1, minutes=13 2025-01-13 19:10:49,021 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=interfero_spectraldiversity_iw2, minutes=14 2025-01-13 19:10:49,022 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,022 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=merge_iw12, minutes=1 2025-01-13 19:10:49,023 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,023 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=caui_iw1_iw2, minutes=15 2025-01-13 19:10:49,023 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,023 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=cleaning_before_ts_iw1, minutes=1 2025-01-13 19:10:49,024 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=cleaning_before_ts_iw2, minutes=1 2025-01-13 19:10:49,025 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,025 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=populate_iw1_iw2, minutes=6 2025-01-13 19:10:49,026 - nsb_build_synthesis - DEBUG - 1.1: in loop step_num={step_num} 2025-01-13 19:10:49,026 - nsb_build_synthesis - DEBUG - 1.2: in loop 2 step_name=make_iw1_iw2, minutes=1 2025-01-13 19:10:49,027 - nsb_build_synthesis - DEBUG - 2: after loop 2025-01-13 19:10:49,047 - nsb_build_synthesis - DEBUG - 3: computes nb minutes max_minutes={max_minutes} 2025-01-13 19:10:49,064 - nsb_build_synthesis - DEBUG - 4: after max_minutes 2025-01-13 19:10:49,141 - nsb_build_synthesis - DEBUG - 5: before save fig 1 2025-01-13 19:10:50,043 - nsb_build_synthesis - DEBUG - 6: before save fig 2 2025-01-13 19:10:50,252 - nsb_build_synthesis - DEBUG - 6: build_step_time_plot DONE 2025-01-13 19:10:50,252 - nsb_build_synthesis - DEBUG - building step_time_plot --> DONE 2025-01-13 19:10:50,254 - nsb_build_synthesis - INFO - DONE with ret_code 0 2025-01-13 19:10:50,254 - wsc_run_gdm_sar.py - INFO - build_synthesis done: going to publish step 2025-01-13 19:10:50,254 - wsc_run_gdm_sar.py - INFO - task created [, ] 2025-01-13 19:10:50,254 - wsc_run_gdm_sar.py - INFO - scheduled created 2025-01-13 19:10:50,254 - wsc_run_gdm_sar.py - INFO - notifying 2025-01-13 19:10:50,255 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'publish products', 'status': 'running', 'step': 'publish', 'progress': 90} 2025-01-13 19:10:50,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443 2025-01-13 19:10:50,488 - urllib3.connectionpool - DEBUG - https://gdm.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/11" 200 None 2025-01-13 19:10:50,489 - wsc_run_gdm_sar.py - INFO - running publish 2025-01-13 19:10:50,490 - wsc_run_gdm_sar.py - INFO - -------------- starting step 10: publish ---------- 2025-01-13 19:10:50,490 - wf_scheduler - INFO - Sequential scheduler: running command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:10:50,490 - wf_scheduler - INFO - launching cmd 0/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:10:50,490 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:10:50,490 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:10:51,217 - wf_task - INFO - ret_code for rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ is 0 2025-01-13 19:10:51,218 - wf_scheduler - INFO - done with cmd 0/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=2821520 2025-01-13 19:10:51,218 - wf_scheduler - INFO - launching cmd 1/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=None 2025-01-13 19:10:51,218 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:10:51,218 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:12:44,861 - wf_task - INFO - ret_code for rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ is 0 2025-01-13 19:12:44,861 - wf_scheduler - INFO - done with cmd 1/2: command=rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/ formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/iw1_iw2/Product/backup_product.json formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/, workdir=/data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693 id=2821523 2025-01-13 19:12:44,861 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ 2025-01-13 19:12:44,861 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693/logs formater.osug:/data/gdm-sar-uga/93434689-5a76-4e79-b141-e15f5dc9d693/ (from directory /data/ist-calcul17/local/gdm-sar/93434689-5a76-4e79-b141-e15f5dc9d693) 2025-01-13 19:12:44,867 - wsc_run_gdm_sar.py - DEBUG - notify: sending notification to https://gdm.poleterresolide.fr/scripts/setStatus with data={'process_token': '93434689-5a76-4e79-b141-e15f5dc9d693', 'log': 'workflow done', 'status': 'terminated', 'step': 'publish', 'progress': 90} 2025-01-13 19:12:44,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm.poleterresolide.fr:443