2022-07-03 14:43:35,097 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar//f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start workflow 2022-07-03 14:43:35,102 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar//f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - swath final is iw1_iw2_iw3 2022-07-03 14:43:35,104 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start workflow 2022-07-03 14:43:35,112 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start DOWNLOAD', 'status': 'running', 'step': 'download', 'progress': 8} 2022-07-03 14:43:35,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 14:43:35,370 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 14:43:35,377 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 14:43:35,379 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - peps download cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json<<< 2022-07-03 14:43:35,384 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 14:43:35,386 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get dem cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV<< 2022-07-03 14:43:35,387 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 1: download ---------- 2022-07-03 14:43:35,389 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 14:43:35,390 - wf_scheduler - INFO - launching cmd 0/2: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 14:43:35,392 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json", "name": "1-0_download_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt"}' 2022-07-03 14:43:35,394 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json", "name": "1-0_download_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt"}' ***** 2022-07-03 14:43:36,479 - wf_task - INFO - run with pid 21606561 2022-07-03 14:44:36,541 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:45:36,603 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:46:36,647 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:47:36,742 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:48:36,837 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:49:42,147 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:50:42,243 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:51:42,337 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:52:42,435 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:53:42,531 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:54:42,627 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:55:42,722 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:56:42,818 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:57:42,915 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:58:43,014 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 14:59:43,110 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:00:43,205 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:01:43,302 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:02:43,397 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:03:43,491 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:04:44,817 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:05:44,910 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:06:45,005 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:07:45,091 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:08:46,453 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:09:46,547 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:10:46,642 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:11:46,738 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:12:48,068 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:13:48,185 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:14:48,227 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:15:48,321 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:16:53,634 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:17:53,729 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:18:53,826 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:19:53,919 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:20:54,014 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:20:54,047 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json is 0 2022-07-03 15:20:54,049 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:20:54,078 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606561 2022-07-03 15:20:54,103 - wf_scheduler - INFO - done with cmd 0/2: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wsc_downloadPepsData.py -wd /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -v 4 -j 2 -c /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/configs/nsbas_config.json, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21606561 2022-07-03 15:20:54,104 - wf_scheduler - INFO - launching cmd 1/2: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:20:54,105 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=09:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV", "name": "1-1_dem_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt"}' 2022-07-03 15:20:54,106 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=09:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV", "name": "1-1_dem_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt"}' ***** 2022-07-03 15:20:55,179 - wf_task - INFO - run with pid 21606619 2022-07-03 15:21:55,240 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606619 2022-07-03 15:22:55,336 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606619 2022-07-03 15:23:56,697 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606619 2022-07-03 15:23:56,734 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV is 0 2022-07-03 15:23:56,735 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606619 2022-07-03 15:23:56,768 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606619 2022-07-03 15:23:56,800 - wf_scheduler - INFO - done with cmd 1/2: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_getDemFile.py -k -s NASADEM_HGT.001 -v 4 -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/DEM --safe /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/SAFE -p VV, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21606619 2022-07-03 15:23:56,806 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt 2022-07-03 15:23:56,834 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt 2022-07-03 15:23:56,914 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:23:56,916 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:23:56,920 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start mkworkdir 2022-07-03 15:23:56,923 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 15:23:56,924 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task workdir vv on swath iw1 2022-07-03 15:23:56,925 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get process task: nsbas cmd = >>nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 workdir vv<< 2022-07-03 15:23:56,926 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task workdir vv on swath iw2 2022-07-03 15:23:56,927 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get process task: nsbas cmd = >>nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 workdir vv<< 2022-07-03 15:23:56,928 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task workdir vv on swath iw3 2022-07-03 15:23:56,929 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get process task: nsbas cmd = >>nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 workdir vv<< 2022-07-03 15:23:56,930 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 1: download ---------- 2022-07-03 15:23:56,930 - wf_scheduler - INFO - Async scheduler: running command=nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 workdir vv, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 workdir vv, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 workdir vv, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:23:56,931 - wf_scheduler - INFO - launching cmd 1/3: nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 workdir vv 2022-07-03 15:23:56,932 - wf_task - INFO - running nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 workdir vv 2022-07-03 15:23:56,933 - wf_task - DEBUG - process-task: running command nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 workdir vv (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:23:56,937 - wf_scheduler - DEBUG - ['Running', 'Waiting', 'Waiting'] 2022-07-03 15:23:56,938 - wf_scheduler - DEBUG - ['Running', 'Waiting', 'Waiting'] 2022-07-03 15:23:56,939 - wf_scheduler - DEBUG - nb_running = 1 2022-07-03 15:23:56,940 - wf_scheduler - DEBUG - nb running=1 in_queue=1 .... max par=50 2022-07-03 15:23:56,940 - wf_scheduler - DEBUG - ['Running', 'Waiting', 'Waiting'] 2022-07-03 15:23:56,941 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:23:56,942 - wf_scheduler - INFO - launching cmd 2/3: nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 workdir vv 2022-07-03 15:23:56,943 - wf_task - INFO - running nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 workdir vv 2022-07-03 15:23:56,943 - wf_task - DEBUG - process-task: running command nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 workdir vv (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:23:56,947 - wf_scheduler - DEBUG - ['Running', 'Running', 'Waiting'] 2022-07-03 15:23:56,948 - wf_scheduler - DEBUG - ['Running', 'Running', 'Waiting'] 2022-07-03 15:23:56,949 - wf_scheduler - DEBUG - nb_running = 2 2022-07-03 15:23:56,950 - wf_scheduler - DEBUG - nb running=2 in_queue=2 .... max par=50 2022-07-03 15:23:56,950 - wf_scheduler - DEBUG - ['Running', 'Running', 'Waiting'] 2022-07-03 15:23:56,951 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:23:56,952 - wf_scheduler - INFO - launching cmd 3/3: nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 workdir vv 2022-07-03 15:23:56,953 - wf_task - INFO - running nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 workdir vv 2022-07-03 15:23:56,954 - wf_task - DEBUG - process-task: running command nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 workdir vv (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:23:56,957 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:23:56,958 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:23:56,959 - wf_scheduler - DEBUG - nb_running = 3 2022-07-03 15:23:56,960 - wf_scheduler - DEBUG - nb running=3 in_queue=3 .... max par=50 2022-07-03 15:23:56,961 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:23:56,961 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:23:56,962 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:24:06,973 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:24:06,975 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:24:06,976 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:24:16,987 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:24:16,989 - wf_scheduler - DEBUG - nb_done/nb_todo = 3/3 2022-07-03 15:24:16,990 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:24:16,991 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:24:16,992 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:24:17,000 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-1_get_dem.txt 2022-07-03 15:24:17,024 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/1-0_peps_download.txt 2022-07-03 15:24:17,107 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - updating procfile /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc 2022-07-03 15:24:17,108 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing profile keys: atmo -> ERAW, unw_method -> mpd, polarisation -> VV 2022-07-03 15:24:17,109 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing lat bounds to 35, 36.5 2022-07-03 15:24:17,110 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing polarisation bounds to vv 2022-07-03 15:24:17,111 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing atmo paramater to ERAW 2022-07-03 15:24:17,112 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing rint and runw by 4 and 8 2022-07-03 15:24:17,113 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing unw_method by mpd 2022-07-03 15:24:17,113 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Seed point not given by user 2022-07-03 15:24:17,114 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - setting CheckUnwFrac to yes 2022-07-03 15:24:17,115 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Individual configuration for bertrand.lovery@univ-grenoble-alpes.fr done 2022-07-03 15:24:17,116 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - expert_param_list are ['PowerMode', 'cluster=dahu_silenus'] 2022-07-03 15:24:17,117 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - expert mode cluster as dahu_silenus 2022-07-03 15:24:17,122 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - updating procfile /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc 2022-07-03 15:24:17,123 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing profile keys: atmo -> ERAW, unw_method -> mpd, polarisation -> VV 2022-07-03 15:24:17,124 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing lat bounds to 35, 36.5 2022-07-03 15:24:17,125 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing polarisation bounds to vv 2022-07-03 15:24:17,126 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing atmo paramater to ERAW 2022-07-03 15:24:17,127 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing rint and runw by 4 and 8 2022-07-03 15:24:17,127 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing unw_method by mpd 2022-07-03 15:24:17,128 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Seed point not given by user 2022-07-03 15:24:17,129 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - setting CheckUnwFrac to yes 2022-07-03 15:24:17,130 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Individual configuration for bertrand.lovery@univ-grenoble-alpes.fr done 2022-07-03 15:24:17,131 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - expert_param_list are ['PowerMode', 'cluster=dahu_silenus'] 2022-07-03 15:24:17,132 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - expert mode cluster as dahu_silenus 2022-07-03 15:24:17,137 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - updating procfile /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc 2022-07-03 15:24:17,138 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing profile keys: atmo -> ERAW, unw_method -> mpd, polarisation -> VV 2022-07-03 15:24:17,139 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing lat bounds to 35, 36.5 2022-07-03 15:24:17,140 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing polarisation bounds to vv 2022-07-03 15:24:17,141 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing atmo paramater to ERAW 2022-07-03 15:24:17,141 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing rint and runw by 4 and 8 2022-07-03 15:24:17,142 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - changing unw_method by mpd 2022-07-03 15:24:17,143 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Seed point not given by user 2022-07-03 15:24:17,144 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - setting CheckUnwFrac to yes 2022-07-03 15:24:17,145 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Individual configuration for bertrand.lovery@univ-grenoble-alpes.fr done 2022-07-03 15:24:17,145 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - expert_param_list are ['PowerMode', 'cluster=dahu_silenus'] 2022-07-03 15:24:17,146 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - expert mode cluster as dahu_silenus 2022-07-03 15:24:17,149 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - ---------------> start burst_select 2022-07-03 15:24:17,152 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start make_slc', 'status': 'running', 'step': 'burst_select', 'progress': 16} 2022-07-03 15:24:17,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 15:24:17,429 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 15:24:17,436 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 15:24:17,438 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task burst_select on swath iw1 2022-07-03 15:24:17,439 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 2 burst_select<< 2022-07-03 15:24:17,440 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task burst_select on swath iw2 2022-07-03 15:24:17,441 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 2 burst_select<< 2022-07-03 15:24:17,442 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task burst_select on swath iw3 2022-07-03 15:24:17,444 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 2 burst_select<< 2022-07-03 15:24:17,445 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 2: burst_select ---------- 2022-07-03 15:24:17,446 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 2 burst_select, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 2 burst_select, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 2 burst_select, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:24:17,447 - wf_scheduler - INFO - launching cmd 1/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 2 burst_select 2022-07-03 15:24:17,448 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 2 burst_select", "name": "2-0_burst_select_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt"}' 2022-07-03 15:24:17,449 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 2 burst_select", "name": "2-0_burst_select_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt"}' ***** 2022-07-03 15:24:18,544 - wf_task - INFO - run with pid 21606628 2022-07-03 15:24:18,545 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606628 2022-07-03 15:24:18,575 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:18,576 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:18,577 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:24:18,578 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 15:24:18,579 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:18,580 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:24:18,581 - wf_scheduler - INFO - launching cmd 2/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 2 burst_select 2022-07-03 15:24:18,582 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 2 burst_select", "name": "2-0_burst_select_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt"}' 2022-07-03 15:24:18,583 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 2 burst_select", "name": "2-0_burst_select_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt"}' ***** 2022-07-03 15:24:19,648 - wf_task - INFO - run with pid 21606629 2022-07-03 15:24:19,649 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:19,650 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:19,651 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:24:19,652 - wf_scheduler - DEBUG - nb running=0 in_queue=2 .... max par=50 2022-07-03 15:24:19,653 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:19,654 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:24:19,655 - wf_scheduler - INFO - launching cmd 3/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 2 burst_select 2022-07-03 15:24:19,656 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 2 burst_select", "name": "2-0_burst_select_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt"}' 2022-07-03 15:24:19,657 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 2 burst_select", "name": "2-0_burst_select_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt"}' ***** 2022-07-03 15:24:21,001 - wf_task - INFO - run with pid 21606630 2022-07-03 15:24:21,003 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:21,004 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:21,005 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:24:21,005 - wf_scheduler - DEBUG - nb running=0 in_queue=3 .... max par=50 2022-07-03 15:24:21,006 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:21,007 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:24:21,008 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:31,019 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:31,020 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:24:31,022 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:41,033 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:41,034 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:24:41,035 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:51,047 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:24:51,048 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:24:51,049 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:25:01,060 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:25:01,062 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:25:01,063 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:25:11,074 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:25:11,076 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:25:11,077 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:25:21,088 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606628 2022-07-03 15:25:21,123 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606629 2022-07-03 15:25:21,149 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606630 2022-07-03 15:25:21,172 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:25:21,173 - wf_scheduler - DEBUG - nb_done/nb_todo = 3/3 2022-07-03 15:25:21,174 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:25:21,175 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606628 2022-07-03 15:25:21,197 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606629 2022-07-03 15:25:21,226 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606630 2022-07-03 15:25:21,259 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:25:21,260 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:25:21,269 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt 2022-07-03 15:25:21,280 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt 2022-07-03 15:25:21,286 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt 2022-07-03 15:25:21,293 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wf_check_commons_date.py -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -m slice123 -v 4<< 2022-07-03 15:25:21,294 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 2: burst_select ---------- 2022-07-03 15:25:21,294 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wf_check_commons_date.py -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -m slice123 -v 4, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:25:21,295 - wf_scheduler - INFO - launching cmd 1/1: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wf_check_commons_date.py -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -m slice123 -v 4 2022-07-03 15:25:21,296 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wf_check_commons_date.py -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -m slice123 -v 4", "name": "2-1_burst_select_check_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-1_burst_select_check_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-1_burst_select_check_iw1_iw2_iw3.txt"}' 2022-07-03 15:25:21,297 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=2,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; wf_check_commons_date.py -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -m slice123 -v 4", "name": "2-1_burst_select_check_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-1_burst_select_check_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-1_burst_select_check_iw1_iw2_iw3.txt"}' ***** 2022-07-03 15:25:22,433 - wf_task - INFO - run with pid 21606634 2022-07-03 15:25:22,435 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606634 2022-07-03 15:25:22,463 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:22,465 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:22,466 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:25:22,467 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 15:25:22,468 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:22,469 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:25:22,470 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:32,481 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:32,483 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 15:25:32,484 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:42,496 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:42,497 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 15:25:42,499 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:52,510 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:25:52,512 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 15:25:52,513 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:26:02,524 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:26:02,526 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 15:26:02,527 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:26:12,538 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:26:12,539 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 15:26:12,541 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 15:26:22,552 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606634 2022-07-03 15:26:22,585 - wf_scheduler - DEBUG - ['Terminated'] 2022-07-03 15:26:22,586 - wf_scheduler - DEBUG - nb_done/nb_todo = 1/1 2022-07-03 15:26:22,587 - wf_scheduler - DEBUG - ['Terminated'] 2022-07-03 15:26:22,588 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606634 2022-07-03 15:26:22,620 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:26:22,621 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:26:22,631 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw3.txt 2022-07-03 15:26:22,642 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw2.txt 2022-07-03 15:26:22,648 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-1_burst_select_check_iw1_iw2_iw3.txt 2022-07-03 15:26:22,651 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/2-0_burst_select_iw1.txt 2022-07-03 15:26:22,657 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - ---------------> start slice 2022-07-03 15:26:22,659 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start slice', 'status': 'running', 'step': 'make_slc', 'progress': 25} 2022-07-03 15:26:22,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 15:26:22,922 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 15:26:22,925 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 15:26:22,927 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task slice123 on swath iw1 2022-07-03 15:26:22,928 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 slice123<< 2022-07-03 15:26:22,928 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task slice123 on swath iw2 2022-07-03 15:26:22,929 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 slice123<< 2022-07-03 15:26:22,930 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task slice123 on swath iw3 2022-07-03 15:26:22,931 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 slice123<< 2022-07-03 15:26:22,932 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 3: make_slc ---------- 2022-07-03 15:26:22,932 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 slice123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 slice123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 slice123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:26:22,933 - wf_scheduler - INFO - launching cmd 1/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 slice123 2022-07-03 15:26:22,934 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 slice123", "name": "3_slice123_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw1.txt"}' 2022-07-03 15:26:22,935 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 slice123", "name": "3_slice123_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw1.txt"}' ***** 2022-07-03 15:26:24,026 - wf_task - INFO - run with pid 21606636 2022-07-03 15:26:24,027 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606636 2022-07-03 15:26:24,057 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:24,059 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:24,059 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:26:24,060 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 15:26:24,061 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:24,062 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:26:24,063 - wf_scheduler - INFO - launching cmd 2/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 slice123 2022-07-03 15:26:24,064 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 slice123", "name": "3_slice123_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw2.txt"}' 2022-07-03 15:26:24,065 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 slice123", "name": "3_slice123_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw2.txt"}' ***** 2022-07-03 15:26:25,164 - wf_task - INFO - run with pid 21606637 2022-07-03 15:26:25,165 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:25,166 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:25,167 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:26:25,168 - wf_scheduler - DEBUG - nb running=0 in_queue=2 .... max par=50 2022-07-03 15:26:25,169 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:25,170 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:26:25,170 - wf_scheduler - INFO - launching cmd 3/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 slice123 2022-07-03 15:26:25,171 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 slice123", "name": "3_slice123_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw3.txt"}' 2022-07-03 15:26:25,172 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=06:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 slice123", "name": "3_slice123_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw3.txt"}' ***** 2022-07-03 15:26:26,289 - wf_task - INFO - run with pid 21606638 2022-07-03 15:26:26,291 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:26,291 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:26,292 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:26:26,293 - wf_scheduler - DEBUG - nb running=0 in_queue=3 .... max par=50 2022-07-03 15:26:26,294 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:26,295 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:26:26,296 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:36,307 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:36,308 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:26:36,309 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:46,321 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:46,322 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:26:46,323 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:56,334 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:26:56,336 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:26:56,337 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:27:06,349 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:27:06,350 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:06,351 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:27:16,362 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:27:16,363 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:16,364 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:27:26,375 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606636 2022-07-03 15:27:26,411 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606637 2022-07-03 15:27:26,443 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606638 2022-07-03 15:27:26,477 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:26,478 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:26,478 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:36,489 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:36,491 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:36,492 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:46,503 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:46,505 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:46,506 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:56,517 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:27:56,519 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:27:56,520 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:06,531 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:06,532 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:06,534 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:16,545 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:16,546 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:16,547 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:26,559 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606636 2022-07-03 15:28:26,593 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606637 2022-07-03 15:28:26,625 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606638 2022-07-03 15:28:26,655 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:26,656 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:26,658 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:36,669 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:36,670 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:36,672 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:46,683 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:46,685 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:46,686 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:56,698 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:28:56,699 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:28:56,701 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:29:06,713 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:29:06,715 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:29:06,716 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:29:16,728 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:29:16,729 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:29:16,731 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:29:26,742 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606636 2022-07-03 15:29:26,776 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606637 2022-07-03 15:29:26,810 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606638 2022-07-03 15:29:26,839 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:26,841 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:29:26,842 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:36,854 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:36,855 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:29:36,857 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:46,868 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:46,870 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:29:46,872 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:56,884 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:29:56,886 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:29:56,888 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:30:06,900 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:30:06,902 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:30:06,903 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:30:16,914 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:30:16,916 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:30:16,918 - wf_scheduler - DEBUG - ['Terminated', 'Finishing', 'Terminated'] 2022-07-03 15:30:26,930 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606637 2022-07-03 15:30:26,965 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:30:26,966 - wf_scheduler - DEBUG - nb_done/nb_todo = 3/3 2022-07-03 15:30:26,968 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:30:26,969 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606636 2022-07-03 15:30:26,998 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606637 2022-07-03 15:30:27,030 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606638 2022-07-03 15:30:27,059 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:30:27,061 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:30:27,072 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw2.txt 2022-07-03 15:30:27,090 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw1.txt 2022-07-03 15:30:27,101 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/3_slice123_iw3.txt 2022-07-03 15:30:27,110 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - ---------------> start simulation 2022-07-03 15:30:27,115 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start simulation', 'status': 'running', 'step': 'simulation', 'progress': 33} 2022-07-03 15:30:27,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 15:30:27,380 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 15:30:27,387 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 15:30:27,389 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task simulation123 on swath iw1 2022-07-03 15:30:27,390 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 simulation123<< 2022-07-03 15:30:27,391 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task simulation123 on swath iw2 2022-07-03 15:30:27,392 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 simulation123<< 2022-07-03 15:30:27,394 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task simulation123 on swath iw3 2022-07-03 15:30:27,395 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 simulation123<< 2022-07-03 15:30:27,396 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 4: simulation ---------- 2022-07-03 15:30:27,397 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 simulation123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 simulation123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 simulation123, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:30:27,398 - wf_scheduler - INFO - launching cmd 1/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 simulation123 2022-07-03 15:30:27,399 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 simulation123", "name": "4_simulation123_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw1.txt"}' 2022-07-03 15:30:27,401 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 simulation123", "name": "4_simulation123_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw1.txt"}' ***** 2022-07-03 15:30:28,508 - wf_task - INFO - run with pid 21606647 2022-07-03 15:30:28,510 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:30:28,540 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:28,542 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:28,543 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:30:28,545 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 15:30:28,546 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:28,547 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:30:28,548 - wf_scheduler - INFO - launching cmd 2/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 simulation123 2022-07-03 15:30:28,550 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 simulation123", "name": "4_simulation123_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw2.txt"}' 2022-07-03 15:30:28,551 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 simulation123", "name": "4_simulation123_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw2.txt"}' ***** 2022-07-03 15:30:29,621 - wf_task - INFO - run with pid 21606648 2022-07-03 15:30:29,622 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:29,624 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:29,625 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:30:29,627 - wf_scheduler - DEBUG - nb running=0 in_queue=2 .... max par=50 2022-07-03 15:30:29,628 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:29,629 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:30:29,630 - wf_scheduler - INFO - launching cmd 3/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 simulation123 2022-07-03 15:30:29,631 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 simulation123", "name": "4_simulation123_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw3.txt"}' 2022-07-03 15:30:29,633 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=12:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 simulation123", "name": "4_simulation123_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw3.txt"}' ***** 2022-07-03 15:30:30,772 - wf_task - INFO - run with pid 21606649 2022-07-03 15:30:30,773 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:30,775 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:30,776 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:30:30,777 - wf_scheduler - DEBUG - nb running=0 in_queue=3 .... max par=50 2022-07-03 15:30:30,778 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:30,779 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:30:30,780 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:40,791 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:40,793 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:30:40,794 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:50,806 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:30:50,807 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:30:50,808 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:00,820 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:00,822 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:00,823 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:10,834 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:10,836 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:10,837 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:20,849 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:20,851 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:20,852 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:31:30,864 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:31:31,005 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:31:31,517 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:31:31,549 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:31:31,550 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:31,551 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:31:41,562 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:31:41,564 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:41,566 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:31:51,577 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:31:51,579 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:31:51,580 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:01,592 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:01,593 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:01,595 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:11,606 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:11,608 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:11,609 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:21,620 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:21,622 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:21,624 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:31,635 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:32:31,671 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:32:31,702 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:32:31,727 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:31,729 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:31,730 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:41,742 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:41,743 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:41,744 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:51,756 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:32:51,758 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:32:51,759 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:01,770 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:01,772 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:01,774 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:11,785 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:11,787 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:11,789 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:21,801 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:21,803 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:21,804 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:31,816 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:33:31,851 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:33:31,880 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:33:31,906 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:31,908 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:31,910 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:41,921 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:41,923 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:41,925 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:51,936 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:33:51,938 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:33:51,940 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:01,951 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:01,953 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:01,954 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:11,966 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:11,968 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:11,970 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:21,981 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:21,983 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:21,985 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:31,997 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:34:32,296 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:34:32,330 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:34:32,362 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:32,364 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:32,365 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:42,377 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:42,379 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:42,381 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:52,393 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:34:52,394 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:34:52,396 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:02,408 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:02,409 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:02,411 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:12,422 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:12,424 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:12,425 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:22,436 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:22,438 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:22,440 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:32,451 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:35:32,487 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:35:32,519 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:35:32,546 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:32,548 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:32,549 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:42,561 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:42,562 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:42,564 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:52,576 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:35:52,577 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:35:52,579 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:02,590 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:02,592 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:02,594 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:12,605 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:12,607 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:12,609 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:22,621 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:22,622 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:22,623 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:32,635 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:36:32,670 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:36:32,701 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:36:32,736 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:32,737 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:32,739 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:42,750 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:42,752 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:42,754 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:52,765 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:36:52,767 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:36:52,769 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:02,781 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:02,783 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:02,784 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:12,796 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:12,798 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:12,800 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:22,811 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:22,813 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:22,814 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:32,826 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:37:32,861 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:37:32,890 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:37:32,920 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:32,922 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:32,923 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:42,935 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:42,937 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:42,938 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:52,950 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:37:52,951 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:37:52,953 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:02,965 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:02,966 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:02,968 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:12,980 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:12,981 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:12,983 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:22,995 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:22,997 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:22,998 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:33,010 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:38:33,046 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:38:33,078 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:38:33,106 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:33,108 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:33,110 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:43,121 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:43,123 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:43,124 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:53,136 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:38:53,138 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:38:53,139 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:03,151 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:03,152 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:03,154 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:13,165 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:18,212 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:18,213 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:28,225 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:28,226 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:28,228 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:38,239 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:39:39,547 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:39:39,579 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:39:39,610 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:39,612 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:39,613 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:49,624 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:49,626 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:49,627 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:59,638 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:39:59,639 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:39:59,640 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:09,652 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:09,653 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:09,654 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:19,665 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:19,667 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:19,668 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:29,679 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:29,680 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:29,681 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:39,693 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:40:39,725 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:40:39,760 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:40:39,793 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:39,794 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:39,795 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:49,806 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:49,808 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:49,809 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:59,820 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:40:59,822 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:40:59,823 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:09,835 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:09,836 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:41:09,837 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:19,848 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:19,850 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:41:19,851 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:29,862 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:29,863 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:41:29,864 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:39,875 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:41:39,910 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:41:39,940 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:41:39,971 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:39,972 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:41:39,973 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:49,984 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:49,986 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:41:49,987 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:41:59,998 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:00,000 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:00,001 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:10,012 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:10,014 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:10,015 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:20,026 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:20,028 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:20,029 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:30,040 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:30,042 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:30,043 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:40,055 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:42:40,089 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:42:40,123 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:42:40,155 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:40,156 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:40,157 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:50,168 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:42:50,170 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:42:50,171 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:00,183 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:00,184 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:00,185 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:10,197 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:10,198 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:10,199 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:20,210 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:20,212 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:20,213 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:30,225 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:30,226 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:30,227 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:40,238 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:43:40,273 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:43:40,306 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:43:40,340 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:40,341 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:40,343 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:50,354 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:43:50,355 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:43:50,357 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:00,368 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:00,370 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:00,371 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:10,382 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:10,383 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:10,385 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:20,396 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:20,398 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:20,399 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:30,410 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:30,411 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:30,413 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:40,424 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:44:40,458 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:44:40,488 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:44:40,522 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:40,524 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:40,525 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:50,537 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:44:50,538 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:44:50,539 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:00,550 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:00,552 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:00,553 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:10,565 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:10,566 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:10,567 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:20,579 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:20,580 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:20,581 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:30,593 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:30,594 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:30,595 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:40,607 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:45:40,642 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:45:40,674 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:45:40,708 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:40,709 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:40,710 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:50,721 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:45:50,759 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:45:50,761 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:00,773 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:00,774 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:00,775 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:10,786 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:10,880 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:11,025 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:21,036 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:21,038 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:21,039 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:31,050 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:31,051 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:31,052 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:46,238 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:46:46,274 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:46:46,307 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:46:46,340 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:46,341 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:46,342 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:56,353 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:46:56,355 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:46:56,356 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:06,367 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:06,368 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:06,369 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:16,380 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:16,382 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:16,382 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:26,393 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:26,395 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:26,395 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:36,406 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:36,408 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:36,409 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:46,420 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:47:46,456 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:47:46,490 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:47:46,524 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:46,525 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:46,526 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:56,537 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:47:56,539 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:47:56,540 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:06,551 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:06,570 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:06,571 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:16,582 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:16,712 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:16,714 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:27,098 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:27,100 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:27,101 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:37,112 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:37,113 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:37,114 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:47,125 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:48:47,161 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:48:47,195 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:48:47,228 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:47,229 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:47,230 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:57,241 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:48:57,242 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:48:57,243 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:07,254 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:07,256 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:07,257 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:17,268 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:17,269 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:17,270 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:27,282 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:27,283 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:27,284 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:37,295 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:37,296 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:37,297 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:47,309 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:49:47,344 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:49:47,378 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:49:47,412 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:47,413 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:47,414 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:57,425 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:49:57,426 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:49:57,427 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:07,438 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:07,439 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:07,441 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:17,452 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:17,453 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:17,455 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:27,466 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:27,467 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:27,469 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:37,480 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:37,481 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:37,482 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:47,493 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:50:47,528 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:50:47,565 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:50:47,596 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:47,597 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:47,598 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:57,609 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:50:57,610 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:50:57,611 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:07,622 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:07,624 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:07,625 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:17,636 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:17,637 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:17,639 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:27,650 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:27,652 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:27,653 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:37,664 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:37,666 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:37,666 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:47,678 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:51:47,712 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:51:47,746 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:51:47,775 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:47,776 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:47,777 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:57,788 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:51:57,789 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:51:57,790 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:07,802 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:07,803 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:52:07,804 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:17,815 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:17,817 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:52:17,818 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:27,830 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:27,831 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:52:27,832 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:37,844 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:37,845 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:52:37,846 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:52:47,858 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:52:47,893 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:52:47,925 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:52:47,956 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:52:47,957 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:52:47,958 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:52:57,969 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:52:57,970 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:52:57,971 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:07,983 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:07,984 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:53:07,985 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:17,997 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:17,998 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:53:17,999 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:28,011 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:28,012 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:53:28,013 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:38,024 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:38,026 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 15:53:38,027 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 15:53:48,039 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:53:48,075 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:53:48,077 - wf_scheduler - DEBUG - nb_done/nb_todo = 3/3 2022-07-03 15:53:48,078 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 15:53:48,079 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606647 2022-07-03 15:53:48,113 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606648 2022-07-03 15:53:48,146 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606649 2022-07-03 15:53:48,181 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 15:53:48,183 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 15:53:48,195 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw2.txt 2022-07-03 15:53:48,282 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw3.txt 2022-07-03 15:53:48,366 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/4_simulation123_iw1.txt 2022-07-03 15:53:48,437 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - ---------------> start interfero_spectraldiversity 2022-07-03 15:53:48,442 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start interfero_spectraldiversity', 'status': 'running', 'step': 'interfero_spectraldiversity', 'progress': 41} 2022-07-03 15:53:48,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 15:53:48,722 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 15:53:48,730 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 15:53:48,732 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task interfero_spectraldiversity on swath iw1 2022-07-03 15:53:48,733 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 interfero_spectraldiversity<< 2022-07-03 15:53:48,734 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task interfero_spectraldiversity on swath iw2 2022-07-03 15:53:48,735 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 interfero_spectraldiversity<< 2022-07-03 15:53:48,736 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task interfero_spectraldiversity on swath iw3 2022-07-03 15:53:48,738 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 interfero_spectraldiversity<< 2022-07-03 15:53:48,739 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 5: interfero_spectraldiversity ---------- 2022-07-03 15:53:48,740 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 interfero_spectraldiversity, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 interfero_spectraldiversity, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 interfero_spectraldiversity, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 15:53:48,741 - wf_scheduler - INFO - launching cmd 1/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 interfero_spectraldiversity 2022-07-03 15:53:48,742 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw1.txt"}' 2022-07-03 15:53:48,743 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw1.txt"}' ***** 2022-07-03 15:53:49,887 - wf_task - INFO - run with pid 21606686 2022-07-03 15:53:49,888 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:53:49,921 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:49,922 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:49,923 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:53:49,924 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 15:53:49,925 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:49,926 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:53:49,927 - wf_scheduler - INFO - launching cmd 2/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 interfero_spectraldiversity 2022-07-03 15:53:49,928 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw2.txt"}' 2022-07-03 15:53:49,929 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw2.txt"}' ***** 2022-07-03 15:53:51,022 - wf_task - INFO - run with pid 21606687 2022-07-03 15:53:51,023 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:51,025 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:51,026 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:53:51,027 - wf_scheduler - DEBUG - nb running=0 in_queue=2 .... max par=50 2022-07-03 15:53:51,028 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:51,029 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:53:51,030 - wf_scheduler - INFO - launching cmd 3/3: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 interfero_spectraldiversity 2022-07-03 15:53:51,031 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw3.txt"}' 2022-07-03 15:53:51,032 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=45:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3 12 interfero_spectraldiversity", "name": "5_interfero_spectraldiversity_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw3.txt"}' ***** 2022-07-03 15:53:52,118 - wf_task - INFO - run with pid 21606688 2022-07-03 15:53:52,119 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:52,120 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:52,121 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 15:53:52,122 - wf_scheduler - DEBUG - nb running=0 in_queue=3 .... max par=50 2022-07-03 15:53:52,123 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:53:52,124 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 15:53:52,125 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:02,136 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:02,137 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:02,139 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:12,151 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:12,152 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:12,153 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:22,164 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:22,166 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:22,167 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:32,178 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:37,253 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:37,254 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:47,265 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:47,267 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:47,268 - wf_scheduler - DEBUG - ['Waiting', 'Waiting', 'Waiting'] 2022-07-03 15:54:57,280 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:54:57,315 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:54:57,349 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:54:57,381 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:54:57,383 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:54:57,384 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:07,396 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:07,397 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:07,399 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:17,410 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:17,412 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:17,413 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:27,425 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:27,427 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:27,428 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:37,439 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:37,440 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:37,441 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:47,453 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:47,454 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:47,455 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:57,466 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:55:57,503 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:55:57,536 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:55:57,570 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:55:57,571 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:55:57,573 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:07,584 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:07,586 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:07,587 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:17,599 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:17,600 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:17,601 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:27,613 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:27,614 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:27,615 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:37,627 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:37,628 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:37,629 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:47,641 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:47,643 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:47,644 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:57,655 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:56:57,690 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:56:57,721 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:56:57,752 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:56:57,753 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:56:57,754 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:07,765 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:07,766 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:07,768 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:17,780 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:17,781 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:17,782 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:27,793 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:27,795 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:27,796 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:37,807 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:37,808 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:37,810 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:47,821 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:47,822 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:47,824 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:57,835 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:57:57,868 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:57:57,900 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:57:57,931 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:57:57,932 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:57:57,933 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:07,945 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:07,946 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:07,947 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:17,958 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:17,960 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:17,961 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:27,973 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:27,975 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:27,976 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:37,987 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:37,988 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:37,989 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:48,001 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:48,002 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:48,003 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:58,015 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:58:58,062 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:58:58,094 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:58:58,127 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:58:58,128 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:58:58,129 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:08,140 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:08,142 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:08,143 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:18,154 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:18,155 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:18,156 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:28,167 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:28,168 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:28,169 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:38,180 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:38,181 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:38,182 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:48,193 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:48,194 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:48,195 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:58,206 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 15:59:58,242 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 15:59:58,274 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 15:59:58,304 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 15:59:58,306 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 15:59:58,307 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:08,318 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:08,319 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:08,320 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:18,331 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:18,332 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:18,334 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:28,345 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:28,346 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:28,347 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:38,359 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:38,360 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:38,361 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:48,372 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:48,374 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:48,375 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:58,386 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:00:58,422 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:00:58,450 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:00:58,482 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:00:58,483 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:00:58,484 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:08,495 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:08,497 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:01:08,498 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:18,509 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:18,511 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:01:18,512 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:28,523 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:28,525 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:01:28,526 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:38,537 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:38,538 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:01:43,748 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:53,759 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:01:53,761 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:01:53,762 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:03,773 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:02:03,809 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:02:03,838 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:02:03,870 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:03,871 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:03,872 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:13,883 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:13,884 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:13,885 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:23,896 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:23,898 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:23,899 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:33,910 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:33,911 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:33,912 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:43,923 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:43,925 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:43,925 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:53,937 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:02:53,938 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:02:53,940 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:03,951 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:03:03,987 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:03:04,021 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:03:04,054 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:04,055 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:04,057 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:14,068 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:14,070 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:14,071 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:24,082 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:24,084 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:24,086 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:34,097 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:34,099 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:34,100 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:44,112 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:44,113 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:44,114 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:54,125 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:03:54,126 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:03:54,127 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:04,139 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:04:04,174 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:04:04,209 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:04:04,238 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:04,239 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:04,241 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:14,252 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:14,253 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:14,255 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:24,266 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:24,267 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:24,269 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:34,280 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:34,281 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:34,283 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:44,294 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:44,296 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:44,297 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:54,308 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:04:54,309 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:04:54,311 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:04,322 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:05:04,358 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:05:04,393 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:05:04,421 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:04,423 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:04,424 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:14,436 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:14,437 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:14,438 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:24,450 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:24,451 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:24,453 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:34,464 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:34,466 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:34,467 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:44,478 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:44,480 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:44,480 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:54,491 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:05:54,494 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:05:54,495 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:04,507 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:06:04,542 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:06:04,569 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:06:04,600 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:04,601 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:04,602 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:14,613 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:14,615 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:14,616 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:24,628 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:24,629 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:24,631 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:34,642 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:34,643 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:34,645 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:44,656 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:44,658 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:44,659 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:54,670 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:06:54,672 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:06:54,674 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:04,686 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:07:04,721 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:07:04,751 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:07:04,782 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:04,783 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:04,784 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:14,796 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:14,798 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:14,799 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:24,810 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:24,812 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:24,813 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:34,825 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:34,827 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:34,828 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:44,839 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:44,841 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:44,842 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:54,853 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:07:54,855 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:07:54,856 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:04,867 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:08:04,903 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:08:04,937 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:08:04,970 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:04,971 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:04,972 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:14,983 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:14,984 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:14,986 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:24,997 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:24,999 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:25,000 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:35,012 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:35,013 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:35,015 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:45,027 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:45,028 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:45,029 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:55,040 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:08:55,041 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:08:55,043 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:05,054 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:09:05,086 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:09:05,111 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:09:05,139 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:05,141 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:09:05,142 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:15,153 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:15,154 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:09:15,155 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:25,167 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:25,168 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:09:25,169 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:35,180 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:35,182 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:09:35,183 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:45,194 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:09:45,196 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:09:50,405 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:00,416 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:00,418 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:00,419 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:10,430 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:10:10,458 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:10:10,481 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:10:10,512 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:10,513 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:10,514 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:20,526 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:20,527 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:20,528 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:30,540 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:30,541 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:30,542 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:40,553 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:40,555 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:40,556 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:50,567 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:10:50,568 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:10:50,569 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:00,581 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:00,582 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:00,583 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:10,594 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:11:10,737 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:11:10,982 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:11:11,048 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:11,243 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:11,245 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:21,257 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:21,258 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:21,259 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:31,271 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:31,272 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:31,273 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:41,284 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:41,368 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:41,456 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:51,590 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:11:53,343 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:11:53,640 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:10,048 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:10,049 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:12:10,051 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:20,062 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:12:20,224 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:12:20,274 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:12:20,305 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:20,371 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:12:20,550 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:30,856 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:35,250 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:12:35,578 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:45,742 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:45,787 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:12:45,895 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:55,907 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:12:56,055 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:12:56,057 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:06,068 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:06,069 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:06,070 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:16,081 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:16,083 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:16,084 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:26,095 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:13:26,131 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:13:26,163 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:13:26,196 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:26,198 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:26,199 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:36,210 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:36,211 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:36,213 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:46,224 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:46,225 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:46,226 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:56,238 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:13:56,240 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:13:56,241 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:06,253 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:06,254 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:06,255 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:16,266 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:16,268 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:16,269 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:26,280 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:14:26,318 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:14:26,351 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:14:26,379 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:26,380 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:26,381 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:36,392 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:36,394 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:36,394 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:46,406 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:46,407 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:46,409 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:56,420 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:14:56,421 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:14:56,422 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:06,434 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:06,435 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:06,437 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:16,448 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:16,449 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:16,450 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:26,462 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:15:26,497 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:15:26,530 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:15:26,563 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:26,564 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:26,565 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:36,576 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:36,578 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:36,579 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:46,591 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:46,592 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:46,593 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:56,604 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:15:56,606 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:15:56,607 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:06,618 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:06,619 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:06,620 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:16,632 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:16,633 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:16,634 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:26,645 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:16:26,681 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:16:26,709 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:16:26,740 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:26,741 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:26,742 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:36,753 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:36,755 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:36,756 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:46,767 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:46,768 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:46,769 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:56,780 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:16:56,782 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:16:56,783 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:06,794 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:06,796 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:06,797 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:16,808 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:16,810 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:16,811 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:26,822 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:17:26,857 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:17:26,887 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:17:26,917 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:26,918 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:26,919 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:36,930 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:36,932 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:36,933 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:46,944 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:46,945 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:46,946 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:56,957 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:17:56,959 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:17:56,960 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:06,971 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:06,972 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:06,973 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:16,985 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:16,986 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:16,987 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:26,998 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:18:27,032 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:18:27,064 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:18:27,096 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:27,098 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:27,099 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:37,110 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:37,111 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:37,112 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:47,123 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:47,125 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:47,126 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:57,138 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:18:57,139 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:18:57,140 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:07,151 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:07,152 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:19:07,153 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:17,164 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:17,165 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:19:17,167 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:27,178 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:19:27,215 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:19:27,222 - wf_task - INFO - ('error while requesting http://dahu:6668/oarapi/jobs/21606687 ', '(error: HTTP Error 500: Internal Server Error) sleeping and trying again in 10 secs') 2022-07-03 16:19:37,268 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:19:37,301 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:37,302 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:19:37,303 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:47,315 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:47,316 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:19:47,317 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:57,329 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:19:57,330 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:19:57,332 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:07,343 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:07,345 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:07,346 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:17,357 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:17,359 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:17,360 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:27,371 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:20:27,407 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:27,408 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:27,409 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:37,420 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:20:37,456 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:20:37,488 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:37,490 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:37,491 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:47,502 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:47,504 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:47,505 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:57,516 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:20:57,517 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:20:57,518 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:07,529 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:07,531 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:07,532 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:17,543 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:17,545 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:17,547 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:27,559 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:21:27,594 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:27,595 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:27,596 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:37,607 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:21:37,643 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:21:37,675 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:37,676 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:37,678 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:47,689 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:47,690 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:47,692 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:57,703 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:21:57,705 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:21:57,706 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:07,717 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:07,719 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:07,719 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:17,730 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:17,732 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:17,733 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:27,745 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:22:27,780 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:27,781 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:27,782 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:37,793 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:22:37,827 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:22:37,859 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:37,860 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:37,861 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:47,872 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:47,874 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:47,875 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:57,886 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:22:57,888 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:22:57,889 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:07,901 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:07,902 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:07,903 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:17,915 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:17,916 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:17,918 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:27,930 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:23:27,965 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:27,966 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:27,968 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:37,980 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:23:38,015 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:23:38,048 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:38,049 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:38,051 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:48,063 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:48,064 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:48,065 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:58,077 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:23:58,079 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:23:58,080 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:08,092 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:08,093 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:24:08,095 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:18,107 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:18,109 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:24:18,111 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:28,123 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:24:28,159 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:28,160 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:24:28,162 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:38,174 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:24:38,209 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:24:38,242 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:38,244 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:24:38,246 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:48,257 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:48,259 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:24:48,261 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:58,272 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:24:58,274 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:03,301 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:13,313 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:13,314 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:13,315 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:23,327 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:23,328 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:23,330 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:33,342 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:25:33,375 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:33,377 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:33,379 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:43,390 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:25:43,425 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:25:43,454 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:43,456 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:43,457 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:53,469 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:25:53,616 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:25:53,768 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:03,779 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:03,781 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:03,782 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:13,793 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:13,795 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:13,796 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:23,807 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:23,904 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:23,906 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:33,917 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:26:33,953 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:33,955 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:33,956 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:43,968 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:26:44,003 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:26:44,037 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:44,039 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:44,040 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:54,052 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:26:54,054 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:26:54,056 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:04,067 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:09,252 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:09,254 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:19,265 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:19,267 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:19,269 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:29,281 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:29,283 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:29,285 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:39,291 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:27:39,325 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:39,327 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:39,329 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:49,341 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:27:49,376 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:27:49,404 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:49,406 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:49,407 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:59,419 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:27:59,421 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:27:59,422 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:09,434 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:09,435 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:28:09,437 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:19,449 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:19,451 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:28:19,453 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:29,464 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:29,466 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/3 2022-07-03 16:28:29,468 - wf_scheduler - DEBUG - ['Running', 'Running', 'Running'] 2022-07-03 16:28:39,480 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:28:39,516 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Running'] 2022-07-03 16:28:39,518 - wf_scheduler - DEBUG - nb_done/nb_todo = 1/3 2022-07-03 16:28:39,519 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Running'] 2022-07-03 16:28:49,531 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:28:49,565 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:28:49,594 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:28:49,596 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:28:49,597 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:28:59,609 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:28:59,611 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:28:59,613 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:09,625 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:09,627 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:09,629 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:19,639 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:19,640 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:19,642 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:29,653 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:29,655 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:29,656 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:39,668 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:39,670 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:39,671 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:49,683 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:29:49,719 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:49,721 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:49,723 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:59,735 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:29:59,736 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:29:59,738 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:09,750 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:09,752 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:09,753 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:19,763 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:19,765 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:19,767 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:29,778 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:29,780 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:29,782 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:39,794 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:39,796 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:39,797 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:49,809 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:30:49,845 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:49,847 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:49,849 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:59,861 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:30:59,863 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:30:59,865 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:09,877 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:09,879 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:09,881 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:19,893 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:19,895 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:19,897 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:29,909 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:29,911 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:29,912 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:39,924 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:39,926 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:39,928 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:49,935 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:31:49,971 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:49,973 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:49,975 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:59,986 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:31:59,988 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:31:59,990 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:10,001 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:10,003 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:32:10,005 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:20,017 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:20,019 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:32:20,020 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:30,032 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:30,034 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:32:30,036 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:40,048 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:40,050 - wf_scheduler - DEBUG - nb_done/nb_todo = 2/3 2022-07-03 16:32:40,052 - wf_scheduler - DEBUG - ['Terminated', 'Running', 'Terminated'] 2022-07-03 16:32:50,064 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:32:50,099 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 16:32:50,101 - wf_scheduler - DEBUG - nb_done/nb_todo = 3/3 2022-07-03 16:32:50,103 - wf_scheduler - DEBUG - ['Terminated', 'Terminated', 'Terminated'] 2022-07-03 16:32:50,104 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606686 2022-07-03 16:32:50,137 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606687 2022-07-03 16:32:50,170 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606688 2022-07-03 16:32:50,203 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 16:32:50,205 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 16:32:55,372 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw2.txt 2022-07-03 16:32:55,752 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw1.txt 2022-07-03 16:33:00,997 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/5_interfero_spectraldiversity_iw3.txt 2022-07-03 16:33:06,121 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -----------> start merge if needed 2022-07-03 16:33:06,127 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start merge', 'status': 'running', 'step': 'merge', 'progress': 50} 2022-07-03 16:33:06,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 16:33:06,396 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 16:33:06,402 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -----------> merge is needed 2022-07-03 16:33:06,407 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 16:33:06,409 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task merge on swath iw123 2022-07-03 16:33:06,411 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw123 12 merge<< 2022-07-03 16:33:06,413 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 6: merge ---------- 2022-07-03 16:33:06,414 - wf_scheduler - INFO - Async scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw123 12 merge, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 16:33:06,415 - wf_scheduler - INFO - launching cmd 1/1: source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw123 12 merge 2022-07-03 16:33:06,416 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=15:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw123 12 merge", "name": "6_merge_iw123_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/6_merge_iw123.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/6_merge_iw123.txt"}' 2022-07-03 16:33:06,418 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=15:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw123 12 merge", "name": "6_merge_iw123_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/6_merge_iw123.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/6_merge_iw123.txt"}' ***** 2022-07-03 16:33:07,534 - wf_task - INFO - run with pid 21606739 2022-07-03 16:33:07,536 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:33:07,568 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:07,569 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:07,571 - wf_scheduler - DEBUG - nb_running = 0 2022-07-03 16:33:07,572 - wf_scheduler - DEBUG - nb running=0 in_queue=1 .... max par=50 2022-07-03 16:33:07,574 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:07,575 - wf_scheduler - DEBUG - nb done: 0 2022-07-03 16:33:07,576 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:17,588 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:17,590 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:33:17,591 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:27,603 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:27,604 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:33:27,606 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:37,617 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:37,619 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:33:37,621 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:47,633 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:47,635 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:33:47,637 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:57,649 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:33:57,651 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:33:57,652 - wf_scheduler - DEBUG - ['Waiting'] 2022-07-03 16:34:07,664 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:34:07,701 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:07,703 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:07,705 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:17,716 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:17,718 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:17,720 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:27,731 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:27,732 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:27,733 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:37,744 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:37,747 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:37,749 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:47,760 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:47,762 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:47,764 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:57,776 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:34:57,778 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:34:57,779 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:07,791 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:35:07,827 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:07,828 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:07,830 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:17,841 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:17,843 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:17,845 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:27,857 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:27,859 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:27,861 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:37,873 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:37,875 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:37,877 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:47,889 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:47,891 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:47,893 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:57,905 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:35:57,907 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:35:57,909 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:07,921 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:36:07,967 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:07,968 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:07,970 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:17,981 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:17,983 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:17,985 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:27,996 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:27,998 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:28,000 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:38,012 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:38,014 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:38,016 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:48,027 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:48,029 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:48,031 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:58,042 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:36:58,045 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:36:58,046 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:08,058 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:37:08,095 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:08,097 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:08,099 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:18,110 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:18,112 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:18,114 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:28,126 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:28,128 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:28,129 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:38,141 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:38,143 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:38,144 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:48,156 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:48,158 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:48,159 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:58,171 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:37:58,173 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:37:58,175 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:08,187 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:38:08,224 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:08,225 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:08,227 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:18,238 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:18,240 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:18,242 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:28,254 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:28,255 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:28,257 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:38,268 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:38,270 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:38,272 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:48,283 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:48,285 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:48,287 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:58,299 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:38:58,301 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:38:58,302 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:08,314 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:39:08,351 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:08,352 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:08,354 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:18,366 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:18,367 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:18,369 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:28,381 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:28,383 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:28,384 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:38,396 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:38,398 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:38,399 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:48,411 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:48,413 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:48,415 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:58,427 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:39:58,429 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:39:58,430 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:08,442 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:40:08,477 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:13,637 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:40:13,639 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:23,650 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:23,652 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:40:23,654 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:33,665 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:33,668 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:40:33,669 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:43,681 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:43,683 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:40:43,684 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:53,696 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:40:53,698 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:40:53,700 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:03,712 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:03,714 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:03,715 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:13,727 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:41:13,761 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:13,763 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:13,764 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:23,776 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:23,777 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:23,779 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:33,791 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:34,331 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:35,071 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:45,126 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:45,128 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:45,130 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:55,141 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:41:55,143 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:41:55,145 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:05,156 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:05,158 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:42:05,160 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:15,171 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:42:20,433 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:20,435 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:42:20,436 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:30,447 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:30,448 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:42:30,449 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:40,460 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:40,463 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:42:40,464 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:50,476 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:42:50,478 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:42:50,480 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:00,491 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:00,493 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:00,495 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:10,506 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:10,508 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:10,509 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:20,521 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:43:20,557 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:20,559 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:20,560 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:30,572 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:30,573 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:30,575 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:40,586 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:40,588 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:40,589 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:50,601 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:43:50,603 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:43:50,604 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:00,616 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:00,617 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:00,619 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:10,630 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:10,632 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:10,633 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:20,645 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:44:20,683 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:20,685 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:20,686 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:30,698 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:30,700 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:30,701 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:40,712 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:40,714 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:40,716 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:50,728 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:44:50,730 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:44:50,731 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:45:00,743 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:45:00,745 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:45:00,746 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:45:10,758 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:45:10,760 - wf_scheduler - DEBUG - nb_done/nb_todo = 0/1 2022-07-03 16:45:10,761 - wf_scheduler - DEBUG - ['Running'] 2022-07-03 16:45:20,773 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:45:20,809 - wf_scheduler - DEBUG - ['Terminated'] 2022-07-03 16:45:20,811 - wf_scheduler - DEBUG - nb_done/nb_todo = 1/1 2022-07-03 16:45:20,812 - wf_scheduler - DEBUG - ['Terminated'] 2022-07-03 16:45:20,814 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606739 2022-07-03 16:45:20,846 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 16:45:20,847 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 16:45:20,860 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/6_merge_iw123.txt 2022-07-03 16:45:20,928 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start atmo filter unwrap 2022-07-03 16:45:20,933 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start filter_unwrap', 'status': 'running', 'step': 'filter_unwrap', 'progress': 58} 2022-07-03 16:45:20,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 16:45:21,202 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 16:45:26,213 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 16:45:26,215 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task caui on swath iw1_iw2_iw3 2022-07-03 16:45:26,217 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui<< 2022-07-03 16:45:26,218 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 7: filter_unwrap ---------- 2022-07-03 16:45:26,220 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 16:45:26,221 - wf_scheduler - INFO - launching cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 16:45:26,222 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui", "name": "7_caui_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/7_caui_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/7_caui_iw1_iw2_iw3.txt"}' 2022-07-03 16:45:26,224 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui", "name": "7_caui_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/7_caui_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/7_caui_iw1_iw2_iw3.txt"}' ***** 2022-07-03 16:45:27,444 - wf_task - INFO - run with pid 21606751 2022-07-03 16:46:27,505 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:47:27,602 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:48:27,700 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:49:27,797 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:50:27,894 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:51:27,992 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:52:28,092 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:53:28,191 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:54:28,289 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:55:28,390 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:56:28,484 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:57:33,699 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:58:33,796 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 16:59:33,893 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:00:33,993 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:01:34,052 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:02:34,148 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:03:34,243 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:04:34,347 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:05:34,443 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:06:34,554 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:07:34,651 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:08:34,747 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:09:34,845 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:10:34,943 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:11:35,049 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:12:35,153 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:13:40,365 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:14:40,460 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:15:45,791 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:16:45,900 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:17:45,993 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:18:46,090 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:19:46,187 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:20:46,282 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:21:46,380 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:22:46,596 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:23:46,692 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:24:46,788 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:25:46,885 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:26:46,982 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:27:47,079 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:28:47,173 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:29:52,388 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:30:52,484 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:31:57,826 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:32:57,922 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:33:58,018 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:34:58,114 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:35:58,212 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:36:58,312 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:37:58,408 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:38:58,505 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:39:58,602 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:40:58,699 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:41:58,796 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:42:58,891 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:43:58,988 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:44:59,086 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:46:04,418 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:47:04,515 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:48:09,860 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:49:09,956 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:50:10,053 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:51:10,149 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:52:10,241 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:53:10,342 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:54:10,446 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:55:10,541 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:56:10,628 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:57:10,726 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:58:10,822 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 17:59:10,986 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:00:11,084 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:01:11,461 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:02:16,707 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:03:16,806 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:04:22,145 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:05:22,236 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:06:22,333 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:07:22,429 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:08:22,521 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:09:22,618 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:10:22,713 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:11:24,081 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:12:24,181 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:13:24,286 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:14:24,380 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:15:24,476 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:16:24,572 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:17:24,669 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:18:29,967 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:19:31,328 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:20:36,481 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:21:36,578 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:22:36,675 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:23:36,772 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:24:36,869 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:25:36,967 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:26:37,064 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:27:37,159 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:28:37,260 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:28:37,297 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui is 0 2022-07-03 18:28:37,299 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:28:37,335 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21606751 2022-07-03 18:28:37,369 - wf_scheduler - INFO - done with cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 caui, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21606751 2022-07-03 18:28:37,370 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 18:28:37,372 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 18:28:37,386 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/7_caui_iw1_iw2_iw3.txt 2022-07-03 18:28:37,493 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - number of interfero 31 2022-07-03 18:28:37,494 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start cleaning if requested 2022-07-03 18:28:42,693 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start cleaning_before_ts', 'status': 'running', 'step': 'cleaning_before_ts', 'progress': 66} 2022-07-03 18:28:42,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 18:28:43,077 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 18:28:43,083 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> cleaning coreg, INTERFERO_sd and interferograms before merging 2022-07-03 18:28:48,330 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 18:28:48,332 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task cleaning_before_ts on swath iw1 2022-07-03 18:28:48,334 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v<< 2022-07-03 18:28:48,336 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task cleaning_before_ts on swath iw2 2022-07-03 18:28:48,338 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v<< 2022-07-03 18:28:48,339 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task cleaning_before_ts on swath iw3 2022-07-03 18:28:48,340 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v<< 2022-07-03 18:28:48,342 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 8: cleaning_before_ts ---------- 2022-07-03 18:28:48,343 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:28:48,344 - wf_scheduler - INFO - launching cmd 0/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:28:48,346 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v", "name": "8_cleaning_before_ts_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw1.txt"}' 2022-07-03 18:28:48,347 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v", "name": "8_cleaning_before_ts_iw1_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw1.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw1.txt"}' ***** 2022-07-03 18:28:49,499 - wf_task - INFO - run with pid 21607274 2022-07-03 18:29:49,561 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:30:49,651 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:31:49,741 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:32:49,832 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:33:49,923 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:34:55,104 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:35:56,461 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:37:01,561 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:38:01,648 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:39:01,739 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:40:01,830 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:41:01,920 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:42:02,006 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:42:02,044 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v is 0 2022-07-03 18:42:02,046 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:42:02,079 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607274 2022-07-03 18:42:02,112 - wf_scheduler - INFO - done with cmd 0/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607274 2022-07-03 18:42:02,114 - wf_scheduler - INFO - launching cmd 1/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:42:02,116 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw2.txt"}' 2022-07-03 18:42:02,118 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v", "name": "8_cleaning_before_ts_iw2_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw2.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw2.txt"}' ***** 2022-07-03 18:42:03,256 - wf_task - INFO - run with pid 21607278 2022-07-03 18:43:03,318 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607278 2022-07-03 18:43:03,356 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v is 0 2022-07-03 18:43:03,358 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607278 2022-07-03 18:43:03,389 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607278 2022-07-03 18:43:03,422 - wf_scheduler - INFO - done with cmd 1/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw2/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607278 2022-07-03 18:43:03,423 - wf_scheduler - INFO - launching cmd 2/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:43:03,425 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v", "name": "8_cleaning_before_ts_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw3.txt"}' 2022-07-03 18:43:03,426 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v", "name": "8_cleaning_before_ts_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw3.txt"}' ***** 2022-07-03 18:43:04,497 - wf_task - INFO - run with pid 21607279 2022-07-03 18:44:04,559 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:45:04,652 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:46:04,742 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:47:04,833 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:48:04,925 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:49:05,015 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:50:10,302 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:51:10,392 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:51:10,426 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v is 0 2022-07-03 18:51:15,652 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:51:15,688 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607279 2022-07-03 18:51:15,719 - wf_scheduler - INFO - done with cmd 2/3: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -c -s -i -t /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607279 2022-07-03 18:51:15,721 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 18:51:15,723 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 18:51:15,735 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw1.txt 2022-07-03 18:51:15,740 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw2.txt 2022-07-03 18:51:15,745 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/8_cleaning_before_ts_iw3.txt 2022-07-03 18:51:15,751 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start time series if needed 2022-07-03 18:51:15,755 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start timeseries', 'status': 'running', 'step': 'timeseries', 'progress': 75} 2022-07-03 18:51:15,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 18:51:16,022 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 18:51:16,027 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> doing timeseries 2022-07-03 18:51:16,032 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 18:51:16,034 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task time_serie on swath iw1_iw2_iw3 2022-07-03 18:51:16,035 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie<< 2022-07-03 18:51:16,036 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 9: timeseries ---------- 2022-07-03 18:51:16,038 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:51:16,039 - wf_scheduler - INFO - launching cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 18:51:16,040 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=42:12:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie", "name": "9_time_serie_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/9_time_serie_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/9_time_serie_iw1_iw2_iw3.txt"}' 2022-07-03 18:51:16,041 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=42:12:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie", "name": "9_time_serie_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/9_time_serie_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/9_time_serie_iw1_iw2_iw3.txt"}' ***** 2022-07-03 18:51:17,191 - wf_task - INFO - run with pid 21607294 2022-07-03 18:52:17,253 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:53:17,343 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:54:17,436 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:55:17,522 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:56:17,619 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:57:17,709 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:58:17,801 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 18:59:17,890 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 19:00:17,986 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 19:01:18,083 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 19:01:18,119 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie is 0 2022-07-03 19:01:18,121 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 19:01:18,155 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607294 2022-07-03 19:01:18,187 - wf_scheduler - INFO - done with cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsbas.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 time_serie, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607294 2022-07-03 19:01:18,189 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 19:01:18,191 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:01:18,203 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/9_time_serie_iw1_iw2_iw3.txt 2022-07-03 19:01:23,400 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start cleaning if requested 2022-07-03 19:01:23,406 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start cleaning_after_ts', 'status': 'running', 'step': 'cleaning_after_ts', 'progress': 83} 2022-07-03 19:01:23,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 19:01:23,701 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 19:01:23,709 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> cleaning merged interferograms directories with unwrapping and geocoding 2022-07-03 19:01:23,715 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 19:01:23,717 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - %%%%% running task cleaning_after_ts on swath iw1_iw2_iw3 2022-07-03 19:01:23,718 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get oartask: nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v<< 2022-07-03 19:01:23,720 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 10: cleaning_after_ts ---------- 2022-07-03 19:01:23,722 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:01:23,723 - wf_scheduler - INFO - launching cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:01:23,724 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v", "name": "10_cleaning_after_ts_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/10_cleaning_after_ts_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/10_cleaning_after_ts_iw1_iw2_iw3.txt"}' 2022-07-03 19:01:23,726 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=21:06:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v", "name": "10_cleaning_after_ts_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/10_cleaning_after_ts_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/10_cleaning_after_ts_iw1_iw2_iw3.txt"}' ***** 2022-07-03 19:01:24,870 - wf_task - INFO - run with pid 21607302 2022-07-03 19:02:24,932 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607302 2022-07-03 19:03:25,024 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607302 2022-07-03 19:03:25,062 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v is 0 2022-07-03 19:03:25,063 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607302 2022-07-03 19:03:25,098 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607302 2022-07-03 19:03:25,132 - wf_scheduler - INFO - done with cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_clean_coreg_int.py -u /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/nsbas.proc -v, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607302 2022-07-03 19:03:25,134 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 19:03:25,135 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:03:25,148 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/10_cleaning_after_ts_iw1_iw2_iw3.txt 2022-07-03 19:03:25,154 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------> start populate and make products 2022-07-03 19:03:25,159 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'Start publish', 'status': 'running', 'step': 'publish', 'progress': 91} 2022-07-03 19:03:25,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 19:03:25,436 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 19:03:25,441 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - populate ctip calcall+ts and ltip InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw 2022-07-03 19:03:25,445 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 19:03:25,447 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - get nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln<< 2022-07-03 19:03:25,449 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 11: publish ---------- 2022-07-03 19:03:25,451 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:03:25,452 - wf_scheduler - INFO - launching cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:03:25,454 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln", "name": "11-0_populate_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt"}' 2022-07-03 19:03:25,456 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln", "name": "11-0_populate_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt"}' ***** 2022-07-03 19:03:26,582 - wf_task - INFO - run with pid 21607307 2022-07-03 19:04:26,644 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:05:26,736 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:06:26,833 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:07:31,970 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:08:37,249 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:09:37,344 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:10:37,440 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:11:37,539 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:12:37,634 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:13:37,731 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:14:37,829 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:15:37,925 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:16:38,020 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:17:38,113 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:18:38,207 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:19:38,303 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:20:38,397 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:21:38,498 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:22:38,633 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:23:43,747 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:24:48,983 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:25:49,080 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:26:49,179 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:27:49,277 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:28:49,375 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:29:49,472 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:30:49,566 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:31:49,604 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:32:49,700 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:33:49,796 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:33:49,832 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln is 0 2022-07-03 19:33:49,834 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:33:49,867 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607307 2022-07-03 19:33:49,897 - wf_scheduler - INFO - done with cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_populate_product.sh /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 12 calcall+ts epos -v ln, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607307 2022-07-03 19:33:49,899 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 19:33:49,900 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:33:49,914 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt 2022-07-03 19:34:05,384 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'select products', 'status': 'running', 'step': 'publish', 'progress': 91} 2022-07-03 19:34:05,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 19:34:05,800 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 19:34:05,811 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Computing on dahu, walltime ceiling of 48 hours 2022-07-03 19:34:05,813 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - get nsbas cmd = >>source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask<< 2022-07-03 19:34:05,815 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 11: publish ---------- 2022-07-03 19:34:05,816 - wf_scheduler - INFO - Sequential scheduler: running command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:34:05,817 - wf_scheduler - INFO - launching cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:34:05,819 - wf_task - DEBUG - oar request: http://dahu:6668/oarapi/jobs data=b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "11-1_make_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt"}' 2022-07-03 19:34:05,820 - wf_task - INFO - ***** PARAMS : b'{"resource": "/nodes=1/core=12,walltime=48:00:00", "command": "source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask", "name": "11-1_make_iw1_iw2_iw3_f7e3512f-fd09-43e4-8887-c725b060f865", "workdir": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865", "project": "pr-nsbas", "stdout": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt", "stderr": "/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt"}' ***** 2022-07-03 19:34:06,979 - wf_task - INFO - run with pid 21607349 2022-07-03 19:35:07,041 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:36:07,136 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:37:07,230 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:38:07,321 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:39:07,419 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:39:12,616 - wf_task - INFO - ret_code for source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask is 0 2022-07-03 19:39:17,700 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:39:17,776 - wf_task - DEBUG - requesting : http://dahu:6668/oarapi/jobs/21607349 2022-07-03 19:39:17,808 - wf_scheduler - INFO - done with cmd 0/1: command=source /bettik/cycle/gdm-sar-uga/env_gdm_sar.sh; nsb_make_data.py -s /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 -w iw1_iw2_iw3 -d /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product -c 12 -t InW_radar_runw,InW_geo_runw,APS_radar_runw,APS_geo_runw,InU_geo_runw,InWF_radar_runw,InWF_geo_runw,Coh_radar_runw,Coh_geo_runw,CosENU_radar_runw,CosENU_geo_runw,DEM_radar_runw,DEM_geo_runw,Lut_geo_runw,Lut_radar_runw,aux_files,InU_radar_runw,TCoh_radar_runw,TCoh_geo_runw,DTs_radar_runw,DTs_geo_runw,Net_radar_runw,Net_geo_runw,MVLOS_radar_runw,MVLOS_geo_runw,StkIn_radar_runw -j epos -m -p -g -v 4 -b backup_product.json -plot -mask, workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=21607349 2022-07-03 19:39:17,810 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 19:39:17,812 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:39:17,823 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt 2022-07-03 19:39:17,986 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt 2022-07-03 19:39:18,051 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'format products', 'status': 'running', 'step': 'publish', 'progress': 91} 2022-07-03 19:39:18,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 19:39:18,313 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None 2022-07-03 19:39:18,319 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Starting building job summary... 2022-07-03 19:39:37,405 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - Building job summary done! 2022-07-03 19:39:37,425 - nsb_build_synthesis:main - INFO - writing to /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/0_synthesis.html 2022-07-03 19:39:37,463 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - -------------- starting step 11: publish ---------- 2022-07-03 19:39:37,464 - wf_scheduler - INFO - Sequential scheduler: running command=ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/', workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:39:37,466 - wf_scheduler - INFO - launching cmd 0/1: command=ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/', workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=None 2022-07-03 19:39:37,467 - wf_task - INFO - running ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/' 2022-07-03 19:39:37,468 - wf_task - DEBUG - process-task: running command ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/' (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:53:49,173 - wf_task - INFO - ret_code for ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/' is 0 2022-07-03 19:53:49,176 - wf_scheduler - INFO - done with cmd 0/1: command=ssh cargo 'rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/ formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3 ; rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/iw1_iw2_iw3/Product/backup_product.json formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/', workdir=/silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865 id=32523 2022-07-03 19:53:49,178 - wf_task - INFO - running rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ 2022-07-03 19:53:49,179 - wf_task - DEBUG - process-task: running command rsync -rLz --exclude={'*.int','*.unw','*.cor','*.rsc'} /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs formater.osug:/data/gdm-sar-uga/f7e3512f-fd09-43e4-8887-c725b060f865/ (from directory /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865) 2022-07-03 19:53:54,252 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-1_make_iw1_iw2_iw3.txt 2022-07-03 19:53:54,413 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - INFO - checking /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/11-0_populate_iw1_iw2_iw3.txt 2022-07-03 19:53:54,479 - /silenus/PROJECTS/pr-nsbas/COMMON/gdm-sar/f7e3512f-fd09-43e4-8887-c725b060f865/logs/0_run_gdm_sar.txt - DEBUG - notify: sending notification to https://gdm-test.poleterresolide.fr/scripts/setStatus with data={'process_token': 'f7e3512f-fd09-43e4-8887-c725b060f865', 'log': 'publish products', 'status': 'running', 'step': 'publish', 'progress': 91} 2022-07-03 19:53:54,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): gdm-test.poleterresolide.fr:443 2022-07-03 19:53:59,883 - urllib3.connectionpool - DEBUG - https://gdm-test.poleterresolide.fr:443 "POST /scripts/setStatus HTTP/1.1" 200 None