text:
Error when running DeepSpeed integration test with Rocm 62

I was trying to build ACPT ROCm 62 image but encountered below error while running deepspeed integration test and failed withWorker 0 killed by signal 6

:0:rocdevice.cpp            :2984: 13356614637254 us: [pid:213   tid:0x7f59bcd69700] Callback: Queue 0x7f59d8000000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016

OS_TYPE=ubuntu2004
GPU_TYPE=rocm62
DESIRED_PYTHON=39
PYTORCH_TYPE=stable
PYTORCH_VERSION=221

deepspeed=0.15.1
horovod=0.24.2
torch_nebula=0.16.13
nebulaml=0.16.13
onnxruntime_training=1.18.0
torch_ort=1.18.0

The below is part of the error logs
2024-10-16T19:14:55.7825728Z =================================== FAILURES ===================================
2024-10-16T19:14:55.7826479Z ________________________________ TestInit.test _________________________________
2024-10-16T19:14:55.7828304Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7830382Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7831792Z [2024-10-16 19:13:18,383] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7833100Z [2024-10-16 19:13:18,388] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7833950Z [2024-10-16 19:13:20,019] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7834714Z [2024-10-16 19:13:20,048] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7835574Z [2024-10-16 19:13:20,048] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7836438Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7837421Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7838218Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7839213Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7840042Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7840923Z :0:rocdevice.cpp            :2984: 13356614637254 us: [pid:213   tid:0x7f59bcd69700] Callback: Queue 0x7f59d8000000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7842092Z :0:rocdevice.cpp            :2984: 13356614637424 us: [pid:212   tid:0x7f59bed69700] Callback: Queue 0x7f59d8400000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7843173Z _______________ TestDistArgs.test[hello-icosahedron-1138-purple] _______________
2024-10-16T19:14:55.7843670Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7844300Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7845070Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7845925Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7846625Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7847477Z [2024-10-16 19:13:24,186] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7848443Z [2024-10-16 19:13:24,187] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7849314Z [2024-10-16 19:13:25,848] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7850186Z [2024-10-16 19:13:25,848] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7851016Z [2024-10-16 19:13:25,850] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7851761Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7852772Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7853562Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7854814Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7855608Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7856464Z :0:rocdevice.cpp            :2984: 13356619523558 us: [pid:394   tid:0x7fa6840bd700] Callback: Queue 0x7fa697200000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7857605Z :0:rocdevice.cpp            :2984: 13356619524337 us: [pid:393   tid:0x7fa6820bd700] Callback: Queue 0x7fa69d300000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7858469Z ______________________ TestGroupedDistTest.test_one[1138] ______________________
2024-10-16T19:14:55.7858965Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7859607Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7860378Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7861405Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7862090Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7862953Z [2024-10-16 19:13:29,047] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7863888Z [2024-10-16 19:13:29,051] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7864725Z [2024-10-16 19:13:30,661] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7865578Z [2024-10-16 19:13:30,661] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7866416Z [2024-10-16 19:13:30,683] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7867142Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7868121Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7868887Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7869864Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7870633Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7871501Z :0:rocdevice.cpp            :2984: 13356624369082 us: [pid:575   tid:0x7f2bd7506700] Callback: Queue 0x7f2bea800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7872647Z :0:rocdevice.cpp            :2984: 13356624369094 us: [pid:574   tid:0x7f2bd7506700] Callback: Queue 0x7f2bea400000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7873582Z ______________________ TestGroupedDistTest.test_two[1138] ______________________
2024-10-16T19:14:55.7874077Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7874718Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7875478Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7876330Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7877132Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7878053Z [2024-10-16 19:13:33,899] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7879009Z [2024-10-16 19:13:33,931] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7879833Z [2024-10-16 19:13:35,510] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7880703Z [2024-10-16 19:13:35,511] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7881530Z [2024-10-16 19:13:35,706] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7882270Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7883287Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7884235Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7885221Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7886005Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7886889Z :0:rocdevice.cpp            :2984: 13356629346307 us: [pid:756   tid:0x7f6084ccb700] Callback: Queue 0x7f60a2700000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7888023Z :0:rocdevice.cpp            :2984: 13356629346349 us: [pid:755   tid:0x7f608cccb700] Callback: Queue 0x7f60a0400000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7888907Z _______________ TestWorldSizeOverrideDistTest.test_world_size_2 ________________
2024-10-16T19:14:55.7889406Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7890054Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7890827Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7891683Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7892369Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7893218Z [2024-10-16 19:13:38,887] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7894173Z [2024-10-16 19:13:38,892] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7894995Z [2024-10-16 19:13:40,552] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7895869Z [2024-10-16 19:13:40,552] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7896695Z [2024-10-16 19:13:40,658] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7897483Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7898464Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7899251Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7900227Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7901128Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7902153Z :0:rocdevice.cpp            :2984: 13356634286048 us: [pid:937   tid:0x7f4ab8921700] Callback: Queue 0x7f4acba00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7903349Z :0:rocdevice.cpp            :2984: 13356634286290 us: [pid:936   tid:0x7f4ab6921700] Callback: Queue 0x7f4ac9800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7904230Z ____________________________ TestDistAllReduce.test ____________________________
2024-10-16T19:14:55.7904735Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7905392Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7906251Z [2024-10-16 19:13:49,398] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7907095Z [2024-10-16 19:13:51,203] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7907962Z [2024-10-16 19:13:51,203] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7908915Z [2024-10-16 19:13:55,102] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7909856Z [2024-10-16 19:13:55,149] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7910695Z [2024-10-16 19:13:56,721] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7911436Z [2024-10-16 19:13:56,757] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7912301Z [2024-10-16 19:13:56,757] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7913125Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7914161Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7914958Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7915947Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7916723Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7917705Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7918480Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7919352Z :0:rocdevice.cpp            :2984: 13356651365016 us: [pid:1301  tid:0x7f17869d0700] Callback: Queue 0x7f1799c00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7920502Z :0:rocdevice.cpp            :2984: 13356651365018 us: [pid:1300  tid:0x7f17869d0700] Callback: Queue 0x7f1799800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7921386Z _____________________ TestDistInit.test_already_init[True] _____________________
2024-10-16T19:14:55.7921880Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7922516Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7923293Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7924147Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7924848Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7925839Z [2024-10-16 19:14:00,866] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7926795Z [2024-10-16 19:14:00,934] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7927624Z [2024-10-16 19:14:02,553] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7928367Z [2024-10-16 19:14:02,556] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7929095Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7930076Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7930857Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7931833Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7932636Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7933505Z :0:rocdevice.cpp            :2984: 13356656197589 us: [pid:1481  tid:0x7f2f401df700] Callback: Queue 0x7f2f53000000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7934663Z :0:rocdevice.cpp            :2984: 13356656197827 us: [pid:1482  tid:0x7f2f3a1df700] Callback: Queue 0x7f2f53800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7935541Z ____________________ TestDistInit.test_already_init[False] _____________________
2024-10-16T19:14:55.7936032Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7936664Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7937449Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7938296Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7938991Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7939857Z [2024-10-16 19:14:05,725] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7941010Z [2024-10-16 19:14:05,730] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7941844Z [2024-10-16 19:14:07,371] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7942593Z [2024-10-16 19:14:07,378] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7943327Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7944325Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7945108Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7946082Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7946920Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7947784Z :0:rocdevice.cpp            :2984: 13356661009132 us: [pid:1662  tid:0x7fdae0b7a700] Callback: Queue 0x7fdaf9900000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7948934Z :0:rocdevice.cpp            :2984: 13356661009277 us: [pid:1663  tid:0x7fdae6b7a700] Callback: Queue 0x7fdafe200000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7950004Z _____________________ TestDistInit.test_already_init[None] _____________________
2024-10-16T19:14:55.7950497Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7951145Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7951910Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7952753Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7953445Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7954299Z [2024-10-16 19:14:10,534] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7955255Z [2024-10-16 19:14:10,544] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7956086Z [2024-10-16 19:14:13,163] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7956835Z [2024-10-16 19:14:13,168] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7957566Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7958538Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7959325Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7960302Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7961083Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7961958Z :0:rocdevice.cpp            :2984: 13356666806077 us: [pid:1843  tid:0x7fb7da5c8700] Callback: Queue 0x7fb7f5800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7963114Z :0:rocdevice.cpp            :2984: 13356666806079 us: [pid:1844  tid:0x7fb7da5c8700] Callback: Queue 0x7fb7f1c00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7964047Z _______________________ TestDistInit.test_no_init[True] ________________________
2024-10-16T19:14:55.7964546Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7965182Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.7965950Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.7966809Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.7967500Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7968353Z [2024-10-16 19:14:16,285] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7969310Z [2024-10-16 19:14:16,351] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7970138Z [2024-10-16 19:14:17,893] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7971001Z [2024-10-16 19:14:17,893] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7971826Z [2024-10-16 19:14:18,060] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7972556Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7973690Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7974526Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7975528Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7976304Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7977180Z :0:rocdevice.cpp            :2984: 13356671739282 us: [pid:2025  tid:0x7faf78da7700] Callback: Queue 0x7faf90400000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7978317Z :0:rocdevice.cpp            :2984: 13356671739281 us: [pid:2024  tid:0x7faf76da7700] Callback: Queue 0x7faf8dc00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7979210Z _______________________ TestDistInit.test_no_init[None] ________________________
2024-10-16T19:14:55.7979706Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7980347Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7981315Z [2024-10-16 19:14:25,565] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7982269Z [2024-10-16 19:14:25,650] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7983092Z [2024-10-16 19:14:27,159] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7983841Z [2024-10-16 19:14:27,241] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7984698Z [2024-10-16 19:14:27,242] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.7985539Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.7986514Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7987304Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7988281Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.7989055Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.7989937Z :0:rocdevice.cpp            :2984: 13356681797244 us: [pid:2375  tid:0x7f12c7e30700] Callback: Queue 0x7f12e1400000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7991093Z :0:rocdevice.cpp            :2984: 13356681797241 us: [pid:2374  tid:0x7f12b1e30700] Callback: Queue 0x7f12e4c00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.7991986Z ________________ TestDistInitWithModel.test_already_init[True] _________________
2024-10-16T19:14:55.7992481Z Worker 0 killed by signal 6
2024-10-16T19:14:55.7993129Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.7993978Z [2024-10-16 19:14:36,912] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7994931Z [2024-10-16 19:14:36,962] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.7995915Z [2024-10-16 19:14:38,716] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.7996890Z [2024-10-16 19:14:38,716] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.7997794Z [2024-10-16 19:14:38,716] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.7998740Z [2024-10-16 19:14:38,736] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.7999589Z [2024-10-16 19:14:38,736] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.8000392Z [2024-10-16 19:14:38,737] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.8001168Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.8002133Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8002926Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8003913Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8004701Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8005575Z :0:rocdevice.cpp            :2984: 13356692342385 us: [pid:2648  tid:0x7f5e62452700] Callback: Queue 0x7f5e86600000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8006727Z :0:rocdevice.cpp            :2984: 13356692342940 us: [pid:2649  tid:0x7f5e5c452700] Callback: Queue 0x7f5e87600000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8007610Z ________________ TestDistInitWithModel.test_already_init[False] ________________
2024-10-16T19:14:55.8008110Z Worker 0 killed by signal 6
2024-10-16T19:14:55.8008754Z ---------------------------- Captured stderr setup -----------------------------
2024-10-16T19:14:55.8009527Z /opt/conda/envs/ptca/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 3 leaked semaphore objects to clean up at shutdown
2024-10-16T19:14:55.8010374Z   warnings.warn('resource_tracker: There appear to be %d '
2024-10-16T19:14:55.8011063Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.8011914Z [2024-10-16 19:14:41,875] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.8012870Z [2024-10-16 19:14:41,890] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.8013906Z [2024-10-16 19:14:44,501] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.8014776Z [2024-10-16 19:14:44,502] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.8015580Z [2024-10-16 19:14:44,502] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.8016523Z [2024-10-16 19:14:44,516] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.8017376Z [2024-10-16 19:14:44,516] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.8018171Z [2024-10-16 19:14:44,516] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.8018957Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.8019927Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8020821Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8021916Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8022761Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8023688Z :0:rocdevice.cpp            :2984: 13356698125673 us: [pid:2832  tid:0x7f925f6c8700] Callback: Queue 0x7f9278a00000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8024841Z :0:rocdevice.cpp            :2984: 13356698126647 us: [pid:2831  tid:0x7f92636c8700] Callback: Queue 0x7f9278200000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8025714Z ___________________ TestDistInitWithModel.test_no_init[True] ___________________
2024-10-16T19:14:55.8026221Z Worker 0 killed by signal 6
2024-10-16T19:14:55.8026872Z ----------------------------- Captured stdout call -----------------------------
2024-10-16T19:14:55.8027744Z [2024-10-16 19:14:47,656] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.8028686Z [2024-10-16 19:14:47,730] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2024-10-16T19:14:55.8029681Z [2024-10-16 19:14:49,320] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.8030541Z [2024-10-16 19:14:49,320] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.8031443Z [2024-10-16 19:14:49,433] [INFO] [logging.py:96:log_dist] [Rank -1] DeepSpeed info: version=0.15.1, git-hash=unknown, git-branch=unknown
2024-10-16T19:14:55.8032301Z [2024-10-16 19:14:49,433] [INFO] [comm.py:652:init_distributed] cdb=None
2024-10-16T19:14:55.8033182Z [2024-10-16 19:14:49,433] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
2024-10-16T19:14:55.8034111Z [2024-10-16 19:14:50,324] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.8034947Z [2024-10-16 19:14:50,327] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 2
2024-10-16T19:14:55.8035728Z ----------------------------- Captured stderr call -----------------------------
2024-10-16T19:14:55.8036705Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8037494Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8038472Z /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8039263Z   warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8040141Z :0:rocdevice.cpp            :2984: 13356703971920 us: [pid:3014  tid:0x7f3046649700] Callback: Queue 0x7f307d200000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8041292Z :0:rocdevice.cpp            :2984: 13356703973048 us: [pid:3015  tid:0x7f3050649700] Callback: Queue 0x7f3081800000 aborting with error : HSA_STATUS_ERROR_EXCEPTION: An HSAIL operation resulted in a hardware exception. code: 0x1016
2024-10-16T19:14:55.8042163Z =============================== warnings summary ===============================
2024-10-16T19:14:55.8043025Z ../../../opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113
2024-10-16T19:14:55.8044050Z   /opt/conda/envs/ptca/lib/python3.9/site-packages/onnxruntime/capi/onnxruntime_validation.py:113: UserWarning: WARNING: failed to get cudart_version from onnxruntime build info.
2024-10-16T19:14:55.8044959Z     warnings.warn("WARNING: failed to get cudart_version from onnxruntime build info.")
2024-10-16T19:14:55.8045276Z
2024-10-16T19:14:55.8045886Z ../../../opt/conda/envs/ptca/lib/python3.9/site-packages/pydantic/fields.py:826
2024-10-16T19:14:55.8047304Z   /opt/conda/envs/ptca/lib/python3.9/site-packages/pydantic/fields.py:826: PydanticDeprecatedSince20: Using extra keyword arguments on `Field` is deprecated and will be removed. Use `json_schema_extra` instead. (Extra keys: 'new_param'). Deprecated in Pydantic V2.0 to be removed in V3.0. See Pydantic V2 Migration Guide at https://errors.pydantic.dev/2.9/migration/
2024-10-16T19:14:55.8048270Z     warn(
2024-10-16T19:14:55.8048405Z
2024-10-16T19:14:55.8048823Z ../../integration_test/test_deepspeed/unit/test_dist.py:62
2024-10-16T19:14:55.8049952Z   /test/integration_test/test_deepspeed/unit/test_dist.py:62: PytestUnknownMarkWarning: Unknown pytest.mark.world_size - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html
2024-10-16T19:14:55.8050795Z     @pytest.mark.world_size(1)
2024-10-16T19:14:55.8050969Z
2024-10-16T19:14:55.8051535Z -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
2024-10-16T19:14:55.8052105Z =========================== short test summary info ============================
2024-10-16T19:14:55.8052708Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestInit::test
2024-10-16T19:14:55.8053599Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistArgs::test[hello-icosahedron-1138-purple]
2024-10-16T19:14:55.8054331Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestGroupedDistTest::test_one[1138]
2024-10-16T19:14:55.8055027Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestGroupedDistTest::test_two[1138]
2024-10-16T19:14:55.8055758Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestWorldSizeOverrideDistTest::test_world_size_2
2024-10-16T19:14:55.8056465Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistAllReduce::test
2024-10-16T19:14:55.8057138Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInit::test_already_init[True]
2024-10-16T19:14:55.8057841Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInit::test_already_init[False]
2024-10-16T19:14:55.8058540Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInit::test_already_init[None]
2024-10-16T19:14:55.8059232Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInit::test_no_init[True]
2024-10-16T19:14:55.8059903Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInit::test_no_init[None]
2024-10-16T19:14:55.8060875Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInitWithModel::test_already_init[True]
2024-10-16T19:14:55.8061613Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInitWithModel::test_already_init[False]
2024-10-16T19:14:55.8062350Z FAILED ../../integration_test/test_deepspeed/unit/test_dist.py::TestDistInitWithModel::test_no_init[True]
2024-10-16T19:14:55.8063026Z ============= 14 failed, 4 passed, 3 warnings in 102.03s (0:01:42) =============
2024-10-16T19:14:56.7134939Z ERROR (104.341s)
2024-10-16T19:14:56.7135124Z
2024-10-16T19:14:56.7135560Z ======================================================================
2024-10-16T19:14:56.7136135Z ERROR [104.341s]: test_deepspeed_integration (__main__.TestPTCA)
2024-10-16T19:14:56.7136627Z Check DeepSpeed integration with PTCA.
2024-10-16T19:14:56.7137460Z ----------------------------------------------------------------------
2024-10-16T19:14:56.7137953Z Traceback (most recent call last):
2024-10-16T19:14:56.7138451Z   File "/test/test_PTCA.py", line 368, in test_deepspeed_integration
2024-10-16T19:14:56.7139367Z     subprocess.check_call("pytest -v --forked {0}/integration_test/test_deepspeed/unit".format(ROOT_PATH).split(), cwd=downloads_test_folder)
2024-10-16T19:14:56.7140386Z   File "/opt/conda/envs/ptca/lib/python3.9/subprocess.py", line 373, in check_call
2024-10-16T19:14:56.7141098Z     raise CalledProcessError(retcode, cmd)
2024-10-16T19:14:56.7141944Z subprocess.CalledProcessError: Command '['pytest', '-v', '--forked', '/test/integration_test/test_deepspeed/unit']' returned non-zero exit status 1.
2024-10-16T19:14:56.7142335Z
2024-10-16T19:14:56.7142884Z ----------------------------------------------------------------------

Also saw the below error, not sure if it's relevant
2024-10-16T19:15:05.5948970Z Traceback (most recent call last):
2024-10-16T19:15:05.5949652Z   File "/opt/conda/envs/ptca/lib/python3.9/runpy.py", line 197, in _run_module_as_main
2024-10-16T19:15:05.5950190Z     return _run_code(code, main_globals, None,
2024-10-16T19:15:05.5950688Z   File "/opt/conda/envs/ptca/lib/python3.9/runpy.py", line 87, in _run_code
2024-10-16T19:15:05.5951158Z     exec(code, run_globals)
2024-10-16T19:15:05.5951902Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/launch.py", line 198, in <module>
2024-10-16T19:15:05.5952410Z     main()
2024-10-16T19:15:05.5953056Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/launch.py", line 194, in main
2024-10-16T19:15:05.5953565Z     launch(args)
2024-10-16T19:15:05.5954219Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/launch.py", line 179, in launch
2024-10-16T19:15:05.5954718Z     run(args)
2024-10-16T19:15:05.5955369Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/run.py", line 803, in run
2024-10-16T19:15:05.5955886Z     elastic_launch(
2024-10-16T19:15:05.5956582Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/launcher/api.py", line 135, in __call__
2024-10-16T19:15:05.5957229Z     return launch_agent(self._config, self._entrypoint, list(args))
2024-10-16T19:15:05.5958025Z   File "/opt/conda/envs/ptca/lib/python3.9/site-packages/torch/distributed/launcher/api.py", line 268, in launch_agent
2024-10-16T19:15:05.5958597Z     raise ChildFailedError(
2024-10-16T19:15:05.5959075Z torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
2024-10-16T19:15:05.5959615Z ============================================================
2024-10-16T19:15:05.5960171Z /test/integration_test/test_nvidia_apex/distributed_data_parallel.py FAILED
2024-10-16T19:15:05.5960852Z ------------------------------------------------------------
2024-10-16T19:15:05.5961272Z Failures:
2024-10-16T19:15:05.5961601Z [1]:
2024-10-16T19:15:05.5962070Z   time      : 2024-10-16_19:15:05
2024-10-16T19:15:05.5962477Z   host      : a184145b9c07
2024-10-16T19:15:05.5962845Z   rank      : 1 (local_rank: 1)
2024-10-16T19:15:05.5963334Z   exitcode  : -6 (pid: 3495)
2024-10-16T19:15:05.5963706Z   error_file: <N/A>
2024-10-16T19:15:05.5964115Z   traceback : Signal 6 (SIGABRT) received by PID 3495
2024-10-16T19:15:05.5964734Z ------------------------------------------------------------
2024-10-16T19:15:05.5965198Z Root Cause (first observed failure):
2024-10-16T19:15:05.5965553Z [0]:
2024-10-16T19:15:05.5966024Z   time      : 2024-10-16_19:15:05
2024-10-16T19:15:05.5966411Z   host      : a184145b9c07
2024-10-16T19:15:05.5966791Z   rank      : 0 (local_rank: 0)
2024-10-16T19:15:05.5967281Z   exitcode  : -6 (pid: 3494)
2024-10-16T19:15:05.5967652Z   error_file: <N/A>
2024-10-16T19:15:05.5968078Z   traceback : Signal 6 (SIGABRT) received by PID 3494
2024-10-16T19:15:05.5968577Z ============================================================

Where is the DeepSpeed error? I only see onnx and torch in the stack traces.

For ROCm issues, FYI @rraminen and @jithunnair-amd

authors: ijenwang-ms jomayeri loadams

repo: microsoft/DeepSpeed


text:
fix num_kv_heads sharding in uneven autoTP for Falcon-40b

Falcon-40b will fail on uneven autotp. Need to add 'num_kv_heads' in the kv_head_names list.

@tjruwase from the failure log it seems like a environment issue.  Has this already been resolved?
Thanks!
FAILED tests/deepspeed/test_deepspeed.py::TrainerIntegrationDeepSpeed::test_early_get_last_lr_zero2_fp16 - deepspeed.ops.op_builder.builder.CUDAMismatchException: >- DeepSpeed Op Builder: Installed CUDA version 11.6 does not match the version torch was compiled with 12.1, unable to compile cuda/cpp extensions without a matching cuda version.

@delock, apologies for the delay on this. The team is gradually returning from the holidays. This will be resolved asap.

source: gharchive/pull-request

authors: Yejing-Lai delock tjruwase

license_type: permissive

license_source: github-api


text:
Fix training of pipeline based peft's lora model

Hi, guys
I find there is an assert failure when I train huggingface's lora based model in pipeline style.
Here is the whole steps that I created my model:

Load the pre-trained chatglm-6b model from huggingface, as Model_A
Use huggingface's peft's get_peft_model(...) and my LoraConfig(...) from Model_A to create the lora model, as Model_B
Create my own pipeline based model Model_C from Model_B

And I run Model_C under 2  3090ti GPUs.  And the assertion failure looks like this:
Traceback (most recent call last):
  File "/home/ubuntu/proj/chatglm-finetuning/train_pipeline.py", line 372, in <module>
    main()
  File "/home/ubuntu/proj/chatglm-finetuning/train_pipeline.py", line 351, in main
    loss = engine.train_batch(data_iter=train_dataloader)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/runtime/pipe/engine.py", line 375, in train_batch
    self._exec_schedule(sched)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/runtime/pipe/engine.py", line 1375, in _exec_schedule
    self._exec_instr(**cmd.kwargs)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/runtime/pipe/engine.py", line 276, in _exec_reduce_tied_grads
    dist.all_reduce(grad, group=group)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/comm/comm.py", line 117, in log_wrapper
    return func(*args, **kwargs)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/comm/comm.py", line 496, in all_reduce
    return cdb.all_reduce(tensor, op, group, async_op)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/deepspeed/comm/torch.py", line 159, in all_reduce
    return torch.distributed.all_reduce(tensor=tensor, op=op, group=group, async_op=async_op)
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/torch/distributed/distributed_c10d.py", line 1520, in all_reduce
    _check_single_tensor(tensor, "tensor")
  File "/home/ubuntu/anaconda3/lib/python3.9/site-packages/torch/distributed/distributed_c10d.py", line 463, in _check_single_tensor
    raise RuntimeError(
RuntimeError: Invalid function argument. Expected parameter `tensor` to be of type torch.Tensor.

After some debugging, I find out the root cause is that my configuration of lora (in below) only add extra lora layer(part) in qkv related layers but not the embedding layer. So the whole embedding layer's parameters are freezed.
lora_config = LoraConfig(r=8, # copied from finetuning_lora.py
                        lora_alpha=32,
                        target_modules=["query_key_value"],
                        lora_dropout=0.1,
                        bias="none",
                        task_type="CAUSAL_LM",
                        inference_mode=False,
                        )

And in my implementation of pipeline based model, I declared the embeding layer as a tied-layer.  So the whole thing is that there are no gradients at all for embedding layer, but embedding layer as the tied layer needs to be synced between two gpus.  The value of gradient is None but is still passed to  all_reduce operation.
Current, my fix is simple and add a check if this grad is None.

@duli2012  Hi, I'm not sure if this pull request meet the project's requirement ?  Or any suggestions on this PR,  expect your reply :)

@tohtana , thank you for your reply,  I saw some unit test failures above, do I need to look into it ?

@xuanhua  I wonder if this is an issue on our CI. Let us take a look and restart after it is fixed.

authors: tohtana xuanhua


text:
Compatibility issues with NumPy 2.0.0

When I run the code
import torch_directml

device = torch_directml.device()

print(device)

I got the error msg:
 A module that was compiled using NumPy 1.x cannot be run in
NumPy 2.0.0 as it may crash. To support both 1.x and 2.x
versions of NumPy, modules must be compiled with NumPy 2.0.
Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to
downgrade to 'numpy<2' or try to upgrade the affected module.
We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last):  File "D:\JetBrains\PyCharm Professional\plugins\python\helpers\pydev\pydevd.py", line 2252, in <module>
    main()
  File "D:\JetBrains\PyCharm Professional\plugins\python\helpers\pydev\pydevd.py", line 2234, in main
    globals = debugger.run(setup['file'], None, None, is_module)
  File "D:\JetBrains\PyCharm Professional\plugins\python\helpers\pydev\pydevd.py", line 1544, in run
    return self._exec(is_module, entry_point_fn, module_name, file, globals, locals)
  File "D:\JetBrains\PyCharm Professional\plugins\python\helpers\pydev\pydevd.py", line 1551, in _exec
    pydev_imports.execfile(file, globals, locals)  # execute the script
  File "D:\JetBrains\PyCharm Professional\plugins\python\helpers\pydev\_pydev_imps\_pydev_execfile.py", line 18, in execfile
    exec(compile(contents+"\n", file, 'exec'), glob, loc)
  File "E:\Projects\---\main.py", line 1, in <module>
    import torch_directml
  File "E:\Projects\---\.venv\Lib\site-packages\torch_directml\__init__.py", line 94, in <module>
    torch._register_device_module('privateuseone', PrivateUse1Module)
  File "E:\Projects\---\.venv\Lib\site-packages\torch\__init__.py", line 1908, in _register_device_module
    device_type = torch.device(device_type).type
E:\Projects\---\.venv\Lib\site-packages\torch\__init__.py:1908: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at ..\torch\csrc\utils\tensor_numpy.cpp:84.)
  device_type = torch.device(device_type).type

Enviroments:

Windows 11 23H2 22631.3880
Python 3.12
torch-directml 0.2.2.dev240614
torch 2.3.1

I got the same error too. My system environment is：

system: Windows 11 专业工作站版
cpu：AMD Ryzen 9 7940HS

As a temporary workaround, it helped me to downgrade numpy:
pip install numpy==1.26.4

As a temporary workaround, it helped me to downgrade numpy:
pip install numpy==1.26.4

Yes it works. It needs to limit the version or try to become compatible with numpy 2

We're tracking an issue where the latest Windows PyTorch builds are built against numpy<2 https://github.com/pytorch/pytorch/issues/131668. This issue should be fixed in the upcoming PyTorch 2.4.1 release which we plan to add support for

source: gharchive/issue

authors: GongHuilin-DL GuangChen2333 VadimShabashov joshjkim

repo: microsoft/DirectML

license: MIT


text:
No module named 'code.env'

When we run python code/tools/train_on_atari.py exp/atari_local.yml， we get the following error：
Traceback (most recent call last):
File "code/tools/train_on_atari.py", line 25, in
from code.env import EnvConfig
ModuleNotFoundError: No module named 'code.env'
We searched the folder code and did not find the file env. Maybe, the file env is forgotten to put into the folder code.

When we run python code/tools/train_on_atari.py exp/atari_local.yml， we get the following error： Traceback (most recent call last): File "code/tools/train_on_atari.py", line 25, in from code.env import EnvConfig ModuleNotFoundError: No module named 'code.env'
We searched the folder code and did not find the file env. Maybe, the file env is forgotten to put into the folder code.

Hi there, sorry for the inconvenience. We've checked with the file list and found some code files were ignored following the git ignore rules. Now we've updated the repository and hope you can find it helpful.
Thank you for your report.

Thank you， I have run python code/tools/train_on_atari.py exp/atari_local.yml successfully.

repo: microsoft/EPPO


text:
Compaction for C++ FASTER

Implements a 3 phased approach similar to the C# version.
Phase 1: Collects records from the region to be compacted into a mini-FASTER instance.
Phase 2: Scans records in FASTER's log upto the safe read-only offset, deleting them from the mini-FASTER instance.
Phase 3: Inserts records from the mini-FASTER into the hybrid log as long as they don't exist in it's mutable region.
Also includes a scan iterator that scans records between a provided address range. Like the C# version, this iterator is capable of buffering pages that are on disk.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: chinkulkarni sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

authors: chinkulkarni msftclas

repo: microsoft/FASTER


text:
Provide support for .Net Framework and other technologies

@jimmyca15
Are there plans to support clients for non .NET Core apps? i.e .Net Framework and PHP?

.NET Framework can use this library already since it is .NET Standard. There are no plans to support PHP with this library.

The console app example would be similar to how an IFeatureManager would be obtained in a .NET Framework application: https://github.com/microsoft/FeatureManagement-Dotnet/blob/master/examples/ConsoleApp/Program.cs

Please re-open if there are more questions.

@jimmyca15 slightly off topic from this SDK but is their a REST API we could use to build a similar implementation in PHP?

@Joe-U-Questionmark this library does not depend on any services. It read feature flags all from IConfiguration.
People can build any configuration providers to feed feature flags into IConfiguration. The Azure App Configuration has a config provider (in .NET and Java) to do so. If you are interested to read feature flags from the App Configuration in PHP, then yes, the App Configuration has REST APIs.

authors: Joe-U-Questionmark jimmyca15 zhenlan

repo: microsoft/FeatureManagement-Dotnet


text:
sequence numbers are reported in telemetry under too many properties

When I'm doing queries in Kusto, and need to investigate summarization issues, I want to see all the fields that carry sequence numbers.
Intelligence gives me a zoo of names, like these:

Data_seqNumber, Data_sequenceNumber,
Data_referenceSequenceNumber, Data_refSequenceNumber

Can we standardize our repo to use fewer different names when logging similar concepts?
We can cut this list in two.
Are there any other cases like that?
This view might be useful to see all the properties that get indexed in Kusto to examine for similar names.
BTW, merging columns would reduce COGS as well :)
This is not urgent, but feels simple and has immidiadate impact, so putting it into June.
Feel free to move out if needed
@markfields - FYI

It can be a separate issue in the end, but I'd like to take an inventory of field names now, and identify other redundant sets.
An idea I had to help enforce using consistent "spellings" of common fields is to add a generic type param to ChildLogger which would be a Partial interface of all the common fields that might be logged at that layer, and then the event passed in would also include that type to get some auto-complete suggestions.  The thought is, it's like the property bags, but instead of being fixed or getters, they're just placeholders.

I do not think it will work. First, it would be pain in the butt to add new properties.
It would also break our desire to have various layers (like driver, loader, runtime) to change independently from one another.
And developers build components in their own repos, leveraging our stack.

Not sure I understand your objections @vladsud. There would be nothing leaked between layers. Just whenever you create a ChildLogger you would do ChildLogger where T is a type with canonical prop names for that layer, and the send functions would have an extra optional param of type Partial so you can set those props and have the compiler help you spell them right. Maybe actually we just change the type of the event param to be Partial & ITelemetryBaseEvent, or augment that base type to get the generic param, or something.

Not sure how practical it really is, but something to keep in mind while cleaning these and others up.

I'm going to close this - the two examples Vlad gave are not actionable - in the code there's only one spelling of each case, it's from older versions that the other is still there.
As for the more general problem, two comments:

Let's keep opening small issues like this (and fix them right away because they're easy!) when we find redundant properties
I've opened this issue covering the larger concern about standardizing and documenting some of our telemetry events: https://github.com/microsoft/FluidFramework/issues/6976

authors: markfields vladsud

repo: microsoft/FluidFramework


text:
Post 1.0 release cleanup

rerun type validation.
updated lerna-package-lock.json

Client tests are failing on ci:test with some intermittent failure seen on other PRs as well (that eventually goes away with rerun). Merging this PR, as these are all type tests and should be failing on build time.


text:
removed OpenMP ugly fix for Mojave

@henry0312 I think 3.16.2 is quite stable and we can require 3.16 for macOS with AppleClang as we discussed earlier.

PR to Homebrew has been proposed: https://github.com/Homebrew/homebrew-core/pull/48822.

Hmmm, everything works fine on our CI services, but fails during building Homebrew formula (even for macOS 10.13, which should be unaffected).
@henry0312 Would you mind take a look: https://jenkins.brew.sh/job/Homebrew Core Pull Requests/54922 ?

Sorry, I don't know about Homebrew.

@henry0312 OK, no problem! I think it's OK to leave the formula as is because it doesn't affect users' experience.

repo: microsoft/LightGBM

license: mit

license_source: bigquery


text:
Unity crashes with speaker chosen as default playback device on Windows 10

For some reason, when my speaker is chosen as default playback device, the Unity crashes when trying to initialize the peerconnection. No error message is given, and attaching VS to Unity does not hit any exception breakpoints. Unity simply just closes.

This does not happen if any other playback device is chosen, as seen below

I'm still investigating the issue, but is there any reason why this should happen?
Unity 2019.1.14
Latest master branch
Windows 10 Build 18362

No, there is no reason why it would fail with one device. Unless another application is using that device in exclusive mode, or (and I don't know if it does) WebRTC is trying to open the device in exclusive mode but another application is using it in shared mode.

That might be the issue, yes. I don't experience this on any other computer using the same code. Weird that it happens on clean restart and no other programs running, but I guess it isn't an issue with the WebRTC code. Other than maybe it should throw an exception instead of silently crashing?

@eirikhollis if you have some time to pinpoint where it's crashing we can look at adding an exception. But on top of my head with the info above I have no guess where that can happen.

We'll leave it for now. I can message you later if I ever do pinpoint it.

authors: djee-ms eirikhollis

repo: microsoft/MixedReality-WebRTC


text:
The video screen displays all layer levels, how can it only display a fixed level of gameobject

The video screen shows all layer levels, how can it be the same as Camera cullingMask?

hideModel does not show
This is because I opened the PV camera, this will render all layers

This seems a Unity issue/question rather than being related to MR-WebRTC.


text:
Build Window should use USB Ncm instead of IpOverUsb

Describe the bug
The MRTK Build Window (Deploy Options) defaults to connecting to a HoloLens over 127.0.0.1. As per the MRTK documentation ( See Using the Windows Device Portal ), IpOverUsb is no longer recommended. The link/button "Open Device Portal" is now broken since http://127.0.0.1:10080/ does not work.
However, the Test Connection button does confirm that it is able to connect to my HL2.
To reproduce

Set up a new project with MRTK.
Navigate to Mixed Reality > Toolkit > Utilities > Build Window > Deploy Options

Expected behavior
The IP used for a Local connection should be 169.254.x.x .
Maybe the best solution is to have inputs for the last two values in the IP?
Screenshots

Your setup

Unity Version 2020.3.6.f1
MRTK Version 2.7.2

Target platform

HoloLens 2

Thanks for catching this @wlewis55.

Hi @wlewis55, until we fix this, the current workaround is to change the Target Type so you can input your USBNcm IP address.

Moving to 2.x Future as there are deeper issues with the build window logic that is breaking with UsbNcm.

We appreciate your feedback and thank you for reporting this issue.
Microsoft Mixed Reality Toolkit version 2 (MRTK2) is currently in limited support. This means that Microsoft is only fixing high priority security issues. Unfortunately, this issue does not meet the necessary priority and will be closed. If you strongly feel that this issue deserves more attention, please open a new issue and explain why it is important.
Microsoft recommends that all new HoloLens 2 Unity applications use MRTK3 instead of MRTK2.
Please note that MRTK3 was released in August 2023. It features an all new architecture for developing rich mixed reality experiences and has a minimum requirement of Unity 2021.3 LTS. For more information about MRTK3, please visithttps://www.mixedrealitytoolkit.org.
Thank you for your continued support of the Mixed Reality Toolkit!

authors: IssueSyncBot davidkline-ms polar-kev wlewis55

repo: microsoft/MixedRealityToolkit-Unity


text:
UGUIInputAdapter NREs when the IMM disables the CanvasProxyInteractor

Describe the bug
#10838 made the IMM disable the CanvasProxyInteractor in some circumstances. This broke the UGUIInputAdapter, as it would NRE whenever the hands were visible :(
To reproduce
Steps to reproduce the behavior:

Make sim hands visible
Mouse over buttons
Observe NRE spam

Expected behavior
No NRE spam.

Fixed!


text:
Mixed Reality Toolkit Configuration Guide is buried

Describe the Issue
Finding the MRTK Configuration Guide is almost impossible without a direct link.
This is the only document that provides a compact list of profile / service types and a brief description of what they do. The next best thing is our Packages doc, and its list of core services is out of date.
What needs to change

The github landing page should provide a link to docs sooner.
A link to the configuration guide should be added to the main doc menu.
Cross-links to the configuration guide should be added to pages like Profiles, MRTK Packages etc.

Additional Context
Our landing page waits too long to provide a documentation link. Even knowing it's there, it still takes me a moment to find it:

From the Getting Started doc, this is how long it takes to see a link to the MRTK Configuration Guide, and it's the last element in a list of bullet points:

The configuration guide appears nowhere in the sidebar menu:

Related: #4779

@cre8ivepark This seems like your domain.


text:
Add support for Leap UnityModules 4.9.1

Overview
Add support for 4.9.1 UnityModules - release notes available here.
Verification
Run through Using Leap and try out the example scenes in Head and Desk mode. 4.9.1 can be downloaded from the release page above or from the Ultraleap Developer Site.
Pull request for the docs repo to come shortly.

@keveleigh @Craig-J I'm just sitting together with UltraLeap in the MS MTC in Munich :) I think in general enabling every single minor version of LeapMotion is exhausting. It seems since version 4.7.1 the versioning mess is gone and the asmdef is also not needed anymore. I suggest we either use a regex for the version check like 4.* or just automatically allow all new versions. I will reach out to the UltraLeap dev team to make them aware of this issue.

I'm part of the dev team at Ultraleap which is responsible for UnityModules. I don't think it's a lot of effort to support new versions especially now that we're back on track keeping the version.txt up to date.
We will likely want to revisit the configuration checker in the next major versions of both our plugin (5.x - as there is likely to be breaking changes requiring new or modified logic) and MRTK (3.x - the major version bump is an opportunity to remove any deprecated logic no longer required for UnityModules versions that the MRTK team no longer want to support).

@Craig-J thanks for the clarification. And sorry, I didn't see that you're from ultraleap :) We were prototyping an ultrahaptic integration for MRTK/HoloLens 2.

We will likely want to revisit the configuration checker in the next major versions of both our plugin (5.x - as there is likely to be breaking changes requiring new or modified logic) and MRTK (3.x - the major version bump is an opportunity to remove any deprecated logic no longer required for UnityModules versions that the MRTK team no longer want to support).

@Craig-J Yes we will, MRTK v3 will likely utilize the LeapMotion OpenXR plugin (https://developer.leapmotion.com/openxr) and remove the logic required for the v2 configuration checker.

authors: CDiaz-MS Craig-J ltwlf


text:
Add Azure DevOps Task to install NLU.DevOps extension

Add a task called NLUInstallExtension that will install a .NET Core CLI tool package in the correct location for integration with NLU.DevOps.

Not sure this is needed as it's reasonably trivial to just use:
- task: DotNetCoreCLI@2
  displayName: Install dotnet-nlu-mock
  inputs:
    command: custom
    custom: tool
    arguments: install dotnet-nlu-mock --add-source $(Build.ArtifactStagingDirectory) --tool-path $(Agent.TempDirectory)/.dotnet

Re-opening, given this is something we may want.

Closing again, now that we have toolPath input, it's trivial to install the tool to the correct location.


text:
Adds Azure DevOps task extension for NLU.DevOps commands

Adds extension to install dotnet-nlu and run the train, test, and clean commands in single, independent tasks.

Add unit tests!

/azp run

/azp run

/azp run


text:
Arecibo backports

Small backports from Arecibo, please refer to the individual commit messages.

Thanks! This also addresses issue #202

@srinathsetty not completely, there's still some duplication between Pasta, on the one hand, and the Halo2curves-based implementations, on the other hand.

authors: huitseeker srinathsetty

repo: microsoft/Nova


text:
Publish OSS Gadget to Nuget

Fix #196.
Creates a template to run and (eventually) a separate pipeline for each ossgadget which will be published.

*.csproj lgtm

authors: daalcant gfs

repo: microsoft/OSSGadget


text:
Multidetectors

WIP to fix #141

I am sorry, but for the time being I don't have the time to finish this. I've taken on another role at work, which currently doesn't leave me time for much else. Should I close the pull request?

Cdhf,
No reason to apologize. We're grateful for the contributions you did make. And we are currently implementing something very much like this. Don't close the pull request yet, we're using the discussion there as a reference. It's better to leave it open as a reminder to us to keep working on it.
Have fun in your new role. I hope you have the opportunity to contribute to OpticSim again. Your comments were always spot on and your suggestions were technically excellent.
-brian
From: cdhf @.>
Sent: Sunday, August 22, 2021 6:55 AM
To: microsoft/OpticSim.jl @.>
Cc: Brian Guenter @.>; Comment @.>
Subject: Re: [microsoft/OpticSim.jl] Multidetectors (#209)
I am sorry, but for the time being I don't have the time to finish this. I've taken on another role at work, which currently doesn't leave me time for much else. Should I close the pull request?

You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fmicrosoft%2FOpticSim.jl%2Fpull%2F209%23issuecomment-903272771&data=04|01|bguenter%40microsoft.com|21326cb985f948719d6708d965746c23|72f988bf86f141af91ab2d7cd011db47|1|0|637652372980714336|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=%2FMp09LZY6GJ92TP%2FrJeraPOaSZMJgAoDnbt4WZ7wByg%3D&reserved=0, or unsubscribehttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAIWNESUTBAOAVXIIM6GNHG3T6D6S7ANCNFSM47J3KOMQ&data=04|01|bguenter%40microsoft.com|21326cb985f948719d6708d965746c23|72f988bf86f141af91ab2d7cd011db47|1|0|637652372980724330|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=8%2BPy%2BsMrW9CzcxERjwbBVb0BAgJD473QQKRM9LCiHl0%3D&reserved=0.
Triage notifications on the go with GitHub Mobile for iOShttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fapps.apple.com%2Fapp%2Fapple-store%2Fid1477376905%3Fct%3Dnotification-email%26mt%3D8%26pt%3D524675&data=04|01|bguenter%40microsoft.com|21326cb985f948719d6708d965746c23|72f988bf86f141af91ab2d7cd011db47|1|0|637652372980724330|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=8CN7FmarBaD4yevpAyoDJ2%2F3fuNb47BLJ0Ds4LArx7M%3D&reserved=0 or Androidhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fplay.google.com%2Fstore%2Fapps%2Fdetails%3Fid%3Dcom.github.android%26utm_campaign%3Dnotification-email&data=04|01|bguenter%40microsoft.com|21326cb985f948719d6708d965746c23|72f988bf86f141af91ab2d7cd011db47|1|0|637652372980734317|Unknown|TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D|1000&sdata=Io0bPb0jQCb7OQWmYc7aMVXrEYkZLqvI7dh7ZFpcaOA%3D&reserved=0.

No progress on this PR for a long time so closing it.

authors: BrianGun cdhf


text:
ERROR: The process "xxxxx" not found

Environment

Steps to Reproduce
1.New a python project
2.Check the Output window
Expected behavior
No errors pop up
Actual behavior
There are some errors pop up
ERROR: The process "10924" not found.
ERROR: The process with PID 5180 (child process of PID 8076) could not be terminated.
Reason: There is no running instance of the task.

Python was not found; run without arguments to install from the Microsoft Store, or disable this shortcut from Settings > Manage App Execution Aliases.
Python was not found; run without arguments to install from the Microsoft Store, or disable this shortcut from Settings > Manage App Execution Aliases.

ERROR: The process "3972" not found.

Can you try the following things:

Make sure Python is installed on your machine.
Make sure that the correct Python interpreter is selected for your project.
Check for Running Processes: The error mentions processes with PIDs (Process IDs). You can open the Task Manager (Ctrl + Shift + Esc) and manually check if the mentioned PIDs are running. If not, try terminating any related processes and restart Visual Studio.

@StellaHuang95
The Python installed from workload and Python interpreter is selected for my project. And check the mentioned PIDs, not found the processes.

I tried terminating any related processes and restart Visual Studio, the error still displayed.

@linette-zyy Thanks. Can you try the following?

Check if your python 3.9 is added to PATH?
Go to -> "start" and type "Manage App Execution Aliases". Go to it and turn off "Python".

I cannot repro it after adding python 3.9 to PATH. And cannot find python in App Execution Aliases.

In today's build 17.9.0 Preview 2.0 [34320.133.main], Python Package: 17.0.23314.1, I can repro it. (Python installed from Microsoft store)

This should be fixed once PTVS consumes the latest pylance stable version.

@StellaHuang95 This issue still repro on the latest build.

The pylance version:

Which stable version with pylance will fix this issue.

We haven't shipped the stable pylance version yet.

authors: StellaHuang95 linette-zyy ttSpace

repo: microsoft/PTVS


text:
Add surface_analysis notebook

This PR adds the surface_analysis notebook to the tutorials folder.

Thanks. Some comments below:

"Azure Storage" -> "Azure Blob Storage"
Use pystac_client rather than satsearch
While running the example, I noticed that the operations like hillshade weren't parallelizing too well. I think that was primarily caused by small chunks in the Dask array (8 Mb). Can you add chunksize=2048 to the stackstac.stack call and link to https://docs.dask.org/en/latest/array-best-practices.html#select-a-good-chunk-size?
I think it's worth (re)-emphasizing that all of the xrspatial functions are just returning DataArrays. Maybe print out the elevation_img DataArray prior to plotting it? And then in the wrapup under "Next steps" you can again mention that these return DataArrays which can be used in downstream analysis.
(xarrap-spatial API nitpick): All of the stuff around setting up the Canvas feels a bit awkward

# get full extent of raster
full_extent = (
    elevation_raster.coords["x"].min().item(),
    elevation_raster.coords["y"].min().item(),
    elevation_raster.coords["x"].max().item(),
    elevation_raster.coords["y"].max().item(),
)

# get ranges
x_range = (full_extent[0], full_extent[2])
y_range = (full_extent[1], full_extent[3])

# set width and height
W = 750
H = height_implied_by_aspect_ratio(W, x_range, y_range)

cvs = ds.Canvas(plot_width=W, plot_height=H, x_range=x_range, y_range=y_range)

That's a lot of typing for what's essentially "(spatially) resample this DataArray" to this new size. It'd be nice if xarray-spatial add a higher-level API to make that easier. Something like
def resample_spatial(ds=None, x=None, y=None, *, width=None, height=None):
    """
    Spatially resample a DataArray to a new size.

    Notes about dimensions, coordinates, how width / height are handled.

    Examples
    ----------
    >>> elevation_small = resample_spatial(elevation_raster, x="x", y="y", width=750)
    """

Implementation-wise that would look very similar to the code from the notebook. Determine the new coordinate bounds, get the width and height for datashader's Canvas. There would be some things to figure with how dimensions are passed in (separate data arrays like ds['x'], ds['y'] vs. a single DataArray and names like `ds, 'x', 'y'), but I think it'd be helpful. Any thoughts on that?

Thanks. The notebook is updated as suggested. A function called canvas_like is being added to xarray-spatial to wrap all resampling steps using in the notebook.

[x] "Azure Storage" -> "Azure Blob Storage"
[x] Use pystac_client rather than satsearch
[x] Call planetary_computer.sign(item) on all the items prior to stacking them
[x] Add chunksize=2048 to the stackstac.stack call and link to https://docs.dask.org/en/latest/array-best-practices.html#select-a-good-chunk-size
[x] (re)-emphasizing that all of the xrspatial functions are just returning DataArrays
[x] (xarrap-spatial API nitpick) Add a higher-level API that uses Datashader internally to resample a DataArray: https://github.com/makepath/xarray-spatial/pull/539

I notice that the file is now 9.7Mb (dunno if it was before) which would make it the largest we have.
Do you know why it's so large? Are you able to cut that down to roughly <3Mb to be in line with the other notebooks?

Thanks for the comments. The resampling section is revert to coding block instead of using canvas_like function. The large file caused by the size of canvas/images to be displayed. I've reduced image width to 300 instead of 400 and the file is about 3.7Mb now.

Great, thanks!

authors: TomAugspurger tcmetzger thuydotm

repo: microsoft/PlanetaryComputerExamples


text:
Text function: thousands grouping incorrectly applied when preceded by an escaped numeric format char

The result of Text(12345.34567, "0\#,0") should be "1234#,5" - since the , character is not between two numeric format chars, it should not be interpreted as a thousands separator. The function currently returns "12,34#5".

Fixed in 1997

authors: CarlosFigueiraMSFT nguhoa

repo: microsoft/Power-Fx


text:
HubSpot CRM issue

Api Name - shared_hubspotcrm
Bug description -Failed to authenticate with Hubspot.
When initiating a new connection with Hobstpot CRM
-Click the Hobspot "Sign In" on the power automate portal
-New window pops up from hubspot asking to sign in
-Provide credentials
-Same windows asks for you to choose a hubspot account that you would like to integrate with.... it lists off all the accounts associated with my credentials.
-select the appropriate account and press "choose account"
-Error pops up in the hubspot browser window saying that "Couldn't complete the connection", "An error occurred while validating the app authorization".

Is this a security bug? (Y/N)
What is the severity of this bug?

CCing @jopanchal and @Amjed-Ayoub. Can you find out if the OAuth client ID has hit a rate limit from HubSpot?

Hi Troy-
Thanks for getting back to me. I am also working this from the Hubspot side to make sure there is nothing on their end. They say that the account hasn’t hit any rate limits and that the initial connection doesnt even get established so it isn’t listed as an integration within the account and won’t have any oauth activity to report against.
I created a short video for the hubspot team to watch the error….  It’s attached but if the there is a size limit I also put it into a dropbox folder that you can access via this link.
https://www.dropbox.com/s/pz99bs9n2bp0xaq/HubspotLoginIssue.mp4?dl=0

Hey all,
I have been having this exact same issue for the last few weeks when trying to connect Power Automate to the HubSpot CRM. The login I am using to connect to the HubSpot Account is a super admin for the account and a Sales Professional (unsure if this would be required).

FWIW:
{status: "DEPRECATED_REPORTS_SCOPE",…} correlationId :  "b953393e-e50f-4cd5-9b33-c02f8cf7a0ec" message :  "The scope you requested, reports, has been deprecated. This install link is invalid. Please try installing this app from our App Marketplace: https://ecosystem.hubspot.com/marketplace/apps" status :  "DEPRECATED_REPORTS_SCOPE"

@troystaylor it look like one of the scops has been removed. please see below.
message
:
"The scope you requested, reports, has been deprecated. This install link is invalid. Please try installing this app from our App Marketplace: https://ecosystem.hubspot.com/marketplace/apps"
status
:
"DEPRECATED_REPORTS_SCOPE"
You might need to remove this scope form the connector files, apiProperties.
Thank you so much.

Do y’all have a video walk through to setup the connection?  I’ve removed the reports from the scopes but it’s not doing anything. Same errorsOn Apr 5, 2023, at 2:28 PM, Amjed Ayoub @.***> wrote:
@troystaylor it look like one of the scops has been removed. please see below.
message
:
"The scope you requested, reports, has been deprecated. This install link is invalid. Please try installing this app from our App Marketplace: https://ecosystem.hubspot.com/marketplace/apps"
status
:
"DEPRECATED_REPORTS_SCOPE"
You might need to remove this scope form the connector files, apiProperties.
Thank you so much.
—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

When will Microsoft merge your PR  @troystaylor?

@salaros It will be a couple of weeks as part of the normal deployment train.

Any chance to expedite if the entire integration is broken?
Thank you in advance for your efforts.

So here's the thing - the entire integration is not broken. It is only broken for users creating their new connection references. The majority of existing users will continue to have their connections work until the token has to be refreshed.

Noted. I appreciate your reply. Cheers.

So here's the thing - the entire integration is not broken. It is only broken for users creating their new connection references. The majority of existing users will continue to have their connections work until the token has to be refreshed.

that's my case

From time to time I try to add a HubSpot to my PowerFlow, but it still fails, means that the solution hasn't been deployed yet.
Is there a reliable way of knowing when exactly a pull request on this repository got actually deployed onto production?

Is there any chance fixes for #2507 will be deployed to make.powerautomate.com in Q2 2023?

To be honest I don't understand why is is taking more than one month to get rid of reports in application's manifest,
just release it as a hotfix if your deployments cycles happen once a year.

Hm.. so have we gotten any closer to having a working HubSpot integration? After almost 3 months it is still not working.
I thought it usually takes 3-4 weeks to get deployed 😢

Hello @salaros I can confirm that the scopes has been removed from the internal connector files. Please allow me some time to investigate this issue.
Please accept our apologies for the inconvenience this has caused.
Thank you so much again for your patience and understanding.

Hey, any follow-up on what @salaros said @troystaylor? I have been trying to get connected and have failed to do so. Will say I am not the most tech savy relative to a programming community but if there's any videos that could help for a work around that would be great as well.

@tyleringram123 when it will start working, I will record a video for you, for now it is not working (for new users, who never connected HubSpot to Power Automate)

Thank you @salaros ! For now just made a custom connector on power automate that does most of teh things. Only thing I am still stuck on is setting up triggers since I am not familiar with webhooks and nuance of it.

@Amjed-Ayoub any news?

Hi all, what is the status on this? Why you don't close this issue with a wontfix status?
It's clearly not working and never will for new users. It had to be fixed and deployed 3 weeks after being reported, but here we are, it's almost August and we are still discussing it.

authors: Amjed-Ayoub dawolfsclaw ellismw jamieaquila salaros troystaylor tyleringram123

repo: microsoft/PowerPlatformConnectors


text:
Proposal - Deel Platform (Independent Publisher)

When submitting a connector, please make sure that you follow the requirements below, otherwise your PR might be rejected. We want to make you have a well-built connector, a smooth certification experience, and your users are happy :)
If this is your first time submitting to GitHub and you need some help, please sign up for this session.

[✔  ] I attest that the connector doesn't exist on the Power Platform today. I've verified by checking the pull requests in GitHub and by searching for the connector on the platform or in the documentation.
[x] I attest that the connector works and I verified by deploying and testing all the operations.
[x] I attest that I have added detailed descriptions for all operations and parameters in the swagger file.
[x] I attest that I have added response schemas to my actions, unless the response schema is dynamic.
[x] I validated the swagger file, apiDefinition.swagger.json, by running paconn validate command.
[x] If this is a certified connector, I confirm that apiProperties.json has a valid brand color and doesn't use an invalid brand color, #007ee5 or #ffffff. If this is an independent publisher connector, I confirm that I am not submitting a connector icon.

If you are an Independent Publisher, you must also attest to the following to ensure a smooth publishing process:

[x] I have named this PR after the pattern of "Connector Name (Independent Publisher)" ex: HubSpot Marketing (Independent Publisher)
[x] Within this PR markdown file, I have pasted screenshots that show: 3 unique operations (actions/triggers) working within a Flow. This can be in one flow or part of multiple flows. For each one of those flows, I have pasted in screenshots of the Flow succeeding.
[x] Within this PR markdown file, I have pasted in a screenshot from the Test operations section within the Custom Connector UI.
[x] If the connector uses OAuth, I have provided detailed steps on how to create an app in the readme.md.

@microsoft-github-policy-service agree [company=""]
Hilmus Software http://hilmus.com
On Thu, Sep 29, 2022 at 10:14 AM microsoft-github-policy-service[bot] <
@.***> wrote:

@jetsstarplus https://github.com/jetsstarplus please read the following
Contributor License Agreement(CLA). If you agree with the CLA, please reply
with the following information.
@microsoft-github-policy-service agree [company="{your company}"]
Options:

(default - no company specified) I have sole ownership of
intellectual property rights to my Submissions and I am not making
Submissions in the course of work for my employer.
(when company given) I am making Submissions in the course of work
for my employer (or my employer has intellectual property rights in my
Submissions by contract or applicable law). I have permission from my
employer to make Submissions and enter into this Agreement on behalf of my
employer. By signing below, the defined term “You” includes me and my
employer.

Contributor License Agreement Contribution License Agreement
This Contribution License Agreement (“Agreement”) is agreed to by the
party signing below (“You”),
and conveys certain license rights to Microsoft Corporation and its
affiliates (“Microsoft”) for Your
contributions to Microsoft open source projects. This Agreement is
effective as of the latest signature
date below.

Definitions.
“Code” means the computer software code, whether in human-readable
or machine-executable form,
that is delivered by You to Microsoft under this Agreement.
“Project” means any of the projects owned or managed by Microsoft
and offered under a license
approved by the Open Source Initiative (www.opensource.org).
“Submit” is the act of uploading, submitting, transmitting, or
distributing code or other content to any
Project, including but not limited to communication on electronic
mailing lists, source code control
systems, and issue tracking systems that are managed by, or on behalf
of, the Project for the purpose of
discussing and improving that Project, but excluding communication
that is conspicuously marked or
otherwise designated in writing by You as “Not a Submission.”
“Submission” means the Code and any other copyrightable material
Submitted by You, including any
associated comments and documentation.
Your Submission. You must agree to the terms of this Agreement
before making a Submission to any
Project. This Agreement covers any and all Submissions that You, now
or in the future (except as
described in Section 4 below), Submit to any Project.
Originality of Work. You represent that each of Your Submissions
is entirely Your original work.
Should You wish to Submit materials that are not Your original work,
You may Submit them separately
to the Project if You (a) retain all copyright and license information
that was in the materials as You
received them, (b) in the description accompanying Your Submission,
include the phrase “Submission
containing materials of a third party:” followed by the names of the
third party and any licenses or other
restrictions of which You are aware, and (c) follow any other
instructions in the Project’s written
guidelines concerning Submissions.
Your Employer. References to “employer” in this Agreement include
Your employer or anyone else
for whom You are acting in making Your Submission, e.g. as a
contractor, vendor, or agent. If Your
Submission is made in the course of Your work for an employer or Your
employer has intellectual
property rights in Your Submission by contract or applicable law, You
must secure permission from Your
employer to make the Submission before signing this Agreement. In that
case, the term “You” in this
Agreement will refer to You and the employer collectively. If You
change employers in the future and
desire to Submit additional Submissions for the new employer, then You
agree to sign a new Agreement
and secure permission from the new employer before Submitting those
Submissions.
Licenses.

Copyright License. You grant Microsoft, and those who receive the
Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive,
royalty-free, irrevocable license in the
Submission to reproduce, prepare derivative works of, publicly
display, publicly perform, and distribute
the Submission and such derivative works, and to sublicense any or all
of the foregoing rights to third
parties.
Patent License. You grant Microsoft, and those who receive the
Submission directly or
indirectly from Microsoft, a perpetual, worldwide, non-exclusive,
royalty-free, irrevocable license under
Your patent claims that are necessarily infringed by the Submission or
the combination of the
Submission with the Project to which it was Submitted to make, have
made, use, offer to sell, sell and
import or otherwise dispose of the Submission alone or with the
Project.
Other Rights Reserved. Each party reserves all rights not
expressly granted in this Agreement.
No additional licenses or rights whatsoever (including, without
limitation, any implied licenses) are
granted by implication, exhaustion, estoppel or otherwise.

Representations and Warranties. You represent that You are
legally entitled to grant the above
licenses. You represent that each of Your Submissions is entirely Your
original work (except as You may
have disclosed under Section 3). You represent that You have secured
permission from Your employer to
make the Submission in cases where Your Submission is made in the
course of Your work for Your
employer or Your employer has intellectual property rights in Your
Submission by contract or applicable
law. If You are signing this Agreement on behalf of Your employer, You
represent and warrant that You
have the necessary authority to bind the listed employer to the
obligations contained in this Agreement.
You are not expected to provide support for Your Submission, unless
You choose to do so. UNLESS
REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING, AND EXCEPT FOR THE
WARRANTIES
EXPRESSLY STATED IN SECTIONS 3, 4, AND 6, THE SUBMISSION PROVIDED
UNDER THIS AGREEMENT IS
PROVIDED WITHOUT WARRANTY OF ANY KIND, INCLUDING, BUT NOT LIMITED TO,
ANY WARRANTY OF
NONINFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE.
Notice to Microsoft. You agree to notify Microsoft in writing of
any facts or circumstances of which
You later become aware that would make Your representations in this
Agreement inaccurate in any
respect.
Information about Submissions. You agree that contributions to
Projects and information about
contributions may be maintained indefinitely and disclosed publicly,
including Your name and other
information that You submit with Your Submission.
Governing Law/Jurisdiction. This Agreement is governed by the
laws of the State of Washington, and
the parties consent to exclusive jurisdiction and venue in the federal
courts sitting in King County,
Washington, unless no federal subject matter jurisdiction exists, in
which case the parties consent to
exclusive jurisdiction and venue in the Superior Court of King County,
Washington. The parties waive all
defenses of lack of personal jurisdiction and forum non-conveniens.
Entire Agreement/Assignment. This Agreement is the entire
agreement between the parties, and
supersedes any and all prior agreements, understandings or
communications, written or oral, between
the parties relating to the subject matter hereof. This Agreement may
be assigned by Microsoft.

—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/PowerPlatformConnectors/pull/2010#issuecomment-1261863663,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMSYB5V7Z7PFY4IY6FNDMZLWAU6ULANCNFSM6AAAAAAQYOXWXU
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hello @jetsstarplus,
Thank you so much for your new proposal submission. We are looking forward to seeing your connector artifacts soon.
Please let us know if you have any questions.
Thank you so much again for working with us.

Hello @jetsstarplus,
I hope you are doing well.
I am following up with you to see how things are going with preparing your connector.
Please let us know if you have any questions.
Thank you.

Hello
I'm performing more research on the platform.
Kindly bare with me
On Fri, 30 Dec 2022, 22:49 Amjed Ayoub, @.***> wrote:

Hello @jetsstarplus https://github.com/jetsstarplus,
I hope you are doing well.
I am following up with you to see how things are going with preparing your
connector.
Please let us know if you have any questions.
Thank you.
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/PowerPlatformConnectors/pull/2010#issuecomment-1368069726,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AMSYB5U6AG4P4THMLVPJE63WP44DLANCNFSM6AAAAAAQYOXWXU
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hello @jetsstarplus ,
I hope you are doing well.
We would like to know the status of your connector. It has been in our repo since September 2022.
Please let us know how you would like to proceed.
Please do not hesitate to reach out if you have any questions as we are always happy to help.
Thank you very much.

Hello @jetsstarplus ,
I hope you are doing well.
Your connector has been in our repo since September 2022, hence we are closing this PR.  Please create a new PR whenever your artifacts are ready.
Thank you very much for you patience and understadning.

authors: Amjed-Ayoub jetsstarplus vmanoharas


text:
System.UnauthorizedAccessException: Access to the path 'C:\Users\andre\AppData\Local\Microsoft\PowerToys\PowerToys Run\settings.json' is denied.

Microsoft PowerToys version
0.37.2.0
Running as admin

[X] Yes

Area(s) with issue?
PowerToys Run
Steps to reproduce
Log
Version: 0.37.2.0
OS Version: Microsoft Windows NT 10.0.19043.0
IntPtr Length: 8
x64: True
Date: 21/05/2021 16:20:12
Exception:
System.UnauthorizedAccessException: Access to the path 'C:\Users\andre\AppData\Local\Microsoft\PowerToys\PowerToys Run\settings.json' is denied.
at System.IO.FileStream.ValidateFileHandle(SafeFileHandle fileHandle)
at System.IO.FileStream.CreateFileOpenHandle(FileMode mode, FileShare share, FileOptions options)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
at System.IO.StreamReader.ValidateArgsAndOpenPath(String path, Encoding encoding, Int32 bufferSize)
at System.IO.StreamReader..ctor(String path, Encoding encoding, Boolean detectEncodingFromByteOrderMarks)
at System.IO.File.InternalReadAllText(String path, Encoding encoding)
at System.IO.File.ReadAllText(String path)
at System.IO.Abstractions.FileWrapper.ReadAllText(String path)
at Microsoft.PowerToys.Settings.UI.Library.SettingsUtils.GetFile[T](String powertoyFolderName, String fileName)
at Microsoft.PowerToys.Settings.UI.Library.SettingsUtils.GetSettings[T](String powertoy, String fileName)
at Microsoft.PowerToys.Settings.UI.Library.SettingsUtils.GetSettingsOrDefault[T](String powertoy, String fileName)
at PowerLauncher.SettingsReader.ReadSettings()
at PowerLauncher.App.<>c__DisplayClass14_0.b__0()
at Wox.Infrastructure.Stopwatch.Normal(String message, Action action)
at PowerLauncher.App.OnStartup(Object sender, StartupEventArgs e)
at System.Windows.Application.OnStartup(StartupEventArgs e)
at System.Windows.Application.<.ctor>b__1_0(Object unused)
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)
✔ Expected Behavior
Start with the system normally
❌ Actual Behavior
this occurred at system startup, Powertoys asked for a report right when I turned on my pc
Other Software
No response

Is the current user logged in and what PowerToys run as a different user?

xref https://github.com/microsoft/PowerToys/issues/11304

authors: andrrff crutkas

repo: microsoft/PowerToys