text:
[Suggestion] Add heat values to common blocks

I think this would add to the mod, and provide more ways to heat up/cool down. It would also help you to feel more immersed, while not being overly apparent as long as values are made well and balanced. You'd need multiple blocks of the type in order to have a noticeable effect.
Right now the Body Heat mechanic is nice and the hot blocks that it checks for is also a neat system. It had me thinking of if heat values could be added to common blocks like stone, cobblestone, glass, wool block to start with maybe. This way you could use some blocks as insulation to keep your house warm, like wool blocks, while a cobblestone floor might radiate a cooler value and the glass too, or if you're down in a cave and jump out of some water but you're standing on stone, surrounded by stone, you might be cold and need some hot blocks to warm up or some hot item that gives you heat.
Alternatively to the heat values being added to blocks if that wouldn't work, there's also the possibility of adding heat levels to areas depending on how deep you are, if that makes sense? So going deeper underground leads to it getting hotter and hotter, absent of hot blocks around. Even hotter if you are next to a hot block. Likewise, the higher you go, the colder it gets. If there was some sort of breath mechanic that could factor into both as well. This would be nice, but I understand right now that you're focused on trying to revamp the heat mechanics and make it more balanced to survive in general so that's why I think it's a nice alternative but my first suggestion would be better for players to be able to build themselves a hotter/cooler place of living with specific blocks types.
I tried this one out with the formatting, hopefully it's a little easier to read and get the necessary info than my last request. Thanks for the response on that one by the way, the JSON work looks really promising and I'm excited to see where it ends up!

Hi, sorry for the long delay. I have also thought about this, but unfortunately, such system would be really resource intensive to implement, since it would involve a lot of raytracing each second.
But the second approach you highlighted might actually work. Currently, the only thing similar to that is that the caves have constant temperature (which is set in the config). I will try to see what I can do, but so far it seems to be fairly easy to implement. But from the realism and balance point of view, I am not really sure which values to put to make it scale realistically.


text:
ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied

Hello, we encountered this error today and we are not sure which causes the error since no requirements changes were made. It was also working before. I have also tried adding --user in pip install -r requirements.txt but doesn't resolve the issue.
Hoping you could help us check this issue, thank you
ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied: 'C:\Users\runneradmin\AppData\Local\Temp\pip-uninstall-x4zixpkk\_cffi_backend.cp39-win_amd64.pyd'
Consider using the --user option or check the permissions.
    runs-on: windows-latest
    timeout-minutes: 20
    steps:
      - name: Publish API Test Results
        uses: EnricoMi/publish-unit-test-result-action/composite@v2.9.0
        if: always()
        with:
          check_name: API Test Results
          files: |
            report.xml

`Run EnricoMi/publish-unit-test-result-action/composite@v2.9.0
Run echo '##[group]Check for Python3'
echo '##[group]Check for Python3'
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: Build and Test
JFROG_CLI_BUILD_NUMBER: 3934
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6345948715
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
MSYS: winsymlinks:nativestrict
Check for Python3
Run case "$RUNNER_OS" in
Run actions/cache/restore@v3
Received 0 of 513563070 (0.0%), 0.0 MBs/sec
Received 67108864 of 513563070 (13.1%), 31.7 MBs/sec
Received 100663296 of 513563070 (19.6%), 31.8 MBs/sec
Received 176160768 of 513563070 (34.3%), 41.8 MBs/sec
Received 230686720 of 513563070 (44.9%), 43.8 MBs/sec
Received 310378496 of 513563070 (60.4%), 49.0 MBs/sec
Received 385875968 of 513563070 (75.1%), 52.3 MBs/sec
Received 452984832 of 513563070 (88.2%), 53.7 MBs/sec
Received 509368766 of 513563070 (99.2%), 53.7 MBs/sec
Cache Size: ~490 MB (513563070 B)
"C:\Program Files\Git\usr\bin\tar.exe" -xf D:/a/temp/13e982d6-9178-40e0-8654-1decd7ccf259/cache.tzst -P -C D:/a/microscope-automation-gui/microscope-automation-gui --force-local --use-compress-program "zstd -d"
Received 513563070 of 513563070 (100.0%), 48.7 MBs/sec
Cache restored successfully
Cache restored from key: enricomi-publish-action-Windows-X64-pip-Python 3.9.13-d81e5b217e041ea3f958821f6daca2f5
Run echo '##[group]Install Python dependencies'
echo '##[group]Install Python dependencies'
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: Build and Test
JFROG_CLI_BUILD_NUMBER: 3934
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6345948715
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
MSYS: winsymlinks:nativestrict

Install Python dependencies
Requirement already satisfied: wheel in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (0.41.2)
Collecting humanize==3.14.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 1))
Using cached humanize-3.14.0-py3-none-any.whl (98 kB)
Collecting junitparser==3.1.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 2))
Using cached junitparser-3.1.0-py2.py3-none-any.whl (13 kB)
Requirement already satisfied: future==0.18.3 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 3)) (0.18.3)
Collecting lxml==4.9.1 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 4))
Using cached lxml-4.9.1-cp39-cp39-win_amd64.whl (3.6 MB)
Requirement already satisfied: psutil==5.9.5 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 5)) (5.9.5)
Collecting PyGithub==2.0.1rc0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 6))
Obtaining dependency information for PyGithub==2.0.1rc0 from https://files.pythonhosted.org/packages/14/a1/f2547e0233b08e4d03586eff0a1ac85d637900591e555a85bf3d69165026/PyGithub-2.0.1rc0-py3-none-any.whl.metadata
Using cached PyGithub-2.0.1rc0-py3-none-any.whl.metadata (2.1 kB)
Collecting Deprecated==1.2.14 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 7))
Obtaining dependency information for Deprecated==1.2.14 from https://files.pythonhosted.org/packages/20/8d/778b7d51b981a96554f29136cd59ca7880bf58094338085bcf2a979a0e6a/Deprecated-1.2.14-py2.py3-none-any.whl.metadata
Using cached Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB)
Collecting wrapt==1.15.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 8))
Using cached wrapt-1.15.0-cp39-cp39-win_amd64.whl (36 kB)
Collecting PyJWT==2.8.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 9))
Obtaining dependency information for PyJWT==2.8.0 from https://files.pythonhosted.org/packages/2b/4f/e04a8067c7c96c364cef7ef73906504e2f40d690811c021e1a1901473a19/PyJWT-2.8.0-py3-none-any.whl.metadata
Using cached PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting PyNaCl==1.5.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 10))
Using cached PyNaCl-1.5.0-cp36-abi3-win_amd64.whl (212 kB)
Collecting cffi==1.15.1 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 11))
Using cached cffi-1.15.1-cp39-cp39-win_amd64.whl (179 kB)
Requirement already satisfied: pycparser==2.21 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 12)) (2.21)
Requirement already satisfied: python-dateutil==2.8.2 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 13)) (2.8.2)
Requirement already satisfied: six==1.16.0 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 14)) (1.16.0)
Collecting requests==2.31.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 15))
Obtaining dependency information for requests==2.31.0 from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting certifi==2023.7.22 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 16))
Obtaining dependency information for certifi==2023.7.22 from https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl.metadata
Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting charset-normalizer==3.2.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 17))
Obtaining dependency information for charset-normalizer==3.2.0 from https://files.pythonhosted.org/packages/cb/dd/dce14328e6abe0f475e606131298b4c8f628abd62a4e6f27fdfa496b9efe/charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl.metadata
Using cached charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl.metadata (31 kB)
Requirement already satisfied: idna==3.4 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 18)) (3.4)
Collecting urllib3==1.26.16 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 19))
Obtaining dependency information for urllib3==1.26.16 from https://files.pythonhosted.org/packages/c5/05/c214b32d21c0b465506f95c4f28ccbcba15022e000b043b72b3df7728471/urllib3-1.26.16-py2.py3-none-any.whl.metadata
Using cached urllib3-1.26.16-py2.py3-none-any.whl.metadata (48 kB)
Requirement already satisfied: cryptography>=3.4.0 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from PyJWT==2.8.0->-r D:\a_actions\EnricoMi\publish-unit-test-result-action\v2.9.0\composite/../python/requirements.txt (line 9)) (40.0.1)
Using cached PyGithub-2.0.1rc0-py3-none-any.whl (346 kB)
Using cached Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB)
Using cached PyJWT-2.8.0-py3-none-any.whl (22 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Using cached charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl (96 kB)
Using cached urllib3-1.26.16-py2.py3-none-any.whl (143 kB)
Installing collected packages: wrapt, urllib3, PyJWT, lxml, junitparser, humanize, charset-normalizer, cffi, certifi, requests, PyNaCl, Deprecated, PyGithub
Attempting uninstall: urllib3
Found existing installation: urllib3 1.26.13
Uninstalling urllib3-1.26.13:
Successfully uninstalled urllib3-1.26.13
Attempting uninstall: charset-normalizer
Found existing installation: charset-normalizer 2.1.1
Uninstalling charset-normalizer-2.1.1:
Successfully uninstalled charset-normalizer-2.1.1
Attempting uninstall: cffi
Found existing installation: cffi 1.16.0
Uninstalling cffi-1.16.0:
Successfully uninstalled cffi-1.16.0
ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied: 'C:\Users\runneradmin\AppData\Local\Temp\pip-uninstall-x4zixpkk\_cffi_backend.cp39-win_amd64.pyd'
Consider using the --user option or check the permissions.

Error: Process completed with exit code 1.`

Does this issue persist? I presume this is happening in a private repo on public github.com, not an enterprise instance.
Can you try the following alternative?
uses: EnricoMi/publish-unit-test-result-action/composite@branch-composite-venv

I still got the same error
Run EnricoMi/publish-unit-test-result-action/composite@branch-composite-venv
with:
check_name: End to End Test Results
files: venture/report.xml
github_token: ***
github_token_actor: github-actions
github_retries: 10
comment_mode: always
fail_on: test failures
action_fail: false
action_fail_on_inconclusive: false
time_unit: seconds
report_suite_logs: none
ignore_runs: false
job_summary: true
compare_to_earlier_commit: true
pull_request_build: merge
check_run_annotations: all tests, skipped tests
seconds_between_github_reads: 0.[2](https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143/job/17379980002#step:27:2)5
seconds_between_github_writes: 2.0
json_thousands_separator:
json_suite_details: false
json_test_case_results: false
search_pull_requests: false

env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Run echo '##[group]Check for Python3'
echo '##[group]Check for Python3'
we check version here just to execute python3 with an argument
on Windows, there is a python3.exe that is a proxy to trigger installation from app store
command which python3 finds that, but python3 -V does not return the version on stdout
if ! which python3 || [[ $(python3 -V) != "python 3." && $(python3 -V) != "Python 3." ]]
then
if ! which python || [[ $(python -V) != "python 3." && $(python -V) != "Python 3." ]]
then
echo "::error::No python3 interpreter found. Please setup python before running this action. You could use https://github.com/actions/setup-python."
exit 1
fi
interpreter="$(which python)"
if [[ ! -e "${interpreter}3" ]]
then
  mkdir -p "$RUNNER_TEMP/bin/"
  ln -s "$interpreter" "$RUNNER_TEMP/bin/python3"
  echo "$RUNNER_TEMP/bin" >> $GITHUB_PATH
fi

fi
echo "version=$(python3 -V)" >> $GITHUB_OUTPUT
echo '##[endgroup]'
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Check for Python3
/c/hostedtoolcache/windows/Python/3.9.13/x64/python3
Run case "$RUNNER_OS" in
case "$RUNNER_OS" in
Linux*)
echo "pip-cache=~/.cache/pip" >> $GITHUB_OUTPUT
;;
macOS*)
echo "pip-cache=~/Library/Caches/pip" >> $GITHUB_OUTPUT
;;
Windows*)
echo "pip-cache=~\AppData\Local\pip\Cache" >> $GITHUB_OUTPUT
;;
esac
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Run actions/cache/restore@v3
with:
path: ~\AppData\Local\pip\Cache
key: enricomi-publish-action-Windows-X64-pip-Python 3.9.13-6ca4d32816ff499719c9ab474caf6c68
enableCrossOsArchive: false
fail-on-cache-miss: false
lookup-only: false
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Cache not found for input keys: enricomi-publish-action-Windows-X64-pip-Python 3.9.13-6ca4d32816ff499719c9ab474caf6c68
Run echo '##[group]Create virtualenv'
echo '##[group]Create virtualenv'
install virtualenv, if it is not yet installed
python3 -m pip install virtualenv
python3 -m virtualenv venv
test activating virtualenv
case "$RUNNER_OS" in
Linux*|macOS*)
source venv/bin/activate;;
Windows*)
source venv\Scripts\activate;;
esac
echo '##[endgroup]'
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Create virtualenv
Requirement already satisfied: virtualenv in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (20.21.1)
Requirement already satisfied: distlib<1,>=0.3.6 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from virtualenv) (0.3.7)
Requirement already satisfied: filelock<4,>=3.4.1 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from virtualenv) (3.12.4)
Requirement already satisfied: platformdirs<4,>=2.4 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from virtualenv) (2.6.0)
created virtual environment CPython3.9.13.final.0-64 in 2430ms
creator CPython3Windows(dest=D:\a\microscope-automation-gui\microscope-automation-gui\venv, clear=False, no_vcs_ignore=False, global=False)
seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\runneradmin\AppData\Local\pypa\virtualenv)
added seed packages: pip==23.1, setuptools==67.6.1, wheel==0.40.0
activators BashActivator,BatchActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator
Run echo '##[group]Install Python dependencies'
echo '##[group]Install Python dependencies'
if [ "success" == "success" ]
then
# activate virtualenv
case "$RUNNER_OS" in
Linux*|macOS*)
source venv/bin/activate;;
Windows*)
source venv\Scripts\activate;;
esac
fi
make sure wheel is installed, which improves installing our dependencies
python3 -m pip install wheel
python3 -m pip install -r $GITHUB_ACTION_PATH/../python/requirements.txt
echo '##[endgroup]'
shell: C:\Program Files\Git\bin\bash.EXE --noprofile --norc -e -o pipefail {0}
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
Install Python dependencies
Requirement already satisfied: wheel in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (0.41.2)
Collecting humanize==3.14.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 1))
Downloading humanize-3.14.0-py3-none-any.whl (98 kB)
---------------------------------------- 98.4/98.4 kB 1.9 MB/s eta 0:00:00
Collecting junitparser==3.1.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 2))
Downloading junitparser-3.1.0-py2.py3-none-any.whl (13 kB)
Requirement already satisfied: future==0.18.3 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 3)) (0.18.3)
Collecting lxml==4.9.3 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 4))
Obtaining dependency information for lxml==4.9.3 from https://files.pythonhosted.org/packages/80/2e/49751104148b03ad880aaf381cc24d67b7d8f401f7d074ad7db4f6d95597/lxml-4.9.3-cp39-cp39-win_amd64.whl.metadata
Downloading lxml-4.9.3-cp39-cp39-win_amd64.whl.metadata (3.9 kB)
Requirement already satisfied: psutil==5.9.5 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 5)) (5.9.5)
Collecting PyGithub==2.0.1rc0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 6))
Obtaining dependency information for PyGithub==2.0.1rc0 from https://files.pythonhosted.org/packages/14/a1/f2547e0233b08e4d03586eff0a1ac85d637900591e555a85bf3d69165026/PyGithub-2.0.1rc0-py3-none-any.whl.metadata
Downloading PyGithub-2.0.1rc0-py3-none-any.whl.metadata (2.1 kB)
Collecting Deprecated==1.2.14 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 7))
Obtaining dependency information for Deprecated==1.2.14 from https://files.pythonhosted.org/packages/20/8d/778b7d51b981a96554f29136cd59ca7880bf58094338085bcf2a979a0e6a/Deprecated-1.2.14-py2.py3-none-any.whl.metadata
Downloading Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB)
Collecting wrapt==1.15.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 8))
Downloading wrapt-1.15.0-cp39-cp39-win_amd64.whl (36 kB)
Collecting PyJWT==2.8.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 9))
Obtaining dependency information for PyJWT==2.8.0 from https://files.pythonhosted.org/packages/2b/4f/e04a8067c7c96c364cef7ef73906504e2f40d690811c021e1a1901473a19/PyJWT-2.8.0-py3-none-any.whl.metadata
Downloading PyJWT-2.8.0-py3-none-any.whl.metadata (4.2 kB)
Collecting PyNaCl==1.5.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 10))
Downloading PyNaCl-1.5.0-cp36-abi3-win_amd64.whl (212 kB)
-------------------------------------- 212.1/212.1 kB 4.3 MB/s eta 0:00:00
Collecting cffi==1.15.1 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 11))
Downloading cffi-1.15.1-cp39-cp39-win_amd64.whl (179 kB)
-------------------------------------- 179.1/179.1 kB 5.3 MB/s eta 0:00:00
Requirement already satisfied: pycparser==2.21 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 12)) (2.21)
Requirement already satisfied: python-dateutil==2.8.2 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 13)) (2.8.2)
Requirement already satisfied: six==1.16.0 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 14)) (1.16.0)
Collecting requests==2.31.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 15))
Obtaining dependency information for requests==2.31.0 from https://files.pythonhosted.org/packages/70/8e/0e2d847013cb52cd35b38c009bb167a1a26b2ce6cd6965bf26b47bc0bf44/requests-2.31.0-py3-none-any.whl.metadata
Downloading requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting certifi==2023.7.22 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 16))
Obtaining dependency information for certifi==2023.7.22 from https://files.pythonhosted.org/packages/4c/dd/2234eab22353ffc7d94e8d13177aaa050113286e93e7b40eae01fbf7c3d9/certifi-2023.7.22-py3-none-any.whl.metadata
Downloading certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting charset-normalizer==3.2.0 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 17))
Obtaining dependency information for charset-normalizer==3.2.0 from https://files.pythonhosted.org/packages/cb/dd/dce14328e6abe0f475e606131298b4c8f628abd62a4e6f27fdfa496b9efe/charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl.metadata
Downloading charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl.metadata (31 kB)
Requirement already satisfied: idna==3.4 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 18)) (3.4)
Collecting urllib3==1.26.16 (from -r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 19))
Obtaining dependency information for urllib3==1.26.16 from https://files.pythonhosted.org/packages/c5/05/c214b32d21c0b465506f95c4f28ccbcba15022e000b043b72b3df7728471/urllib3-1.26.16-py2.py3-none-any.whl.metadata
Downloading urllib3-1.26.16-py2.py3-none-any.whl.metadata (48 kB)
---------------------------------------- 48.4/48.4 kB 2.5 MB/s eta 0:00:00
Requirement already satisfied: cryptography>=3.4.0 in c:\hostedtoolcache\windows\python\3.9.13\x64\lib\site-packages (from PyJWT==2.8.0->-r D:\a_actions\EnricoMi\publish-unit-test-result-action\branch-composite-venv\composite/../python/requirements.txt (line 9)) (40.0.1)
Downloading lxml-4.9.3-cp39-cp39-win_amd64.whl (3.9 MB)
---------------------------------------- 3.9/3.9 MB 19.2 MB/s eta 0:00:00
Downloading PyGithub-2.0.1rc0-py3-none-any.whl (346 kB)
--------------------------------------- 346.1/346.1 kB 21.0 MB/s eta 0:00:00
Downloading Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB)
Downloading PyJWT-2.8.0-py3-none-any.whl (22 kB)
Downloading requests-2.31.0-py3-none-any.whl (62 kB)
---------------------------------------- 62.6/62.6 kB 1.7 MB/s eta 0:00:00
Downloading certifi-2023.7.22-py3-none-any.whl (158 kB)
---------------------------------------- 158.3/158.3 kB 9.3 MB/s eta 0:00:00
Downloading charset_normalizer-3.2.0-cp39-cp39-win_amd64.whl (96 kB)
---------------------------------------- 96.9/96.9 kB 5.4 MB/s eta 0:00:00
Downloading urllib3-1.26.16-py2.py3-none-any.whl (143 kB)
---------------------------------------- 143.1/143.1 kB 8.3 MB/s eta 0:00:00
Installing collected packages: wrapt, urllib3, PyJWT, lxml, junitparser, humanize, charset-normalizer, cffi, certifi, requests, PyNaCl, Deprecated, PyGithub
Attempting uninstall: urllib3
Found existing installation: urllib3 1.26.13
Uninstalling urllib3-1.26.13:
Successfully uninstalled urllib3-1.26.13
Attempting uninstall: charset-normalizer
Found existing installation: charset-normalizer 2.1.1
Uninstalling charset-normalizer-2.1.1:
Successfully uninstalled charset-normalizer-2.1.1
Attempting uninstall: cffi
Found existing installation: cffi 1.16.0
Uninstalling cffi-1.16.0:
Successfully uninstalled cffi-1.16.0
ERROR: Could not install packages due to an OSError: [WinError 5] Access is denied: 'C:\Users\runneradmin\AppData\Local\Temp\pip-uninstall-1mijh0l3\_cffi_backend.cp39-win_amd64.pyd'
Consider using the --user option or check the permissions.
Error: Process completed with exit code 1.
Run actions/cache/save@v3
with:
path: ~\AppData\Local\pip\Cache
key: enricomi-publish-action-Windows-X64-pip-Python 3.9.13-6ca4d32816ff499719c9ab474caf6c68
enableCrossOsArchive: false
env:
REACT_APP_API_ENDPOINT: localhost:8000
REACT_USE_MEMORY_MAPPED_FILES: 1
ENABLE_TEST_AUTOMATION_ENDPOINT: 1
IMAGE_DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data/NK
DATA_DIRECTORY: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
ALLOWED_ORIGINS: http://localhost:3000,http://localhost:8000
NEXTFLOW_IMAGING_PIPELINE_REVISION: 0.1.5
MASKRCNN_MODEL_WEIGHTS: D:\a\microscope-automation-gui\microscope-automation-gui/live-navigator/tests/test_data
JFROG_CLI_ENV_EXCLUDE: password;secret;key;token;auth;JF_ARTIFACTORY_;JF_ENV_;JF_URL;JF_USER;JF_PASSWORD;JF_ACCESS_TOKEN
JFROG_CLI_OFFER_CONFIG: false
JFROG_CLI_BUILD_NAME: End to End Tests
JFROG_CLI_BUILD_NUMBER: 225
JFROG_CLI_BUILD_URL: https://github.com/cellanome/microscope-automation-gui/actions/runs/6402766143
JFROG_CLI_USER_AGENT: setup-jfrog-cli-github-action/3.3.0
LANEBRAIN_VERSION:  "0.6.4"
FLOWCELL_SERVER_VERSION:  "0.1.11"
pythonLocation: C:\hostedtoolcache\windows\Python\3.9.13\x64
PKG_CONFIG_PATH: C:\hostedtoolcache\windows\Python\3.9.13\x64/lib/pkgconfig
Python_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python2_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
Python3_ROOT_DIR: C:\hostedtoolcache\windows\Python\3.9.13\x64
MSYS: winsymlinks:nativestrict
"C:\Program Files\Git\usr\bin\tar.exe" --posix -cf cache.tzst --exclude cache.tzst -P -C D:/a/microscope-automation-gui/microscope-automation-gui --files-from manifest.txt --force-local --use-compress-program "zstd -T0"
Cache Size: ~10 MB (10013726 B)
Cache saved successfully
Cache saved with key: enricomi-publish-action-Windows-X64-pip-Python 3.9.13-6ca4d3[28

Please try again.

It is working now using "uses: EnricoMi/publish-unit-test-result-action/composite@branch-composite-venv".
Thank you @EnricoMi 😊

Alright, I'll release that fix soon.
Please don't use @branch-composite-venv, as this will disappear once I merge that fix into master.

This has been released.

I see, what should I use though? is it EnricoMi/publish-unit-test-result-action/composite@v2 or EnricoMi/publish-unit-test-result-action@v2.11.0? my apologies as I'm not sure since I'm using windows

source: gharchive/issue

authors: EnricoMi sayurionishi

license_type: permissive

license_source: github-api


text:
Is there any possibility of displaying all the test cases with names in Github actions summary

Hi
Hope all is well. Is there any possibility that we can see the test results in a github actions summary like below example.

Thank you !!

That should be doable, but this feature would have to be disabled by default as this can grow very large for many users.
Contribution welcome, should be straight forward to add.

authors: EnricoMi yalamarthisr


text:
Add respective plugin to its section

Transcript annotation plugin was not getting attached to it respective section. That is why NMD is not appearing in input form.

Hi @nakib103 ,
Is there a sandbox and Jira to test this update?

Hi @nakib103 , Is there a sandbox and Jira to test this update?

Hi @Mehrnaz-Charkhchi , It is basically changing the input form. You can see the updated input form in my sandbox - http://wp-np2-11.ebi.ac.uk:7070/Multi/Tools/VEP. But unfortunately the jobs are gonna get failed because my sandbox is setup for e108 now as test is ongoing for e108 public docs - https://github.com/Ensembl/public-plugins/pull/601 .
Respective JIRA card- https://www.ebi.ac.uk/panda/jira/browse/ENSVAR-4920 (NMD was released in e107 but unfortunately I missed this code logic and it is not available in the site currently)

source: gharchive/pull-request

repo: Ensembl/public-plugins

license_source: bigquery


text:
Firestore API does not work when passing input to the where clause

Test screen:
https://studio.ensembleui.com/app/Qq0BF6CHFWUobsQoZ9Ns/screen/L6fInEWIzTJuXqoGiKIO

Run as is and check the console. getStageMatches return an empty array
Uncomment line 74, which is the stageId for semi finals
Now you see two matches returned

@amin-nas stageId is not being passed as input to the widget and thus not being passed to the invokeAPI call. See the console.log I added to the screen

repo: EnsembleUI/ensemble


text:
Sync preview to current cursor doesn't work for included files

Describe the bug
In a included typ file, the sync preview with current cursor command is not working
To Reproduce
main.typ file:
main file content

#include "other.typ"

other.typ file:
other content

Start the preview from main.typ file.
Open other.type, make sure it's the actived editor.
Run "Sync preview with current cursor" command, nothing happened.

Expected behavior
Preview scroll to cursor pos of other.typ file.
Package/Software version:
VSCode version(Help -> About):
Version: 1.83.1 (user setup)
Commit: f1b07bd25dfad64b0167beb15359ae573aecd2cc
Date: 2023-10-10T23:48:05.904Z
Electron: 25.8.4
ElectronBuildId: 24154031
Chromium: 114.0.5735.289
Node.js: 18.15.0
V8: 11.4.183.29-electron.0
OS: Windows_NT x64 10.0.25982

Additional context
I briefly studied the current implementation code and found that the reason is that the VSCode extension code maintains an “activeTask”, which is a “doc --> server” mapping. When executing the preview sync command, it checks whether the current document is in this mapping. If it is not, do nothing.
As a temporary solution for personal use, I tried a small modification: When there is only one item in activeTask, the preview sync event in any file will be sent to the one unique preview server. This works fine for me and fully meets my needs, I usually only open one preview server.
If we need support multiple preview instances and achieve it theoretically correct(considering troublesome situations such as multiple preview instances depending on the same file), the extension code needs dependency information from compiler. The implementation may require modifications to the upstream projects, like typst.ts, etc. So I just opened this Issue for discussion instead of write a PR.

For quick solution, we can simply broadcast request to all preview server. This could introduce false positive (FP), that some other preview panels accidentally scroll to position. But it will exactly work on most scenario that:

there is only single preview panel, hence no FP.
the request is on a content file only owned by the some preview panel, hence no FP.

The false positive is indeed introduced when we make request on a template or package file shared by multiple preview panels, which are less likely to happen. We can wait for users that need this further improvement. @Enter-tainer

Both the broadcast and https://github.com/Enter-tainer/typst-preview/compare/v0.8.3...7sDream:typst-preview:patch/include-file-sync-cursor looks good to me.
To fully address this issue, the vscode extension code should be aware of the files used by typst-preview server, which is not easy.

Okay, I'll happy to send a PR of my changes first so that I can use official release instead of my fork.
For the final solution, we can keep this Issue open and discuss it in the long term.

closed as #166 merged

authors: 7sDream Enter-tainer Myriad-Dreamin

repo: Enter-tainer/typst-preview

license: MIT


text:
convert comments into blocks

line comments are esay, block comments have to be split into lines.
Sounds like fun ...

slightly ugly case with comments WITHIN constrolstructures

easierst fix: just ignore them??

yeah, just ignore this

reopen if weird comments becoming an issue

repo: Entkenntnis/robot-karol-web


text:
🔀 :: (ENTRY-25) User Change Password API 개발

close #ENTRY-25

takeIf라는 메소드가 있었네요~ 덕분에 저도 배워갑니다👏

repo: EntryDSM/Equus-User


text:
Installation hint: could not bulid wheels for gmsh-sdk, matplotlib

When I install the software on anaconda with the command: pip install pyleecan[full], it says that the libraries gmsh-sdk and matplotlib cannot be installed correctly, but in fact, I already have gmesh 4.11.1 and matplotlib 3.7.2 installed on my anaconda.

Hello,
Thank you for your interest in pyleecan. In fact pyleecan requires a version of matplotlib>=3.3.2 and <=3.3.4 which conflict with your current Anaconda version. You can find all the requirements and the corresponding versions here: https://github.com/Eomys/pyleecan/blob/master/requirements-full.txt
To go forward, you can either try a more recent version of matplotlib but we can't say how stable it will be or you can install a new python outside of Anaconda using: https://pyleecan.org/get.pyleecan.html (we used to recommend to use anaconda but we no longer for more requirements flexibility). The GUI installer can also be an option depending on what you are looking for.
We plan to investigate moving Pyleecan to Python 3.11 (today we recommend 3.8), that should remove lot of version requirements. I don't know when we will have time for that.
Best regards,
Pierre

Thank you very much for your reply, I think the pyleecan platform is very helpful for the in-depth study of motors, and I look forward to the next version will be able to increase the version of python to the latest version, to eliminate the compatibility of some libraries during the installation of the software, thank you!

authors: BonneelP YongYahn

repo: Eomys/pyleecan


text:
Side By Side

Hi all,
I know there is an option to display the time on the side of the calendar, but people here wants to display it one on top of the other, is that even possible?
Have the calendar on top and the time component underneath it?

Hi, you can do it but this depends a lot of the Bootstrap grid system, so... you can do it but it's not gonna be pretty...
What you want is this:

That style up there is definied by 2 two divs:

 and

As you can see they are with the BS Grid system so if your width is > 992px they will take the media rules, what you could try to do is change that to a col-lg-6 or something like that and will end like this:

Is pretty? For me, yeah sure, I actually don't care and my clients neither...
Now where can I change that?! Well the fast forward option is using Jquery something like when the widget show:
$("#myDatepicker").on('dp.show', function(e) {
  $("div.datepicker.col-md-6").removeClass('col-md-6').addClass('col-lg-6');
  $("div.timepicker.col-md-6").removeClass('col-md-6').addClass('col-lg-6');
});

Is this a dirty trick, yeap pretty much. It does work? Yes, so just ignore it :) (That's what you're gonna tell to your fellow developers...)
The other one is looking into the code and change it for yourself, but not sure where those lines are... so.... Good luck :D
Hope it works for you!

Hi William,
Thank you for your reply, I was reading a bit further the documentation and apparently there in a function that does that, I havent tried because people here gave up on the idea but the specs says
collapse(collapse)
Takes a boolean. If set to false the picker will display similar to sideBySide except vertical.

Hey I didn't remember that one! thanks.

repo: Eonasdan/bootstrap-datetimepicker

license: mit


text:
How to free memory usage

Describe the bug
Running the Phi-3.5 Vision Task multiple times with the following code increases the memory usage from 2G to 20GB.
tokio::spawn(async move {
    let image_processor = ImageProcessor::init().await;
    loop {
            let image_path = ...;
            if let Ok(desc) = image_processor.describe_image(image_path).await {
                println!("image_processor:{}", desc);
            }

           sleep(Duration::from_secs(60)).await;
    }
});

use anyhow::Ok;
use mistralrs::Model;
use mistralrs::{TextMessageRole, VisionLoaderType, VisionMessages, VisionModelBuilder};

pub struct ImageProcessor {
    model: Model,
}

const MODEL_ID: &str = "~/Downloads/Phi-3.5-vision-instruct-UQFF/";

impl ImageProcessor {

    pub async fn init() -> Self {
        let model = VisionModelBuilder::new(MODEL_ID, VisionLoaderType::Phi3V)
            .from_uqff("phi3.5-vision-instruct-q4k.uqff".into())
            .build()
            .await
            .unwrap();
        Self { model }
    }

    pub async fn describe_image(&self, image_url: &str) -> Result<String, anyhow::Error> {
        let bytes = std::fs::read(image_url)?;

        let image = image::load_from_memory(&bytes)?;

        let messages = VisionMessages::new().add_phiv_image_message(
            TextMessageRole::User,
            "What is depicted here? Please describe the scene in detail.",
            image,
        );

        let response = self.model.send_chat_request(messages).await?;

        let desc = response.choices[0].message.content.as_ref().unwrap();
        dbg!(
            response.usage.avg_prompt_tok_per_sec,
            response.usage.avg_compl_tok_per_sec
        );
        Ok(desc.to_string())
    }
}

Latest commit or version
mistralrs = { git = "https://github.com/EricLBuehler/mistral.rs.git", rev = "32e894510696e9aa3c11db79268ee031a3ecefa6", features = ["metal"]}

When I try to initialize the model within each loop iteration, the following log appears, but it fails to output a response.
[2024-10-26][10:54:42][mistralrs_core][WARN] Engine is dead, rebooting
[2024-10-26][10:54:42][mistralrs_core][INFO] Successfully rebooted engine and updated sender + engine handler

@jiabochao
Did you find a solution to this issue?
I'm facing the same problem (reference: #865)

@jiabochao
Thanks for your response. So you're saying the memory issues can be avoided by separating it into a web server implementation? While using a web server or child processes could work, I think we'd prefer to manage the memory directly in Rust, wouldn't we?

authors: jiabochao solaoi


text:
[1.10.2] Pay Command - Error

Running TotalEconomy-1.5.1.jar and spongeforge-1.10.2-2073-5.0.0-BETA-1683.jar  with Forge 2073, and I have an error message every time that someone does the /pay command.
https://gyazo.com/c67b14d53eee180e8d102989c3405902

uhm, you know that (according to gh releases) the lastest pre-release is just 1.5.0 ? ._.

@Rasgnarok Did you just rename the file or is it a typo?

Aha, typo yep. thanks for catching that <<

Let me test this on my end and I will get back to you. Thanks.

I was not able to recreate the issue. Try again on the latest version of forge and sponge. If it still happens then wait till the full release of 1.5.0 as it could just be an issue with the DEV version.

@Rasgnarok Are you still having this issue on the latest version of Total Economy?

authors: Erigitic MarkL4YG Rasgnarok

repo: Erigitic/TotalEconomy


text:
Performance issues in /utils (by P3)

Hello! I've found a performance issue in /utils: batch() should be called before map(), which could make your program more efficient. Here is the tensorflow document to support it.
Detailed description is listed below:

/pre_process_mnist.py: dataset_train.batch(batch_size)(here) should be called before dataset_train.map(image_rotate_random,num_parallel_calls=PARALLEL_INPUT_CALLS)(here), dataset_train.map(image_shift_rand,num_parallel_calls=PARALLEL_INPUT_CALLS)(here), dataset_train.map(image_squish_random,num_parallel_calls=PARALLEL_INPUT_CALLS)(here), dataset_train.map(image_erase_random,num_parallel_calls=PARALLEL_INPUT_CALLS)(here) and dataset_train.map(generator,num_parallel_calls=PARALLEL_INPUT_CALLS)(here).
/pre_process_mnist.py: dataset_test.batch(batch_size)(here) should be called before dataset_test.map(generator,num_parallel_calls=PARALLEL_INPUT_CALLS)(here).
/pre_process_smallnorb.py: dataset_train.batch(batch_size)(here) should be called before dataset_train.map(random_patches,num_parallel_calls=PARALLEL_INPUT_CALLS)(here), dataset_train.map(random_brightness,num_parallel_calls=PARALLEL_INPUT_CALLS)(here), dataset_train.map(random_contrast,num_parallel_calls=PARALLEL_INPUT_CALLS)(here) and dataset_train.map(generator,num_parallel_calls=PARALLEL_INPUT_CALLS)(here).
/pre_process_smallnorb.py: dataset_test.batch(1)(here) should be called before dataset_test.map(generator,num_parallel_calls=PARALLEL_INPUT_CALLS)(here).

Besides, you need to check the function called in map()(e.g., generator called in dataset_test.map(generator,num_parallel_calls=PARALLEL_INPUT_CALLS)) whether to be affected or not to make the changed code work properly. For example, if generator needs data with shape (x, y, z) as its input before fix, it would require data with shape (batch_size, x, y, z).
Looking forward to your reply. Btw, I am very glad to create a PR to fix it if you are too busy.

Hi @DLPerf!
Thank you for your tip. However, I have a doubt: does inserting batch before all transformation functions reduce the variance of the dataset? I mean, doing as you're saying, all images of a batch go through the same transformation. On the other hand, keeping batch at the end ensures a different random transformation for each image.

authors: DLPerf EscVM

repo: EscVM/Efficient-CapsNet


text:
Investigate deduplication of txes for non-DA nodes

Currently, nodes that are not in the DA will gossip about transactions that the DA has already seen. This ticket is to propose a solution where transactions already submitted to the DA will not be gossiped about.

Closing as #1801 solved this. Transactions only get sent to the committee, so we no longer get a ballooning # of transactions

repo: EspressoSystems/HotShot


text:
fix: Typo Correction aws_ecs_benchmarks_cdn_gpu.sh

This pull request fixes a typo in the aws_ecs_benchmarks_cdn_gpu.sh script. Specifically:

Corrected registerred to registered.

Changes

File Modified: scripts/benchmark_scripts/aws_ecs_benchmarks_cdn_gpu.sh
Lines Changed:

Line 106: Fixed spelling mistake in the comment

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

authors: CLAassistant dramarereg


text:
Update arkworks dependencies

Description
Pay special attention to:

the few TODOs I left
usage of Projective/Affine representation
(de)serialization: compressed/uncompressed (flags are sometimes ignored) & checked/unchecked
creation of cosets for (i)FFTs

closes: https://github.com/EspressoSystems/jellyfish/issues/45

Before we can merge this PR, please make sure that all the following items have been
checked off. If any of the checklist items are not applicable, please leave them but
write a little note why.

[x] Targeted PR against correct branch (main)
[x] Linked to GitHub issue with discussion and accepted design OR have an explanation in the PR that describes this work.
[ ] Wrote unit tests
[ ] Updated relevant documentation in the code
[ ] Added a relevant changelog entry to the Pending section in CHANGELOG.md
[ ] Re-reviewed Files changed in the GitHub PR explorer

I'm glad to see this merged! Just saw that since https://github.com/EspressoSystems/tagged-base64/pull/47 hasn't been merged and tagged yet, the master here now depends on a branch of tagged-base64, which probably isn't ideal for long term, sth to keep in mind :)

repo: EspressoSystems/jellyfish


text:
Auto-refresh popup view for dynamic entities

Auto-refresh popup view for dynamic entities.
This is hard to test because the SDK doesn't allow you to create popups for dynamic entities because of 2 issues. I added a workaround in the SDK and I can provide that to the reviewers of this PR.
Toolkit example code for this is in ryan/dynamicEntityPopup branch if you want to try test it out.

@mhdostal how hard would it be to preserve the expanded/collapsed state when the dynamic entity changes? Notice in the video below, when the entity changes, the collapsed section expands:

@mhdostal how hard would it be to preserve the expanded/collapsed state when the dynamic entity changes? Notice in the video below, when the entity changes, the collapsed section expands:

It seems the entire list of popup elements are being redrawn, as the PopupElementList() is in a block dictated by the @State private var evaluation: Evaluation? var. The default value for the DisclosureGroup.isExpanded is true, which is why it's expanding when redrawn.
A solution would be to have a model object for each popup element which contained an isExpanded property. That would prevent the default state from being reset each redraw.  We've considered this for the FormView, as we're trying to set the initial state of a Group Element. I haven't tried this as we'd need to refactor some stuff in the FormView, but might this work?

Interesting. I'm not sure if that would work, I'd have to think through it. Either way, it can happen outside this PR.

Either way, it can happen outside this PR.

We need to incorporate something like that into the FeatureForm work, so we'll take a look at porting our solution to the popup.

This is pretty cool.
You could build a lightweight dashboard just based on this

authors: dg0yal mhdostal rolson

repo: Esri/arcgis-maps-sdk-swift-toolkit


text:
fix package.json license string

just a small change to avoid an npm install nag.
@dmfenton, should we bump to 1.0.1 (for @substack's contribution)?

@jgravois yep, let's bump it. Do you have the permissions?

okay, i just tagged both 1.0.0 and 1.0.1 github releases.
@chelm can you add the npm account esri_dev as a collaborator here so that i can push 1.0.1 when you have a second please?

badge here isn't freshy yet, but 1.0.1 is now on npm.  thanks @chelm!

authors: dmfenton jgravois

repo: Esri/esri-proj-codes


text:
Use of NAVTEQ Traffic Patterns data - 60-minute granular

Hello,
Thank you very much for your very useful tool.
With NAVTEQ Traffic Patterns data, the tool only makes use of the 15-minute granular Speed Patterns Dictionary (SPD) .csv file in KPH.
Do you expect to produce soon a code for 60-minute granular ? It will be very useful too.
Thank you very much for your response.
Kind regards,
Matteu

There are no plans to use the 60-minute granular SPD, since the 15-minute granular SPD is able to provide greater detail.  If using the 60-minute granular SPD is desired, the tool's source code is public, so you can modify the source code to be able to consume the 60-minute granular SPD.

repo: Esri/street-data-processing-tools


text:
ENH-000084221  Enhance 'Leak Survey Compliance Dashboard' to display additional useful leak information.

Salesforce ID: ENH-000084221
Salesforce Submitter: Thomas Noble
Salesforce Submit Date: 12/23/2014 12:37 PM
Salesforce Bug Type: Product
Salesforce Severity: Medium
Repro Data: (n/a)
Work Around: User does not think the out-of-box widgets are sufficient for complete monitoring of their pipe network.
Product: ArcGIS for Utilities and Telecom
Functional Category: ArcGIS for Utilities and Telecom
Client Platform: (n/a)
Version Found: 10.2
Planned Version Fixed: (n/a)
Comment: Enhancement logged

closing, logged in wrong repo

TRIAGED

authors: LindsayThomas MikeMillerGIS

repo: Esri/water-utility-mobile-map


text:
Added support for standardised import resolution

Resolver-Engine project is an Ethereum Foundation grantee, with a goal to create tooling for standardised Solidity import resolution.
Currently each and every framework has a different way of resolving imports, causing great anguish for the end-developers. With the Resolver-Engine, all projects that use it have a common set of supported functionality, sane defaults and maintenance of a dedicated team meaning that in the future Waffle will be able to support more imports just by upgrading the dependency.
Basic usage:
import { ImportFsEngine } from "@resolver-engine/import-fs";

ImportFsEngine()
  .require("github:OpenZeppelin/openzeppelin-solidity/contracts/ownership/Ownable.sol#v2.1.2")
  .then(file => console.log(`Loaded url ${file.url} with source: ${file.source}`);

Existing functionality that instantly gets added to this project:

[x] Filesystem, relative and absolute imports
[x] NPM and node_modules with support for monorepo pattern
[x] URI and URL support
[x] Github and branch support
[x] IPFS through a gateway
[x] Swarm through a gateway
[x] Initial Truffle-like support for Ethpm packages

Additionally, backwards compatibility was added to support Waffle's original resolution methods
We've noticed a refactor in the past days, thus we mark this PR as a Work-In-Progress, so that we can work with you, gather feedback and together create a Cooperative community around the tooling and standards.
In the upcoming days similiar PRs will be posted to

Remix-IDE
0xProject sol-compiler

Hi @ritave,
I did re-review and found potentially breaking change -> linking now requires a full path of a file, which is impossible to use in practice (as people use different computers, with different file systems).
That might be a symptom of a deeper problem, that Resolver-Engine is using file paths instead of fully qualified names.

Ping @ritave, any news? :D

Hi,
Thanks for your feedback. We've managed to address all your remarks and maintain compatibility with previous feature set - linking now works the same way as before.

Looks good, nice refactoring! Merging. Will release a new version soon.

authors: marekkirejczyk ritave squadack

repo: EthWorks/Waffle


text:
Mapping of .map data to journal entries is incorrect

I've noticed that the data within the .map file isn't accurately mapping to journal data correctly, As per the below image, the burg Bellstar lists its province as Flarereva however it is in the Province of Bellstar County.

I've looked through the .map file and the Bellstar burg index is in the list of province indices for Bellstar County and not in Flarereva's list.
Unofficial Azgaar's Fantasy Map Generator Import version: 0.2.8
FMG version: 1.8 (current stable version used here)
Foundry Version: 9.269

Can you link the map file you are using?

Sure thing.
Here you go.

Mine does the same

authors: DeimosJ Ethck SirNiloc

repo: Ethck/azgaar-foundry


text:
🛑 Lisandro Bril is down

In c98b629, Lisandro Bril (https://www.lisandrobril.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Lisandro Bril is back up in 11847bc.

repo: Etixen/upptime


text:
Crashes on Launch

When I open up the installer it just crashes without no window quickly flashing up,
I am running Windows 8.1 Build 9600

here is the problem details
Problem signature:
  Problem Event Name:	APPCRASH
  Application Name:	terminus-1.0.92-setup.exe
  Application Version:	1.0.92.0
  Application Timestamp:	5a6fed7c
  Fault Module Name:	System.dll
  Fault Module Version:	0.0.0.0
  Fault Module Timestamp:	5a6fed15
  Exception Code:	c0000005
  Exception Offset:	00001581
  OS Version:	6.3.9600.2.0.0.256.48
  Locale ID:	1033
  Additional Information 1:	5861
  Additional Information 2:	5861822e1919d7c014bbb064c64908b2
  Additional Information 3:	dba6
  Additional Information 4:	dba6f3f51243e7af8337f6bced10f1a2

Is your OS 32 or 64 bit?

authors: Eugeny jylescoad-ward

repo: Eugeny/terminus


text:
Better schedule css

Still not happy with it but it is a bit better now.

Thanks, this is much better now :-)

repo: EuroPython/epcon


text:
What does the argument for Diminuendo/Crescendo represents?

Is it the final note velocity?
Also, would it be possible to create a more expressive alias, a la Dur?
Thanks!

The argument is a percentage increase/decrease governed by the length of the entire value, not the final velocity. Here you can see the effect with Diminuendo (I've formatted the ghci output a bit to make it more readable). Notice what happens to the volumes at the MEvent level, which is what a Music value is processed into just before heading to MIDI output.
Prelude Euterpea> m = line [c 4 qn :+: e 4 qn :+: g 4 qn :+: c 4 qn]
Prelude Euterpea> mp = phrase [Dyn (Diminuendo 0.5)] m
Prelude Euterpea> perform mp
[
MEvent {eTime = 0 % 1, eInst = AcousticGrandPiano, ePitch = 60, eDur = 1 % 2, eVol = 127, ...},
MEvent {eTime = 1 % 2, eInst = AcousticGrandPiano, ePitch = 64, eDur = 1 % 2, eVol = 111, ...},
MEvent {eTime = 1 % 1, eInst = AcousticGrandPiano, ePitch = 67, eDur = 1 % 2, eVol = 95, ...},
MEvent {eTime = 3 % 2, eInst = AcousticGrandPiano, ePitch = 60, eDur = 1 % 2, eVol = 79, ...}]
The volumes decrease to 79 rather than 64 because it does a simple linear interpolation over the entire duration of the value. So, if you used the argument 0.0 then the last note would still have a velocity >0 even if not by a lot.
When using Crescendo, it is important to first use addVolume to set the volume in some way so it is lower, as the default is 127. So, when working with dynamics, I recommend working with the types Music (Pitch,Volume) or Music (AbsPitch,Volume), as Crescendo, Accent, etc are not detectable from a default volume of 127.
Phrase modifiers are one of the lesser used parts of Euterpea, so they were not given other aliases to avoid namespace pollution. However, it would be easy to make your own functions to wrap them for a particular application. For example, you could redo the above example using such a function:
dim amt = phrase [Dyn (Diminuendo amt)]
mp = dim 0.5 m
While on the subject of creating custom things, I should note that it's also possible to define your own interpretations of these phrase modifiers. The HSoM library provides an easy way to do this via Players. In plain vanilla Euterpea you can also create your own algorithm for converting to MEvents, which can be supplied to the playC function (which takes a PlayParams value that has a bunch of things you can customize).

Forgot to thank you :). It worked just as you described.
Nice library, by the way.

authors: AgustinCB donya

license: Zlib


text:
Doesnt seem to work

When I try to implement this in my react native code, the orbit controls dont respond to touch

Fixed in v2

authors: EvanBacon banjianpan

repo: EvanBacon/expo-three-orbit-controls


text:
Swordfish reads the whole row group instead of streaming chunks?

Describe the bug
Reading a 2GB parquet file with a single row group:

Reading a 1-row parquet file:

To Reproduce
Write the parquets (couldn't keep it into a single row group with daft/pyarrow):
import fastparquet
import numpy as np
import pandas as pd
from pyarrow import parquet as pq

GIB = 1 << 30

def write_parquet(dst: str, n_rows: int):
    df = pd.DataFrame(
        {"x": np.random.randint(low=0, high=256, size=n_rows, dtype=np.uint8)}
    )
    fastparquet.write(
        filename=dst, data=df, row_group_offsets=n_rows + 1, compression="SNAPPY"
    )

    assert pq.read_metadata(dst).num_row_groups == 1

if __name__ == "__main__":
    big_parquet = write_parquet(dst="big.parquet", n_rows=GIB)
    small_parquet = write_parquet(dst="small.parquet", n_rows=1)

Read (in a different process to avoid GC cleaning the written parquets in the middle of the benchmark):
import daft

if __name__ == "__main__":
    daft.set_execution_config(enable_native_executor=True, default_morsel_size=1)
    df = daft.read_parquet("big.parquet")
    assert df.num_partitions() == 1

    df_iter = df.iter_rows(results_buffer_size=1)
    next(df_iter)

Expected behavior
I would expect the memory usage for reading the first row to be significantly less than the memory required for materializing the whole dataframe, while using morsel size of 1. However, df.collect still takes considerably longer to execute, so we might actually be doing less work. Any thoughts on why this could be?
Component(s)
Parquet
Additional context
I’m not sure if it’s related, but when saving the parquet file with multiple row groups (I tested with 22), reading the first row still consumes a lot of memory. However, if we read just the first row group, the memory usage is much lower.

Couple things here:

Morsel size is currently only applied to operators, e.g. filters, url_downloads, not reads.
read_parquet reads in 1 row group at a time into memory. This is why memory usage is high for "big.parquet", which only has 1 row group. Only upon reading the row group, it will deserialize and stream the row group in chunks of 128kb. This is why iter_rows will be faster than .collect().
Regarding:

when saving the parquet file with multiple row groups (I tested with 22), reading the first row still consumes a lot of memory. However, if we read just the first row group, the memory usage is much lower.

Memory pressure in swordfish isn't fully fleshed out yet, so nothing is preventing the reader from reading all the row groups. This is something we're currently working on!

read_parquet reads in 1 row group at a time into memory.

QQ @colin-ho is this something that can be optimized in the future? I.e. some kind of stateful reading that would materialize at page boundaries instead of at rowgroup boundaries.
I imagine this could get complicated with nested types.

Yeah it can be optimized, we just need to change the reader to be more granular. This is just for local btw, the remote parquet reader already reads at the page level.

Thanks for the detailed response! I’ll avoid using Swordfish with larger datasets for now to prevent OOM :)

authors: colin-ho jaychia sagiahrac

repo: Eventual-Inc/Daft


text:
Make IN work in SQLite

Example of broken program:
logica - run Q <<<'Q(x) :- x in [1,3,5], Constraint(x in [1,2,3]); @Engine("sqlite");'

sqlite3.OperationalError: no such table: UNNEST

Fixded.

repo: EvgSkv/logica


text:
How to use these script files？

I found this link in your paper. You gave a link to CellProfiler, but I found it to be a piece of software. I don't know how to use these script files. Can you have a specific example or description?

Hello,
CellProfiler is software developed by the Broad to analyze images. To do this you create a pipeline of image processing steps. Once you have this pipeline you may need to apply this pipeline to many (thousands) of plates from high content imaging experiments, like we had to do in the mentioned paper. We therefore created some simple scripts to help with this and open-sourced them for reference. Useage and functionality are pretty simple: you invoke it with a directory that contains a plate worth of images (or with subdirectories per plate) and it will run through these. We provided the pipelines we used and some corresponding steps. You will likely have to adapt this to your particular pipelines or steps, and possible naming conventions for the image files.
These scripts are only a first step. We will soon release an update of this that is much improved.
I am not sure this answered your question. If not, feel free to be more specific.

@roelWuyts
Thank you. I'll try to use it as you said. I looked at the Processplate. sh script file you provided. I found a python file in it: . / CellProfiler / CellProfiler. py, but I didn't find this file in this project. Where should I get this file?

Dear,
I just had a look and in the meantime the latest CellProfiler is Cellprofiler 3, which is indeed different. We used CellProfiler 2.1.1 (also the provided pipelines were used with this version, I do not know if they work with CellProfiler 3). This should do the trick:
git clone https://github.com/CellProfiler/CellProfiler.git
git -C ./CellProfiler checkout -b 2.1.1 tags/2.1.1
You then have the expected CellProfiler.py.
Hope this helps !

@roelWuyts
Thank you. Your method is right.

authors: roelWuyts zhouhao-learning

repo: ExaScience/process-plate


text:
Horizontal Scrolling and Column Selection on Repeaters

Hi,
I was wondering if the Fuelux library have horizontal scrolling and a feature to pick and choose the columns to be displayed on the Repeater dynamically? That is show/hide columns dynamically on the Repeater.
Thanks.

@kevinparkerson I think is the way, off the top of my head. I'm out of the office right now.
Set list_columnSizing to false, you may want to set a width to the column inside the columns array in your datasource. Show/hide columns can be controlled by calling the render method with a new columns array.
See http://getfuelux.com/extensions.html#bundled-extensions-list-datasource for more details.

authors: interactivellama rathinaganesh

repo: ExactTarget/fuelux


text:
How to change keymap for #Accept?

For Copilot, I have the following keymap:
imap <silent><script><expr> <Right> copilot#Accept("<Right>")
How would I translate that for Codeium? I tried changing "copilot" for "codeium", as shown below, but it does not work..
imap <silent><script><expr> <Right> codeium#Accept("<Right>")
Any help would be appreciated. I want to use the Right arrow key as keymap for accepting the suggestion..

Maybe you just need to remove the "" inside it, as per README.

Doing:
imap <silent><script><expr> <Right> codeium#Accept()
sorta works, but now the right arrow doesn't behave as expected when there is no codeium suggestions...

I'm not familiar with Vim Script, so I cannot help you further If you want to have a multiplex <Right>. I will recommend you using another keymap instead.

I think you can use exists('b:_codeium_completions').
inoremap <silent><expr> <Right> exists('b:_codeium_completions') ? codeium#Accept() : "\<Right>"

@Shougo Hi, is it possible to translate the code into Lua? Specifically, I would like to know how to access the buffer variable b:_codeium_completions in Lua from Neovim. This could help me too, #124.

I guess the API you added in https://github.com/Exafunction/codeium.vim/pull/137 is for this?

It is not related.    I have added the API for my completion plugin.

inoremap   exists('b:_codeium_completions') ? codeium#Accept() : "<Right>"

Thank you, but sadly this does not work. It seems to add a tab (4 spaces)...

 inoremap <silent><expr> <Right>
  \ exists('b:_codeium_completions') && !empty(get(b:_codeium_completions, 'items', [])) ?
  \ codeium#Accept() : "\<Right>"

Yes, this works as expected! Thank you Shougo!!

inoremap
\ exists('b:_codeium_completions') && !empty(get(b:_codeium_completions, 'items', [])) ?
\ codeium#Accept() : "<Right>"
i'm not familiar with vim and lua. does anyone know how can i config this in lua?

inoremap <silent><expr> <Right>   \ exists('b:_codeium_completions') && !empty(get(b:_codeium_completions, 'items', [])) ?   \ codeium#Accept() : "\<Right>"
i'm not familiar with vim and lua. does anyone know how can i config this in lua?

 inoremap <silent><expr> <Right>
  \ exists('b:_codeium_completions') && !empty(get(b:_codeium_completions, 'items', [])) ?
  \ codeium#Accept() : "\<Right>"

i'm not familiar with vim and lua. does anyone know how can i config this in lua?

authors: LichKing-W Shougo nyngwang vinoff


text:
The last row is not read in XLS file

XLS file contains 5 rows - 1 header and 4 data. But when try to read the file - the last row is not read.
Maybe there are some issue in the file because after resave - all rows can be read.
But if uncomment next code inside method moveToNextRecordNoIndex() in class Excel.ExcelBinaryReader:
//if (!m_canRead && m_depth > 0) m_canRead = true;

			//if (!m_canRead && m_dbCellAddrsIndex < (m_dbCellAddrs.Length - 1))
			//{
			//	m_dbCellAddrsIndex++;
			//	m_cellOffset = findFirstDataCellOffset((int)m_dbCellAddrs[m_dbCellAddrsIndex]);

			//	m_canRead = readWorkSheetRow();
			//}

Everything works properly and original file can be fully read.
FICHIER_MODELE.zip

Really strange...
Loaded your file using latest trunk/development build and found no problems.
Isn't it original BIFF rather then the file after "resaving" in Excel?
Are you using older code?
http://it.tinypic.com/view.php?pic=217ces&s=9#.VvL3rXpM4pk

Yes, you are right. everything is correct when use .AsDataSet(); method.
But in our application we read row by row with method .Read().
I think this is an issue in our usage, not in library.

authors: Solnake wizardgsz

repo: ExcelDataReader/ExcelDataReader


text:
Add dev mode and fix image analysis bug

This should fix the bug

 fix image analysis for challenge response


text:
[feature] Request type file

now no type file or @types/better-opn.  and typescript report error

Hi @chenxxzhe, I would be more than happy for you to contribute and open a PR if it is really critical to you.

authors: ExiaSR chenxxzhe

repo: ExiaSR/better-opn


text:
Added rateLimit endpoint support.

Changed baseUrl so that it no longer contains data. It's better to spell out the entire endpoint all over rather than assume. Also, I need it because the rateLimit endpoint requires stats prefixed instead of data in the url.
Added rudimentary unit test.
Fixed failing test in histTest.

Test failing due to histoHour() test for number of items returned. The API sometimes returns 170, then 169. Maybe we should just take this test out?

Closing as this is no longer needed.

repo: ExodusMovement/cryptocompare


text:
Support hooks to add custom documentation to objects, fields, arguments and enum values

We came up with a documentation technique that works well for us (syncing both development teams and our product documentation team). We're trying to resolve the relevant Markdown documentation for each object, field, argument and enum value.
SchemaGeneratorHooks is an awesome general purpose vehicle for intercepting schema generation. I think it can be very helpful in this case, but it would have to be extended to include hook methods that would allow me to augment builder objects just before calling build(). That way I can call the builders' description method and add my own documentation. Specifically I'm asking for the inclusion of the following hooks:
fun willGenerateGraphQLObject(objectName: String, builder: graphql.schema.GraphQLObjectType.Builder): graphql.schema.GraphQLObjectType.Builder = builder

fun willGenerateGraphQLField(objectName: String, fieldName: String, builder: graphql.schema.GraphQLFieldDefinition.Builder): graphql.schema.GraphQLFieldDefinition.Builder = builder

fun willGenerateGraphQLEnumType(enumName: String, builder: graphql.schema.GraphQLEnumType.Builder): graphql.schema.GraphQLEnumType.Builder = builder

fun willGenerateGraphQLEnumValue(enumName: String, enumValue: String, builder: graphql.schema.GraphQLEnumValueDefinition.Builder): graphql.schema.GraphQLEnumValueDefinition.Builder = builder

fun willGenerateGraphQLArgument(objectName: String, fieldName: String, argumentName: String, builder: graphql.schema.GraphQLArgument.Builder): graphql.schema.GraphQLArgument.Builder = builder

I added the names of the objects/fields/arguments/enums to the hooks' contexts since it's difficult to extract that information from the builders directly.
What do you think?
Thanks a lot for a fantastic library!

You can add custom documentation using `@GraphgQL

You can add custom documentation using @GraphQLDescription annotation that can be added to any type. See https://github.com/ExpediaDotCom/graphql-kotlin/wiki/Fields#documenting-fields for more details.
Is there some additional functionality needed that current annotation doesn't provide?

GraphQL supports Markdown schema documentation. Our technique is pretty basic - we maintain a directory with Markdown files. The documentation can be as rich as Markdown allows (we use paragraphs, links, tables etc). Within those files an h1 (# ...) demarcates a beginning of a type documentation. h2 (## ...) demarcates a beginning of a field documentation. The directory structure doesn't really matter so we can organize these files as we see fit. Several types can be documented in the same file. Our documentation team uses an external tool to author the files (mostly https://typora.io/).
Maintaining documentation by passing an argument to an annotation is disadvantageous because:

it's very limiting. It isn't convenient to read/write anything more than pretty short string values. We don't consider that adequate documentation for our API.
it's maintained as part of the code. While this may be perfectly fine in many case we find it hinders collaboration with our documentation team.
There can be many GraphQL API endpoints implemented using different stacks but we would like the documentation for all of them to be maintained coherently using the same documentation method.

We generate another GraphQL schema for another use case not using graphql-kotlin using the documentation technique I described above successfully and we would like to continue to document all our APIs in similar way.
We would happily contribute the above mentioned documentation technique although it's very simple. It only involves scanning a directory for Markdown files, parsing them using https://github.com/vsch/flexmark-java and providing a resolution method for types and fields.

@liqweed I see why you would want this with your dynamic documentation.
We could add a method for every GraphQLType implementation but would it make more sense if we added a hook at the the same location as didGenerateGraphQLType? This is called right before we add the type to the schema but that is not helpful for you since we don't use the modified value if you were to change it in the hook.
If we added a new hook at the same location as didGenerateGraphQLType, we can have you modify the type by passing it into a builder again and the returning it.
/**
 * Called after using reflection to generate the graphql object type but before returning it to the schema.
 * This allows for modifying the type info, like description or directives
 */
fun willAddGraphQLTypeToSchema(type: KType, generatedType: GraphQLType): GraphQLType = generatedType

Your hooks can check all the possible types
override fun willAddGraphQLTypeToSchema(type: KType, generatedType: GraphQLType): GraphQLType {
    return when (generatedType) {
        is GraphQLScalarType -> GraphQLScalarType.Builder(generatedType).description("My custom description + old one: ${generatedType.description}").build()
        else -> generatedType
    }
}

Actually I noticed that we already have this with the onRewireGraphQLType but it is just not called for all the object types. If I fixed that you could use that hook in the same way as above

To add description for fields I would also need the field's name at that point. The builders don't expose the added fields for inspection or manipulation.
If I understand correctly, according to your suggestion I should traverse all the information in the builder, including its fields, and create a copy based on that - right?

Are there use cases for mutating hooks besides adding markdown, could it be used to implement custom directives? https://github.com/ExpediaDotCom/graphql-kotlin/issues/88#issuecomment-447260683

@liqweed You can access the name of the generatedType since at this point in the hook, it is fully generated. You can also look at the info on the KType but that is not always the most accurate if you are using this like @GraphQLName to override the type name

@rharriso This hook can be used at this point to add any more info to the type, not just documentation. We already have a way to do custom directives, documented here: https://github.com/ExpediaDotCom/graphql-kotlin/wiki/Schema-Directives
The comment you are referring to is a way to expose a config method or setting to provide a list of pre-configured directives instead of using the onRewireGraphQLType. There are slightly different issues.

@smyrick To make sure I follow your comment about modifying fields using this new hook, do you mean like so?
class DocumentationSchemaGeneratorHooks : SchemaGeneratorHooks {
    override fun willAddGraphQLTypeToSchema(type: KType, generatedType: GraphQLType): GraphQLType {
        return when(generatedType) {
            is GraphQLObjectType -> {
                val builder = GraphQLObjectType.Builder(generatedType)
                builder.clearFields()
                generatedType.fieldDefinitions.forEach {
                    builder.field(GraphQLFieldDefinition.Builder(it).description(resolveFieldDocumentation(generatedType.name, it.name)))
                }
                builder.description(resolveTypeDocumentation(generatedType.name)).build()
            }
            else -> generatedType
        }
    }
}

@liqweed Yep that looks correct, I know it's a few lines to parse but with some helper functions you can reuse the code for all the types, not just object types.
If that doesn't work please feel free to create a new issue with this hook

@smyrick Thanks, I think that would do.
Thank you for such a quick handling of the issue!
Looking forward to seeing this in an upcoming release.

This mechanism works well for all GraphQLTypes except for GraphQLInterfaceTypes.
The following code:
    override fun willAddGraphQLTypeToSchema(type: KType, generatedType: GraphQLType): GraphQLType {
        return when (generatedType) {
            is GraphQLInterfaceType -> GraphQLInterfaceType.newInterface(generatedType)
                .description("My resolved description").build()
            else -> generatedType
        }
    }

Produces the following error:
graphql.AssertException: All types within a GraphQL schema must have unique names. No two provided types may have the same name.
No provided type may have a name which conflicts with any built in types (including Scalar and Introspection types).
You have redefined the type 'Result' from being a 'GraphQLInterfaceType' to a 'GraphQLInterfaceType'

	at graphql.schema.GraphQLTypeCollectingVisitor.assertTypeUniqueness(GraphQLTypeCollectingVisitor.java:105)
	at graphql.schema.GraphQLTypeCollectingVisitor.visitGraphQLInterfaceType(GraphQLTypeCollectingVisitor.java:58)
	at graphql.schema.GraphQLInterfaceType.accept(GraphQLInterfaceType.java:152)
	at graphql.schema.TypeTraverser$TraverserDelegateVisitor.enter(TypeTraverser.java:71)
	at graphql.util.Traverser.traverse(Traverser.java:147)
	at graphql.schema.TypeTraverser.doTraverse(TypeTraverser.java:58)
	at graphql.schema.TypeTraverser.depthFirst(TypeTraverser.java:50)
	at graphql.schema.TypeTraverser.depthFirst(TypeTraverser.java:38)
	at graphql.schema.SchemaUtil.allTypes(SchemaUtil.java:42)
	at graphql.schema.GraphQLSchema.<init>(GraphQLSchema.java:102)
	at graphql.schema.GraphQLSchema.<init>(GraphQLSchema.java:37)
	at graphql.schema.GraphQLSchema$Builder.build(GraphQLSchema.java:411)
	at com.expedia.graphql.generator.SchemaGenerator.generate$graphql_kotlin_schema_generator(SchemaGenerator.kt:68)
	at com.expedia.graphql.ToSchemaKt.toSchema(toSchema.kt:24)
	at com.expedia.graphql.ToSchemaKt.toSchema$default(toSchema.kt:21)

@liqweed These seems like a valid error, I have created a new issue which is open for anyone to work on https://github.com/ExpediaDotCom/graphql-kotlin/issues/281

authors: dkuc84 liqweed rharriso smyrick

repo: ExpediaDotCom/graphql-kotlin