text:
Add arm64 image build and switch build to use Docker BuildX

Checklist

[x] Implementation
[ ] Tests
[ ] Docs

Implementation:
Switched build system to use Docker BuildX, allowing targeting of multi-arch docker images. Currently only building arm64 and amd64 arch images, but it might be good to add other ARM architectures if anyone wants to run containerised on an older Raspberry Pi.
Tests:
Build process tested against my own Docker repo. I've assumed that the repo secrets DOCKER_PASSWORD and DOCKER_USERNAME are the login details for the inspircd/inspircd-docker Docker Hub repo, and I've made sure that the build works pushing to my Docker Hub. I've verified that the INSP_VERSION env var is respected and added to the BuildX args, so it definitely pulls the correct tagged version of the inspircd source. Can't really test this bit as it's the GitHub actions build script...
Docs:
Don't think any explicit docs are needed. My testing on my own multi-arch k8s cluster shows that the images can be happily used on whatever host, and image pulls will select the correct architecture for the host automatically.
Caveats:
Build time of the GitHub build action is quite long, increasing from ~10mins to ~50mins. I've run a test build on my Raspbery Pi 4, and the build time on that system is not far off that upper ballpark. I've had a look at the caching of the docker/build-publish step, and I don't think it's likely to help much seeing as this image only gets built once in a while.
Merging:
If this PR is merged, then the build action will kick off, and it will REPLACE all currently tagged images in the docker hub repo - so the current amd64 images tagged 3/3.10/3.10.0/latest will be replaced. Not sure it'll be a problem, but just something to be aware of.

So the PR build failed - it's failing to log in to docker hub. The build script uses the following:
        name: Login to DockerHub
        uses: docker/login-action@v1
        with:
          username: ${{ secrets.DOCKER_USERNAME }}
          password: ${{ secrets.DOCKER_PASSWORD }}

Which worked in my fork, because I had two secrets called DOCKER_USERNAME and DOCKER_PASSWORD. I've removed setting the secrets in the env block, as some build actions echo out the entire env block to their log when they run, which is obviously bad. But I can't see if I've got the right secrets. I thought I had but... yeah. I'm a bit baffled as to why this is failing. I could disable the docker login step if it's not a master build, I suppose?

Disabling the docker hub login step unless it's a master build seems to make sense to me - there's no need to log into a service that we're not going to use.
I'm at the end of my rope now - since I have no visibility of this repo's secrets, I can't make sure that DOCKER_USERNAME and DOCKER_PASSWORD will work when used by the docker/login-action@v1 step.

Some tests fail when run locally. After doing docker swarm init and docker build -t inspircd:testing ., the following four tests fail:
customConfigSecrets.sh:, secrets.sh
image inspircd:testing could not be accessed on a registry to record its digest. Each node will access inspircd:testing independently, possibly leading to different nodes running different versions of the image.

default.sh:, mountConfig.sh
SSL handshake has read 2602 bytes and written 709 bytes
Verification error: unable to verify the first certificate

All other tests pass.
The certificate issues, I don't really get.
The other issue -  "image could not be accessed on a registry" - could have a work around. Had a look at this: https://codeblog.dotsandbrackets.com/private-registry-swarm/ and the suggestion is to create a service that runs a registry and force docker to use and trust that registry, then build and publish the image to that registry in the test context, and then run the tests. Unless I've misunderstood this whole process.
Other observations:

The Docker BuildX step doesn't leave the built image lying around
we want to build and test images before merging.
in order for the tests to pass, it looks like docker needs to run an image available in an image repository (??? might have misunderstood this!)
we don't want to leave test images lying around in a public repo, so we don't want to push them to Docker Hub
we could use GitHub Container Registry for test images, setting up a separate build step just for that repo, and delete the image from the repo after testing is finished - see https://github.com/docker/build-push-action/blob/master/docs/advanced/isolated-builders.md and https://docs.github.com/en/packages/working-with-a-github-packages-registry/working-with-the-container-registry )
this would only work for builds against the main repo, not for forked repos (the auth secrets necessary to login wouldn't be present on forks)

the workflow i'm proposing is:
if building a PR:

modify run_tests.sh to allow overriding of the test image name. locally, it can still be (and defaults to) inspircd:testing
Option A:
build amd64 image only
push it to GHCR as inspircd:testing-$SOME_BUILD_IDENTIFIER
execute run-tests.sh with that image - e.g. export $TEST_IMAGE=gchr.io/inspircd/inspircd:testing-$SOME_BUILD_IDENTIFIER
once test passes/fails, delete the image (<- not sure how to do this!)
Option B:
run a registry service
force docker to use and trust that registry
build the docker image tagged as inspircd:testing and then push to transient registry service

if building a merge to master
don't run the tests, because managing the test images is a pain. If only PRs where the tests pass are merged, then the tests will have been run in the GitHub action when the PR was being built.
I could be a bit wrong though.

repo: inspircd/inspircd-docker


text:
A.03.10.missing.language.filter

This issue has been extracted from the issue list on:https://ies-svn.jrc.ec.europa.eu/issues/2685
Comment

A.01.04 and 1.02.09 as prerequisites
I think it is in conflict with A.01.06 where a default language should be provide anyway.

A.02.09 states that if language requested by client is NOT contained in the list of supported languages, the default language is used as defined in \inspire_common:Language
However based on 3.10 this should be equivalent to missing language parameter? -> In other words, the response should contain metadata records of several natural languages, as provided by the INSPIRE Discovery Service.

See #54 , A.2.9 is not a pre-requisite as it tests the GetCapabilities operation, and this tests the GetRecords operation. It could be seen that this test case is conditional on the service containing metadata in more than one language, but this is partly described by the requirement wording ("Depending on the discovery service contents").
At A.2.9, it is correct that if no language filter is provided in the GetCapabilites request, the response will be in the default language. Here, at A.3.10, it is correct that if no language filter is provided in the GetRecords request, the response may contain records in several languages.
Proposed resolution: reject this comment.

See #31 suggesting A.1.4 should become a summary test case

source: gharchive/issue

authors: PeterParslow jensscheerlinck

license_type: permissive

license_source: bigquery


text:
records: addition of cli

Signed-off-by: Harris Tzovanakis me@drjova.com

@harunurhan updated

source: gharchive/pull-request

repo: inspirehep/inspirehep

license: MIT

license_source: github-api


text:
[tutorial] For Of loop

Description of the tutorial

Definition of for...of loop
Difference between for and for...of loop
Examples explaining the working of for...of loop
Basic challenges using for...of loop

Do you want to be assigned to work on this?
(mark [x])

[x] YES
[ ] NO

Optional: Any additional info you want to add
None

You're assigned now @Parth-ops 🎉

authors: Parth-ops sabderemane


text:
建议服务详情可以看到服务占用资源情况

In GitLab by @cuiaq123 on Dec 17, 2019, 06:01

In GitLab by @cuiaq123 on Dec 17, 2019, 06:01
assigned to @luotian-github

In GitLab by @luotian-github on Dec 17, 2019, 07:56
assigned to @sokril and unassigned @luotian-github

repo: inspursoft/board


text:
post-filter datetime - Filter evaluation failed

Describe the bug
windows console execution file(instaloader.exe) arguments
--post-filter="date_utc < datetime(2022,1,14)"
Filter evaluation failed: can't compare offset-naive and offset-aware datetimes
it's not possible to compare datetime
but version 4.8.2 is possible.

To Reproduce
instaloader.exe romi.fit --dirname-pattern "folder" --fast-update -l "id"
-f "x:\xxx\session-id" --post-filter="date_utc < datetime(2022,1,14)" --no-video-thumbnails --no-captions --no-metadata-json --no-compress-json --filename-pattern "{date_utc} {owner_username} {shortcode}"
Only download posts with property "date_utc < datetime(2022,1,14)".
Loaded session from x:\xxx\session-id.
Logged in as udjoa10.
Stored ID 1078396896 for profile romi.fit.
[1/1] Downloading profile romi.fit
romi.fit 피트 신새롬 275\romi.fit_2022-01-06_09-30-40_UTC_profile_pic.jpg
Retrieving posts from profile romi.fit.
[  1/354]  skipped. Filter evaluation failed: can't compare offset-naive and offset-aware datetimes
[  2/354]  skipped. Filter evaluation failed: can't compare offset-naive and offset-aware datetimes

Expected behavior
I dont't get it.

Error messages and tracebacks
no trackbacks

Instaloader version
4.8.3

Thanks for reporting! This is fixed in version 4.8.2.

authors: aandergr kygger

repo: instaloader/instaloader


text:
Unable to download using code snippet in putty ubuntu but works in local [ConnectionException: JSON Query to graphql/query: HTTP error code 401]

I'm using the following code snippet in my python program which downloads videos to aws. And I'm able to download successfully in my local on visual studio but when I do the same in putty ubuntu server I get instaloader.exceptions.ConnectionException: JSON Query to graphql/query: HTTP error code 401. I've imported instaloader==4.10
I'm not able to tell if it's because of some cookies that got saved in local but aren't in the putty server maybe?
Here's the code snippet:
async def instLoad(from_num,link):
    I = Instaloader(
        filename_pattern="video", download_pictures=False, save_metadata=False, post_metadata_txt_pattern='',
    )
    id_pattern = r"(/p/|/reel/)([a-zA-Z0-9_-]+)/"
    match = re.search(id_pattern, link)
    if match:
        id = match.group(2)
        post = Post.from_shortcode(I.context, id)
#[CHANGED] cipher.py in (Python311\Lib\site-packages\pytube) line 30: var_regex = re.compile(r"^\$*\w+\W")
        video_url = post.video_url
        r = requests.get(video_url, stream=True)

        random_string = ''.join(random.choice(string.ascii_letters) for _ in range(4))
        s3_file = from_num+random_string+'.mp4'
        s3_client.upload_fileobj(r.raw, bucket, s3_file, ExtraArgs={
            'ContentType': 'video/mp4',
            'ContentDisposition': 'inline'
        })
        video_link = f"https://{bucket}.s3.amazonaws.com/{s3_file}"
    return video_link

Here's the error:

File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/instaloadercontext.py", line 405, in get_json
raise ConnectionException("HTTP error code {}.".format(resp.status_code))
instaloader.exceptions.ConnectionException: HTTP error code 401.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/ubuntu/.local/lib/python3.10/site-packages/flask/app.py", line 2190, in wsgi_app
response = self.full_dispatch_request()
File "/home/ubuntu/.local/lib/python3.10/site-packages/flask/app.py", line 1486, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/home/ubuntu/.local/lib/python3.10/site-packages/flask/app.py", line 1484, in full_dispatch_request
rv = self.dispatch_request()
File "/home/ubuntu/.local/lib/python3.10/site-packages/flask/app.py", line 1469, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
File "/home/ubuntu/.local/lib/python3.10/site-packages/asgiref/sync.py", line 277, in call
return call_result.result()
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
return self.__get_result()
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
raise self._exception
File "/home/ubuntu/.local/lib/python3.10/site-packages/asgiref/sync.py", line 353, in main_wrap
result = await self.awaitable(*args, **kwargs)
File "/home/ubuntu/app.py", line 151, in bot
video_link = await instLoad(from_number, incoming_msg)
File "/home/ubuntu/app.py", line 31, in instLoad
post = Post.from_shortcode(I.context, id)
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/structures.py", line 135, in from_shortcode
post._node = post._full_metadata
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/structures.py", line 252, in _full_metadata
self._obtain_metadata()
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/structures.py", line 239, in _obtain_metadata
pic_json = self._context.graphql_query(
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/instaloadercontext.py", line 483, in graphql_query
resp_json = self.get_json('graphql/query',
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/instaloadercontext.py", line 448, in get_json
return self.get_json(path=path, params=params, host=host, session=sess, _attempt=_attempt + 1,
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/instaloadercontext.py", line 448, in get_json
return self.get_json(path=path, params=params, host=host, session=sess, _attempt=_attempt + 1,
File "/home/ubuntu/.local/lib/python3.10/site-packages/instaloader/instaloadercontext.py", line 438, in get_json
raise ConnectionException(error_string) from err
instaloader.exceptions.ConnectionException: JSON Query to graphql/query: HTTP error code 401.

I also encountered the same problem. I guessed that too frequent visits caused the IP to be officially banned by Instagram. I changed the IP and the problem was solved.

If your aws fixed ip is banned by ins, it will be difficult to do it. I also initiated the request on the Google server. The difference is that I used a dynamic ip as a proxy so that it can be successful. Otherwise, there is nothing I can do.

Okay, from what I've found the error is due to the following reason:
I logged in to instagram on my browser at some point, the code ran on local and Instaloader automatically downloaded certain cookies which it used for the session. Later when I logged out it still had the cookies and could use them.
Obviously since there is no browser on the putty/aws etc. it can't get the cookies to use in session file. Maybe there is way to find where it saves the cookie and manually putting that file in aws/putty server.
I'm not sure if this is why, because I found this out by deleting the instagram account, since the account was deleted of course the cookies of that account are going to be useless.

I also encountered the same problem. I guessed that too frequent visits caused the IP to be officially banned by Instagram. I changed the IP and the problem was solved.

If multiple visits was the reason it wouldn't work in my local as well, not just the putty ubuntu server.

I am running this on AWS instance, it works fine in local but not in aws, any solution? I tried updating header but no luck. Any help will be appreciated. Let me know if I can use my static IP and get this running.

Best advise I can give is try to look for a way to find the place it stored the cookies sessionfile and add it to the aws instance?

Also having the same error. Someone used VPN to trick this error? It's ok?

authors: Devaryalakhanpal QingsiLiu felp99


text:
🛑 香港｜CN2 is down

In 5e3742d, 香港｜CN2 ($HKCN2_SITE_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: 香港｜CN2 is back up in 7749ea5.

repo: intSailers/uptime


text:
🛑 Shopintake is down

In d203f59, Shopintake (https://www.shopintake.com) was down:

HTTP code: 403
Response time: 343 ms

Resolved: Shopintake is back up in a981558 after 44 minutes.


text:
Don't invoke sbt from the makefile.

This avoids rebuilding everything with sbt when running "mvn install".
Also avoid copying the generated library to the source directory.

LGTM @dianfu any further comments?

Currently sbt is used to do both packaging and publishing the jar to maven central repository. I'm ok to remove sbt from the makefile. But we should add the functionality to publish the jar the maven central repository using maven plugin.

Why have sbt in the build here at all? It's such a small library, maven is more than enough. Just "mvn deploy" to upload to maven central should be enough, no?

Agree that maven is enough to do that. But it's so easy as you said that "maven deploy" is enough.  For example, you need to generate a PGP signature for the jar. Anyway, I'm +1 to use maven to do that.

+1 on this PR. I will create a separate PR to cover the necessary changes to publish the jar to maven central repository.

authors: dianfu vanzin winningsix

repo: intel-hadoop/chimera


text:
The term "Total processed messages" is confusing

Suggest to change the chart/value in dashboard as four metrics:

total received messages (from processors without any outputs)
total sent messages (from processors without any inputs)
average processor send throughput
average processor receive throughput

suggest to rename as "Total output messages"
suggest to rename as "Total received messages"

Is there any way to show the average latency for message overall handling? I mean, treating the DAG as a blackbox and show the average latency for each message from in to out of this black box.

repo: intel-hadoop/gearpump


text:
[POAE7-2439] Support Coalesce Function for Arrow Format

What changes were proposed in this pull request?

Support Coalesce Function for Arrow Format.
Coalesce contains IF and Cast, First verify IF test case, then verify Cast test case after [POAE7-2512].
Why are the changes needed?

Support Coalesce Function for Arrow Format.
Does this PR introduce any user-facing change?

No.
How was this patch tested?

Uts.
Which label does this PR belong to?

CODEREFACTOR,cider,test

Open cast test case which is case when. @kd97

repo: intel/BDTK


text:
FreeBSD port

I'm trying to port daal into FreeBSD. The library itself compiles fine, but when I try to compile a sample, I'm getting a lot of unresolved references defined in "libdaal_mkl_*.a" libraries. Is it possible to obtain a source code of these libraries to compile them natively and finalize porting? Thanks.

So any chances to obtain missed sources?

Hello rayrapetyan!
Sorry for delayed answer.
libdaal_mkl_.a are custom build of , mostly,  Intel® Math Kernel Library (Intel MKL). Because Intel MKL doesnt have open source variant, we cant provide their source code.
Within next few days we will explore possibilities to provide libdaal_mkl_.a libs for FreeBSD*.
Could you provide FreeBSD* and compiler version which you use?
Andrey

FreeBSD 11.1 (amd64), clang 4.0.0. Thanks.

Hi @dr-pain , I've created a branch based on intel:daal_2018_update2:
https://github.com/rayrapetyan/daal/tree/FreeBSD_support
Build instructions (tested on FreeBSD 11.1-RELEASE-p10, clang version 4.0.0):

Replace mkl libs in daal_last/externals/mklfpk/fbsd/lib with ones compiled natively in FreeBSD (daal lib compiles OK anyway, but final targets will fail to compile with unresolved dependencies, the reason why this issue was created).
pkg install tbb-2018.2 openjdk8
setenv CPATH /usr/local/openjdk8/include:/usr/local/openjdk8/include/freebsd
gmake daal PLAT=fbsd32e COMPILER=clang

Let me know if you have any questions\issues. Thanks!

Hello @rayrapetyan !
sorry for delayed answer again.
I have looked into your branch and want to say what you did good job! Thank you!
I have successfully built DAAL dynamic libs and run example with them without modifications of mklfpk linux libs (I have just copied src\externals\mklfpk\lnx to src\externals\mklfpk\fbsd).
I have used your branch, but did some changes:

makefile. change "-u" option to "-Wl$(comma)-u -Wl$(comma)" in lines 529, 531, 559, 561
examples\cpp\makefile_lnx should be used as template for examples\cpp\makefile_fbsd
After that, one problem remains only - mklfpk libs refers to stderr&stdout symbols. It may be solved by adding code:
FILE *stdout=__stdoutp;
FILE *stderr=__stderrp;
into final application (or somewhere in DAAL sources).

Will look on static libs building issue - I see that something wrong with creation of them (libraries size is too small).
Andrey

@dr-pain, thanks. Mine static is 20MB:
ls -la __release_fbsd_clang/daal/lib/intel64_fre/libdaal_core.a
-rw-r--r--  1 robert  wheel  20413048 Jul  3 16:48 __release_fbsd_clang/daal/lib/intel64_fre/libdaal_core.a
What's the expected size?

@rayrapetyan , >850Mb for libdaal_core.a, >100Mb for libdaal_sequential.a and libdaal_thread.a.

@dr-pain, thanks, and what about  undefined references? Could you provide mkl sources or at least natively compiled binaries?

@rayrapetyan ,
I have used native linux libs with no modifications + little modifications in makefile are required. See my prev answer.
If it will not help, send me build logs please.

@rayrapetyan
I expect that you have added
#undef stdout
#undef stderr
FILE *stdout=__stdoutp;
FILE *stderr=__stderrp;
into your main.cpp global section (outside main function body).
my command line is:
clang++ -Wall -w -I./source/utils -I/usr/include/c++/v1 -I/usr/local/include  -m32 -std=c++11 -stdlib=libc++ -nostdinc++ -L/usr/local/lib/gcc6 ./source/association_rules/assoc_rules_apriori_batch.cpp -o _results/clang_ia32_parallel_so/assoc_rules_apriori_batch.exe -Wl,--start-group "/localdisk/agilev/daal-2018-u2-os-rls/src/__release_fbsd/daal/lib/ia32_fre"/libdaal_core.so "/localdisk/agilev/daal-2018-u2-os-rls/src/__release_fbsd/daal/lib/ia32_fre"/libdaal_thread.so  -L"/localdisk/agilev/daal-2018-u2-os-rls/src/__release_fbsd/daal/../tbb/lib/ia32_fre/gcc4.4" -ltbb -ltbbmalloc -lc -Wl,--end-group
So, try to:

add linker options --start-group/--end-group around linked libs
remove libdaal_mkl_thread.a from command line. It should be linked into libdaal_thread.so already
change compiler to clang

#undef stdout
#undef stderr
did the trick, thanks a lot! I'll try to figure out why static lib is so small, but your help would be highly appreciated!

@rayrapetyan
in my case, without this "trick" compilation failed with "incompatible redefinition" message. So, you may want to check your build logs.
Can I ask you question? What is the purpose of your DAAL to FreeBSD porting works?

In my case just adding "undef" resolved all issues and app build and runs fine:

/usr/local/bin/cmake --build /ara/devel/sandbox/daal_dt/cmake-build-debug --target daal_dt -- -j 2
/usr/local/bin/cmake -H/ara/devel/sandbox/daal_dt -B/ara/devel/sandbox/daal_dt/cmake-build-debug --check-build-system CMakeFiles/Makefile.cmake 0
/usr/local/bin/gmake -f CMakeFiles/Makefile2 daal_dt
gmake[1]: Entering directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
/usr/local/bin/cmake -H/ara/devel/sandbox/daal_dt -B/ara/devel/sandbox/daal_dt/cmake-build-debug --check-build-system CMakeFiles/Makefile.cmake 0
/usr/local/bin/cmake -E cmake_progress_start /ara/devel/sandbox/daal_dt/cmake-build-debug/CMakeFiles 2
/usr/local/bin/gmake -f CMakeFiles/Makefile2 CMakeFiles/daal_dt.dir/all
gmake[2]: Entering directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
/usr/local/bin/gmake -f CMakeFiles/daal_dt.dir/build.make CMakeFiles/daal_dt.dir/depend
gmake[3]: Entering directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
cd /ara/devel/sandbox/daal_dt/cmake-build-debug && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /ara/devel/sandbox/daal_dt /ara/devel/sandbox/daal_dt /ara/devel/sandbox/daal_dt/cmake-build-debug /ara/devel/sandbox/daal_dt/cmake-build-debug /ara/devel/sandbox/daal_dt/cmake-build-debug/CMakeFiles/daal_dt.dir/DependInfo.cmake --color=
gmake[3]: Leaving directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
/usr/local/bin/gmake -f CMakeFiles/daal_dt.dir/build.make CMakeFiles/daal_dt.dir/build
gmake[3]: Entering directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
[ 50%] Building CXX object CMakeFiles/daal_dt.dir/main.cpp.o
/usr/bin/c++   -I/ara/devel/sandbox/daal/__release_fbsd_clang/daal/include -I/ara/devel/sandbox/daal/__release_fbsd_clang/daal/examples/cpp/source/utils  -pthread -g   -std=gnu++11 -o CMakeFiles/daal_dt.dir/main.cpp.o -c /ara/devel/sandbox/daal_dt/main.cpp
[100%] Linking CXX executable daal_dt
/usr/local/bin/cmake -E cmake_link_script CMakeFiles/daal_dt.dir/link.txt --verbose=1
/usr/bin/c++   -pthread -g   CMakeFiles/daal_dt.dir/main.cpp.o  -o daal_dt  -L/ara/devel/sandbox/daal/__release_fbsd_clang/daal/lib/intel64_fre  -L/ara/devel/sandbox/daal/externals/mklfpk/fbsd/lib/intel64  -L/usr/local/lib -Wl,-rpath,/ara/devel/sandbox/daal/__release_fbsd_clang/daal/lib/intel64_fre:/ara/devel/sandbox/daal/externals/mklfpk/fbsd/lib/intel64:/usr/local/lib -ldaal_core -ldaal_thread -ltbb -ltbbmalloc /ara/devel/sandbox/daal/externals/mklfpk/fbsd/lib/intel64/libdaal_mkl_thread.a
gmake[3]: Leaving directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
[100%] Built target daal_dt
gmake[2]: Leaving directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'
/usr/local/bin/cmake -E cmake_progress_start /ara/devel/sandbox/daal_dt/cmake-build-debug/CMakeFiles 0
gmake[1]: Leaving directory '/ara/devel/sandbox/daal_dt/cmake-build-debug'

Output:
/ara/devel/sandbox/daal_dt/cmake-build-debug/daal_dt
The first element of the Cholesky factor: 5.26354e-315
Process finished with exit code 0
The reason I'm trying to port DAAL is a lack of working "Decision Trees" classifier for one of the CPP projects I'm working on. I've tried mlpack (created a port - https://www.freshports.org/math/mlpack/), but it produces some weak predictions (comparing to scikit-learn) - https://github.com/mlpack/mlpack/issues/1399. Then I've tried shogun, surprisingly it was very buggy - https://github.com/shogun-toolbox/shogun/issues/4282, author has rewritten the whole thing after that. Tried few other less popular libs, there are issues everywhere.
DAAL looks like a well tested stable product, so hopefully it will show same or better results in predictions (comparing to scikit-learn).
Of course, I'm also just a big fun of FreeBSD, using this OS everywhere and want to contribute back as much as I can.
So these two reasons. Thanks.

@rayrapetyan
I have found the root of problem - FreeBSD ar utility doesnt recognize "@" option which allow to read command line args from file. I also cant find analog of this option :-(
So, need to rework scheme of adding object files into archive.
The simplest way (change link.static.fbsd macro to unconditional usage of link.static.fbsd.script) also doesn`t work at FreeBSD because long command line.
I have tried to process __work_clang/fbsd32/kernel/libdaal_core_link.txt line by line, but it takes too much time (one ar call per one file for ~5200 files).
Will try to invent something more useful.

@dr-pain, I've tried to overcome that with ar's "MRI Librarian Commands" (addmod) with an unwrapped list of obj files from the txt file. It took more than an hour producing a huge HDD and CPU load (still goes). Do you think 1Gb static lib makes any sense? I'm pretty sure no one will use it anyway, it will just sit and waste huge amount of space. What if we just drop it from the output? Thanks.

@dr-pain, yeah, I've stepped into the same... Any workaround for "too long command-line"? I've tried to create a shell script dynamically and execute from there but it's too bulky..

@dr-pain, nevermind, /usr/local/bin/ar works fine with @ :). Preparing final changes to commit...

@dr-pain, so the only problem left, the combination with comma doesn't work:

clang++ -m64 -shared -Wl,--start-group -z relro -z now -z noexecstack __work_clang/fbsd32e/thread_dll/threading_tbb.o _work_clang/fbsd32e/thread_dll/service_thread_pinner_tbb.o externals/mk
lfpk/fbsd/lib/intel64/libdaal_mkl_thread.a externals/mklfpk/fbsd/lib/intel64/libdaal_vmlipp_core.a -fPIC -Wl,-u -Wl, fpk_blas_avx2_daxpy -Wl,-u -Wl, fpk_blas_avx2_dgemm -Wl,-u -Wl, fpk_blas
avx2_dgemv -Wl,-u -Wl, fpk_blas_avx2_dsymm -Wl,-u -Wl, fpk_blas_avx2_dsyr -Wl,-u -Wl, fpk_blas_avx2_dsyrk -Wl,-u -Wl,....
gives:
clang++: error: no such file or directory: 'fpk_blas_avx2_daxpy'
clang++: error: no such file or directory: 'fpk_blas_avx2_dgemm'
clang++: error: no such file or directory: 'fpk_blas_avx2_dgemv'
clang++: error: no such file or directory: 'fpk_blas_avx2_dsymm'
clang++: error: no such file or directory: 'fpk_blas_avx2_dsyr'
clang++: error: no such file or directory: 'fpk_blas_avx2_dsyrk'
clang++: error: no such file or directory: 'fpk_blas_avx2_saxpy'
clang++: error: no such file or directory: 'fpk_blas_avx2_sgemm'
clang++: error: no such file or directory: 'fpk_blas_avx2_sgemv'
clang++: error: no such file or directory: 'fpk_blas_avx2_ssymm'
clang++: error: no such file or directory: 'fpk_blas_avx2_ssyr'
...

@rayrapetyan
I have prepared workaround tor BSD ar from /usr/bin :-) but your solution with /usr/local/bin/ar looks better. Lets leave it.
Hmm. "-Wl,-u -Wl, fpk_blas_avx2_dgemm" solution works fine for me. Which clang++ did you use? maybe FreeBSD has several versions of it as with ar.
I also plat to incorporate stdout/stderr definition into library to avoid necessity of this code in final application.
And main part.
Thank you for your involvement into FreeBSD support addition to DAAL! We will discuss how we will keep it.
Andrey

I've recently upgraded to 11.2 which uses clang version 6.0.0, maybe that's the reason.
I've also added stdout\stderr into daal sources and fixed double definition of sched_getaffinity (used extern in one of the sources instead). May I ask you - what's the purpose of -u funcname? Is it to avoid specifying daal_mkl_* libs when compiling user apps ot something else? Thanks!

I don`t try to make secret here :-)
man clang++:
-Wl,
Pass the comma separated arguments in args to the linker.
man ld:
-u symbol
--undefined=symbol
Force symbol to be entered in the output file as an undefined
symbol.  Doing this may, for example, trigger linking of additional
modules from standard libraries.  -u may be repeated with different
option arguments to enter additional undefined symbols.  This
option is equivalent to the "EXTERN" linker script command.
libdaal_core.so needs fpk_* symbols from libdaal_sequential.so or libdaal_thread.so. To make these symbols visible, I need to specify them via -u linket option. Otherwise, linker will made them internal.
nm libdaal_thread.so | grep fpk_ (library built with -u):
...
01265ff0 T fpk_blas_ssse3_dcopy
012661f0 T fpk_blas_ssse3_ddot
...
nm libdaal_thread.so | grep fpk_ (library built without -u) gives nothing.
Will ask our IT dept to install new FreeBSD 11.2 and do experiments.

@rayrapetyan
I tested at FreeBSD 11.2 server too:
[agilev@nnviclef134 ~]$ uname -a
FreeBSD nnviclef134 11.2-RELEASE FreeBSD 11.2-RELEASE #0 r335510: Fri Jun 22 04:32:14 UTC 2018     root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64
[agilev@nnviclef134 ~]$ clang++ --version
FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0)
Target: x86_64-unknown-freebsd11.2
Thread model: posix
InstalledDir: /usr/bin
build should work.
Could you put your latest changes to branch?

Done, please check. I'm getting all these errors at the very end of process.

Hello @rayrapetyan !
I have tried to build DAAL from your branch. And now I see where problem is.
makefile , strs 529, 531, 559, 561: remove extra space from the middle of "-Wl$(comma) ,$(shell".
I also have couple of changes in makefile which help to avoid presence of /externals/mklfpk/fbsd
folder (which is duplication of /externals/mklfpk/lnx). Will put my makefile here later today.

Thanks, committed all suggested changes. Now everything works fine! Let me know if I need to perform a pull request into your branch...

authors: dr-pain rayrapetyan

repo: intel/daal


text:
Fix BC for trees

Fix for BC for trees

make test

make test

make test

make test

make test


text:
docs: conf: Add download button for ipython notebooks

Signed-off-by: mHash1m hashimchaudry23@gmail.com

Codecov Report

Merging #1118 (393c8de) into master (a118bf5) will decrease coverage by 0.07%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1118      +/-   ##
==========================================
- Coverage   83.12%   83.04%   -0.08%
==========================================
  Files         150      150
  Lines        9778     9774       -4
  Branches     1657     1657
==========================================
- Hits         8128     8117      -11
- Misses       1305     1311       +6
- Partials      345      346       +1

Impacted Files
Coverage Δ

dffml/util/data.py
64.08% <0.00%> (-2.77%)
:arrow_down:

tests/util/test_net.py
98.36% <0.00%> (-1.64%)
:arrow_down:

dffml/base.py
84.38% <0.00%> (-0.34%)
:arrow_down:

dffml/df/memory.py
79.64% <0.00%> (-0.26%)
:arrow_down:

dffml/util/testing/consoletest/commands.py
75.16% <0.00%> (-0.06%)
:arrow_down:

dffml/source/df.py
76.54% <0.00%> (ø)

dffml/noasync.py
43.63% <0.00%> (+0.53%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a118bf5...393c8de. Read the comment docs.

repo: intel/dffml


text:
Intel HAXM installation failed! Install Haxm failed with 'The system requirements are not satisfied'

Intel HAXM installation failed!
Log file content :
Version: 7.6.6
Output folder: C:\Program Files\Intel\HAXM
Extract: checktool.exe... 100%
Execute: C:\Program Files\Intel\HAXM\checktool.exe --verbose
CPU vendor          *  GenuineIntel
Intel64 supported   *  Yes
VMX supported       *  Yes
VMX enabled         *  Yes
EPT supported       *  Yes
NX supported        *  Yes
NX enabled          *  Yes
Hyper-V disabled    *  Yes
OS version          -  Windows 6.1.7600
OS architecture     *  x86_64
Guest unoccupied    *  Yes. 0 guest(s)
The system requirements are not satisfied.

Hi @Varun2012 ,you could try to disable Hyper-V via 'bcdedit /set hypervisorlaunchtype off' in the windows terminal with admin privilege . Then reboot you PC for trying again. If above method still could not resolve your issue, please refer to https://github.com/intel/haxm/blob/master/docs/manual-windows.md#one-time-setup and https://github.com/intel/haxm/blob/master/docs/manual-windows.md#disabling-hyper-v-on-windows-10

Issue didn't resolve.

You need to install SP1 on Windows 7. The above solution is useless since HyperV isn't a problem for most WIn7 users

authors: Varun2012 demberto wayne-ma

repo: intel/haxm


text:
Fetch the llvm-spirv component automatically if no llvm-spirv specified.

Add the public llvm-spirv component to the Triton XPU backend.
Support to build the XPU backend friendly.

https://github.com/intel/intel-xpu-backend-for-triton/blob/llvm-target/scripts/compile-triton.sh can be modified to no longer clone the SPIRV-LLVM translator after this change. Created https://github.com/intel/intel-xpu-backend-for-triton/pull/189.

authors: chengjunlu whitneywhtsang

repo: intel/intel-xpu-backend-for-triton


text:
Update SGX Docs

Please provide a description of this PR:
To help us figure out who should review this PR, please put an X in all the areas that this PR affects.

[ ] Ambient
[ ] Configuration Infrastructure
[ ] Docs
[ ] Installation
[ ] Networking
[ ] Performance and Scalability
[ ] Policies and Telemetry
[ ] Security
[ ] Test and Release
[ ] User Experience
[ ] Developer Infrastructure

Please check any characteristics that apply to this pull request.

[ ] Does not have any user-facing changes. This may include CLI changes, API changes, behavior changes, performance improvements, etc.

Hi @gyohuangxin , PTAL.

repo: intel/istio


text:
Update README.md

Adding podcast link because it can't hurt.

It looks great to me :)

authors: ezelanza kdruckman

repo: intel/open-ecosystem-ref-code


text:
Remove sh tutorial scripts

This pull request is to remove all .sh files and replace them with readme files with detailed instructions on how to start the experiment with or without TLS.

It was decided to not go with strategy to remove all .sh scripts and move completely to fx commands for user convenience (at least for right now).

authors: alexey-gruzdev alexey-khorkin

repo: intel/openfl


text:
Deselct GBT_regression test

tests/daal4py/sycl/gradient_boosted_regression.py test times out on PVC, deselected for now by bumping up the version as we await complete removal of the tests when no longer dependent on sycl algorithms.

/intelci: run

repo: intel/scikit-learn-intelex


text:
Revert "Add sklearn 1.5 to CI matrix"

Reverts intel/scikit-learn-intelex#1842 due to introduced GPU CI failures

@Alexsandruss with merge of #1855 this can now be reverted.

authors: ethanglaser icfaust


text:
[experiment] ENH: using only raw inputs for onedal backend

Description
Add a comprehensive description of proposed changes
List associated issue number(s) if exist(s): #6 (for example)
Documentation PR (if needed): #1340 (for example)
Benchmarks PR (if needed): https://github.com/IntelPython/scikit-learn_bench/pull/155 (for example)

PR should start as a draft, then move to ready for review state after CI is passed and all applicable checkboxes are closed.
This approach ensures that reviewers don't spend extra time asking for regular requirements.
You can remove a checkbox as not applicable only if it doesn't relate to this PR in any way.
For example, PR with docs update doesn't require checkboxes for performance while PR with any change in actual code should have checkboxes and justify how this code change is expected to affect performance (or justification should be self-evident).
Checklist to comply with before moving PR from draft:
PR completeness and readability

[ ] I have reviewed my changes thoroughly before submitting this pull request.
[ ] I have commented my code, particularly in hard-to-understand areas.
[ ] I have updated the documentation to reflect the changes or created a separate PR with update and provided its number in the description, if necessary.
[ ] Git commit message contains an appropriate signed-off-by string (see CONTRIBUTING.md for details).
[ ] I have added a respective label(s) to PR if I have a permission for that.
[ ] I have resolved any merge conflicts that might occur with the base branch.

Testing

[ ] I have run it locally and tested the changes extensively.
[ ] All CI jobs are green or I have provided justification why they aren't.
[ ] I have extended testing suite if new functionality was introduced in this PR.

Performance

[ ] I have measured performance for affected algorithms using scikit-learn_bench and provided at least summary table with measured data, if performance change is expected.
[ ] I have provided justification why performance has changed or why changes are not expected.
[ ] I have provided justification why quality metrics have changed or why changes are not expected.
[ ] I have extended benchmarking suite and provided corresponding scikit-learn_bench PR if new measurable functionality was introduced in this PR.

/intelci: run

There are significant issues with private CI for certain algos here that need to be addressed.

/intelci: run

/intelci: run

/intelci: run

authors: ahuber21 ethanglaser samir-nasibli


text:
feat: Add member and channel permissions calculation functions

About
This pull request adds functions to calculate base permissions for a member, as well as calculate the member's permissions in a given channel, using permissions overwrites.
Checklist

[ ] I've ran pre-commit to format and lint the change(s) made.
[ ] I've checked to make sure the change(s) work on 3.8.6 and higher.
[ ] This fixes/solves an Issue.

(If existent):

I've made this pull request for/as: (check all that apply)

[ ] Documentation
[ ] Breaking change
[ ] New feature/enhancement
[ ] Bugfix

Since 4.3.0 has been released, I will mark this PR as ready to check.

repo: interactions-py/library


text:
Hosting cellxgene_VIP with Heroku

Hi,
Thanks for the nice work, which makes it much easier to visualize the result with so many flexible functions.
I've hosted the cellxgene result successfully with Heroku, but I don't know what to do with your plugin version. What should be modified in the Dockerfile mentioned in cellxgene github?
I've tried to replace pip3 install cellxgene with git clone, but it does not work though...
FROM ubuntu:bionic

ENV LC_ALL=C.UTF-8
ENV LANG=C.UTF-8

RUN apt-get update && \
    apt-get install -y build-essential libxml2-dev python3-dev python3-pip zlib1g-dev python3-requests python3-aiohttp && \
    python3 -m pip install --upgrade pip && \
    # pip3 install cellxgene
    apt-get install -y git &&\
    git clone https://github.com/interactivereport/cellxgene_VIP.git

Forgive me if this question is not so directly to your package development.
Thank you.

Could you please follow the installation instruction?
https://github.com/interactivereport/cellxgene_VIP#installation-instruction
You need to run "config.sh" to generate and copy files needed by cellxgene_VIP.

authors: interactivereport phoebee-h


text:
List third-party components

cell architecture is great and very simple to use, but maybe it's a bit low level. It makes easy to be modular, so what about adding a list of already known cell-based components like the traditional ScroolView and similar ones, so others can go and use them directly of the selves instead of need to craft them from scratch using HTML? Or maybe propose that cell-based components use the cell-* prefix on npm, or maybe do both things (list and prefix)?

google material design components +1

@spyhole You could probably do something like this pretty easily using Cell and Material Design Lite (https://getmdl.io/).

@Caffeinix yeah, i mean the "mdl" has been merged in to "mdc" (https://github.com/material-components/material-components-web) by Google in https://material.io/

closing with https://github.com/intercellular/cell/issues/130

authors: Caffeinix gliechtenstein piranna spyhole

repo: intercellular/cell

license: mit


text:
Support single phase transfers in connectors

https://github.com/interledger/rafiki/issues/1016#issuecomment-1419081252

@wilsonianb can you add some more details here? Why could we do a single phase transfer if streamDestination === true?

:stuck_out_tongue_winking_eye:

https://github.com/interledger/rafiki/pull/730

:point_up_2: that PR gave us this :point_down:
https://github.com/interledger/rafiki/blob/a27c1ea4a382182cb6191684d8ebe87c2426129f/packages/backend/src/connector/core/middleware/balance.ts#L77-L92
If this is the streamDestination then we've already called the subsequent middleware (next) and are needlessly doing a two phase transfer.

authors: mkurapov sabineschaller wilsonianb

repo: interledger/rafiki


text:
add sbomasm as a tool for spdx and cyclonedx

closes https://github.com/interlynk-io/sbomasm/issues/115
This PR fixes 2 things
1. adds sbomasm as tool for following cases:

when sbom is edited for any subject, document, primary-component, component-name-version.

If subject is a document, following cases are possible:

provide tool(other tools except sbomasm) explicity

In this case, sbomasm tool is not provided. For example:

$ go run main.go edit  --subject document --tool 'trivy (0.56.1)'  --tool 'parlay (0.5.1)' --tool 'bomctl (v0.4.1)'  photon.spdx.json --output photon-default.spdx.json

provide tool explicity with sbomam for different version or same version

in this case, sbomasm is provided via --tool flag for different version

$ go run main.go edit  --subject document --tool 'trivy (0.56.1)'  --tool 'parlay (0.5.1)' --tool 'bomctl (v0.4.1)'  --tool 'sbomasm (v2.4.2)'  photon-default.spdx.json --output photon-default-newVersion.spdx.json

NOTE: The default version of  sbomasm is 0.1.9.

2. Fix duplicate for tools.
For example:
A sbom photon1.spdx.json containing these tools in it:
"creationInfo": {
"licenseListVersion": "3.19",
"creators": [
 "Tool: tern-b8e13d1780cd3a02204226bba3d0772d95da24a0",
 "Tool: trivy-0.56.1",
 "Tool: parlay-0.5.1",
 "Tool: bomctl-v0.4.1"
],
"created": "2023-01-12T22:06:03Z"
},

On executing this command: the photon2.spdx.json sbom comes up with duplicate tools:
$ sbomasm edit -a --subject document --tool 'trivy (0.56.1)'  --tool 'parlay (0.5.1)' --tool 'bomctl (v0.4.1)'  photon1.spdx.json --output photon2.spdx.json
 "creationInfo": {
  "licenseListVersion": "3.19",
  "creators": [
   "Tool: tern-b8e13d1780cd3a02204226bba3d0772d95da24a0",
   "Tool: trivy-0.56.1",
   "Tool: parlay-0.5.1",
   "Tool: bomctl-v0.4.1",
   "Tool: trivy-0.56.1",
   "Tool: parlay-0.5.1",
   "Tool: bomctl-v0.4.1"
  ],
  "created": "2023-01-12T22:06:03Z"
 },

This PR resolve the duplicate of tools for both cases missing as well as append.

Added e2e test:
Our Requirements:
1. We wanted to write a robust and automated test for the sbomasm edit command.

We wanted to:

go run main.go edit --missing --subject document --tool 'trivy (0.56.1)' --tool 'parlay (0.5.1)' --tool 'bomctl (v0.4.1)' photon-lite.spdx.json --output expected-output-lite.spdx.json

- Validate the generated output file (`photon-missing.spdx.json`). --> This file(actual result or actual file) will be generated during test execution.
- Compare the generated file against an expected result (`expected-output-lite.spdx.json`). --> we will provide this file(expected result or expected file).

2. We choose testscript test library

Why ?

It allows tests to run in an isolated temporary workspace ($WORK),
It provides simple and powerful commands like exec, exists, and cmp for script-based testing. cmp command ensures the generated file matches the expected result

3. Implementation

Using testscript, we created a directory structure and test script:

edit_test.go

Defined how the test environment is set up (Setup) :

Like copy the files which will be required to execute the command, say, photon-lite.spdx.json file is required when executing sbomasm edit command.
Similarly, copy the expected-output-lite.spdx.json, which will be later on used to compare the o/p of this file with actually obtained file after execution of sbomasm edit command.
The sbomasm command is mapped to cmd.Execute(): which will be used inside edit_test.txt script.

edit_test.txt

Defined the script to be run in the isolated workspace.:

Run the actual command(exec): sbomasm edit command.

exec sbomasm edit --missing --subject document --tool 'trivy (0.56.1)' --tool 'parlay (0.5.1)' --tool 'bomctl (v0.4.1)' photon-lite.spdx.json --output photon-missing.spdx.json

Validation:

The test passes if:
photon-missing.spdx.json is created successfully.
The generated file photon-missing.spdx.json matches expected-output-lite.spdx.json.

repo: interlynk-io/sbomasm


text:
Which licence to use?

We want a permissive licence for this app so that ideally people can just take and reuse and repackage. Our standard LGPL 2.1 is probably not appropriate.
Do you agree? Suggestions @sergiocontrino @yochannah?

revisiting this - the repo currently has GPL which is strongly copylefted (non-permissive). I think we should relicence to MIT or Apache for better permissiveness.

Okay, I just chatted with @sergiocontrino and he agrees it's okay to migrate to a more permissive licence. My understanding of software relicencing rules is that generally you should have permission from most or ideally all contributors.
Dear @julie-sullivan and @leoank, as the other contributors on this repo who aren't me - could you please confirm that you're okay with moving to Apache?

I'm okay with moving to Apache.

That is fine.

Thanks so much, both!

authors: julie-sullivan leoank yochannah


text:
RPOD define procedure for Orion approach to Gateway and docking

Create a fine-grained procedure for ES1 (references this comment).

Ideally would be a markdown file placed in proc/rpod. See proc/rpod/ES4.md for reference.

repo: intern-space-program/ksp


text:
Feature/v3 p2 stage iam cicd

Story/Ticket Reference ID from JIRA:
Link
Additional Comments:
p2-stage IAM setup for CICD
Checklist:

[x] Unit test completed?: (Y/N)
[x] Docs folder up to date?: (Y/N)
[x] Add if anything missed: (Y/N)

All checklists are okay.
This PR looks great - it's ready to merge! Please review and let's ship it. :)

Up


text:
Add drillthrough action to meters

example

by  single click

Done in 3.1.88

Works!

authors: Lena-Ev evshvarov gnibeda

repo: intersystems-community/DeepSeeWeb


text:
Added more suffix

I have added some more regex based on my recent scans, I usually encounter those suffixes.

Thank you for your contributions @Kr1shna4garwal!

repo: intigriti/misconfig-mapper


text:
How can i get Drag Source object in Dnd calendar?

Hi. I`m using this example http://intljusticemission.github.io/react-big-calendar/examples/index.html to work with Drag and Drop calendar.
I need to retrieve drag source. Can you help me with that?

Hi there, unfortunately I'm not really familiar with react dnd at this point the addon is contributed by others.

authors: jquense valedelobo

repo: intljusticemission/react-big-calendar


text:
Setup automated testing

Would be good to have travis-ci or circle ci run the test suite on pull requests and master after merges.

Apologies, I can't right now.

I'll see what I can do. Might make more sense to get this moved over to the Omniauth organization.

authors: andrew tmilewski

repo: intridea/omniauth-github


text:
include manually added params to the email access check

Currently the email_access_allowed? method specifies from an options['scopes'] that is set with the builder. The application that I am working on does not use that and instead passes the scopes in with the params - /auth/github?scopes=user,repo,etc
This means that email_access_allowed? always returns false.
My change allows email scopes from both sources.
I could use some help though because this causes 11 test failures. I am not sure how best to stub out @env, which makes me think there is a better way of getting at the url params than my method.

Actually, the best way to go about this is to use a "setup" method.
More information can be found here:

http://www.createdbypete.com/articles/dynamic-omniauth-provider-setup/
https://github.com/omniauth/omniauth/wiki/Setup-Phase

authors: mattbreeden tmilewski


text:
Picplz support

Any plans on adding Picplz support?

Since OmniAuth is going to be split into several gems, I'm going to go ahead and close this (OmniAuth itself won't have any strategies). I did add a strategy request section to this wiki page though and put Pizplz on there for you.

authors: fbjork mbleigh

repo: intridea/omniauth


text:
Update CODEOWNERS for inclusion

Description
Thanks for contributing this Pull Request. Make sure that you submit this Pull Request against the master branch of this repository, add a brief description, and tag the relevant issue(s) and PR(s) below.

Relevant Issues : (compulsory)
Relevant PRs : (optional)
Type of change :

[ ] New feature
[ ] Bug fix for existing feature
[ ] Code quality improvement
[ ] Addition or Improvement of tests
[ ] Addition or Improvement of documentation

@stationeros i think we can close this PR - changes seem redundant

This isn't redundant, it matters !

authors: namitad stationeros

repo: intuit/Trapheus


text:
Scenarios failing due to evaluation of 'karate-config.js' javascript function call failed: null

When running a project with multiple (upwards of 1000) scenarios and a few functions set in karate-config.js, including a cached login call using the karate.callSingle process, after around 80% or so of the tests are run, all scenarios start failing.
Tried reproducing the issue in an isolated environment/project, but I hit a wall while trying to do so. Tried (based on the original project):

almost 3 times the amount of scenarios and feature files;
callable scenarios that call JavaScript functions created in the karate-config.js file;
great amount of text printed per scenario;
with and without sleep timer between calls (to simulate the original's longer execution time);
tried using the same karate-config.js file;

I will keep trying to find a way to reproduce this issue and, depending on your and my managers' availability, we can try to work with you as consultant for this issue.

@Gokuroro sorry, promptly closing this. we need a way to replicate. try taking a heap dump and get others to look at it if needed. try the following:

set log level to WARN
if any file upload / download tests are present, remove them
there is a configure setting to printEnabled
don't use the logPrettyRequest and logPrettyResponse options
run with fewer parallel threads
if you know of any scenarios with huge response payloads, comment them out

@Gokuroro hey could it be that after 10 minutes your cached login actually expires ?

current log levels:

<logger name="com.intuit" level="DEBUG"/>;
<root level="info"> ... </root>;

no upload scenarios present;
grepping for printEnabled returns nothing;
grepping for logPretty returns nothing;
parallel set to 1 (if I understood correctly): Results results = Runner.parallel(getClass(), 1, "target/surefire-reports");;
karate-config.js is read correctly for most of the run. Also, tried with both OpenJDK8 and OracleJDK9;

As for the scenarios with huge response payloads, this looks like a pretty good hint, since there are multiple cases like this. I'll go through with some more tests and let you know if I can reproduce going forward.
As always, thanks a lot for the support.

@ptrthomas I have rolled this issue to my client's management so they may work with you as consultant if the need arrives. I was able to remove some tests to make the suite work, but that's not a good solution for the project and, as stated, I was not able to reproduce it in a controlled environment.
Given there is classified information in the tests I'm working on, the decision is on management on how to proceed going forward.

@Gokuroro ok. I would say it is unlikely to be a karate issue :) did you see my comment where my guess is your one-time auth expires after 5-10 minutes which explains the behavior you are seeing

@ptrthomas yes, I thought I had answered it, sorry about that. Our auth token does not have a (short) expiration time, with some of my experiences it working almost 24h after the login at least. Either way, the issue observed is evaluation of 'karate-config.js' javascript function call failed: null which seems to be during the karate-config.js file parsing stage.
I'll do some tests on the token expiration time just in case.

@Gokuroro are the karate tests packaged into a JAR file by any chance before you run the tests ?

This is possible. Does it have anything to do with the <packaging>jar</packaging> item in pom.xml? I was not the one who setup the karate environment for the project, so I'm more aware of creating tests with it than the setup.

@Gokuroro great, thanks for the update.
attention @celcius112 can you take a look at the changes in #833 are causing the stream to be null under load when in a JAR ? please help !

@ptrthomas it ran fine the first time locally, but did not work in the subsequent runs. I'm testing other packaging formats right now. war also failed and others (pom, maven-plugin) didn't even run. I'll look a bit more into it. :(
Worst case, I'll have to leave further contact to my managers, since I'll be leaving this project soon anyway.

@ptrthomas I'll take a look after my vacations 😅 🌴

@ptrthomas the changes in https://github.com/intuit/karate/pull/833 should not apply here since it is not released yet, am I right ?

@ptrthomas thank you guys very much for all the effort, but since we're on testing phase, we'll just split the CI jobs in 2 based on tags for now. As I mentioned previously, I'll be leaving the project and if this is an issue going forward for the team, they'll contact you guys with better directions.
@celcius112 this is happening in 0.9.5.RC1, if this information helps.

@celcius112 we did an RC release - but hey no worries, see you after your vacation !

Ah nice ! I did not see this RC.
@Gokuroro Is there a stacktrace somewhere ? I don't remember whether there's a more precise log when evaluating with Nashorn. And is it failing at a precise moment ? Like precisely after 10 minutes ? And last question (maybe 😛), are you running the tests in parallel ?

@ptrthomas ok thanks for the resources, i'll take a look

authors: Gokuroro celcius112 ptrthomas

repo: intuit/karate


text:
🛑 INU API is down

In 779efe1, INU API (https://api.inuappcenter.kr) was down:

HTTP code: 0
Response time: 0 ms

Resolved: INU API is back up in 88ec466 after 1 minute.

repo: inu-appcenter/cafeteria-status


text:
Not puppet 4 compatible

Wondering if there's a plan to fix this for Puppet 4.

If puppet 4 isn't shipping an own utility to check for faulty catalogues I
will definitely strive for puppet 4 compatibility. Give me some time to
check this out. I'm planning a little hackathon in the next 2 weeks and
hope to include this feature
Am 26.05.2015 08:13 schrieb "Alex Harvey" notifications@github.com:

Wondering if there's a plan to fix this for Puppet 4.
—
Reply to this email directly or view it on GitHub
https://github.com/invadersmustdie/puppet-catalog-test/issues/18.

As far as I can tell, Puppet Labs favours use of puppet-rspec to both compile and run tests on catalogs.  I personally see the tests on catalogs as a bit redundant if you do integration level tests with Beaker, so I see this project as still having value.

Added Puppet 4 compat on master branch. I would love to get some feedback if this fits your use-case

Released with version 0.4.0

repo: invadersmustdie/puppet-catalog-test


text:
Support RowTables

Closes #64
Note that we cannot call apply! on rowtables since the elements of the NamedTuple rows are immutable in this instance.
e.g. row = NamedTuple{(:a, :b)}(a=1, b=2)
Converting to-from a columntable defeats the purpose as it wouldn't be mutating the underlying table.

reminder to bump the project


text:
Add support for NULL elements in arrays

PostgreSQL arrays can have NULL elements, but this is not supported by the
current type conversion machinery of LibPQ.jl. This commit adds support for NULL
array elements, by changing the Julia element type for PostgreSQL arrays from
T to Union{T, Missing}. Though this is a breaking change, I think it is more
in line with the behavior of PostgreSQL arrays. It also fixes problems I
encounter when using queries that return arrays with NULL elements.
Since this is a big change, I am not 'fleshing out' this change with tests until
I get some feedback on whether this would be a welcome change.

I don't understand why these changes would affect the parsed type when the result should be an OffsetArray.

I don't think https://github.com/invenia/LibPQ.jl/pull/85/commits/0a37cca143288064328feac901baf2d54c70c4a1 is necessary

In https://github.com/invenia/LibPQ.jl/pull/85/commits/64bdc98f66f7b6d3dad9eb07e2b49dc18c9ad935 you need to make the arrays missing-inclusive after you reshape, or reshape will make a ReshapedArray.
Also you should go ahead and add a test or two for the behaviour with NULL. Thanks for this!

I have an idea:
If you set it up so you keep https://github.com/invenia/LibPQ.jl/commit/0a37cca143288064328feac901baf2d54c70c4a1#diff-0f5f2c643546fb8d14be2b38c08d84f9R328 but change the other method to:
function parse_numeric_array(eltype::Type{T}, str::AbstractString) where T
    eq_ind = findfirst(isequal('='), str)

    if eq_ind !== nothing
        offset_str = str[1:eq_ind-1]
        range_strs = split(str[1:eq_ind-1], ['[',']']; keepempty=false)
        ranges = map(range_strs) do range_str
            lower, upper = split(range_str, ':'; limit=2)
            return parse(Int, lower):parse(Int, upper)
        end
        arr = OffsetArray{T}(undef, ranges...)
        el_iter = eachmatch(r"[^\}\{,]+", str[eq_ind+1:end])
    else
        arr = Array{T}(undef, array_size(str)...)
        el_iter = eachmatch(r"[^\}\{,]+", str)
end

then you can have NULL support by default but add this for supporting arrays without nulls:
    @eval function Base.parse(::Type{AbstractArray{$jl_eltype}}, pqv::PQValue{$array_oid})
        parse_numeric_array($jl_eltype, string_view(pqv))
    end

Yeah, my intent with 0a37cca was to leave the door open for arrays without NULL elements. I don't quite understand your suggestion for parse_numeric_array (I think it may have been clipped), is it to just make array with the specified element type, and then try to assign missing to it regardless of whether the element type includes Missing? If so, that seems ok to me: if the element type is erroneously specified to not include Missing and there really are NULLs, then assigning the elements seems like as good of a place as any to throw an error.

Yep, that's exactly it

Tests finally passed. I squashed the commits and fixed up the commit message.

Looks like the DataFrames.jl no longer supports DataStreams (JuliaData/DataFrames.jl#1783)?

Also see JuliaData/DataFrames.jl/#1773

Yep, sorry I looked into it but apparently never hit send on my comment. I have a PR incoming that will just cap DataFrames until I have time to remove DataStreams here too. Once that's in we can retrigger CI (I expect tests to pass).

Sorry for the problem.
Is removing DataStreams.jl support a huge problem. If I understand the design trend that @quinnj implements correctly its support should not be continued in DataFrames.jl as it should not be needed.
But if it is essential to keep it we can move it to deprecated section for the time being and release a patch v0.18.1.
CC @quinnj , @nalimilan

A deprecation would be much appreciated! That would allow us to more easily identify cases where we need to replace DataStreams with Tables for use with DataFrames (in our internal packages, of which there are many). But it's not the end of the world, and we could cap DataFrames at 0.17.x for a time.

@quinnj - what do you think is best to do (maybe there is an easy way to move to Tables.jl so there is no need to add the deprecation). But if it is not simple I would revert it to deprecated (as we have many other major changes in 0.18 so it would be better if they are tested against in real world 😄).

I think if we need to make a change for all of our packages that do this we might as well switch them to using Tables.jl. We're really only ever using a simple Data.stream! call so it won't be too hard. Things can be upper-bounded for a short time (like a week or two).

OK - so I understand that for the time being we can wait with reverting the change in DataFrames.jl, but if you find that things are more nasty please let me know and I will make a patch release reverting them as deprecated.

Sure, thanks!

authors: bkamins galenlynch iamed2


text:
add missing closing div to frontpage.html

Closes #247

Build is failing due to pkg_resources.UnknownExtra: nbconvert 6.0.7 has no such extra feature 'execute'. Invenio-previewer has been fixed (pinned): https://github.com/inveniosoftware/invenio-previewer but it wasn't released.

authors: dfdan ppanero


text:
WIP deposit form: affiliations vocabulary

closes https://github.com/inveniosoftware/invenio-app-rdm/issues/919

not needed

repo: inveniosoftware/invenio-app-rdm


text:
Services: Communities: Add feature to require community based on config

closes: https://github.com/CERNDocumentServer/cds-rdm/issues/88

UI comment: could you make sure the background on the error message is uniform? otherwise it looks like a bug

Looks like there was some issue with my assets watch command, the UI looks fine after I created a new instance in a new virtual env.

Also, reopened https://github.com/inveniosoftware/invenio-app-rdm/pull/2846, as it was erroring out when you try to remove a community that has already been removed from another tab/window.

repo: inveniosoftware/invenio-rdm-records


text:
Duplicate releases

Latest release script seems to add a new release entry & commit every time the CI Job runs - even if the release already exists:

Dang I saw this with 8.9.0 and thought it was fixed but 8.9.1 was going to be the test, and it is/was. Not fixed. On it

authors: Salakar mikehardy

repo: invertase/firestore-ios-sdk-frameworks


text:
Android: Heads-up notification doesn't work despite having the right importance level

I'm trying to show a local notification using notifee. It works fine on iOS but on Android I can't create a local notification as a Heads-up notification.
Here is how I construct the notification:
const channelId = await notifee.createChannel({
    id: 'incoming_task',
    name: 'Incoming Task',
    importance: AndroidImportance.HIGH,
});

await notifee.displayNotification({
   title: 'Title',
   body: 'Body!',
   android: {
     channelId,
     importance: AndroidImportance.HIGH,
     visibility: AndroidVisibility.PUBLIC,
   },
});

@notifee/react-native: 5.4.1
Test device: OnePlus 9 Pro

It seems there was an issue on the phone. I can see the heads-up notifications now.

@hamidhadi thanks for reporting back and closing the issue

I'm experiencing the same issue on pixel 5a android 13 , the only way I get heads-up notification is when I go to app setting manually to enable pop-up notification on the set channel

@hamidhadi thanks for reporting back and closing the issue

I'm experiencing the same issue on pixel 5a android 13 , the only way I get heads-up notification is when I go to app setting manually to enable pop-up notification on the set channel

authors: FashMuyhee hamidhadi helenaford

repo: invertase/notifee


text:
[bug]: Max seed value is too low

Is there an existing issue for this?

[X] I have searched the existing issues

OS
Windows
GPU
cuda
VRAM
8GB
What happened?
There are plenty of prompts all over the internet with seeds much higher than what InvokeAI allows.
E.g., I tried this one:

112358132141

It was truncated to:

4294967295

Up-arrow icon next to the field is greyed out indicating limit is reached.
It seems, the issue appears with any sampler.
Screenshots

Additional context
No response
Contact Details
No response

Do we know whats the high end cap for seed values? If there is one.

looks like it's a 64-bit int: https://pytorch.org/docs/stable/generated/torch.manual_seed.html#torch.manual_seed
in decimal, that's 18,446,744,073,709,551,615
(Wolfram Alpha claims that's less than the number of possible states of Rubik's cube, which seems hard to believe!)

In AUTOMATIC1111, I've tried to detect it from trial end error. Here are my findings:

The field itself seems to be unlimited in size.
But it behaves differently depending on what you've input there

a regular int or a float are both treated as a float
if you put any character stopping it to be a number, it seems to be treated as a stricng, shich is hashed in some way.

The max raw seed value is 18446744073709519872, i.e. 2^64
HOWEVER, all the generations starting from 18446744073709517824 (2^64-2048) give almost the same result. As well as 2048 seeds before them (witrh another image), As well as 2048 before them..

This behavior doesn't seem to depend on a model being used.
And it also hints that floats are used even with provided int seeds.

So, with these findings:

I believe, the best solution would be replecate the same seed treatment as in A11's webui.
If you don't agree, you should at least raise the max value to 18446744073709519872.

So Typescript lets me know that  ...
Numeric literals with absolute values equal to 2^53 or greater are too large to be represented accurately as integers.
.. which means 9007199254740992 is the highest value I can set for the field.

The goal isn't to allow a user input anything, but to be able to re-generate other people's examples. So I guess, for now you should at least raise it to 9007199254740992 as a simple fix.
But in the future - yeah, I strongly believe generated images shouldn't be different depending on which UI you used to make them. So, yeah, the true solution is unfortunately "follow A11 since he sets the trend".

Also,

too large to be represented accurately as integers

Doesn't that mean you can also represent them as floats? A11 seems to do the same thing. It SHOWS a user whatever they have typed. But it USES these seeds as floats.

The goal isn't to allow a user input anything, but to be able to re-generate other people's examples. So I guess, for now you should at least raise it to 9007199254740992 as a simple fix.
But in the future - yeah, I strongly believe generated images shouldn't be different depending on which UI you used to make them. So, yeah, the true solution is unfortunately "follow A11 since he sets the trend".

The main difference in the results is because of how each implementation handles the attention system. As long as that is not standardized, they will all end up having different results. Maybe some day we'll have a library that is so state of the art that everyone uses that and we get some sort of standardization but I don't think that's happening any time soon. The seed value is the smallest concern in that regard.

I'd have to manually add a ton of checks to verify that the entire thing is a number
For now, as a simpler solution, you can:

Keep it a number in the UI
Raise the field max limit to 2^64 if possible, 9007199254740992 otherwise.
Under the hood (in Python), convert those ints into floats.

As long as that is not standardized, they will all end up having different results.
I understand that. But I believe it would be better if we at least try to minimize those differences.

The seed value is the smallest concern in that regard.
I get somewhat different results in A11's UI and yours. I get it, different implementations. But being unable to replice someone else's result AT ALL seems like a huuuge turn of to any other newcomers (and somewhat to me, tbh).

Numeric literals with absolute values equal to 2^53 or greater are too large to be represented accurately as integers.

Hypothetically you could use BigInt, but I have no idea whether the input widget and validation methods are written for that.

I strongly recommend promoting the seed to the largest integer the InvokeAI default latent generator algorithm can handle.  Unfortunately, InvokeAI uses a different latents generator algorithm than other stable diffusion implementations (such as the Replicate cogs which use a pytorch Generator seed:  https://github.com/replicate/cog-stable-diffusion/blob/38510524cf4f3dc679e5945ebb52feb40d52c1a9/predict.py#L106).  It would be great if these different latent generation algorithms were made pluggable within InvokeAI, such that artists migrating from other implementations could fully utilize InvokeAI.  Currently, the seeds are incompatible even if they are the have the same numeric scale (and using the "same" scheduler or CFG scale, and other parameters)

I'll add a pull request soon.  I have increased the UI seed max to 2^53 as per Javascript precision limitations.  I will test and see if seeds are usable to 2^63 via CLI invocation with the seeding changes I made to the pipeline.  I have been able to utilize 53-bit seeds originally used with the standard diffusers StableDiffusionPipeline, and obtained perceptually identical results in InvokeAI.  I have also adjusted the minimum CFG value allowable in the InvokeAI UI as well.

I opened this pull request which supports 53-bit seeds in the invokeai UI, and 63-bit (pytorch/numpy maximum) seeds via the invokeai CLI.
https://github.com/invoke-ai/InvokeAI/pull/2843

Numeric literals with absolute values equal to 2^53 or greater are too large to be represented accurately as integers.

Hypothetically you could use BigInt, but I have no idea whether the input widget and validation methods are written for that.

Unfortunately, using BigInt would forgo using the pytorch/numpy random number generator algorithm 63-bit limit:
https://pytorch.org/docs/stable/generated/torch.manual_seed.html
While it is possible to generate latents with larger seeds, it would prevent seed sharing between stable diffusion implementations that use the current tacitly agreed upon method.

I also noticed this problem of seed truncation and would like to reopen this issue if possible

authors: Lex-DRL blessedcoolant dfl keturn waffletower

repo: invoke-ai/InvokeAI


text:
🛑 Bitwage API (Sandbox) is down

In cec3198, Bitwage API (Sandbox) (https://api.sandbox.bitwage.com) was down:

HTTP code: 403
Response time: 362 ms

Resolved: Bitwage API (Sandbox) is back up in 2fb71c7 after 21 minutes.


text:
🛑 Bitwage API (Sandbox) is down

In bd0954b, Bitwage API (Sandbox) (https://api.sandbox.bitwage.com) was down:

HTTP code: 403
Response time: 118 ms

Resolved: Bitwage API (Sandbox) is back up in 102ab2b after 11 minutes.


text:
🛑 冬天的导航站 SVW2 is down

In dc8f0f9, 冬天的导航站 SVW2 (https://me.iamdt.cn/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: 冬天的导航站 SVW2 is back up in 8b93247 after 9 minutes.


text:
whois script performance

PHP-Whois version: current main version
PHP version: 5.5
Description
Checking availability query at low performance
How to reproduce
I debug the running time for the code below
if (Whois::create()->isDomainAvailable("google.com")) {
print "Bingo! Domain is available! :)";
}
I can see that this domain  query runs really slow , it will consume around 2-3 seconds per request.
Possible Solution
whois server query socket optimize
Additional context

Is default config using for .com zones?
CPU loaded at 100% per php-whois process?
How many seconds executing native CLI 'whois google.com'?

it seems that only .com whois server query load really slow

I can confirm this from AWS instances only.

Hmm.. I'll check it.
The IANA WHOIS Server: whois.verisign-grs.com
Very strange why centralnic is first

Confirm - I experience the same issue for .com and .net
Solution is to furce verisign-grs as a custom server.

Fixed - https://github.com/io-developer/php-whois/commit/4b034f022db1ec08bf544d97a804dfe4675c5175

authors: TimSparrow erichuang2015 io-developer liyo

repo: io-developer/php-whois


text:
Add documentation

Just a sketch here - please edit in place, add, delete, etc; just thinking out loud.
Commands to learn about what's in my environment
$ autover numpy scipy conda sed
numpy=1.12.1                   # /Users/cball/anaconda3/lib/python3.6/site-packages/numpy
scipy=0.19.0                   # /Users/cball/anaconda3/lib/python3.6/site-packages/scipy
sed=unknown                    # /usr/bin/sed

Add/edit my package's version info?
Run a command? Edit setup.py, __init__.py? Add a file?
$ autover ??? mypackage

Commands to learn about autover itself
$ autover --version
?
$ autover --help
?

I believe autover is finally ready to document. It is nice to have /examples/pkg_bundle and        /examples/pkg_depend to make things concrete.
There are now lots of ways of using autover so I'll just make some notes about how to integrate it into a project:

There are two short functions to copy into setup.py. They don't ever need changing: you only need to set the reponame in the function call to set the setup.py version.
You need .version to be included in the package. This can be done via setup.py or in the MANIFEST.
As with anything involving git archive support, you need need to set .gitattributes and track that file.
(Optional) You probably want to add .version to your .gitignore and probably version.py as well (unless you explicitly chose to embed it).

I think that summarizes setting things up to use autover. Actually using it (setting tags, auto-packaging and releasing etc) also requires docs but I'm not going to start that just yet.

authors: ceball jlstevens

repo: ioam/autover


text:
Indexed Tables when there is no explicit key dimension

I've opened this issue is to discuss a feature I am working on that I've already introduced in commit 156f6d5.
When working on Lancet, I discovered that if you have no meaningful key dimension to add to your Table, you have to introduce one yourself anyway (because Tables are NdElements and therefore related to NdMappings). This is awkward to do and could lead to different people using lots of inconsistent dimension names for the required 'pseudo' dimension: 'Row', 'Index', 'Unique Key', 'ID' etc. This seems like a problem that needs to be solved once at the Table level to keep things consistent.
It should always be possible to index your data out of a table so there is always some dimension to index by, whether you think of it that way or not. For instance, in Pandas, your dataframes always have an index and indexing by row in any system is indexing by a key dimension.
My solution is to rename the one key dimension from 'Default' to 'Index' and treat it a little differently if it is the only key dimension specified. An indexed table enforces that the key is simply the row index of that entry in the table. In addition, an indexed table (i.e if you don't change the key_dimensions) allows Table to have a more flexible constructor. Say I have a list of values, I can now put it in a table:
table = hv.Table(data=[0,10,20,30])

This is now a two-column table where 'Index' is the first column. You can now index your values by position, allowing you to treat Table elements as fancy lists:
>>> table[1]
10

Before, you would have had to decide yourself to index by row and then do something awkward like:
hv.Table(data=enumerate([0,10,20,30]), key_dimension=['arbitrary-dimension-name'])

The only downside I can see with this approach is that if you want to use a single key dimension called 'Index' then that dimension must have the semantics we impose (i.e the row index). I think this is less of a restriction than making it hard to use Tables when you don't have your own meaningful key dimension to assign!
Edit: Of course there are ways around this by introducing new parameters, e.g index_dimension_name but I would rather avoid complicating things! A class attribute could be ok if  people really want to use 'Index' as their key dimension name.
Note that I've implemented this in such a way that the old constructor works as before: the tests are passing after this commit was made and I didn't have to update the reference data.
I consider what I have committed as a working prototype and if you have any suggestions for improvement this is the right place to tell me what you think!

Before I forget, I should mention something I don't quite understand yet: in Python 3, I get an error in our python2sort utility function (python 2 compatible sorting) unless I first disable self._sorted, add the data, set sorted back to true and then resort.
I would rather avoid doing this if possible!

It sounds reasonable to me.  Why not call it "row" rather than "Index", if it is specifically required to have the semantics of a row number?

'Row' was my initial name but then I thought 'Index' might be nicer for consistency with the terminology used in pandas.
I am perfectly happy to change it but I would first like to know what other people's preferences are. @philippjfr Which one do you prefer?

Added commits 74ea93a and 185c8be. The new format now seems to be working nicely in Lancet!

In 626e87a I switched from the name 'Index' to the name 'Row'. It is shorter and it might be better to not get things confused with pandas anyway.

I'm going to close this issue unless I hear some feedback suggesting other improvements....

authors: jbednar jlstevens

repo: ioam/holoviews


text:
add show() method (analogous to matplotlib)

For workflows which don't involve Jupyter notebooks, it would be really nice to have a show() method, that opens a new GUI window (like matplotlib does) or browser tab (perhaps more appropriate for bokeh). The syntax could be something like this:
import holoviews as hv
my_curve = hv.Curve(my_data)
my_curve.show(backend="matplotlib", dest="window")
my_curve.show(backend="bokeh", dest="browser")

Unlikely to add it as a method on objects but I wouldn't be opposed to a top-level hv.show.

I think h.show() is reasonable for work at the interactive prompt (as suggested by @drs251 ) but I really don't want to see it used in other contexts (notebooks, bokeh server etc).

So I was looking at how to have a BokehRenderer.show(), and then found that BokehRenderer.app(obj, show=True) does the job for a single object. Before discovering BokehRenderer.app(), I had implemented something for my own use which would handle opening multiple tabs when passed a list of objects, and in each tab, I added a Bokeh button that says "Close tab", and when the last button is hit, the server application is stopped.  I could integrate this into the  BokehRenderer.app() implementation, but I wasn't sure if that method was used for anything else.

authors: Dr-Irv drs251 jlstevens philippjfr


text:
test to demonstrate #61

@ayushanand18 : I think you should have edit access to modify this branch on my fork to get the test passing.

@ayushanand18 : I think you should have edit access to modify this branch on my fork to get the test passing.

I think I have been granted rights on this repo and not the fork, so should I checkout with this PR?

Update. The tests will pass after #86 gets merged. The necessary fixes for this one are in that PR.
Attached: a screenshot from my local run.

repo: iobis/pyobis


text:
Hue Gruppezustand/ Zustand einzelne Lampen in Gruppe

Hallo,
mir ist folgendes Problem aufgefallen:
Wenn ich meine Gruppe Schlafzimmer (Schlafzimmer.on) ausschalte mit false, gehen die dazugehörigen Lampen aus. Wenn ich jetzt nun eine einzelne Lampe in dieser Gruppe Schlafzimmer einschalten will (bsp. Nachtischlampe), muss ich Nachtischlampe.on immer zweimal mit true betätigen, damit diese an geht. Dieses Verhalten ist bei allen Gruppen und Lampen

Wie schaltest du denn die Punkte? Und zeig mal das zugehörige Log am besten Loglevel debug. Kann/Sollte eigentlich nicht sein.

timeout
10
sec

hue.0.Philips_hue.Wohnbereich.command
FALSE

{"on":false,"transitiontime":0}

hue.0.Philips_hue.Essbereich.command
FALSE

{"on":false,"transitiontime":0}

hue.0.Philips_hue.Betonwand.command
FALSE

{"on":false,"transitiontime":0}

hue.0.Philips_hue.Flur.command
FALSE

{"on":false,"transitiontime":0}

hue.0.Philips_hue.Küche.command
FALSE

{"on":false,"transitiontime":0}

Wie schaltest du die Datenpunkte?

Hallo tut mir leid. Hab jetzt mal geupdated und jetzt scheint es zu funktionieren, Ich schalte meist mit dem datenpunkt command und json. Mir ist zuvor aufgefallen wenn ich beispielweise das haus verlasse und einen taster betätige der alle hue Lampen ausmacht All.command {"on":false,"transitiontime":80}, dass ich danach andere lampen/bzw. Gruppen immer zweimal betätigen musste mit xx.command  {"on":true.....usw}
jetzt nach dem Update oder vielleicht nach dem Neustart des Adapters scheint es zu funktionierne


text:
Adapter startet nicht.

From @matze1708 on November 26, 2017 10:50
Hallo,
der Adapter startet nicht und bringt Fehler ins log.
Forum Thread:
http://forum.iobroker.net/viewtopic.php?f=20&t=9270&p=99007#p99007
Fehler:
`node node_modules/iobroker.wifilight/wifilight.js --logs --force
/opt/iobroker/node_modules/soef/soef.js:1141
fns.adapter = fns.adapter(options);
^
TypeError: fns.adapter is not a function
at Object.exports.Adapter (/opt/iobroker/node_modules/soef/soef.js:1141:23)
at Object. (/opt/iobroker/node_modules/iobroker.wifilight/wifilight.js:20:20)
at Module._compile (module.js:570:32)
at Object.Module._extensions..js (module.js:579:10)
at Module.load (module.js:487:32)
at tryModuleLoad (module.js:446:12)
at Function.Module._load (module.js:438:3)
at Module.runMain (module.js:604:10)
at run (bootstrap_node.js:383:7)
at startup (bootstrap_node.js:149:9)`
LOG:

host.ioBroker-RasPi
2017-11-26 11:42:42.830
error
instance system.adapter.wifilight.0 terminated with code 1 ()

Caught
2017-11-26 11:42:42.830
error
by controller[0]: at startup (bootstrap_node.js:149:9)

Caught
2017-11-26 11:42:42.830
error
by controller[0]: at run (bootstrap_node.js:383:7)

Caught
2017-11-26 11:42:42.829
error
by controller[0]: at Module.runMain (module.js:604:10)

Caught
2017-11-26 11:42:42.829
error
by controller[0]: at Function.Module._load (module.js:438:3)

Caught
2017-11-26 11:42:42.829
error
by controller[0]: at tryModuleLoad (module.js:446:12)

Caught
2017-11-26 11:42:42.829
error
by controller[0]: at Module.load (module.js:487:32)

Caught
2017-11-26 11:42:42.829
error
by controller[0]: at Object.Module._extensions..js (module.js:579:10)

Caught
2017-11-26 11:42:42.828
error
by controller[0]: at Module._compile (module.js:570:32)

Caught
2017-11-26 11:42:42.828
error
by controller[0]: at Object. (/opt/iobroker/node_modules/iobroker.wifilight/wifilight.js:20:20)

Caught
2017-11-26 11:42:42.828
error
by controller[0]: at Object.exports.Adapter (/opt/iobroker/node_modules/soef/soef.js:1141:23)

Caught
2017-11-26 11:42:42.828
error
by controller[0]: TypeError: fns.adapter is not a function

Caught
2017-11-26 11:42:42.827
error
by controller[0]: ^

Caught
2017-11-26 11:42:42.827
error
by controller[0]: fns.adapter = fns.adapter(options);

Caught
2017-11-26 11:42:42.824
error
by controller[0]: /opt/iobroker/node_modules/soef/soef.js:1141

Copied from original issue: soef/ioBroker.wifilight#14

From @soef on December 13, 2017 20:32
Hallo, da muss bei dir noch eine altes soef Modul im Einsatz sein. Mache einmal ein Update des Wifilight Adapters, oder deinstalliere und installiere ihn neu. Oder du führst
npm install soef
im node_modules/iobroker.wifilight Verzeichnis.

From @soef on December 26, 2017 7:42
Die Lichterkette wird ja nicht per WLAN sondern per Infrarot gesteuert.  Funktioniert also mit diesem Adapter nicht. Du kannst aber den Broadlink oder Logitech Hub Adapter mit der entsprechenden Hardware verwenden und die Tasten der Fernbedienung anlernen.

From @matze1708 on December 20, 2017 13:31
Tatsächlich.... "sudo npm install soef" hat es gelöst.... zumindest ist er direkt mal grün.
Spricht der auch dieses magicHome?
https://www.amazon.de/Kontrolleur-Fernbedienung-Steuerung-Controller-RGBW/dp/B075KHJ871/ref=sr_1_1?ie=UTF8&qid=1513776608&sr=8-1&keywords=led+rgbw+controller
Vielen Dank für deine Hilfe.

From @matze1708 on December 26, 2017 11:39
Ich kann doch die lichtstreifen per wlan auch am iPhone steuern.

From @soef on December 26, 2017 15:38
Ups, hatte nur die IR Fernbedienung gesehen. Aber dann kann ich nicht sagen ob der Kontroller auch gesteuert werden kann.

From @matze1708 on December 26, 2017 15:43
Er findet ihn unter ak001-zj200

From @soef on December 26, 2017 15:48
Dann müsste es ja mit dem gemergeten Pull Request funktionieren, oder?

From @matze1708 on December 26, 2017 15:49
Leider nein.
Also starten tut er. Nur das device nicht einbinden

From @matze1708 on December 26, 2017 20:25
Jetzt bekomme ich diese Meldung
wifilight.0	2017-12-26 21:15:27.316	error	wrong device type. not yet supported!
wifilight.0	2017-12-26 21:15:27.314	error	Known types are: LW12, LD382A, LD382, UFO, MiLight, MiLightRGB, MiLightW
wifilight.0	2017-12-26 21:15:27.314	error	config.device.type (AK001-ZJ200) is not a known device type. Skipping this device!

From @soef on December 26, 2017 20:10
Ich habe nun noch ein paar Änderungen vorgenommen. Eigentlich ist die Geräte-Bezeichnung nur beim Ermitteln neuer Geräte notwendig. Wenn IP, Port und Geräte Typ richtig konfiguriert sind ist die Bezeichnung irrelevant.

From @soef on December 26, 2017 20:29
Der Geräte Type scheint leer zu sein. Es müsste LD382A sein. Schaue mal in die Spalte Type in der Konfiguration.

From @matze1708 on December 26, 2017 20:33
Jetzt klappt es!
Er hatte im auto discover den typ nicht gesetzt.
Daher ging es wahrscheinlich nicht.

From @soef on December 26, 2017 20:44
Eigentlich sollte der Typ erkannt werden. Kannst Du noch einmal die Instance deinstallieren und wieder neu installieren? Oder für einen Test eine zweite Instanz installieren und ein auto discover durchführen?


text:
Constant Warning Object Fachmann.Heizgerät is invalid

I have a brand new installation of IoBroker and the the Wolf-Smartset Adapter and i get almost every 2 seconds the following warning:
Object Fachmann.Heizgerät.Parameter_HG.419_Einstellungen.15007000001 is invalid: obj.common.min (5) needs to be less than or equal to obj.common.max (3) This will throw an error up from js-controller version 7.0.0!

The parameter 15007000001 is set according to standard. Is there something I can do?

Please add release version information to every problem reported:

version of adapter:
version of js-controller:
nodeJS version installed:
Operating system type / version:

Please attach a log of adapter start (until error occures) with Instance Loglevel set to DEBUG.
Min and Max values are retrieved from system. So most likely the system returns invalid or unusual data. Lets see wht debug log contains. The commuication data should be logged there.

In the meantime you could set log level to error to reduce size of log.

PlatformBetriebssystem:linux
Architektur:x64
CPUs:2
Geschwindigkeit:3247 MHz
Modell:Intel(R) N95
RAM:2 GB
System-Betriebszeit:03:04:44
Node.js:v20.18.1
time:1734279548154
timeOffset:-60
NPM:10.8.2
Adapter-Anzahl:549
Datenträgergröße:7.8 GB
Freier Festplattenspeicher:3.1 GB
Aktive Instanzen:19
Pfad:/opt/iobroker/
Here is the log of the adapter start:

2024-12-15 17:22:57.484 - info: host.iobroker "system.adapter.wolf-smartset.0" enabled
--
2024-12-15 17:22:57.666 - info: host.iobroker instance system.adapter.wolf-smartset.0 in version "1.2.3" started with pid 1021
2024-12-15 17:22:58.359 - info: wolf-smartset.0 (1021) starting. Version 1.2.3 in /opt/iobroker/node_modules/iobroker.wolf-smartset, node: v20.18.1, js-controller: 7.0.3
2024-12-15 17:22:58.670 - info: wolf-smartset.0 (1021) Initialization with Login and new Session done!
2024-12-15 17:22:59.222 - info: javascript.0 (368) script.js.common.Wolf_Betriebsart: Wolf Betriebsart ändert: 10
2024-12-15 17:23:01.353 - warn: wolf-smartset.0 (1021) Object Fachmann.Heizgerät.Parameter_HG.419_Einstellungen.15007000001 is invalid: obj.common.min (5) needs to be less than or equal to obj.common.max (3) This will throw an error up from js-controller version 7.0.0!
2024-12-15 17:23:03.073 - info: javascript.0 (368) script.js.common.Wolf_Betriebsart: Wolf Betriebsart ändert: 10

Thanks for the feedback. But this log ist NOT a log with level DEBUG.
Please go to instances and select DEBUG log level to create the log.
-) activate EXPERT MODE

-) open instance area (picture shwoes backuitp but you should use wolf-smartset of course) and select DEBUG at loglevel

2024-12-15 200533.990 - info host.i.txt
Ok Log as a Textfile.

The Api seems to retun invalid data:
2024-12-15 20:05:35.334 - debug: wolf-smartset.0 (1290) API GET GUI DESC.: ...
{"ValueId":15007000001,"SortId":4602,"SubBundleId":0,"ParameterId":15007000001,"IsReadOnly":false,"NoDataPoint":false,"IsExpertProtectable":false,"Name":"Hysterese Heizung (zu WP010)","NamePrefix":"WP011","Group":"419_Einstellungen","ControlType":6,"ValueState":0,"HasDependentParameter":false,"Unit":"K","MinValueCondition":"0.5","MaxValueCondition":"3","MinValue":5,"MaxValue":3,"StepWidth":0.1,"Decimals":1},
Please check whether this can be configured at the external system. Most likely the min value should read 0.5.
This error should be fixed at manufacturer firmware / parameter table.
We can evaluate wether it makes sense to implement some "override" at adapter code - but the base error is not located at the adapter code or to ignore invalid paramater data - but thats both no on the fly decision.

fixed with 1.2.4

Thank you, works perfectly!

please retest with 1.2.4


text:
docs: Add Updating to Capacitor 7 page

preview: https://capacitor-docs-git-rdmr-445-ionic1.vercel.app/docs/next/updating/7-0

@jcesarmobile did we want to include anything about the edge to edge stuff for Android? There was a way to opt out of that I think that's come up in a few ways that we had talked about adding to the upgrade guide.

We have not changed Capacitor's Android template to disable edge to edge, so I would say no, unless we want to disable edge to edge in Capacitor's Android template.

authors: dallastjames jcesarmobile

repo: ionic-team/capacitor-docs


text:
Web worker importScripts violates CSP

Hi,
I've been using v2.5.1 of this plugin until this week when I upgraded to 4.2.0 and then 4.2.1. However, my app's web workers are no longer working because the CSP is violated everywhere I use importScripts since I switched to 4.x.x. This does not happen when I revert to 2.5.1. This is what the error looks like:

Refused to load the script 'http://localhost:8080/js/proxy.min.js' because it violates the following Content Security Policy directive: "script-src 'self' https://*.stripe.com https://*.pushwoosh.com https://*.googleapis.com 'unsafe-inline'
'unsafe-eval' https://cdnjs.cloudflare.com/ajax/libs/rollbar.js/2.14.4/rollbar.min.js https://*.linkpreview.net
http://*.linkpreview.net https://cdnjs.cloudflare.com/ajax/libs/rollbar.js/2.13.0/rollbar.min.js https://ipinfo.io https://*.algolianet.com https://*.algolia.net".

On v2.5.1 of this plugin I don't get this error and the workers work as expected. This is happening on Android, haven't confirmed on ios. I also use the comlink library to manage the workers.
Cordova: latest (9.x)
Cordova-android: latest from master branch of the cordova-android repo

can you provide a sample app?

Not yet, just haven't had the time.

Not yet, just haven't had the time.

Okay I have a sample reproduction you can use to see the problem.
Check this CI run. There are 2 artifacts for the 2 versions of this plugin, and you can test the problem by running testWorker('test value') in the dev tools console. With the build containing version 2.5.1 of this plugin, the command will log value from worker: test value in the console i.e. the web worker is working correctly without any CSP problems. But with the build containing version 4.2.1 of this plugin, you will get this error message:

Refused to load the script 'http://localhost:8080/js/proxy.min.js' because it violates the following Content Security Policy directive: "script-src 'self' 'unsafe-inline' 'unsafe-eval'".

At least this is what I get on my end, and that's the same problem happening in the real app. To be clear, the problem isn't with proxy.min.js. It throws the error on the first file that I try to import with importScripts, whether it's proxy.min.js or anything else.

Have seen and trying to look at a similar issue.

Ping :raising_hand_man: .

@jcesarmobile think this would help? https://github.com/GoogleChromeLabs/worker-plugin/issues/36

looks like you have made changes in the sample app recently and running testWorker('test value') doesn't work, so can't properly reproduce, can you fix the sample app?

@jcesarmobile sorry I thought I had updated this issue. The problem was that I was using hard-coded paths to the imported scripts, so on version 2.x of the plugin where WKPort is still available, my paths always ended with :8080. Version 4.x removed the port from the default URL, so the hard-coded paths became incorrect. I will create an issue about updating the migration guide from 2.x to 4.x to include the removal of the WKPort option.

Please see #581, thanks.

authors: CodeWithOz Mapiac Textras jcesarmobile

repo: ionic-team/cordova-plugin-ionic-webview


text:
iOS Simulator reopens for every ionic cordova run command

Ionic version:  (check one with "x")
[ ] 2.x
[X] 3.x
[ ] 4.x
I'm submitting a ...  (check one with "x")
[X] bug report
[ ] feature request
Current behavior:
When running ionic cordova run ios the simulator opens and loads the app, if I stop the process and then run it again, after build the simulator closes and opens.
Expected behavior:
I'm not sure in which ionic version started happening but before it never closed the simulator and reopened it when targeting the same iOS version and simulator device; it just closed the app and loaded the new one.
Steps to reproduce:
Run the following commands:

ionic cordova run ios -lc --target=iPhone-X
Wait for the app to build and run in the simulator
cmd-c
ionic cordova run ios -lc --target=iPhone-X
Wait again for the app to build and then you'll see it close the simulator and open it again

(The target param is just to make sure the run command opens the same simulator device)
Related code:
Starter template shows this behavior
Other information:
macOS High Sierra 10.13.1
Ionic info: (run ionic info from a terminal/cmd prompt and paste output below):
cli packages: (/usr/local/lib/node_modules)

    @ionic/cli-plugin-proxy : 1.5.4
    @ionic/cli-utils        : 1.17.0
    ionic (Ionic CLI)       : 3.17.0

global packages:

    cordova (Cordova CLI) : 7.1.0

local packages:

    @ionic/app-scripts : 3.1.0
    Cordova Platforms  : android 6.3.0 ios 4.5.2
    Ionic Framework    : ionic-angular 3.9.2

System:

    Android SDK Tools : 25.2.5
    ios-deploy        : 1.9.2
    ios-sim           : 6.1.2
    Node              : v6.11.4
    npm               : 3.10.10
    OS                : macOS High Sierra
    Xcode             : Xcode 9.1 Build version 9B55

Environment Variables:

    ANDROID_HOME     : /usr/local/Cellar/android-sdk/24.4.1_1
    HTTP_PROXY       : not set
    http_proxy       : not set
    HTTPS_PROXY      : not set
    https_proxy      : not set
    IONIC_HTTP_PROXY : not set
    PROXY            : not set
    proxy            : not set

Misc:

    backend : legacy

Hello! Thank you for opening an issue with us!
This issue seems more like an Ionic CLI issue than an Ionic Framework issue. I will move it to that repo for you. Please follow up using the newly created issue.
Thank you for using Ionic

This issue was moved to ionic-team/ionic-cli#2869

authors: eduardoRoth kensodemann

repo: ionic-team/ionic