text:
fix deployment

I'm afraid I'm out of my depth here, this came up in the deployment server with:
building all machine configurations...
trace: [alex-plan-to-nix-pkgs] cabal new-configure --with-ghc=ghc --with-ghc-pkg=ghc-pkg
trace: [happy-plan-to-nix-pkgs] cabal new-configure --with-ghc=ghc --with-ghc-pkg=ghc-pkg
trace: [hscolour-plan-to-nix-pkgs] cabal new-configure --with-ghc=ghc --with-ghc-pkg=ghc-pkg
trace: To materialize, point `materialized` to a copy of /nix/store/q09xn5njhi80cb4fjb2x59i0vmgxlnzh-stack-to-nix-pkgs
building '/nix/store/17djfqkhw7rm69pc8xyya01pnd9my8vv-stack-to-nix-pkgs.drv'...
substituteStream(): WARNING: pattern '/nix/store/y28jgvngfk5v0b2mnzixnxbklywqsyla-plutus' doesn't match anything in file '/nix/store/q09xn5njhi80cb4fjb2x59i0vmgxlnzh-stack-to-nix-pkgs/pkgs.nix'
substituteStream(): WARNING: pattern '/nix/store/y28jgvngfk5v0b2mnzixnxbklywqsyla-plutus' doesn't match anything in file '/nix/store/q09xn5njhi80cb4fjb2x59i0vmgxlnzh-stack-to-nix-pkgs/default.nix'
hash mismatch in fixed-output derivation '/nix/store/kmj7hkmhpmb84129w05kkincnwm2b0dq-stack-to-nix-pkgs':
  wanted: sha256:1jzlddl4hrgc2qypwma2rn86anya1kakkdxffrh20gmy3b7azd55
  got:    sha256:1k75ivlwjkcmgi7cm1vfdh2fl9h4n9vl5sl04f8gpplf6gkb0akx
error: build of '/nix/store/17djfqkhw7rm69pc8xyya01pnd9my8vv-stack-to-nix-pkgs.drv' failed
(use '--show-trace' to show detailed location information)
Traceback (most recent call last):
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/bin/..nixops-wrapped-wrapped\", line 990, in <module>
    args.op()
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/bin/..nixops-wrapped-wrapped\", line 411, in op_deploy
    max_concurrent_activate=args.max_concurrent_activate)
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/lib/python2.7/site-packages/nixops/deployment.py\", line 1056, in deploy
    self.run_with_notify('deploy', lambda: self._deploy(**kwargs))
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/lib/python2.7/site-packages/nixops/deployment.py\", line 1045, in run_with_notify
    f()
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/lib/python2.7/site-packages/nixops/deployment.py\", line 1056, in <lambda>
    self.run_with_notify('deploy', lambda: self._deploy(**kwargs))
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/lib/python2.7/site-packages/nixops/deployment.py\", line 996, in _deploy
    self.configs_path = self.build_configs(dry_run=dry_run, repair=repair, include=include, exclude=exclude)
  File \"/nix/store/hwcnfx27ym6fgfqdxs68ac1d7ckgla9m-nixops-1.6.1/lib/python2.7/site-packages/nixops/deployment.py\", line 664, in build_configs
    raise Exception(\"unable to build all machine configurations\")
Exception: unable to build all machine configurations

I can reproduce this failure by deploying manually from origin/master and with the change I can deploy manually successfully from origin/fix-build however the hercules build are failing but I don't understand why.

lol@ A technical error occurred: CppOtherException (Just "nix::SysError")

Yeah, the hercules builders need to be redeployed, and until then things randomly fail...

repo: input-output-hk/plutus


text:
plutus-tx: add a basic tutorial

This adds a basic tutorial on PlutusTx. It's focussed on just the PlutusTx bit, so nothing about how to actually write contracts, just how to use the plugin and the TH stuff.
I've used markdown-unlits and doctest to extract the Haskell from the tutorial and compile and doctest it,  thus ensuring that it actually works and continues working!
In the process I noticed a number of things that were not good, some of which I have fixed and others of which have TODOs.
Other fixes:

I didn't realise this, but https://github.com/input-output-hk/plutus/pull/326 changes the shape of the generated expression so we can't recognize it unless GHC does some simplification first! This is very bad, so I went back to the old way, although it means unsafeTExpCoerce gets a little further out of its box.
It's nicer to explicitly import Language.PlutusTx.Builtins rather than re-exporting it from Language.PlutusTx.TH. There is a separate issue which is whether the plutus-tx package should provide these modules (at the moment you have to get them from plutus-tx-plugin), but that's for later.

@disassembler this required a bit of fiddling, I opened https://iohk.myjetbrains.com/youtrack/issue/DEVOPS-1147 about it.

source: gharchive/pull-request

license_type: permissive

license_source: github-api


text:
Sums-of-products mk II

Don't look here yet.

/benchmark plutus-benchmark:validation

:boom: :facepalm: :sob:

/benchmark plutus-benchmark:nofib

/benchmark plutus-benchmark:validation

/benchmark plutus-benchmark:validation

applyEvaluate wasn't getting inlined now because it appears multiple times. I added an INLINE pragma. That took us a bit closer, but not the whole way there, and I don't know why :thinking:

/benchmark plutus-benchmark:validation

The Core now looks identical apart from new stuff :|

/benchmark plutus-benchmark:validation


text:
1.0.0-alpha.0

This PR bumps the version to 1.0.0-alpha.0.

@VirginiaBalseiro if you rebase or recreate this (due to the tag) then you'll get the undici update that I've just merged, which fixes audit

authors: ThisIsMissEm VirginiaBalseiro

repo: inrupt/universal-fetch

license: MIT


text:
gcalcli 4.0.0 GA release?

Hello,
I didn't find any Mailing List or irc for this project so I'm going to ask it here.
If I understood correctly, releases "4.0.0a4", "4.0.0a3" and so on are Alpha versions. Alpine Linux current package version 3.4.0 and I would like to upgrade to the new version but for that I needed to know if there is any plan/date to release the GA version?

Hi there,
I'm relatively new on this project so I'm also unclear as to what the plan is for the next release.
I've been very focused on code quality and testing.  Perhaps one of the original authors can update this thread with respect to release plans.

My plan for 4.0.0 was to get rid of the gflags dependency and try to make everything else work as expected using the latest google libraries.

@tresni Thanks for the answer. Is there any ETA for the 4.0.0 GA?

Not sure what GA stands for.
I'll try to make an inventory of what we need to do specifically to update the google dependencies.  We have the gflags removed in master, but in my opinion, it needs more testing before we should release it.  I think it's hard to give ETAs on this type of project because the work is done by volunteers in their spare time.
At the very least we should probably push another alpha release sometime soon.

GA mean General Availability. Marketing speak for a "release".  :-)

I'm happy to adopt @tresni's answer.  We've done part 1, removed the gflags and moved to argparse.  The part 2 is indicated in #353.  I know we also have some milestones set up with some tickets attached to them.  I'll take a look at the milestones and try to get things organized around 4.0.0 (we should fix the regression/bug tickets as well, i guess).  After I update the milestone, I'll close this issue.

I understand the desire to fix up oauthclient stuff, but seeing as it's now deprecated it might be worth tagging a new release - The last release was almost three years ago! :)

source: gharchive/issue

authors: ainola insanum jcrowgey rgdoliveira tresni

repo: insanum/gcalcli


text:
Crash when switching to privacy mode

It looks like I've got a corrupt privacy mode image on my device and it crashes as soon as I short-press unpair to switch to privacy mode:
NodeMCU ESP32 build unspecified powered by Lua 5.1.4 on SDK IDF
Short press on unpair
> waitUntilIdle...
Wait complete!
Powered on
ERROR:  panel.lua:136: bad argument #2 to 'spidevice_transfer' (string or table expected)
stack traceback:
        [C]: in function 'spidevice_transfer'
        panel.lua:136: in function 'displayLines'
        main.lua:672: in function 'displayFn'
        main.lua:501: in function 'initAndDisplay'
        main.lua:679: in function 'showFile'
        main.lua:66: in function 'shortPressUnpair'
        main.lua:19: in function <main.lua:14>

As far as i'm aware, the image on the server is a valid one. I'll reset the device and see if that fixes it with the current image I've got set.

@tomsci says it's fixed! 🎉

repo: inseven/statuspanel


text:
Can't find isaacgym module

Hello,
When I try to run train.py, the following message appears:
Traceback (most recent call last):
File "train.py", line 33, in
import isaacgym
ModuleNotFoundError: No module named 'isaacgym'
But the thing is, IsaacGym is installed and works on my computer, I can run IsaacGymEnvs without problem. Thanks a lot for any help.

Hello,
please make sure you have installed isaacgym in the same conda env with timechamber.
If the problem still exists, could you give me a screenshot of you conda env list?

Hello, by "isaacgym" I assume you mean the folder isaacgym/Python/isaacgym, right? If the top folder in the isaacgym tar is copied straight to site-packages, there are error messages about not finding the python files.
Anyway, I did that. Then there were error messages about not finding ninja and scipy, so I installed them, and the error message AttributeError: module 'numpy' has no attribute 'float'. Solved by installing numpy==1.22.4.
After that, it works! It's a very cool repo, thanks for sharing it!

authors: ZiyiLiubird karlengblom

repo: inspirai/TimeChamber


text:
Improve earliest date handling

Currently the earliest_date uses the legacy_creation_date: https://github.com/inspirehep/inspirehep/blob/69f4ceeff84c2284b0b3f6b64c7c898301caadda/backend/inspirehep/records/utils.py#L27-L54. That date is not really part of the paper metadata, but an "accidental" property of the INSPIRE record (aka metametadata). We should not consider that field for the calculation of the earliest_data, and instead use the record creation date as a fallback if no other date can be found inside the record (created attribute instead of legacy_creation_date which won't be there for labs-native records).

It seems that currently we use legacy_creation_date for created attribute too (if it is available) https://github.com/inspirehep/inspirehep/blob/69f4ceeff84c2284b0b3f6b64c7c898301caadda/backend/inspirehep/records/api/base.py#L397

It seems that currently we use legacy_creation_date for created attribute too (if it is available) https://github.com/inspirehep/inspirehep/blob/69f4ceeff84c2284b0b3f6b64c7c898301caadda/backend/inspirehep/records/api/base.py#L397

That's ok, as long as we use the created date (either on labs or legacy, so created field thanks to this) as a fallback.

That's ok, as long as we use the created date (either on labs or legacy, so created field thanks to this) as a fallback.

3. In `LiteratureDetailSchema` instead of using the [method to retrieve the earliest date](https://github.com/inspirehep/inspirehep/blob/bf8fc166e01119590a3f56937b05014583592764/backend/inspirehep/records/marshmallow/literature/ui.py#L88) use `fields.Field(attribute='earliest_date')`

This wont' be possible, as data in there might not be an LiteratureRecord object, but just simple dictionary. Additionally this method returns "prettified" date like: "Sep 15, 2020" which is different form what earliest_date property returns.

3. In `LiteratureDetailSchema` instead of using the [method to retrieve the earliest date](https://github.com/inspirehep/inspirehep/blob/bf8fc166e01119590a3f56937b05014583592764/backend/inspirehep/records/marshmallow/literature/ui.py#L88) use `fields.Field(attribute='earliest_date')`

This wont' be possible, as data in there might not be an LiteratureRecord object, but just simple dictionary. Additionally this method returns "prettified" date like: "Sep 15, 2020" which is different form what earliest_date property returns.

wouldn't also the citation count stuff fail in that case? when is the thing passed to the schema a dict and not a LitetatureRecord?

wouldn't also the citation count stuff fail in that case? when is the thing passed to the schema a dict and not a LitetatureRecord?

In this schema we do not serialize citations.
Almost all tests for this schema is passing only a dictionary.  In principal we should pass there only LiteratureRecord object, but as I remember from the past we had issues with this that sometimes object was stripped from data :/ In my implementation I will assume that there is LiteratureRecord object but I will do simple fallback if we pass a dictionary.

In this schema we do not serialize citations.
Almost all tests for this schema is passing only a dictionary.  In principal we should pass there only LiteratureRecord object, but as I remember from the past we had issues with this that sometimes object was stripped from data :/ In my implementation I will assume that there is LiteratureRecord object but I will do simple fallback if we pass a dictionary.

authors: MJedr michamos pazembrz

repo: inspirehep/inspirehep


text:
Instaloader downloads older highlights then in latest-stamps

Describe the bug
I'm using instaloader with --latest-stamps parameter, so I downloaded a profile with everything (posts, stories, highlights, igtvs), cleaned up photos/videos from the disk, and re-run instaloader with the same parameters, but it started to download photos/videos from highlights dated 2021, while in latest-timestamps.ini latest synchronized for this profile May 2022
To Reproduce
Steps to reproduce the behavior:
instaloader user_profile --login=my_login --password=my_pass --stories --highlights --tagged --igtv --no-metadata-json --no-profile-pic --no-captions --no-video-thumbnails --latest-stamps --dirname-pattern "D:\test"
Expected behavior
As stated in documentation, I should be able remove some old posts and instaloader should download it again with --latest-stamps option
Instaloader version
4.9.2

Your description is mixing things. The title says stories have a problem, the description talks about highlights. These are slightly different things.
Refering to the manual https://instaloader.github.io/cli-options.html?highlight=latest stamps#cmdoption-latest-stamps

Only works for media associated with a specific profile, and that is returned in chronological order: profile posts, profile stories, profile IGTV posts and profile tagged posts.

Sorry, that was a typo, fixed the title

Tested downloading of some small profile to a separate folder and here are my findings:
If --dirname-pattern parameter is specified, then regardless of using --fast-update or --latest-stamps params all media is downloaded to the specified directory and only one subdirectory called the same as a username you are downloading will be created within target directory and will contain covers for each highlights "folder"
If --dirname-pattern parameter isn't specified, then folders created for each highlights as in user's instagram profile. Works the same with --fast-update or --latest-stamps params.
So the reason issue happened - I downloaded user profiles to some main folder and later when decided to rename each user's folder to firstname_lastname and specify --dirname-pattern - old media that I cleaned up started to download to the "root" folder, as mentioned in the first behavior of this comment.
So ideally use one approach to the folder structure, with highlights folders or without. Easier to implement - without. But with folders, it's easier to browse contents.
Also with highlights folders if say a story was downloaded it will be stored in the user's folder and if later this story is added by a user to highlights, it will be stored in the appropriate highlights folder, so we'll end up with duplicates. Also if one story is added to different highlights and we use highlights folders (i.e. don't specify --dirname-pattern param) - the same media will be duplicated in different highlights folders.
So as a fix I can propose to add a check to go through all files in the target folder and try to find a media in the highlights subfolder and skip it if it already exists and don't download to the root folder when moving from one folder or all downloaded profiles to per person by specifying --dirname-pattern param.
The best solution would be to keep the highlights folder structure and use symlinks, to not waste disk space, so 1 media can show up in the root folder and different highlight folders and if a user deletes a media it will be removed everywhere

Hi,
I've also noticed that --latest-stamps doesn't work for highlights. Is there any workaround for this?
It would be cool if instaloader would save the timestamp of the latest highlight, and then discard any previous file (I mean, so files are not saved, even if they must be downloaded someway).
Thanks.

authors: Karmac SergeySypalo Showmaster3000

repo: instaloader/instaloader


text:
KeyError: 'edge_sidecar_to_children'

Describe the bug
Traceback (most recent call last):
  File "/usr/local/bin/instaloader", line 11, in <module>
    load_entry_point('instaloader==4.2.8', 'console_scripts', 'instaloader')()
  File "/usr/local/lib/python3.6/site-packages/instaloader/__main__.py", line 410, in main
    storyitem_filter_str=args.storyitem_filter)
  File "/usr/local/lib/python3.6/site-packages/instaloader/__main__.py", line 186, in _main
    download_stories, fast_update, post_filter, storyitem_filter)
  File "/usr/local/lib/python3.6/site-packages/instaloader/instaloader.py", line 1017, in download_profiles
    downloaded = self.download_post(post, target=profile_name)
  File "/usr/local/lib/python3.6/site-packages/instaloader/instaloader.py", line 462, in download_post
    for sidecar_node in post.get_sidecar_nodes():
  File "/usr/local/lib/python3.6/site-packages/instaloader/structures.py", line 226, in get_sidecar_nodes
    for edge in self._field('edge_sidecar_to_children', 'edges'):
  File "/usr/local/lib/python3.6/site-packages/instaloader/structures.py", line 159, in _field
    d = self._full_metadata
  File "/usr/local/lib/python3.6/site-packages/instaloader/structures.py", line 142, in _full_metadata
    self._obtain_metadata()
  File "/usr/local/lib/python3.6/site-packages/instaloader/structures.py", line 134, in _obtain_metadata
    self._full_metadata_dict = pic_json['entry_data']['PostPage'][0]['graphql']['shortcode_media']
KeyError: 'graphql'
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/instaloader/structures.py", line 156, in _field
    d = d[key]
KeyError: 'edge_sidecar_to_children'

To Reproduce
Steps to reproduce the behavior:
Instaloader command line
Expected behavior
A clear and concise description of what you expected to happen (if not obvious).
Error messages and tracebacks
KeyError: 'edge_sidecar_to_children'
Instaloader version
4.2.8
Additional context
Add any other context about the problem here.

Any help with that? @Thammus

Getting same error with 4.2.9
[  1/ 49] Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/instaloader/structures.py", line 157, in _field
    d = d[key]
KeyError: 'edge_sidecar_to_children'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/bin/instaloader", line 11, in <module>
    load_entry_point('instaloader==4.2.9', 'console_scripts', 'instaloader')()
  File "/usr/lib/python3.7/site-packages/instaloader/__main__.py", line 414, in main
    storyitem_filter_str=args.storyitem_filter)
  File "/usr/lib/python3.7/site-packages/instaloader/__main__.py", line 189, in _main
    download_stories, fast_update, post_filter, storyitem_filter)
  File "/usr/lib/python3.7/site-packages/instaloader/instaloader.py", line 1039, in download_profiles
    downloaded = self.download_post(post, target=profile_name)
  File "/usr/lib/python3.7/site-packages/instaloader/instaloader.py", line 466, in download_post
    for sidecar_node in post.get_sidecar_nodes():
  File "/usr/lib/python3.7/site-packages/instaloader/structures.py", line 227, in get_sidecar_nodes
    for edge in self._field('edge_sidecar_to_children', 'edges'):
  File "/usr/lib/python3.7/site-packages/instaloader/structures.py", line 160, in _field
    d = self._full_metadata
  File "/usr/lib/python3.7/site-packages/instaloader/structures.py", line 143, in _full_metadata
    self._obtain_metadata()
  File "/usr/lib/python3.7/site-packages/instaloader/structures.py", line 135, in _obtain_metadata
    self._full_metadata_dict = pic_json['entry_data']['PostPage'][0]['graphql']['shortcode_media']
KeyError: 'graphql'

I've got the same error.
I've tested with multiples Instagram account and the bug seems to occur when instaloader have to download multiples images in one post.
`File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 157, in _field
d = d[key]
KeyError: 'edge_sidecar_to_children'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/instaloader", line 11, in
load_entry_point('instaloader==4.2.9', 'console_scripts', 'instaloader')()
File "/usr/local/lib/python3.5/dist-packages/instaloader/main.py", line 414, in main
storyitem_filter_str=args.storyitem_filter)
File "/usr/local/lib/python3.5/dist-packages/instaloader/main.py", line 189, in _main
download_stories, fast_update, post_filter, storyitem_filter)
File "/usr/local/lib/python3.5/dist-packages/instaloader/instaloader.py", line 1010, in download_profiles
self.download_tagged(profile, fast_update=fast_update, post_filter=post_filter)
File "/usr/local/lib/python3.5/dist-packages/instaloader/instaloader.py", line 884, in download_tagged
downloaded = self.download_post(post, target if target else Path(profile.username) / Path(':tagged'))
File "/usr/local/lib/python3.5/dist-packages/instaloader/instaloader.py", line 466, in download_post
for sidecar_node in post.get_sidecar_nodes():
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 227, in get_sidecar_nodes
for edge in self._field('edge_sidecar_to_children', 'edges'):
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 160, in _field
d = self._full_metadata
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 143, in _full_metadata
self._obtain_metadata()
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 135, in _obtain_metadata
self._full_metadata_dict = pic_json['entry_data']['PostPage'][0]['graphql']['shortcode_media']
KeyError: 'graphql'
`

Well, New error:
Traceback (most recent call last):
  File "/storage/dockerdata/syncthing/instaloader/instaloader/structures.py", line 158, in _field
    d = d[key]
KeyError: 'edge_sidecar_to_children'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/storage/dockerdata/syncthing/instaloader/instaloader.py", line 6, in <module>
    main()
  File "/storage/dockerdata/syncthing/instaloader/instaloader/__main__.py", line 414, in main
    storyitem_filter_str=args.storyitem_filter)
  File "/storage/dockerdata/syncthing/instaloader/instaloader/__main__.py", line 189, in _main
    download_stories, fast_update, post_filter, storyitem_filter)
  File "/storage/dockerdata/syncthing/instaloader/instaloader/instaloader.py", line 1039, in download_profiles
    downloaded = self.download_post(post, target=profile_name)
  File "/storage/dockerdata/syncthing/instaloader/instaloader/instaloader.py", line 466, in download_post
    for sidecar_node in post.get_sidecar_nodes():
  File "/storage/dockerdata/syncthing/instaloader/instaloader/structures.py", line 228, in get_sidecar_nodes
    for edge in self._field('edge_sidecar_to_children', 'edges'):
  File "/storage/dockerdata/syncthing/instaloader/instaloader/structures.py", line 161, in _field
    d = self._full_metadata
  File "/storage/dockerdata/syncthing/instaloader/instaloader/structures.py", line 144, in _full_metadata
    self._obtain_metadata()
  File "/storage/dockerdata/syncthing/instaloader/instaloader/structures.py", line 136, in _obtain_metadata
    self._full_metadata_dict = pic_json['entry_data']['PostPage'][0]['graphql']['shortcode_media']
KeyError: 'graphql'

Edit, this is the content of the pic_json:
{'config': {'csrf_token': 'vZjBrdMAIEJt5CdY4jPvkv3SlRsWfYV2', 'viewer': {'biography': 'Hobbyphotographer (Lumix GH4), Japanese Culture & Anime enthusiast, Linux User, Lvl20', 'external_url': 'https://calvin-c.photography/?src=ig', 'full_name': 'Calvin', 'has_phone_number': True, 'has_profile_pic': True, 'id': '1156575468', 'is_joined_recently': False, 'is_private': False, 'profile_pic_url': 'https://scontent-dus1-1.cdninstagram.com/vp/68998b21536d72ab6f56d8f9c69a6ceb/5E3489DE/t51.2885-19/s150x150/45291094_785502951790379_4519902365448404992_n.jpg?_nc_ht=scontent-dus1-1.cdninstagram.com', 'profile_pic_url_hd': 'https://scontent-dus1-1.cdninstagram.com/vp/58a45fceed3637e9ce255e2f85b14775/5E35112E/t51.2885-19/s320x320/45291094_785502951790379_4519902365448404992_n.jpg?_nc_ht=scontent-dus1-1.cdninstagram.com', 'username': 'calvin_thefreak', 'badge_count': '{"seq_id": 25533, "badge_count": 0, "badge_count_at_ms": 1569874169417}'}, 'viewerId': '1156575468'}, 'country_code': 'DE', 'language_code': 'en', 'locale': 'en_US', 'entry_data': {'PostPage': [{}]}, 'hostname': 'www.instagram.com', 'deployment_stage': 'c2', 'platform': 'web', 'nonce': '8sPZhhXgkxlqfmOf+Md/sg==', 'mid_pct': 85.36416, 'zero_data': {}, 'cache_schema_version': 3, 'server_checks': {'hfe': True}, 'knobx': {'4': False, '17': False, '18': True, '19': True}, 'to_cache': {'gatekeepers': {'4': True, '5': False, '6': False, '7': False, '8': False, '9': False, '10': False, '11': True, '12': False, '13': True, '14': True, '15': True, '16': False, '18': True, '19': False, '23': False, '24': False, '26': True, '27': False, '28': False, '29': True, '31': False, '32': True, '34': False, '35': False, '38': True, '40': True, '41': False, '43': False, '45': True, '59': True, '60': False, '61': False, '62': False, '63': False, '64': False, '65': False, '66': True, '67': False, '68': False, '69': False}, 'qe': {'app_upsell': {'g': '', 'p': {}}, 'igl_app_upsell': {'g': '', 'p': {}}, 'notif': {'g': '', 'p': {}}, 'log_cont': {'g': '', 'p': {}}, 'onetaplogin': {'g': 'control', 'p': {'after_login': 'true', 'storage_version': 'one_tap_storage_version'}}, 'multireg_iter': {'g': '', 'p': {}}, 'felix_clear_fb_cookie': {'g': 'control', 'p': {'is_enabled': 'true', 'blacklist': 'fbsr_124024574287414'}}, 'felix_creation_duration_limits': {'g': 'dogfooding', 'p': {'maximum_length_seconds': '3600', 'minimum_length_seconds': '60'}}, 'felix_creation_fb_crossposting': {'g': 'control', 'p': {'is_enabled': 'false'}}, 'felix_creation_fb_crossposting_v2': {'g': 'control', 'p': {'is_enabled': 'true', 'display_version': '2'}}, 'felix_creation_validation': {'g': 'control', 'p': {'edit_video_controls': 'true', 'description_maximum_length': '2200', 'max_video_size_in_bytes': '3600000000', 'minimum_length_for_feed_preview_seconds': '60', 'title_maximum_length': '75', 'valid_cover_mime_types': 'image/jpeg,image/png', 'valid_video_extensions': 'mp4,mov', 'valid_video_mime_types': 'video/mp4,video/quicktime'}}, 'mweb_topical_explore': {'g': '', 'p': {}}, 'post_options': {'g': 'control', 'p': {'enable_igtv_embed': 'true', 'use_refactor': 'true'}}, 'iglscioi': {'g': '', 'p': {}}, 'sticker_tray': {'g': '', 'p': {}}, 'web_sentry': {'g': 'test', 'p': {'show_feedback': 'true'}}, '0': {'p': {'4': True, '7': False, '8': False, '9': False}, 'qex': True}, '2': {'p': {'0': True}, 'qex': True}, '4': {'p': {'0': False}, 'qex': True}, '5': {'p': {'1': False}, 'qex': True}, '6': {'p': {'1': True, '5': False, '6': False, '7': False, '9': False, '10': False}, 'qex': True}, '7': {'p': {}, 'qex': True}, '10': {'p': {'2': False}, 'qex': True}, '12': {'p': {'0': 5}, 'qex': True}, '13': {'p': {'0': True}, 'qex': True}, '16': {'p': {'0': False}, 'qex': True}, '17': {'p': {'1': True}, 'qex': True}, '19': {'p': {'0': True}, 'qex': True}, '21': {'p': {'2': False}, 'qex': True}, '22': {'p': {'1': False, '2': 8.0, '3': 0.85, '4': 0.95, '5': 10.0, '10': 10.0}, 'qex': True}, '23': {'p': {'0': False, '1': False}, 'qex': True}, '25': {'p': {}, 'qex': True}, '26': {'p': {'0': ''}, 'qex': True}, '27': {'p': {'0': False}, 'qex': True}, '28': {'p': {'0': False}, 'qex': True}, '29': {'p': {}, 'qex': True}, '30': {'p': {'0': True}, 'qex': True}, '31': {'p': {}, 'qex': True}, '33': {'p': {}, 'qex': True}, '34': {'p': {'0': False}, 'qex': True}, '36': {'p': {'0': True, '1': False, '2': False, '3': False, '4': False}, 'qex': True}, '37': {'p': {'0': False}, 'qex': True}, '39': {'p': {'0': False, '2': False, '3': False, '4': False, '5': False}, 'qex': True}, '40': {'p': {'0': False}, 'qex': True}, '41': {'p': {'3': True}, 'qex': True}, '42': {'p': {'0': True}, 'qex': True}, '43': {'p': {'0': False, '1': False, '2': False}, 'qex': True}, '44': {'p': {'1': 'control', '2': 0.0}, 'qex': True}, '45': {'p': {'0': False, '1': 'not_now', '2': False, '4': 18, '5': False, '6': False, '7': True, '8': 4, '9': False, '10': 'default', '11': False, '12': False, '13': False, '14': False, '15': False, '16': 18, '17': 0}, 'qex': True}, '46': {'p': {'0': False}, 'qex': True}, '47': {'p': {'0': True, '1': False, '2': False, '3': False}, 'qex': True}, '48': {'p': {'0': False}, 'qex': True}, '49': {'p': {'0': False}, 'qex': True}, '50': {'p': {'0': False}, 'qex': True}, '51': {'p': {'0': False}, 'qex': True}, '52': {'p': {'0': False}, 'qex': True}, '53': {'p': {'0': 30}, 'qex': True}}, 'probably_has_app': True, 'cb': True}, 'device_id': None, 'rollout_hash': 'f73597121a9f', 'bundle_variant': 'metro', 'is_canary': False}

To Reproduce
Steps to reproduce the behavior:
Instaloader command line

Is there a way to reproduce this issue? We run nightly tests where this issue never occured.

Well, seems like Instagram Api blocked some json keys to block my automated stuff.
I now have the cron from me set to run randomly within a 24h timeframe, that I get all the stories.
I think I hit a limit or so on the side of instagram API

@aandergr
I've reproduce it this morning and the error is only happening while downloading a post with multiples pics while I am logged.
`root@ns310023:~/test# instaloader anickdumontet --login testaccount
Loaded session from /tmp/.instaloader-root/session-testaccount.
Logged in as testaccount.
Stored ID 338019518 for profile anickdumontet.
anickdumontet/2018-07-16_18-35-20_UTC_profile_pic.jpg
Retrieving posts from profile anickdumontet.
[  1/448] Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 157, in _field
d = d[key]
KeyError: 'edge_sidecar_to_children'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/instaloader", line 11, in
load_entry_point('instaloader==4.2.9', 'console_scripts', 'instaloader')()
File "/usr/local/lib/python3.5/dist-packages/instaloader/main.py", line 414, in main
storyitem_filter_str=args.storyitem_filter)
File "/usr/local/lib/python3.5/dist-packages/instaloader/main.py", line 189, in _main
download_stories, fast_update, post_filter, storyitem_filter)
File "/usr/local/lib/python3.5/dist-packages/instaloader/instaloader.py", line 1039, in download_profiles
downloaded = self.download_post(post, target=profile_name)
File "/usr/local/lib/python3.5/dist-packages/instaloader/instaloader.py", line 466, in download_post
for sidecar_node in post.get_sidecar_nodes():
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 227, in get_sidecar_nodes
for edge in self._field('edge_sidecar_to_children', 'edges'):
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 160, in _field
d = self._full_metadata
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 143, in _full_metadata
self._obtain_metadata()
File "/usr/local/lib/python3.5/dist-packages/instaloader/structures.py", line 135, in _obtain_metadata
self._full_metadata_dict = pic_json['entry_data']['PostPage'][0]['graphql']['shortcode_media']
KeyError: 'graphql'
root@ns310023:~/test# instaloader --version
4.2.9
`

authors: aandergr calvinc64 davispuh hmbrg mseguin pinkrazorgoblin


text:
downloading all stories that have a certain hashtag

I'm trying to download all stories of the people I follow that have a certain hashtag or mention.
So something of the sort:
instaloader --login=my_username --storyitem-filter=" '#desiredHashtag' in hashtags " :stories
Where '#desiredHashtag' in hashtags is the condition I need to change. However, reading through the documentation I did not come across a way to do this, for the storyitem-filter there is no such attribute yet and I don't know how else I should go about this.
Help is appreciated!

Accessing hashtags and other tappable objects like mentions in stories is not yet supported.

authors: Thammus kaiott


text:
More Access to a JsonExportable's Metadata

A motivation for this change

Fixes the lack of access to post data that is only accessable through the instagram-private-api (e.g. saved_collection_ids).
added get_json_structure(structure: JsonExportable) function to be an attribute of an Instaloader instance. This allows for the access of post data that is not directly accessible through the Instaloader API (e.g. saved_collection_ids).

The completeness of this change

Is it just a proof of concept? No
Is the documentation updated (if appropriate)? No
Do you consider it ready to be merged or is it a draft? Read to be merged
Can we help you at some point? Sure!

The implementation does not seem well though-through. The Post._iphone_struct method is simply duplicated and private methods are called from outside of the class.

authors: aandergr adamcesco


text:
getInitialProps from _app are lost when using withPasswordProtect()

Describe the bug
Any props set within custom _app component are lost when exporting withPasswordProtect()
To Reproduce
Steps to reproduce the behaviour:

Setup a custom _app file with getInitialProps setting a value.
Export using withPasswordProtect()
Login successfully
Console log _app props on page and they're undefined
Leave everything as is except remove withPasswordProtect() and your props will re-appear on the page

Expected behavior
Props from _app shouldn't be overwritten or lost.
Stack
Node fermium, Next 12, next-password-protect 1.7

+1

You should be able to attach getInitialProps to the instance returned from the HOC instead. See this modified example from the readme:
import { withPasswordProtect } from "next-password-protect";

// Before: export default App;
const ProtectedApp = process.env.PASSWORD_PROTECT
  ? withPasswordProtect(App, {
    // Options go here (optional)
    loginApiUrl: "/login",
  })
  : App;

// Set getInitialProps on HOC instance
ProtectedApp.getInitialProps = () => {
  //
};

export default ProtectedApp;

authors: specialfae vf-telwing vildantursic

repo: instantcommerce/next-password-protect


text:
PyPI Pre-release tracking card

This card is to track the first pypi pre-release for the 5/2 milestone
relates to #256

We've had two successful PyPi releases at this point - closing this issue.

authors: cdoern nathan-weinberg

repo: instructlab/instructlab


text:
Filters are or instead of and?

Hi, cool action, thanks! We've just rolled this out to some of our repos to reduce PR noise.
One small observation, I had configured both the author and startsWith and it seems the behaviour is any comment by the author OR comments that start with the given prefix. I expected this to be and rather than or, might be worth adding a note to the readme!
Thanks again, cool project.

Thank you for your feedback. I fixed the doc as https://github.com/int128/hide-comment-action/issues/219. Feel free to open a pull request for the better doc.


text:
fsspec and dask.delayed

We are running into an issue that's difficult to characterize precisely and debug, in part because it is intermittent.
This relates to use of fsspec in intake-esm. We are reading several zarr stores inside a dask.delayed function. We discovered the fsspec.get_mapper is not thread-safe, which is perhaps expected after reading the documentation.
We changed the code to pre-generate a dictionary of mapping like this
mapper_dict = {
            path: fsspec.get_mapper(path) for path in self.df[path_column_name]
        }  #

where self.df[path_column_name] contains a strings like 'gs://cmip6/AerChemMIP/BCC/BCC-ESM1/ssp370/r1i1p1f1/Amon/pr/gn/'.
We subsequently use mapper_dict[path] in the call to xarray.open_zarr, which is inside a dask.delayed function.
This works most of the time, but we get intermittent failures that seem like perhaps the mapping has been disrupted. The failure rate is order 20%. This is the error message.
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
<timed exec> in <module>

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/core.py in to_dataset_dict(self, zarr_kwargs, cdf_kwargs)
    167         self.zarr_kwargs = zarr_kwargs
    168         self.cdf_kwargs = cdf_kwargs
--> 169         return self.to_dask()
    170
    171     def _get_schema(self):

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_xarray/base.py in to_dask(self)
     67     def to_dask(self):
     68         """Return xarray object where variables are dask arrays"""
---> 69         return self.read_chunked()
     70
     71     def close(self):

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_xarray/base.py in read_chunked(self)
     42     def read_chunked(self):
     43         """Return xarray object (which will have chunks)"""
---> 44         self._load_metadata()
     45         return self._ds
     46

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake/source/base.py in _load_metadata(self)
    115         """load metadata only if needed"""
    116         if self._schema is None:
--> 117             self._schema = self._get_schema()
    118             self.datashape = self._schema.datashape
    119             self.dtype = self._schema.dtype

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/core.py in _get_schema(self)
    172         from intake.source.base import Schema
    173
--> 174         self._open_dataset()
    175         self._schema = Schema(
    176             datashape=None, dtype=None, shape=None, npartitions=None, extra_metadata={}

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/core.py in _open_dataset(self)
    233         ]
    234
--> 235         dsets = dask.compute(*dsets)
    236         del mapper_dict
    237

/srv/conda/envs/notebook/lib/python3.7/site-packages/dask/base.py in compute(*args, **kwargs)
    444     keys = [x.__dask_keys__() for x in collections]
    445     postcomputes = [x.__dask_postcompute__() for x in collections]
--> 446     results = schedule(dsk, keys, **kwargs)
    447     return repack([f(r, *a) for r, (f, a) in zip(results, postcomputes)])
    448

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/client.py in get(self, dsk, keys, restrictions, loose_restrictions, resources, sync, asynchronous, direct, retries, priority, fifo_timeout, actors, **kwargs)
   2509                     should_rejoin = False
   2510             try:
-> 2511                 results = self.gather(packed, asynchronous=asynchronous, direct=direct)
   2512             finally:
   2513                 for f in futures.values():

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/client.py in gather(self, futures, errors, direct, asynchronous)
   1809                 direct=direct,
   1810                 local_worker=local_worker,
-> 1811                 asynchronous=asynchronous,
   1812             )
   1813

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/client.py in sync(self, func, asynchronous, callback_timeout, *args, **kwargs)
    750         else:
    751             return sync(
--> 752                 self.loop, func, *args, callback_timeout=callback_timeout, **kwargs
    753             )
    754

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/utils.py in sync(loop, func, callback_timeout, *args, **kwargs)
    325             e.wait(10)
    326     if error[0]:
--> 327         six.reraise(*error[0])
    328     else:
    329         return result[0]

/srv/conda/envs/notebook/lib/python3.7/site-packages/six.py in reraise(tp, value, tb)
    691             if value.__traceback__ is not tb:
    692                 raise value.with_traceback(tb)
--> 693             raise value
    694         finally:
    695             value = None

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/utils.py in f()
    310             if callback_timeout is not None:
    311                 future = gen.with_timeout(timedelta(seconds=callback_timeout), future)
--> 312             result[0] = yield future
    313         except Exception as exc:
    314             error[0] = sys.exc_info()

/srv/conda/envs/notebook/lib/python3.7/site-packages/tornado/gen.py in run(self)
    733
    734                     try:
--> 735                         value = future.result()
    736                     except Exception:
    737                         exc_info = sys.exc_info()

/srv/conda/envs/notebook/lib/python3.7/site-packages/distributed/client.py in _gather(self, futures, errors, direct, local_worker)
   1665                             exc = CancelledError(key)
   1666                         else:
-> 1667                             six.reraise(type(exception), exception, traceback)
   1668                         raise exc
   1669                     if errors == "skip":

/srv/conda/envs/notebook/lib/python3.7/site-packages/six.py in reraise(tp, value, tb)
    690                 value = tp()
    691             if value.__traceback__ is not tb:
--> 692                 raise value.with_traceback(tb)
    693             raise value
    694         finally:

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/core.py in _load_group_dataset()
    268
    269     ds = aggregate(
--> 270         aggregation_dict, agg_columns, n_agg, nd, lookup, mapper_dict, zarr_kwargs, cdf_kwargs
    271     )
    272     group_id = '.'.join(key)

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in aggregate()
     94             return ds
     95
---> 96     return apply_aggregation(v)
     97
     98

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in apply_aggregation()
     76             dsets = [
     77                 apply_aggregation(value, agg_column, key=key, level=level + 1)
---> 78                 for key, value in v.items()
     79             ]
     80             keys = list(v.keys())

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in <listcomp>()
     76             dsets = [
     77                 apply_aggregation(value, agg_column, key=key, level=level + 1)
---> 78                 for key, value in v.items()
     79             ]
     80             keys = list(v.keys())

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in apply_aggregation()
     76             dsets = [
     77                 apply_aggregation(value, agg_column, key=key, level=level + 1)
---> 78                 for key, value in v.items()
     79             ]
     80             keys = list(v.keys())

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in <listcomp>()
     76             dsets = [
     77                 apply_aggregation(value, agg_column, key=key, level=level + 1)
---> 78                 for key, value in v.items()
     79             ]
     80             keys = list(v.keys())

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in apply_aggregation()
     60                 data_format=data_format,
     61                 zarr_kwargs=zarr_kwargs,
---> 62                 cdf_kwargs=cdf_kwargs,
     63             )
     64

/srv/conda/envs/notebook/lib/python3.7/site-packages/intake_esm/merge_util.py in open_dataset()
    100
    101     if data_format == 'zarr':
--> 102         ds = xr.open_zarr(path, **zarr_kwargs)
    103         return _set_coords(ds, varname)
    104

/srv/conda/envs/notebook/lib/python3.7/site-packages/xarray/backends/zarr.py in open_zarr()
    617         synchronizer=synchronizer,
    618         group=group,
--> 619         consolidated=consolidated,
    620     )
    621     ds = maybe_decode_store(zarr_store)

/srv/conda/envs/notebook/lib/python3.7/site-packages/xarray/backends/zarr.py in open_group()
    277         if consolidated:
    278             # TODO: an option to pass the metadata_key keyword
--> 279             zarr_group = zarr.open_consolidated(store, **open_kwargs)
    280         else:
    281             zarr_group = zarr.open_group(store, **open_kwargs)

/srv/conda/envs/notebook/lib/python3.7/site-packages/zarr/convenience.py in open_consolidated()
   1180
   1181     # setup metadata sotre
-> 1182     meta_store = ConsolidatedMetadataStore(store, metadata_key=metadata_key)
   1183
   1184     # pass through

/srv/conda/envs/notebook/lib/python3.7/site-packages/zarr/storage.py in __init__()
   2455             d = store[metadata_key].decode()  # pragma: no cover
   2456         else:  # pragma: no cover
-> 2457             d = store[metadata_key]
   2458         meta = json_loads(d)
   2459

/srv/conda/envs/notebook/lib/python3.7/site-packages/fsspec/mapping.py in __getitem__()
     78             if default is not None:
     79                 return default
---> 80             raise KeyError(key)
     81         return result
     82

KeyError: 'cmip6/CMIP/CCCma/CanESM5/historical/r10i1p2f1/Amon/pr/gn/.zmetadata'****

Running without the distributed scheduler seems to avoid the problem.
cc @rabernat

Here's the rendered version of the failing notebook: https://nbviewer.jupyter.org/gist/andersy005/0251963a30efb3e0122275235e79b324/CMIP6-Pangeo-Demo.ipynb
And here's the a link to binder: https://binder.pangeo.io/v2/gist/andersy005/0251963a30efb3e0122275235e79b324/master

Seems to work well with current master versions of fsspec and gcsfs. This was likely the same issue as https://github.com/pangeo-data/pangeo/issues/691

OK to close?

OK to close?

Yes

authors: andersy005 martindurant matt-long

license_source: bigquery


text:
🛑 Shopintake is down

In 4cf19f3, Shopintake (https://www.shopintake.com) was down:

HTTP code: 403
Response time: 519 ms

Resolved: Shopintake is back up in b468f1f after 7 minutes.


text:
Need checksum tests for VLAN tagged packets

We support packets with VLAN tags but there are no tests for them yet. One important area is checksum calculation tests because these tests may be used as examples of correctly using functions for checksum calculation.

Fixed by #223

authors: gshimansky mbulatova

repo: intel-go/nff-go


text:
Removing System.exit as it causes to exit application containers

Further to https://github.com/intel-iot-devkit/tinyb/pull/116 another System.exit is removed to prevent application containers (e.g. OSGi and Spring) to exit. The reason why it is important is that tinyb native libraries could be "side-loaded" through creating a temporary file etc.
Signed-off-by: Vlad Kolotov vkolotov@gmail.com

Hi @petreeftime, would you be able to merge this? Thanks!

repo: intel-iot-devkit/tinyb

license: mit


text:
docs: model: vowpalWabbit: added example usage

Fixes #615
Cleanup and Support for data already in vw format.

@0dust just pinging you on this in case it dropped off your radar

Very nice!! :D

repo: intel/dffml


text:
Build getting failed when trying to build DGPU driver image via KMM on Openshift 4.12

Hello Team,
As we are not able to use the pre-build mode container image having a different kernel version than our kernel version i.e. 4.18.0-372.71.1.el8_6.x86_64, we are trying the On-premise Build Mode approach via KMM to build DGPU driver image in Openshift 4.12 as documented in below github link.
[https://github.com/intel/intel-technology-enabling-for-openshift/tree/main/kmmo#managing-intel-dgpu-driver-with-kmm-operator]
Build is getting triggered, but unfortunately we are seeing below error(snippet below)
Also sharing the complete logs of the build pod for the analysis, require the team support take it up forward.
intel-dgpu-on-premise-build-mode-r8hjv-undefined.log
Log snippet
/build/intel-gpu-i915-backports/drivers/gpu/drm/i915/fabric/netlink.c:1333:14: note: (near initialization for 'nl_iaf_cmds[19].start')
cc1: some warnings being treated as errors
make[6]: *** [scripts/Makefile.build:318: /build/intel-gpu-i915-backports/drivers/gpu/drm/i915/fabric/netlink.o] Error 1
make[5]: *** [scripts/Makefile.build:558: /build/intel-gpu-i915-backports/drivers/gpu/drm/i915/fabric] Error 2
make[4]: *** [scripts/Makefile.build:558: /build/intel-gpu-i915-backports/drivers/gpu/drm/i915] Error 2
make[3]: *** [Makefile:1584: _module_/build/intel-gpu-i915-backports] Error 2
make[2]: *** [Makefile.build:13: modules] Error 2
make[1]: *** [Makefile.real:105: modules] Error 2
make: *** [Makefile:50: modules] Error 2
error: build error: error building at STEP "RUN git clone -b ${I915_RELEASE} --single-branch https://github.com/intel-gpu/intel-gpu-i915-backports.git && cd intel-gpu-i915-backports && install -D COPYING /licenses/i915/COPYING && export LEX=flex; export YACC=bison && export OS_TYPE=rhel_9 && export OS_VERSION="9.2" && cp defconfigs/i915 .config && make olddefconfig && make modules -j $(nproc) && make modules_install": error while running runtime: exit status

Hi @fayazahamedj, thanks for submitting the issue. The reason for that issue is that dockerfile recipe is for OpenShift 4.13 based on RHEL 9.2. OpenShift 4.12 is based on RHEL 8.6 and the dockerfile recipe to build driver container is different as a result.
Please use tag 1.0.1 release for OpenShift 4.12: https://github.com/intel/intel-technology-enabling-for-openshift/releases/tag/v1.0.1. Make sure to use the KMM module CR for the appropriate mode (pre-built or on-premise) from this tag.
For OCP 4.12 certified pre-built images, please refer to https://github.com/intel/intel-data-center-gpu-driver-for-openshift/tree/main/release#release-information
If you need to still use on premise build, please use tag 1.1.0 release dockerfile here: https://github.com/intel/intel-data-center-gpu-driver-for-openshift/blob/v1.1.0/docker/intel-dgpu-driver.Dockerfile
If anything is still unclear, feel free to comment again. Thanks!

authors: fayazahamedj hershpa


text:
Test "test_batch_normalization" segfaults just after being called, in a wide range of scenarios

Hello,
I just tried to compile MKL-DNN. I am somehow a longtime user of the library, and I usually succeeded in building and testing it with this same setup (the last time, however, was months ago).
Now, with a fresh reinstall of the OS, the build succeeds but one of the tests fails. I tried to compile with different compiler and libraries solutions... all with the same result.
I have tried to document thoroughly the error below, that happens both with GNU and Intel compilers, with or without MKL and/or IntelMP support.
I am obviously available for further testing/providing more info if needed.
Thanks for your work and support.
Regards.

Environment

CPU manufacturer and model

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              8
On-line CPU(s) list: 0-7
Thread(s) per core:  2
Core(s) per socket:  4
Socket(s):           1
NUMA node(s):        1
Vendor ID:           GenuineIntel
CPU family:          6
Model:               94
Model name:          Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz
Stepping:            3
CPU MHz:             900.067
CPU max MHz:         3600.0000
CPU min MHz:         800.0000
BogoMIPS:            5426.00
Virtualization:      VT-x
L1d cache:           32K
L1i cache:           32K
L2 cache:            256K
L3 cache:            8192K
NUMA node0 CPU(s):   0-7
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves ibpb ibrs stibp dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp

OS version

Linux emaballarin-precision-workstation 4.14.34-1-MANJARO #1 SMP PREEMPT Thu Apr 12 17:26:43 UTC 2018 x86_64 GNU/Linux

Note: it's just the Arch Linux kernel with preemption support.

Compiler version
Tried both GCC and Intel C/C++, with versions as follows...

$ gcc --version

gcc (GCC) 7.3.1 20180312
Copyright (C) 2017 Free Software Foundation, Inc.

$ icc --version

icc (ICC) 19.0.0.046 20180317
Copyright (C) 1985-2018 Intel Corporation.  All rights reserved.

MKLROOT value and configuration

$ echo MKLROOT=$MKLROOT

MKLROOT=/opt/intel/compilers_and_libraries_2019.0.046/linux/mkl

From ~/.bashrc...
source /opt/intel/parallel_studio_xe_2019/bin/psxevars.sh
source /opt/intel/compilers_and_libraries/linux/mpi/intel64/bin/mpivars.sh
source /opt/intel/mkl/bin/mklvars.sh intel64
source /opt/intel/tbb/bin/tbbvars.sh intel64
export MKL_ROOT="$MKLROOT"
export MKLINC="/opt/intel/mkl/include"
export TBB_ROOT="$TBBROOT"
export MKLROOT="$MKL_ROOT"
export LD_LIBRARY_PATH="/opt/intel/compilers_and_libraries_2019.0.046/linux/compiler/lib/intel64_lin:$LD_LIBRARY_PATH"
export MKL_THREADING_LAYER=INTEL
export OMP_NUM_THREADS=4
export KMP_AFFINITY=verbose,granularity=fine,proclist=[0-4],explicit

Note: however, the problem occurs exactly the same when compiling without Intel MKL and IntelMP support. I have manually checked that the OpenMP library used is the one wanted (I had in the past libiomp/libgomp incompatibilites, but it was on a completely different setup).

CMake version

cmake version 3.10.3
CMake suite maintained and supported by Kitware (kitware.com/cmake).

CMake output log
I will actually have a hard time finding the build log (I will provide it later today, if needed... sorry!).
However, the build went fine with both compilers, as expected. Please, see below (at the end) for maybe useful logfiles.

Steps to reproduce

Clone the mkl-dnn repository from git;
Follow the readme instructions, but without the MKL Small Library, building with (1) full MKL support or (2) no MKL support whatsoever. The problem occurs with no difference.
Compile with (a) Intel Parallel Studio XE compilers or (b) GNU Compilers Suite. The problem occurs with no difference.

Actual behavior

The tests are run;
Test N° 21/36 "test_batch_normalization" fails with Exception: segmentation fault. All the other tests pass.

Expected behavior

The tests are run;
All tests pass.

Additional information:

The configuration file, sourced to setup the Intel Compilers toolchain

# C/C++/Fortran
export CC=icc
export CXX=icpc
export FC=ifort
export CMAKE_C_COMPILER=icc
export CMAKE_CXX_COMPILER=icpc
export CMAKE_Fortran_COMPILER=ifort

# MPI
export MPI_C_COMPILER=mpiicc
export MPI_CXX_COMPILER=mpiicpc
export MPI_Fortran_COMPILER=mpiifort

The configuration file, sourced to setup the GNU Compilers toolchain

# C/C++/Fortran
export CC=gcc
export CXX=g++
export FC=gfortran

The linking status of libmkldnn.so after the Intel+MKL+IntelMP compilation

        linux-vdso.so.1 (0x00007ffe3dd73000)
        libiomp5.so => /opt/intel/compilers_and_libraries_2019.0.046/linux/compiler/lib/intel64_lin/libiomp5.so (0x00007f759df90000)
        libmkl_rt.so => /opt/intel/compilers_and_libraries_2019.0.046/linux/mkl/lib/intel64_lin/libmkl_rt.so (0x00007f759d901000)
        libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f759d57a000)
        libm.so.6 => /usr/lib/libm.so.6 (0x00007f759d22e000)
        libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x00007f759d017000)
        libpthread.so.0 => /usr/lib/libpthread.so.0 (0x00007f759cdf9000)
        libc.so.6 => /usr/lib/libc.so.6 (0x00007f759ca42000)
        libdl.so.2 => /usr/lib/libdl.so.2 (0x00007f759c83e000)
        /usr/lib64/ld-linux-x86-64.so.2 (0x00007f759f213000)

The linking status of libmkldnn.so after the GNU (no MKL, no IntelMP) compilation

        linux-vdso.so.1 (0x00007ffff6fa7000)
        libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f2ef5275000)
        libm.so.6 => /usr/lib/libm.so.6 (0x00007f2ef4f29000)
        libgomp.so.1 => /usr/lib/libgomp.so.1 (0x00007f2ef4cfb000)
        libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x00007f2ef4ae4000)
        libpthread.so.0 => /usr/lib/libpthread.so.0 (0x00007f2ef48c6000)
        libc.so.6 => /usr/lib/libc.so.6 (0x00007f2ef450f000)
        /usr/lib64/ld-linux-x86-64.so.2 (0x00007f2ef5dcc000)
        libdl.so.2 => /usr/lib/libdl.so.2 (0x00007f2ef430b000)

The failed test logfile (in the Intel+MKL+IntelMP case)

21/36 Testing: test_batch_normalization
21/36 Test: test_batch_normalization
Command: "/home/emaballarin/Downloads/mkl-dnn/build/tests/gtests/test_batch_normalization"
Directory: /home/emaballarin/Downloads/mkl-dnn/build/tests/gtests
"test_batch_normalization" start time: Apr 20 03:36 CEST
Output:
----------------------------------------------------------
[==========] Running 140 tests from 8 test cases.
[----------] Global test environment set-up.
[----------] 4 tests from Simple_NC/bnrm_test_float
[ RUN      ] Simple_NC/bnrm_test_float.TestsBnrm/0
OMP: Info #211: KMP_AFFINITY: decoding x2APIC ids.
OMP: Info #209: KMP_AFFINITY: Affinity capable, using global cpuid leaf 11 info
OMP: Info #154: KMP_AFFINITY: Initial OS proc set respected: {0,1,2,3,4,5,6,7}
OMP: Info #156: KMP_AFFINITY: 8 available OS procs
OMP: Info #157: KMP_AFFINITY: Uniform topology
OMP: Info #179: KMP_AFFINITY: 1 packages x 4 cores/pkg x 2 threads/core (4 total cores)
OMP: Info #213: KMP_AFFINITY: OS proc to physical thread map:
OMP: Info #171: KMP_AFFINITY: OS proc 0 maps to package 0 core 0 thread 0
OMP: Info #171: KMP_AFFINITY: OS proc 4 maps to package 0 core 0 thread 1
OMP: Info #171: KMP_AFFINITY: OS proc 1 maps to package 0 core 1 thread 0
OMP: Info #171: KMP_AFFINITY: OS proc 5 maps to package 0 core 1 thread 1
OMP: Info #171: KMP_AFFINITY: OS proc 2 maps to package 0 core 2 thread 0
OMP: Info #171: KMP_AFFINITY: OS proc 6 maps to package 0 core 2 thread 1
OMP: Info #171: KMP_AFFINITY: OS proc 3 maps to package 0 core 3 thread 0
OMP: Info #171: KMP_AFFINITY: OS proc 7 maps to package 0 core 3 thread 1
OMP: Info #249: KMP_AFFINITY: pid 18970 tid 18970 thread 0 bound to OS proc set {0}
OMP: Info #249: KMP_AFFINITY: pid 18970 tid 18971 thread 1 bound to OS proc set {1}
OMP: Info #249: KMP_AFFINITY: pid 18970 tid 18972 thread 2 bound to OS proc set {2}
OMP: Info #249: KMP_AFFINITY: pid 18970 tid 18973 thread 3 bound to OS proc set {3}
<end of output>
Test time =   0.23 sec
----------------------------------------------------------
Test Failed.
"test_batch_normalization" end time: Apr 20 03:36 CEST
"test_batch_normalization" time elapsed: 00:00:00
----------------------------------------------------------

The failed test logfile (in the GNU case)

20/35 Testing: test_batch_normalization
20/35 Test: test_batch_normalization
Command: "/home/emaballarin/Downloads/mkl-dnn-gcc/build/tests/gtests/test_batch_normalization"
Directory: /home/emaballarin/Downloads/mkl-dnn-gcc/build/tests/gtests
"test_batch_normalization" start time: Apr 20 03:54 CEST
Output:
----------------------------------------------------------
[==========] Running 140 tests from 8 test cases.
[----------] Global test environment set-up.
[----------] 4 tests from Simple_NC/bnrm_test_float
[ RUN      ] Simple_NC/bnrm_test_float.TestsBnrm/0
<end of output>
Test time =   0.25 sec
----------------------------------------------------------
Test Failed.
"test_batch_normalization" end time: Apr 20 03:54 CEST
"test_batch_normalization" time elapsed: 00:00:00
----------------------------------------------------------

Hi @emaballarin,
Thanks for the report!
We indeed recently introduced this regression.
Should be fixed very soon.

Closed with 575b7e860d824a2d3fe901f36f22b00faeaf037f.

authors: emaballarin emfomenk

repo: intel/mkl-dnn


text:
WIP: disruptive testing

This provides tests for PR #196.
It is a superset of PR #228, which in turn is a superset of PR #234.

@avalluri I previously pointed you to my sanity-testing-normal-driver branch for testing your PR. Please use this here instead.

I've rebased on top of the changes for PR #236.

Exposing it enables writing tests that are more focused on a particular aspect and thus easier to debug when something goes wrong. I think that's important.
Testing cache volumes will also be easier that way.

To demonstrate what I meant with that I added a test for cache volumes: cd25587ef1e00dd34e954f303512f4cee449d958

@pohly would you mind if I take this PR in #196

Amarnath Valluri notifications@github.com writes:

@pohly would you mind if I take this PR in #196

Not at all, please do. Merging them together always has been the goal.

Merged via PR #196

The changes already merged as part of #196

authors: avalluri pohly

repo: intel/pmem-CSI


text:
CI: minor deselected test update

Description
Follow-up to https://github.com/intel/scikit-learn-intelex/pull/1862, test is still failing in py3.9 skl1.2.1 conformance on GPU test, likely due to need for less than or equal to
Fixes # - issue number(s) if exists

[ ] I have reviewed my changes thoroughly before submitting this pull request.
[ ] I have commented my code, particularly in hard-to-understand areas.
[ ] I have updated the documentation to reflect the changes, if necessary (updated in # - add PR number)
[ ] The unit tests pass successfully.
[ ] I have run it locally and tested the changes extensively.
[ ] I have resolved any merge conflicts that might occur with the base branch.
[ ] Git commit message contains an appropriate signed-off-by string (see CONTRIBUTING.md for details)
[ ] I have added a respective label(s) to PR if I have a permission for that.

/intelci: run

/intelci: run

/intelci: run

/intelci: run

repo: intel/scikit-learn-intelex


text:
Inline loop causes StackOverflowException

Translator.DotNetToJavaScript should track currently translated method nodes

Fixed with 05494e2, tested with previously offending code

repo: intellifactory/websharper


text:
Question : does it handle images?

Hi, thanks a lot for making this.
I was wondering, I saw that the original project included image support so that you could get a base 64 encoded image to give to a vision enabled LLM. Is that something that's implemented in your project?
Thanks!

Unfortunately, not for now.

Thanks!

but it cat take screenshot of the page.
user@vscode:~/notes$ curl -H "x-respond-with: pageshot" 'https://api.reader.berlin.cx/https://www.google.com/search?q=beste+bars+in+berlin&start=10'
http://api.reader.berlin.cx/instant-screenshots/pageshot-dd40727b-1e3e-4d00-a0c8-76916a6de72a.png

repo: intergalacticalvariable/reader


text:
[Multi-Tenant] Fix tests & github actions on feature branch

A lot of tests were broken by the fact that several existing tables have added foreign key constraints on tenantId. Now that the time constraint for Rafiki work week show and tell is no longer a factor, the feature branch should be brought up to the same standard as the main branch. In other words, new features should not break any existing tests or Github actions, and any tests & actions broken by features that are already merged in should be fixed.

https://github.com/interledger/rafiki/issues/2971
https://github.com/interledger/rafiki/issues/2970
https://github.com/interledger/rafiki/issues/2968
https://github.com/interledger/rafiki/issues/3009
https://github.com/interledger/rafiki/issues/3015

Closing as current multi-tenancy feature branch implements deprecated design.

Closing again as we are using the original design for multi-tenancy, but are starting fresh.

repo: interledger/rafiki


text:
chore: added focus to the first focusable elements on component load

Context

fixes https://github.com/interledger/testnet/issues/809

Changes

Added focus to the first focusable input element on component load across multiple components in wallet

We could add the same in these pages as well:

forgotten password - focus on email input:

register/create account new user - focus on email input:

Maybe add these, then looks good :)

authors: Tymmmy devcer

repo: interledger/testnet


text:
refactor(popup): add useBrowser hook; avoid importing everywhere

Context

https://github.com/interledger/web-monetization-extension/pull/395#issuecomment-2210951743
Changes proposed in this pull request

Extension builds preview

Name
Link

Latest commit
6aa25700af240f6c9d484ab9abcd6ddfdee87795

Latest job logs
Run #9836674756

DownloadDownload

authors: raducristianpopa sidvishnoi

repo: interledger/web-monetization-extension


text:
fix parsing error

closes https://github.com/interlynk-io/sbomqs/issues/353
This PR trigger a parser error, if any.  Earlier it wasn't.
See below:
$ go run main.go compliance -n -D  tt.json
2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:30	engine.ComplianceRun()
2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:36	Config: &{Path:[tt.json] Categories:[] Features:[] JSON:false Basic:false Detailed:false Pdf:false Spdx:false Cdx:false Recurse:false Debug:true ConfigPath: Ntia:true Bsi:false BsiV2:false Oct:false Fsct:false Color:false}
2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:86	engine.getSbomDocument()
2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:135	failed to create sbom document for  :tt.json

2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:136	invalid character '\n' in string literal

failed to parse tt.json : invalid character '\n' in string literal
2024-11-19T22:40:51.888+0530	DEBUG	engine/compliance.go:40	getSbomDocument failed for file :tt.json

failed to get sbom document for tt.json
Error: invalid character '\n' in string literal
Usage:
  sbomqs compliance [flags]

Examples:
 sbomqs compliance  < --ntia | --bsi | --bsi-v2 | --fsct | --oct >  [--basic | --json]   <SBOM file>

  # Check a NTIA minimum elements compliance against a SBOM in a table output
  sbomqs compliance --ntia samples/sbomqs-spdx-syft.json

  # Check a BSI TR-03183-2 v1.1 compliance against a SBOM in a table output
  sbomqs compliance --bsi samples/sbomqs-spdx-syft.json

  # Check a BSI TR-03183-2 v2.0.0 compliance against a SBOM in a table output
  sbomqs compliance --bsi-v2 samples/sbomqs-spdx-syft.json

   # Check a Framing Software Component Transparency (v3) compliance against a SBOM in a table output
  sbomqs compliance --fsct samples/sbomqs-spdx-syft.json

  # Check a OpenChain Telco compliance against a SBOM in a JSON output
  sbomqs compliance --oct --json samples/sbomqs-spdx-syft.json

   # Check a Framing Software Component Transparency (v3) compliance against a SBOM in a table colorful output
  sbomqs compliance --fsct --color samples/sbomqs-spdx-syft.json

Flags:
  -b, --basic      output in basic format
  -c, --bsi        BSI TR-03183-2 (v1.1)
  -s, --bsi-v2     BSI TR-03183-2 (v2.0.0)
  -l, --color      output in colorful
  -D, --debug      debug logging
  -d, --detailed   output in detailed format(default)
  -f, --fsct       Framing Software Component Transparency (v3)
  -h, --help       help for compliance
  -j, --json       output in json format
  -n, --ntia       NTIA minimum elements (July 12, 2021)
  -t, --oct        OpenChain Telco SBOM (v1.0)

exit status 1

Incorrect PR.

repo: interlynk-io/sbomqs


text:
implement float arithmetic

Closes #4
Closes #12
Closes #17

Codecov Report

Merging #52 (f76a87f) into master (0d74fd5) will increase coverage by 3.9%.
The diff coverage is 68.2%.

:exclamation: Current head f76a87f differs from pull request most recent head 95dfae5. Consider uploading reports for the commit 95dfae5 to get more accurate results

@@           Coverage Diff            @@
##           master     #52     +/-   ##
========================================
+ Coverage    24.9%   28.8%   +3.9%
========================================
  Files          18      18
  Lines        4210    4215      +5
========================================
+ Hits         1050    1216    +166
+ Misses       3160    2999    -161

Impacted Files
Coverage Δ

src/isa/exec.rs
41.0% <0.0%> (ø)

src/isa/flags.rs
1.4% <ø> (+1.1%)
:arrow_up:

src/reg/core_regs.rs
23.3% <44.1%> (+1.3%)
:arrow_up:

src/data/number.rs
47.9% <56.1%> (+1.8%)
:arrow_up:

src/data/arithm.rs
76.0% <83.9%> (+27.3%)
:arrow_up:

src/lib.rs
34.8% <0.0%> (+30.2%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0d74fd5...95dfae5. Read the comment docs.


text:
chooseColumnSpec control is visualized twice (no such issue in DSW 1.x)

Extract from dashboard:
    <control name="" action="chooseColumnSpec" target="" targetProperty="HU2mapDSW2.termlist" location="widget" type="auto" controlClass="" label="Measure to colorize the map" title="" value="" text="" readOnly="false" valueList="" displayList="" activeWhen="">
      <valueRequired>false</valueRequired>
    </control>

Latest release of DSW 2 shows both a label+dropdown (expeted) and a button with the same label (unexpected!):

DSW 1.4.76 visualizes the same dashboard on the same IRIS instance correctly:

Fixed with the 1.37 release

No, not fixed. I've just installed 2.1.38, and the extra button is still there.

BTW, ZPM now works on IRIS for Health

authors: dmitry-zasypkin evshvarov

repo: intersystems-community/DeepSeeWeb


text:
🛑 Het Markiezenhof is down

In 56fde6d, Het Markiezenhof (https://www.markiezenhof.nl) was down:

HTTP code: 502
Response time: 601 ms

Resolved: Het Markiezenhof is back up in 8f0e3da after 25 minutes.

repo: intk/intk-upptime


text:
Publish to Gradle Plugin Portal

What Changed
Publish Gradle plugin to Gradle Plugin Portal

:rocket: PR was released in v0.8.2 :rocket:

repo: intuit/hooks


text:
Writing your own step defination

If a user has a need of implementing his own cucumber step definition, does karate provides that ability?

No. You use either a JavaScript function or you can call Java code if you really need to. Kindly read the documentation: https://github.com/intuit/karate#calling-java

authors: kaustubhshete ptrthomas

repo: intuit/karate


text:
Reading "karate.config" file

Can we read "karate.config" settings in Java class? There is any other alternative please suggest.

please ask these kinds of questions on stack-overflow, the community there will educate you on how to actually ask questions: https://stackoverflow.com/questions/tagged/karate

authors: ptrthomas vinodkpasi


text:
Adding support to spin up docker in a sibling container (from when Ka…

Description
Thanks for contributing this Pull Request. Make sure that you submit this Pull Request against the develop branch of this repository, add a brief description, and tag the relevant issue(s) and PR(s) below.

Relevant Issues : (compulsory)
Relevant PRs : (optional)
Type of change :

[x] New feature
[ ] Bug fix for existing feature
[ ] Code quality improvement
[ ] Addition or Improvement of tests
[ ] Addition or Improvement of documentation

if the following is used:
{ docker: 'ptrthomas/karate-chrome', showDriverLog: true, siblingContainer: true, useDockerHost: true };
An hostname that is different from localhost will be used by the Docker Target but also by the WebSocket URL. If useDockerHost is true then the host "host.docker.internal" will be used (to let docker use its own DNS resolver to resolve the container), otherwise the name of the container that was launched will be used. By default useDockerHost is false meaning that the container name will be used by default. This setting will depend on the Docker network in use.
Also solves for https://stackoverflow.com/questions/59426102/karateui-how-to-add-host-header-into-addoptions-during-the-driver-configurati by including the siblingContainer: true
See following for the implemented workarounds:

https://github.com/chromedp/chromedp/issues/505 (localhost header)
https://stackoverflow.com/a/53868234/1916529 (replace of the returned webSocketDebuggerUrl)

Should be obvious but putting it here for future Googlers - you still need to solve (on your own) the strategy for deploying Karate in a container and providing it access to launch a sibling container. There are several security implications you will need to navigate but the solution that seems to be more accepted is to include the socket of the host into the container where your Karate is running to give it control of the host docker.
Few useful links:
https://devopscube.com/run-docker-in-docker/
https://tomgregory.com/running-docker-in-docker-on-windows/
https://stackoverflow.com/questions/47854463/docker-got-permission-denied-while-trying-to-connect-to-the-docker-daemon-socke

@joelpramos the docker part of the build seems to have failed

@joelpramos is this ready to merge ?

@ptrthomas I just need to change the naming of the properties I introduced (e.g. remote target or something instead of sibling container).
Also need to re read the documentation to check whether there was a use case I didn't consider but I'm pretty certain this is fine as the new code is all conditional on that new property.

I will get it done today

@ptrthomas ready for merge.
There is a change for the way the ports are exposed. Instead of relying on the operative system to find us a free port and expose that in the container, we're now relying on docker to expose in a random available port and grabbing that port for use. This enables the use case of sibling containers (as to avoid port clashes).
In addition there are a few optional parameters for when using a chrome in a remote local (e.g. sibling docker container, chrome hosted in another machine etc.).
There are some limitations described here https://github.com/chromedp/chromedp/issues/505 when the host is not localhost. The workaround is applied when setting the property remoteHost to true. I didn't see this as problematic when using the container name as hostname but when using host.docker.internal I came across this issue.
Using host.docker.internal relies on docker's internal DNS resolution - in my particular case as I was just trying out in a VM didn't setup a docker network and was just using the bridge. To overcome that I've added a second parameter useDockerHost. When set to true the host.docker.internal will be used, otherwise the container name (e.g. karate-chrome for http://karate-chrome:9222/json) will be used instead. By default this property is set to false as I assume most folks using containers will be running this in a proper docker network or they'll be using their local machines (in which case none of these parameters are needed).
Sample configuration the docker target:
{ docker: 'ptrthomas/karate-chrome', showDriverLog: true, remoteHost: true, useDockerHost: true };
PS: I only tested with Chrome... I assume that if the others don't use that HOST header property than no harm no foul but in any case the previous behavior did not change unless you are using these new optional parameters.

authors: joelpramos ptrthomas


text:
PassportJS

Would you be able to provide some guidance on integration with PassportJS?

@YasharF : I have not used PassportJS in the past. But going through their documentation, it seems like a middleware which is used to authenticate requests in node applications. Our client is just doing that.
I am not sure why you would want to integrate with PassportJS. Help me fill in on this and we could take a look at it. Thanks !

Using your middleware is a one-off implementation.  PassportJS is a more standardized way.  Many people would not use one-off solutions, especially if there is a need to integrate with multiple services.
Anyway, I ended up doing the integration of intuit/QuickBooks with PassportJS using the generic OAuth 2.0 plugin for passport js: https://github.com/sahat/hackathon-starter/commit/285b6b170d029322b0b000f056c2ce9331728398

Looking at the starter code you have provided here seems like exchanging the authCode for access/refresh tokens is not handled or may be I have missed something ?!
But this is a great value addition to developers who are integrating multiple services. I will send in a PR once I get past this. Thanks @YasharF

You are correct, handling the refresh token is an issue with pretty much all of the oAuth providers that hackathon-starter has integration with, and we are working on fixing it:
https://github.com/sahat/hackathon-starter/issues/977
https://github.com/sahat/hackathon-starter/pull/976

Alrighty. Good Stuff @YasharF
The excited me wanted to try out the QuickBooks implementation in your sample. However, I did not see an option to SignIn with QuickBooks when I visit the page http://localhost:8080/login after deploying app.js
Also, do I need to be logged into the website to invoke Sign in with QuickBooks?
https://cdn1.imggmi.com/uploads/2019/7/11/f5782c9769d74a08d37ca5e74cd75c70-full.png

authors: YasharF abisalehalliprasan anilkumarbp

repo: intuit/oauth-jsclient


text:
header: updated quick actions dropdown.

closes https://github.com/zenodo/rdm-project/issues/486

Result:
Unauthenticated users

If the user clicks "New upload" or "New community", they're redirected to the login page
Authenticated users

Can you keep the original menu item text:

New upload
New community

Also the caret down icon is missing after the ...

Can you keep the original menu item text:
* New upload

* New community

Also the caret down icon is missing after the ...

small suggestion: could you increase a distance between + and New ? it seems a little bit too cramped together

small suggestion: could you increase a distance between + and New ? it seems a little bit too cramped together

I am not sure if what I did is correct in terms of good practices (let me know if it isn't): I added an ID to the label and added a margin-left.

I am sure you did, but just to be sure, does the link correctly redirect to login when anonymous?

small suggestion: could you increase a distance between + and New ? it seems a little bit too cramped together

I am not sure if what I did is correct in terms of good practices (let me know if it isn't): I added an ID to the label and added a margin-left.

it seems to me like now there is a huge space on the left...

after some discussions, we decide it to postpone it until optimal solution is found

authors: alejandromumo jbenito3 kpsherva lnielsen ntarocco

repo: inveniosoftware/invenio-app-rdm


text:
[TASK-US#15] Write item availabilities REST endpoint

Write REST endpoint

closing as duplicate of https://github.com/inveniosoftware/invenio-circulation/issues/70

authors: BadrAly ludmilamarian

repo: inveniosoftware/invenio-circulation


text:
views: use endpoint pid_type instead of key for blueprints

Changes views.py to use pid_type in the endpoint map instead of the key for
the name of the endpoint. (closes #101)

Signed-off-by: Nikos Filippakis nikolaos.filippakis@cern.ch

I'm quite sure this will create conflicts if you have multiple endpoints for the same pid type.
RECODRS_REST_ENDPOINTS = {
  'recid' : {'pid_type': 'recid', ...},
  'recid_donwloads' : {'pid_type': 'recid', ...},
}

This pattern is very common in Records-UI. I'm not sure we're using in for Records-REST though.

I think we have conflicts in any case.
See for example where the pid_type is used to build the endpoint.

@hachreak That I would classify as a bug :-)
The only case where we use the pid_type to generate the endpoint with is when we have to make a redirect. https://github.com/inveniosoftware/invenio-records-ui/blob/master/invenio_records_ui/views.py#L171-L173
Here the assumption is that you must define at one endpoint with the same name as a pid type - otherwise the redirects won't work.

Ah.. ok.. XD
So, in this case, maybe, does it means that we have at least 4 bugs? :) 1, 2, 3, 4

1, 2 are bugs, 3 i don't think you can fix, 4 is not a bug

@nikofil @lnielsen @hachreak for 1,2 we should probably use self.__name__ instead.

cc @kaplun @jacquerie @jmartinm
This PR is needed before inspirehep/inspire-next#1613

Actually I agree with @lnielsen in that the proposed solution wouldn't work. What about the otherway round and not using the pid_type at all for building routes?

The only case where we use the pid_type to generate the endpoint with is when we have to make a redirect. https://github.com/inveniosoftware/invenio-records-ui/blob/master/invenio_records_ui/views.py#L171-L173

@kaplun how do you propose to solve the redirection?

What about introducing a separate new config variable to be filled up with the explicit map pid_type->endpoint to be used in these situations?

Alternatively, since we are already in the view, and since PIDs can redirect to each other only within the same pid_type what about using the current endpoint of the view and just change the PID value?

@jirikuncar @lnielsen what do you think about #119 as an alternative fix to this issue?

Closed via #119.

authors: hachreak jirikuncar kaplun lnielsen nikofil

repo: inveniosoftware/invenio-records-rest


text:
travis: bump Elasticsearch version

Bump Elasticsearch version as requested in inveniosoftware/invenio#3961.

Merged in https://github.com/inveniosoftware/invenio-records-rest/pull/276

authors: jorikvankemenade ntarocco


text:
BibCirculation: problem with 'Edit physical copies'

When accessing the 'Item details' page of an item by e.g. pressing the 'Edit physical copies' button in bibedit a '500  Internal Server Error' is shown and an error mail is sent detailing an exception
'HTTPError: HTTP Error 400: Bad Request' from urllib2 originating from the BIBCIRCULATION_OPENER.open call in the get_book_cover(isbn) function in bibcirculation_utils.py, lines 104ff. This call tries to retrieve a book cover for the item and is not essential for the functionality. (In Invenio 1.0 this problem did not arise because in the underlying code urllib instead if urllib2 had been used which throws no HTTPError exception.)
In the master branch this problem seems to be fixed by putting the BIBCIRCULATION_OPENER call into """ """, lines 179ff. A possible solution might be to back port this into the maint-1.1 branch.
I was able to get the BibCirculation working in our 1.1.4 test installation by porting the get_book_cover() function from master, i.e.
"""cover_xml = BIBCIRCULATION_OPENER.open(...
...
...                 'Keywords=' + isbn)"""
cover_xml=""
...
except:  (instead of except AttributeError: important!)

@shesselbach Indeed this works well is master.  Can you please submit your maint-1.1 patch as a pull request?

authors: shesselbach tiborsimko

repo: inveniosoftware/invenio


text:
PendingLoans: sort loans by request start date.

closes: https://github.com/CERNDocumentServer/cds-ils/issues/627

As there is confusion, and both PRs modify the same code, I'm gonna implement the changes of both in https://github.com/inveniosoftware/react-invenio-app-ils/pull/506.

repo: inveniosoftware/react-invenio-app-ils


text:
Permission denied for mkdir: /home/inventree/data/static

Deployment Method

[ ] Installer
[ ] Docker Development
[X] Docker Production
[ ] Bare metal Development
[ ] Bare metal Production
[ ] Digital Ocean image
[ ] Other (please provide a link Steps to Reproduce

Describe the problem*
I've followed the install guide for docker production and after I run "docker compose run inventree-server invoke update" I get the error message "mkdir: cannot create directory '/home/inventree/data/static': Permission denied"
I am running the command as super user. Also all the other containers I've run so far, I never had this issue. So I'm a bit puzzled.
Due to this error the container "inventree-production-inventree-server-run-099234e15f89" exits with an error.
General solution from google did not work for me. But I am also still learning how to use docker correctly.
Any help would be appreciated.
Steps to Reproduce

download production directory from the repo with .env, docker-compose.yml and nginx.prod.conf files
configure only the .env file with external volume (/mnt/nas/DB/InvenTree/) etc.
switch to su
run command "docker compose run inventree-server invoke update"

Relevant log output
root@porty:/home/porty/Downloads/InvenTree# docker compose run inventree-server invoke update
[+] Running 2/2
 ✔ Network inventree-production_default  Created  0.2s
 ✔ Container inventree-db                Created  0.9s
[+] Running 1/1
 ✔ Container inventree-db  Started  0.6s
Creating directory /home/inventree/data/static
mkdir: cannot create directory ‘/home/inventree/data/static’: Permission denied

hi there @AlexPerni
have you checked if  your docker user has full rights on/mnt/nas/DB/InvenTree/ ? Maybe try to create a file
su docker -c "nano /mnt/nas/DB/InvenTree/test.txt"

Hi @matmair
that was it! Foolish beginners fault, I did not test if I can do anything on the external mounted storage.
Fixed it, thank you very much :)

Typical problem; even after 10 years sysadmin'ing I still run into it sometime.

We should add this to the FAQ

authors: AlexPerni SchrodingersGat matmair

repo: inventree/InvenTree


text:
[bug] displayed numbers on front page aren't independent of row settings

Please verify that this bug has NOT been raised before.

[X] I checked and didn't find a similar issue

Describe the bug*
hi again,
there is a small bug on the front page which in my opinion limits the usefulness of the page all together. If you have more then 25 items in a specific category, lets say low stock for example, then instead of the total number only a 25 will be displayed if the rows per page is set to 25:

Steps to Reproduce

have more then 25 items with low stock flag
go to front page
got to low stock entry
set rows per page to 25

Expected behaviour
Independent of the rows per page settings the total number of fitting entries should be shown.
Deployment Method

[ ] Docker
[X] Bare metal

Version Information
Version Information:
InvenTree-Version: 0.12.0 dev
Django Version: 3.2.18
Database: postgresql
Debug-Mode: True
Deployed using Docker: False
Active plugins: [{'name': 'InvenTreeBarcode', 'slug': 'inventreebarcode', 'version': '2.0.0'}, {'name': 'InvenTreeCoreNotificationsPlugin', 'slug': 'inventreecorenotificationsplugin', 'version': '1.0.0'}]
Relevant log output
No response

Can reproduce, thanks for the report @T0jan

I will leave this sitting for a bit for any beginner to pick if they want as it is a localised issue.
Basically, a filter is set by default on API calls by bootstrap-table, our table library. One fix is to set the limit to a higher, fixed value (maybe 101) and add a plus symbol to the badge if the number of records is higher than the set value (so display 100+ if the number of results is 101). You can set the parameter via the options. The specific one is documented here.


text:
Controller方法的属性问题

原方法属性是这样：

编织后的方法：

这样在请求进来之后，会报405错误，因为原方法的属性被移除了，加在了新方法上，而请求进来调用的是原方法名。
请问这个可以通过配置或者某个属性来实现不改变原方法的属性吗？

你用的版本是3.0.x，这个反馈过（ #75 ），已经修复了，更新到3.1.0以上就可以了，推荐直接更新到4.0.0

多谢。问题解决了

authors: inversionhourglass josephgugu

repo: inversionhourglass/Rougamo


text:
🛑 StartRisk Services is down

In a2b1741, StartRisk Services ($SERVICES_PING) was down:

HTTP code: 0
Response time: 0 ms

Resolved: StartRisk Services is back up in 0f1991a after 5 minutes.

repo: invig/startrisk-uptime


text:
Install process

Great project!
How is the PCB fitted into the controller? Do you have an images?


text:
[enhancement]: Support for Seamless tiling in 3.0.0

Is there an existing issue for this?

[X] I have searched the existing issues

Contact Details
No response
What should this feature add?
3.0.0 should support Seamless tiling, the same way that
Seamless tiling allows for textures to be generated during the image generation process. Users should be able to choose tiling along the X or Y access
Alternatives
No response
Aditional Content
No response

Duplicate of #3975

repo: invoke-ai/InvokeAI