text:
AWS CLI connectivity issue: Windows client to remote Scality

Description
aws s3 ls --endpoint-url=http://linux_box:8000 --debug
Falls back on SSL authentication and fails; should authenticate with HTTP
Steps to reproduce the issue
Follow standard set up documentation for a CentOS client
Then attempt to connect to said client via Windows AWS CLI as above
Note that "local" connectivity between Linux box and Scality is fine.
Note that curl, etc. return valid response (not a firewall issue)
Output:
l.s3.ListBuckets: calling handler <function add_expect_header at 0x000000000312D
6D8>
2018-02-08 16:43:09,601 - MainThread - botocore.hooks - DEBUG - Event before-cal
l.s3.ListBuckets: calling handler <bound method S3RegionRedirector.set_request_u
rl of <botocore.utils.S3RegionRedirector object at 0x0000000004296DD8>>
2018-02-08 16:43:09,601 - MainThread - botocore.endpoint - DEBUG - Making reques
t for OperationModel(name=ListBuckets) (verify_ssl=True) with params: {'body': '
', 'url': u'http://ut008693:8000/', 'headers': {'User-Agent': 'aws-cli/1.14.22 P
ython/2.7.9 Windows/7 botocore/1.8.26'}, 'context': {'auth_type': None, 'client_
region': 'us-east-1', 'signing': {'bucket': None}, 'has_streaming_input': False,
'client_config': <botocore.config.Config object at 0x0000000004296048>}, 'query
_string': '', 'url_path': u'/', 'method': u'GET'}
2018-02-08 16:43:09,601 - MainThread - botocore.hooks - DEBUG - Event request-cr
eated.s3.ListBuckets: calling handler <bound method RequestSigner.handler of <bo
tocore.signers.RequestSigner object at 0x000000000428AF98>>
2018-02-08 16:43:09,601 - MainThread - botocore.hooks - DEBUG - Event choose-sig
ner.s3.ListBuckets: calling handler <bound method ClientCreator._default_s3_pres
ign_to_sigv2 of <botocore.client.ClientCreator object at 0x0000000003FF2780>>
2018-02-08 16:43:09,601 - MainThread - botocore.hooks - DEBUG - Event choose-sig
ner.s3.ListBuckets: calling handler <function set_operation_specific_signer at 0
x0000000003126EB8>
2018-02-08 16:43:09,602 - MainThread - botocore.auth - DEBUG - Calculating signa
ture using v4 auth.
2018-02-08 16:43:09,602 - MainThread - botocore.auth - DEBUG - CanonicalRequest:
GET
/
host:ut008693:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b785
2b855
x-amz-date:20180208T164309Z
host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2018-02-08 16:43:09,604 - MainThread - botocore.auth - DEBUG - StringToSign:
AWS4-HMAC-SHA256
20180208T164309Z
20180208/us-east-1/s3/aws4_request
27c612558e8c3e70cc8adebff41ff6f869f570ebebecaea665787120d725b82c
2018-02-08 16:43:09,604 - MainThread - botocore.auth - DEBUG - Signature:
ea8b883a19c7ad42345bb70595f1e8827d1109e1cac85913fa0e21f5cd3f1b5c
2018-02-08 16:43:09,608 - MainThread - botocore.endpoint - DEBUG - Sending http
request: <PreparedRequest [GET]>
2018-02-08 16:43:09,608 - MainThread - botocore.vendored.requests.packages.urlli
b3.connectionpool - INFO - Starting new HTTP connection (1): ut008693
2018-02-08 16:43:09,648 - MainThread - botocore.vendored.requests.packages.urlli
b3.connectionpool - DEBUG - "GET / HTTP/1.1" 400 233
2018-02-08 16:43:09,651 - MainThread - botocore.parsers - DEBUG - Response heade
rs: {'content-length': '233', 'x-amz-id-2': '8538fda9a648a5b77e82', 'server': 'S
3 Server', 'connection': 'keep-alive', 'x-amz-request-id': '8538fda9a648a5b77e82
', 'date': 'Thu, 08 Feb 2018 16:43:09 GMT', 'content-type': 'application/xml'}
2018-02-08 16:43:09,651 - MainThread - botocore.parsers - DEBUG - Response body:
InvalidURICou
ld not parse the specified URI. Check your restEndpoints configuration.</Message

8538fda9a648a5b77e82
2018-02-08 16:43:09,653 - MainThread - botocore.hooks - DEBUG - Event needs-retr
y.s3.ListBuckets: calling handler <botocore.retryhandler.RetryHandler object at
0x0000000004296DA0>
2018-02-08 16:43:09,654 - MainThread - botocore.retryhandler - DEBUG - No retry
needed.
2018-02-08 16:43:09,654 - MainThread - botocore.hooks - DEBUG - Event needs-retr
y.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from
_error of <botocore.utils.S3RegionRedirector object at 0x0000000004296DD8>>
2018-02-08 16:43:09,655 - MainThread - botocore.hooks - DEBUG - Event after-call
.s3.ListBuckets: calling handler <function enhance_error_msg at 0x0000000003EA1D
D8>
2018-02-08 16:43:09,665 - MainThread - awscli.clidriver - DEBUG - Exception caug
ht in main()
Traceback (most recent call last):
File "awscli\clidriver.pyc", line 207, in main
File "awscli\customizations\commands.pyc", line 190, in call
File "awscli\customizations\commands.pyc", line 187, in call
File "awscli\customizations\s3\subcommands.pyc", line 475, in _run_main
File "awscli\customizations\s3\subcommands.pyc", line 540, in _list_all_bucket
s
File "botocore\client.pyc", line 317, in _api_call
File "botocore\client.pyc", line 615, in _make_api_call
ClientError: An error occurred (InvalidURI) when calling the ListBuckets operati
on: Could not parse the specified URI. Check your restEndpoints configuration.
2018-02-08 16:43:09,667 - MainThread - awscli.clidriver - DEBUG - Exiting with r
c 255

An error occurred (InvalidURI) when calling the ListBuckets operation: Could not
parse the specified URI. Check your restEndpoints configuration.
C:\Users\ahi17.aws>notepad dump.txt
C:\Users\ahi17.aws>aws s3 ls --endpoint-url=http://ut008693:8000 --debug > dump
.txt
2018-02-08 16:47:42,578 - MainThread - awscli.clidriver - DEBUG - CLI version: a
ws-cli/1.14.22 Python/2.7.9 Windows/7 botocore/1.8.26
2018-02-08 16:47:42,579 - MainThread - awscli.clidriver - DEBUG - Arguments ente
red to CLI: ['s3', 'ls', '--endpoint-url=http://ut008693:8000', '--debug']
2018-02-08 16:47:42,581 - MainThread - botocore.hooks - DEBUG - Event session-in
itialized: calling handler <function add_scalar_parsers at 0x0000000003E7E208>
2018-02-08 16:47:42,581 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,581 - MainThread - botocore.hooks - DEBUG - Event session-in
itialized: calling handler <function inject_assume_role_provider_cache at 0x0000
0000036D1CF8>
2018-02-08 16:47:42,581 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le credentials_file from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le config_file from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le metadata_service_timeout from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le metadata_service_num_attempts from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,582 - MainThread - botocore.hooks - DEBUG - Event session-in
itialized: calling handler <function attach_history_handler at 0x0000000003CF93C
8>
2018-02-08 16:47:42,584 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,584 - MainThread - botocore.hooks - DEBUG - Event building-c
ommand-table.s3: calling handler <function add_waiters at 0x0000000003E85198>
2018-02-08 16:47:42,585 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.s3.anonymous: calling handler <function uri_param at 0x00000000033A582
8>
2018-02-08 16:47:42,585 - MainThread - botocore.hooks - DEBUG - Event building-c
ommand-table.ls: calling handler <function add_waiters at 0x0000000003E85198>
2018-02-08 16:47:42,585 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.paths: calling handler <function uri_param at 0x00000000033A5828>
2018-02-08 16:47:42,585 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.human-readable: calling handler <function uri_param at 0x0000000003
3A5828>
2018-02-08 16:47:42,586 - MainThread - botocore.hooks - DEBUG - Event process-cl
i-arg.custom.ls: calling handler <awscli.argprocess.ParamShorthandParser object
at 0x00000000036ADE80>
2018-02-08 16:47:42,586 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.page-size: calling handler <function uri_param at 0x00000000033A582
8>
2018-02-08 16:47:42,586 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.anonymous: calling handler <function uri_param at 0x00000000033A582
8>
2018-02-08 16:47:42,586 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.request-payer: calling handler <function uri_param at 0x00000000033
A5828>
2018-02-08 16:47:42,588 - MainThread - botocore.hooks - DEBUG - Event load-cli-a
rg.custom.ls.summarize: calling handler <function uri_param at 0x00000000033A582
8>
2018-02-08 16:47:42,588 - MainThread - botocore.hooks - DEBUG - Event process-cl
i-arg.custom.ls: calling handler <awscli.argprocess.ParamShorthandParser object
at 0x00000000036ADE80>
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le region from config file with value 'us-east-1'.
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le ca_bundle from defaults.
2018-02-08 16:47:42,588 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,589 - MainThread - botocore.session - DEBUG - Loading variab
le api_versions from defaults.
2018-02-08 16:47:42,589 - MainThread - botocore.credentials - DEBUG - Looking fo
r credentials via: env
2018-02-08 16:47:42,589 - MainThread - botocore.credentials - DEBUG - Looking fo
r credentials via: assume-role
2018-02-08 16:47:42,589 - MainThread - botocore.credentials - DEBUG - Looking fo
r credentials via: shared-credentials-file
2018-02-08 16:47:42,591 - MainThread - botocore.credentials - INFO - Found crede
ntials in shared credentials file: ~/.aws/credentials
2018-02-08 16:47:42,592 - MainThread - botocore.loaders - DEBUG - Loading JSON f
ile: C:\Program Files\Amazon\AWSCLI\botocore\data\endpoints.json
2018-02-08 16:47:42,612 - MainThread - botocore.session - DEBUG - Loading variab
le profile from defaults.
2018-02-08 16:47:42,612 - MainThread - botocore.hooks - DEBUG - Event choose-ser
vice-name: calling handler <function handle_service_name_alias at 0x000000000310
0D68>
2018-02-08 16:47:42,615 - MainThread - botocore.loaders - DEBUG - Loading JSON f
ile: C:\Program Files\Amazon\AWSCLI\botocore\data\s3\2006-03-01\service-2.json
2018-02-08 16:47:42,654 - MainThread - botocore.hooks - DEBUG - Event creating-c
lient-class.s3: calling handler <function add_generate_presigned_post at 0x00000
000030D0CF8>
2018-02-08 16:47:42,654 - MainThread - botocore.hooks - DEBUG - Event creating-c
lient-class.s3: calling handler <function add_generate_presigned_url at 0x000000
00030D0B38>
2018-02-08 16:47:42,655 - MainThread - botocore.args - DEBUG - The s3 config key
is not a dictionary type, ignoring its value of: None
2018-02-08 16:47:42,660 - MainThread - botocore.endpoint - DEBUG - Setting s3 ti
meout as (60, 60)
2018-02-08 16:47:42,661 - MainThread - botocore.client - DEBUG - Registering ret
ry handlers for service: s3
2018-02-08 16:47:42,661 - MainThread - botocore.client - DEBUG - Using S3 path s
tyle addressing.
2018-02-08 16:47:42,663 - MainThread - botocore.hooks - DEBUG - Event before-par
ameter-build.s3.ListBuckets: calling handler <function validate_bucket_name at 0
x00000000031172E8>
2018-02-08 16:47:42,663 - MainThread - botocore.hooks - DEBUG - Event before-par
ameter-build.s3.ListBuckets: calling handler <bound method S3RegionRedirector.re
direct_from_cache of <botocore.utils.S3RegionRedirector object at 0x000000000429
2DD8>>
2018-02-08 16:47:42,663 - MainThread - botocore.hooks - DEBUG - Event before-par
ameter-build.s3.ListBuckets: calling handler <function generate_idempotent_uuid
at 0x0000000003100F98>
2018-02-08 16:47:42,664 - MainThread - botocore.hooks - DEBUG - Event before-cal
l.s3.ListBuckets: calling handler <function add_expect_header at 0x0000000003117
6D8>
2018-02-08 16:47:42,664 - MainThread - botocore.hooks - DEBUG - Event before-cal
l.s3.ListBuckets: calling handler <bound method S3RegionRedirector.set_request_u
rl of <botocore.utils.S3RegionRedirector object at 0x0000000004292DD8>>
2018-02-08 16:47:42,664 - MainThread - botocore.endpoint - DEBUG - Making reques
t for OperationModel(name=ListBuckets) (verify_ssl=True) with params: {'body': '
', 'url': u'http://ut008693:8000/', 'headers': {'User-Agent': 'aws-cli/1.14.22 P
ython/2.7.9 Windows/7 botocore/1.8.26'}, 'context': {'auth_type': None, 'client_
region': 'us-east-1', 'signing': {'bucket': None}, 'has_streaming_input': False,
'client_config': <botocore.config.Config object at 0x0000000004292048>}, 'query
_string': '', 'url_path': u'/', 'method': u'GET'}
2018-02-08 16:47:42,664 - MainThread - botocore.hooks - DEBUG - Event request-cr
eated.s3.ListBuckets: calling handler <bound method RequestSigner.handler of <bo
tocore.signers.RequestSigner object at 0x0000000004286F98>>
2018-02-08 16:47:42,664 - MainThread - botocore.hooks - DEBUG - Event choose-sig
ner.s3.ListBuckets: calling handler <bound method ClientCreator._default_s3_pres
ign_to_sigv2 of <botocore.client.ClientCreator object at 0x0000000003FF5780>>
2018-02-08 16:47:42,664 - MainThread - botocore.hooks - DEBUG - Event choose-sig
ner.s3.ListBuckets: calling handler <function set_operation_specific_signer at 0
x0000000003100EB8>
2018-02-08 16:47:42,665 - MainThread - botocore.auth - DEBUG - Calculating signa
ture using v4 auth.
2018-02-08 16:47:42,665 - MainThread - botocore.auth - DEBUG - CanonicalRequest:
GET
/
host:ut008693:8000
x-amz-content-sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b785
2b855
x-amz-date:20180208T164742Z
host;x-amz-content-sha256;x-amz-date
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
2018-02-08 16:47:42,667 - MainThread - botocore.auth - DEBUG - StringToSign:
AWS4-HMAC-SHA256
20180208T164742Z
20180208/us-east-1/s3/aws4_request
465a69ee0e0b528b6069e5ff271165592545d6b19cbfbb5b35ab7072a5fa816b
2018-02-08 16:47:42,667 - MainThread - botocore.auth - DEBUG - Signature:
94238c93cce93122c6ee314e932d281a6ec02a6d36d9547487a1a76be486936d
2018-02-08 16:47:42,671 - MainThread - botocore.endpoint - DEBUG - Sending http
request: <PreparedRequest [GET]>
2018-02-08 16:47:42,671 - MainThread - botocore.vendored.requests.packages.urlli
b3.connectionpool - INFO - Starting new HTTP connection (1): ut008693
2018-02-08 16:47:42,707 - MainThread - botocore.vendored.requests.packages.urlli
b3.connectionpool - DEBUG - "GET / HTTP/1.1" 400 233
2018-02-08 16:47:42,709 - MainThread - botocore.parsers - DEBUG - Response heade
rs: {'content-length': '233', 'x-amz-id-2': 'f02356fe4d41bb671a51', 'server': 'S
3 Server', 'connection': 'keep-alive', 'x-amz-request-id': 'f02356fe4d41bb671a51
', 'date': 'Thu, 08 Feb 2018 16:47:42 GMT', 'content-type': 'application/xml'}
2018-02-08 16:47:42,710 - MainThread - botocore.parsers - DEBUG - Response body:
InvalidURICou
ld not parse the specified URI. Check your restEndpoints configuration.</Message

f02356fe4d41bb671a51
2018-02-08 16:47:42,710 - MainThread - botocore.hooks - DEBUG - Event needs-retr
y.s3.ListBuckets: calling handler <botocore.retryhandler.RetryHandler object at
0x0000000004292DA0>
2018-02-08 16:47:42,710 - MainThread - botocore.retryhandler - DEBUG - No retry
needed.
2018-02-08 16:47:42,710 - MainThread - botocore.hooks - DEBUG - Event needs-retr
y.s3.ListBuckets: calling handler <bound method S3RegionRedirector.redirect_from
_error of <botocore.utils.S3RegionRedirector object at 0x0000000004292DD8>>
2018-02-08 16:47:42,710 - MainThread - botocore.hooks - DEBUG - Event after-call
.s3.ListBuckets: calling handler <function enhance_error_msg at 0x0000000003E7AD
D8>
2018-02-08 16:47:42,713 - MainThread - awscli.clidriver - DEBUG - Exception caug
ht in main()
Traceback (most recent call last):
File "awscli\clidriver.pyc", line 207, in main
File "awscli\customizations\commands.pyc", line 190, in call
File "awscli\customizations\commands.pyc", line 187, in call
File "awscli\customizations\s3\subcommands.pyc", line 475, in _run_main
File "awscli\customizations\s3\subcommands.pyc", line 540, in _list_all_bucket
s
File "botocore\client.pyc", line 317, in _api_call
File "botocore\client.pyc", line 615, in _make_api_call
ClientError: An error occurred (InvalidURI) when calling the ListBuckets operati
on: Could not parse the specified URI. Check your restEndpoints configuration.
2018-02-08 16:47:42,714 - MainThread - awscli.clidriver - DEBUG - Exiting with r
c 255

An error occurred (InvalidURI) when calling the ListBuckets operation: Could not
parse the specified URI. Check your restEndpoints configuration.

Adding "linux_box": "us-east-1", inside the "restEndpoints" section of your config.json should fix your issue.


text:
renamed example dashboard and updated TA's readme file

Jira Link: https://sentinelone.atlassian.net/browse/{TICKET}
🥅 Goal
Explain why is this change needed
🛠 Solution
Provide description of changes
🏫 Testing
How the changes were tested

Thanks.
This PR broke end to end tests (https://github.com/scalyr/dataset-addon-for-splunk/actions/runs/6278160603/job/17051334128), but I think this commit should fix it - ecf3a584ec910b8bfee5d60ca4e4ee5b8808f2a3.

source: gharchive/pull-request

repo: scalyr/dataset-addon-for-splunk

license_type: permissive

license_source: github-api


text:
How to create a controller file

Hi All,
I am using following command for invite friends
in Gemfile
gem 'devise_invitable', '~> 1.5.2'   and entered following commands in terminal
budle install
bundle exec rails generate devise_invitable:install
bundle exec rails generate devise_invitable:views
Views file are generated but controller files are not generated. What should I do and what the next steps to get it. Please hands to me

You don't need to generate controllers if you don't need to change anything, really you don't need to generate views if default views are ok for you.
If you need a controller, create it by yourself, create it blank file or use rails g controller, then follow steps on README: https://github.com/scambra/devise_invitable#configuring-controllers

Then, When my enter the following URL it returns
No route matches [GET] "/users/invitations"
No route matches [GET] "/users/invitations/new"
What Should I do

You missed rails generate devise_invitable User

Yes. I have missed the code your pointed out on my first chatting in this loop. But on my code i have correctly do it. Like as
gem 'devise_invitable', '~> 1.5.2'
bundle install
bundle exec rails generate devise_invitable:install
bundle exec rails generate devise_invitable user
bundle exec rake db:migrate
bundle exec rails generate devise_invitable:views
But it will returns
No route matches [GET] "/users/invitations"
No route matches [GET] "/users/invitations/new"

Did you add devise_for :users to your routes? It isn't in README of DeviseInvitable, because it's a needed step for devise

In my routes.rb
devise_for :users, :controllers => { :invitations => 'users/invitations' }
how can I execute it?.

what's output for rake routes CONTROLLER=users/invitations?

Sorry, I didn't get your point.
But when I entered following two URL it returns "ActionController::RoutingError No routes matches"
"/users/invitations"
"/users/invitations/new"

There is something wrong in your app, you must have config/routes.rb with:
Rails.application.routes.draw do
  devise_for :users, :controllers => { :invitations => 'users/invitations' }
  [other routes for your app]
end

Or your file is missing or something is wrong with file and rails find no routes.
rake routes in terminal should list all routes defined for your app

Here I shared the screen shot of my all routes

/users/sign_in only workable but I don't know the username and password. And all other routes are No routes matches is only displayed
Please help me !!!!!

Probably you wrote wrong command when looking for invitations routes:
bundle exec rake routes CONTROLLER=users/invitations
? should not added to command, I was asking you
Anyway, you can see all routes in that screenshot, you can see there is no /users/invitations route, it's /users/invitation but POST, not GET, to create invitation with form. And there is no route /users/invitations/new, it's /users/invitation/new. So you should open /users/invitation/new in your browser

Here I using production mode for application, not development mode.
for production mode, we should use "bundle exec" keyword before the command "rake routes CONTROLLER=users/invitations?"
When  "/users/invitation/new" it should returns
RuntimeError (Circular dependency detected while autoloading constant Users::InvitationsController)

bundle exec doesn't harm, ensure gem versions from gemfile are loaded.
About circular dependency, you may have wrong parent controller for Users::InvitationsController, is it class Users::InvitationsController < Devise::InvitationsController?

Can I know, where should I changed this ?
class Users::InvitationsController < Devise::InvitationsController

You created users/invitations_controller.rb becuase you want to change some controller behaviour, or add some methods. That controller must inherit from Devise::InvitationsController

Then I have one doubt about this, Now I changed in routes.rb is it right?
in routes.rb
devise_for :users
instead of
devise_for :users, :controllers => { :invitations => 'users/invitations' }

If you have devise_for :users, you will use default controller (Devise::InvitationsController, provided by devise_invitable gem), not your controller.
Configuring controllers is pretended to change default behaviour, if you don't need to change the controller's behavior, you don't need to generate your own controller and you don't need to change routes, you can use devise_for :users

Yes. Thanks now working.
But the links are not shown.
Manually I entered the URL when user login and logout

There is no default link, you can add it to your layout or any view you want to have link to invite

Okay. well
When user click a Accept invitation friend link, the invitation is not accepted. What I do?

source: gharchive/issue

authors: karthickms scambra

license: mit

license_source: bigquery


text:
Update dynamodb to 2.17.152

Updates software.amazon.awssdk:dynamodb from 2.17.125 to 2.17.152.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "software.amazon.awssdk", artifactId = "dynamodb" } ]

labels: library-update, early-semver-patch, semver-spec-patch, commit-count:1

Superseded by #1404.

repo: scanamo/scanamo


text:
#19 Fixed no tests ran when --tags unspecified

Fix for issue #19
When no --tags is specified it should collect all testcases as selected.

Added testcase to catch scenario

Lol, nice one. I will fix the lints tomorrow and cut a release, thanks!

authors: Stefanhg scastlara

repo: scastlara/pytest-tagging

license: MIT


text:
Question about dexhand pose generation

Hello, thanks for your excellent work.
However, when i am following instruction of task 3, i have encountered this error:
(scenediff) xinglj@user-SYS-4029GP-TRT:/data/xinglj/Scene-Diffuser$ bash scripts/grasp_gen_ur/train.sh xlj01
/data/xinglj/miniconda3/envs/scenediff/lib/python3.8/site-packages/torch/utils/_contextlib.py:125: UserWarning: Decorating classes is deprecated and will be disabled in future versions. You should only decorate functions or methods. To preserve the current behavior of class decoration, you can directly decorate the __init__ method and nothing else.
warnings.warn("Decorating classes is deprecated and will be disabled in "
Traceback (most recent call last):
File "train.py", line 14, in
from models.visualizer import create_visualizer
File "/data/xinglj/Scene-Diffuser/models/visualizer.py", line 133, in
class MotionGenVisualizer():
File "/data/xinglj/Scene-Diffuser/utils/registry.py", line 61, in deco
self._do_register(name, func_or_class)
File "/data/xinglj/Scene-Diffuser/utils/registry.py", line 45, in _do_register
assert (
AssertionError: An object named '' was already registered in 'Visualizer' registry!
could you please offer any help about this? many thanks.

Hi, which version of PyTorch are you using? If you're using PyTorch 2, the error might be related to this issue: https://github.com/scenediffuser/Scene-Diffuser/issues/8

thanks a lot, will try it.
by the way, there's another question about the figure 5 in your paper. how can you export the mesh of shadow? thanks.

I have found the corresponding function. Thanks.

repo: scenediffuser/Scene-Diffuser


text:
🛑 EC-Balzheim is down

In c3a2029, EC-Balzheim (https://www.ec-balzheim.de) was down:

HTTP code: 0
Response time: 0 ms

Resolved: EC-Balzheim is back up in 283c05e after 17 minutes.

repo: schliesser/upptime


text:
Updated documentation for Ubuntu install

The currently posted documentation for Deb/Ubuntu installs could use a little fleshing out. As requested I've cleaned mine up to better fit your format and included below.

DEB based install
Software Installation
Install the pre-requisites
aptitude install apache2 mysql-server ruby libalgorithm-diff-perl libjson-perl libxml-simple-perl libhtml-tree-perl libapache2-mod-perl2

Download and install the Seccubus application
wget https://github.com/schubergphilis/Seccubus_v2/releases/download/x/seccubus_x.Bx_all.deb
dpkg -i seccubus_2.x.Bx_all.deb

Update the configuration file in /etc/seccubus/config.xml
Configure the Database
Now create the database and populate the database with the following commands:
mysql -u root -p << EOF
create database seccubus;
grant all privileges on seccubus.* to seccubus@localhost identified by 'seccubus';
flush privileges;
EOF
mysql -u seccubus -pseccubus seccubus < /var/lib/seccubus/structure_vx.mysql
mysql -u seccubus -pseccubus seccubus < /var/lib/seccubus/data_vx.mysql

Replace structure_vx.mysql and data_vx.mysql with the highest versioned file in the directory.
Web Server Setup
Make any necessary changes to /etc/apache2/conf.d/seccubus.conf. Once completed run the following
commands to properly load the necessary Apache modules.:
a2enmod perl
a2enmod cgi

Restart the webserver and surf to http://localhost/seccubus/ to start using seccubus
service httpd restart

Should be published on https://seccubus.com/documentation/seccubus-v2-on-debian/ within a few minutes.

authors: packs seccubus


text:
"Top of Round" alert does not fire if "Repeating" is true

Creating a "Top of Round" alert using these settings will result in the alert not firing:
Trigger after rounds = 1
Repeat frequency = 1

Thanks for the report! This should be fixed in the next version, which I hope to release today.

authors: j-schoch schultzcole

repo: schultzcole/FVTT-Turn-Alert


text:
falsey → falsy

Both look acceptable, but falsy is is more common than falsey, especially in contemporary English:
https://books.google.com/ngrams/graph?content=falsy%2Cfalsey&year_start=1800&year_end=2019&corpus=en-2019

Could you add it to the relevant pre-commit check?

I don't know which is the relevant pre-commit check.

https://github.com/scientific-python/cookie/blob/88dc8212f740783d4a74b239429c35950a73a8bd/.pre-commit-config.yaml#L79

I don't get it, I haven't changed capitalization.

You can make a new entry like that for disallowed words if you don't like the "disallow caps" title:
      - id: disallow-words
        name: Disallow certain words
        language: pygrep
        entry: '[Ff]alsey'
        exclude: .pre-commit-config.yaml$

authors: DimitriPapadopoulos henryiii

repo: scientific-python/cookie


text:
hdmedians is not available from conda-forge for windows

hdmedians is unavailable from conda-forge on windows. Adding windows support is a goal of scikit-bio over the next year. Currently hdmedians is only used in a single function in skbio:  _permdisp._config_med().
We may consider implementing hdmedians within skbio, as hdmedians has the Apache 2.0 license which may be compatible with our own license. Alternatively we may consider replacing hdmedians with another package which is available on conda-forge for windows and more actively maintained.
@qiyunzhu had this idea initially. @wasade and @mortonjt what are your thoughts?

Looking at the source code, it actually looks pretty minimal. The only
possible concern is porting the extra cython code from hdmedians - we’d
need to make sure that the cython code also ports to windows
On Tue, Mar 26, 2024 at 6:14 PM Matt Aton @.***> wrote:

hdmedians https://github.com/daleroberts/hdmedians is unavailable from
conda-forge on windows. Adding windows support is a goal of scikit-bio over
the next year. Currently hdmedians is only used in a single function in
skbio: _permdisp._config_med().
We may consider implementing hdmedians within skbio, as hdmedians has the
Apache 2.0 license which may be compatible with our own license.
Alternatively we may consider replacing hdmedians with another package
which is available on conda-forge for windows and more actively maintained.
@qiyunzhu https://github.com/qiyunzhu had this idea initially. @wasade
https://github.com/wasade and @mortonjt https://github.com/mortonjt
what are your thoughts?
—
Reply to this email directly, view it on GitHub
https://github.com/scikit-bio/scikit-bio/issues/1996, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AA75VXOEJ2H4NAGUEMLYVE3Y2HXM5AVCNFSM6AAAAABFJYYZ6KVHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYDSNBTGYYDEMI
.
You are receiving this because you were mentioned.Message ID:
@.***>

@mataton This is great to know! Thanks! Yes let's port hdmedians.
The relevant hdmedians function is geomedian, which in turn calls geomedian_axis_one. I think that geomedian_axis_one is the only function we need to port (along with any utility functions it calls, like dist_euclidean and norm_euclidean).

Looks good, would stats/distance/_utils.py be a good place to put these?

Closed with PR #2003.

authors: mataton mortonjt qiyunzhu

repo: scikit-bio/scikit-bio


text:
Extend integration tests

Following parts need integration tests:

Reissued certificate:
Make a client which sends a certificate reissuance request and validates that a correct certificate response is received (done as acceptance test)
Signed payloads:
Sending and receiving signed payloads. Also, the test should ensure that some of the required certificates are missing locally and need to be fetched from the certificate server.

Closing this due to age. The entire control-plane PKI is moving to X.509 (see here), so this is no longer up-to-date.

authors: Oncilla scrye

repo: scionproto/scion


text:
MasterASKey rollover

Currently, that MasterASKey cannot be changed. According to the SCION book this key should change every couple of days. The current proposal to do this having at most two keys active (to enable seemless key rollover) and adding a 'keyslot' bit to each HopField that indicates which key slot is used for the hop field.

The BS would be in charge of master key rollover. The BR doesn't actually need the master key, it only needs the hopfield MAC key if i remember correctly. In that case the BS would send a command to the BR saying "update your hopfield MAC key on slot [01]", and the BR needs to persist this to disk to survive restarting the process.

authors: kormat shitz


text:
Changes to Dispatcher

Hey,
I am currently working on my bachelor thesis for "Improving packet processing speeds on SCION endhosts" at the University of Magdeburg at the chair of Prof. Dr. David Hausheer. We want to evaluate an XDP approach that was already mentioned within #3961 and prototyped by @martenwallewein to raise package processing speeds at SCION end hosts. Therefore, we want to make changes to the current dispatcher. It is one of the main goals of this thesis to upstream the changes to scionproto, that future work can be done on this approach.
#3961 mentions, that you do want to remove the dispatcher in the near term.  Therefore I have multiple questions:
1. Is there a road map for this change?
2. Do you still upstream changes for the dispatcher?
2.1. Would you potentially upstream a change implementing an optional XDP accelerated version of the dispatcher?
We think about an in-place implementation in the existing dispatcher. This would allow us to access the needed information without any problems and provide a drop-in solution for all users of the dispatcher. Also, we want to make sure that the dispatcher and the snet library are also able to work without an XDP accelerated version for legacy and non XDP compatible environments.
2.2. Would you potentially upstream a change exposing the application registration information?
We could also think of a change to expose the needed application registration information to use with an external control binary. We need this information to make sure routing the correct packages to the correct application and passing the packages we do not want to handle to the existing dispatcher.
If you need further information about those changes, feel free to contact me or @martenwallewein (my supervisor).
Thanks in Advance!
Best Regards,
Johann

Hi @johannwagner. Thanks a lot for your inquiry. See  my answers inline.

#3961 mentions, that you do want to remove the dispatcher in the near term. Therefore I have multiple questions:
1. Is there a road map for this change?

There is not a specific roadmap yet, but we'd like to get it done in H2 2021.

2. Do you still upstream changes for the dispatcher?
2.1. Would you potentially upstream a change implementing an optional XDP accelerated version of the dispatcher?
We think about an in-place implementation in the existing dispatcher. This would allow us to access the needed information without any problems and provide a drop-in solution for all users of the dispatcher. Also, we want to make sure that the dispatcher and the snet library are also able to work without an XDP accelerated version for legacy and non XDP compatible environments.

Given that we plan to drop dispatcher support I don't really see a good chance for this to be upstreamed. This would increase the maintenance burden and also introduce new tech (XDP), which is non-trivial and needs some expertise to maintain. Instead, I propose to implement such a dispatcher in a separate project/repository. We would be glad to link to it from the main README.

2.2. Would you potentially upstream a change exposing the application registration information?
We could also think of a change to expose the needed application registration information to use with an external control binary. We need this information to make sure routing the correct packages to the correct application and passing the packages we do not want to handle to the existing dispatcher.

Could you elaborate on this further? I don't quite understand what you intend to do here.
-Sam

Hey,
thanks for your answer!
Prof. Dr. Hausheer already mentioned within a meeting that we should think about a solution without touching the dispatcher due to its deprecation plans. So we thought about a solution with another control binary, which is not the dispatcher to deploy our XDP approach. As far as we know we need the application registration information to achieve our goal to make sure routing only the correct packages directly to the applications.
Therefore we thought about a minimal PR introducing the possibility to extract information about application registrations from the dispatcher to utilize them within a control binary for your XDP approach. This can be done by utilizing another UNIX socket or exposing a REST API or adding that information to the Prometheus endpoint.
Best, Johann

Therefore we thought about a minimal PR introducing the possibility to extract information about application registrations from the dispatcher to utilize them within a control binary for your XDP approach. This can be done by utilizing another UNIX socket or exposing a REST API or adding that information to the Prometheus endpoint.

I don't quite understand. My understanding is that in such a setting the dispatcher should be bypassed, i.e., the application does not register with the dispatcher at all. How would you then get the relevant information from the dispatcher?

Hey Sam,
thanks for joining the discussion! We do not want to bypass the whole dispatcher with the ebpf approach, but only the packet forwarding logic for particular apps. From #3961, if I understand correctly, the consens is at the moment to let apps open regular UDP ports and to keep the "dispatcher" port 30041 for all incoming SCION packets, to avoid having the port rewriting (copy SCION UDP dest port into UDP dest port so that packets arrive at the applications sockets) done in the border routers. This means, we need a component that does exactly this, which also handles SCMP messages, e.g. port unreachable if a SCION packet arrives having a SCION UDP port that does not match any listening application.
The information we need from the dispatcher is: Which SCION apps are registerend and listen on which UDP ports, so that we can only rewrite ports for those registered SCION applications in ebpf and pass all other packets untouched to the kernel (e.g. those packets that would require sending back SCMP messages, which can not be done in ebpf). This was our intention to put it in the dispatcher for the moment.
So in case our understanding of this forwarding/rewriting is correct, than we would gladly like to help with this aspect to find a solution to which our ebpf approach could later be attached in an easy way. Otherwise, it would be great if we can clarify this. Having the ebpf part outside of the SCION repo is, as mentioned before, also fine for us.
Best,
Marten

Hi @martenwallewein
Thanks for the clarifications. It makes sense to me now.
If we do the port rewriting on the endhost and thus have something akin to the "dispatcher" (let's call it "dispatcher-ng") that wouldn't get any registrations from SCION apps anymore, since the dispatcher-ng would use the L4 information to rewrite the port. How do you imagine this to work with the external utility that installs the EBPF programs? To me it seems that this component would need to get that information from somewhere else.

I see, thanks for the response. We got a bit confused with the current state using the dispatcher and the planned state that does not use any app registrations (which removes the dependency to the "dispatcher-ng" and the reconnects, right?) .
To solve this for ebpf without adding app registration, we are currently thinking about fetching open udp ports in the control binary and share this list with the ebpf code, so that we can check if an app is listening behind the SCION udp port for incoming SCION packets. But thats not related to the dispatcher or the dispatcher-ng anymore and will probably be extract completely into a separated component.
It would be great if we could keep this issue open anyhow for further discussion (maybe we could rename it, because it does not reflect changes to the dispatcher anymore)

Hey @martenwallewein, @johannwagner, you do not have to send "Port unreachable" SCMP messages, this is optional. The dispatcher does not currently implement this either, the packets are just silently dropped. I'd suggest to keep it simple, at least for the start, and just ignore open/closed ports in your ebpf component.

Hey @matzf, good to know that it's not implemented at the moment. @johannwagner already found a way to keep a list of open ports, so we will be ready once this is implemented in the dispatcher or its successor.

The dispatcher has been dropped in the meantime

authors: johannwagner martenwallewein matzf oncilla shitz


text:
Reduce unit tests runtime

Running the unit tests is taking a long time (circa 10 minutes on CI).
We should try to reduce this.
This is most probably due to running workflows on full loki/sans2d data, which contains many pixels, leading to expensive memory allocations.
We should reduce the data to just a few pixels. We could for example extract a vertical line or slab of pixels, that would still have a discernable scattering pattern, but would be much less expensive.
Note that in the process, we would need a new detector bank shape specific for the tests.

Note that the docs are also quite long to build, maybe something similar can be done there?

This will be easy to do for our own files, but not for the ISIS ones, I think?

I think we are loading hdf5 scipp format files that we created from the ISIS files? If so, we can do the same selecting a vertical strip of pixels? (maybe we want to keep a cross (+) of pixels so we can also compute Qx, Qy?

Maybe simply keeping every 2nd or 4th pixel would get us far enough?

authors: SimonHeybrock nvaytet

repo: scipp/esssans


text:
ci: Add lint workflow and ci workflow

Purpose

Make the testing GitHub Actions workflow a seperate workflow from the linting
workflow.
Update GitHub Action versions to the latest major version tags.

At the moment this just runs the tests and coverage, but it doesn't report them at all, but as we don't have full tests yet this is left as a stub intentionally.
Does this introduce a breaking change?

[ ] Yes
[x] No

The CI complaining here is expected
/opt/hostedtoolcache/Python/3.12.2/x64/lib/python3.12/site-packages/coverage/control.py:887: CoverageWarning: No data was collected. (no-data-collected)
  self._warn("No data was collected.", slug="no-data-collected")

as we aren't giving it tests to collect yet.

repo: scipy-conference/assign-reviews


text:
TST: test_location_scale proper 32bit Linux skip

the test skip was not being applied properly for test_location_scale() per the Debian report in gh-17839; I reproduced in a i386/debian Docker container that was running a 32-bit interpreter on a 64-bit base machine

the adjustment used here allows the test to skip properly when using a 32-bit interpreter, even on a 64-bit machine

as an aside, I'm pretty sure we do this kind of logic in many different places in NumPy and SciPy, sometimes using sys.maxsize instead, etc.

This SO post seems to suggest that examining sys.maxsize is preferred.

So do the Python docs, but it was working so I went with it. It seems like a fairly obscure scenario, and we already short-circuit MacOS in the check:

Feel free to push over if you want...

It is a one-line test skipping adjustment I tested in a Docker container with a core dev approval, so I'm going to merge it as we look toward a bug-fix release soon-ish.

authors: andyfaff tylerjereddy

repo: scipy/scipy


text:
Revert "DEP: make import scipy.stats.stats raise a deprecation warning"

This reverts commit d93b3bd4b62715e2a88f7d9ad54b6d86b63052d6.
Sorry early morning screw up!

Reference issue

What does this implement/fix?

Additional information

This has saved me a few times:
https://stackoverflow.com/questions/10260311/git-how-to-disable-push

authors: j-bowhay mdhaber


text:
MAINT: Update fast_matrix_market to 1.7.4

Keep in sync with upstream.
The changes are purely on the C++ side. Mainly:

Fix #include errors on GCC 13, though this has already been patched in #19409
Support for C++23 fixed-width floating point types, and string types.
New mechanism to handle symmetric Matrix Market files. May in the future replace the current Python method.

Check fails in unrelated modules.
Upstream tests on 32-bit Linux and Python 3.12.


text:
Added a sanity check to signal.savgol_filter

ENH: added a sanity check to the scipy.signal.savgol_filter
When using savgol_filter with mode's default parameter "interp", passing an x array with a size less than the window_length results in a rather cryptic TypeError raised back in numpy.polyfit with the message "expected x and y to have the same length". This message offers no indication that the x size in relation to the window_length is causing the issue. I've included a value check with a more informative error message. The check piggy backs off of the mode == "interp" code flow, as it only affects that mode.

Looks like a good change to me. The TravisCI test failures are unrelated.

Merged by squash, thanks @SunsetOrange

Cheers all!

authors: Eric89GXL SunsetOrange perimosocordiae


text:
Geocentric spherical coordinates are missing?

pymap3d is awesome, but seems to be missing a one basic coordinate system that would be useful: spherical ECEF. Currently one can do ecef2geodetic and vice versa, but not sph2geodetic and vice versa.
For example, if a user wants to convert geodetic lat/lon/alt to geocentric lat/lon/alt, they need to convert to XYZ ECEF with geodetic2ecef and then manually calculate spherical geocentric coordinates themselves. Is this by design? If not, would it be acceptable for me to submit a PR adding this to the library?

I submitted a pull request which contains a function 'geodetic2geocentric' that would do what you want.  It also has geocentric2geodetic.
See here:
https://github.com/rpavlick/pymap3d/blob/master/pymap3d/latitude.py

Thank you. I had found some numerical issues that I was resolving with the PR, I will try to finish this implementation. Thanks and thanks!

This work is in the https://github.com/scivision/pymap3d/tree/rcurve branch, based on that PR

The geocentric <=> geodetic conversions are added in pymap3d v2.0.1.  Thanks!

@asreimer v2.1 was just released, adding many more functions of this sort.

Thank you!

authors: asreimer rpavlick scivision


text:
add 'make syntaxcheck'

We could employ ShellCheck or some other static analysis tools (or even plain sed calls...)
Moved from sclorg/postgresql-container#210.

This is already solved. make shellcheck does the magic, right?

Feel free to reopen it.

authors: phracek praiskup

repo: sclorg/container-common-scripts


text:
Enable c6 vagrant box test

We should validate the CentOS Linux 6 Vagrant box is usable too.

The reason I have this as its own test that can be enabled/disabled is that it would then help use the same tests to validate Vagrant boxes being built in cbs, in addition to the sco-vagrant1 scl itself.

Thanks! Merging.

authors: hhorak kbsingh

repo: sclorg/sclo-ci-tests


text:
Include extra information on "Invalid data parsing payload" error

Fixes #7

Updated.

repo: scottgonzalez/node-git-notifier


text:
NameError: global name 'exit' is not defined

So I tried running ICE recently after installing new cores on RetroArch and got this error. Any ideas?

ICE no longer has developer support for issues. Please reference issue #473 and hopefully that helps. Thanks!

authors: HEspoke NAFEDUDE

repo: scottrice/Ice


text:
Does not support hash routes

In next/router proper, I am seeing asPath values that include the URL hash as I expect. However, passing hashes to next-router-mock is removing hashes. It looks like the pathing logic only deals with pathname and query but doesn't preserve hash so my tests are "passing" even though at runtime the behavior is different (and failing) causing a false-positive test suite.
router.push('/page#hash=true');
router.push(new URL('/page#hash=true', 'https://www.google.com'));

console.log(asPath);
// logs: "/page"

Fixed in 0.6.3!

You the best!

authors: kamranayub scottrippey

repo: scottrippey/next-router-mock


text:
Need to reinstance after update

Hi,
Very nice work with the mongita project!
I have just started experimenting with it.
I have found that if i write to a collection in one process and reads from it in another, the values when reading will not be updated without reinstance the MongitaClient. From behaviour it seems like the full db is loaded to memory? is there a function I can use to refresh?
I was testing this with MongitaClientDisk.
If I open two instances of the same db and collection in the same process the changes to the collection is reflected immediately.
Best regards.

Hi @LMSAas. Apologies for my delay in getting back to you.
Mongita is not process-safe and is only experimentally thread-safe. Usually, for separate processes, you would want something like a full-blown MongoDB installation. I'm curious to hear what your use case is? I might be able to add some sort of no-cache flag but would need to feel like there's a pretty good reason to do so.
Internally, data is cached to memory when it is read or written and stays that way through the life of the process (I would like to add cache eviction but I haven't yet)
As a workaround, you can do client.close() to clear the cache but I know it's not a great workaround.

Fair enough. It turns out that in databases, process safety is a hard problem and is best handled through a client-server model. I'm not sure how SQLite does it internally (or, for that matter, what promises it does and does not make).
For my notes, possible fixes are:

Adding a no_cache flag
Actually implementing process safety
Building a SQLite engine (which is something I've been strongly considering)

For you, I have a list of alternative embedded databases listed at the bottom of the README. I might look into UnQLite if you don't mind a different interface.
Closing for now.

Thank you for the answers and a cool project!

authors: LMSAas scottrogowski

repo: scottrogowski/mongita


text:
Add options to remove descriptive elements

Closes #38. I’ve added three new options:

--remove-titles (removes <title>)
--remove-descriptions (removes <desc>)
--remove-descriptive-elements (removes <title>, <desc> and <metadata>)

I’ve also added tests for each (9 in total) and modified the corresponding SVG files. I’m not that familiar with Python, so constructive comments are appreciated! I wasn’t sure about adding a type check to removeDescriptiveElements() (for the set type), but apparently that is not very Python’y?

@Ede123: Better?

Yes, perfect. Thank you!

repo: scour-project/scour


text:
[Lazy Loading] Wait for all images to be loaded to get all the src URL not the data:image/gif;base64...==

I am scraping a page with 500 items but i can't get all the URL of the images because  some of them (the majority) are not loaded before the browser is closed. Some src attributes have their correct URL but for those that are not loaded i got data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==
Here is part of my code, but i got AttributeError: 'ScrapyPlaywrightDownloadHandler' object has no attribute 'contexts'
when i write PageCoroutine("wait_for_timeout", 120000)
    def start_requests(self):
        yield scrapy.Request(
            url=self.casami_url_list_product,
            # meta={"playwright": True},
            meta=dict(playwright=True,
                      playwright_include_page=True,
                      playwright_page_coroutines=[
                          PageCoroutine(
                              'wait_for_selector', "//div[contains(@class, 'products-list')]"),
                          PageCoroutine("evaluate", "window.scrollBy(0, document.body.scrollHeight)"),
                          PageCoroutine("wait_for_timeout", 120000),  # got AttributeError: 'ScrapyPlaywrightDownloadHandler' object has no attribute 'contexts' when declared
                          PageCoroutine("screenshot", path=Path(__file__).parent / "recovered.png", full_page=True)
                      ])
        )

    # async def parse(self, response):
    def parse(self, response):
        all_product_items = response.xpath("//div[contains(@class, 'products-list')]"
                                           "//div[contains(@class, 'product-layout product-grid')]")
        product_name_xpath = "//div[contains(@class, 'product-image-container')]/a/@title"
        product_image_url_xpath = "//div[contains(@class, 'product-image-container')]//img/@src"
        product_price_xpath = "//div[contains(@class, 'price')]/span[contains(@class,'price-new')]/text()"
        product_detail_url_xpath = "//div[contains(@class, 'product-image-container')]/a/@href"

        for product_item in all_product_items:

            yield {"name": product_item.xpath("." + product_name_xpath).get(),
                   "price": product_item.xpath("." + product_price_xpath).get(),
                   "image_url": product_item.xpath("." + product_image_url_xpath).get(),
                   "product_detail_url": product_item.xpath("." + product_detail_url_xpath).get()}

Thanks for reply

You've encountered a data URL, which in this case happens to be a base64-encoded GIF image. That is a valid image, and it will be displayed by browsers as is.
See also:

https://developer.mozilla.org/en-US/docs/Web/HTTP/Basics_of_HTTP/Data_URIs
https://stackoverflow.com/a/9967193

authors: elacuesta gikpro

repo: scrapy-plugins/scrapy-playwright


text:
Add Creative Cloud

Here's Adobe CC, verified working in jamf on Catalina. Let me know if there's a better way to get the download link!
Here's the jamf log:
[STEP 1 of 4]

Executing Policy Creative Cloud
[STEP 2 of 4]
Running script Installomator...
Script exit code: 0
Script result: 2021-04-28 14:48:51 shifting arguments for Jamf2021-04-28 14:48:51 ################## Start Installomator 2021-04-28 14:48:51 ################## adobecc 2021-04-28 14:48:51 no blocking processes defined, using Creative Cloud as default 2021-04-28 14:48:51 Changing directory to /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.zLq7goVz 2021-04-28 14:48:51 Spotlight not returning any app, trying manually in /Applications. 2021-04-28 14:48:51 could not find Creative Cloud.app 2021-04-28 14:48:51 no more blocking processes, continue with update 2021-04-28 14:48:51 Downloading https://prod-rel-ffc-ccm.oobesaas.adobe.com/adobe-ffc-external/core/v1/wam/download?sapCode=KCCC&productName=Creative%20Cloud&os=mac&guid=3cda2676-f4fc-4260-8b61-f9d820105e29&contextParams=%7B%22component%22%3A%22cc-home%22%2C%22visitor_guid%22%3A%2219436244748138622232565995318656911370%22%2C%22browser%22%3A%22Safari%22%2C%22context_guid%22%3A%226a5696ea-4858-48cd-bc83-694698f4d2a0%22%2C%22planCodeList%22%3A%22%22%2C%22installerWaitTime%22%3A30%2C%22Product_ID_Promoted%22%3A%22KCCC%22%2C%22contextComName%22%3A%22ACom%3ACCH%22%2C%22contextSvcName%22%3A%22NO-CCD%22%2C%22contextOrigin%22%3A%22ACom%3ACCH%22%2C%22aam_uuid%22%3A%2223074960036023656461797120837856430647%22%2C%22gpv%22%3A%22helpx.adobe.com%3Adownload-install%3Akb%3Acreative-cloud-desktop-app-download%22%2C%22creative-cloud-referrer%22%3A%22https%3A%2F%2Fhelpx.adobe.com%2Fdownload-install%2Fkb%2Fcreative-cloud-desktop-app-download.html%22%2C%22AMCV_D6FAAFAD54CA9F560A4C98A5%2540AdobeOrg%22%3A%22102365995%257CMCMID%257C19436244748138622232565995318656911370%257CMCAAMLH-1620249276%257C9%257CMCAAMB-1620249276%257C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%257CMCOPTOUT-1619651676s%257CNONE%257CMCSYNCSOP%257C411-18753%257CvVersion%257C2.2.0%22%2C%22mid%22%3A%2223275764998481040001781260498026036921%22%2C%22aid%22%3A%22%22%2C%22AppMeasurementVersion%22%3A%222.20.0%22%2C%22kaizenTrialDuration%22%3A7%7D&wamFeature=nuj-live&environment=prod&api_key=CCHomeWeb1 to Creative Cloud.dmg 2021-04-28 14:48:52 Mounting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.zLq7goVz/Creative Cloud.dmg 2021-04-28 14:48:53 Mounted: /Volumes/Creative Cloud Installer 2021-04-28 14:48:53 looking for app: /Volumes/Creative Cloud Installer/Creative Cloud.app 2021-04-28 14:48:53 found app: /Volumes/Creative Cloud Installer/Creative Cloud Installer.app 2021-04-28 14:48:53 Verifying: /Volumes/Creative Cloud Installer/Creative Cloud Installer.app 2021-04-28 14:48:53 Team ID: JQ525L2MZD (expected: JQ525L2MZD ) 2021-04-28 14:48:53 Copy /Volumes/Creative Cloud Installer/Creative Cloud Installer.app to /Applications 2021-04-28 14:48:53 Changing owner to rezhko 2021-04-28 14:49:04 found app at /Applications/Creative Cloud.app, version 2.4.0.41 2021-04-28 14:49:04 Installed Creative Cloud, version 2.4.0.41 2021-04-28 14:49:04 notifying 2021-04-28 14:49:04 Deleting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.zLq7goVz 2021-04-28 14:49:04 Unmounting /Volumes/Creative Cloud Installer "disk2" ejected. 2021-04-28 14:49:04 ################## End Installomator
[STEP 3 of 4]
[STEP 4 of 4]

Isn't the Adobe CC download URL different for each version?

I think this PR can be closed if the Adobe installer being downloaded can't be silently installed. Any comments?

authors: a-rez acodega pro4tlzz

repo: scriptingosx/Installomator


text:
Need help porting example app from GitHub to Fitbit

I'm attempting to switch this example app over to Fitbit instead of GitHub.
It's forked at https://github.com/wsmoak/phoenix_oauth2_example (should default to the fitbit branch)
The changes are minor:

renamed web/oauth/git_hub.ex to fitbit.ex and updated urls
Fitbit requires a 'scope' parameter, this was added to auth_controller line 13
Updated to latest oauth2 version 0.1.1 in mix.exs and updated dependencies

Fitbit's OAuth2 docs:  https://wiki.fitbit.com/display/API/OAuth+2.0
Register an app is at: https://dev.fitbit.com/apps
After clicking 'Sign in with Fitbit' the user is sent to Fitbit and clicks "Allow".  They are sent back with a code, however the response from the call to Fitbit.get_token contains an error.  I see it when I attempt to log the token, and it dumps the contents to the log and the web page, including:
%{"errors" => [%{"errorType" => "oauth", "fieldName" => "n/a", "message" => "No Authorization header provided in the request. Each call to Fitbit API should be OAuth signed"}], "success" => false}
Do you see anything I'm doing wrong?  Thanks in advance for any advice on this!  And let me know if this isn't the right place to ask.

https://wiki.fitbit.com/display/API/OAuth+2.0 says "The Authorization header should be set to Basic followed by a space and a Base64 encoded string of your application’s client id and secret concatenated with a colon."
In Fitbit.get_token I added:
  |> put_header("Authorization", "Basic " <> Base.encode64( System.get_env("CLIENT_ID") <> ":" <> System.get_env("CLIENT_SECRET")))
and that worked.


text:
chore(libzkp): upgrade to v0.10.3

Purpose or design rationale of this PR
Describe your change. Make sure to answer these three questions: What does this PR do? Why does it do it? How does it do it?
PR title
Your PR title must follow conventional commits (as we are doing squash merge for each PR), so it must start with one of the following types:

[ ] build: Changes that affect the build system or external dependencies (example scopes: yarn, eslint, typescript)
[ ] ci: Changes to our CI configuration files and scripts (example scopes: vercel, github, cypress)
[ ] docs: Documentation-only changes
[ ] feat: A new feature
[ ] fix: A bug fix
[ ] perf: A code change that improves performance
[ ] refactor: A code change that doesn't fix a bug, or add a feature, or improves performance
[ ] style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
[ ] test: Adding missing tests or correcting existing tests

Deployment tag versioning
Has tag in common/version.go been updated or have you added bump-version label to this PR?

[ ] No, this PR doesn't involve a new deployment, git tag, docker image tag
[ ] Yes

Breaking change label
Does this PR have the breaking-change label?

[ ] No, this PR is not a breaking change
[ ] Yes

Tested. But the circuit side versioned_blob_hash is the last elem of pi hash preimage

repo: scroll-tech/scroll


text:
If "set shellslash", can't open file if path have space.

If "set shellslash", can't open file if path have space.

D:/Program Files/vim/vimrc

Can't open vimrc. It will open:

D:/Program/ Files/vim/vimrc

ANNOUNCEMENT:  Pull request #734 offers a potential fix for this problem. Please checkout the branch there for testing. It must be tested before we merge the changes.

authors: bleakwind lifecrisis

repo: scrooloose/nerdtree

license: WTFPL


text:
How do I get access to the underlying schema?

Hey,
first of all let me thank you for creating tiptap, it's really great! However, I probably need some clarification on how to use pass content around.
I'm using vuex to store the editor content while writing.
new Editor({
        extensions: [
          new Heading({
            levels: [2, 3, 4],
          }),
        ],
        content: this.$store.state.story.text,
        onUpdate: function(payload) {
          this.$store.commit(UPDATE_STORY_TEXT, payload);
        }.bind(this),
      });

It stores getHTML, getJSON, state and transaction keys as well. I use this together with prosemirror-utils package inside one of my getters like this:
const getters = {
  features: state => {
    return state.story && state.story.text && state.story.text.state
      ? findChildrenByMark(state.story.text.state.doc, state.story.text.state.config.schema.marks.featureMark)
          .map(obj => obj.node.marks[0])
          .filter(mark => mark.attrs[STORY_LINK_LAT_ATTR])
          .map(mark => ({ lat: mark.attrs[STORY_LINK_LAT_ATTR], lng: mark.attrs[STORY_LINK_LNG_ATTR]}))
      : [];
  },
};

This works just fine while I'm writing, because the state.config.schema is available inside my vuex store. Once I save the content and load it again (see here), I lose my getters.features, because there is no state.story.text.state anymore.
Should I just go for some general nested array function, or is there a way to do that with tiptap?

You can use the this.editor.getSchemaJSON() to get the schema.
https://github.com/scrumpy/tiptap/issues/368

authors: kshitizshankar zimmicz

repo: scrumpy/tiptap