text:
Mount ephemeral disk with project quota enabled

Hi Bosh Team,
We (Garden Team) would like to use project quotas on ext4 filesystems on diego cells in CF, so that we can more easily and reliably enforce disk quotas for app containers. This draft PR is by no means merge-ready. We would like to use it as a basis for discussion on how to achieve that together.
What are project quotas?
Project quotas is a relatively new ext4 feature available since kernel version 4.5 and e2fs-tools 1.43 (although it is probably better to use a newer version such as 1.44.5). Generally speaking it provides a way to limit the size of directories (a.k.a projects) on ext4 volumes formatted and mounted with specific options.
Why do we need them?
CF limits the amount of disk that apps can use, so that a rogue app cannot use up all the disk on the diego cell. Currently Garden achieves this by using an exotic mix of filesystems. Namely, the ephemeral dis is ext4 (without project quotas enabled), so we have to create a loop device, format it as xfs with project quotas and mount it on /var/vcap/data/grootfs/store. This setup causes lots of pain for us, for example the sparse file that backs the loop device up can grow to exhaust the complete ephemeral disk and we have lots of code to try to prevent this. We have also seen lots of reports of file system lockups and we believe that they might be connected to that complex file systems setup. If ephemeral disks had project quotas enabled we would not have to do all those hoops.
What would the impact be?
We had an exploration story in our backlog to measure the performance impact of enabling project quotas on ext4 file systems. TL;DR, we concluded that there is about 20% slowdown on creating and deleting large files that cannot make use of RAM caching. For small files the performance impact is neglectable. We therefore believe that enabling project quotas on diego cells would not be a problem because:

Applications/Services which use lots of disk IO would either use persistent databases, or persistent disks. In other words, they would not be using the ephemeral volume to perform their disk IO
For the rest of the processes running on the diego cell (such as bosh jobs) disk IO should be quite minimal and therefore covered by the RAM cache, so we believe that there would not be a big impact.

What is missing in this PR
e2fs-progs that are bundled into stemcells as of today are outdated and do not support ext4 project quotas. Could you suggest how solve that? Can we bump the e2fs-progs package, or should we distribute an up-to-date binary and use it on the bosh-agent instead?
In this PR we enable project quotas for ephemeral disk for all bosh vms. We realise that bosh is a generic tool, so probably project quotas should be enabled conditionally. We do not know how to implement that and would appreciate your input a lot. Any feedback from your side is also very welcome!

Hey, any comments on this one? We'd like to start a discussion on enabling quotas on ext4 so that the CF filesystem stack is simplified.

repo: cloudfoundry/bosh-agent


text:
Bump github.com/vito/go-interact/interact

fixes extra newlines in longer prompts
fixes cloudfoundry/bosh-cli#31

Full vendor diff at 0eb3903...c573392; only skimmed it
Manually verified; lightly tested other commands; units/integration green; acceptance too confusing

nice catch, thanks for the fix!

source: gharchive/pull-request

repo: cloudfoundry/bosh-cli

license_type: permissive

license_source: github-api


text:
added run-template

Expands a bosh template by binding a manifest and release
USAGE: run-template <job_name> <manifest_filename> <template_name>
run this from inside your release/jobs folder
job_name: the name of the job that contains your template that you want to run
manifest_filename: the manifest that would be used to deploy your release. eg: bosh -d  manifest
template_name: not the file_name, but the name that the file will expand into
Notes: If a Links default value cannot be found, a generated default value will be put in its place.
Any other missing params will result in an error
Co-authored-by: Paul Nikonowicz pnikonowicz@pivotal.io
Co-authored-by: Sanhita Mukherji smukherji@pivotal.io
Co-authored-by: Anthony Emengo aemengo@pivotal.io
What is this change about?
Allows a template expansion from a bosh vm manifest
Please provide contextual information.
NA
What tests have you run against this PR?
manual tests. we are using a variant of this on our team
How should this change be described in bosh release notes?
introduce run-template Expands a bosh template by binding a manifest and release
Does this PR introduce a breaking change?
No.
Tag your pair, your PM, and/or team!
pnikonowicz
sanhitamukherji
aemengo

Hi @pnikonowicz,
Thanks for the submission. At the moment we feel uncomfortable supporting this utility long term. Ideally this can stay as an external tool that others can maintain and take advantage of. For that reason we are going to close this pull request. Please let us know if you have any other questions.
Best,
@jfmyers9 && @xtreme-conor-nosal

repo: cloudfoundry/bosh


text:
[stemcell-builder] Fix calling apt-get distr-upgrade command in base_apt stage

Hey, all.
I tried to build base os image using following command bundle exec rake stemcell:build_os_image[ubuntu,trusty,base_os_image_path] and got this error stack trace: https://gist.github.com/allomov/7f51891b0e502638f7cf. I used base os image from this URL: http://s3.amazonaws.com/bosh-os-images/bosh-ubuntu-trusty-os-image.tgz.
Using advices from this ticket I was able to fix this problem and run stemcell:build_os_image without errors.
This PR shows what I needed to do for the fix.

@allomov have you tried running os image build on master? we have not seen this failure in our ci.

A good question. I used bosh 2858 (this commit b72546515fe71a0fe123a0ef688d93088d19aec8) to run stemcell:build_os_image task.
Currently I can't see what could fix this issue in the master for changelog and diff. Do you use the same base os image for tests? Is it possible that this test image has correct version of udev?

What do you mean by: "Do you use the same base os image for tests?"
OS image is locked down via the json file during the stemcell building.

I thought that if you use updated base OS image or smth like this. Could you tell what CI scripts do you use?

That's ok if you don't see errors, I'll close the issue. I just needed to make this updates to make it work on my side.

authors: allomov cppforlife


text:
Give BUILTIN/Users ReadAndExecute permission

This is so an unprivileged user in a container can read and execute buildpack / lifecycle binaries from the executor_cache
The change is compatible with garden-windows 2012 and 2016 as we are only adding permissions to the cache directory

Thanks, @sesmith177! Sounds reasonable, prioritizing for the Diego team to review.
Best,
Eric

For context, this is required since the windows bosh agent sets the permissions of /var/vcap to be readable, writable and executable only by system users and admins. this used to work on windows 2012 since bind mounts are doing a copy into the container, but 2016 have real bind mounts and  which inherit the permissions of the host directory. this causes cached artifacts (e.g. lifecycle and buildpack) not to be accessible inside the container.

authors: ematpl jvshahid sesmith177

repo: cloudfoundry/diego-release


text:
[Feature]: Developer can run tasks on a Korifi deployed without Eirini

blocked on #1490

Background
As an operator
I want to replace Korifi's task runner
So that I can customise the way my system runs tasks
Acceptance Criteria
WHEN I install Korifi following the installation instructions
THEN I see the instructions don't include an eirini-controller installation step
AND I see they include a job-task-runner installation step
AND I can perform any task operation successfully
Dev Notes

This is about swapping out eirini-controller and its Task resource for the new job-task-runner and TaskWorkload.
Once this is done, we should also replace eirini-controller with job-task-runner in our docs and scripts.

Note: the work is probably complete in the issues/1407-use-job-task-workload-runner branch, but e2e fails because of #1490

source: gharchive/issue

authors: gcapizzi kieron-dev

repo: cloudfoundry/korifi


text:
Bump k8s libs and controller runtime

Is there a related GitHub Issue?
No
What is this change about?
Draft PR as we require feedback on including controller-runtime@master
Controller-runtime does not yet have a release that builds with v0.26.0 of the client-go library.
We are getting dependabot requests to update the k8s libraries to v0.26.0, so here we bump those libraries and take the latest version of controller-runtime so that the code builds.
Note that there are some struct/interface renames that have caused changes in our client library fakes. StatusWriter -> SubResourceWriter, for example.
Does this PR introduce a breaking change?
Maybe
Acceptance Steps

Tag your pair, your PM, and/or team
@cloudfoundry/wg-cf-on-k8s-korifi-approvers
Things to remember

We're not seeing the controllers tests fail locally strangely

The failing controller tests appear to be caused by a new Claims field that was added to the ResourceRequirements type for Kubernetes v1.26. The comments for this field include the listType Kubebuilder marker with a value of set, which results in the x-kubernetes-list-type key being included in the CRD definition for AppWorkload and TaskWorkload. This in turn requires the corresponding x-kubernetes-map-type key to be included in the items subkey of the new claims property in the CRD, but there is no corresponding mapType Kubebuilder marker in the definition for the ResourceClaim type.
This results in the following error when Kubernetes tries to install the generated CRD:

The CustomResourceDefinition "appworkloads.korifi.cloudfoundry.org" is invalid: spec.validation.openAPIV3Schema.properties[spec].properties[resources].properties[claims].items.x-kubernetes-map-type: Invalid value: "null": must be atomic as item of a list with x-kubernetes-list-type=set

I can fix this by:

remove the x-kubernetes-list-type key from the CRD, or
add the x-kubernetes-map-type key to the items key under claims with a value of atomic

Both of these changes require a change to the api/core/v1 library code; either to add a comment to the ResourceClaim type, or to remove the comment from the Claims field in the ResourceRequirements type. The alternative is for us to copy the ResourceRequirements type into the Korifi codebase so that we can remove it ourselves.

This has been fixed in https://github.com/kubernetes/kubernetes/pull/114585 by changing the ResourceClaim's listType comment from set to map and adding a listMapKey=name comment. The change is being back-ported to Kubernetes v1.26 in https://github.com/kubernetes/kubernetes/pull/114617 (which has not been merged as of the time of writing).

Closing, as all the dependencies have now caught up and work together in published releases

authors: davewalter kieron-dev


text:
package-lock.json should not be required

What version of Cloud Foundry and CF CLI are you using? (i.e. What is the output of running cf curl /v2/info && cf version?
packs v0.0.9
What version of the buildpack you are using?
5c4c6ec2280
If you were attempting to accomplish a task, what was it you were attempting to do?
Build a project with a package.json file but no package-lock.json.
Many projects will not have a package-lock.json as it's not required by npm, even though it is encouraged. If a project contains an npm-shrinkwrap.json file, the package-lock.json is completely ignored. Many npm alternatives will not generate a package-lock.json file.
What did you expect to happen?
The buildpack should detect and run npm install at build time.
What was the actual behavior?
The buildpack detects, but errors at buildtime.
[detector] 2019/01/25 19:42:37 NPM Buildpack: pass
...
[builder] -----> Node.js Buildpack 0.0.2
[builder] -----> NodeJS 11.4.0: Contributing to layer
[builder]        Downloading from https://nodejs.org/dist/v11.4.0/node-v11.4.0-linux-x64.tar.gz
[builder]        Verifying checksum
[builder]        Expanding to /workspace/org.cloudfoundry.buildpacks.nodejs/node
[builder]        Writing NODE_HOME to shared
[builder]        Writing NODE_ENV to shared
[builder]        Writing NODE_MODULES_CACHE to shared
[builder]        Writing NODE_VERBOSE to shared
[builder]        Writing NPM_CONFIG_PRODUCTION to shared
[builder]        Writing NPM_CONFIG_LOGLEVEL to shared
[builder]        Writing WEB_MEMORY to shared
[builder]        Writing WEB_CONCURRENCY to shared
[builder] -----> NPM Buildpack 0.0.3
[builder] unable to find "package-lock.json"
[builder] 2019/01/25 19:42:45 Error: failed to : exit status 102

Can you provide a sample app?
https://github.com/projectriff-samples/node-square/tree/10ee582a990eab43772f7d99d715740ddcee2b1b
Use projectriff/builder:0.2.0-snapshot-ci-f2315fde2cae as the builder image.
Please confirm where necessary:

[x] I have included a log output
[x] My log includes an error message
[x] I have included steps for reproduction

Thanks for this issue @scothis! This has since been fixed and should be released!

authors: scothis tylerphelan

repo: cloudfoundry/npm-cnb


text:
Wrong processing if the same appname exist on different spaces

Issue:
The "change-stack" method doesn't take into account that the same appame can exists on different spaces on the same org. It changes the stack only on the first it found. The sort of this list keeps always the same.
Steps to Reproduce:
Having two apps with the same name e.g. "lere-static" on different spaces.
It is very common for a developer to have spaces called "dev", "int", "prd" and so on but to have the very same name for the app.
Two apps with the same name (lere-static) on two different spaces in the same org still on stack cflinuxfs2.
The cf target is set to the second space with guid "e88144..." (see below):
cf curl /v3/apps?names=lere-static | egrep "guid|stack"
         "guid": "fdb2aacb-814a-48e9-8206-b26f6492ef6c",
               "stack": "cflinuxfs2"
                  "guid": "691a1bf2-ad90-4d64-a515-5c843abb55c0"
         "guid": "bd4f60e1-1c66-47ba-a6d7-15270320f60b",
               "stack": "cflinuxfs2"
                  "guid": "e88144bb-4481-48ba-ad52-639cc60ce8d1"

Changing the stack of appname "lere-static" with the plugin:
cf change-stack lere-static cflinuxfs3 --v3
Attempting to change stack to cflinuxfs3 for lere-static...

App lere-static is already started
Application lere-static was successfully changed to Stack cflinuxfs3

Query again like the integrated method it does:
cf curl /v3/apps?names=lere-static | egrep "guid|stack"
         "guid": "fdb2aacb-814a-48e9-8206-b26f6492ef6c",
               "stack": "cflinuxfs3"
                  "guid": "691a1bf2-ad90-4d64-a515-5c843abb55c0"
         "guid": "bd4f60e1-1c66-47ba-a6d7-15270320f60b",
               "stack": "cflinuxfs2"
                  "guid": "e88144bb-4481-48ba-ad52-639cc60ce8d1"

The first app in this list was processed. The app with guid "bd4f..." in the space I am targeted to is sill using cflinuxfs2.
Retry to change the stack in the space I am targeted since the app has still the cflinuxfs2 stack:
cf change-stack lere-static cflinuxfs3 --v3
Attempting to change stack to cflinuxfs3 for lere-static...

2019/05/16 08:12:00 error talking to cf: application is already associated with stack cflinuxfs3

Expected result:
The "change-stack" command should change the app in the space I am targeted.
I would like to change the stack on the appname within space "dev" to be sure the new stack works for the same appname also in space "prd".
Right now I don't have a control nor can I fulfill the need to change the stack on all my apps with the same appname.
Possible solution:

working with app guid
Take only care of the appname within the space I have been targeted.

@renelehmann Thanks for pointing this out! We introduced this bug when we did some performance improvements. Working on fixing it now.

Fixed this on our master branch with this commit
We will be releasing this soon (definitely within a week).
@renelehmann Would be great if you could give it a spin though!

Thanks a lot @kardolus for your fast reply and effort.
I build the stack-auditor (commit 0b057e4a44b21ffcb7452e386907dfb37f90c096) and run into an unexpected error on using the updated plugin.
cf change-stack lere-static cflinuxfs3
Attempting to change stack to cflinuxfs3 for lere-static...

lere-static failed to stage on: cflinuxfs3. Restaging on existing stack: cflinuxfs2

I then executed the stack change with curl commands (setting the stack_guid) to exclude any problems on the app itself or the platform and it worked with this procedure.
So I am guessing there is a little regress.

@renelehmann hmmm interesting. I wonder, were you targeting the correct space while you were performing the change-stack command? I mean the space that has the app you want to move to fs3.
What happened here is that the stack-auditor tried to stage your app on fs3, that failed, and then it busted out and should have left your original app up and running.
Did you experience any downtime with your app?
Also, could you tell us more about your app? How long does it approximately take to start up? Which buildpack are you using (which language/package manager)?
Super useful feedback! Thank you so much for giving this a try. Do you happen to have a sample app I could use for reproduction?

^ @shanks3012 interesting stuff right here

@renelehmann just a follow up on this, and the give you some more context, we are implementing a completely new feature. Your app is being staged on fs3 while we just let the fs2 instance run. Then, if your cloud foundry supports it, we will do a zero downtime restart after which your app will be running on fs3. If your CF does not support it, there will be some downtime while your app boots up.
The advantage here is that if your app does not work well with fs3 (it doesn't compile, or does not start up), then your original app will either keep running (staging fails) or it will be recovered (start up failed).

@renelehmann Just a quick clarification, did you actually re-stage the app and verify it was working entirely with the curl commands?
The V3 api allows you to modify the app's stack independently from actually re-staging it and I'm wondering if that's what happened (or if the app got into a funky state somehow). Either way, it would be helpful to see a your curl commands and maybe a sample app.

I then executed the stack change with curl commands (setting the stack_guid) to exclude any problems on the app itself or the platform and it worked with this procedure.
So I am guessing there is a little regress.

@kardolus , @Zanadar Thanks for further informations and questions.
To clarify, it was or is a simple basic test based on the staticfile_buildback and to reproduce the space issue some developers run or will run into it.
Testcase: push an app based on cflinuxfs2 on two different spaces and migrate the stack
  mkdir /tmp/static/;touch /tmp/static/Staticfile
  cf push lere-static -b staticfile_buildpack -s cflinuxfs2 -p /tmp/static

#Trying the updated stack-auditor plugin "change-stack" with mentioned issues.
Set the stack with API calls (linux formated), successfully (forced with downtime):
  cf curl /v2/apps/$APPGUID -d '{"stack_guid":"$STACKGUID"}' -X PUT
  cf curl /v2/apps/$APPGUID -d '{"state":"STOPPED"}' -X PUT
  cf curl /v2/apps/$APPGUID -d '{"state":"STARTED"}' -X PUT

Since I know you have implemented the feature for blue/green deployments I checked
our Foundation if all is working as expected. Our cf is align to cf-deployment 7.11.0.
The cf implementation fully supports the "rolling app deployment feature" from CAPI (cc_deployment_updater).
But here comes the clue, we do not allow all v3-zdt-* (experimental) calls on our API yet.
Does this now makes sense to the new issue we run?
So, in our case it would be nice if we could have a command option not to check or using the "zdt" feature.

@renelehmann How are you blocking usage of this API? Is there a proxy or something?

@Zanadar  We call the component filter and provides extended endpoints to access the resources which are provided on top of Cloud Foundry (e.g. backup of service_instances). Most of the CC API calls will be forwarded from our LB and gorouter to this component. The filter component then processes the call or forward it over the gorouter to CC.
Since the use of v3-zdt* is not whitelisted yet it will not be forwarded to CC.

@renelehmann thanks for the feedback! We will make it an opt-in functionality to use the v3-zdt-restart command. For example by setting a "--v3" flag.

@renelehmann think we have a nice solution with this commit: https://github.com/cloudfoundry/stack-auditor/commit/2f2211748b5e03495cbd974b0ab7cb8f6301958a
We will release it soon.
Closing for now, feel free to reopen. Thanks for all the feedback!

@kardolus Thanks a lot for implementing this nice solution.
I could successfully test it with or without the "--v3" flag.
(Unfortuantely we block on our filter component not only the v3-zdt* but also some "newer" V3 PATCH/POST/PUT/ API calls. So the used PATCH /v3/apps/:guid/relationships/current_droplet run into a blockade also.
But for testing I could use another environment to bypass this behaviour. And we are going to releasing this further blockade soon.)
All good from our side and that you closed it already.
Thanks a lot for your help.

authors: Zanadar kardolus renelehmann

repo: cloudfoundry/stack-auditor


text:
Remote syslog endpoint saturation causes back pressure causing VM's to run out of space.

Greetings,
I have a customer who is experiencing significant disk space issues when the remote endpoint becomes overwhelmed. This backpressure spills to disk causing the VM to run out of space. This impacts production environments.
Here are some example metrics of VM's beginning to be impacted:

docs.count
docs.deleted store.size
store.size
pri.store.size

33,148,446
0
51.4gb
25.7gb

514,838
0
918mb
461.4mb

69,694,093
0
130.8gb
65.3gb

55,322,132
0
107.1gb
53.5gb

8,990,170
0
15.2gb
7.6gb

56,903,861
0
111gb
55.5gb

62,124,773
0
116.9gb
58.4gb

56,188,648
0
108gb
54gb

6,313,710
0
10.2gb
5.1gb

57,702,893
0
110.8gb
55.4gb

68,047,992
0
124.5gb
62.3gb

59,502,261
0
107.4gb
54.1gb

52,959,350
0
101.7gb
50.9gb

84
0
633.7kb
316.8kb

10,880,778
0
19.7gb
9.8gb

7,406,031
0
12.8gb
6.4gb

26,296,208
0
38.2gb
19.1gb

4,823,962
0
8gb
4gb

2,298,889
0
3.4gb
1.7gb

27,052,261
0
38.3gb
19.1gb

32,431,457
0
55.9gb
27.9gb

3,239,340
0
5.1gb
2.5gb

20,917,875
0
32.1gb
16.1gb

29,342,904
0
46gb
23gb

28,534,677
0
44.8gb
22.3gb

17,826,714
0
35.2gb
16.9gb

38,102,676
0
73.6gb
36.8gb

30,807,026
0
48.6gb
24.3gb

37,077,513
0
73.1gb
36.3gb

19,607,216
0
37.2gb
18.7gb

36,063,944
0
70.4gb
35.2gb

33,248,748
0
52.3gb
26.1gb

36,740,763
0
70.6gb
35.3gb

24,967,719
0
63gb
24.7gb

28,961,976
0
50.3gb
25.2gb

26,505,503
0
53.4gb
26.7gb

23,972,181
0
47.4gb
23.8gb

39,789,841
0
75.7gb
37.9gb

42,149,654
0
79.8gb
39.8gb

40,434,754
0
76.8gb
38.3gb

41,784,767
0
79.3gb
39.7gb

29,338,150
0
53.9gb
26.9gb

30,807,985
0
47.5gb
23.8gb

13,184,702
0
20.9gb
10.4gb

34,904,823
0
64.3gb
32.1gb

32,682,527
0
73gb
41.4gb

32,862,985
0
50.1gb
25.1gb

36,998,389
0
73.3gb
35.9gb

36,651,049
0
68.1gb
34.1gb

32,730,307
0
63gb
31.4gb

37,317,771
0
57.4gb
28.6gb

34,556,258
0
68.5gb
35gb

39,718,662
0
74.4gb
37.2gb

24,254,479
0
45.1gb
22.9gb

25,698,414
0
51.4gb
26.1gb

4,691,009
0
7.7gb
3.8gb

18,691,546
0
32.3gb
16.1gb

In a perfect world, adding filebeat support would be the customer's ideal solution as it is a more efficient method and would allow more throughput.

@tpbrisco

repo: cloudfoundry/syslog-release


text:
Made all route datasource fields optional

Purpose

To mimic V3 API of Routes, made mandatory domain field of route datasource optional too

Does this introduce a breaking change?

[ ] Yes
[x] No

Pull Request Type
What kind of change does this Pull Request introduce?

[ ] Bugfix
[ ] Feature
[ ] Refactoring (no functional changes, no api changes)
[x] Documentation content changes
[ ] Other... Please describe:

How to Test

Test the code via automated test

go test ./...

Additional test steps

...

What to Check
Verify that the following are valid:

Automated tests are executed successfully

...

Other Information

Checklist for reviewer

The following organizational tasks must be completed before merging this PR:

[ ] The PR is assigned to the Terraform project and a status is set (typically "in review").
[ ] The PR has the matching labels assigned to it.
[ ] The PR has a milestone assigned to it.
[ ] If the PR closes an issue, the issue is referenced.
[ ] Possible follow-up items are created and linked.

Functionality achieved by #53


text:
How to  Integration User Account and Authentication LDAP?

When I config the uaa.yml on uaa server,  then restart the uaa server , all config has resotre, why?
Anther issue,  can’t   click  the apply change  on OPS Manager dashboard.

It seems you are running a PCF manager. For that, please go through the official support channel.
A standalone UAA would not overwrite its configuration file.
In a Cloud Foundry environmnent, the configuration files will always be overwritten by the manifest.

authors: alandchen fhanik

repo: cloudfoundry/uaa


text:
[Feature]  CldImage doesn't support cname, privateCdn or secureDistribution

Feature Request
Cloudinary permits to custom the CDN but next-cloudinary, especially, CldImage, doesn't give access to this.
See your own documentation:
https://cloudinary.com/documentation/cloudinary_sdks#cross_sdk_info
https://cloudinary.com/documentation/advanced_url_delivery_options#private_cdns_and_cnames
https://support.cloudinary.com/hc/en-us/articles/202520562-Can-we-deliver-our-assets-using-a-subdomain-of-our-own-domain-like-cdn-example-com
Potential Solution
As for the configuration of the cloudName NEXT_PUBLIC_CLOUDINARY_CLOUD_NAME="<Your Cloud Name>" in .env file. It would be very much appreciated to have the same way to configure a custom CDN. For example:
NEXT_PUBLIC_CLOUDINARY_CNAME="<Your CNAME>"
Or to have a way to pass the CNAME directly to CldImage component.
Thanks

hey @dlepaux CldImage actually supports a config prop where you can do just that!
you can add it with:
<CldImage config={{
 url: {
    secureDistribution: 'spacejelly.dev',
    privateCdn: true
  }
}} />

now unfortunately that isn't globally configurable. one way to support that globally is to create a wrapper component, then use that wrapper component, but that's also not ideal, so perhaps your idea would be a good way to support it globally
part of the issue is Next.js doesn't have an native way for me to be able to add global configurations and i want to avoid adding individual environment variables for every little configuration, but i think cname is likely one that makes sense as an environment variable, particularly because it may change depending on the environment being used
I'll try to work up a PR for this!

Hey ! Thank you for your quick answer.
Do you know if by configuring a custom domain (CNAME), does the regular cloudinary URLs are still valid ?
Thanks

yup! here's an example:
https://cld.fromdesignto.dev/image/upload/v1694695724/cld-sample-4.jpg
https://res.cloudinary.com/fromdesigntodev/image/upload/v1694695724/cld-sample-4.jpg

in addition to the config prop, privateCdn and secureDistribution are now configurable as environment variables:
NEXT_PUBLIC_CLOUDINARY_SECURE_DISTRIBUTION="<Your Secure Distribution / CNAME>"
NEXT_PUBLIC_CLOUDINARY_PRIVATE_CDN="<true|false>"

i opted not to support the cname property as it's considered legacy and only available in the context of non-secure requests, but let me know if that creates problems
https://cloudinary.com/documentation/cloudinary_sdks#configuration_parameters

authors: colbyfayock dlepaux

repo: cloudinary-community/next-cloudinary

license: MIT


text:
Added a PodMonitor for monitoring the CNPG Operator

Adds a PodMonitor for monitoring the operator based on the example in the documentation.
Closes #107

Thanks @itay-grudev, could you wrap it in a condition (monitoring.podMonitorEnabled) and only output it if explicitly enabled? Otherwise it will fail at installation/upgrade time if the Prometheus operator is not installed

authors: itay-grudev phisco

repo: cloudnative-pg/charts


text:
fix(CI): upgrade to ubuntu 20.10

CI is stuck on master

Codecov Report
Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (17fe079) 100.00% compared to head (c2a1346) 92.00%.
Report is 2 commits behind head on master.

Files
Patch %
Lines

...able-lifecycle/src/lib/ngx-observable-lifecycle.ts
60.00%
1 Missing and 1 partial :warning:

Additional details and impacted files
@@             Coverage Diff             @@
##            master      #64      +/-   ##
===========================================
- Coverage   100.00%   92.00%   -8.00%
===========================================
  Files            1        1
  Lines           23       25       +2
  Branches         9       11       +2
===========================================
  Hits            23       23
- Misses           0        1       +1
- Partials         0        1       +1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

repo: cloudnc/ngx-observable-lifecycle


text:
contributors details

Contributors details have been added, please look into it

Thank you Mr. Jatin!!!

authors: cloudparadigmjain jatinmehrotra

repo: cloudparadigmjain/WIDS


text:
Duo Tester

I am helping to release new versions of bastion, however I do not use Duo MFA. I'm requesting for anyone in the community that uses Duo to please help test that ~~https://github.com/cloudposse/bastion/pull/70~~ the latest releases still work with Duo authentication.
Additionally, if anyone can think of a basic functional/integation test for Duo and add it to the project (in the test folder), that would be awesome.
Thanks!

Hi @jonmchan, longtime bastion Duo user here running latest tag (yes bite me 😆) and I haven't noticed any issues with the latest release you guys have pushed - all still working fine in regards to duo
Thanks a lot for the great effort put into this!
PS: Would it be possible to push the docker images to the github registry aswell?

authors: jkaberg jonmchan

repo: cloudposse/bastion


text:
Use non greedy aws_iam_user_group_membership

what
aws_iam_group_membership [1] is a greedy resource that can cause
inconsistent behaviour. The resource will conflict with itself if used more
than once with the same group. To non-exclusively manage the users in a
group switch to the aws_iam_user_group_membership [2] resource which
can be used multiple times with the same user for non-overlapping groups.
why
Note that terraform-aws-iam-user [3] is using the
aws_iam_user_group_membership resource. This mix is causing issues when
running root account level Terraform. users is run and any subsequent
runs of iam (which calls this module) is greedily removing users from
groups that were associated in the users run.
testing
I managed to reproduce this issue on testing after bumping root.cloudposse.co terraform-root-modules to current release.
Applying users followed by iam, users are not removed from any groups.
[1] https://www.terraform.io/docs/providers/aws/r/iam_group_membership.html
[2] https://www.terraform.io/docs/providers/aws/r/iam_user_group_membership.html
[3] https://github.com/cloudposse/terraform-aws-iam-user/blob/master/main.tf#L20-L25

I believe this might have other unintended effects.
EG: You now cant pass var.user_names from the output of another resource (eg. a resource that creates the users) as it will fail to compute count (known terraform limitation). This means now you need to know by some external logic that your users are created before this can run, as there is no way to do depends_on between modules aside from implicit dependencies.
eg.
module "some_user_creation_module" {
  user_names = "${var.user_names}"
}

module "this_module" {
  user_names = "${module.some_user_creation_module.users}"
}

authors: joshmyers pecigonzalo


text:
OnDelete and OnUpdate properties not working

Currently, in HarbourBridge the code seems to have support to add the OnDelete and OnUpdate properties in case they are present in the foreign key of the source schema for mysql dump migration. But on running migration for mysql dump file the OnDelete and OnUpdate properties are getting updated only for source schema and not for spanner.

Since OnDelete property is currently not supported in spanner, closing this for now as its an intended behaviour.

repo: cloudspannerecosystem/harbourbridge

license_source: bigquery


text:
Cannot add local policies to ManagedPolicyArns

I want to do the equivalent of:
   policies = []     for policy_name in policy_names:         '{"ref":"'+policy_name+'"}'         policies.append('{"ref":"'+policy_name+'"}')     t.add_resource(Role(         role_name,         Path="/",         ManagedPolicyArns=policies,         AssumeRolePolicyDocument=Policy(             Statement=[                 Statement(                     Effect=Allow,                     Action=[AssumeRole],                     Principal=Principal("Service", ["ec2.amazonaws.com"])                 )             ]         )     ))
but it results in
            "Properties": {                 "AssumeRolePolicyDocument": {                     "Statement": [                         {                             "Action": [                                 "sts:AssumeRole"                             ],                             "Effect": "Allow",                             "Principal": {                                 "Service": [                                     "ec2.amazonaws.com"                                 ]                             }                         }                     ]                 },                 "ManagedPolicyArns": [                     "{\"ref\":\"GiveAccessToReadEverything\"}",                     "{\"ref\":\"GiveLoggingAccess\"}"                 ],                 "Path": "/"             },             "Type": "AWS::IAM::Role"
I would like to just be able to add a local policy I already generated without it trying to clean up my string (it appears join is doing this) any suggestions?
(im debugging a fix for this at the moment, mainly by seeing if i can pass a local account arn somehow)

policies.append(troposphere.Ref(policy_name)) seems to fix this issue, so ill close for now. I dont know why this passes correctly and the other does if someone wants to be super informative.

repo: cloudtools/troposphere


text:
Proposal：add a flag to support custom suffixes for IDL

Why did this proposal come up？
For reference, kitex supports custom suffix names, and Hertz makes it mandatory to determine IDL type by suffix.
I propose to unify the code style for the same cloudwego subproject.
Describe alternatives you've considered
From a user experience point of view, the type is determined by the suffix by default, but the option to customize the suffix is left to the user.
For Kitex, add the default suffix determination function, but also support custom suffixes.
Hertz adds the function of custom suffixes.
为什么会出现这个提案 ？
参考 kitex 支持自定义后缀名，Hertz 为强规定通过后缀判断 IDL 类型。
我提议同属于 cloudwego 的子项目，最好统一代码风格。
描述你想要的解决方案
从用户体验的角度来看， 默认通过后缀判断类型，但是还是要留给用户去自定义后缀的选项。
即给 kitex 增加默认后缀判断功能，但同时支持自定义后缀。
Hertz 增加自定义后缀的功能。

Support to unify the style of kitex and hertz

kitex 已经支持了后缀猜测
https://github.com/cloudwego/kitex/pull/590

repo: cloudwego/hertz


text:
skynet占满cpu，但是所有服务都正常响应

skynet占满cpu，但是所有服务都正常响应
很难重现，只有一个现场，这个服务器大概跑了一周，发现cpu被占满
PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
27510 game      20   0  252912  27224   1484 R 99.9  2.7   4941:45 skynet

但是所有的服务都正常，没有拥塞，任务很少，响应也都正确，应该不是死循环或者循环call问题。
stat
:00000004       cpu:0.001394    message:29      mqlen:0 task:0
:00000006       cpu:0.000784    message:11      mqlen:0 task:0
:00000007       cpu:0.001686    message:11      mqlen:0 task:0
:00000008       cpu:0.014091    message:29      mqlen:0 task:0
:00000009       cpu:0.000965    message:12      mqlen:0 task:1
:0000000a       cpu:0.012387    message:78      mqlen:0 task:1
:0000000b       cpu:0.041549    message:21      mqlen:0 task:1
:0000000c       cpu:0.760351    message:12507   mqlen:0 task:2
:0000000d       cpu:0.012948    message:12      mqlen:0 task:0
:0000000e       cpu:2.329448    message:39209   mqlen:0 task:4
:0000000f       cpu:0.08777     message:1539    mqlen:0 task:0
:00000010       cpu:0.016192    message:519     mqlen:0 task:0
:00000011       cpu:0.158207    message:3214    mqlen:0 task:0
:00000012       cpu:1.905713    message:17686   mqlen:0 task:6
:000002d3       cpu:0.040202    message:424     mqlen:0 task:1
:000002d5       cpu:0.031169    message:376     mqlen:0 task:1
:000002d6       cpu:0.046675    message:390     mqlen:0 task:1
:000002d7       cpu:0.012635    message:281     mqlen:0 task:0
:000002dd       cpu:0.007929    message:54      mqlen:0 task:1
<CMD OK>

另外发现占用cpu都在系统空间，看起来不是lua逻辑问题
%Cpu(s): 20.5 us, 79.1 sy,  0.0 ni,  0.0 id,  0.0 wa,  0.0 hi,  0.0 si,  0.3 st
后来发现占cpu的不是工作线程，好像是socket线程，backtrace了一下看到停在这。
#0  0x00007fcf9e6a0c53 in __atomic_preadv_replacement (fd=-1657083256, vector=0x7fcf9bfa5ccc, count=-1678091056,
    offset=140529692707923) at ../sysdeps/posix/preadv.c:75
#1  0x000000000040c8fb in skynet_socket_poll () at skynet-src/skynet_socket.c:79
#2  0x000000000040b5d3 in thread_socket (p=0x7fcf9e21d280) at skynet-src/skynet_start.c:68
#3  0x00007fcf9f46a184 in start_thread (arg=0x7fcf9bfa6700) at pthread_create.c:312
#4  0x00007fcf9e6a937d in __ecvt_r (value=9.532824124368238e-130, ndigit=0, decpt=0x0, sign=0x0,
    buf=0x7fcf9bfa69c0 "\300yz\234\317\177", len=140529651836672) at efgcvt_r.c:218
#5  0x0000000000000000 in ?? ()

但服务器网络是好的，所有的功能也都正常，不看cpu占用的话不会发现这个问题。
请问这可能会是什么问题？从哪个方向查？

从 backtrace 看是 epoll wait 占用了 cpu , 这里 epoll wait 是无限等待直到有消息触发。
可以考虑看是不是 epoll ctrl 传入了错误的值。所有socket 对象都在一个全局数组里，可以用 gdb 遍历查看有多少活跃连接。

另外可以加点 printf 看看epoll wait 的调用频率，比如每1000 次 wait 输出一下，看出问题的时候是否在高频调用它。

恩，正常的服务器随便断下，基本是停在epoll_wait
#0  0x00007fd80b14aa13 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81
#1  0x000000000040e823 in sp_wait (max=64, e=0x7fd809e4f1b8, efd=<optimized out>) at skynet-src/socket_epoll.h:55
#2  socket_server_poll (ss=0x7fd809e4f180, result=result@entry=0x7fd808a46cd0, more=more@entry=0x7fd808a46ccc)
    at skynet-src/socket_server.c:1218
#3  0x000000000040c8fb in skynet_socket_poll () at skynet-src/skynet_socket.c:79
#4  0x000000000040b5b7 in thread_socket (p=0x7fd80acb8280) at skynet-src/skynet_start.c:68
#5  0x00007fd80bf0b184 in start_thread (arg=0x7fd808a47700) at pthread_create.c:312
#6  0x00007fd80b14a37d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

不正常的服务器会停在这2个地方，从来没有停在过epoll_wait
#0  0x00007fcf9e6a0c53 in __atomic_preadv_replacement (fd=-1657083256, vector=0x7fcf9bfa5ccc, count=-1678091056, offset=-1)
    at ../sysdeps/posix/preadv.c:75
#1  0x000000000040c8fb in skynet_socket_poll () at skynet-src/skynet_socket.c:79
#2  0x000000000040b5d3 in thread_socket (p=0x7fcf9e21d280) at skynet-src/skynet_start.c:68
#3  0x00007fcf9f46a184 in start_thread (arg=0x7fcf9bfa6700) at pthread_create.c:312
#4  0x00007fcf9e6a937d in __ecvt_r (value=6.9430831659744263e-310, ndigit=0, decpt=0x0, sign=0x0,
    buf=0x7fcf9bfa69c0 "\300yz\234\317\177", len=140529651836672) at efgcvt_r.c:218
#5  0x0000000000000000 in ?? ()

#0  0x00007fcf9e6a9a13 in __qecvt_r (value=<optimized out>, ndigit=-1678091056, decpt=0x7fcf9bfa5cb0, sign=0x7fcf9bfa5ccc,
    buf=0x7fcf9bfa58e8 "\020", len=140529672840760) at efgcvt_r.c:237
#1  0x00007fcf90f82380 in ?? ()
#2  0x00007fcf9d3ae600 in ?? ()
#3  0x00000000000000b5 in ?? ()
#4  0x0000000000000000 in ?? ()

用gdb把里面的活动socket找出来，我需要研究下，以前没做过，晚些回复你结果。
由于没法重现，所以也没法加printf调试。

通过gdb拿SOCKET_SERVER的信息发现，epool会不断的给出一个相同的消息
0x00007fcf9e6a0c53 in __atomic_preadv_replacement (fd=-1657083256, vector=0x7fcf9bfa5ccc, count=-1678091056, offset=-1)
    at ../sysdeps/posix/preadv.c:75
75      ../sysdeps/posix/preadv.c: No such file or directory.
5: *(struct socket*)SOCKET_SERVER.ev[0] = {opaque = 9, high = {head = 0x0, tail = 0x0}, low = {head = 0x0, tail = 0x0}, wb_size = 0,
  fd = 0, id = 1, protocol = 0, type = 8, p = {size = 64, udp_address = "@", '\000' <repeats 17 times>}}
4: SOCKET_SERVER.ev[0] = {s = 0x7fcf9d3aea88, read = false, write = false}
3: SOCKET_SERVER.event_index = 1
2: SOCKET_SERVER.event_n = 1
1: SOCKET_SERVER.checkctrl = 1

应该就是这个导致了wait不断被唤醒，占满cpu
这个消息是干什么的呢？怎么出现的？

type = 8 是 SOCKET_TYPE_BIND ， 说明这个是个 listen 的端口，可以从 opaque = 9  (服务地址) 去确认一下，是否是你的 gate 监听端口。id =1 是内部的 fd 。不过， fd = 0 比较奇怪，因为这通常是保留给 stdin 的。
如果不是 EPOLLIN 和 EPOLLOUT 则可能是出错了。建议把 epoll 返回的 flag 拿出来看看到底是什么。skynet 这里并没有处理 EPOLLERR ，可能是一个需要完善的点。

我推测是触发了 EPOLLERR ，但是没有触发过 EPOLLOUT EPOLLIN 导致代码无法关闭这个 fd ，而 epoll 使用的是 LT 模式，不处理的话会一直触发。这里需要完善一下错误的处理。
不过是否是 EPOLLERR ，最好可以进一步的确认。
另外，这应该只是一个表象，关键是为什么 fd = 0 处于 SOCKET_TYPE_BIND 状态。stdin 很容易和别的东西冲突。目前 skynet 即使在后台，fd = 0 应该也是重定向到 /dev/null 的。

9号服务是console，用的确实是stdin，我没有用daemon，直接用的(./skynet xxx >> xxx.log)，然后远程连接断开，进程也没关。
另外说下我做的可能有关联的改动，在gate里面（不是9号服务），我把redirect默认的dummy session从1改成了fd，想在收到消息时知道是谁发的，我也不大确认会不会出问题。
skynet.redirect(agent, c.client, "client", fd, msg, sz)

首先，可以看看我今天的修改能不能解决部分问题。
我刚才做了一些测试，虽然没有还原你的情况，但是发现另一个潜在的问题：如果不小心把一个 fd close 掉，但是却在 close 之前没有调用 sp_del 从 epoll 中删除，就会导致一个已经删除的 fd 的消息依然被 sp_wait 报告。而且由于 fd 已经 close ，所以即无法读这个 fd 来删除消息，也无法再 sp_del 去删。结果这个死消息就不断地抛出来了。
在我的测试中，我强行关闭了 fd 0 ，结果就不断地打印 socket-server: invalid socket 。
我 google 了一下，这个应该属于很难解决的问题。 https://idea.popcount.org/2017-03-20-epoll-is-fundamentally-broken-22/ 这个帖子的解决建议是把整个 epollfd 都废除掉新建一个。这也是 libev 遇到过的问题： http://lists.schmorp.de/pipermail/libev/2016q1/002680.html 。

调试了下，那个出错的flag是16，也就是EPOLLHUP。
也就是说这问题的起源是ssh退出后，console的stdin收到了EPOLLHUP消息。
但是我试了启动skynet再退出ssh，又重现不了这个现象。

我这边改成daemon就不会出问题了，另外 #644 最好把EPOLLHUP也处理了，保险一些。
你看看这个问题还需不需要跟进，不需要我就关了。

从 man epoll_ctl 上看，似乎直接把 EPOLLHUP 看作 EPOLLIN ，然后让 read 正常工作就可以了？

EPOLLHUP Hang  up  happened  on  the  associated file descriptor.  epoll_wait(2) will  always wait for this event; it is not necessary to set it in  events.   Note  that  when  reading  from  a channel such as a pipe or a stream socket, this event merely indicates that the peer closed its end of the channel.   Subsequent reads from the channel will return 0 (end of file) only after all outstanding data in the channel has been consumed.

好的，这个问题算是解决了，关单了，多谢。

authors: cloudwu jxfzlmb

repo: cloudwu/skynet


text:
Testing on a custom dataset

Hi, I've been having this problem for testing my trained model on my own custom dataset. I've been able to train my model with the provided code to format into lmdb. However, when I'm trying to test my trained model, this error shows up:
model input parameters 32 100 20 1 512 256 37 25 TPS ResNet BiLSTM CTC
loading pretrained model from saved_models/Test_pretrained/best_accuracy.pth
deep-text-recognition-benchmark\test.py:208: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
model.load_state_dict(torch.load(opt.saved_model, map_location=device))
'cp' is not recognized as an internal or external command,
operable program or batch file.
dataset_root:    Dataset/Validation\IIIT5k_3000  dataset: /
Traceback (most recent call last):
File "deep-text-recognition-benchmark\test.py", line 282, in
test(opt)
File "deep-text-recognition-benchmark\test.py", line 226, in test
benchmark_all_eval(model, criterion, converter, opt)
File "deep-text-recognition-benchmark\test.py", line 46, in benchmark_all_eval
eval_data, eval_data_log = hierarchical_dataset(root=eval_data_path, opt=opt)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "deep-text-recognition-benchmark\dataset.py", line 124, in hierarchical_dataset
concatenated_dataset = ConcatDataset(dataset_list)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "paddleocr1\Lib\site-packages\torch\utils\data\dataset.py", line 328, in init
assert len(self.datasets) > 0, "datasets should not be an empty iterable"  # type: ignore[arg-type]
^^^^^^^^^^^^^^^^^^^^^^
AssertionError: datasets should not be an empty iterable
And this is my script:
python test.py --eval_data Dataset/Validation --benchmark_all_eval --Transformation TPS --FeatureExtraction ResNet --SequenceModeling BiLSTM --Prediction CTC --saved_model saved_models/Test_pretrained/best_accuracy.pth
Can anyone please help me resolve my issue?

Hi, I've been having this problem for testing my trained model on my own custom dataset. I've been able to train my model with the provided code to format into lmdb. However, when I'm trying to test my trained model, this error shows up:
model input parameters 32 100 20 1 512 256 37 25 TPS ResNet BiLSTM CTC
loading pretrained model from saved_models/Test_pretrained/best_accuracy.pth
deep-text-recognition-benchmark\test.py:208: FutureWarning: You are using torch.load with weights_only=False (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https://github.com/pytorch/pytorch/blob/main/SECURITY.md#untrusted-models for more details). In a future release, the default value for weights_only will be flipped to True. This limits the functions that could be executed during unpickling. Arbitrary objects will no longer be allowed to be loaded via this mode unless they are explicitly allowlisted by the user via torch.serialization.add_safe_globals. We recommend you start setting weights_only=True for any use case where you don't have full control of the loaded file. Please open an issue on GitHub for any issues related to this experimental feature.
model.load_state_dict(torch.load(opt.saved_model, map_location=device))
'cp' is not recognized as an internal or external command,
operable program or batch file.
dataset_root: Dataset/Validation\IIIT5k_3000 dataset: / Traceback (most recent call last): File "deep-text-recognition-benchmark\test.py", line 282, in test(opt) File "deep-text-recognition-benchmark\test.py", line 226, in test benchmark_all_eval(model, criterion, converter, opt) File "deep-text-recognition-benchmark\test.py", line 46, in benchmark_all_eval eval_data, eval_data_log = hierarchical_dataset(root=eval_data_path, opt=opt) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "deep-text-recognition-benchmark\dataset.py", line 124, in hierarchical_dataset concatenated_dataset = ConcatDataset(dataset_list) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "paddleocr1\Lib\site-packages\torch\utils\data\dataset.py", line 328, in init assert len(self.datasets) > 0, "datasets should not be an empty iterable" # type: ignore[arg-type] ^^^^^^^^^^^^^^^^^^^^^^ AssertionError: datasets should not be an empty iterable
And this is my script: python test.py --eval_data Dataset/Validation --benchmark_all_eval --Transformation TPS --FeatureExtraction ResNet --SequenceModeling BiLSTM --Prediction CTC --saved_model saved_models/Test_pretrained/best_accuracy.pth
Can anyone please help me resolve my issue?

use the same number used for training
--output_channel 256 or 512
--hidden_size

repo: clovaai/deep-text-recognition-benchmark


text:
Merge pre-existing package.json with file generated by Cloverfield

Re issue #23

Tried to make it fit the pre-existing code structure as much as possible.
There is some "intelligence" to the merging from the package-merge package rather than a straight object merge - keywords field will be merged without duplicates etc. Might want to take a quick look at that package to see if its desired behaviour:

https://github.com/izaakschroeder/package-merge/blob/master/lib/merge.js

Tests fail due to a missing package.

Yeah, seems the guy who maintains package-merge didnt declare lodash as a dependency.
Its passing on my machine seemingly because its a dependency of precommit-hook thats been spat into node_modules by npm 3 as far as i can tell.
Not sure what the best approach is - theres not a ton of functionality in that package but i thought it would be nice to have. Could fork it and make a PR and in the meantime use the fork or do a simpler
{ ...origPkg, ...genPkg} type merge?

Hi, @halhenke can you please update PR so I can merge it? thanks :ok_hand:

OK for sure - sorry thought i already had - must be losing it... :-(

Aorry, for the delat, @halhenke
I've just checked the new generation process. Package.json is merged respecting existing values. Other files not, though. Like README.md has new values, though package.json still has old ones.
I am not sure about intended behaviour here. I can suggest that when we merge package.json we can see which values have been changed and replace them accordingly in other files too. But not touching values that should not be changed.
Alternative (and much easier) solution could be - read package.json to get "suggested" values for the second run. Then either I just hit "Enter" and use those default ones - or enter new ones - does not matter. Replace all things as usual.
Honestly after playing with it a bit I'd rather go for the second solution.
Related to #44 by the way.

:+1:

Hey sorry for delay in getting back to you Nik - busy few days,
Didn't realise we wanted to merge README also - was only thinking of package.json.
I also like the second idea - at least it makes people aware of whats happening. Will rework it and see if i can come up with something that deals with other files - think there could be some hard to deal with edge cases - but otherwise will go for the user prompt option.
Did you want me to try and work in suggestions from #44 also (i got the impression the other guy didnt want to)? Dont mind.

Awesome! #44 looks like duplicate to me then.

Cool! :+1:

What's going on with this?

Sorry, sort of got lost in Christmas stuff - have a couple of free days, will try to finish it off.

Cool. Thanks!

OK this thing has been dragging on for a while (apologies) would love to wrap it up
Not entirely happy with what i've done (it feels a bit hack-ish) but wanted to check its the direction we wanted.
Anyway if a package.json file is found that exists:

grab author/email/github from package.json & use as defaults
read dependecies, devDependencies and scripts fields and add questions whether the user wants to merge them into the template package.json (could easily add other fields like peerDependencies if you like)

Feels a bit inelegant because its not using the same handlebars template/vars method to modify most fields - though we do now have author/email variables etc that will now be used in other templates also.
Could use more tests. Anyway just wanted to get any feedback/suggested changes when you guys have time.

Hey guys - just wanted to say - if this PR just missed the mark or isnt working out I wont be offended if you just want to kill it or anything. Its all pretty fuzzy for me at this point anyway.

@nkbt Comments?

Wow, that looks cool, pretty much package.json-specific merging. I wish github sends emails on PR updated. I'll try it on couple of existing projects and let you know asap!

@nkbt Any more thoughts?

:-(
I'll take a look at it either tonight or later this weekend.

authors: ericelliott halhenke nkbt

repo: cloverfield-tools/cf-package

license: mit


text:
Removing users

Is it possible to delete users? I can make people inactive but there's doesn't seem to be a way to remove them completely.
I'm asking because an (inactive) account is automatically created when someone uses the Sign up link, I'd like to able to remove accounts for requests that we refuse.

Yes, however not easy. Biggest problem is what to do if the user has any files or other items associated with their account.
You can use https://github.com/clowder-framework/clowder/blob/master/scripts/mongodb/migrate_users.py to delete a user and it does some magic to check. Use migrate_users.py <id>.

Ok, thanks, I'll take a look.

authors: ocaisa robkooper

repo: clowder-framework/clowder

license: NCSA


text:
corrected links in footer

The links for {github, twitter, google+, HOME, READ, SEARCH, CONTRIBUTE}  in footer points to http://api.cltk.org/
I have corrected the links except CONTRIBUTE (I am not sure about the link to contribute so I left as it is).
I changed github, twitter, google+ links according to header.

Thanks!

Thank you sir.

authors: achaitanyasai lukehollis


text:
Batching with multiprocessing CLI

In this PR I add a CLI that allows reading from a JSONL file, create a number of separate processes to process the data with a modelkit.Model and output it to JSONL too.
Some features:

one process reads, and another one writes data
lazy loads the models, such that non serializable models work
it also builds batches for each worker
it supports ordered and unordered output

LGGTM

authors: antoinejeannot victorbenichoux

repo: clustree/modelkit


text:
mode_16_pal_256_win

Thank you for contributing to tamcolors!
Link the relating issue(s).
https://github.com/cmcmarrow/tamcolors/issues/137
Select ALL that apply.

[ ] Bug fix
[x] New feature
[ ] Breaking change
[ ] Doc change
[ ] Tests added/change

Still need to write mode for mac and linux

repo: cmcmarrow/tamcolors


text:
Release Change Healthcare

Link to issue
Link to PR (initial)
Proposed release version: ASAP

Initial set of Change Healthcare signals to be released to the API as soon as possible.

[ ] API documentation
[ ] draft API mailing list notification and send to @Akvannortwick

[x] Statistical review (usually correlations)
[ ] Signal / source name review (usually Roni)

@krivard @rumackaaron
The indicator is deployed and scheduled in staging (currently for 9:30pm or so):
Ex. curl to see data:
curl -X GET 'https://api-staging.delphi.cmu.edu/epidata/api.php?source=covidcast&data_source=changehc&signal=smoothed_adj_cli&time_type=day&geo_type=hrr&time_values=20200201-202011010&geo_value=1'

All done! Indicator deployed in prod and scheduled to run at 9:43pm each day.

authors: korlaxxalrok krivard

repo: cmu-delphi/covidcast-indicators


text:
Update APISnoop to include release 1.22

Add new release 1.22 to the APISnoop web UI

implemented in #500 , and it is now much simpler to update releases.  Simple go to resources/coverage/releases.yaml and update this file to include the new release.  Everthing updates itself from there.

authors: Riaankl zachmandeville

repo: cncf/apisnoop


text:
[zh] Localize 'TLS(Transport Layer Security)'

[ ] Localize the content/en/TLS(Transport Layer Security).md to content/zh-cn/ in dev-zh.

Solve by https://github.com/cncf/glossary/pull/1102

repo: cncf/glossary


text:
Update wordlist.txt to add multitenancy

Added "multitenancy".  Along with multi-tenancy, this is a common speling (e.g. https://en.wikipedia.org/wiki/Multitenancy)
Signed-off-by: Sergey Borovoy 48699431+sergeyborovoy@users.noreply.github.com

ref: #1154

authors: seokho-son sergeyborovoy


text:
Added Scality RING and Zenko logo

Pre-submission checklist:
Please check each of these after submitting your pull request:

[x ] Are you only including a repo_url if your project is 100% open source? If so, you need to pick the single best GitHub repository for your project, not a GitHub organization.
[x] Is your project closed source or, if it is open source, does your project have at least 250 GitHub stars?
[x] Have you picked the single best (existing) category for your project?
[x] Does it follow the other guidelines from the new entries section?
[x] Have you included a URL for your SVG or added it to hosted_logos and referenced it there?
[x] Does your logo clearly state the name of the project/product and follow the other logo guidelines?
[x] Does your project/product name match the text on the logo?
[x] Have you verified that the Crunchbase data for your organization is correct (including headquarters and LinkedIn)?
[ ] ~5 minutes after opening the pull request, the CNCF-Bot will post the URL for your staging server. Have you confirmed that it looks good to you and then added a comment to the PR saying "LGTM"?

Deploy preview for landscape failed.
Built with commit 6dcc3e8f81266bb87d93af9014a92888d053548a
https://app.netlify.com/sites/landscape/deploys/5c6d92fe265dc100086779e2

This is failing because you're overflowing a category. We'll fix it manually on this branch shortly.

Thanks @dankohn I thought there was something in my commit. Do I have to undo the last commit or are you able to pick 068b313 yourself?

Please fix up the commit so you think it's ready to go.

Ready to go, thanks

Replaced with https://github.com/cncf/landscape/pull/1120

authors: CNCF-Bot ZeusTheTrueGod dankohn smaffulli

repo: cncf/landscape


text:
Remove CNCF Trailmap

According to https://github.com/cncf/trailmap/issues/19#issuecomment-1240693340 the CNCF Trailmap is in the process of being removed
CC @alexcontini27
Signed-off-by: Daniel Holbach daniel@weave.works
Pre-submission checklist:
Please check each of these after submitting your pull request:

[ ] Are you only including a repo_url if your project is 100% open source? If so, you need to pick the single best GitHub repository for your project, not a GitHub organization.
[ ] Is your project closed source or, if it is open source, does your project have at least 300 GitHub stars?
[ ] Have you picked the single best (existing) category for your project?
[ ] Does it follow the other guidelines from the new entries section?
[ ] Have you added your SVG to hosted_logos and referenced it there?
[ ] Does your logo clearly state the name of the project/product and follow the other logo guidelines?
[ ] Does your project/product name match the text on the logo?
[ ] Have you verified that the Crunchbase data for your organization is correct (including headquarters and LinkedIn)?
[x] ~30 minutes after opening the pull request, the CNCF-Bot will post the URL for your staging server. Have you confirmed that it looks good to you and then added a comment to the PR saying "LGTM"?

LGTM!


text:
Add Stolon project

Stolon provides cloud native high availability for PostgreSQL
Pre-submission checklist:
Please check each of these after submitting your pull request:

[ ] Are you only including a repo_url if your project is 100% open source? If so, you need to pick the single best GitHub repository for your project, not a GitHub organization.
[ ] Is your project closed source or, if it is open source, does your project have at least 250 GitHub stars?
[ ] Have you picked the single best (existing) category for your project?
[ ] Does it follow the other guidelines from the new entries section?
[ ] Have you included a URL for your SVG or added it to hosted_logos and referenced it there?
[ ] Does your logo clearly state the name of the project/product and follow the other logo guidelines?
[ ] Does your project/product name match the text on the logo?
[ ] Have you verified that the Crunchbase data for your organization is correct (including headquarters and LinkedIn)?
[ ] 2 minutes after opening the pull request, the CNCF-Bot will post the URL for your staging server. Have you confirmed that it looks good to you and then added a comment to the PR saying "LGTM"?

Deploy preview for landscape ready!
Built with commit 807a87d53112ecdb981346900440db2fa1544aee
https://deploy-preview-674--landscape.netlify.com

LGTM

authors: CNCF-Bot sgotti


text:
Polish schema changes

Background: https://airtable.com/tblD3oZPLJgGhCmch/viwchkdQkRUw6hZ3z/rectLCc933bZ74VVM?blocks=hide
PM: @awoods187, @rolandcrosby
Eng:

Closing - currently marked as "not building" in AirTable.

authors: jseldess lnhsingh

repo: cockroachdb/docs


text:
Build a Rust App with CockroachDB Doc Update

Re: Build a Rust App with CockroachDB
Issue Description
This document seems to be massively out of date. The code given for a secure cockroach connection in Rust does not build. Producing the following errors:
   Compiling conq_db v0.1.0 (/mnt/c/Users/michael/conveqs/conq_db)
error[E0433]: failed to resolve: could not find `openssl` in `tls`
 --> src/cockroachlabs_examle.rs:8:20
  |
8 | use postgres::tls::openssl::openssl::ssl::{SslConnectorBuilder, SslMethod};
  |                    ^^^^^^^ could not find `openssl` in `tls`

error[E0433]: failed to resolve: could not find `openssl` in `tls`
 --> src/cockroachlabs_examle.rs:9:20
  |
9 | use postgres::tls::openssl::openssl::x509::X509_FILETYPE_PEM;
  |                    ^^^^^^^ could not find `openssl` in `tls`

error[E0432]: unresolved import `postgres::tls::openssl`
 --> src/cockroachlabs_examle.rs:7:20
  |
7 | use postgres::tls::openssl::OpenSsl;
  |                    ^^^^^^^ could not find `openssl` in `tls`

error[E0433]: failed to resolve: could not find `Client` in `postgres`
  --> src/conn_secure.rs:17:32
   |
17 |     let mut client = postgres::Client::connect(
   |                                ^^^^^^ could not find `Client` in `postgres`

error[E0433]: failed to resolve: use of undeclared type or module `SslConnectorBuilder`
  --> src/cockroachlabs_examle.rs:13:33
   |
13 |     let mut connector_builder = SslConnectorBuilder::new(SslMethod::tls()).unwrap();
   |                                 ^^^^^^^^^^^^^^^^^^^ use of undeclared type or module `SslConnectorBuilder`
error[E0433]: failed to resolve: use of undeclared type or module `SslMethod`
  --> src/cockroachlabs_examle.rs:13:58
   |
13 |     let mut connector_builder = SslConnectorBuilder::new(SslMethod::tls()).unwrap();
   |                                                          ^^^^^^^^^ use of undeclared type or module `SslMethod`

error[E0425]: cannot find value `X509_FILETYPE_PEM` in this scope
  --> src/cockroachlabs_examle.rs:16:73

Suggested Resolution
Update example with something compatible with current postgress crate.
Always put dates, version numbers, dependencies on all such documents and example codes.

Thanks for reporting this, @ZiCog, and apologies that our Rust tutorial is out of date. I'll look for someone here who might be able to help.

Actually, so that I can make progress on my project, it would be useful to just know what version of the postgres and openssl crates that example was build against. Basically the content of the Cargo.toml file.

@ZiCog could you try postgres = "0.15" (https://docs.rs/postgres/0.15.2/postgres/)?

Ha, yes. I have just been trying a whole bunch of releases. None would build.

https://users.rust-lang.org/t/rust-postgres-and-openssl/33328/5

After taking advice from the postgress crates author, see rust-lang. link above, and some more futzing around this at least compiles and connects to my roach in the cloud:
use postgres::{Connection, TlsMode};
use postgres_openssl::{OpenSsl};
use postgres_openssl::openssl::ssl::{SslMethod, SslConnector};

pub fn sfackler_example() {
    let mut builder = SslConnector::builder(SslMethod::tls()).unwrap();

    builder.set_ca_file("/home/michael/certs/ca.crt").unwrap();
    builder.set_certificate_chain_file("/home/michael/certs/client.root.crt").unwrap();
//    builder.set_private_key_file("/home/michael/certs/client.root.key", X509_FILETYPE_PEM).unwrap();

    let negotiator = OpenSsl::from(builder.build());

    let conn = Connection::connect(
        "postgres://root@otaniemi.conveqs.fi:26257",
        TlsMode::Require(&negotiator),
    ).unwrap();

    conn.execute("SELECT 1::VARCHAR", &[]).unwrap();
}

With Cargo.toml:
[dependencies]
postgres = "0.15"
postgres-openssl = "0.1"

That of course fails to make the complete the connection with :
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(ConnectParams("a password was requested but not provided"))', src/libcore/result.rs:1084:5

Because I have commented out the line that sets the private key file.
If anyone can find where that "X509_FILETYPE_PEM" comes from this would probably work.

OK. After discussion with the postgres crates author I have a working example of making secure connection to cockroachdb from Rust:
use postgres::{Connection, TlsMode};
use postgres_openssl::{OpenSsl};
use postgres_openssl::openssl::ssl::{SslMethod, SslConnector};
use postgres_openssl::openssl::ssl::SslFiletype;

struct Person {
    id:   i64,
    name: String,
    data: Option<Vec<u8>>,
}

pub fn sfackler_example() {
    let mut builder = SslConnector::builder(SslMethod::tls()).unwrap();

    builder.set_ca_file("/home/zicog/certs/ca.crt").unwrap();
    builder.set_certificate_chain_file("/home/zicog/certs/client.root.crt").unwrap();
    builder.set_private_key_file("/home/zicog/certs/client.root.key", SslFiletype::PEM).unwrap();

    let negotiator = OpenSsl::from(builder.build());

    let conn = Connection::connect(
        "postgres://root@xyz.com:26257",
        TlsMode::Require(&negotiator),
    ).unwrap();

    conn.execute("USE defaultdb", &[]).unwrap();

    match conn.execute("CREATE TABLE person (
                    id              SERIAL PRIMARY KEY,
                    name            VARCHAR NOT NULL,
                    data            BYTEA
                  )", &[]) {
        Ok(_) => (),
        Err(e) => {
            // Will error out if table already exists.
            println!("{:?}", e);
        },
    }

    let me = Person {
        id: 1,
        name: "John".to_string(),
        data: None,
    };

    // NB: This does not insert the id.
    conn.execute("INSERT INTO person (name, data) VALUES ($1, $2)",
                 &[&me.name, &me.data]).unwrap();

    for row in &conn.query("SELECT id, name, data FROM person", &[]).unwrap() {
        let person = Person {
            id: row.get(0),
            name: row.get(1),
            data: row.get(2),
        };
        println!("Found person {}: {}", person.id, person.name);
    }
}

Using this in the Cargo.toml file:
[dependencies]
postgres = "0.15"
postgres-openssl = "0.1"

Works a treat.

authors: ZiCog jseldess mattcrdb nvanbenschoten


text:
Document foreign key column ordering

Fixes https://github.com/cockroachdb/docs/issues/11347.

This change is

authors: cockroach-teamcity ericharmeling


text:
[DOC-10520] Fix the domain on some API examples

DOC-10520] Fix the domain on some API examples
Previews:
src/current/cockroachcloud/egress-perimeter-controls.md
src/current/v22.1/vault-db-secrets-tutorial.md
src/current/v22.2/vault-db-secrets-tutorial.md
src/current/v23.1/vault-db-secrets-tutorial.md
src/current/v23.2/vault-db-secrets-tutorial.md
src/current/v24.1/vault-db-secrets-tutorial.md

I think it should be cockroachlabs.cloud and not cockroachlabs.com ?

Whoops, you are right. Done.


text:
Add columns to information_schema.columns

Fixes #4258.

This change is

http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/ead1a49f5574e6c79bb4bd5269ef5bece6e83be6/

@knz, ping.

TFTR, @BramGruneir.

authors: cockroach-teamcity jseldess


text:
Renamed SQLAlchemy dialect

Fixes #7121.

Renamed cockroachdb-python to sqlalchemy-cockroachdb.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/a1727659b2051953fadd96687f36406b37ad5d8f/
Edited pages:

v1.0/build-a-python-app-with-cockroachdb-sqlalchemy.md
v1.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.1/advanced-client-side-transaction-retries.md
v19.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.1/known-limitations.md
v19.1/transactions.md
v19.2/advanced-client-side-transaction-retries.md
v19.2/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.2/cockroachcloud-connect-to-your-cluster.md
v19.2/deploy-a-python-to-do-app-with-flask-kubernetes-and-cockroachcloud.md
v19.2/install-client-drivers.md
v19.2/known-limitations.md
v19.2/multi-region-application.md
v19.2/run-multi-statement-transactions.md
v19.2/transactions.md
v2.0/build-a-python-app-with-cockroachdb-sqlalchemy.md
v2.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v2.1/known-limitations.md
v20.1/advanced-client-side-transaction-retries.md
v20.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v20.1/cockroachcloud-connect-to-your-cluster.md
v20.1/deploy-a-python-to-do-app-with-flask-kubernetes-and-cockroachcloud.md
v20.1/install-client-drivers.md
v20.1/known-limitations.md
v20.1/run-multi-statement-transactions.md
v20.1/transactions.md

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/777b540e964e5fbd152195d5c6c19896e3417159/
Edited pages:

v1.0/build-a-python-app-with-cockroachdb-sqlalchemy.md
v1.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.1/advanced-client-side-transaction-retries.md
v19.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.1/known-limitations.md
v19.1/transactions.md
v19.2/advanced-client-side-transaction-retries.md
v19.2/build-a-python-app-with-cockroachdb-sqlalchemy.md
v19.2/cockroachcloud-connect-to-your-cluster.md
v19.2/deploy-a-python-to-do-app-with-flask-kubernetes-and-cockroachcloud.md
v19.2/install-client-drivers.md
v19.2/known-limitations.md
v19.2/multi-region-application.md
v19.2/multi-region-setup.md
v19.2/run-multi-statement-transactions.md
v19.2/transactions.md
v2.0/build-a-python-app-with-cockroachdb-sqlalchemy.md
v2.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v2.1/known-limitations.md
v20.1/advanced-client-side-transaction-retries.md
v20.1/build-a-python-app-with-cockroachdb-sqlalchemy.md
v20.1/cockroachcloud-connect-to-your-cluster.md
v20.1/deploy-a-python-to-do-app-with-flask-kubernetes-and-cockroachcloud.md
v20.1/install-client-drivers.md
v20.1/known-limitations.md
v20.1/run-multi-statement-transactions.md
v20.1/transactions.md


text:
Highlight sidenav for more release note pages

Previously, when looking at many of our  specific release note pages,
the sidenav would collapse. Now:

When looking at any supported production release of CRDB,
the sidenav stays open to:
CockroachDB > Releases > Production Releases > All Production Releases
When looking at any testing release for the upcoming version,
the sidenav stays open to:
CockroachDB > Releases > Testing Releases
When looking at any but the latest CockroachCloud release,
the sidenav stays open to:
CockroachCloud > Release Notes > All Release Notes

For CRDB, pages for earlier production releases continue and pages
for earlier testing releases are not reflected in the sidenav.
We could cover those, too, but I'm not sure it's worth the effort.
Fixes #9957
Fixes #8454
One open issue: The "All Production Releases" and "Testing Releases" links
in the sidenav open /releases/index.html at specific anchor points. These
links work, but our sidenav doesn't seem to able keep the right entry
highlighted in the sidenav due to the anchors. I've opened an issue
for that: https://github.com/cockroachdb/docs/issues/9982.

This change is

Online preview: http://cockroach-docs-review.s3-website-us-east-1.amazonaws.com/dbff332183fd73e5146f763eb802920c68ebee1f/


text:
freebsd: convert rlimit.Cur to uint64

Hi,
the rlimit.Cur is a int64 so I just hardcoded the conversion. Are you fine with this? Otherwise I can break out the function and add a _freebsd.go file etc but this seemed easier.
log from current master:
[cryptix@svahnry ~/go/src/github.com/codahale/metrics/runtime:master] uname -a
FreeBSD svahnry 10.1-RELEASE-p9 FreeBSD 10.1-RELEASE-p9 #0: Tue Apr  7 01:09:46 UTC 2015     root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC  amd64
[cryptix@svahnry ~/go/src/github.com/codahale/metrics/runtime:master] go test
# github.com/codahale/metrics/runtime
./fds.go:17: cannot use rlimit.Cur (type int64) as type uint64 in return argument
FAIL	github.com/codahale/metrics/runtime [build failed]

Awesome, thanks! I’ll add a comment to make sure it doesn’t get removed in the future.

authors: codahale cryptix

repo: codahale/metrics


text:
Limit over run output

Linked to #1351 from Chris
@ mention of reviewers
@ihsaan-ullah
A brief description of the purpose of the changes contained in this PR.
If a submission writes a output line larger than the stream buffer size ( default 64k ) a LimitOverrunError will be raise. Rather than using readline(...) use readutil(....) and in the case of a overrun just return the current buffer, the rest of the line will be returned with the next read.
A checklist for hand testing

Tested with local worker connected to codabench.org

Checklist

[x] Code review by me
[x] Hand tested by me
[x] I'm proud of my work
[x] Code review by reviewer
[x] Hand tested by reviewer
[x] CircleCi tests are passing
[x] Ready to merge

Note for myself: need to update the compute worker docker image for testing and deployment.

@ihsaan-ullah @cjh1
Updating all compute workers are needed to take this change into account.
Are you using your own queue of compute workers?

If yes, the procedure to update workers is described here: https://github.com/codalab/codabench/wiki/Compute-Worker-Management---Setup#update-docker-image

If no, do you need this change to be deployed soon in the public queue?

authors: Didayolo ihsaan-ullah

repo: codalab/codabench


text:
Bank feeds api - nav + corrections

Description
Added xero bank feeds to side nav, removed a random link from text
Type of change

[ ] New document(s)/updating existing
[X] Fixes
[X] Styling
[ ] Bug fix (non-breaking change which fixes an issue)

Do we not think a dedicated page for xero bank feeds is warranted?

Do we not think a dedicated page for xero bank feeds is warranted?

It probably is, but at the moment we already refer to this in the overview itself. Better to have something in the side nav rather than nothing at all

authors: mcclowes pzaichkina

repo: codatio/codat-docs


text:
problem withkinect2_calibration!!!

after capturing a budget of about 120 frames for both the IR calibration, color calibration and sync and respecting all instructions on the Web page, the output are these and when i launch the viewer after the calibration the points in the video are not aligned with the image, but are shifted by a long, the re-projection error is approximately 0.3(is too big?) ,(And the image and the point cloud are shifted ..'..why?)
for the color calibration:
%YAML:1.0
cameraMatrix: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 1.1004687793237374e+03, 0., 1.0069369709567793e+03, 0.,
1.0978066255792717e+03, 4.5910703830681450e+02, 0., 0., 1. ]
distortionCoefficients: !!opencv-matrix
rows: 1
cols: 5
dt: d
data: [ 5.1273018211442180e-02, -4.1309038575363652e-02,
-1.5403380499678277e-02, 1.3607453419991436e-02,
1.2777603635683029e-02 ]
rotation: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 1., 0., 0., 0., 1., 0., 0., 0., 1. ]
projection: !!opencv-matrix
rows: 4
cols: 4
dt: d
data: [ 1.1004687793237374e+03, 0., 1.0069369709567793e+03, 0., 0.,
1.0978066255792717e+03, 4.5910703830681450e+02, 0., 0., 0., 1.,
0., 0., 0., 0., 1. ]
for the depth calibration:
%YAML:1.0
depthShift: -2.2823243656717089e+01
for the ir calibration
%YAML:1.0
cameraMatrix: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 3.6491380051748291e+02, 0., 2.4959685356221763e+02, 0.,
3.6438630560775880e+02, 2.0772319014430403e+02, 0., 0., 1. ]
distortionCoefficients: !!opencv-matrix
rows: 1
cols: 5
dt: d
data: [ 1.0165096942146126e-01, -2.9299799708217533e-01,
-7.8572653956486820e-04, -6.7892402528351662e-04,
1.1590297474610570e-01 ]
rotation: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 1., 0., 0., 0., 1., 0., 0., 0., 1. ]
projection: !!opencv-matrix
rows: 4
cols: 4
dt: d
data: [ 3.6491380051748291e+02, 0., 2.4959685356221763e+02, 0., 0.,
3.6438630560775880e+02, 2.0772319014430403e+02, 0., 0., 0., 1.,
0., 0., 0., 0., 1. ]
for the pose calibration:
%YAML:1.0
rotation: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 9.9894326499132058e-01, -3.1952017133869632e-03,
-4.5849144097694909e-02, 5.5494116217593434e-03,
9.9866726137486050e-01, 5.1311841602970365e-02,
4.5624087488219479e-02, -5.1512054356692150e-02,
9.9762966620726579e-01 ]
translation: !!opencv-matrix
rows: 3
cols: 1
dt: d
data: [ -6.4922819925538416e-02, 1.9525107596072039e-02,
3.7529080315411516e-02 ]
essential: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ 6.8255090272380497e-04, -3.8484842264318329e-02,
1.7553140349080749e-02, 4.0451466438663368e-02,
-3.4642208107197110e-03, 6.3048254960314049e-02,
-1.9864758182739209e-02, -6.4773908118525639e-02,
-2.4360999807420910e-03 ]
fundamental: !!opencv-matrix
rows: 3
cols: 3
dt: d
data: [ -5.2237669512051990e-07, 2.9496242838306074e-05,
-1.0898902090344002e-02, -3.1033795693758629e-05,
2.6615488031678916e-06, -1.0457711038294761e-02,
3.1504366658227895e-02, 2.3710177483597092e-02, 1. ]

I am facing the same problem.
I repeated the calibration process twice and made sure that I am not missing anything.
Please help

Cly@ly-HP-Pavilion-Notebook:~/catkin_ws$ rosrun kinect2_calibration kinect2_calration chess5x7x0.03 record color
[ INFO] [main] Start settings:
Mode: record
Source: color
Board: chess
Dimensions: 5 x 7
Field size: 0.03
Dist. model: 5 coefficients
Topic color: /kinect2/hd/image_mono
Topic ir: /kinect2/sd/image_ir
Topic depth: /kinect2/sd/image_depth
Path: ./
[ INFO] [main] starting recorder...
[ INFO] [Recorder::startRecord] Controls:
[ESC, q] - Exit
[SPACE, s] - Save current frame
[l] - decrease min and max value for IR value range
[h] - increase min and max value for IR value range
[1] - decrease min value for IR value range
[2] - increase min value for IR value range
[3] - decrease max value for IR value range
[4] - increase max value for IR value range
[ERROR] Tried to advertise a service that is already advertised in this node [/kinect2_calib_1498205553081554212/compressed/set_parameters]
[ERROR] Tried to advertise a service that is already advertised in this node [/kinect2_calib_1498205553081554212/compressed/set_parameters]
Please help

@lvxingzhe1991 ,that is ok. you  can proceed with the following steps.


text:
Update Qdrant Version

Updates the qdrant version, works with qdrant version v0.9.1.
The update includes breaking changes in qdrant, therefore existing collections have to be recreated.
Dev-setup, refinery, dev and beta must be updated accordingly.

Checklist:

[ ] update qdrant version in dev-setup
[ ] update qdrant version in refinery
[ ] update qdrant version on dev
[ ] update qdrant version on beta

repo: code-kern-ai/refinery-neural-search


text:
Issue scan QR in Iphone.

I have to push source :https://github.com/code-kotis/barcode-scanner/tree/gh-pages to folder web in IIS 7.
It scan QR code in window phone and Android  is Ok , but at Iphone is not good.
i have to test in qrcodescan the same me.
you can support me, make it handle in iphone the same andoid and window phone?
sorry for my english not good!

@thanhbinh9xnt Hey, as of now safari doesnt support the mediaStream API. So qrcodescan.in has a camera button on the bottom to take picture and scan the photo for qr codes. It should work fine. Let me know

Closing this issue. I mentioned the details in above comments. @thanhbinh9xnt Thanks

repo: code-kotis/barcode-scanner


text:
Add an easy way to create a new application/... in a running cluster

I realized I almost never test application creation/... during development.
The story_marketplace and story_registry would be useful to run during development, but they start/stop the cluster, making them not very convenient to use.
In my opinion it would be beneficial to have a way to run them against a running cluster, this would provide an easy way for some testing of the cluster functionality.

Putting the command here also in case I forget :)
$ oc new-app <sample_app> && oc rollout status <sample_app> && oc get routes -ojsonpath='{.items[].spec.host}' | xargs curl -Ik

authors: cfergeau praveenkumar

repo: code-ready/crc


text:
[BUG] Can't connect to the VM via SSH during initial setup

During the crc setup a connection cannot be established via SSH to the VM.  Also CRC domains are not pingable/resolvable.
General information

OS: Windows
Hypervisor:  Hyper-V
Did you run crc setup before starting it? Yes
Running CRC on:  Desktop

CRC version
# Put `crc version` output here

CodeReady Containers version: 1.35.0+751824a9
OpenShift version: 4.9.5 (bundle installed at C:\Program Files\CodeReady Containers\crc_hyperv_4.9.5.crcbundle)

CRC status
# Put `crc status --log-level debug` output here

C:\Users\user1>crc status --log-level debug
DEBU CodeReady Containers version: 1.35.0+751824a9
DEBU OpenShift version: 4.9.5 (bundle installed at C:\Program Files\CodeReady Containers\crc_hyperv_4.9.5.crcbundle)
DEBU Running 'crc status'
DEBU Checking file: C:\Users\user1\.crc\machines\crc\.crc-exist
DEBU Checking file: C:\Users\user1\.crc\machines\crc\.crc-exist
DEBU Running 'Hyper-V\Get-VM crc | Select-Object -ExpandProperty State'
DEBU Running SSH command: df -B1 --output=size,used,target /sysroot | tail -1
DEBU Using ssh private keys: [C:\Users\user1\.crc\machines\crc\id_ecdsa C:\Users\user1\.crc\cache\crc_hyperv_4.9.5\id_ecdsa_crc]
DEBU SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:64939->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output:
DEBU Cannot get root partition usage: ssh command error:
command : df -B1 --output=size,used,target /sysroot | tail -1
err     : ssh: handshake failed: read tcp 127.0.0.1:64939->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.
DEBU cannot get OpenShift status: CreateFile C:\Users\user1\.crc\machines\crc\kubeconfig: The system cannot find the file specified.
CRC VM:          Running
OpenShift:       Unreachable (v4.9.5)
Disk Usage:      0B of 0B (Inside the CRC VM)
Cache Usage:     14.94GB
Cache Directory: C:\Users\user1\.crc\cache

CRC config
# Put `crc config view` output here

crc config view
- consent-telemetry                     : no

Host Operating System
# Put the output of `cat /etc/os-release` in case of Linux
# put the output of `sw_vers` in case of Mac
# Put the output of `systeminfo` in case of Windows

Host Name:                 HOME
OS Name:                   Microsoft Windows 10 Pro
OS Version:                10.0.19043 N/A Build 19043
OS Manufacturer:           Microsoft Corporation
OS Configuration:          Standalone Workstation
OS Build Type:             Multiprocessor Free
Registered Organization:
System Boot Time:          10-Nov-21, 5:31:40 PM
System Manufacturer:       Micro-Star International Co., Ltd.
System Model:              MS-7C37
System Type:               x64-based PC
Processor(s):              1 Processor(s) Installed.
                           [01]: AMD64 Family 23 Model 113 Stepping 0 AuthenticAMD ~3800 Mhz
BIOS Version:              American Megatrends Inc. H.00, 04-Jun-19
Windows Directory:         C:\WINDOWS
System Directory:          C:\WINDOWS\system32
Boot Device:               \Device\HarddiskVolume2
System Locale:             en-us;English (United States)
Total Physical Memory:     32,717 MB
Available Physical Memory: 27,279 MB
Virtual Memory: Max Size:  37,581 MB
Virtual Memory: Available: 29,603 MB
Virtual Memory: In Use:    7,978 MB
Page File Location(s):     C:\pagefile.sys
Domain:                    WORKGROUP
Logon Server:              \\HOME
Network Card(s):           5 NIC(s) Installed.
                           [01]: VMware Virtual Ethernet Adapter for VMnet1
                                 Connection Name: VMware Network Adapter VMnet1
                                 DHCP Enabled:    No
                                 IP address(es)
                                 [01]: 192.168.189.1
                                 [02]: fe80::a50e:f5a6:7fc1:df62
                           [02]: VMware Virtual Ethernet Adapter for VMnet8
                                 Connection Name: VMware Network Adapter VMnet8
                                 DHCP Enabled:    No
                                 IP address(es)
                                 [01]: 192.168.83.1
                                 [02]: fe80::784f:cea5:acbe:3e76
                           [03]: Realtek PCIe GbE Family Controller
                                 Connection Name: Ethernet
                                 DHCP Enabled:    Yes
                                 DHCP Server:     192.168.1.1
                                 IP address(es)
                                 [01]: 192.168.1.22
                                 [02]: fe80::3073:9af6:d507:f64f
                           [04]: Bluetooth Device (Personal Area Network)
                                 Connection Name: Bluetooth Network Connection
                                 Status:          Media disconnected
                           [05]: Hyper-V Virtual Ethernet Adapter
                                 Connection Name: vEthernet (Default Switch)
                                 DHCP Enabled:    No
                                 IP address(es)
                                 [01]: 172.29.16.1
                                 [02]: fe80::d5e5:3470:f62f:ecb7
Hyper-V Requirements:      A hypervisor has been detected. Features required for Hyper-V will not be displayed.

Steps to reproduce

crc setup --log-level debug
crc start--log-level debug

Expected
Setup completes successfully.
Actual
Setup fails midway
Logs
Before gather the logs try following if that fix your issue
$ crc delete -f
$ crc cleanup
$ crc setup
$ crc start --log-level debug

https://gist.github.com/cid404/aeb2ae79b2406873db4b7ef00b8aecb0

I'm still getting this probem after run all the comment above

@cuongtsm it's better if you open a new issue and follow the issue template to provide the information that we need to assist you.

the OP had VMware and Hyper-V installed. This needs modification with bcdedit to work properly. That is not a supported setup.
Please file a new issue with your setup info.

authors: cfergeau cid404 cuongtsm gbraad


text:
Drop host dnsmasq setup on Linux

While https://github.com/code-ready/crc/pull/264 makes the dnsmasq setup simpler already, it'd be nice to not have to do any dnsmasq setup on the host machine at all.

WIP branch here: https://github.com/code-ready/crc/pull/590


text:
Updates to the Website

Anyone wants to work on improving the website ?
TODO on the WEBSITE

[ ] The chapters need to updated to the current 4 chapters
[ ] Details about each chapter to be updated
[ ] Details of codeIIEST projects to be updated in the website
[ ] A bit about previous members of codeIIEST (a sort of details about codeIIEST alumni)

@saugata001
@adilmah
??

anyone willing to work on this?

@prateekiiest I'm up!

Thanks @xdsarkar . Could you start working on the above issues?

@prateekiiest was going through the site after quite some time, the "Team" section has only pics of the members. Adding their names would make sense.
Also, the Blog section. Something we had planned from the initiation, but never happened till now :P
Even I started working on the Algo blog, but couldn't get time to proceed.
Would be nice to see and Algo, and a Tech blog, Tech as in something actively discussing current enhancement in tech, the kind of discussions we see in websites like TechCrunch.

I guess I can update all this after March

@indrarahul2013 need to work on this

Sure !!

authors: indrarahul2013 prateekiiest smitbose xdsarkar


text:
about $$().size() bug

print $$().size()    is 0
But  i can $$().get(0)  to  get elememnt

if First findelement  by id  work
List<SelenideElement> pageList1 = $("#work").$$(By.className("ul-0")); 		System.out.println(pageList1.size());
it worked.

if Change the order
	System.out.println($$(By.className("ul-0")).get(0).$$("li").shouldHave(sizeGreaterThan(0)).size()); 		//如果存在多页,进行翻页测试 		List<SelenideElement> pageList = $$(By.className("ul-0")); 		System.out.println($$(By.className("ul-0")).size()); 		System.out.println($$(By.className("ul-0"))); 		System.out.println(pageList.size());
it worked..........

good

authors: bentys zhupengfarmer

repo: codeborne/selenide


text:
Update zh-HANT.ozar.coffee

Translate

Thanks for your help with translations, @changekai!

authors: changekai nwinter

repo: codecombat/codecombat


text:
Loss of coverage after adding a new unit test

Environment:

JaCoCo version: 0.8.8
Operating system: ubuntu
Tool integration: Maven
Pull request: https://github.com/nbauma109/jd-core-v0/pull/65

Steps:

Create a new branch from master
Commit and push a new unit test to the new branch
Create a new pull request
Read codecov report

Expected behaviour

Global code coverage increases or remains the same
None of the classes may have decreased coverage

Actual behaviour
A loss of coverage is observed but this is due to wrong initial coverage.
The native jacoco reports do not show any coverage loss (the version before also has the same uncovered pieces).

@nbauma109 can you open a topic in our community boards for this?

repo: codecov/uploader


text:
Update markerclusterer - moved to GitHub from SVN.

There was an issue with the markers on the Events map. I think it has to do with the fact that Google moved the repo from SVN to GitHub. I have updated the file + added the 5 markers (m1-m5). The images were added in folder static/img/* - I find it weird there was no other markers before, so if you spot a mistake, please flag it and don't accept the PR. Thanks!

Coverage remained the same at 85.114% when pulling 39abc0bbb28dd9f0dd559e39570b469b1eb7d2e5 on oana-sipos:master into c881805f57b16b989940f0ea143fa533eeecb1f5 on codeeu:master.

Hey @oana-sipos,
It's great that you spotted the issue and provided a fix!
You're probably right that the images stopped working since this URL is no longer available: http://google-maps-utility-library-v3.googlecode.com/svn/trunk/markerclusterer/images/m2.png I think we shouldn't have used that in the first place.
After a quick glance over the diff I think it looks fine and your solution to include the images in our repo is a lot better than to reference them from an external server.
I can't do much more, however, since I've stepped down from the webdev team at Code Week. I will give you write access to the repositories and you'll be able to merge this PR yourself should you decide so. I can also provide you with access to the production server so you or someone esle can deploy the fix.

@mitio Just saw this and invited @oana-sipos to be a member of the org.

@kerstin Yeah, I also added her in the "Members" team (people with write and admin access).
If you're interested into restructuring the teams, please go ahead as you see fit. 🚢

Coverage remained the same at 85.114% when pulling c38a367c363b28fbad6e808ea6b062d643e2e0b8 on oana-sipos:master into c881805f57b16b989940f0ea143fa533eeecb1f5 on codeeu:master.

@mitio Could you please deploy? Thanks 🍨

@oana-sipos I deployed it using the ./deploy-latest-coding-events script I wrote (as mentioned in the instructions).
Now no markers show on the map, however.
I will leave it deployed so you can track what might have caused it. I did a very quick investigation but I see no apparent problems aside from the fact that the markersclusterer.js is loaded from this URL in production: http://events.codeweek.eu/static/CACHE/js/4ed9097d9207.js which means the images would be searched for in http://events.codeweek.eu/static/CACHE/img/m... which is not correct. Maybe an absolute path needs to be used for them, e.g. /static/img/m. I think, however, that the problem is somewhere else since no marker images are attempted to be loaded and no markers appear to be drawn at all.

P.S. Here is the deploy log and the short deployment script.

Something is clearly weird in here. As far as I understand markerclusterer.js is loaded in production from http://events.codeweek.eu/static/CACHE/js/8121d734f1ac.js which doesn't fully make sense. I am trying to run everything locally and also deploy to heroku to see how it works in a prod env. An evening + night of traveling is awaiting for me, so it might take until tomorrow to fix it fully (am afraid will not have a connection anytime soon). If you think it's better, please revert the deploy to the previous commit. Thanks, keep in touch!
p.s. About deploying: guess you would need a private ssh key from me to be able to connect to root?

Things are different on the public site due to the fact that there's some concatenation and caching going on only on production. You might need to check out the actual configuration on the production server.
However, the file itself is being loaded, so that doesn't seem to be the problem. The issue is possibly somewhere else.
Let's leave this version up for now. No need to revert back to another broken version.
For deploying, I will need your public key, not the private one. The private key must stay only in your possession. You can check out this article or this one on the topic on generating the private-public key pair. When you've generated one, just email me the contents of your public key (most likely contained in ~/.ssh/id_rsa.pub).

I meant public of course :P E-mail sent to you with it. Just ping me when you add it. Thanks!

authors: coveralls kerstin mitio oana-sipos

repo: codeeu/coding-events


text:
Revert is causing some trouble

Revert seems to be using today's date as opposed to the passed date from the form.

If it's not the first step, it should use the previous stage's complete date, otherwise it should use the start date.


text:
An idea: Copy to clipboard buttons on tons of the form fields

A lot of our users will need to transfer information from our fields to their own databases. It might add a lot of convenience for them if they could simply click a button to copy the value of the field into their clipboard for pasting into their own database system.
example:

Requires Flash :(

Interesting new development: http://output.jsbin.com/nivuho/quiet

Nice!

Looks like MDN is writing about this as well - might be worth implementing the non-flash version to see what it's like.
https://developer.mozilla.org/en-US/docs/Web/API/ClipboardEvent

authors: bengolder mapsam svmatthews

repo: codeforamerica/rva-screening


text:
Provide online code editor option

If this education platform is targeting each and every learner in India then this feature is a must.
Whenever a user is viewing a course provide the user with the capabilities to open an online code editor in the website itself.
We have an approved online interview feature that will require an online editor so why not use the same component for this task as well.

@Abhishek-kumar09 is this approved, if yes is anyone working on this? I would love to work on this!

repo: codeforcauseorg/edu-client


text:
[WIP] DON'T MERGE - Adds gems for google map integration:

Getting error message ActionController::RoutingError (No route matches [GET] /assets/bootstrap.min.css.map) when rendering home page. We think that it's maybe to do with the order of scripts in the application layout... any ideas?

Got a visible map.  Looks good.

authors: ScorchConway chompasina

repo: codefordenver/Circular

license: isc


text:
Review wireframes

I've created wireframes for how the site would work on a mobile device and on a tablet or computer: http://lpmo40.axshare.com/#p=iphone_frame_for_desktop_view
I created three graphs in the wireframes using some of the existing data, but a lot of the data sources do not seem to be accurate or are not well-documented.

Data integrity and freshness has been a challenge, for sure.
Super excited about having wireframes!
Are you looking for any specific feedback on these, Janet?

Probably the best feedback right now would be if the layouts make sense based on our existing content. When we hear back from enough people, I can revise these wireframes or move into visual design.
Feedback on the individual graphs would be helpful too, but not crucial to moving forward with the site as a whole. I think it would be good practice to work out a rough wireframe of each graph moving forward so we can see if our data makes sense.

How do you think this will this be when we have a larger number of graphs?  Do we limit the number of graphs to keep it usable?  Do we need to have some navigation?  Maybe some accordion functionality?  Even with accordion functionality, it could be less usable on a smaller screen.  Maybe we limit based on the device you are using.  Maybe I'm just worrying about a non-problem.
Do you have ideas on how maps will fit into the equation?
I do think we want to make this product in a way that we could update content and use it for another data hub project.  It seems reasonable based on what I see here, but want to make sure we state that as an objective.
The legend for "Percentage of Household..." is overlaying the graph.  I wonder if we can find a way to put it above the graph like in the "Household Income...".  I think it would be easier to code up if we did.

I've updated the wireframes based on this feedback at the same link above ( http://lpmo40.axshare.com/#p=iphone_frame_for_desktop_view ) with a sample map in one of the panels. I also added a filtering system for when we have more content to keep users from scrolling forever.
It makes sense to use this structure as a template for other datahub projects but it could get confusing to have too many data topics in this one site.
I'd love to get more feedback before moving to styling these wireframes!

Thanks - Janet - this is great! I think topic/tagged visualizations is a really useful, simple and flexible scheme for exploring different collections of data vizualizations. One suggestion to consider might be (primarily for website version as discussed) to add a "Key Metric" for each chart that we could include in the metadata that would display to the right of the "Title" bar. For example, see how these Metrics are displayed here: http://www.civicdashboards.com/city/durham-nc-16000US3719000/. So for the " Number of Housing Units per Resident" we'd have "2.3 (2014)" next to it

authors: adamajm danforthdesign ronstebelton

repo: codefordurham/affordablehousing


text:
Twitter、Facebook関連の多数変更

📝 関連issue

close #69
close #68

⛏ 変更内容

OGPにTwitterとFacebook用の記述を追加
新型コロナウィルス対策サイトになっていた部分をまとめサイトに変更
SideBarのTwitterリンク、FacebookリンクをJust 道 ITのものに変更

📸 スクリーンショット

Twitterアイコンも丸くしてくださったんですね、芸が細かい❤

LGTM！