text:
[2.4.3] ide-helper:generate overwrites vendor file

$ ./artisan ide-helper:generate
A new helper file was written to _ide_helper.php
Unexpected no document on Illuminate\Database\Eloquent\Model
Wrote expected docblock to /vagrant/…/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php

$ PAGER= git diff vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php`:
diff --git a/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php b/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php
index cbb3ee648..1eeb017da 100644
--- a/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php
+++ b/vendor/laravel/framework/src/Illuminate/Database/Eloquent/Model.php
@@ -15,6 +15,13 @@ use Illuminate\Database\Eloquent\Relations\Pivot;
 use Illuminate\Database\Query\Builder as QueryBuilder;
 use Illuminate\Database\ConnectionResolverInterface as Resolver;

+/**
+ *
+ *
+ * @mixin \Eloquent
+ * @mixin \Illuminate\Database\Eloquent\Builder
+ * @mixin \Illuminate\Database\Query\Builder
+ */
 abstract class Model implements ArrayAccess, Arrayable, Jsonable, JsonSerializable, QueueableEntity, UrlRoutable
 {
     use Concerns\HasAttributes,

I believe this is due to https://github.com/barryvdh/laravel-ide-helper/pull/624
vendor files should never be written to, nor overwritten, in any circumstance; especially not from different packages.

https://github.com/barryvdh/laravel-ide-helper/pull/626

I don't understand why it was okay to add @mixin \Eloquent for ages, but now it's so horrible to rewrite the DocBlock for this package to work?

It's okay to write it to the idehelper or the user models, not vendor code.

authors: barryvdh iPaat mfn

repo: barryvdh/laravel-ide-helper


text:
Save load

Now, when you load a project, the blocks are actually shown on screen instead of just added in the background

I placed one small comment, other then that it looks fine :)

source: gharchive/pull-request

license_type: permissive

license_source: bigquery


text:
calculate % changed

[ ] How many of the metrics have changed? (in %)
[ ] How much % has each of the metrics changed?

diff src/index.js test/index.js | diffstat
 unknown |  180 ++++++++++++++++++++++++++++++++++++++++++++++++++++------------
 1 file changed, 148 insertions(+), 32 deletions(-)

fixed in a77082d1460a07ae6d07c5ddddedeceef739ea9e

source: gharchive/issue

repo: bartveneman/css-analysis-diffstat

license: MIT

license_source: github-api


text:
Can't connect to server

Server show's offline. Logs from server
FIG FILES CREATED. WAIT FOR ANOTHER 40 SECONDS TO MAKE SURE ALL CHANGES WERE APPLIED...
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED rename GameplayTags.ini
CONFIG FILE DIR CHANGED change GameplayTags.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change AstroServerSettings.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
CONFIG FILE DIR CHANGED change GameUserSettings.ini
ON ERROR: 0024:fixme:advapi:DeregisterEventSource (00000000CAFE4242) stub
child process exited with code 0
DONE
CONFIG FILES WERE CREATED. SHUT DOWN THE SERVER, UPDATE CONFIG AND THEN RESTART
--------------SERVER STOP--------------
GOING TO STOP THE SERVER...
HEALTH CHECK STOPPED!
BACKUP STOPPED!
--------------SERVER STOP DONE--------------
child process close all stdio with code 0
GOING TO UPDATE THE SERVER CONFIGURATION BASED ON CURRENT ENV VARIABLES...
PUBLIC IP IS:  ****
INIT BACKUP...
LOADING CURRENT BACKUPS FROM /backup AND /backup/daily
BACKUP IS NOW RUNNING
HEALTH CHECK IS NOW RUNNING
--------------SERVER INIT DONE--------------
--------------START THE SERVER--------------
ON ERROR: _XSERVTransmkdir: Owner of /tmp/.X11-unix should be set to root
ON ERROR: 0084:fixme:hid:handle_IRP_MN_QUERY_ID Unhandled type 00000005
ON ERROR: 0084:fixme:hid:handle_IRP_MN_QUERY_ID Unhandled type 00000005
ON ERROR: 0084:fixme:hid:handle_IRP_MN_QUERY_ID Unhandled type 00000005
ON ERROR: 0084:fixme:hid:handle_IRP_MN_QUERY_ID Unhandled type 00000005
ON ERROR: 0024:fixme:ntdll:NtQuerySystemInformation info_class SYSTEM_PERFORMANCE_INFORMATION
ON ERROR: 0024:fixme:advapi:RegisterEventSourceW ((null),L"Astro-PID32"): stub
ON ERROR: 0024:fixme:gameux:GameExplorerImpl_VerifyAccess (0000000000672560, L"Z:\astroneer\Astro\Binaries\Win64\AstroServer-Win64-Shipping.exe", 00000000004EDC98)
ON ERROR: ALSA lib confmisc.c:767:(parse_card)
ON ERROR: cannot find card '0'
ON ERROR:
ALSA lib conf.c:4745:(_snd_config_evaluate)
ON ERROR: function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4745:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1246:(snd_func_refer) error evaluating name
ALSA lib conf.c:4745:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5233:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2660:(snd_pcm_open_noupdate) Unknown PCM default
ON ERROR: ALSA lib confmisc.c:767:(parse_card) cannot find card '0'
ALSA lib conf.c:4745:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4745:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1246:(snd_func_refer) error evaluating name
ALSA lib conf.c:4745:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5233:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2660:(snd_pcm_open_noupdate) Unknown PCM default
ON ERROR: 0024:fixme:bcrypt:BCryptOpenAlgorithmProvider algorithm L"DH" not supported
ON ERROR: 0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
ON ERROR: 0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
ON ERROR: 0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
0024:fixme:msvcp:_Locinfo__Locinfo_ctor_cat_cstr (00000000004EEB70 1 C) semi-stub
ON ERROR: 0024:fixme:advapi:DeregisterEventSource (00000000CAFE4242) stub
child process exited with code 0
2024-10-06T16:11:57-07:00 UNABLE TO INIT HEALTH CHECK AS THERE IS NO SAVE GAME FILE!
2024-10-06T16:12:17-07:00 UNABLE TO INIT HEALTH CHECK AS THERE IS NO SAVE GAME FILE!
2024-10-06T16:12:37-07:00 UNABLE TO INIT HEALTH CHECK AS THERE IS NO SAVE GAME FILE!

I noticed the same after a server update a while ago.
In most cases restarting the container did solve the problem.
However.. I just published a new version of the Image (2.x) that uses proton instead of wine which seems to work but i did not test it over a longer period of time...
Be aware that the current dedicated server version does not support the new DLC (Glitchwalker): https://blog.astroneer.space/p/astroneer-glitchwalkers/
Hope System Era will add support for the DLC but this may take a while...

I tested the latest image, unfortunately, the game still says it's offline. IDK if the dedicated server prints any log.

This seems like the PublicIP field in AstroServerSettings.ini is set to the wrong value. Make sure it is set to the same public IP you entered into the server checker.

This seems like the PublicIP field in AstroServerSettings.ini is set to the wrong value. Make sure it is set to the same public IP you entered into the server checker.

It is the same value. For further details, I am hosting the server on my Linux PC, port forwarding configured on my router (the router gets the public up). This setup worked for other games I have played, but somehow failed to work for Astroneer.

This seems like the PublicIP field in AstroServerSettings.ini is set to the wrong value. Make sure it is set to the same public IP you entered into the server checker.

It is the same value. For further details, I am hosting the server on my Linux PC, port forwarding configured on my router (the router gets the public IP). This setup worked for other games I have played, but somehow failed to work for Astroneer.

Ok, if the IP matches, does rhe port in the config also match the one you're putting into the server checker. Public and Private port also have to match.
Also check that the Heartbeat Interval is not 0.

Also check that the Heartbeat Interval is not 0.

Where can I find this setting?

Thanks @JoeJoeTV for your help, appreciate.
@KrisCris Did you set the IP Address via ENV variable or did you let the server determine your current ip address?

Thanks @JoeJoeTV for your help, appreciate.
@KrisCris Did you set the IP Address via ENV variable or did you let the server determine your current ip address?

I am using the env, can verify that the ip is indeed written into the file.

Thanks @JoeJoeTV for your help, appreciate.
@KrisCris Did you set the IP Address via ENV variable or did you let the server determine your current ip address?

I am using the env, can verify that the ip is indeed written into the file.

Are you using the provided docker-compose file and if yes, did you change anything?

Are you using the provided docker-compose file and if yes, did you change anything?

Thanks for the help! I think I have solved the issue.
The main issue causing the Server is experiencing issue on that checker page is the docker port mapping - the game has to run on the port you exposed to the public, mapping it to a different port will cause issue.
Then, you can only join the game with the IP configured on the server, no local IP or things like that.
Finally, the NAT Loopback was somehow broken with my current network configuration. Idk why my network switch caused the issue, but as soon as I plugged the ethernet cable directly onto the router, everything worked out.
Hopefully this can also be helpful to ppl facing similar issues.

@KrisCris Yes the server can only be joined via pulic ip / port as there is no dns resolution implemented (and i don't think that they are going to implement that in future).
Not sure if i understood you right with the port mapping but there was an issue with the docker-compose file that always exposed port 8777. I Already fixed this in the latest develop. It should now expose the port configured in .env if one is defined.

Not sure if i understood you right with the port mapping

So for example if the server is using 8777, then you do 12345:8777, which doesn’t work. I am not sure why would this happen, but you have to match the internal port and the one exposed: set the port env to 12345, then 12345:12345

I am not sure why would this happen, but you have to match the internal port and the one exposed: set the port env to 12345, then 12345:12345

the server being unable to connect via a private ip address, like 192.168.x.x, kinda sucks.

Just to explain a bit, why this happens:
The cause is just how the dedicated server system for Astroneer is build. It's more complicated in comparison to e.g. a Minecraft dedicated server, where you just have an application listening on a port which the client connects to.
For Astroneer there is 3 components: The game client, the dedicated server and the 3rd party Playfab service.
When the dedicated server starts, it will start listening on the game port (e.g. 7777) on the UDP protocol for any interface AND register itself as a running server with the Playfab service, passing along it's "URL", which is the IPv4 address in the PublicIP field and the port separated by a colon.
Additionally, the server won't start when given a local range IPv4 address.
It will then regularly send heartbeat messages to Playfab, telling it that it's still online and its status (player counter, etc.).
When a game client now wants to connect to the server, it first asks Playfab about the entered "URL" (again IP:Port) and the server's details. If nothing is there, the server will show as offline and if it gets something , it will display the server as online and show the player count from Playfab.
If the server is online, the player can click to join and only then will the game try to connect to the dedicated server itself via the URL given by Playfab (so the public IP and game port).
Because of this, the IP has to be the public one and the local and public port must match.
NOTE: This is how I understood the system from asking other people, trying out and writing AstroTuxLauncher, since there is no official documentation on any of this currently, so some things may be not fully accurate.

https://github.com/barumel/docker-astroneer-server/issues/6#issuecomment-2496511185
Thanks for the explanation!

authors: JoeJoeTV KrisCris barumel hexonMD

repo: barumel/docker-astroneer-server


text:
security

https://github.com/moajs/moa-api/issues/15

https://github.com/krakenjs/lusca

https://github.com/koajs/koa-lusca

license: mit


text:
feat: custom button text on external drop cards

Description

Deploy Notes
Notes regarding deployment of the contained body of work. These should note any
db migrations, nginx routes, infrastructure changes, and anything that must be done before deployment.

[ ] Need to add environment variables

ENV_VAR=

Screenshots (if appropriate)

Review Error for lauchness @ 2023-08-14 14:39:12 UTC
User failed mfa authentication, public email is not set on your github profile. see go/mfa-help

Review Error for ximxim @ 2023-08-14 14:41:19 UTC
User failed mfa authentication, see go/mfa-help

authors: cb-heimdall wilsoncusack


text:
Deploy stopped working since v1.7: docker stderr: context "<name>" does not exist

Hi, thanks for this great package!
Today i tried to use the latest Kamal image and i got the error below. Looks like it's not able to inspect / create the docker context.
Logs from kamal deploy -d production --verbose using ghcr.io/basecamp/kamal:v1.7.0 but it happens with both v1.7.0 and v1.7.1.
Status: Downloaded newer image for ghcr.io/basecamp/kamal:v1.7.0
Log into image registry...

... removed for brevity ...

 DEBUG [f5a53d64] 	Login Succeeded
  INFO [f5a53d64] Finished in 1.720 seconds with exit status 0 (successful).
Build and push app image...
  INFO [dbc88fd7] Running docker --version && docker buildx version on localhost
 DEBUG [dbc88fd7] Command: docker --version && docker buildx version
 DEBUG [dbc88fd7] 	Docker version 20.10.24, build 297e1284d3bd092e9bc96076c3ddc4bb33f8c7ab
 DEBUG [dbc88fd7] 	github.com/docker/buildx v0.15.0 d3a53189f7e9c917eeff851c895b9aad5a66b108
  INFO [dbc88fd7] Finished in 0.078 seconds with exit status 0 (successful).
  INFO Cloning repo into build directory `/tmp/kamal-clones/my-app-2f65914456263/workdir/`...
  INFO [08f28ec4] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263 clone /workdir on localhost
 DEBUG [08f28ec4] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263 clone /workdir
 DEBUG [08f28ec4] 	Cloning into 'workdir'...
 DEBUG [08f28ec4] 	done.
  INFO [08f28ec4] Finished in 0.200 seconds with exit status 0 (successful).
  INFO [ecc25a58] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ status --porcelain on localhost
 DEBUG [ecc25a58] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ status --porcelain
  INFO [ecc25a58] Finished in 0.011 seconds with exit status 0 (successful).
  INFO [d71a3f71] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ rev-parse HEAD on localhost
 DEBUG [d71a3f71] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ rev-parse HEAD
 DEBUG [d71a3f71] 	eec8108d97d18d6aff73362813289615131c86d7
  INFO [d71a3f71] Finished in 0.002 seconds with exit status 0 (successful).
  INFO [5bb8e984] Running docker context inspect kamal-my-app-native-remote-amd64 --format '{{.Endpoints.docker.Host}}' on localhost
 DEBUG [5bb8e984] Command: docker context inspect kamal-my-app-native-remote-amd64 --format '{{.Endpoints.docker.Host}}'
 DEBUG [5bb8e984] 	context "kamal-my-app-native-remote-amd64" does not exist
 DEBUG [5bb8e984]
  WARN Missing compatible builder, so creating a new one first
  Finished all in 2.8 seconds
  ERROR (SSHKit::Command::Failed): docker exit status: 256
docker stdout: Nothing written
docker stderr: context "kamal-my-app-native-remote-amd64" does not exist

/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/command.rb:97:in `exit_status='
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/local.rb:59:in `block in execute_command'
/usr/local/lib/ruby/3.2.0/open3.rb:228:in `popen_run'
/usr/local/lib/ruby/3.2.0/open3.rb:103:in `popen3'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/local.rb:44:in `execute_command'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/abstract.rb:148:in `block in create_command_and_execute'
<internal:kernel>:90:in `tap'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/abstract.rb:148:in `create_command_and_execute'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/abstract.rb:66:in `capture'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/sshkit_with_ext.rb:9:in `capture_with_info'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/build.rb:38:in `block in push'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/abstract.rb:31:in `instance_exec'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/backends/abstract.rb:31:in `run'
/usr/local/bundle/gems/sshkit-1.22.2/lib/sshkit/dsl.rb:10:in `run_locally'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/build.rb:36:in `push'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/build.rb:8:in `deliver'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/command.rb:28:in `run'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/invocation.rb:127:in `invoke_command'
/usr/local/bundle/gems/thor-1.3.0/lib/thor.rb:527:in `dispatch'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/invocation.rb:116:in `invoke'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/main.rb:35:in `block in deploy'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/base.rb:75:in `print_runtime'
/usr/local/bundle/gems/kamal-1.7.0/lib/kamal/cli/main.rb:24:in `deploy'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/command.rb:28:in `run'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/invocation.rb:127:in `invoke_command'
/usr/local/bundle/gems/thor-1.3.0/lib/thor.rb:527:in `dispatch'
/usr/local/bundle/gems/thor-1.3.0/lib/thor/base.rb:584:in `start'
/usr/local/bundle/gems/kamal-1.7.0/bin/kamal:9:in `<top (required)>'
/usr/local/bundle/bin/kamal:25:in `load'
/usr/local/bundle/bin/kamal:25:in `<main>'

The same command using v1.6.0 works.
Logs from kamal deploy -d production --verbose using ghcr.io/basecamp/kamal:v1.6.0.
Status: Downloaded newer image for ghcr.io/basecamp/kamal:v1.6.0
Log into image registry...

... removed for brevity ...

 DEBUG [f0cb5b8b] 	Login Succeeded
  INFO [f0cb5b8b] Finished in 1.774 seconds with exit status 0 (successful).
Build and push app image...
  INFO [8796fd53] Running docker --version && docker buildx version on localhost
 DEBUG [8796fd53] Command: docker --version && docker buildx version
 DEBUG [8796fd53] 	Docker version 20.10.24, build 297e1284d3bd092e9bc96076c3ddc4bb33f8c7ab
 DEBUG [8796fd53] 	github.com/docker/buildx v0.14.1 59582a88fca7858dbe1886fd1556b2a0d79e43a3
  INFO [8796fd53] Finished in 0.083 seconds with exit status 0 (successful).
  INFO Cloning repo into build directory `/tmp/kamal-clones/my-app-2f65914456263/workdir/`...
  INFO [a6a7a86b] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263 clone /workdir on localhost
 DEBUG [a6a7a86b] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263 clone /workdir
 DEBUG [a6a7a86b] 	Cloning into 'workdir'...
 DEBUG [a6a7a86b] 	done.
  INFO [a6a7a86b] Finished in 0.236 seconds with exit status 0 (successful).
  INFO [c2ff35c9] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ status --porcelain on localhost
 DEBUG [c2ff35c9] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ status --porcelain
  INFO [c2ff35c9] Finished in 0.012 seconds with exit status 0 (successful).
  INFO [f3dbccb0] Running /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ rev-parse HEAD on localhost
 DEBUG [f3dbccb0] Command: /usr/bin/env git -C /tmp/kamal-clones/my-app-2f65914456263/workdir/ rev-parse HEAD
 DEBUG [f3dbccb0] 	eec8108d97d18d6aff73362813289615131c86d7
  INFO [f3dbccb0] Finished in 0.002 seconds with exit status 0 (successful).
  INFO [16895a4f] Running docker buildx build --push --platform linux/amd64 --builder kamal-my-app-native-remote -t ghcr.io/edolix/my-app:eec8108d97d18d6aff73362813289615131c86d7 -t ghcr.io/edolix/my-app:latest-production --label service="my-app" --file Dockerfile . on localhost
 DEBUG [16895a4f] Command: docker buildx build --push --platform linux/amd64 --builder kamal-my-app-native-remote -t ghcr.io/edolix/my-app:eec8108d97d18d6aff73362813289615131c86d7 -t ghcr.io/edolix/my-app:latest-production --label service="my-app" --file Dockerfile .
 DEBUG [16895a4f] 	ERROR: no builder "kamal-my-app-native-remote" found
  WARN Missing compatible builder, so creating a new one first
 DEBUG Using builder: native/remote
  INFO [77f58e4a] Running docker context create kamal-my-app-native-remote-amd64 --description 'kamal-my-app-native-remote amd64 native host' --docker 'host=' ; docker buildx create --name kamal-my-app-native-remote kamal-my-app-native-remote-amd64 --platform linux/amd64 on localhost
 DEBUG [77f58e4a] Command: docker context create kamal-my-app-native-remote-amd64 --description 'kamal-my-app-native-remote amd64 native host' --docker 'host=' ; docker buildx create --name kamal-my-app-native-remote kamal-my-app-native-remote-amd64 --platform linux/amd64
 DEBUG [77f58e4a] 	kamal-my-app-native-remote-amd64
 DEBUG [77f58e4a] 	Successfully created context "kamal-my-app-native-remote-amd64"
 DEBUG [77f58e4a] 	kamal-my-app-native-remote
  INFO [77f58e4a] Finished in 0.066 seconds with exit status 0 (successful).
  INFO [4e267505] Running docker buildx build --push .....

... logs keep going till deploy succeeds

Context
I'm using the workaround described in https://github.com/basecamp/kamal/issues/809 so there's a dummy config/deploy.yml and a real config/deploy.production.yml with these settings:

deploy.production.yml
service: my-app

image: edolix/my-app

servers:
  web:
    hosts:
      - my-app.egallo.dev
    labels:
      traefik.http.services.my-app-web-production.loadbalancer.server.port: "8000"
      traefik.docker.network: private
      traefik.http.routers.smart_track.rule: Host(`my-app.egallo.dev`)
      traefik.http.routers.smart_track.entrypoints: websecure
      traefik.http.routers.smart_track.tls.certresolver: letsencrypt
      traefik.http.routers.smart_track_secure.entrypoints: websecure
      traefik.http.routers.smart_track_secure.rule: Host(`my-app.egallo.dev`)
      traefik.http.routers.smart_track_secure.tls: true
      traefik.http.routers.smart_track_secure.tls.certresolver: letsencrypt
    options:
      "add-host": host.docker.internal:host-gateway
      network: "private"

registry:
  server: ghcr.io
  username:
    - KAMAL_REGISTRY_USERNAME
  password:
    - KAMAL_REGISTRY_PASSWORD

# Inject ENV variables into containers (secrets come from .env).
# Remember to run `kamal env push` after making changes!
env:
  clear:
    HOSTNAME: my-app.egallo.dev
  secret:
    - removed_for_brevity

# Use a different ssh user than root
ssh:
  user: ubuntu

builder:
  remote:
    arch: amd64

healthcheck:
  path: /up
  port: 8000

accessories:
  db:
    image: postgres:16.0
    roles:
      - web
    env:
      secret:
        - POSTGRES_PASSWORD
    directories:
      - data:/var/lib/postgresql/data
    options:
      network: "private"

traefik:
  options:
    publish:
      - "443:443"
    volume:
      - "/letsencrypt/acme.json:/letsencrypt/acme.json"
    network: "private"
  args:
    accesslog: true
    accesslog.format: json
    log: true
    log.level: DEBUG
    entryPoints.web.address: ":80"
    entryPoints.websecure.address: ":443"
    entryPoints.web.http.redirections.entryPoint.to: websecure
    entryPoints.web.http.redirections.entryPoint.scheme: https
    entryPoints.web.http.redirections.entrypoint.permanent: true
    entrypoints.websecure.http.tls: true
    entrypoints.websecure.http.tls.domains[0].main: "my-app.egallo.dev"
    certificatesResolvers.letsencrypt.acme.email: "edo91.gallo@gmail.com"
    certificatesResolvers.letsencrypt.acme.storage: "/letsencrypt/acme.json"
    certificatesResolvers.letsencrypt.acme.httpchallenge: true
    certificatesResolvers.letsencrypt.acme.httpchallenge.entrypoint: web

Docker version
Client:
 Cloud integration: v1.0.35+desktop.13
 Version:           26.0.0
 API version:       1.45
 Go version:        go1.21.8
 Git commit:        2ae903e
 Built:             Wed Mar 20 15:14:46 2024
 OS/Arch:           darwin/arm64
 Context:           desktop-linux

Server: Docker Desktop 4.29.0 (145265)
 Engine:
  Version:          26.0.0
  API version:      1.45 (minimum version 1.24)
  Go version:       go1.21.8
  Git commit:       8b79278
  Built:            Wed Mar 20 15:18:02 2024
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.6.28
  GitCommit:        ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Still digging through trying to understand where could be the issue but the ticket might be helpful for others.
Thanks again!

Could it be around these lines:
https://github.com/basecamp/kamal/blob/4697f894411af5f6e245c15c84b5073bc48edd04/lib/kamal/cli/build.rb#L45-L47
the error message from v1.7 is context "kamal-my-app-native-remote-amd64" does not exist while in v1.6.0 was ERROR: no builder "kamal-smart-track-native-remote" found.

Hmm interesting, when I run docker context inspect kamal-my-app-native-remote-amd64 --format '{{.Endpoints.docker.Host}}' which doesn't exist, I get this error message:
context "kamal-my-app-native-remote-amd64": context not found: open <snip>/.docker/contexts/meta/ad3cdf99c2f765ec10c20f6e8d60aac5f39e063f514574d5863c922f20ec6216/meta.json: no such file or directory

So I'd be interested to know why you are getting a different error message. In any case let's update the matcher to include does not exist.

Looks like the does not exist error message is coming from the  cli.remove call.
It will run docker context rm kamal-app-native-remote-amd64; docker buildx rm kamal-app-native-remote where docker context rm returns exactly context "kamal-app-native-remote-amd64" does not exist.
I don't understand why this WARN line before cli.remove didn't show up in the logs tho. Is the output overridden by the docker error message?

@edolix - the stacktrace is from line 38 of build.rb, so it looks like it is from the docker inspect command. I've released v1.7.2 with a fix for this - could you confirm if that's worked?

I had the same issue, but didn't investigate further. I thought it might have to do something with the multiarch build (as this made it work again) and my newly setup server with Ubuntu 22.04 instead of doing builds on my M2.

authors: djmb edolix plattenschieber

repo: basecamp/kamal


text:
Create LICENSE

Resolves #2

An already mentioned
https://github.com/bashnick/transformer/blob/d953b08dd6be5e5a5fe19a83b03eb61bb97e4c45/README.md?plain=1#L33

@bashnick Friendly ping 🏓

repo: bashnick/transformer


text:
Merge upstream commits

Avoid Basho fork drifting too far from upstream project.

:+1: 	00bfcb6

authors: javajolt kesslerm

repo: basho/bear


text:
Please add a License

Would you please be so kind as to add a license to this repository, so it is clear how it is licensed out?
I am assuming you are intending Apache V2, since that seems to be what you use, and also what is written in the header of lager_syslog_backend.erl, but if you could explicitly add a license, it would help greatly!
Thank you!

Added in 62f3a41. Should be merged pretty soon.

That's fantastic. Thank you very much!


text:
Improve SSL warning [JIRA: CLIENTS-835]

When you use a Python and an "old" version of OpenSSL this code will emit a warning:

https://github.com/basho/riak-python-client/blob/master/riak/security.py#L41-L45
https://github.com/basho/riak-python-client/blob/master/riak/security.py#L60-L64

Since Python 2.6 isn't supported anymore, this could be simplified. It would also be nice to not emit this warning unless a TLS/SSL connection is attempted.

@dannylauca voila :smile:

repo: basho/riak-python-client


text:
riak_kv_gcounter dialyzer errors

riak_kv_gcounter.erl:64: Invalid type specification for function riak_kv_gcounter:new/2. The success typing is (_,pos_integer()) -> {'ok',riak_kv_gcounter:gcounter()}
riak_kv_gcounter.erl:75: Invalid type specification for function riak_kv_gcounter:update/3. The success typing is ('increment' | {'increment',pos_integer()},_,riak_kv_gcounter:gcounter()) -> {'ok',riak_kv_gcounter:gcounter()}
riak_kv_gcounter.erl:85: Function merge/2 has no local return
riak_kv_gcounter.erl:86: The call riak_kv_gcounter:merge(GCnt1::any(),GCnt2::any(),[]) does not have an opaque term of type riak_kv_gcounter:gcounter() as 3rd argument
riak_kv_gcounter.erl:99: The call riak_kv_gcounter:merge(Rest::any(),RestOfClock2::[tuple()],[{_,_},...]) does not have opaque terms as 2nd and 3rd arguments
riak_kv_gcounter.erl:101: The call riak_kv_gcounter:merge(Rest::any(),Clock2::[tuple()],[{_,_},...]) does not have opaque terms as 2nd and 3rd arguments

Some of these are pretty domain-specific, so I figured I'd file an issue for now. For example, I'm not sure what types should be integer() vs. pos_integer(), etc.

The #1164 (merged into 2.1 branch) deals with these warnings. Is it sufficient to close this issue?

authors: hmmr reiddraper


text:
WIP: Issue/#83 release annotations

Hello @ceckoslab
Here is latest changes required to achieve dynamic release annotations
Kindly review and let me know
P.S. Also need to update test to reflect latest changes

Hello @ceckoslab
I fixed currently existing tests and prepared to implement dynamic releases tests. I guess we need some tests for that.
Also I think we need to implement releases for other types of diagram, am I right?
So I hope tomorrow we will have tests and releases implemented for all kind of diagrams

Hello @korzol
I think that it looks fine for now. Please do not implement more things for other diagram types because I am planning to do some refactoring around the view logic.
Could you go in to details about what and where you plan to implement more tests?

Hello @ceckoslab
I thought about adding another file into /tests/BasicRum/DiagramBuilder/ directory. Lets say DevicePerformaceTest.php or DevicePerformaceDesktopTest.php which will test diagram building for device performance (desktop) which is time_series and where dynamic releases is applicable

Hello @korzol
Could you write one more when the Data Layer returns empty result set? I remember that we were getting a notice for undefined variable in this case and our tests were failing.

Hello @korzol
Is this PR still a WIP? If not, could you remove the WIP part of the title?

authors: ceckoslab korzol

repo: basicrum/backoffice


text:
alternative solution

Hi
Thank you very much for this project, it helped me a lot when trying to play DayZ with friends.
But over time, I realized that I lacked the server browser, history, favorites and automatic installation of mods. And I tried to implement this in the project https://github.com/WoozyMasta/dayz-ctl
Perhaps it will be useful or interesting, so I decided to share it here

Cool project, thanks for sharing.
You should however post this somewhere else instead of here, as it doesn't belong on this issue tracker.

authors: WoozyMasta bastimeyer

repo: bastimeyer/dayz-linux-cli-launcher


text:
Generate README files

With "next steps" if any
With documentation about how Vike is used

The following is an example of generated README:

This app have been created with Bati using the following flags: --eslint --solid --edgedb
To-Do
EdgeDB
Setup
If EdgeDB CLI is not yet installed, execute the following command:
curl --proto '=https' --tlsv1.2 -sSf https://sh.edgedb.com | sh

Once the CLI is installed, you can initialize a project:
edgedb project init

Then follow instructions at https://www.edgedb.com/docs/intro/quickstart#set-up-your-schema
About this app
This app is ready to start thanks to Vike and SolidJS.
In order to get familiar with Vike, here are some of the features that are already in place
/pages/+config.h.ts
This is the interface between Vike and your code. It imports/uses:

A Layout component that wraps your Pages
A customizable Head component
A default title

Routing
By default, Vike does Filesystem Routing: the URL of a page is determined based on where its +Page.tsx (or +config.h.ts) file is located on the filesystem.
If you want to deep dive into routing, Vike lets you choose between:

Server Routing and Client Routing
Filesystem Routing, Route Strings and Route Functions

/pages/_error/+Page.tsx
An error page which is rendered when errors occurs.
/pages/+onPageTransitionStart.ts and /pages/+onPageTransitionEnd.ts
The onPageTransitionStart() hook, together with onPageTransitionEnd(), enables you to implement page transition animations.
ssr by default
You can disable SSR for all your pages, or only for some pages while still using SSR for your other pages.
HTML Streaming support
Can be enabled/disabled for all your pages, or only for some pages while still using it for others.

@AurelienLourot @brillout any wording that you would change/add/remove?

Love it 💯

With "next steps"

Neat, I like that wording. Maybe we can even call it # Next Steps instead of # To-Do.
I made a PR: https://github.com/batijs/bati/pull/183. Feel free to reject all/some of it. (I've no strong opinions here, just slight personal preferences thus feel more then free to reject all/parts of it.)
(FYI I think I found a new improved way to communicate the whole fake imports thing, enabling us to remove the .h. file extension.)

LGTM ✨
(Tiny typo at „app havehas been created“.)

repo: batijs/bati


text:
🛑 SAT - Portal CFDI is down

In 1d44a68, SAT - Portal CFDI (https://portalcfdi.facturaelectronica.sat.gob.mx) was down:

HTTP code: 503
Response time: 196 ms

Resolved: SAT - Portal CFDI is back up in 590dc8f after 10 minutes.

repo: batnieluyo/sat-monitor


text:
Revert "Http server"

msimerson  wants to merge 1 commit into master

Actually, he doesn't.

haha

authors: celesteking msimerson

repo: baudehlo/Haraka


text:
如何实现checkbox的绑定选中？

我想实现编辑的时候，根据已有的数据显示某些行时选中的，有方案吗？

h

有复选框的选中事件么？     想实现的效果：选中某行的复选框，得到当前行的所有数据

可以通过getCheckedData 方法获取已选中的行的数据
或通过getCheckedTr 方法获取已选中的行dom
行的选中不支持通过代码进行操作
单条行显中后没有事件进行接收，但是可以通过getCheckedData进行获取已选中的
或者可以将所遇到的详细场景进行描述，如果确实存在这种需求，会考虑对此进行升级。

获取数据确实没有问题，就是通过行的的主键来绑定已有的值，通常用在编辑的时候。这个现在我还没有找到合适的方法，就去手动遍历了每一行的数据，然后对比主键，将这一行的checbox选中

authors: baukh789 cuitwangshicheng cupPhone


text:
toolchains_llvm@1.0.0

Release: https://github.com/bazel-contrib/toolchains_llvm/releases/tag/1.0.0

@fmeum, not sure how the new presubmit and review process is supposed to work. I can not add reviewers to the PR.

It's in the process of being automated, right now these operations can only be performed by members of a certain GitHub team.

authors: fmeum siddharthab

repo: bazelbuild/bazel-central-registry


text:
Add Python script that generates //:repositories.bzl

Just experimenting.
NOT FOR REVIEW!

Interesting.
I'm not exactly sure where you are going but there are a few things to think about

point to a repo release by git commit or release tag
retrieve the package from the cannonical URL from github based on the tag
update sha
see if the file is also in the mirror, download and verify sha
use urls = [...] if found in mirror

Most repos should depend on other repos by name only.
If they insist on pinning to a specific version of that repo, it must be given another name.
Personally, I don't find building repositories.bzl all that hard. Where I would like to see great improvement is in the UI.  WORKSPACE should look like
http_repository(name='bazel_federatoin', ...)
load('@bazel_federation//:repositories.bzl', 'rules_foo', 'rules_bar', ...)

load('@federation_generated', "federation_load")
federation_load()

Without all the mucking about with the individual setup rules for each repo.  @sergiocampama
started something like that. https://github.com/sergiocampama/pesto  I have been meaning to get around to trying the same for the federation, but have not had the chance.

I was trying to add rules_proto to the federation, but had serious trouble doing so because of a cyclic dependency between rules_proto, rules_cc and protobuf (and rules_java might joint that circle soon-ish).
Realistically, I saw two options on how to resolve this:

Create a single function that loads rules_cc, rules_proto and protobuf and make the current function an alias of it. This works fine as long as we have this limited set of rules, but doesn't solve the general case of cyclic deps.
Create a way of letting rules define their dependencies and compute the transitive closure of all dependencies from that. This could be done in Starlark (more or less just rename dependencies.py to deps.bzl), or have a script that reads the dependency and emits repositories.bzl. Computing the transitive closure of deps is a fixpoint iteration on the dependency declarations, so it's O( |dependency_dict|^2 ), hence maybe a bit slow to do it all the time a load function is called.

Ideally, these dependency definitions should live in the rules repo itself rather than the federation. It's easier to start by putting it in the federation, though.
I think all your points could be added to the script eventually.
I also have an idea of how to improve the setup, but that needs a little more time.
(kinda like npm repos have a package.json, Bazel could have a bpm.star to declare dependencies. Users would then declare their direct dependencies in bpm.star, run bpm write-workspace [or teach Bazel itself how to do it] and get a WORKSPACE file that has all loads and setups in it. I wasn't aware of @sergiocampama's repo, but I feel like it's very similar).

authors: Yannic aiuto

repo: bazelbuild/bazel-federation


text:
Add bazel RC support

Current implementation uses --bazelrc=/dev/null which means that bazel will ignore .bazelrc. There are cases where this may block some use cases
CC: @natansil @ittaiz

Btw,
This is indeed one of the improvements this library needs. Ease hermetic
dependency on external repositories.
I think there’s a bit of an easier way then what you did. I’ll try to play
around with it tomorrow.
On Sun, 8 Apr 2018 at 12:21 Shachar Anchelovich notifications@github.com
wrote:

@anchlovi commented on this pull request.
In javatests/build/bazel/tests/integration/BazelBaseTestCaseTest.java
https://github.com/bazelbuild/bazel-integration-testing/pull/58#discussion_r179941400
:

 Command cmd = driver.bazel("test", "//:IntegrationTestSuiteTest");
 final int exitCode = cmd.run();

 org.hamcrest.MatcherAssert.

assertThat(exitCode, is(successfulExitCode(cmd)));
}

@Test
public void testUseBazelRcFile() throws Exception {
setUpTestSuit("IntegrationTestSuiteTest");

To do so I'll need to setup many things manually so features like copy run
files will work
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bazelbuild/bazel-integration-testing/pull/58#discussion_r179941400,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABUIFyUVpe7xJ_9jWrSzvCCFLtBjrykYks5tmdahgaJpZM4TGlFS
.

authors: anchlovi ittaiz

repo: bazelbuild/bazel-integration-testing


text:
Update jazzer

This brings improved macOS support as well as a configurable deps for java_fuzz_test.

I updated Jazzer to a version with native support for M1 Macs. I don't know whether Honggfuzz supports it, but everything else in rules_fuzzing should.


text:
Improve validation of extension attribute to pkg_tar

If the pkg_tar rule is called without specifying compressor, then extension should only be allowed to take one of these values exactly (with or without the leading dot) [^1] [^2]:
https://github.com/bazelbuild/rules_pkg/blob/60dbd92d1ce3338cbb8adcb8ae8800ea3421d7b8/pkg/private/tar/tar.bzl#L35-L38
The current implementation will accept a value such as tar.gz.bz2.xz which implies the file has three layers of compression. It will also accept a value such as txt.gz which implies that it is a compressed plain text file, i.e. readable directly by zcat, zless, or similar. These should cause a failure.
[^1]: A leading dot is silently removed in the attribute's value.
[^2]: In this list, the leading dot before tar.xz is missing and should be restored.

Should be done alongside #60

authors: aiuto dpward


text:
Devices do not support tenant association

Currently there does not appear to be any way to associated imported devices with a tenant, so they are left hanging.

This literately took 5 minutes to implement. Can you please test the branch "feature/add-vm_tenant_relation"
Thank you.

Works beautifully! Thank you so much!!!!!

authors: andymelichar bb-Ricardo

repo: bb-Ricardo/netbox-sync


text:
Update scalafmt-core to 3.7.1

Updates org.scalameta:scalafmt-core from 3.6.1 to 3.7.1.
GitHub Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scalameta", artifactId = "scalafmt-core" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scalameta", artifactId = "scalafmt-core" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Superseded by #64.

Superseded by #69.

repo: bbarker/diz


text:
Style multiline with + is indented

cop is correcting my code in new line after + is on the end
def method_name
  first_long_line_of_code +
    second_long_line_of_code +
    third_long_line_of_code
end

expected:
def method_name
  first_long_line_of_code +
  second_long_line_of_code +
  third_long_line_of_code
end

is there configuration option for this ?
Log is reporting
: [Corrected] Use 2 (not 0) spaces for indenting an expression spanning multiple lines.

No. The style aligned (which is the default for Style/MultilineOperationIndentation) only enforces aligned operands when the first operand is preceded by something (a keyword such as if or an assignment to a variable). The reason why we want to indent the continuation of an operation like the one in your example is that we want to make clear that it's not the start of a a new expression. I find your preferred style a bit strange, almost misleading.

ok I never looked at it this way. thank you for explanation.
exmaple above is not the best one.
Consider such situation:
def method_name
  calculate_result_for( 1,      2,   34, 5, 6) +
  calculate_result_for(23, 234, 546, 4, 5) +
  calculate_result_for( 3,      4, 111, 1, 9)
end

Is there any posiibility turn it off for a single method ?

Absolutely! Just disable the cop locally.
# rubocop:disable Style/MultilineOperationIndentation

def method_name
  calculate_result_for( 1,   2,  34, 5, 6) +
  calculate_result_for(23, 234, 546, 4, 5) +
  calculate_result_for( 3,   4, 111, 1, 9)
end

# rubocop:enable Style/MultilineOperationIndentation

Another idea for how to get out of the problem is this:
def method_name
  result = calculate_result_for( 1,   2,  34, 5, 6) +
           calculate_result_for(23, 234, 546, 4, 5) +
           calculate_result_for( 3,   4, 111, 1, 9)
  result
end

thank you very much.

repo: bbatsov/rubocop


text:
Regex + RichText translation

Hello! I have a string in a game that I want to create a regex for, that looks like
<color\=white>総ユニット数:18/30</color> (<color\=#80ffffff>未配置:1</color>  <color\=#80ff80ff>配置済:9</color>  <color\=#ffaa80ff>略奪:8</color>  <color\=#ff4040ff>負傷:0</color> )
I try to create a regex for it like this:
r:"^<color\\=(#?\w+)>総ユニット数:(\d+)\/(\d+)<\/color> \(<color\\=#80ffffff>未配置:(\d+)<\/color>  <color\\=#80ff80ff>配置済:(\d+)<\/color>  <color\\=#ffaa80ff>略奪:(\d+)<\/color>  <color\\=#ff4040ff>負傷:(\d+)<\/color> \)$"=<color\=$1>Total number of units:$2/$3</color> (<color\=#80ffffff>Unassigned:$4</color>  <color\=#80ff80ff>Deployed: $5</color>  <color\=#ffaa80ff>Looting:$6</color>  <color\=#ff4040ff>Injured: $7</color> )
But it does not work. I have checked, the whole string matches the regex. I have also tried setting MaxTextParserRecursion=2 and using separate regexes for rich text parts, like this:
r:"未配置:(\d+)"=Unassigned:$1
r:"配置済:(\d+)"=Deployed:$1
r:"略奪:(\d+)"=Looting:$1
r:"負傷:(\d+)"=Injured:$1```

It also didn't work.
Can anybody help me with it?

Okay, turns out that TemplateAllNumberAway=True messes up matching, and the string that Translator tries to match to regex looks like this:
<color=white>総ユニット数:{{A}}</color> (<color=#{{B}}ffffff>未配置:{{C}}</color>  <color=#{{D}}ff{{E}}ff>配置済:{{F}}</color>  <color=#ffaa{{G}}ff>略奪:{{H}}</color>  <color=#ff{{I}}ff>負傷:{{J}}</color> )

So what worked for me was to add several substituted strings that correspond to RichText parts:
未配置:{{A}}=Unassigned:{{A}}
配置済:{{A}}=Deployed:{{A}}
略奪:{{A}}=Looting:{{A}}
負傷:{{A}}=Injured:{{A}}```

Still, problem of regex matching with `TemplateAllNumberAway=True` probably needs some work.

I have a similar problem with regex matching:
XUnity output this translation line:
每一点根骨提供基础法术强度+4%，速度+0.1\n\n当前：基础法术强度 14.0=Each point of root bone provides +4% base spell strength and +0.1 speed\n\nCurrent: Base Spell Strength 14.0
When I tried to replace it with this regex it fails to match:
sr:"每一点根骨提供基础法术强度+4%，速度+0.1\n\n当前：基础法术强度 ([\d\.]+)"=Each point of root bone provides +4% base spell strength and +0.1 speed\n\nCurrent: Base Spell Strength $1
The text should be identical in both cases, and I have TemplateAllNumberAway=False in the config but it seems like that does no effect.

authors: pipja zclimber


text:
Crystal 0.23.1

Hi!
I've tried this shard with the latest Crystal release, and it doesn't work.
Do you have any plans to maintain this library?

https://github.com/bbtfr/proxy.cr/pull/2

Sorry for the delay, I have been busy lately.
I saw your PR, would you like to re-open it?

Hi.
I've made a lot of changes includes change file structure and rename the project to http_proxy_server. You check it here https://github.com/mamantoha/http_proxy_server.
I can create new PR, but it will be incompatible with your repository.
What do you think? Should we merge our repositories?

ok, I think a new repo would be fine, since I don't have much time to maintain this project.

authors: bbtfr mamantoha


text:
🐛 [BUG]: Updating edge jumps to top handle

Is there an existing issue for this?

[X] I have searched the existing issues and this is a new bug.

Current Behavior
I have custom node with 4 source handles all around.
<Handle id="source-left" type="source" :position="Position.Left" />
<Handle id="source-top" type="source" :position="Position.Top" />
<Handle id="source-right" type="source" :position="Position.Right" />
<Handle id="source-bottom" type="source" :position="Position.Bottom" />

Add 2 custom nodes in flow called A and B
Connect an edge between (source) B-left and (target) A-left
Try updating the edge target from B-left to B-bottom.
As soon as you move the handle, the edge source jumps from A-left to A-top
So, when updating the target to another handle, the source handle always jumps to top (temporarily).
Expected Behavior
Source handle should stay commected
Steps To Reproduce
No response
Relevant log output
No response
Anything else?
No response

Please provide a proper reproduction of the issue.
You can find a sandbox template here: https://codesandbox.io/p/devbox/vue-flow-basic-gfgro4
I’ll gladly check what’s wrong once I’m back from my vacation once you’ve provided a repro ^^

Ok, thanks, I'll provide a reproduction today

Here is a link to a reproduction:
https://codesandbox.io/p/devbox/adoring-violet-tzvkh7
Just drag the edge from node B and you'll see side A jumping from left to top.

Will be fixed in the next release

Fixed with 1.41.3

Fixed with 1.41.3

@bcakmakoglu Thank you very much for your efforts; however, I am still encountering an issue. Whenever I call addNodes or directly add new nodes and edges data, all the old node handles move to the top and bottom, which is quite confusing for me. Have you ever come across a similar problem?
https://github.com/user-attachments/assets/e8c3b001-af05-4047-89f4-83a38214c463

A reproduction for that issue would be needed for me to debug it, just a video isn't telling me much about your code and what might be happening.

A reproduction for that issue would be needed for me to debug it, just a video isn't telling me much about your code and what might be happening.

I'm sorry, I just saw this. Here is the reproduction logic I wrote for the issue:
https://stackblitz.com/edit/vitejs-vite-zk61qe?file=src%2FuseLayout.ts

That's a bit too complex for a simple repro tbh, I can't figure out where you do what in that sandbox and it'd take me too much time to sit down and analyse everything in there 😅
Can you strip it down to as little as possible that still re-creates the issue.

authors: Zambiorix bcakmakoglu yiwwhl

repo: bcakmakoglu/vue-flow


text:
ftp connect to ftp.broadinstitute.org failed

I ran into some error while installing genome refernece data:
Running GGD recipe: hg19 hapmap 3.3
--2017-10-21 10:21:02--  ftp://gsapubftp-anonymous:password@ftp.broadinstitute.org/bundle/hg19/hapmap_3.3.hg19.sites.vcf.gz
=> `-'
Resolving ftp.broadinstitute.org... 69.173.80.251
Connecting to ftp.broadinstitute.org|69.173.80.251|:21... connected.
Logging in as gsapubftp-anonymous ...
Login incorrect.

Sorry about the issue, this is typically caused by Broad's servers being busy. We don't have any control over these external resources, but the installer/upgrade process you were running will restart from where it left off if you run with the same command again. Hopefully the server will be happier when retrying and finish cleanly for you. Hope this helps.

Can we re-open this? FTP access is now disabled permanently, as documented here, and Google bucket should be used instead.

authors: chapmanb veggiesaurus weizhu365

repo: bcbio/bcbio-nextgen


text:
sqlalchemy.exc.InterfaceError: (sqlite3.InterfaceError) Error binding parameter 123 - probably unsupported type.

Version info

bcbio version (bcbio_nextgen.py --version):1.2.3
OS name and version: Ubuntu 18.04 bionic

To Reproduce

Exact bcbio command you have used

bcbio_nextgen.py -t local -n 20 ../config/config.yaml

Your sample configuration file

details:
- algorithm:
    aligner: bwa
    mark_duplicates: false
    remove_lcr: true
    tools_on: gemini
    variantcaller:
      somatic: vardict
      germline: freebayes
    svcaller: lumpy
    effects: snpeff
    effects_transcripts: canonical_cancer
    vcfanno: [gemini,somatic]
  analysis: variant2
  description: normal-sample
  files: ../input/PD44692b_N_sorted.bam
  genome_build: hg38
  metadata:
    batch: bcbio
    phenotype: normal
- algorithm:
    aligner: bwa
    mark_duplicates: false
    remove_lcr: true
    tools_on: gemini
    variantcaller:
      somatic: vardict
      germline: freebayes
    svcaller: lumpy
    effects: snpeff
    effects_transcripts: canonical_cancer
    vcfanno: [gemini,somatic]
  analysis: variant2
  description: tumor-sample
  files: ../input/PD44692a_T_sorted.bam
  genome_build: hg38
  metadata:
    batch: bcbio
    phenotype: tumor
fc_date: '2020-04-29'
fc_name: oesophageal
upload:
  dir: ../final
resources:
  default:
    memory: 4G
    cores: 8
    jvm_opts: ["-Xms2000m", "-Xmx4000m"]

Observed behavior
Error message or bcbio output.
Expected behavior
Traceback (most recent call last):
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 924, in <module>
    impacts_extras=a.impacts_field, aok=a.a_ok)
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 234, in __init__
    self.load()
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 322, in load
    self._load(self.vcf, create=False, start=i+1)
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 306, in _load
    self.insert(variants, expanded, keys, i)
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 374, in insert
    vilengths, variant_impacts)
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 402, in _insert
    self.__insert(v_objs, self.metadata.tables['variants'].insert())
  File "/tools/software/bcbio_tools/bin/vcf2db.py", line 436, in __insert
    raise e
sqlalchemy.exc.InterfaceError: (sqlite3.InterfaceError) Error binding parameter 123 - probably unsupported type.
[SQL: INSERT INTO variants (variant_id, chrom, start, "end", vcf_id, ref, alt, qual, filter, type, sub_type, call_rate, num_hom_ref, num_het, num_hom_alt, num_unknown, aaf, gene, ensembl_gene_id, transcript, is_exonic, is_coding, is_lof, is_splicing, is_canonical, exon, codon_change, aa_change, aa_length, biotype, impact, impact_so, impact_severity, polyphen_pred, polyphen_score, sift_pred, sift_score, ab, abp, ac, af, an, ao, cigar, db, decomposed, dp, dpb, dpra, epp, eppr, gti, len, lof, meanalt, mqm, mqmr, ns, numalt, odds, old_multiallelic, old_variant, paired, pairedr, pao, pqa, pqr, pro, qa, qr, ro, rpl, rpp, rppr, rpr, run, saf, sap, sar, srf, srp, srr, ac_adj_exac_afr, ac_adj_exac_amr, ac_adj_exac_eas, ac_adj_exac_fin, ac_adj_exac_nfe, ac_adj_exac_oth, ac_adj_exac_sas, ac_exac_all, af_adj_exac_afr, af_adj_exac_amr, af_adj_exac_eas, af_adj_exac_fin, af_adj_exac_nfe, af_adj_exac_oth, af_adj_exac_sas, af_esp_aa, af_esp_all, af_esp_ea, af_exac_all, an_adj_exac_afr, an_adj_exac_amr, an_adj_exac_eas, an_adj_exac_fin, an_adj_exac_nfe, an_adj_exac_oth, an_adj_exac_sas, an_exac_all, clinvar_disease_name, clinvar_sig, common_pathogenic, gnomad_ac, gnomad_af, gnomad_af_afr, gnomad_af_amr, gnomad_af_asj, gnomad_af_eas, gnomad_af_fin, gnomad_af_nfe, gnomad_af_oth, gnomad_af_popmax, gnomad_af_sas, gnomad_an, max_aaf_all, num_exac_het, num_exac_hom, rs_ids, gts, gt_types, gt_phases, gt_depths, gt_ref_depths, gt_alt_depths, gt_quals, gt_alt_freqs) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)]
[parameters: (25566, u'chr1', 12827540, 12827541, u'rs182233185', u'G', u'A', 306.29998779296875, None, 'snp', 'ts', 1.0, 0, 1, 0, 0, 0.5, u'PRAMEF11', None, u'ENST00000619922.1', 1, 1, 0, 0, 0, u'3/4', u'c.583C>T', u'p.Arg195Cys', 478, u'protein_coding', u'missense_variant', u'missense_variant', 'MED', None, None, None, None, 0.33333298563957214, 15.315299987792969, 1, 0.5, 2, 17, u'1X', 1, 0, 51, 51.0, 0.0, 6.203639984130859, 7.097780227661133, 0, 1, 'None', 1.0, 45.76470184326172, 44.82350158691406, 1, 1, 70.51809692382812, None, 'None', 1.0, 1.0, 0.0, 0.0, 0.0, 0.0, 659, 1285, 34, 10.0, 4.159900188446045, 5.309510231018066, 7.0, 1, 7, 4.159900188446045, 10, 13, 7.097780227661133, 21, 504.0, 26.0, 0.0, 0.0, 4.0, 3.0, 0.0, 537.0, 0.057500001043081284, 0.002267200034111738, 0.0, 0.0, 6.263500108616427e-05, 0.0033859999384731054, 0.0, -1.0, -1.0, -1.0, 0.004611399956047535, 8762.0, 11468.0, 8454.0, 6592.0, 63862.0, 886.0, 16426.0, 116450.0, None, None, 0, 3, 0.00031895001302473247, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, -1.0, (246644, 9406), 0.057500001043081284, 483.0, 27.0, u'rs182233185', <read-only buffer for 0x7fa46b128fc0, size -1, offset 0 at 0x7fa4637f17f0>, <read-only buffer for 0x7fa46b128f90, size -1, offset 0 at 0x7fa4637f1830>, <read-only buffer for 0x7fa46b12b030, size -1, offset 0 at 0x7fa4637f1870>, <read-only buffer for 0x7fa46b12b060, size -1, offset 0 at 0x7fa4637f18b0>, <read-only buffer for 0x7fa46b12b090, size -1, offset 0 at 0x7fa4637f18f0>, <read-only buffer for 0x7fa46b12b0c0, size -1, offset 0 at 0x7fa4637f1930>, <read-only buffer for 0x7fa46b12b0f0, size -1, offset 0 at 0x7fa4637f1970>, <read-only buffer for 0x7fa46b12b120, size -1, offset 0 at 0x7fa4637f19b0>)]
(Background on this error at: http://sqlalche.me/e/rvf5)
' returned non-zero exit status 1.

Log files
NA
Additional context
NA

Hi @hocinebendou!
We had a similar issue before #3087
I think here the problematic gnomad_exome.vcf.gz record is:
gnomad_an = (246644, 9406) at chr1:12827541
If you re-install your hg38/variation/gnomad_exome.vcf.gz, that might help to solve the issue.
To re-install:

Delete gnomad_exome record from hg38/versions.csv
run bcbio_nextgen.py upgrade -u skip --genomes hg38 --datatarget gemini

In my updated installation this particular variant is decomposed:
tabix gnomad_exome.vcf.gz chr1:12827541-12827542 | grep "AN="
chr1	12827541	rs1198360404	G	A	1087.49	PASS	AC=3;AC_afr=0;AC_afr_female=0;AC_afr_male=0;AC_amr=1;AC_amr_female=1;AC_amr_male=0;AC_asj=0;AC_asj_female=0;AC_asj_male=0;AC_eas=0;AC_eas_female=0;AC_eas_jpn=0;AC_eas_kor=0;AC_eas_male=0;AC_eas_oea=0;AC_female=1;AC_fin=0;AC_fin_female=0;AC_fin_male=0;AC_male=2;AC_nfe=2;AC_nfe_bgr=0;AC_nfe_est=0;AC_nfe_female=0;AC_nfe_male=2;AC_nfe_nwe=2;AC_nfe_onf=0;AC_nfe_seu=0;AC_nfe_swe=0;AC_oth=0;AC_oth_female=0;AC_oth_male=0;AC_popmax=1;AC_raw=6;AC_sas=0;AC_sas_female=0;AC_sas_male=0;AF=0.000318945;AF_afr=0;AF_afr_female=0;AF_afr_male=0;AF_amr=0.000625;AF_amr_female=0.00125628;AF_amr_male=0;AF_asj=0;AF_asj_female=0;AF_asj_male=0;AF_eas=0;AF_eas_female=0;AF_eas_kor=0;AF_eas_male=0;AF_eas_oea=0;AF_female=0.000234852;AF_fin=0;AF_fin_female=0;AF_fin_male=0;AF_male=0.0003885;AF_nfe=0.000509684;AF_nfe_est=0;AF_nfe_female=0;AF_nfe_male=0.000938967;AF_nfe_nwe=0.000609756;AF_nfe_onf=0;AF_oth=0;AF_oth_female=0;AF_oth_male=0;AF_popmax=0.000625;AF_raw=0.000102941;AF_sas=0;AF_sas_female=0;AF_sas_male=0;AN=9406;AN_afr=952;AN_afr_female=528;AN_afr_male=424;AN_amr=1600;AN_amr_female=796;AN_amr_male=804;AN_asj=228;AN_asj_female=156;AN_asj_male=72;AN_eas=866;AN_eas_female=404;AN_eas_jpn=0;AN_eas_kor=334;AN_eas_male=462;AN_eas_oea=532;AN_female=4258;AN_fin=108;AN_fin_female=34;AN_fin_male=74;AN_male=5148;AN_nfe=3924;AN_nfe_bgr=0;AN_nfe_est=6;AN_nfe_female=1794;AN_nfe_male=2130;AN_nfe_nwe=3280;AN_nfe_onf=638;AN_nfe_seu=0;AN_nfe_swe=0;AN_oth=368;AN_oth_female=154;AN_oth_male=214;AN_popmax=1600;AN_raw=58286;AN_sas=1360;AN_sas_female=392;AN_sas_male=968;BaseQRankSum=1.95;ClippingRankSum=0.406;DP=416844;FS=0;InbreedingCoeff=-0.0337;MQ=22.92;MQRankSum=-0.323;QD=8.06;ReadPosRankSum=0.406;SOR=0.707;allele_type=snv;faf95=8.604e-05;faf99=8.623e-05;n_alt_alleles=1;nhomalt=0;nhomalt_afr=0;nhomalt_afr_female=0;nhomalt_afr_male=0;nhomalt_amr=0;nhomalt_amr_female=0;nhomalt_amr_male=0;nhomalt_asj=0;nhomalt_asj_female=0;nhomalt_asj_male=0;nhomalt_eas=0;nhomalt_eas_female=0;nhomalt_eas_jpn=0;nhomalt_eas_kor=0;nhomalt_eas_male=0;nhomalt_eas_oea=0;nhomalt_female=0;nhomalt_fin=0;nhomalt_fin_female=0;nhomalt_fin_male=0;nhomalt_male=0;nhomalt_nfe=0;nhomalt_nfe_bgr=0;nhomalt_nfe_est=0;nhomalt_nfe_female=0;nhomalt_nfe_male=0;nhomalt_nfe_nwe=0;nhomalt_nfe_onf=0;nhomalt_nfe_seu=0;nhomalt_nfe_swe=0;nhomalt_oth=0;nhomalt_oth_female=0;nhomalt_oth_male=0;nhomalt_popmax=0;nhomalt_raw=0;nhomalt_sas=0;nhomalt_sas_female=0;nhomalt_sas_male=0;popmax=amr;variant_type=snv
chr1	12827541	rs182233185	G	C	3.34571e+06	PASS	AC=1;AC_afr=0;AC_afr_female=0;AC_afr_male=0;AC_amr=0;AC_amr_female=0;AC_amr_male=0;AC_asj=0;AC_asj_female=0;AC_asj_male=0;AC_eas=0;AC_eas_female=0;AC_eas_jpn=0;AC_eas_kor=0;AC_eas_male=0;AC_eas_oea=0;AC_female=0;AC_fin=0;AC_fin_female=0;AC_fin_male=0;AC_male=1;AC_nfe=0;AC_nfe_bgr=0;AC_nfe_est=0;AC_nfe_female=0;AC_nfe_male=0;AC_nfe_nwe=0;AC_nfe_onf=0;AC_nfe_seu=0;AC_nfe_swe=0;AC_oth=0;AC_oth_female=0;AC_oth_male=0;AC_popmax=1;AC_raw=1;AC_sas=1;AC_sas_female=0;AC_sas_male=1;AF=4.05443e-06;AF_afr=0;AF_afr_female=0;AF_afr_male=0;AF_amr=0;AF_amr_female=0;AF_amr_male=0;AF_asj=0;AF_asj_female=0;AF_asj_male=0;AF_eas=0;AF_eas_female=0;AF_eas_jpn=0;AF_eas_kor=0;AF_eas_male=0;AF_eas_oea=0;AF_female=0;AF_fin=0;AF_fin_female=0;AF_fin_male=0;AF_male=7.45179e-06;AF_nfe=0;AF_nfe_bgr=0;AF_nfe_est=0;AF_nfe_female=0;AF_nfe_male=0;AF_nfe_nwe=0;AF_nfe_onf=0;AF_nfe_seu=0;AF_nfe_swe=0;AF_oth=0;AF_oth_female=0;AF_oth_male=0;AF_popmax=3.27718e-05;AF_raw=3.9946e-06;AF_sas=3.27718e-05;AF_sas_female=0;AF_sas_male=4.34934e-05;AN=246644;AN_afr=14778;AN_afr_female=8868;AN_afr_male=5910;AN_amr=34480;AN_amr_female=20208;AN_amr_male=14272;AN_asj=9962;AN_asj_female=4840;AN_asj_male=5122;AN_eas=18258;AN_eas_female=9252;AN_eas_jpn=130;AN_eas_kor=3812;AN_eas_male=9006;AN_eas_oea=14316;AN_female=112448;AN_fin=21162;AN_fin_female=10098;AN_fin_male=11064;AN_male=134196;AN_nfe=111446;AN_nfe_bgr=2516;AN_nfe_est=228;AN_nfe_female=48800;AN_nfe_male=62646;AN_nfe_nwe=41230;AN_nfe_onf=30100;AN_nfe_seu=11352;AN_nfe_swe=26020;AN_oth=6044;AN_oth_female=2860;AN_oth_male=3184;AN_popmax=30514;AN_raw=250338;AN_sas=30514;AN_sas_female=7522;AN_sas_male=22992;BaseQRankSum=4.83;ClippingRankSum=0.158;DP=19795847;FS=1.102;InbreedingCoeff=0.0793;MQ=35.75;MQRankSum=0.603;QD=13.27;ReadPosRankSum=0.241;SOR=0.58;allele_type=snv;faf95=0;faf99=0;n_alt_alleles=2;nhomalt=0;nhomalt_afr=0;nhomalt_afr_female=0;nhomalt_afr_male=0;nhomalt_amr=0;nhomalt_amr_female=0;nhomalt_amr_male=0;nhomalt_asj=0;nhomalt_asj_female=0;nhomalt_asj_male=0;nhomalt_eas=0;nhomalt_eas_female=0;nhomalt_eas_jpn=0;nhomalt_eas_kor=0;nhomalt_eas_male=0;nhomalt_eas_oea=0;nhomalt_female=0;nhomalt_fin=0;nhomalt_fin_female=0;nhomalt_fin_male=0;nhomalt_male=0;nhomalt_nfe=0;nhomalt_nfe_bgr=0;nhomalt_nfe_est=0;nhomalt_nfe_female=0;nhomalt_nfe_male=0;nhomalt_nfe_nwe=0;nhomalt_nfe_onf=0;nhomalt_nfe_seu=0;nhomalt_nfe_swe=0;nhomalt_oth=0;nhomalt_oth_female=0;nhomalt_oth_male=0;nhomalt_popmax=0;nhomalt_raw=0;nhomalt_sas=0;nhomalt_sas_female=0;nhomalt_sas_male=0;popmax=sas;variant_type=multi-snv

Sergey

@naumenko-sa. @pvanheus followed your instructions. However, this time I'm getting the following error:
OpenBLAS blas_thread_init: pthread_create failed for thread 31 of 32: Resource temporarily unavailable
OpenBLAS blas_thread_init: RLIMIT_NPROC 31668 current, 386078 max
Traceback (most recent call last):
  File "/tools/software/bcbio/anaconda/bin/py", line 11, in <module>
    load_entry_point('pythonpy==0.4.11', 'console_scripts', 'py')()
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pkg_resources/__init__.py", line 490, in load_entry_point
    return get_distribution(dist).load_entry_point(group, name)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2853, in load_entry_point
    return ep.load()
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2444, in load
    return self.resolve()
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2450, in resolve
    module = __import__(self.module_name, fromlist=['__name__'], level=0)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pythonpy/__main__.py", line 142, in <module>
    lazy_imports(args.expression, args.pre_cmd, args.post_cmd)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pythonpy/__main__.py", line 45, in lazy_imports
    import_matches(query)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pythonpy/__main__.py", line 38, in import_matches
    import_matches(query, prefix='%s.' % module_name)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pythonpy/__main__.py", line 38, in import_matches
    import_matches(query, prefix='%s.' % module_name)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/pythonpy/__main__.py", line 36, in import_matches
    module = __import__(module_name)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/variation/vardict.py", line 25, in <module>
    from bcbio import bam, broad, utils
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/bam/__init__.py", line 8, in <module>
    import numpy
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/numpy/__init__.py", line 142, in <module>
    from . import core
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/numpy/core/__init__.py", line 24, in <module>
    from . import multiarray
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/numpy/core/multiarray.py", line 14, in <module>
    from . import overrides
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/numpy/core/overrides.py", line 7, in <module>
    from numpy.core._multiarray_umath import (
KeyboardInterrupt
Failed to open -: unknown file type
Failed to open -: unknown file type
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/variation/freebayes.py", line 330, in call_somatic
    _write_header(header)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/variation/freebayes.py", line 313, in _write_header
    for hline in header[:-1] + new_headers + [header[-1]]:
IndexError: list index out of range
' returned non-zero exit status 1.

Not sure why numpy is complaining?
Thanks Sergey

Glad that we solved the original issue!
We were dealing with numpy/openblas before (see openblas part): #1225
https://stackoverflow.com/questions/33506042/openblas-error-when-importing-numpy-pthread-creat-error-in-blas-thread-init-fu
Does numpy work at all in your system (make sure you are running bcbio python)?
import numpy as np

Try to check out openblas versions, here is what I see on one of the working bcbio/Ubuntu systems:
conda list | grep openblas
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
liblapack                 3.8.0               14_openblas    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge

Then try to upgrade blas library if it is outdated:
bcbio_conda update numpy scipy openblas

or
bcbio_nextgen.py upgrade -u skip --tools

SN

@naumenko-sa. Thanks for your reply.
I can confirm that bcbio numpy is installed. We did run the upgrade command but the error still the same error. I want to add that I'm running bcbio using slurm (sbatch command). Does the numpy problem has something to do with the parallelism of slurm?
Thanks

I think it is rather related to python than to slurm.
What is your python?
which python
Are you able to import numpy in python?
import numpy as np

What are you libblas versions?
conda list | grep openblas
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
liblapack                 3.8.0               14_openblas    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge

SN

Thanks @naumenko-sa
Here are the information you requested:
Which python?
/tools/software/bcbio/anaconda/bin/python
Are you able to import numpy in python?
Yes
What are you libblas versions?
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
liblapack                 3.8.0               14_openblas    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge

Thanks! Everything looks fine.
Sorry, I don't see any clues on the bcbio side.
Maybe the issue is related to the difference between nodes of your cluster (main node vs the node where your job is actually running with sbatch?)
Can you try to

run it on the main node (where the environment looks ok)
check the environment (python) on the compute nodes?

S.

Thanks @naumenko-sa.
It was a memory problem. We allocated more memory. This time I'm getting the following issue. Not sure why bcbio is looking for dbsnp-153.vcf.gz in my working directory. Is it a configuration problem? I appreciate too much your help. Thanks
Traceback (most recent call last):
  File "/tools/software/bcbio/anaconda/bin/bcbio_nextgen.py", line 245, in <module>
    main(**kwargs)
  File "/tools/software/bcbio/anaconda/bin/bcbio_nextgen.py", line 46, in main
    run_main(**kwargs)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 50, in run_main
    fc_dir, run_info_yaml)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 91, in _run_toplevel
    for xs in pipeline(config, run_info_yaml, parallel, dirs, samples):
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/pipeline/main.py", line 165, in variant2pipeline
    samples = run_parallel("postprocess_variants", samples)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/distributed/multi.py", line 28, in run_parallel
    return run_multicore(fn, items, config, parallel=parallel)
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/bcbio/distributed/multi.py", line 86, in run_multicore
    for data in joblib.Parallel(parallel["num_jobs"], batch_size=1, backend="multiprocessing")(joblib.delayed(fn)(*x) for x in items):
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 1017, in __call__
    self.retrieve()
  File "/tools/software/bcbio/anaconda/lib/python3.6/site-packages/joblib/parallel.py", line 909, in retrieve
    self._output.extend(job.get(timeout=self.timeout))
  File "/tools/software/bcbio/anaconda/lib/python3.6/multiprocessing/pool.py", line 670, in get
    raise self._value
subprocess.CalledProcessError: Command 'set -o pipefail; vcfanno -p 8 /usr/people/hbendou/uct/bcbio/PD44692/test1/work/vardict/dbsnp.conf /usr/people/hbendou/uct/bcbio/PD44692/test1/work/vardict/bcbio-effects.vcf.gz | bcftools reheader -h /usr/people/hbendou/uct/bcbio/PD44692/test1/work/vardict/bcbio-effects-annotated-sample_header.txt | bcftools view  |  bgzip -c > /usr/people/hbendou/uct/bcbio/PD44692/test1/work/bcbiotx/tmpalcw8zs6/bcbio-effects-annotated.vcf.gz
=============================================
vcfanno version 0.3.2 [built with go1.12.1]
see: https://github.com/brentp/vcfanno
=============================================
vcfanno.go:112: [Flatten] unable to open file: //usr/people/hbendou/uct/bcbio/PD44692/test1/variation/dbsnp-153.vcf.gz in
[E::bcf_hdr_read] Input is not detected as bcf or vcf format
Failed to read the header: -
Failed to open -: unknown file type

Hi @hocinebendou !
Could you try to trace the location of the annotation files in your installation?

vcfanno: gemini triggers annotation with /data/genomes/Hsapiens/hg38/config/vcfanno/gemini.conf
it has dbsnp record: file="variation/dbsnp-153.vcf.gz"
check if you have the file: /data/genomes/Hsapiens/hg38/variation/dbsnp-153.vcf.gz
check hg38 resources file:

$ cat  /data/genomes/Hsapiens/hg38/seq/hg38-resources.yaml | grep dbsnp
dbsnp: ../variation/dbsnp-153.vcf.gz

S

Hi @naumenko-sa
I checked. There is no file dbsnp-153.vcf.gz. Instead I found dbsnp-151.vcf.gz which I suppose is an old version.
What you suggest to update it?
Thanks
Hocine

Yes, try to update hg38 data
bcbio_nextgen.py upgrade -u skip --data --genomes hg38 --datatarget variation
Sergey

Hi @naumenko-sa
It worked without issues.
Thanks

authors: hocinebendou naumenko-sa


text:
CSS styling, buttons hover effect

CSS styling, buttons hover effect

Thanks

authors: Tunestring bcebel


text:
Include a placeholder index.html on the initial deployment

The web page will display an error message until the CronJob runs (scheduled for Sundays at 0:00).  This can be resolved with a placeholder index.html file created on the initial deployment of the solution.  The default web page will be overwritten by the CronJob.
The initial index.html can be simple initially as "Please wait until next Sunday 00:00 before using".
Alternatively, look for a way to trigger the CronJob immediately on deployment rather than waiting to the next Sunday.  Perhaps an init container in the web deployment that runs a job?

Created a kind: Job in the template that runs an initial load.

repo: bcgov/AppAssessment


text:
Test - Province in Government RM Issue

Province is drop down select an option but there are no options to select under 'Government Location'

Also made British Columbia the default value.

authors: bferguso emjohnst

repo: bcgov/BCHeritage


text:
Sort my workplans by start date descending

https://app.zenhub.com/workspaces/epictrack-63891ea941d309001fa292cf/issues/gh/bcgov/epic.track/1927
Details:

change order_by to start_date.desc()

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

:exclamation: No coverage uploaded for pull request base (develop@d92d450). Click here to learn what that means.

Additional details and impacted files
@@            Coverage Diff             @@
##             develop    #2045   +/-   ##
==========================================
  Coverage           ?   76.27%
==========================================
  Files              ?      283
  Lines              ?     9312
  Branches           ?        0
==========================================
  Hits               ?     7103
  Misses             ?     2209
  Partials           ?        0

Flag
Coverage Δ

epictrack-api
76.27% <100.00%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

authors: codecov-commenter jadmsaadaot


text:
Record attachment type for project and/or survey report attachments

Overview
Links to jira tickets

https://quartech.atlassian.net/browse/BHBC-1382

This PR contains the following changes

Record attachment type for project and/or survey report attachments

This PR contains the following types of changes

[x] New feature (change which adds functionality)
[x] Enhancement (improvements to existing functionality)

How Has This Been Tested?

Locally

Screenshots

funny alignment

There is an table called project_report_attachment .. should the project report be recorded in there ?

authors: anissa-agahchen sdevalapurkar

repo: bcgov/biohubbc


text:
Investigate if teimpPaymentPercentage and teimpPaymentAmount calculated fields are still required[5]

###Description of the Tech Debt###
These two calculated fields are on the TEIMP form but we don't show them on the form. Investigate if we still need these two fields on this form.
###Tech Debt Triage#
The purpose of our technical debt triage process is to analyze technical debt to determine risk level of the technical debt and the value in tackling that technical debt.
Risk Value Scoring:

Level
Value

High
3

Medium
2

Low
1

Technical Debt - Risk Types
Level
Value

Business Area Risk - Risk of business area visibility / damage to user experience

1

Developer Fault Risk - How likely will this tech debt cause a future error related to coding on top of it

1

System Fault Risk - Risk of system errors or application downtime

1

Time Scale Risk - Compound risk effect if left alone. How much more difficult to fix or dangerous will this become over time?

1

Time Sink Risk - How much will this tech debt slow the development process down

1

TOTAL SCORE:

5

Discussion with @nanyangpro and @Sepehr-Sobhani determined these calculations are no longer necessary

There is nothing for the PO to test :)
Thanks @BCerki !

authors: BCerki Sepehr-Sobhani pbastia

repo: bcgov/cas-cif


text:
Incorporate Opt-in workflows into the design

Describe the task
Context (to be refined) below:

Hanna: Hi Scrum Team, it seems like there's been a decision in the business area that industrial operations will be allowed to opt in starting in the first year, i.e. at the same time as the other OBPS registrants. We will need to account for this in the Registration App. The implications I can think of off the top of my head are:
-we'll probably need some checkbox to indicate an opt-in (not sure at what stage, i.e. user access approval, operator, operation?)
-we may need to collect additional data from an opt-in, e.g. the BA seems to indicate that they will need to demonstrate that they are ready to participate - we should find out how that demonstration should happen and whether we need to support that in the app. E.g. an additional form they need to fill out, or attach a document, or sign something, etc.
These are initial thoughts ... we should add this to things to discuss with business area.

Patricia: I was able to confirm that Adria made this decision official, so yes, Opt-ins (smaller industry under 10KT) can apply to participate in OBPS. The process will include first applying to the Director (Adria), who will confirm whether or not they can join. Once approved by the Director, they should be allowed to register in (mostly?) the same manner as Regulated Operations and will also received a carbon tax exemption the same way. Apparently Opt-ins will have until Feb 2024 to apply. More info to come on this as we learn more!!

Dylan: Something to consider is an allow-list for operators. Not totally sure if it would work for our use case, but if some operators need to be approved by adria, we'll probably have to record that approval somehow (either online or offline).

Acceptance Criteria

[ ] Review relevant slide in the Sep 21 Registration Engagement deck
[ ] Create wireframes for the features/workflows Opt-ins in Figma
[ ] Get input from the business area
[ ] Refine design based on the input gathered

Additional context

Hey team! Please add your planning poker estimate with Zenhub @jaimiebutton @nanyangpro @NicoleGovvy

Hi @hannavovk - This ticket is ready for you to review and can be closed with the design updates below in Figma:

(New) Workflow | Add Operator - for when operator profile doesn't exist
(New) Screen | New Entrant and/or Opt-in - for when registering an operation
(New) Screen | Carbon Tax Exemption - for when an operation is registered

As described in the ticket, further refinements/iterations should be made based on future input we get/collect. The design updates above serve as a visual reference to support communications between us and the business area. (cc: @suhafa :)

Thanks @nanyangpro !

authors: hannavovk nanyangpro

repo: bcgov/cas-registration


text:
new private land layer needed in layer picker

[ ] add the private cadastral layer from the BC Datawarehouse to the layer picker and ensure it can be turned on/off like the other layers.

Layer is called "PMBC Parcel CADSTRE - Private - Fully Attributed" (in imap).

repo: bcgov/invasivesbc


text:
feat: retrieve compliance report chain

feat: Retrieve Full Report Chain and Enhance Frontend Display

Thanks for fixing test cases @kevin-hashimoto, But found issues w.r.t BCeID user.

Please fix the issue from both BCeID user and IDIR user perspective and mask statuses as deemed necessary.
Since we're using chain instead of history, is it necessary to have both history and chain data?

We will need both as the chain is a list of supplemental reports with the history of events for each report

repo: bcgov/lcfs


text:
Admin console User/Group management will not highlight group when selected

There is an issue with the upgraded Keycloak consoles where it doesn't highlight which group you've clicked on when you're trying to manage groups for a user manually.
The issue below happens in dev and test, but not prod at current time. (The group membership list component is a bit different in the old prod version)
So if trying to remove a user from a group it looks like the UI isn't working (though it actually is)
It seems to be that the UI will not highlight the item in the list if it is currently in both group panes (Group Membership and Available Groups).
In the example from the screenshot below I have set up to reproduce

In the left pane nothing will highlight
In the right pane ACCESS_FOR_ALL and SAMPLE_GROUP will highlight, and the other 2 won't

(this example is in https://sso-test.pathfinder.gov.bc.ca/auth/admin/jbd6rnxw/console/ and I've reproduced in another Keycloak realm as well)
This has been tested in Chrome and Firefox, as well as on another team member's computer.
So if you click on a group to leave it, it does successfully remove it from the list. So it's just that it's not highlighting in the UI.

@junminahn  is this still relevant as a known error for us?

@junminahn is this still relevant as a known error for us?

We can see if this issue is addressed in RH SSO 7.5 in the gold cluster.

authors: junminahn loneil zsamji

repo: bcgov/ocp-sso


text:
Credit Trade screen to be built based on wireframe and including history

Credit Transfer | Credit Trade screen to be built based on wireframe and including history |3| [v0.0.3-alpha]
https://trello.com/c/1XtO2C6o

https://trello.com/c/1XtO2C6o

The issue was create for experimental use. We start to actively use the issues and milestones. Close this issue for now and reopen it if needed.

authors: dainetrinidad kuanfandevops

repo: bcgov/tfrs


text:
Compliance Report | Part 2 Summary Line 1 and Line 12 |2|

Task:
This card builds off of the work that was completed in Card 1250 by implementing the required functionality for the Part 2 Renewable Fuel Requirement Summary section of the Summary & Declaration Page.
Line 1 - Volume of petroleum-based gasoline supplied:

This line displays the total volume of petroleum-based gasoline reported in Schedule B.
Schedule B: Fuel Type = Petroleum-based gasoline

Line 12 - Volume of petroleum-based diesel supplied:

This line displays the total volume of petroleum-based diesel reported in Schedule B and reported in Schedule C with the expected use of Heating Oil.
Formula is Schedule B: Fuel Type = Petroleum-based diesel + Schedule C: Fuel Type = Petroleum-based diesel and expected use of "Heating Oil".
With respect to Schedule C, the part 2 requirements for this field only include Petroleum-based diesel used for heating oil and excludes petroleum-based diesel used for other purposes (e.g. aviation, national defense, other, etc.)

Other Requirements:

The corresponding value should be displayed in the format that places a comma every 3 digits. We are dealing with large volumes and unformatted number values can be difficult to read at a glance. For example, instead of 4327423 have it display on the screen as 4,327,423.
Non-editable cell

https://trello.com/c/mSRrVzYC/1468-compliance-report-part-2-summary-line-1-and-line-12-2

 Compliance Report | Part 2 Summary Line 1 and Line 12 |2|

Resolved in Sprint Quasar

authors: KMenke amichard


text:
Hamburger 577

By default the sidebar shrinks and expands depending on screen width
If the user clicks the hamburger button the sidebar toggles to either narrow or wide.
If the user clicks the hamburger button it is assumed they want the sidebar to stay in the desired state no matter what the screen width.

Innkeeper will need it as well. The innkeeperLayout is a separate file.
(Originally these were split in case they differed but haven't so far so the innkeeperLayout might be able to be swapped with appLayout with an isInnkeeper parameter that sets the 1 class that makes them different.)

Good to go ahead from the UX end.

I like it!👍
We may want to adjust breakpoint widths for when the sidebar collapses to coordinate with the flexbox grid, so tables and stuff would collapse at the same breakpoint. But we'll probably want to test around to see what the best sizes are for that stuff later.

authors: GurcharanjeetSingh loneil popkinj

repo: bcgov/traction


text:
Form_validation always accepts empty array

See the following code:
		$this->load->library('form_validation');

		$inputData = ['inp' => []];
		$this->form_validation->set_data($inputData);

		$this->form_validation->set_rules('inp', 'Input field', 'is_natural|required');

		//Will return true
		$this->form_validation->run();

This behaviour seems to be caused by a missing check in the following code:
	protected function _execute($row, $rules, $postdata = NULL, $cycles = 0)
	{
		// If the $_POST data is an array we will run a recursive call
		if (is_array($postdata))
		{
			foreach ($postdata as $key => $val)
			{
				$this->_execute($row, $rules, $val, $key);
			}

			return;
		}

There's no missing check.
An empty array means no data, which in turn means no form was submitted - the library doesn't "accept" it; it ignores it. That's the intended behavior.

Forgive me, but either I did not explain my problem well enough, or I have to reread the manual again.
Another example:
Two input fields, both required and `is_natural

Forgive me, but either I did not explain my problem well enough, or I have to reread the manual again.
Another example:
Two input fields, both required and is_natural
The input is accepted ($this->form_validation->run() returns true) even though the second value is an empty array instead of the required natural number.
		$this->load->library('form_validation');

		$inputData = ['number1' => 5, 'number2' => []];
		$this->form_validation->set_data($inputData);

		$this->form_validation->set_rules('number1', 'Input field 1', 'is_natural|required');
		$this->form_validation->set_rules('number2', 'Input field 2', 'is_natural|required');

		//Will return true
		$this->form_validation->run();

Hmm ... I didn't notice the 'inp' key in your initial post, my bad.

Confirmed ... too bad you didn't report this a few hours earlier, the fix could've landed into 3.0.5. :/

Also, incidentally, this will provide progress towards #193.

I'll try to release 3.0.6 ASAP (next week), this is pretty bad.

Won't this return true as well if you use inp[] in the rule even in the 3.0.6 release? Does for me.
    $this->load->library('form_validation');
    $inputData = ['inp' => []];
    $this->form_validation->set_data($inputData);

    $this->form_validation->set_rules('inp[]', 'Input field', 'is_natural|required');

    //Will return true
    $this->form_validation->run();

Also how do you post an empty array? Is this fix only relevant when using $this->form_validation->set_data?

'inp[]' is not the same as 'inp'; please post on our forums if you don't understand how it works.

authors: Bitblade coldlamper narfbg

repo: bcit-ci/CodeIgniter


text:
6492 signature implementation

Summary
This PR is adding 6492 signature support to the SDK
Change Type

[ ] Bug Fix
[ ] Refactor
[x] New Feature
[ ] Breaking Change
[ ] Documentation Update
[ ] Performance Improvement
[ ] Other

Checklist

[x] My code follows this project's style guidelines
[x] I've reviewed my own code
[ ] I've added comments for any hard-to-understand areas
[ ] I've updated the documentation if necessary
[x] My changes generate no new warnings
[ x I've added tests that prove my fix is effective or my feature works
[x] All unit tests pass locally with my changes
[x] Any dependent changes have been merged and published

PR-Codex overview
This PR updates test timeouts, adds signature verification tests, and refactors BiconomySmartAccountV2 with new methods and constants.
Detailed summary

Updated test timeouts
Added signature verification tests
Refactored BiconomySmartAccountV2 with new methods and constants

✨ Ask PR-Codex anything about this PR by commenting with /codex {your question}

Size limit + lint @VGabriel45

repo: bcnmy/biconomy-client-sdk


text:
remove dependency on string

The node package string modifies String.prototype which is a Javascript antipattern - some may agree/ disagree with this.
However, when the same project includes the shelljs package as well, things get really messy - to and toEnd get invoked for no apparent reason:

getNativeStringProperties in node_modules/yargs/node_modules/string/lib/string.js:681:32
calls String.toEnd in node_modules/shelljs/src/common.js:186:23
this really should not happen, and modifying String.prototype appears to be the root cause.

This does not occur with yargs@1 or yargs@2, but it does indeed occur with yargs@3.

@bguiz I agree that modifying String.prototype is an antipattern. Having said that, according to the string documentation it should only be modifying the string prototype if you ask it to:
 Originally, it modified the String prototype. But I quickly learned that in JavaScript, this is considered poor practice.
https://github.com/bcoe/yargs/blob/master/lib/parser.js#L37
Having said this, there it sounds like you're seeing strange behavior around string?

@bguiz I like the looks of this library as a drop in replacement:
https://www.npmjs.com/package/morph
give it a shot and see if you continue seeing shelljs problems?

Yeah, don't get me wrong - both shelljs and string appear to be modifying String.prototype. SO the former is to blame too.
In yargs@3, this function in string is the offender, getNativeStringProperties in node_modules/yargs/node_modules/string/lib/string.js:681:32.
Despite the efforts to avoid it - highlighted in https://github.com/bcoe/yargs/blob/master/lib/parser.js#L37 - the getNativeStringProperties function appears to still be getting called; so I have a feeling that string's documentation might be misleading.
If currently, the only use of the string is for camelise and decamelise, I say go for it!

I've swapped out the string dependency in #108, let me know if this fixes the issues you were seeing with shelljs.

Took a while to get around to it, but I have finally tested this fix
with task-yargs and my target application - and this works like a
charm!
Consequently, task-yargs uses the latest yargs, as of
now
Thanks for the fix!
W: http://bguiz.com
On 28 February 2015 at 15:21, Benjamin E. Coe notifications@github.com wrote:

I've swapped out the string dependency in #108, let me know if this fixes
the issues you were seeing with shelljs.
—
Reply to this email directly or view it on GitHub.

@bguiz awesome!
Fun fact, I spent all weekend adding bash completion to yargs (and fixing a ton of bugs), would love for you to give it a shot:
https://github.com/bcoe/yargs#completioncmd-description-fn
I won't publish the feature to latest until I can get a few people to QA it. But you can test it out by running:
npm install yargs@next.

Adding bash completion was already on my radar:
https://github.com/bguiz/task-yargs/issues/3
... but I was looking at using complete or node-tabtab directly.
Since yargs supports it out of the box now, that's even better!
W: http://bguiz.com
On 9 March 2015 at 17:27, Benjamin E. Coe notifications@github.com wrote:

@bguiz awesome!
Fun fact, I spent all weekend adding bash completion to yargs (and fixing a
ton of bugs), would love for you to give it a shot:
https://github.com/bcoe/yargs#completioncmd-description-fn
I won't publish the feature to latest until I can get a few people to QA it.
But you can test it out by running:
npm install yargs@next.
—
Reply to this email directly or view it on GitHub.

authors: bcoe bguiz

repo: bcoe/yargs


text:
Fail to achieve concurrency

masterFile.txt
Above is the input file for the map. Now I was hoping that it would get split per line. Meaning, there shall be 10 lambda functions running concurrently, considering the input file has 10 new lines. Hence it fails to achieve concurrency.
But it doesn't. Instead, Only a single lambda function is running which executes each line sequentially.
Here is my code:
func main() {
	job := corral.NewJob(wordCount{}, wordCount{})

	options := []corral.Option{
		corral.WithSplitSize(12),
		corral.WithMapBinSize(12),
	}

	driver := corral.NewDriver(job, options...)
	driver.Main()
}

It does show multiple maps (example 1/10, 2/10 etc) while I execute it locally. But when I deploy it to aws lambda, it only executes 1 map/function.
Any kind of help would be really appreciated.

I was able to use your example code/input and have 10 parallel lambdas using the following invocation:
go run main.go -v --lambda --out s3://${AWS_TEST_BUCKET} s3://${AWS_TEST_BUCKET}/master_file.txt

(Where ${AWS_TEST_BUCKET} is the bucket you've stored your input in)
Can you provide the command you're invoking the job with as well as the output log? (The verbose log would be helpful)

Firstly, Thanks alot for the quick reply
Here is more information:
Command:
Main --lambda s3://{BuckName}/masterFile.txt --out s3://{BuckName}/
where Main is the exe file generated by go build command
AWS Lambda Logs:

START RequestId: 6e4992fe-43d3-454e-b7fe-629955cf57ab Version: $LATEST
File - file_0.json
File - file_1.json
File - file_2.json
File - file_3.json
File - file_4.json
File - file_5.json
File - file_6.json
File - file_7.json
File - file_8.json
File - file_9.json
END RequestId: 6e4992fe-43d3-454e-b7fe-629955cf57ab
REPORT RequestId: 6e4992fe-43d3-454e-b7fe-629955cf57ab	Duration: 1762.65 ms	Billed Duration: 1800 ms Memory Size: 1500 MB	Max Memory Used: 112 MB
START RequestId: 1b11b786-1df6-48f8-bed4-703186fcb955 Version: $LATEST
END RequestId: 1b11b786-1df6-48f8-bed4-703186fcb955
REPORT RequestId: 1b11b786-1df6-48f8-bed4-703186fcb955	Duration: 266.66 ms	Billed Duration: 300 ms Memory Size: 1500 MB	Max Memory Used: 112 MB

@bcongdon hoping and waiting for another quick reply :)

Hi, I wish I had better news, but I'm still unable to reproduce the error you're having. 😕 (When I deploy, I get the correct number of jobs)
The only thing I can think of would be to try undeploying everything (Main --undeploy), reuploading inputs to S3, and then redeploying.
Also, I'd double check that you're using the latest version of corral, a reasonably up-to-date version of go (I tested using 1.11.4), etc.

I'd also make the general suggestion that corral wasn't really built to handle really small input splits like this. Optimally, you'd want to give splits that are as big as possible while allowing the lambda to still process its entire split before timing out.
In principle there's nothing preventing you from using 12-byte input splits, but be warned that corral wasn't designed to work optimally for this (and having such small splits probably won't scale well to large inputs)
In your example, it looks like you might be loading files in the map phase? If your use-case supports it, it might be better to feed all the input files as inputs to the map phase. (i.e. Main file*.json). Without more context, I'm not sure if this is what you're trying to do. 🙂

Hi,
Regarding "In your example, it looks like you might be loading files in the map phase?" - Yes, I am loading files in the map because I have thousands of file which I want to process parallelly. So that's the use-case. of using corral.
Anyways,  I am checking the versions and other possible ways to resolve the issue. Will let you know if I achieve success.

Undeploying everything, reinstalling dependency and rebuilding everything from the scratch magically solved the concurrency issue.  🥇
But it is not creating the exact number of maps as the number of new lines, as you warned. But I wish there was a way to split the input merely on the basis on new lines and not per bytes. Hoping for an update :-)
But thanks anyways!

@bcongdon 1 more question - Main -v --lambda s3://{BuckName}/masterFile.txt --out s3://{BuckName}/  deploys to lambda function and executes it. IS there a way to execute the already deployed function with input file as argument?

The --lambda flag only redeploys if your code has changed, so you can do something like
Main -v --lambda --out s3://{OutputBucket}/ s3://{InputBucket}/masterFile1.txt
... followed immediately by
Main -v --lambda --out s3://{OutputBucket}/ s3://{InputBucket}/masterFile2.txt
and (assuming you didn't make any code changes) the same Lambda will be used.
Note that the last argument is a list of input files, so you could even do something like this to act on both files with 1 run:
Main -v --lambda --out s3://{OutputBucket}/ s3://{InputBucket}/masterFile1.txt s3://{InputBucket}/masterFile2.txt

Currently there isn't a flag that explicitly skips the compilation/deployment step. I think this could be useful if you have really big jobs and don't want to compile everything each time you run it. I created #8 to track this idea.

authors: ShagunParikh bcongdon

repo: bcongdon/corral


text:
prepare to add continuous state based predicates to spot envs

also fix default spot IP to prevent hanging / bad behavior when running tests on network
coauthor: @nkumar-bdai

(tested on spot)

repo: bdaiinstitute/predicators