text:
Enhancement: Better diagnostics for errors.

While studying CloudDQ, I created a configuration file and used it in an execution.   I obviously made a mistake in my config file which has resulted in the error: ERROR malformed JSON.   The issue I am reporting here is in terms of "servicability".  Based on the information presented in this error output, how can I narrow down on my issue?  Is there an opportunity for the project to offer "better" diagnostics?
python3 clouddq_executable_v0.5.2_debian_10_python3.9.zip \
    ALL \
    test1.yaml \
    --gcp_project_id="${GOOGLE_CLOUD_PROJECT}" \
    --gcp_bq_dataset_id="${CLOUDDQ_BIGQUERY_DATASET}" \
    --gcp_region_id="${CLOUDDQ_BIGQUERY_REGION}" \
    --print_sql_queries \
    --target_bigquery_summary_table="${CLOUDDQ_TARGET_BIGQUERY_TABLE}"kolban@cloudshell:~/clouddq (kolban-dataplex)$ ./run
Your active configuration is: [cloudshell-11175]
2022-03-05 16:12:46 cs-158005325041-default clouddq.integration.gcp_credentials[1748] INFO Successfully created GCP Client.
2022-03-05 16:12:46 cs-158005325041-default clouddq[1748] INFO Starting CloudDQ run with configs:
{"clouddq_run_configs": {"rule_binding_ids": "ALL", "rule_binding_config_path": "test1.yaml", "dbt_path": null, "dbt_profiles_dir": null, "environment_target": "dev", "gcp_project_id": "kolban-dataplex", "gcp_region_id": "us-central1", "gcp_bq_dataset_id": "dq_output", "gcp_service_account_key_path": null, "gcp_impersonation_credentials": null, "metadata": "{}", "dry_run": false, "progress_watermark": true, "target_bigquery_summary_table": "kolban-dataplex.dq_output.target", "debug": false, "print_sql_queries": true, "skip_sql_validation": false, "summary_to_stdout": false, "enable_experimental_bigquery_entity_uris": false, "enable_experimental_dataplex_gcs_validation": false, "bigquery_client": null, "gcp_credentials": {"credentials": "<google.auth.compute_engine.credentials.Credentials object at 0x7fa1709d60a0>", "project_id": "kolban-dataplex", "user_id": "kolban@kolban.altostrat.com"}}}
2022-03-05 16:12:46 cs-158005325041-default clouddq.runners.dbt.dbt_connection_configs[1748] INFO Using Application-Default Credentials (ADC) to authenticate to GCP...
2022-03-05 16:12:46 cs-158005325041-default clouddq[1748] INFO Writing rule_binding views and intermediate summary results to BigQuery dq_summary_table_name: `kolban-dataplex.dq_output.dq_summary`.
2022-03-05 16:12:46 cs-158005325041-default clouddq[1748] INFO Using dq_summary_dataset: kolban-dataplex.dq_output
2022-03-05 16:12:46 cs-158005325041-default clouddq[1748] INFO Using target_bigquery_summary_table: `kolban-dataplex.dq_output.target`.
2022-03-05 16:12:47 cs-158005325041-default clouddq[1748] INFO Preparing SQL for rule bindings: ['SALES_WIDGET', 'SALES_QUANTITY']
2022-03-05 16:12:47 cs-158005325041-default clouddq[1748] ERROR malformed JSON
Traceback (most recent call last):
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/clouddq/clouddq/main.py", line 486, in main
    configs_cache.get_entities_configs_from_rule_bindings(
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/clouddq/clouddq/classes/dq_configs_cache.py", line 354, in get_entities_configs_from_rule_bindings
    for record in self._cache_db.query(query):
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/py_deps/pypi__sqlite_utils/sqlite_utils/db.py", line 410, in query
    cursor = self.execute(sql, params or tuple())
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/py_deps/pypi__sqlite_utils/sqlite_utils/db.py", line 422, in execute
    return self.conn.execute(sql, parameters)
sqlite3.OperationalError: malformed JSON
"malformed JSON"
Traceback (most recent call last):
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/clouddq/clouddq/main.py", line 486, in main
    configs_cache.get_entities_configs_from_rule_bindings(
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/clouddq/clouddq/classes/dq_configs_cache.py", line 354, in get_entities_configs_from_rule_bindings
    for record in self._cache_db.query(query):
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/py_deps/pypi__sqlite_utils/sqlite_utils/db.py", line 410, in query
    cursor = self.execute(sql, params or tuple())
  File "/tmp/Bazel.runfiles_b3f80ukr/runfiles/py_deps/pypi__sqlite_utils/sqlite_utils/db.py", line 422, in execute
    return self.conn.execute(sql, parameters)
sqlite3.OperationalError: malformed JSON

malformed JSON
Waiting up to 5 seconds.
Sent all pending logs.

Hi Neil, thanks for your feedback. The error message could definitely be improved. Would you mind sharing the configs YAML used in this example? We'd need to check what the issue here so we can throw a better error message when it occurs.

Here is the YAML that I used:
entities:
  SALES_TABLE:
    source_database: BIGQUERY
    table_name: sales2
    dataset_name: clouddq
    project_name: kolban-dataplex
    columns:
      DATE_ID:
        name: date
        data_type: DATE
        description: date description
      WIDGET:
        name: widget
        data_type: STRING
        description: widget description
      QUANTITY:
        name: quantity
        data_type: INTEGER
        description: quantity description
      UNIT_PRICE:
        name: unit_price
        data_type: FLOAT
        description: unit_price description
      STATE:
        name: ship_state
        data_type: STRING
        description: ship_state description

rules:
  NOT_BLANK:
    rule_type: NOT_BLANK
    dimension: completeness
  POSITIVE:
    rule_type: CUSTOM_SQL_EXPR
    dimension: correctness
    params:
      custom_sql_expr: "$column >= 0"
  NOT_TOO_HIGH:
    rule_type: CUSTOM_SQL_EXPR
    dimension: correctness
    params:
      custom_sql_expr: "$column < 1000"

rule_dimensions:
  - consistency
  - correctness
  - duplication
  - completeness
  - conformance
  - integrity

row_filters:
  NONE:
    filter_sql_expr: "True"

rule_bindings:
  SALES_WIDGET:
    entity_id: SALES_TABLE
    column_id: WIDGET
    row_filter_id: NONE
    rule_ids:
      - NOT_BLANK
  SALES_QUANTITY:
    entity_id: SALES_TABLE
    column_id: QUANTITY
    row_filter_id: NONE
    rule_ids: POSITIVE

The working YAML was the last line which should have read:
    rule_ids:
      - POSITIVE

Thank you Neil. Sorry for the delayed response. I believe I know what needs to be fixed and will work on it this week.

authors: kolban-google thinhha

repo: GoogleCloudPlatform/cloud-data-quality


text:
feat: GAE_DEPLOYMENT_ID used for minor version

The GAE_DEPLOYMENT_ID environment variable (with a fallback to
GAE_MINOR_VERSION) will be used as the default value of
minorVersion_.

Looks like tests must be updated?

PTAL

source: gharchive/pull-request

authors: DominicKramer jinwoo

repo: GoogleCloudPlatform/cloud-debug-nodejs

license_type: permissive

license_source: github-api


text:
Display error for native properties

This prevents native properties from being reported as undefined when we
are unable to check their values for fear of executing stateful code.

@ofrobots PTAL.

@ofrobots Ready for another look.

LGTM w/ comments.

authors: matthewloring ofrobots


text:
Publish a container image for Apple M1 machines

Bug Description
Crash on Docker for Mac Kubernetes, M1 chip.
Stacktrace
runtime: unexpected return pc for runtime.asyncPreempt called from 0xc0003d2000
stack: frame={sp:0xc000309cf0, fp:0xc000309cf8} stack=[0xc000308000,0xc00030a000)
000000c000309bf0:  000000c0000a2180  000000c0002aa160
000000c000309c00:  000000c00010c238  000000c000000180
000000c000309c10:  000000c000000208  000000c0000a21d0
000000c000309c20:  000000c0000002b8  000000000044338e <runtime.newproc+110>
000000c000309c30:  000000c000309c38  000000c000309c68
000000c000309c40:  00000000004081eb <runtime.chanrecv2+43>  000000c00010c1e0
000000c000309c50:  000000c0003f5cc0  000000c000000101
000000c000309c60:  000000000095b0c5 <github.com/GoogleCloudPlatform/cloudsql-proxy/proxy/proxy.(*Client).Run+165>  000000c000309ce0
000000c000309c70:  000000000095b0e5 <github.com/GoogleCloudPlatform/cloudsql-proxy/proxy/proxy.(*Client).Run+197>  000000c00010c1e0
000000c000309c80:  000000c0003f5cc0  000000c0003d2000
000000c000309c90:  0000004000800b8e  0000000000000033
000000c000309ca0:  0000000000b8e130  000000c00045e0d0
000000c000309cb0:  0000000000466d80 <runtime.newproc.func1+0>  000000c000717cf8
000000c000309cc0:  0000000000000000  0000000000000000
000000c000309cd0:  0000000000000000  0000000000000000
000000c000309ce0:  000000c000309f70  000000000046f940 <runtime.asyncPreempt+0>
000000c000309cf0: <000000c0003d2000 >000000c00010c1e0
000000c000309d00:  000000c00010c360  000000c0003d2000
000000c000309d10:  0000000000000000  000000c00051a180
000000c000309d20:  000000c00018b740  000000c00010c1e0
000000c000309d30:  0000000000000000  0000000000000000
000000c000309d40:  0000000000b7e900  000000c00002a920
000000c000309d50:  000000c0001c8000  0000000000000000
000000c000309d60:  0000000000000000  000001c00018b0b0
000000c000309d70:  00000006fc23ac00  000000c0002dfda0
000000c000309d80:  0000000000000000  0000000000000000
000000c000309d90:  0000000000ac5b47  0000000000000002
000000c000309da0:  0000000000000002  0000000000000002
000000c000309db0:  0000000000000002  0000000000000002
000000c000309dc0:  0000000000000002  0000000000b88a90
000000c000309dd0:  0000000000000002  0000000000000002
000000c000309de0:  000000c00011d838  0000000000000000
000000c000309df0:  000000000000007e
fatal error: unknown caller pc

runtime stack:
runtime.throw(0xacf03d, 0x11)
        /usr/local/go/src/runtime/panic.go:1117 +0x72
runtime.gentraceback(0xffffffffffffffff, 0xffffffffffffffff, 0x0, 0xc000000180, 0x0, 0x0, 0x7fffffff, 0xaf54d0, 0x40306a59a0, 0x0, ...)
        /usr/local/go/src/runtime/traceback.go:261 +0x1a56
runtime.copystack(0xc000000180, 0x2000)
        /usr/local/go/src/runtime/stack.go:908 +0x2f1
runtime.shrinkstack(0xc000000180)
        /usr/local/go/src/runtime/stack.go:1180 +0x13d
runtime.scanstack(0xc000000180, 0xc000034698)
        /usr/local/go/src/runtime/mgcmark.go:720 +0x58e
runtime.markroot.func1()
        /usr/local/go/src/runtime/mgcmark.go:233 +0xc6
runtime.markroot(0xc000034698, 0x14)
        /usr/local/go/src/runtime/mgcmark.go:206 +0x33e
runtime.gcDrain(0xc000034698, 0x7)
        /usr/local/go/src/runtime/mgcmark.go:1014 +0x118
runtime.gcBgMarkWorker.func2()
        /usr/local/go/src/runtime/mgc.go:2003 +0x17e
runtime.systemstack(0xc000000d80)
        /usr/local/go/src/runtime/asm_amd64.s:379 +0x66
runtime.mstart()
        /usr/local/go/src/runtime/proc.go:1246

goroutine 67 [GC worker (idle), 2 minutes]:
runtime.systemstack_switch()
        /usr/local/go/src/runtime/asm_amd64.s:339 fp=0xc00003f760 sp=0xc00003f758 pc=0x46c680
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1967 +0x1c7 fp=0xc00003f7e0 sp=0xc00003f760 pc=0x41f567
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc00003f7e8 sp=0xc00003f7e0 pc=0x46e4c1
created by runtime.gcBgMarkStartWorkers
        /usr/local/go/src/runtime/mgc.go:1835 +0x37

goroutine 1 [chan receive (scan), 2 minutes]:
github.com/GoogleCloudPlatform/cloudsql-proxy/proxy/proxy.(*Client).Run(0xc0003d2000, 0xc00010c1e0)
        /go/src/cloudsql-proxy/proxy/proxy/client.go:137 +0xc5
**
ERROR:/qemu/accel/tcg/cpu-exec.c:697:cpu_exec: assertion failed: (cpu == current_cpu)

Environment

OS type and version: macOS 11.3.1 , Docker for Mac 3.3.3.
Cloud SQL Proxy version (./cloud_sql_proxy -version): 1.22.0

The M1 is an ARM chip and the stack trace says asm_amd64, which makes me think it's not running an ARM binary. Which docker image are you using?

@hazcod Can you confirm which docker image you're using?

This is the official one, but it might be emulated Docker for Mac via qemu I guess to x86?

I assume you're using the default image and not alphine or buster.
In any case, this should just work, but perhaps there's still an issue here with Docker? We'll investigate.

How are you starting your container? I see there are some known issues with Docker on the M1 chip:

Not all images are available for ARM64 architecture. You can add --platform linux/amd64 to run an Intel image under emulation. In particular, the mysql image is not available for ARM64. You can work around this issue by using a mariadb image.

https://docs.docker.com/docker-for-mac/apple-silicon/#known-issues

Note: the link above recommends running ARM64 containers on Apple Silicon. Recently distroless added support for ARM64.

We probably need to do something special to support ARM64 in the default container. Until then I think using the emulation flag as Eno described above is a suitable work around.

For reference how I run it via Kubernetes on Docker for Mac:
apiVersion: apps/v1
kind: Deployment

metadata:
  namespace: "{{ .Values.namespace }}"
  name: "{{ .Values.name }}-api"

  labels:
    app: "{{ .Values.name }}"
    owner: "{{ .Values.owner }}"

spec:
  replicas: {{ .Values.replicaCount }}

  selector:
    matchLabels:
      app: "{{ .Values.name }}"
      component: "api"

  strategy:
    type: Recreate

  template:

    metadata:

      labels:
        app: "{{ .Values.name }}"
        owner: "{{ .Values.owner }}"
        component: "api"

      annotations:
        seccomp.security.alpha.kubernetes.io/pod: runtime/default
        {{ if not .Values.developmentMode }}
        # do not enable on Docker for Mac, since it doesn't support AppArmor
        container.apparmor.security.beta.kubernetes.io/api: runtime/default
        {{ end }}

    spec:

      restartPolicy: Always

      {{ if not .Values.developmentMode }}
      serviceAccountName: "{{ .Values.serviceAccount }}"

      initContainers:
      - image:  gcr.io/google.com/cloudsdktool/cloud-sdk:slim
        name: workload-identity-initcontainer
        command:
        - '/bin/bash'
        - '-c'
        - |
          curl -s -H 'Metadata-Flavor: Google' 'http://169.254.169.254/computeMetadata/v1/instance/service-accounts/default/token' --retry 30 --retry-connrefused --retry-max-time 30 > /dev/null || exit 1
      {{ end }}

      containers:
      -
        imagePullPolicy: Always
        image: eu.gcr.io/cloudsql-docker/gce-proxy:1.22.0
        name: cloudsql-proxy

        command:
        - '/cloud_sql_proxy'
        - '-enable_iam_login'
        {{ if not .Values.developmentMode }}
        - '-ip_address_types=PRIVATE'
        {{ end }}
        - '-instances={{ .Values.app.db.requests.instanceUrl }}=tcp:3126,{{ .Values.app.db.meta.instanceUrl }}=tcp:3127'

        {{ if .Values.developmentMode }}
        env:
        -
          name: GOOGLE_APPLICATION_CREDENTIALS
          value: /sa.json

        volumeMounts:
        -
          mountPath: /sa.json
          name: {{.Values.name}}-api-sajson
          readOnly: true
        {{ end }}

        resources:
          requests:
            cpu: 0.5
            memory: 0.5Gi
          limits:
            cpu: 0.5
            memory: 0.5Gi

        securityContext:
          readOnlyRootFilesystem: true
          privileged: false
          runAsNonRoot: true
          allowPrivilegeEscalation: false
          capabilities:
            drop: [all]
          seccompProfile:
            type: RuntimeDefault

      volumes:
      {{ if .Values.developmentMode }}
      -
        hostPath:
          path: {{ .Values.devServiceAccountFile}}
        name: "{{.Values.name}}-api-sajson"
      {{ end }}

@hazcod I don't have access to an Apple Silicon machine presently. However, if there's interest you could build your own container by making two changes to the Dockerfile at the root of this project:

Change Line 22 to  RUN CGO_ENABLED=0 GOOS=darwin GOARCH=arm64 go build -ldflags "-X main.metadataString=container" -o cloud_sql_proxy ./cmd/cloud_sql_proxy
Change Line 25 to FROM gcr.io/distroless/static:nonroot-arm64.

After those changes, you'll have an M1 friendly version of the Cloud SQL Auth proxy. But again, I don't have an Apple Silicon machine at the moment and can't verify myself.

Peeking in here again for official arm64 images. :-)

We have this prioritized internally for the first half of this year. Right now, there's other work in flight that takes priority (e.g., v2 proxy).

Fixed by https://github.com/GoogleCloudPlatform/cloudsql-proxy/pull/1193. We'll have an M1 friendly container in the next release.

source: gharchive/issue

authors: enocom hazcod kurtisvg

repo: GoogleCloudPlatform/cloudsql-proxy


text:
Added retry loop to _HandleMetadataUpdate

This is in response to issue #862 opened by @rjschwei
Added a retry counter with a default of 50 tries before breaking the loop.

@hopkiw For your review

/assign @hopkiw

Okay... Think I'm done now.

@hopkiw Hey there. Just waiting on review.

@hopkiw Thanks for finishing this out. I was away for a few weeks.

license_source: bigquery


text:
Docker image v0.2.0 is broken

What is broken
docker run -i --rm gcr.io/gcp-runtimes/container-structure-test:v0.2.0 --help
/go_default_test: error while loading shared libraries: libstdc++.so.6: cannot open shared object file: No such file or directory

Probably wrong base image...I am bit confused by your bazel machinery.
What I expect
Same thing as for v0.1.3
docker run -i --rm gcr.io/gcp-runtimes/container-structure-test:v0.1.3 --help                                                                                2s
Usage of /go_default_test:
  -driver string
        driver to use when running tests (default "docker")
  -image string
        path to test image
  -pull
        force a pull of the image before running tests
  -save
        preserve created containers after test run
  -test.bench regexp
        run only benchmarks matching regexp
  -test.benchmem
        print memory allocations for benchmarks
  -test.benchtime d
        run each benchmark for duration d (default 1s)
...

Hey,
Sorry about this. It was fixed in #61, but we have to cut a release to get a new image out. I'll do one today.

Fixed in the release v0.2.1.
Thanks!

authors: dlorenc zemanlx


text:
Don't require a name for a subscription

The Pub/Sub documentation states:

If the name is not provided in the request, the server will assign a random name for this subscription on the same project as the topic.

- https://github.com/GoogleCloudPlatform/gcloud-ruby/issues/193 / @blowmage
--
So, let's not require it!

https://github.com/GoogleCloudPlatform/gcloud-node/pull/757#issuecomment-130735254

repo: GoogleCloudPlatform/gcloud-node


text:
feat: add BigQuery Studio embedded notebook showing analysis with Gemini models

This PR adds a notebook for using Gemini Pro and Gemini Pro Vision models in BQ using integration in BQML. Notebook is focused on BigQuery Studio embedded notebook experience.
Thank you for opening a Pull Request!
Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

[X] Follow the CONTRIBUTING Guide.
[X] You are listed as the author in your notebook or README file.

[X] Your account is listed in CODEOWNERS for the file(s).

[X] Make your Pull Request title in the https://www.conventionalcommits.org/ specification.
[X] Ensure the tests and linter pass (Run nox -s format from the repository root to format).
[N/A] Appropriate docs were updated (if necessary)

Couple of minor nits. Looks good overall! Not sure if owlbot will do this automatically, but it would also be nice if you could format the SQL cells how bigquery auto-formats them.

I made updates and also formatted the queries - some don't format nicely in BQ editor but I used formats from the docs in those cases.

repo: GoogleCloudPlatform/generative-ai


text:
After upgrade to 1-5-0, I get ImportError: dynamic module does not define init function (initcygrpc)

from google.cloud import datastore
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/cloud/datastore/__init__.py", line 60, in <module>
    from google.cloud.datastore.batch import Batch
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/cloud/datastore/batch.py", line 24, in <module>
    from google.cloud.datastore import helpers
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/cloud/datastore/helpers.py", line 29, in <module>
    from google.cloud.datastore_v1.proto import datastore_pb2
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/cloud/datastore_v1/__init__.py", line 18, in <module>
    from google.cloud.datastore_v1.gapic import datastore_client
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/cloud/datastore_v1/gapic/datastore_client.py", line 18, in <module>
    import google.api_core.gapic_v1.client_info
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/api_core/gapic_v1/__init__.py", line 16, in <module>
    from google.api_core.gapic_v1 import config
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/google/api_core/gapic_v1/config.py", line 23, in <module>
    import grpc
  File "/base/data/home/apps/s~notify-engine/1-0-3.407710064260605490/lib/grpc/__init__.py", line 22, in <module>
    from grpc._cython import cygrpc as _cygrpc
ImportError: dynamic module does not define init function (initcygrpc)

Even after downgrade, I see same error.

I my project I am installing / upgrading these packages:
google-api-python-client
google-cloud-datastore
google-cloud-pubsub
google-endpoints
google-endpoints-api-management
oauth2client==3.0.0

Are you able to solve this issue?

Hey there! I'm sorry you're experiencing this. The driver you're having issues with is part of google-cloud-python. The Python driver in this repo (package name googledatastore) is totally separate. Please re-file this issue there and the google-cloud-python team will investigate. Sorry for the confusing situation.

This issue was moved to GoogleCloudPlatform/google-cloud-python#5170

authors: nkumar15 wsh zonito


text:
MaxMessageSize too low for Cloud Pub/Sub

Cloud Pub/Sub allows responses of up to 20 MB, so the channel default of 4 MB causes deframing errors for users, as can be seen here https://code.google.com/p/cloud-pubsub/issues/detail?id=50 . MaxMessageSize should either be increased to at least 20 MB, or else users should be given the ability to change it themselves.

@pongad : I'm unsure if this is already addressed in the pubsub-hp branch.

This issue seems to be alleviated by https://github.com/grpc/grpc-java/issues/2307 . As of GRPC 1.0.3 though, the fix hasn't been merged...

@garrettjonesgoogle This is now available here. It is marked experimental though. Are we OK to use this? I'm a little worried about ABI compatibility with later releases. Or do we plan to shade the entire gRPC?

Good catch. I'm trying to get away from dependencies on experimental features. We will need to think about this.

Filed issue https://github.com/grpc/grpc-java/issues/2763 .

Maybe we could mark it as experimental on our own surface too, so that users can make their own choice about whether to depend on it.

Hmm ideally we wouldn't actually want to expose this on our surface, since this can be completely determined by which API is in use.

@pongad  - GAX issue: https://github.com/googleapis/gax-java/issues/149 - please resolve that issue if for some reason no GAX change is necessary to support Pub/Sub.

@mdietz94 Sorry it took me so long to get to this. I want to make sure. This is only for Subscriber right? The Publisher is unaffected?

Yes, this is only inbound message size, so this only affects Subscriber.

This has been fixed for a while. https://github.com/GoogleCloudPlatform/google-cloud-java/pull/1911 moved the grpc call into GAX, so that it's no longer made directly from google-cloud-java. Resolving.

authors: garrettjonesgoogle mdietz94 pongad

repo: GoogleCloudPlatform/google-cloud-java


text:
Typo in documentation

There is a small typo in the documentation here: https://googlecloudplatform.github.io/google-cloud-node/#/docs/logging/1.0.3/logging/entry
the code if (!error)  should be if (!err).

Thanks for reporting! Fixed in e83cb8b9e4ca39e6acc342045e3701039fe9117e

authors: mastoj stephenplusplus

repo: GoogleCloudPlatform/google-cloud-node


text:
Update EL9 timeout

20m is still not enough; this needs deeper investigation but also need to unblock a different release in the short term.

/lgtm

authors: jjerger zmarano

repo: GoogleCloudPlatform/guest-test-infra


text:
Automated cherry pick of #11381

We should bump ContainerVM before 1.0.1. #11381 has baked in the main branch long enough.

cc @roberthbailey @dchen1107

LGTM.

LGTM thanks!

(Travis is a flake.)

And now Travis is the short version from master. :)

Shippable is 1/2 here, and the 1 looks like a flake, plus this is all config.

authors: dchen1107 roberthbailey zmerlynn

repo: GoogleCloudPlatform/kubernetes


text:
Split namespace docs user vs admin.

Move namespace.md and examples dir from docs/user-guide
to docs/admin.
Assumption is that creating and deleting namespaces is an "admin"
task.
Add a mostly new user-guide to namespaces that gives more advice
on when to use namespaces, and how to work within them,
but not how to create/delete them.  It is more succinct than
before.

LGTM, comment is optional

addressed comment.

hack/run-gendocs.sh

Fixed by pushing the file I forgot to push in last PR.

LGTM

@erictune I think this is or is going to break the build. You moved example files without updating the examples test. Could you please send a follow up PR asap?

authors: erictune krousey lavalamp


text:
WIP: Support readiness checks

This is a pass at addressing #620, to support readiness checks of pods before being added to the endpoint pool of services. What's left is to do is write unit/integration tests and improve documentation. I'm opening this as a WIP to start discussion around the api and anything else.

cc @bgrant0607, want to take a look at this?

Generally speaking the code LGTM.  I defer to @bgrant0607 and @smarterclayton  on the details of the API spec.  We might consider making readiness tied to a specific port, but I think that could (and should) be an extension for the future.

Thanks. Will look at this today.

I've rebased, addressed the comments and refactored the api. I'll write the docs/tests, and finish this up sometime tomorrow/this weekend.

I've refactored the api per the comments, and added documentation. I've implemented readiness. I've made some minor refactoring's to pkg/probe related code to facilitate testing, and added unit tests. This is ready for review. I've tried to organize the commits in logical chunks to hopefully make review easier because of the size.

Looks pretty good. Thanks! Just a few minor comments, and we're waiting on the other PR I mentioned.

Looks good. Only 2 minor comments. Thanks for all the iterations on this.
Have you run the e2e test?

No worries. I'm not set up with gcp yet. I'll try to get that going this morning.

That wasn't bad.
Ran 20 of 20 Specs in 1388.811 seconds
SUCCESS! -- 20 Passed | 0 Failed | 0 Pending | 0 Skipped I0210 08:39:49.841956  105690 driver.go:83] All tests pass

Great! Thanks much.
LGTM

authors: a-robinson bgrant0607 brendandburns mikedanese


text:
Include cloudbuild in places version needs to be set.  Specify rc for…

… all versions

This is the last item in #269

repo: GoogleCloudPlatform/open-match


text:
Docker related changes for controller+spark

Description of what I changed
Fixes #360
This adds a Dockerfile for the controller and a docker-compose config for combining this new docker
image with Spark images (from Bitnami). It also adds an option for limiting number of pipeline workers.

E2E test

TESTED:
Ran:
docker-compose -f compose-controller-spark-sql.yaml up

Then ran the pipeline through the controller UI and query it using beeline
docker exec -it spark-thriftserver bin/beeline

Checklist: I completed these to help reviewers :)

[x] I have read and will follow the review process.
[x] I am familiar with Google Style Guides for the language I have coded in.
[x] My IDE is configured to follow the Google
[ ] I have added tests to cover my changes. (If you refactored existing code that was well tested you do not have to add tests)
[x] I ran mvn clean package right before creating this pull request and
added all formatting changes to my commit.
[x] All new and existing tests passed.
[x] My pull request is based on the latest changes of the master branch.

To be clear, this line is the only real change since last review round.


text:
RAD Lab UI is not allowing Data Science Module submission if GPU is 0

Describe the bug
When Deploying Data Science Module via RAD Lab UI at the last prompt window as shown below, i.e. if the GPU number is 0, it doesn't allow to go ahead and Submit the deployment.
To Reproduce
Steps to reproduce the behavior:

Go to RAD Lab UI
Deploy Data Science module
Navigate till 3rd page and see that GPU is set to 0
The "Submit" button is greyed out.

NOTE: When we set the the GPU to 1 or anything except 0 , Submit button turns blue and we can submit.
Not sure if its impacting any other module with number type variable is set to 0.
Expected behavior
We should be able to submit the module even if the GPU is set to 0
Screenshots

This issue is now fixed and pushed to main.

repo: GoogleCloudPlatform/rad-lab


text:
Google Cloud API Client initialization inconsistent

Story
Rubyist knows to use Google Data Store API. Rubyist wants to learn Google Vision API and the samples use different Google Cloud API Client initialization. Confusion begins.
Issue
Initialization is inconsistent between these two samples. The issue may exist in other samples within the Ruby space.
DataStore uses
require "gcloud"
gcloud = Gcloud.new
datastore = gcloud.datastore
Vision uses
require "google/cloud"
gcloud = Google::Cloud.new
vision = gcloud.vision
Issue exists in the following locations:
appengine/datastore/app.rb
appengine/pubsub/app.rb
appengine/pubsub/spec/pubsub_spec.rb
bigquery/shakespeare.rb
datastore/sample.rb
logging/spec/sample_spec.rb
logging/sample.rb
pubsub/sample.rb
Possible Solution
Use the same initialization in all Ruby samples.

Duplicate of #55
Fix pending in #65

authors: frankyn remi

repo: GoogleCloudPlatform/ruby-docs-samples


text:
Added enable-ui-service flag to disable UI service

This Pull request tries to provide users an option to disable UI service due to following reasons.

Spark Driver service contains the same port that is already exposed by UI service.
A global way to disable the service, as service is a limited resource in a Kubernetes cluster (Limit of 5000 per namespace and 10,000 per cluster).

Adding link to OpenShift maximums as I was not able to identify Kubernetes service maximum
This PR also closes #1031

@googlebot I fixed it.


text:
test: fix go linter install

Install with "go install" into .output/go/bin, instead of the local user's $GOPATH/bin.
The latest versions of go install respect GOPATH, but not GOBIN. But we can't set GOPATH as a global in the Makefile, otherwise we wouldn't be able to build, cache, and vendor using the system Go.

exciting change!

authors: karlkfi mikebz

repo: GoogleContainerTools/kpt-config-sync


text:
Use custom resource in advanced config

close https://github.com/GoogleContainerTools/kpt/issues/1498

I wonder if we can do something like below to have clearer interfaces. Other function developers in golang can follow this pattern when they need config in ConfigMap and CRD.
Let me know if this makes sense to you.
type SetAnnotationConfig interface {
	Transform([]*kyaml.RNode) error
}

type CRDForSetAnnotationConfig struct {
	metav1.TypeMeta   `json:",inline" yaml:",inline"`
	metav1.ObjectMeta `json:"metadata,omitempty" yaml:"metadata,omitempty"`

	Annotations map[string]string `json:"annotations,omitempty" yaml:"annotations,omitempty"`
	FieldSpecs  []types.FieldSpec `json:"fieldSpecs,omitempty" yaml:"fieldSpecs,omitempty"`
}

func (c *CRDForSetAnnotationConfig) Transform([]*kyaml.RNode) error { return nil }

type ConfigMapForSetAnnotationConfig struct {
	corev1.ConfigMap `json:",inline" yaml:",inline"`
}

func (c *ConfigMapForSetAnnotationConfig) Transform([]*kyaml.RNode) error { return nil }

func decode(in []byte) (SetAnnotationConfig, error) {
	type k8sObject struct {
		metav1.TypeMeta `json:",inline" yaml:",inline"`
	}
	var obj k8sObject
	if err := yaml.Unmarshal(in, &obj); err != nil { /*do something*/ }
	switch {
	case obj.APIVersion == "v1" && obj.Kind == "ConfigMap":
		var cmCfg ConfigMapForSetAnnotationConfig
		if err := yaml.Unmarshal(in, &cmCfg); err != nil { /*do something*/ }
		return &cmCfg, nil
	case obj.APIVersion == fnCRDConfigAPIVersion && obj.Kind == fnCRDConfigKind:
		var crdCfg CRDForSetAnnotationConfig
		if err := yaml.Unmarshal(in, &crdCfg); err != nil { /*do something*/ }
		return &crdCfg, nil
	}
	return nil, nil
}

func run(resourceList *framework.ResourceList) error {
	...
	fnConfigBytes := convertToBytes(resourceList.FunctionConfig)
	cfg, err := decode(fnConfigBytes)
	err = cfg.Transform(resourceList.Items)
	...
}

This LGTM, will do it.

@mengqiy @Shell32-Natsu Why should we accept configMap as an input ? Isn't that confusing for the users as to when to use what ? Instead, if each function has it's own crd for input config, it is more uniform and clear IMO.

@phanimarupaka Because in the pipeline, if user specifies the parameters via 'configMap', it will be converted to a ConfigMap. We have to support this case.

@mengqiy Please review again.

@phanimarupaka Because in the pipeline, if user specifies the parameters via 'configMap', it will be converted to a ConfigMap. We have to support this case.

Why should we allow users to pass parameters via configMap. I commented on the pipeline definition doc as well. It would be nice if there is single way to pass inputs to function. WDYT ?

@phanimarupaka Because in the pipeline, if user specifies the parameters via 'configMap', it will be converted to a ConfigMap. We have to support this case.

Why should we allow users to pass parameters via configMap. I commented on the pipeline definition doc as well. It would be nice if there is single way to pass inputs to function. WDYT ?

I think the reason is we want to provide a convenient way for uses to provide simple configs instead of forcing them to write a CRD for every function even when they don't want additional configs.

@Shell32-Natsu @phanimarupaka We need a broader discussion with @droot about if it should be a best practice for a function to support both ConfigMap and CRD. The decision is affected by the hydration design. We can discuss it offline if needed.
Supporting CRD in the functions in this PR is anyway needed.

authors: Shell32-Natsu mengqiy phanimarupaka


text:
fix git url parsing

fix https://github.com/GoogleContainerTools/kpt/issues/2936
Instead of blindingly looking for ".git" anywhere in the URL, use url.Parse to identify the path, and check for ".git" in the path.
I noticed the URL parsing code doesn't have any unit tests, so I added a couple.

@martinmaly I've updated the PR based on your and Sunil's feedback, would you mind taking another look while Sunil is OOO?

repo: GoogleContainerTools/kpt


text:
porch cli: command to reject deletion proposal of published packagerevs

This adds a way to reject a proposal of deletion of a published package revision (i.e. change the lifecycle from DeletionProposed back to Published) via a flag:
kpt alpha rpkg propose-delete --reject

We could alternatively have a separate command. For publishing package revisions, we have rpkg propose and rpkg reject; we could analogously something like have rpkg propose-delete and rpkg reject-delete. I chose the flag route because it seemed slightly cleaner and clearer, but I am open to suggestions.

Using a flag on the propose-delete command seems inconsistent with the existing UX. I can think of two other alternatives that I think I like better:

Let the reject command undo both proposed deletion and publishing. So the cli will just check the current state of the packagerevision and then chose to either move it back to draft or published.
If we want a flag for reject a proposed deletion, add that flag to the reject command rather than the propose-delete command.

The third option if of course to just add a separate reject-delete command, but it seems a bit unnecessary.

Using the reject command for both seems like the better UX to me.

Using the reject command for both seems like the better UX to me.

Will do! Ty @johnbelamaric and @mortent for the suggestions

authors: johnbelamaric mortent natasha41575


text:
update the the pdf template editor

There is lint warning, please fix those, also name and description need to add validation.

authors: athena-chen-chen solittlework

repo: GovAlta/adsp-monorepo


text:
docs: ✏ add documentation

Issues: #16

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

repo: Gpx/user-event

license: MIT


text:
Have to press ENTER for each session so cannot leave unattended

What happened:
The new "press ENTER, you are aware of this and will not ask for support in case of a crash." message appears for each session so cannot be left unattended.
I am using version 226.1.0.16.117 but GramAddict logs
INFO | Instagram version: not found
What you expected to happen:
If this message has to be displayed, then pressing ENTER once should allow the bot to run, sleep and resume without having to press ENTER again so that it can be left unattended and run for long periods of time.
And/or fix why it can't seem to determine what version of Instagram is installed on my connected phone.
How to reproduce it (as minimally and precisely as possible):
Anything else we need to know?:
Environment:

GramAddict version: 3.2.5
Device Model/Emulator Type: Samsung Galaxy S6
Android Version: 7.0
Instagram Version: 226.1.0.16.117
Discord Ticket ID:           *(if submitting crash log)

Relevant Logs:

*Note: if you have a crash log, please do not attach the archive here as this is not a secure place to upload the sensitive data inside. Please open a ticket in Discord in #lobby and provide the ticket ID here.

There is a parameter in config to use to avoid to press enter, please have a look at config-example folder in this github

Apologies, this does indeed resolve the issue for me.

authors: mastrolube theDustRoom

repo: GramAddict/bot


text:
Add support for setting video frame rate

Adds support to set fps of the video being recorded (Issue #51)
(Needs testing to check if the set fps actually reflects in the video across different devices, especially at 60 fps for devices that support it)

The video frame rate despite being set correctly doesn't seem to reflect on the video currently. We could merge this PR once this gets resolved on CameraX

The latest changes made in the recent release does fix the issue with uncertainties with lower ranges on my Pixel 7A. However, the issue still persists for 60 fps, where recording a video while choosing a 60-fps range (from the list of supported ranges reported by the library) doesn't make the fps of the recorded video close to the selected range.
Have filed an issue for the same on CameraX's issue tracker: https://issuetracker.google.com/issues/384146331

repo: GrapheneOS/Camera


text:
🛑 Server Gaming is down

In d937db7, Server Gaming (https://game.greathost.ro) was down:

HTTP code: 403
Response time: 1014 ms

Resolved: Server Gaming is back up in 621b996 after 1 minute.

repo: GreathostRo/upptime


text:
🛑 Server Gaming is down

In 9aec94f, Server Gaming (https://game.greathost.ro) was down:

HTTP code: 403
Response time: 1181 ms

Resolved: Server Gaming is back up in 7cb6573 after 2 minutes.


text:
bug report

Hello! Thank you for creating this unique mods in the new version of Minecraft. but when I used this mod, I found that it didn't completely hide the name tag (the name tag would appear whenever a block blocked my view, but the name tag would only disappear if I looked at the player)

After my testing, I found a conflict between your mods and EntityCulling, as long as I remove EntityCulling, ToggleNametags will work fine (completely hide name tags)
https://www.curseforge.com/minecraft/mc-mods/entityculling

Thanks for confirming this. I can't really do anything about this conflict unfortunately.

authors: Cirinmoran Greek

repo: Greek/ToggleNametags


text:
Add automated builds, testing

title

oooh yeah, that's easy.

Is the current automation work for builds and what did you mean by testing? Thanks.

Hey, this is not actually completed. There are still no automated tests.

How could we go about automating testing? All we can really does is syntax tests

What do you mean by syntax tests? I believe there is nothing preventing tests to be created, I just didn't really have the time to do it yet.

repo: GreenDiscord/vlc-rpc


text:
Test failures

Currently we have three failing tests on main. Two of them are easy to fix (see #82).
The test that still fails comes from line 218 of __init__.py where we expect four values to be returned by get_runtime_config (in configure.py) but that function returns six values. I think we just need to plumb in jobinfo and PU to __init__ but I'm not totally sure which way around the fix should go. Looks like some merge conflict resolution gone wrong to me. I think this is the cause of the error reported in #81.
While we're at it, I think the type hints in get_runtime_config are out of sync with the values that actually get returned (four rather than six types listed). It's not the only issue that mypy finds:
 cats/check_clean_arguments.py:31: error: Need type annotation for "info" (hint: "info: Dict[<type>, <type>] = ...")  [var-annotated]
cats/check_clean_arguments.py:31: error: Argument 1 to "dict" has incompatible type "list[tuple[str | Any, ...]]"; expected "Iterable[tuple[Never, Never]]"  [arg-type]
cats/check_clean_arguments.py:56: error: Expected keyword arguments, {...}, or dict(...) in TypedDict constructor  [misc]
cats/configure.py:50: error: Module has no attribute "eror"; maybe "error"?  [attr-defined]
cats/configure.py:67: error: Incompatible return value type (got "tuple[Mapping[str, Any], APIInterface, str, int, list[tuple[int, float]] | None, Any]", expected "tuple[dict[Any, Any], APIInterface, str, int]")  [return-value]
cats/configure.py:87: error: Missing return statement  [return]
cats/__init__.py:199: error: Incompatible types in assignment (expression has type "bytes", variable has type "CATSOutput")  [assignment]
cats/__init__.py:209: error: Missing return statement  [return]
Found 8 errors in 3 files (checked 10 source files)

Worth adding a mypy test to our CI? Worth setting github up to preclude merging / pushing onto main when the tests don't pass?

@andreww both of those are good ideas!

Possibly worth making the return type of get_runtime_config a TypedDict while at it - large tuples can be unwieldy.

@andreww both of those are good ideas!

In #82 I have added a mypy check step to the github actions and I have (just now) turned on the branch protection rule that mandates that the checks (linter, type checking, and test cases) pass before merging is allowed onto main. We can still bypass the branch protection rules (just like we could to avoid review) but this ought to stop main braking again. PRs will need to be "up to date" against main (so some rebasing / merging main into the feature branch may be needed). We can tweak this as needed.
That PR also fixes the "easy" mypy issues. Typing issues remain in two places. One is basically the same issue that causes the test case to fail. The other is validate_jobinfo - mypy doesn't like the way we pull the string apart. Probably easy to fix.

All dealt with by merge yesterday

authors: abhidg andreww

repo: GreenScheduler/cats


text:
Compatible with InfluxDB CLI - Support GZIP compression

What type of enhancement is this?
API improvement
What does the enhancement do?
Here is a related request:
2024/03/12 03:30:29
POST /v1/influxdb/api/v2/write?bucket=xxx-public&org=my-org&precision=s HTTP/1.1
Host: yyy.us-west-2.aws.greptime.cloud
User-Agent: influx/dev (darwin) Sha/none Date/2024-03-11T19:17:02Z
Transfer-Encoding: chunked
Accept: application/json
Authorization: Token uuu:ppp
Content-Encoding: gzip
Content-Type: text/plain
Accept-Encoding: gzip

Now we return:
2024/03/12 03:38:50
HTTP/2.0 400 Bad Request
Content-Length: 87
Access-Control-Allow-Credentials: true
Access-Control-Allow-Headers: DNT,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization
Access-Control-Allow-Methods: OPTIONS
Access-Control-Allow-Origin: *
Access-Control-Max-Age: 1728000
Content-Type: text/plain; charset=utf-8
Date: Mon, 11 Mar 2024 19:38:50 GMT
Strict-Transport-Security: max-age=15724800; includeSubDomains

Request body didn't contain valid UTF-8: invalid utf-8 sequence of 1 bytes from index 1

Implementation challenges
I suppose we should handle Content-Encoding header and use gzip if necessary.

Related InfluxDB CLI code:
// clients/write/write.go
		buf := bytes.Buffer{}
		gzw := gzip.NewWriter(&buf)
		_, err := gzw.Write(batch)
		gzw.Close()
		if err != nil {
			return err
		}

		req := c.PostWrite(ctx).Body(buf.Bytes()).ContentEncoding("gzip").Precision(params.Precision)

InfluxDB IOx related code:
// influxdbv3_server/src/http.rs
        // Unzip the gzip-encoded content
        use std::io::Read;
        let decoder = flate2::read::GzDecoder::new(&body[..]);

        // Read at most max_request_bytes bytes to prevent a decompression bomb
        // based DoS.
        //
        // In order to detect if the entire stream ahs been read, or truncated,
        // read an extra byte beyond the limit and check the resulting data
        // length - see the max_request_size_truncation test.
        let mut decoder = decoder.take(self.max_request_bytes as u64 + 1);
        let mut decoded_data = Vec::new();
        decoder
            .read_to_end(&mut decoded_data)
            .map_err(Error::InvalidGzip)?;

repo: GreptimeTeam/greptimedb


text:
refactor: unify the KvBackend

I hereby agree to the terms of the GreptimeDB CLA
What's changed and what's your intention?

Unify the KvBackend
Rename kv_store to kv_backend

Checklist

[ ]  I have written the necessary rustdoc comments.
[ ]  I have added the necessary unit tests and integration tests.

Refer to a related PR or issue link (optional)

@fengjiachun PTAL


text:
Support Filtering by multiple or filters

@yuanbohan Hi Yuanbo, I want to support or filter but even if I add something in promql.y I get the error "invalid promql query", I am new to yacc and I have used antlr before (anltr is relatively It's relatively simple, just modify the grammar definition, but yacc doesn't seem to work), so I hope you can give me some suggestions.
【victoriametrics or expression】

https://docs.victoriametrics.com/keyconcepts/#filtering-by-multiple-or-filters
【promql.y】
label_match_list -> Result<Matchers, String>:
                label_match_list COMMA label_matcher { Ok($1?.append($3?)) }
        |       label_match_list LOR label_matcher { Ok($1?.append($3?)) }  // support or filter
        |       label_matcher { Ok(Matchers::empty().append($1?)) }
;

【error】
expression：
a{label1="1" or label2="2"}
 Err("invalid promql query")

MetricsQL is an enhancement option, and our team has discussed it. But we have no plan to totally implement the extension, and have no milestone for it.
Thanks for your PR, and I will merge it if it works fine, as well as the test cases, and test coverage.

@yuanbohan
Thanks! Looking forward to the progress

I have one more small question. Why is it still not supported to use or connect lable_macher after making the following modifications?
before:
label_match_list -> Result<Matchers, String>:
                label_match_list COMMA label_matcher { Ok($1?.append($3?)) }
        |       label_matcher { Ok(Matchers::empty().append($1?)) }
;

after:
label_match_list -> Result<Matchers, String>:
                label_match_list COMMA label_matcher { Ok($1?.append($3?)) }
        |       label_match_list LOR label_matcher { Ok($1?.append($3?)) }
        |       label_matcher { Ok(Matchers::empty().append($1?)) }
;

cargo build success!

I have not tested yet, but I think it should be placed in label_matchers production
label_matchers -> Result<Matchers, String>:
                LEFT_BRACE label_match_list LOR label_match_list RIGHT_BRACE { $2 }
        |       LEFT_BRACE label_match_list RIGHT_BRACE { $2 }
        |       LEFT_BRACE label_match_list COMMA RIGHT_BRACE { $2 }
        |       LEFT_BRACE RIGHT_BRACE { Ok(Matchers::empty()) }
        |       LEFT_BRACE COMMA RIGHT_BRACE
                { Err("unexpected ',' in label matching, expected identifier or right_brace".into()) }
;

and maybe there SHOULD BE some special logic in inside_braces  for the LOR, maybe it is tokenized as identifier instead of the LOR token

@groobyming If you're trying this way as I mentioned above, you should notice that it's not exactly tested.
LEFT_BRACE label_match_list LOR label_match_list RIGHT_BRACE { $2 }

NOTE the tail part, the { $2 } is wrongly typed, and you MUST change it

fixed by #84

authors: groobyming yuanbohan

repo: GreptimeTeam/promql-parser


text:
Sort temporary fields in GT backends

Description
This PR sorts the temporary fields in the GT backends by name to ensure that the same code is generated each time a stencil is compiled for reproducibility.
Before submitting this PR, please make sure:

[x] The code builds cleanly without new errors or warnings
[x] The code passes all the existing tests
[x] If this PR adds a new feature, new tests have been added to test these
new features
[x] All relevant documentation has been updated or added

Thank you very much, @egparedes!

This was previously a single line commit and now there are 18 files modified. If you have time, could you try to merge/rebase on the current master again or open a new PR with the single line fix starting from master?

My apologies, I was attempting to resolve the formatting issues and made the issue worse. I will create a new PR.

authors: eddie-c-davis egparedes


text:
New data_kbuff directive v2

This PR implements the possibility to serialize data inside a k-blocked region of code. It buffers data(:,:,k) for each k-iteration and serializes data(:,:,:) out once a field is completely filled.

Minor cleanup and making consistent of existing code.
New Fortran file utils_ppser_kbuff.f90 that implements the buffering functionality (currently for 3d sp, dp, int fields and only in write mode).
New !$ser data_kbuff k_value=k k_size=nz name=field(:,:) that can be used as a drop-in replacement of !$ser data name=field(:,:,:) but within a k-loop.
Update of documentation.
Minor cleanup of pp_ser.py (should have no impact on any of the users)

It implements all changes requested by @havogt in #220. This is a new PR since the other one was made from master, which was a very bad idea.

looks good to me ! I did not look at what is wrong with the test

Re the Travis test: Not sure what is happening there as well. @havogt Is this an issue on Travis CI? has master been building successfully all the time?

Seems to be a travis issue. I restarted the build and other combinations failed. Now running the master.

launch jenkins

launch jenkins

authors: havogt lxavier ofuhrer

repo: GridTools/serialbox


text:
Move command with a different slot causes a TTL exhausted.

While testing a redis cluster I discovered some strange behaviour, which I am unsure where the bug lies.
The issue is when a move response is returned with another slot than the one decided in the  execute in the StrictRedisCluster:
The issue is the following code snippet in the execute_method in StrictRedisCluster:
@clusterdown_wrapper
def execute_command(self, *args, **kwargs):
...
a)     slot = self._determine_slot(*args)
while ttl > 0:
if asking:
...
else:
if self.refresh_table_asap:
# MOVED
b)                  node = self.connection_pool.get_master_node_by_slot(slot)
else:
node = self.connection_pool.get_node_by_slot(slot)
c)              r = self.connection_pool.get_connection_by_node(node)
        try:
            ...

d)              r.send_command(*args)
e)              return self.parse_response(r, command, **kwargs)
...
except MovedError as e:
# Reinitialize on ever x number of MovedError.
# This counter will increase faster when the same client object
# is shared between multiple threads. To reduce the frequency you
# can set the variable 'reinitialize_steps' in the constructor.
self.refresh_table_asap = True
self.connection_pool.nodes.increment_reinitialize_counter()
f)                node = self.connection_pool.nodes.set_node(e.host, e.port, server_type='master')
g)                self.connection_pool.nodes.slots[e.slot_id][0] = node
What we have seen is follows:
a slot is computed on the client and return let us say slot s1... item a)
node n1 is resolved by mapping the master slot of s1 to a node... item b)
and connection is resolved from n1... item c)
request is sent... item d)
the response is parsed which is a move command with slot s2 and node n2 and an exception is thrown ... item e)
a new node n3 will be created with the information from the exception... item f)
the slot n2 is not updated with the n3 node.
and everything is retried again.
The slot is calculated to s1, which then is resolved to n1
What I think should happen is either:

s1 should be resolved to n3
2 the slot variable should be updated to contain the s2 value

What seem quite strange around this is that the server and the client do not compute to the same slot.
a key which basically is a json string, which contained a lot of curly braces, which may have been the issue.
But if solution 1 is correct it means that line g:
self.connection_pool.nodes.slots[e.slot_id][0] = node
has to be corrected to self.connection_pool.nodes.slots[slot_id][0] = node
If solution 2 is correct
Then following line should be added after g:
slot = e.slot_id
I am unsure if one should follow what the server responds or the client should follow what it has?

Basically, without any solid steps to reproduce the problem and what data/state your cluster was in before the problem and after the problem, i will have a hard time to really determine anything of this as i assume as the code is right now it works as expected and that it does correct and that your end have got into a wired state or edge case that was not intended to be in, so without the cluster state at least before and after your moved error started to happen, i can't really say anything. You might have some wired case of splitbrain that caused this, i dunno really.

Hi
The cluster was rebooted and the hash slot was was not matching between the server and the client. So it is already from the server starts.
I have submitted a bug to https://github.com/antirez/redis/issues/6027
However I think the python library could be improved by taking into the account the that the slot has been moved to another node, and thereby be more robust and save a round trip.
Enterprise redis 5.4.0-19 has been used for the cluster
In order to reproduce the issue:
Restart a new cluster
Execute following script:
    client = StrictRedisCluster.from_url(url="redis://redis-xx:13893")
    client.set("{'1':{'i32':1}}", "a")

Actual result: rediscluster.exceptions.ClusterError: TTL exhausted. is thrown
Expected result: The client is trying to use the other slot, which the server has been indicated is the right slot, and the operation was applied to that server and no exception occurred

@mat013 As i mentioned in the linked issue i do think that the problem is with Redis Enterprise as i have reviewed the keyslot algorithm i have here and it is according to spec and performs as i expect and according to the spec. You need to get this problem cross verified that it is an issue with Enterprise Redis as i do not think it is a problem with this lib.

Also on a technical side-note. Nothing but vanilla redis is "officially" supported. Yes if you follow the ABI/API of redis is shold work, but we probably have proof here that it do not.

But even though the problem has not been reproducable in the community edition of Redis IMHO I think that rather than raising a TTL exhausted exception(which IMHO is not correct because the server has indicated that another node should be used, however the client never tries the other node) the behaviour of the library could be improved as the redis protocol actually supports trying another server also in case that the hash_slot is not agreed between the client and server.
If the line is added as suggested i.e.
slot = e.slot_id
I would think the library would work in both cases i.e. when the hash_slot is agreed between the client and the server and when it not agreed.
So why not support both cases because protocol actually leaves the possibility.
I would be happy to make a PR if you think this would be an improvement

No the behaviour of the library is Correct as it tries to determine the hash of the slot and it gets the slot number that the spec and vanilla redis says it should be, see my reproduce in the redis ticket. The lib gets the same slots as the redis server outputs.
The TTL exchausted is a consequence of a missmatch between what the cluster says is a MOVED error and what the client thinks is right. And even if i change it to trust what the cluster says is true, it will still fail out as the client lib will not magically change what slot it thinks the key belongs to. And the client lib should not save any data on what key is routed to what node. It should save the node layout yes, but not some magic rebind table that a keyslot output from this lib should be translated to something that the server side says.
Please do try to add that line you have and make some tests to prove me wrong, then i will consider it, but i need proof of it first that that kind of change really works in both cases.
But i still argue/stand that your redis server is the problem, not the lib and the server should correct it's fault to comply with the spec.

I agree it the problem is on the server, and I have submitted a bug. But as it stands right now I do not think you can work around the issue  unless the mapping between the hash slot and nodes are modified manually, which I thin would be a hack
I will need a colleague of mine to do the test it as I do not have the necessary access, and I am effectively on holiday so it may take 3 weekhowever I can give concrete examples when it fails and what would fix it and how it will work when adding the fix,
My fix makes the assumption that the MOVE operation whenever the client and the server both agree
on the hash_slot then that will be returned as part of the MOVE response, but I think that would be a fair assumption.
So given the code is as follow:
a) slot = self._determine_slot(*args)
while ttl > 0:
if asking:
...
else:
if self.refresh_table_asap:
MOVED
b) node = self.connection_pool.get_master_node_by_slot(slot)
else:
node = self.connection_pool.get_node_by_slot(slot)
c) r = self.connection_pool.get_connection_by_node(node)
    try:
        ...

d) r.send_command(*args)
e) return self.parse_response(r, command, **kwargs)
...
except MovedError as e:
Reinitialize on ever x number of MovedError.
This counter will increase faster when the same client object
is shared between multiple threads. To reduce the frequency you
can set the variable 'reinitialize_steps' in the constructor.
self.refresh_table_asap = True
self.connection_pool.nodes.increment_reinitialize_counter()
f) node = self.connection_pool.nodes.set_node(e.host, e.port, server_type='master')
g) self.connection_pool.nodes.slots[e.slot_id][0] = node
h) slot = e.slot_id
Line H is the one I intended to add
Supposedly we do not have line H and given we have two nodes one having 100.100.100.100 and the other 200.200.200.200
The mapping between hash slot to node used in line b) is
...
[10000] = 100.100.100.100.100
[20000] = 100.100.100.100.100
We imagine that the correct node for hash_slot 10000 should be on 200.200.200.200 but our for some reason the mapping do not match what is on the server
What we have seen is that following:
in line a) slot = 10000
in line b) node = 100.100.100.100
in line c) the connection to 100.100.100.100 is returned
in line d-e) the request is sent and answer is received where a MOVE response has been returned with the port 20000 and 200.200.200.200
in line f) a new node is being created with the ip 200.200.200.200
in line g) the index [20000] is now set to 200.200.200.200
Everything will be repeated until TTL is exhausted because index 20000 is updated but the slot we look at is 10000
If line h) was added then
In the case client and server agree on the hash slot then
in line a) slot = 10000
in line b) node = 100.100.100.100
in line c) the connection to 100.100.100.100 is returned
in line d-e) the request is sent and answer is received where a MOVE response has been returned with the port 10000 and 200.200.200.200
in line f) a new node is being created with the ip 200.200.200.200
in line g) the index [10000] is now set to 200.200.200.200
in line h) slot is assigned to 10000 (so effectively the slot did not change)
2nd iteration
in line a) slot = 10000
in line b) node = 200.200.200.200
in line c) the connection to 200.200.200.200 is returned
in line d-e) the request is sent and answer is OK
In the case client and server do not agree on the hash slot then
in line a) slot = 10000
in line b) node = 100.100.100.100
in line c) the connection to 100.100.100.100 is returned
in line d-e) the request is sent and answer is received where a MOVE response has been returned with the port 20000 and 200.200.200.200
in line f) a new node is being created with the ip 200.200.200.200
in line g) the index [20000] is now set to 200.200.200.200
in line h) slot is assigned to 20000
We do another iteration
in line a) slot = 20000
in line b) node = 200.200.200.200
in line c) the connection to 200.200.200.200 is returned
in line d-e) the request is sent and answer is OK

repo: Grokzen/redis-py-cluster


text:
Not stable for SetRGB/temperature/brightness

adjust the temperature & brightness many times,  it will shows the error info "UnhandlePromiseRejectionWarning: Unhandled promise rejection (rejection id: xx) [object object]"
In addition, cannot right set correct color with "colour picker" node for SetRGB

Thanks for report. Will dig into it  next week.

Hi. There is critical issue for yeelight IP address. For example, the yeelight connect AP and assigned 192.168.1.86, we can command yeelight. But the network is shutdown or AP is shutdown, the node-red will crash. I think the code should add exception function to handle the network issue.
BR,
Chris

Could you try the latest version?

Dears,
I will try the latest version. Also find the node-red crash issue that is yeelight is offline or AP is shutdown. For example, the yeelight assigned by AP is 192.168.1.150, when AP shutdown or yeelight offline, the node-red crash and cannot running. I believe maybe should add exception handle the issue.
Best Regards,
Chris
发件人: Alexander Sorokin [mailto:notifications@github.com]
发送时间: 2017年12月4日 15:23
收件人: Gromina/node-red-contrib-yeelight node-red-contrib-yeelight@noreply.github.com
抄送: Chris Tang Chris.JJ.Tang@jci.com; Author author@noreply.github.com
主题: Re: [Gromina/node-red-contrib-yeelight] Not stable for SetRGB/temperature/brightness (#1)
Could you try the latest version?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FGromina%2Fnode-red-contrib-yeelight%2Fissues%2F1%23issuecomment-348879938&data=02|01|chris.jj.tang%40jci.com|2885baf10cfb49b6404208d53ae7e753|a1f1e2147ded45b681a19e8ae3459641|0|0|636479690052311798&sdata=hxdg7ZandjFJvZIBvPDidxWEeA%2FC6YNdZbdEzhozKzg%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAe4iDXizjzGbLrnJdgl3-0of6yMV29p_ks5s853qgaJpZM4PoRol&data=02|01|chris.jj.tang%40jci.com|2885baf10cfb49b6404208d53ae7e753|a1f1e2147ded45b681a19e8ae3459641|0|0|636479690052311798&sdata=jWToaGflxpyGpixKMpikM9fhQ4%2FPxR7qixScnfFdxHI%3D&reserved=0.

Dears,
I test it by latest version but crash issue still exist. Attach crash graphic for reference.
[cid:image001.png@01D36D51.734310F0]
Best Regards,
Chris
发件人: Chris Tang
发送时间: 2017年12月4日 17:08
收件人: 'Gromina/node-red-contrib-yeelight' reply@reply.github.com; Gromina/node-red-contrib-yeelight node-red-contrib-yeelight@noreply.github.com
抄送: Author author@noreply.github.com
主题: 答复: [Gromina/node-red-contrib-yeelight] Not stable for SetRGB/temperature/brightness (#1)
Dears,
I will try the latest version. Also find the node-red crash issue that is yeelight is offline or AP is shutdown. For example, the yeelight assigned by AP is 192.168.1.150, when AP shutdown or yeelight offline, the node-red crash and cannot running. I believe maybe should add exception handle the issue.
Best Regards,
Chris
发件人: Alexander Sorokin [mailto:notifications@github.com]
发送时间: 2017年12月4日 15:23
收件人: Gromina/node-red-contrib-yeelight <node-red-contrib-yeelight@noreply.github.commailto:node-red-contrib-yeelight@noreply.github.com>
抄送: Chris Tang <Chris.JJ.Tang@jci.commailto:Chris.JJ.Tang@jci.com>; Author <author@noreply.github.commailto:author@noreply.github.com>
主题: Re: [Gromina/node-red-contrib-yeelight] Not stable for SetRGB/temperature/brightness (#1)
Could you try the latest version?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FGromina%2Fnode-red-contrib-yeelight%2Fissues%2F1%23issuecomment-348879938&data=02|01|chris.jj.tang%40jci.com|2885baf10cfb49b6404208d53ae7e753|a1f1e2147ded45b681a19e8ae3459641|0|0|636479690052311798&sdata=hxdg7ZandjFJvZIBvPDidxWEeA%2FC6YNdZbdEzhozKzg%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAe4iDXizjzGbLrnJdgl3-0of6yMV29p_ks5s853qgaJpZM4PoRol&data=02|01|chris.jj.tang%40jci.com|2885baf10cfb49b6404208d53ae7e753|a1f1e2147ded45b681a19e8ae3459641|0|0|636479690052311798&sdata=jWToaGflxpyGpixKMpikM9fhQ4%2FPxR7qixScnfFdxHI%3D&reserved=0.

I've also had the same issue, when the light is offline, i.e. power is switched off, node-red will crash. The light in this example is found at 192.168.30.49 but is offline:
Dec  7 10:26:52 raspberrypi Node-RED[28092]: 7 Dec 10:26:52 - [red] Uncaught Exception: Dec  7 10:26:52 raspberrypi Node-RED[28092]: 7 Dec 10:26:52 - Error: connect EHOSTUNREACH 192.168.30.49:55443 Dec  7 10:26:52 raspberrypi Node-RED[28092]: at Object.exports._errnoException (util.js:1020:11) Dec  7 10:26:52 raspberrypi Node-RED[28092]: at exports._exceptionWithHostPort (util.js:1043:20) Dec  7 10:26:52 raspberrypi Node-RED[28092]: at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1090:14) Dec  7 10:26:52 raspberrypi systemd[1]: nodered.service: main process exited, code=exited, status=1/FAILURE Dec  7 10:26:52 raspberrypi systemd[1]: Unit nodered.service entered failed state. Dec  7 10:26:52 raspberrypi systemd[1]: nodered.service holdoff time over, scheduling restart.

Hi,
Please find the "index.js" on C:\Users\xxxx\node_modules\yeelight2 and edit "//    this.emit('error', err);" on Line 45. I believe can solve the issue.
BR,
Chris

Thanks Chris, but nope, still the same issue

Hi,
I attach index.js file you can replace it on C:\Users\xxxx\node_modules\yeelight2
P.S. Please change the name index.bak to index.js firstly.
Best Regards,
Chris
发件人: glennss [mailto:notifications@github.com]
发送时间: 2017年12月12日 1:15
收件人: Gromina/node-red-contrib-yeelight <node-red-contrib-yeelight@noreply.github.commailto:node-red-contrib-yeelight@noreply.github.com>
抄送: Chris Tang <Chris.JJ.Tang@jci.commailto:Chris.JJ.Tang@jci.com>; Author <author@noreply.github.commailto:author@noreply.github.com>
主题: Re: [Gromina/node-red-contrib-yeelight] Not stable for SetRGB/temperature/brightness (#1)
Thanks Chris, but nope, still the same issue
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FGromina%2Fnode-red-contrib-yeelight%2Fissues%2F1%23issuecomment-350792013&data=02|01|chris.jj.tang%40jci.com|8ade7b7508024e70f1a608d540babc9e|a1f1e2147ded45b681a19e8ae3459641|0|0|636486093123539341&sdata=nME0v1DpI9kHqtedylz99gQWSABTlJNRomXZAvtUXOo%3D&reserved=0, or mute the threadhttps://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAe4iDbDpi5TN9dBX8u_yk6ncOx0tb8m9ks5s_WMbgaJpZM4PoRol&data=02|01|chris.jj.tang%40jci.com|8ade7b7508024e70f1a608d540babc9e|a1f1e2147ded45b681a19e8ae3459641|0|0|636486093123539341&sdata=WUMWu347f5ecf%2FXkfNdAevPFLHRxJ9ESPQwGIK5S68A%3D&reserved=0.

Hey,
I can confirm the issue with SetRGB and Colour Picker. Already got the latest version of node-red-contrib-yeelight along with Colour Picker in "Format: hex" and it's just changing the color to blue, but no other color.
Thank you for your help :)

repo: Gromina/node-red-contrib-yeelight


text:
Feat/add database entities

Criação das entidades e migrations da aplicação.
Foi concluido a criação das entidades e migrations com sucesso.
Solicitante(s) da tarefa
Kayke Fujinaka
Card(s) da tarefa

Criação das tabelas no banco de dados

Checklist
Você realizou o code review do seu próprio PR?

[x] Sim
[ ] Não

Necessário seguir alguma ordem de deploy (ex: aceitar outro PR antes)?

[ ] Sim
[X] Não

Testes que precisa ser realizado para aprovação do PR

[X] Produtos
[ ] Ux/Ui
[ ] QA

Responsáveis pelos testes QA:

Kayke Fujinaka

OBS Ao usar "path maping" nos arquivos de entidades, a nova versão do TypeORM não consegue ler, por isso que tive que retirar!

repo: Grupo-GCB/expense-tracker-backend


text:
set fakePlayerResident to true but didn't work

Fake players disappear when server restart, even fakePlayerResident set to true.
Besides, I checked logs that shows
"User <uuid> - <fakeplayername> doesn't currently have data pre-loaded - denying login."
when a fake player is being spawned. Don't know whether this is related to this issue.
Game version: 1.20.1
Mod version: 2.7.0

the same pb

the same pb

经过测试 是2.7.0的假人控制模组会出现这个bug，回退到2.6.0就没有这个问题了。

谢谢，已经提前回退了。
------------------ 原始邮件 ------------------
发件人: @.>;
发送时间: 2023年7月31日(星期一) 晚上6:55
收件人: @.>;
抄送: @.>; @.>;
主题: Re: [Gu-ZT/gugle-carpet-addition] set fakePlayerResident to true but didn't work (Issue #30)
经过测试 是2.7.0的假人控制模组会出现这个bug，回退到2.6.0就没有这个问题了。
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: @.***>

repo: Gu-ZT/gugle-carpet-addition


text:
[Feature]: Option to disable the default Markdown attributes

What happened?
Haha sorry, me again ;-)
Thank you for adding the option to set classes for the article! However, the default attributes now mess with the appearance. I have added prose, but (for instance) headings are off because they are overruled by the defaults. Of course I can target them in my custom css, but that kind of defeats the purpose of the option to set your own classes.
I would like to propose that no defaults are being set if any custom classes are present, or something like that.
Sorry for keeping you busy ;)
How to reproduce the bug
See title
Package Version
latest
PHP Version
latest
Laravel Version
latest
Which operating systems does with happen with?
No response
Notes
No response

The issue is that this then collides with all other defaults like the Code Syntax Highlighting. I have added Alpine stuff, such as the copy to clipboard action, that I would need to remove also in that case.

Does the Alpine stuff also target styling or is it only the class name thats used? (diving in to source now)

I wrap it inside a container and I apply the styling on the container. The inner code block is render via shiki. But the tailwind prose thingy targets the code blocks, so it adds margins inside the code block, wheares I add the margins on the container, since the container adds that header with the language name and the action.

Hmm I see.
But to disable defaults for H, P, TABLE and BLOCKQUOTE only is not an option?

It is, but then you'll have a huge margin inside the code block. Because the prose class will add it inside the container.

Hmm I see.
But to disable defaults for H, P, TABLE and BLOCKQUOTE only is not an option?

It is, but then you'll have a huge margin inside the code block. Because the prose class will add it inside the container.

Personally I don't have a use for code blocks (yet) so I'm not really bothered by that. But I can imagine others are.
I'd say I'd rather then target the code block specifically to remove something when using prose, instead of having to target multiple elements just to add or overrule something :)

Well in that case I'll add a disableDefaultClasses or something similar to the KB panel. :)

Well, what if you put the classes in the config? That way you don't have to disable anything. People can just remove stuff there.

Well in that case I'll add a disableDefaultClasses or something similar to the KB panel. :)

Well, what if you put the classes in the config? That way you don't have to disable anything. People can just remove stuff there.

That would add yet another directory you need to add to your Vite Theme that would check for Tailwind Classes. I'm already unhappy with having to go through both resources and src :D

Ah, valid point!
disableDefaultClasses() would be a better choice then :)

Added in version 1.4.0. :)

Added in version 1.4.0. :)

Perfect, thanks! 💪🏽
But you know I'm gonna come back with more, right? 😅

Lol, I'm already looking forward to it :-)

authors: gavinhewitt lukas-frey

repo: GuavaCZ/filament-knowledge-base


text:
GitHub Actions for React

Is your feature request related to a problem? Please describe.
It's important to have testing of the boilerplate code, so that we can always check it's compatibility with different versions
Describe the solution you'd like
GitHub Action to test the React Boilerplate code with Node 14 and Node 15
Additional context
None

I would like to be assigned to this


text:
Discord server

When click on the link for the Discord server, I get an "Invalid Invalid" error from Discord. (This invite may be expired, or you might not have permission to join).

Thanks for the issue report! I've replaced the link with one that doesn't expire: https://discord.gg/7tSq5EaA6Z


text:
Create wireframes for trainee's user journey

We have already defined the first user stories for trainees. It is a good starting point for creating wireframes for their user journey.
Use a tool of your choice to draw wireframes. Wireframes should represent the user journey and not visual design. Think how a user moves from one screen to another and where they can find the desired information and actions.
Acceptance criteria

Wireframes must cover all defined user stories
Place a link or images in a comment when completed

authors: PaulinaWywrot alexeyschepin

repo: H-BAHDON/class-of-our-own


text:
🛑 H2 invent Support is down

In 7fcdb3a, H2 invent Support (https://supportchat.h2-invent.com) was down:

HTTP code: 502
Response time: 3856 ms

Resolved: H2 invent Support is back up in f3b5df0 after 16 minutes.


text:
Home assistant autodiscovery not working - 0.7.0

Version of the custom_component

0.7.0
Describe the bug
The home assistant does not detect the display that I have connected using MQTT.
Model: wt32-sc01-plus_8MB
OpenHASP version: 0.6.4-dev a4f1fdd
Home Assistant 2023.1.7
Supervisor 2023.01.1
Operating System 9.5
Frontend 20230110.0 - latest
Mosquitto broker - 6.1.3 (home assistant add-on) - protocol version 5 (but with 3 is the same)
I checked the communication between MQTT and the display. Everything is fine. Through MQTT Explorer everything seems fine.
But I don't see it in it doesn't appear in devices and services.
I have several other devices that communicate via MQTT without issue.
I was only able to see this error when calling OpenHASP from Devices and services.
If there is anything else I need to do to resolve a problem, I am available.
Thanks in advance!
Debug log

2023-01-28 19:08:51.301 INFO (MainThread) [custom_components.openhasp.config_flow] Discovery Only
2023-01-28 19:08:53.464 ERROR (MainThread) [homeassistant] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/util/logging.py", line 154, in async_wrapper
    await async_func(*args)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/discovery.py", line 306, in async_integration_message_received
    result = await hass.config_entries.flow.async_init(
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 229, in async_init
    flow, result = await task
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 256, in _async_init
    result = await self._async_handle_step(flow, flow.init_step, data, init_done)
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 374, in _async_handle_step
    result: FlowResult = await getattr(flow, method)(user_input)
  File "/config/custom_components/openhasp/config_flow.py", line 89, in async_step_mqtt
    _discovered = json.loads(discovery_info.payload)
  File "/usr/local/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.10/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Invalid control character at: line 1 column 141 (char 140)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/util/logging.py", line 156, in async_wrapper
    log_exception(format_err, *args)
  File "/usr/src/homeassistant/homeassistant/util/logging.py", line 115, in log_exception
    friendly_msg = format_err(*args)
  File "/usr/src/homeassistant/homeassistant/components/mqtt/client.py", line 243, in <lambda>
    f"Exception in {msg_callback.__name__} when handling msg on "
AttributeError: 'functools.partial' object has no attribute '__name__'

_discovered = json.loads(discovery_info.payload)

It seems to error out decoding the discovery message. What is the exact payload of the discovery message?

I have this:
{"node":"plate35","mdl":"SC01 Plus","mf":"openHASP","hwid":"68b6b3369e34","pages":12,"sw":"0.6.4-dev","uri":"http://10.10.11.44","input":{"{<":[1]},"power":[],"light":[],"dim":[]}
After "input" I see strange characters, but I don't know where they are from.

That seems like a bug. What is the configuration of the GPIO pins?

In notepad++, the unknown characters are seen like this: "SUBETB<ENO"
I only have this:
pin 1 push button group 1 "normally open"
"gpio": {
"config": [
2196766977,
262670,
0,
0,
0,
0,
0,
0
]
}

authors: fvanroie mishomvp

repo: HASwitchPlate/openHASP-custom-component


text:
Dcos support

Pull request to further improve HSDS cluster resiliency on DCOS during scale up and scale down.

Thanks @s004pmg!

repo: HDFGroup/hsds


text:
🛑 SkipTheTrailers is down

In 929c99f, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in 0ebbaa7.

repo: HDVinnie/TrackerHub


text:
🛑 SkipTheCommericals is down

In fd6a52b, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in e47bcc4.


text:
🛑 SkipTheCommericals is down

In 2cc8b77, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 262d950.


text:
🛑 SkipTheCommericals is down

In c5f1791, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 4e9e5b8.


text:
🛑 SkipTheCommericals is down

In d60c6e2, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in c6a9ed0.


text:
🛑 SkipTheTrailers is down

In d1075ac, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in 7457c6a.


text:
🛑 Telly is down

In 671248f, Telly ($TLY) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Telly is back up in 142ba8a.


text:
⚠ PrivateHD has degraded performance

In 63157f6, PrivateHD ($PHD) experienced degraded performance:

HTTP code: 200
Response time: 3968 ms

Resolved: PrivateHD performance has improved in 3718262.


text:
🛑 Telly is down

In 1138070, Telly ($TLY) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Telly is back up in cc0876f.


text:
🛑 SkipTheCommericals is down

In 92f1e01, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 21200a4.


text:
🛑 SkipTheTrailers is down

In f928204, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in a97d07c.


text:
🛑 SkipTheCommericals is down

In 3016f2a, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 6c258ef.


text:
🛑 SkipTheCommericals is down

In 3bf7290, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 6fe4096.


text:
⚠ SceneTime has degraded performance

In 7893d55, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1911 ms

Resolved: SceneTime performance has improved in e50269d after 7 minutes.


text:
🛑 SkipTheTrailers is down

In 0aeea08, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in aa6f758.


text:
🛑 Telly is down

In a838395, Telly ($TLY) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Telly is back up in 55ff906.


text:
🛑 SkipTheCommericals is down

In 8e6333d, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 2bb72ce.


text:
🛑 SkipTheTrailers is down

In 2b0c194, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in be6ad94.


text:
🛑 SkipTheTrailers is down

In 82f9418, SkipTheTrailers ($STT) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheTrailers is back up in 1f659da.


text:
🛑 SkipTheCommericals is down

In 93c0349, SkipTheCommericals ($STC) was down:

HTTP code: 0
Response time: 0 ms

Resolved: SkipTheCommericals is back up in 293a380.


text:
Release file naming

The release file names should have the pattern  "ResourceType-id.json"  and the "id" portion has to be an exact string match to the value in the "id" filed in the JSON object.  "ResourceType" is CodeSystem, ValueSet, etc.
Also, the "id" value has to pass: http://hl7.org/fhir/datatypes.html#id
CodeSystem-CompLOINC.json in the 1-9 release does not follow this pattern.

@joeflack4 I still see an issue with file names vs resource id.
For example: CodeSystem-so.json   has resource id "CodeSystem-so".  The resource id in this case should be "so".

repo: HOT-Ecosystem/owl-on-fhir-content


text:
Autocompletion löscht Zeile nicht

CRLF FTW. Müssen gleich noch ein paar MAC-Tests machen.

Mac-Test:

weniger screenshorts, mehr debugging.

license: mit


text:
HTML 2.1: UI, Icon, QRC icon should say HRC

From @coblassa Telegram user:
I think 'QRC' is the wrong word and 'HRC' is the correct word.
https://github.com/HTMLCOIN/HTMLCOIN/blob/master-2.1/src/qt/res/icons/qrctoken.png

This is now fixed in the 2.2.0 release, thanks for the report, it did not go unnoticed.

repo: HTMLCOIN/HTMLCOIN


text:
バッチ処理の計算量改善

WHAT
https://github.com/HUITGroup/member-bot/blob/main/batch.go#L45
ここで serchRoleMembers たくさん呼んでいるので、計算量改善の余地があると思います。
現状、

n := ギルドのメンバー数
m := ギルド全体のロール数
k := 個人が持つロール数の最大値

として、O(nmk) の時間がかかっています。
これを O(nk + m) に改善します。
処理対象のメンバーは、

本日退会のメンバー
明日退会予定のメンバー
一週間後退会予定のメンバー

の三種類なので、それぞれに対して serchRoleMembers を呼んで、よしなに処理をすればいいです。
何らかの不具合で、kick されるべきメンバーが漏れてしまい、過去の時刻を role として持つメンバーが残った場合、ずっと kick されないという問題があります。
これは別処理で、O(m) かけて、過去の時刻を role として持つメンバーが存在しないか確認しましょう（このような状況が生じるのは正常系ではないので、計算量としては考えないことにします）

まだ改善できてないので、今後行います

authors: monkukui shoumoji

repo: HUITGroup/member-batch


text:
Add a hash function for HXL documents

Add a function to produce a hash over a HXL document, including

Text headers (row immediately before hashtags)
Hashtags
Content

Output would look something like this:
{
	"url": "http://example.org/data.csv",
	"datestamp": "2018-11-13T07:00:00-05:00",
	"md5": "689DX...",
	"rows": 187,
        "headers": ["Females affected", "District name", "District P-code", "Responding org"],
	"hashtags": ["#affected+f", "#adm1+name", "#adm1+code", "#org"]
}

Requested by @SimonbJohnson to support HXL analysis workflow.

Clarification from @SimonbJohnson (via email) -- he's looking for a hash of just the headers and hashtags, not the data.

Also to do: add a command-line utility hxlhash to make it easy to use this functionality in shell scripts.

Added a data_hash property to hash the entire dataset.
Added a hxlhash command-line utility.
$ hxlhash sample-data.csv
51f6e9b29f943d381938400f1062a0c2
$ hxlhash --headers-only sample-data.csv
3252897e927737b2f6f423dccd07ac93

On to HXLStandard/hxl-proxy#249 now for web API support.

repo: HXLStandard/libhxl-python

license: unlicense


text:
[Bug]: Agent startup depends on tools.jar?

Preflight Checklist

[X] I agree to follow the Code of Conduct that this project adheres to.
[X] I have searched the issue tracker for an issue that matches the one I want to file, without success.
[X] I am not looking for support or already pursued the available support channels without success.

Version
1.0.0
Installation Type
Other (specify below)
Service Name
DongTai-Engine
Describe the details of the bug and the steps to reproduce it
OS：Ubuntu 20.04.2 LTS
JDK：

Run：

Error：
Not Running with JDK!
Additional Information
Agent code：

But since In JDK 9 and later，Removed rt.jar and tools.jar

Logs
No response

duplicate

repo: HXSecurity/DongTai


text:
GPTQ Support [Cont.]

This PR enables loading GPTQ quantized models and running weight-only quantized inference on HPU. For a previous discussion, see #421.

Awaiting legal input on licensing

authors: maktukmak michalkuligowski

repo: HabanaAI/vllm-fork


text:
removed background image to avoid using twice while it should use in …

…whole page.
Description
Removed background image.since we use this image for whole page.
Fixes # (issue Profile Quiz Results #108)
How to test?
npm run storybook
Checklist

[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] This PR is ready to be merged and not breaking any other functionality

Good job @soujanyapolavarapu!

Thankyou @sofiiadidovych

Seems good :)

Thank you @valmdz

repo: HackYourFuture-CPH/Guide-IT


text:
Module computers-and-developers completed

Module computers-and-developers completed

ok

repo: HackYourFutureBelgium/bf-welcome-to-js


text:
Example code for Date Range Picker?

Where is example code for Date Range? https://hacker0x01.github.io/react-datepicker/#example-13
It is not clear how it works and how to make it work.
What this.handleChangeStart should do?
What this.handleChangeEnd should do?
What for are selectsStart and selectsEnd? What do they do?
<DatePicker
selected={this.state.startDate}
selectsStart
startDate={this.state.startDate}
endDate={this.state.endDate}
onChange={this.handleChangeStart} />

<DatePicker
selected={this.state.endDate}
selectsEnd
startDate={this.state.startDate}
endDate={this.state.endDate}
onChange={this.handleChangeEnd} />

All examples are at https://github.com/Hacker0x01/react-datepicker/tree/master/docs-site/src/examples

Thanks.
However, it is actually confusing. You have examples directory in plugin's root directory examples/hello-world. And there is only one example there. And one might have no idea to check other directories for examples.

I hear you; one improvement could be to add links to the code next to each of the examples on the docs site.  PRs for improvements are welcome

https://github.com/Hacker0x01/react-datepicker/blob/master/docs-site/src/examples/date_range.jsx

How we can get an object when we selected ?

authors: davideghz phuongthuan rafeememon wzup


text:
Add --assume_filename option

Add --assume_filename option to control the search path for the style config file when reading from stdin; needed for editor integration.
Add Sublime editor integration python script.

Notes:

The assume_filename option is needed because the current working directory (cwd) will generally not be the path of the file in the editor. So when the editor passes the file's contents through stdin, without this option, the correct .editorconfig file for the file in the editor would not be found.
This Sublime python script is very similar to the clang-format-sublime.py script from the Clang project. Scripts for other editors can be found in clang's repository in ...\tools\clang-format\ . Note that the scripts will have to be simplified because dfmt currently only supports reformatting the whole file.

I used to have editor integration scripts in the DCD repository. It ended up being a bad idea. DCD integration is now handled by separate projects. I want to do the same thing with dfmt. You may want to try adding dfmt support to https://github.com/yazd/DKit.

Wouldn't it be simpler to specify a path to a .editorconfig file?

Implementation-wise, I think it is simpler to specify a file (like was already done with "dummy.d"). For the editor/user, it is nice to specify a file because that is what the editor is passing through stdin. This would then do the exact same thing as if the file was passed through the commandline (instead of stdin). In theory this would allow different editorconfig files for different files (or different file types) in the same directory. When specifying a path+stdin instead, you would not be able to get the same behavior as passing a file.

The editor integration script is meant to be a single script, with no installation requirements and with only dfmt functionality. Perhaps more of an example file for larger editor packages. I like how such scripts are part of the clang-format repository, and not in another separate repo (there are of course many C++ sublime packages out there). This means it is easy for the developers of dfmt/clang-format to test and amend commandline options such as assume_filename.

authors: Hackerpilot JohanEngelen

repo: Hackerpilot/dfmt


text:
Instagram profile avatar option added

Instagram profile avatar can add now through the Instagram user name.

@HaithemMosbahi Please update the doc if you merge this to master.

It would be nice to have the docs before merging it to master.

okay.. I will add.

repo: HaithemMosbahi/ngx-avatar


text:
Help needed: I dont understand how to run this plugin

My steps:

Download obsidian run plugin
Download obsidian custom save plugin
Add "run: run file" command to custom save plugin
Created a new md file in vault
Added a dataview code like following

`
%% run start
dv.list from "" where file.cday = date("<%tp.date.now(\"YYYY-MM-DD\")%>") sort file.ctime asc

%%
`
At this point I have no idea what to do next to get a markdown/text from the dataview query. Can someone please help me?

You have to run JavaScript. The code that you write is not JavaScript at all.

Thanks for the answer. I tried finding some examples with dataview and wasnt sure how to write a js for it. I'll look into it.

authors: HananoshikaYomaru natarslan

repo: HananoshikaYomaru/obsidian-run


text:
🛑 Beta is down

In d457b43, Beta (https://beta.premid.app) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Beta is back up in 8c3741b.


text:
🛑 CDN server 1 is down

In 71fb78b, CDN server 1 (https://cdn.scratch.mit.edu/scratchr2/static/867ec47c1657f9fde21932c086a84195/images/logo_sm.png) was down:

HTTP code: 503
Response time: 472 ms

Resolved: CDN server 1 is back up in bb4a1de after 11 minutes.


text:
🛑 Japanese is down

In 4d6d8dc, Japanese (https://ja.scratch-wiki.info) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Japanese is back up in 52ee14c after 16 minutes.


text:
🛑 Portal is down

In 3dba659, Portal (https://scratch-wiki.info) was down:

HTTP code: 508
Response time: 1755 ms

Resolved: Portal is back up in 510007d after 8 minutes.


text:
ueditor上传800M的大视频文件提示：上传失败，请重试

你遇到了什么 BUG
简单描述你遇到的 BUG。
如何复现
复现 BUG 的步骤:

进入编辑器 页面。
点击 上传视频。
选择大小为800M视频，点击开始上传。
上传视频处提示：上传失败，请重试。

是 UEditor 的 BUG 还是组件的 BUG
初步判断一下是因为 UEditor 导致的报错，还是由于本仓库的 vue-ueditor-wrap 组件导致的报错。
你是否查阅了 README 中的常见问题和其他 ISSUE
已查阅，没有发现我遇到的问题
截图
如果可能，提供截图

开发环境

操作系统: [e.g. mac]
浏览器:  [e.g. 谷歌 71.0.3578.98 版本]
是否使用了本仓库下载的 UEditor 资源文件:  [e.g. 否]

额外说明
如果可能请提供一个复现问题的 GitHub 仓库地址

后端配置文件中有一个限制视频文件最大上传体积的的配置项 videoMaxSize

这个已经配置了，是2G

那我就不清楚了，你自己去网上搜吧

我也遇到了同样的问题，大佬现在是怎么解决的


text:
🛑 Happy Vibes Bot 3 is down

In 487adab, Happy Vibes Bot 3 ($BOT3) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Happy Vibes Bot 3 is back up in 77d9c36.

repo: Happy-Vibes-Bot/status


text:
🛑 Happy Vibes Bot 1 is down

In 43c0266, Happy Vibes Bot 1 ($BOT1) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Happy Vibes Bot 1 is back up in 02ce05e.


text:
🛑 Happy Vibes Bot 5 is down

In fc2b164, Happy Vibes Bot 5 ($BOT5) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Happy Vibes Bot 5 is back up in d027a01.


text:
🛑 Happy Vibes Bot 1 is down

In 6e95bc2, Happy Vibes Bot 1 ($BOT1) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Happy Vibes Bot 1 is back up in a7c7d3e after 6 minutes.


text:
🛑 Happy Vibes Bot 2 is down

In 984b6cd, Happy Vibes Bot 2 ($BOT2) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Happy Vibes Bot 2 is back up in 9da7a89 after 1 hour, 5 minutes.


text:
FLA save files not importing

[✔] I have checked the known issues and searched Github to ensure this issue has not already been reported.
[✔ ] This is not a feature request, I know those belong on Discord/Github Discussions.

Description of the bug:
FLA save files are not importing. This applies with both files I've used in PJ64 and files I've downloaded from the internet to try.
Can you reproduce? If so please list the steps:

[✔] Yes, here are the steps to reproduce the bug:

Go to https://drive.google.com/file/d/1vt91mBPItp5pxov9G4nij29XopuNGUcZ/view
Download and unzip FLA file.
Try and drop it onto save page. Get "Unsupported file dropped, ignoring" message.

Expected behavior:
Save import successfully.
Screenshots or videos:

System Information:

OS: Windows 10
GFX Backend: DirectX
Game Version: 1.0.0
Rom Version: GC

Additional Information:
2 Ship 2 Harkinian.log

@sanityormadness can you try removing spaces & special characters from the file name?

I was able to get the save imported by removing spaces/special characters from the file path. Closing this out, let me know if that doesn't work for you

Okay, yes, that worked. I will point out that the only spaces/special characters in the path were ones because "ZELDA MAJORA'S MASK" is the internal name of the ROM, and I got a message telling me it was unsupported. That still needs fixed, or it's going to trip a lot of people up.

Actually, while it's known I haven't created a github issue to keep track of it so we can just use this one

Additionally, the game only imports the save in the first slot.

Fixed by #611

authors: TailsGuy garrettjoecox sanityormadness


text:
Adds even more interpolation fixes

Adds the following interpolation fixes/changes:

Interpolate Biggoron ice wind breath
Fix interpolation on Keaton grass leaves vanishing swirl
Interpolate Goron ice melting, snowball and dust effects
Skip interpolation on pause cursor when moving it
Skip interpolation on item drops once picked up by the player
Interpolate wider angle changes to specifically handle Deku Link spinning and Deku Link diving into a Deku flower

Normally we have a heuristic to skip interpolating angle changes greater than 91º which I'm not sure how that was decided, so instead of increasing this across the board, I decided to just increase for Deku Link when in the two action states mentioned above.

Build Artifacts

2ship-linux.zip
2ship-windows.zip
2ship-mac.zip

Not the biggest fan of the solution for the item00, I assume there's no other field we can use to determine that state? I know one of them is lifetime but I think that might be multi-use.

I tried checking for the actionFunc originally, but the problem with that is I need to know that the actionFunc has been executed. Since Draw is performed after Update, the actionFunc is already assigned but never called yet by the time Draw is executed.
I might be able to get away with not adding a field to item00 struct by getting the player and seeing if the item00 pos.x and pos.z are identical to the player's.

I might be able to get away with not adding a field to item00 struct by getting the player and seeing if the item00 pos.x and pos.z are identical to the player's.

Updated PR to drop the item00 struct changes in favor of this.


text:
Captioning the box will create a black dot only shown on Windows

Hi, @HarisIqbal88
I am back again 😸 ! I found that labeling a caption will make a black dot by the following code. Though it's invisible on my Mac OS and Ubuntu, I found it when I open the pdf on Windows, using Adobe reader exactly.
\path (\LastEastx/2,-\y/2,+\z/2) + (0,-25pt) coordinate (cap)
        edge ["\textcolor{black}{ \bf \caption}"',captionlabel](cap) ; %Block caption/pic object label

I am wondering that the way you make labels by adding a edge, but the tutorials in TiKz always use node, which seems malfunctioned in your repo. (Maybe I use the node syntax wrongly)

Hi, I was not aware of this behaviour. Also, there is no particular reason to use this way of creating labels. You can use node or other options mentioned in #7

Hi @HarisIqbal88 and cheers for a lovely package, it has saved me much headache drawing neural networks.
I also see the black dot with Texmaker (PDFLaTeX) on Ubuntu when I am not using a caption for a Box. I found that if you comment out the following three lines from Box.sty the problem disappears.

\tikzstyle{captionlabel}=[text width=15*\LastEastx/\scale,text centered]
\path (\LastEastx/2,-\y/2,+\z/2) + (0,-25pt) coordinate (cap)
edge "\textcolor{black}{ \bf \caption}"',captionlabel ; %Block caption/pic object label

authors: HarisIqbal88 martinlindstrom omegahh