text:
Runtime error when running tensorflow.python.ops.gen_math_ops.ragged_bincount

Click to expand!
Issue Type
Bug
Have you reproduced the bug with TF nightly?
No
Source
binary
Tensorflow Version
2.10.0
Custom Code
Yes
OS Platform and Distribution
Ubuntu 22.04
Mobile device
No response
Python version
3.9
Bazel version
No response
GCC/Compiler version
No response
CUDA/cuDNN version
No response
GPU model and memory
No response
Current Behaviour?
Empty tensor or negative argument.

Standalone code to reproduce the issue
import tensorflow as tf
import os
import numpy as np
from tensorflow.python.ops import gen_math_ops
try:
  splits_tensor = tf.saturate_cast(tf.random.uniform([], minval=-256, maxval=257, dtype=tf.int64), dtype=tf.uint64)
  splits = tf.identity(splits_tensor)
  values_tensor = tf.saturate_cast(tf.random.uniform([3, 3], minval=-256, maxval=257, dtype=tf.int64), dtype=tf.uint64)
  values = tf.identity(values_tensor)
  weights = []
  size = -80
  binary_output = False
  out = gen_math_ops.ragged_bincount(splits=splits,values=values,weights=weights,size=size,binary_output=binary_output,)
except Exception as e:
  print("Error:"+str(e))

### Relevant log output

```shell
2023-01-21 13:48:15.238976: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-01-21 13:48:15.525093: E tensorflow/stream_executor/cuda/cuda_blas.cc:2981] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2023-01-21 13:48:16.279948: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/lib/
2023-01-21 13:48:16.280110: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libnvinfer_plugin.so.7'; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/lib/
2023-01-21 13:48:16.280118: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2023-01-21 13:48:17.172034: I tensorflow/stream_executor/cuda/cuda_gpu_executor.cc:980] successful NUMA node read from SysFS had negative value (-1), but there must be at least one NUMA node, so returning NUMA node zero
2023-01-21 13:48:17.199016: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudnn.so.8'; dlerror: libcudnn.so.8: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: :/lib/
2023-01-21 13:48:17.199033: W tensorflow/core/common_runtime/gpu/gpu_device.cc:1934] Cannot dlopen some GPU libraries. Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU. Follow the guide at https://www.tensorflow.org/install/gpu for how to download and setup the required libraries for your platform.
Skipping registering GPU devices...
2023-01-21 13:48:17.200445: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
Error:<class 'tensorflow.python.framework.ops.EagerTensor'> returned a result with an error set

</details>

@nimashiri As this comment suggests, the invalid inputs will lead to the custom error.
The documentation requires size to be a non negative int and conversion to tf.uint64 from tf.int64 can lead to the error. Please refer the documentation for valid inputs. Thanks.

@pjpratik  vulnerabilities occur when invalid arguments are being sent to APIs. So your reply here is wrong.
@nimashiri this is not a vulnerability, you're receiving a user error. Please consult SECURITY.md before sending new reports as very few of them are really actionable (and they should have been submitted via private channels)

authors: mihaimaruseac nimashiri pjpratik


text:
dynamic variants of attention_decoder and embedding_attention_decoder

I've been following @alrojo's PR(#4686) for the tf.contrib.seq2seq.dynamic_rnn_decoder. I recently had to customize tf.nn.seq2seq.embedding_attention_decoder and tf.nn.seq2seq.attention_decoder with while loops for a personal project, so I'd be happy to help write attention and embedding_attention decoder functions for use with tf.contrib.seq2seq.dynamic_rnn_decoder if that would be helpful. I'm unclear on whether this is already being worked on, since I see discussion of a rnn_decoder_attention function in #4761, but it was a commit which followed the old structure of tf.contrib.seq2seq.

Hi @ssampang
I am currently working on finalizing a attention decoder function with the proper kernel_tests, I hope to submit it next week.

Hi @alrojo , is there any progress in the attention decoder?
thank you

source: gharchive/issue

authors: alrojo ssampang tttwwy

repo: tensorflow/tensorflow

license_type: permissive

license_source: github-api


text:
DLL load failed while importing _pywrap_tensorflow_internal: A dynamic link library (DLL) initialization routine failed

{
"name": "ImportError",
"message": "Traceback (most recent call last):
File "c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 62, in
from tensorflow.python._pywrap_tensorflow_internal import *
ImportError: DLL load failed while importing _pywrap_tensorflow_internal: A dynamic link library (DLL) initialization routine failed.
Failed to load the native TensorFlow runtime.
See https://www.tensorflow.org/install/errors for some common causes and solutions.
If you need help, create an issue at https://github.com/tensorflow/tensorflow/issues and include the entire stack trace above this error message.",
"stack": "---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\python\pywrap_tensorflow.py:62, in
61 try:
---> 62   from tensorflow.python._pywrap_tensorflow_internal import *
63 # This try catch logic is because there is no bazel equivalent for py_extension.
64 # Externally in opensource we must enable exceptions to load the shared object
65 # by exposing the PyInit symbols with pybind. This error will only be
66 # caught internally or if someone changes the name of the target _pywrap_tensorflow_internal.
67
68 # This logic is used in other internal projects using py_extension.
ImportError: DLL load failed while importing _pywrap_tensorflow_internal: A dynamic link library (DLL) initialization routine failed.
During handling of the above exception, another exception occurred:
ImportError                               Traceback (most recent call last)
Input In [6], in <cell line: 2>()
1 #import keras libraries and packages
----> 2 import keras
3 from keras.models import Sequential
4 from keras.layers import Dense
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\keras\init.py:20, in
1 # Copyright 2015 The TensorFlow Authors. All Rights Reserved.
2 #
3 # Licensed under the Apache License, Version 2.0 (the "License");
(...)
13 # limitations under the License.
14 # ==============================================================================
15 """Implementation of the Keras API, the high-level API of TensorFlow.
16
17 Detailed documentation and user guides are available at
18 keras.io.
19 """
---> 20 from keras import distribute
21 from keras import models
22 from keras.engine.input_layer import Input
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\keras\distribute\init.py:18, in
1 # Copyright 2019 The TensorFlow Authors. All Rights Reserved.
2 #
3 # Licensed under the Apache License, Version 2.0 (the "License");
(...)
13 # limitations under the License.
14 # ==============================================================================
15 """Keras' Distribution Strategy library."""
---> 18 from keras.distribute import sidecar_evaluator
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\keras\distribute\sidecar_evaluator.py:17, in
1 # Copyright 2020 The TensorFlow Authors. All Rights Reserved.
2 #
3 # Licensed under the Apache License, Version 2.0 (the "License");
(...)
13 # limitations under the License.
14 # ==============================================================================
15 """Python module for evaluation loop."""
---> 17 import tensorflow.compat.v2 as tf
19 # isort: off
20 from tensorflow.python.platform import tf_logging as logging
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\init.py:37, in
34 import sys as _sys
35 import typing as _typing
---> 37 from tensorflow.python.tools import module_util as _module_util
38 from tensorflow.python.util.lazy_loader import LazyLoader as _LazyLoader
40 # Make sure code inside the TensorFlow codebase can use tf2.enabled() at import.
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\python\init.py:36, in
27 import traceback
29 # We aim to keep this file minimal and ideally remove completely.
30 # If you are adding a new file with @tf_export decorators,
31 # import it in modules_with_exports.py instead.
32
33 # go/tf-wildcard-import
34 # pylint: disable=wildcard-import,g-bad-import-order,g-import-not-at-top
---> 36 from tensorflow.python import pywrap_tensorflow as _pywrap_tensorflow
37 from tensorflow.python.eager import context
39 # pylint: enable=wildcard-import
40
41 # Bring in subpackages.
File c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\python\pywrap_tensorflow.py:77, in
75     sys.setdlopenflags(_default_dlopen_flags)
76 except ImportError:
---> 77   raise ImportError(
78       f'{traceback.format_exc()}'
79       f'

Failed to load the native TensorFlow runtime.
'
80       f'See https://www.tensorflow.org/install/errors '
81       f'for some common causes and solutions.
'
82       f'If you need help, create an issue '
83       f'at https://github.com/tensorflow/tensorflow/issues '
84       f'and include the entire stack trace above this error message.')
ImportError: Traceback (most recent call last):
File "c:\Users\OWNER\anaconda3\envs\tf_env\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 62, in
from tensorflow.python._pywrap_tensorflow_internal import *
ImportError: DLL load failed while importing _pywrap_tensorflow_internal: A dynamic link library (DLL) initialization routine failed.
Failed to load the native TensorFlow runtime.
See https://www.tensorflow.org/install/errors for some common causes and solutions.
If you need help, create an issue at https://github.com/tensorflow/tensorflow/issues and include the entire stack trace above this error message."
}

Hi @dambeebu ,
Could you please try using the latest version of TensorFlow 2.18.0-rc1? I am providing the documentation for the latest version here. Please let us know if the issue still persists.
Thank you!


text:
Error using TF in Python

I have Python 3.5.2 and Anaconda 4.1.1 (64bit) and when i tried installing TF i got the same error earlier today.
After following uninstall and then reinstall TF commands i was able to start Python app using TF; but now i am getting OpKernel error for unknown op: UpdateFertileSlots.

Any idea how to fix this?
N.B: i did searched online and could not find any answer in SO or any other resource to fix this issue to start using TF.

Could you please try to:

Uninstall TensorFlow
Download a nightly build and install it

then follow up if worked for you?

This rocked @Carmezim ! thanks a lot.

Great it worked. If there is no other doubts regarding this issue this can be closed now.

It also worked for me but is there a way to not use nightly builds?

@atabakd You can actually ignore it as this issue is already fixed at HEAD but wasn't cherry picked for the current release. It will be present in the 1.1r. To get rid of it is only upgrading to a nightly build.

that means the problem can be resolved if I uninstall Tensorflow and install the nightly build version.  btw do you know when version 1.1 is released @Carmezim

@mrnameless123 it's pre-released https://github.com/tensorflow/tensorflow/releases

so I just simply need to wait until it's officially released and use pip --upgrade tensorflow on laptop right?

@mrnameless123 Correct. The latest nightly build is probably already updated as well. Or you can download the source code and build it.

Thank you very much, @Carmezim

I got the same error. I thought the pip3 --upgrade install would install 1.1 by now?
I tried:
PS C:\Users\kmand> pip3 install --upgrade tensorflow==1.1.0
Collecting tensorflow==1.1.0-rc2
  Downloading tensorflow-1.1.0rc2-cp35-cp35m-win_amd64.whl
...
tobuf>=3.2.0->tensorflow==1.1.0-rc2)
Installing collected packages: werkzeug, tensorf
  Found existing installation: tensorflow 1.0.1
    Uninstalling tensorflow-1.0.1:
      Successfully uninstalled tensorflow-1.0.1
Successfully installed tensorflow-1.1.0rc2 werkzeug-0.12.1

That looks strange!?

i have the same error mentioned above, yet, uninstalling TF and installing the build didn't solve the problem. what else can i do?
thx

how to install GPU and CPU of tensorflow on windows 7 for 32 bit .i have  installed cuda toolkit for  win 32   and now i am not able to install GPU and CPU versions for tensor i am getting the following error after creating a virtual environment on windows 7 for tensorflow.

@sreelathasamudrala  hi, I install CPU-only version of TensorFlow via native pip3 successfully according to the official page https://www.tensorflow.org/install/install_windows#common_installation_problems, however it throws warning: 43134753 when I execute sess = tf.Session(), but it does not affect the following execution. May be you can try it.

i did pip3 installation also but still getting the same error.

I tried extracting files of tensorflow 1.0.1.rc1 ionto the same folder as i have sent in the attachment but still not getting the  execution .

i tried to run tensorflow program without cpu and gpu  installation and i am getting errors.

please help me guys cant download tf in win 7 using cuda 5.5 release  download of cuda toolkit for win 32

@sreelathasamudrala Even I got the same error, and it is solved using the solution at this link http://www.stefangordon.com/install-tensorflow-in-anaconda-on-windows/

authors: Carmezim NirDiamant ZhouYL0213 atabakd chakriv88 kristianmandrup melzoghbi mrnameless123 sreelathasamudrala


text:
Utility for repeatedly running tensors on queued input and accumulating the results

I've written a utility function in TensorFlow that I've found quite helpful for loading Tensors with queue based inputs into memory, e.g., for looking at input data stored in the form of TF-records files or for looking at inference results. I've found it especially useful for interactively exploring the results of saved models from IPython notebooks, i.e., doing inference on small datasets or small portions of big datasets.
Here's what the API looks like:
from typing import Mapping, Optional, Dict

def run_repeatedly(
    batched_tensors: Mapping[object, tf.Tensor],
    checkpoint_dir: Optional[str] = None,
    max_num_batches: Optional[int] = None) -> Dict[object, np.ndarray]:
  """Repeatedly run tensors until they are exhausted.

  Args:
    batched_tensors: dict of tensors to evaluate, each of which should have a
      first axis corresponding to a batch of examples.
    checkpoint_dir: optional path to checkpoint to load.
    max_num_batches: optional maximum number of batches to run.

  Returns:
    A dict of numpy.ndarray objects containing the result of evaluating
    batched_tensors and concatenated across batches along the first axis.

  Raises:
    ValueError: if checkpoint_dir has no valid checkpoint
  """
  # the implementation makes use of tf.contrib.metrics.streaming_concat
  # and a tf.train.Supervisor: it handles all the boilerplate around starting
  # up a session.

And a few usage example:

Previewing features loaded from files:

tensors = tf.contrib.learn.read_batch_features(....)
arrays = run_repeatedly(tensors, max_num_batches=10)

For running inference on a full dataset while also accumulating input tensors (useful for debugging):

tensors = tf.contrib.learn.read_batch_features(....)
predictions = make_predictions(tensor_inputs, ...)
tensors.update(predictions)
arrays = run_repeatedly(tensors, checkpoint_dir=path_to_saved_model)

Does something like this belong somewhere in core TensorFlow, or maybe one of the contrib libraries?
This is somewhat similar to Estimator.predict from tf.contrib.learn, but with a few key differences:

It's more flexible, not expecting inputs in the form of a tf.learn model.
It automatically concatenates across batches. In practice, I find this highly useful, because I can often store the results of a model in memory even though I don't have enough memory to run inference on everything at once.

@mrry, could you evaluate this contribution since it is firmly in your area of expertise. Thanks!

friendly ping, Derek: is this something that's still useful for users?

It sounds like a utility that could stand alone as a self-contained project, but I don't think it's something we'd  want to support as part of the core library.

authors: aselle itsmeolivia mrry shoyer


text:
Fix AttributeError in resnet.py

There is no function tf.softmax() in Tensorflow 1.x.
When running the old code, Python interpreter complains:
File "resnet.py", line 152, in res_net_model
prediction, loss = res_net(x, y)
File "resnet.py", line 148, in res_net
return tf.softmax(logits), loss
AttributeError: 'module' object has no attribute 'softmax'

Can one of the admins verify this patch?

I submitted a pull request once but cla did not works:
https://github.com/tensorflow/tensorflow/pull/10465
So I request again and this time cla works.
Thank for your time!

@tensorflow-jenkins test this please

source: gharchive/pull-request

authors: caisq ksellesk tensorflow-jenkins


text:
Branch 179628764

Push

Can one of the admins verify this patch?

@tensorflow-jenkins test this please

@tensorflow-jenkins test this please

@tensorflow-jenkins test this please

@caisq could you take a look at the failure in tensorflow/python/debug/wrappers/grpc_wrapper.py? Looks like python3 does not have sys.maxint. Thanks!

@yifeif will do, it's interesting that the Kokoro tests didn't catch it. Might be a mac+python3 specific thing.

@tensorflow-jenkins test this please

@yifeif, thanks for the attempt to fix the sys.maxint related failures. I think you need to remove the import sys lines from both files as well. Otherwise there will be linter errors.

@yifeif Ah - never mind about import sys: they were already there for other purposes.

authors: caisq ekelsen tensorflow-jenkins yifeif


text:
Switch to v2 version of tf.unique to enable axis support

This fix is a follow up to #15654 to switch to unique_v2 for tf.unique so that axis support could be enabled.
This follows the compatibility workflow as PR 15654 has been merged 3+ weeks ago.
This fix is part of the effort for #15644.
Signed-off-by: Yong Tang yong.tang.github@outlook.com

Nagging Assignee @protoget: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Hi, when will this land in a tensorflow release?

We are eagerly waiting for this release.

@yongtang  could you address the test failure?

I run tests on my GPU machine and could not reproduce the failure showed up in GPU Python3. Will spend some time investigating it.

Nagging Assignee @protoget: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

So, FTR the error is:
InvalidArgumentError (see above for traceback): Cannot assign a device for operation 'Adam/update_Variable/sub_3': Could not satisfy explicit device specification '/device:GPU:0' because no supported kernel for GPU devices is available.

When running:
    return optimizer._apply_sparse_duplicate_indices(g, self._v)

It says that the kernel is not registered. I would guess that there's a convert to tensor that converts to a different type in py3 which is not implemented.

It has been 14 days with no activity and the awaiting response label was assigned. Is this PR still valid? Assigning the stalled label. Please comment to reassure me that this is still being worked on.

It has been 43 days that this pull-request has stalled. Please create a new pull-request with the requested changes.

Is there a current work around?

authors: Hoeze aseem-hegshetye drpngx nairouz protoget tensorflowbutler yongtang


text:
Add complex128 support

Added complex128 support, based on the guidence from @girving and others in PR #2244. All (python) tests passed.
Complex128 support is not added for these including ops with input: complex64 and output: complex64:

Real
Imag
Conj
*FFT*

Can one of the admins verify this patch?

authors: hunkim tensorflow-jenkins


text:
Update README.md

Removed typos and increased readability.

Nagging Reviewer @sguada: You have been added as a reviewer to this pull request. Please add your review or reassign. It has been 29 days with no activity and the awaiting review label has been applied.


text:
Test case updated with unpack Op struct

Missing Unpack Op added

@aselle Could you PTAL and approve

@aselle Could you PTAL and approve

Nagging Reviewer @aselle: You have been added as a reviewer to this pull request. Please add your review or reassign. It has been 14 days with no activity and the awaiting review label has been applied.

Nagging Reviewer @aselle: You have been added as a reviewer to this pull request. Please add your review or reassign. It has been 29 days with no activity and the awaiting review label has been applied.

Can one of the admins verify this patch?

authors: ANSHUMAN87 gbaned mellanox-github tensorflowbutler


text:
#10617: Update CODEOWNERS

Ticket
#10617
Problem description
We'd like ownership of the Llama folder under models/demos/tg

Good morning
Approved

authors: cglagovichTT tt-rkim

repo: tenstorrent/tt-metal


text:
Remote control play/pause not responding in example - add RemoteControlTogglePlayPause event?

Just found something with remote control events which might be nice to add in your ViewController example...
'RemoteControlPlay' and 'RemoteControlPause' UIEvents don't get called if you press headphone remote button or play/pause on the lock screen. It's the .RemoteControlTogglePlayPause one which gets called, so maybe adding something like this would be helpful?
override func remoteControlReceivedWithEvent(event: UIEvent?) {
if event?.type == .RemoteControl {
switch event!.subtype {
case .RemoteControlPlay :
self.jukeBox.play()
case .RemoteControlTogglePlayPause :
print("Toggle Play/Pause received")
self.playPauseAction()
I'd also consider moving the default example override func remoteControlReceivedWithEvent into the core Jukebox.swift, as you're already calling beginReceivingRemoteControlEvents when Jukebox is initialised and the example calls through to the expected Jukebox play/pause/next/previous methods already.. just for convenience maybe :)

unfortunately the remote event is propagated through the responder chain so i cannot intercept it inside of Jukebox, readme updated. thanks for the input and sorry for the late reply.

authors: antiero teodorpatras

repo: teodorpatras/Jukebox

license: mit

license_source: bigquery


text:
@ #497 | should support register with weight

please check this PR, thank you!
connect #497

I think we should try this: http://ruby-doc.org/core-2.2.2/Enumerable.html#method-i-sort_by

@datphan I've updated, please check this PR again!

@hoatle please check again! I've updated.

@hoatle I've updated! Please check again!

authors: datphan hieptranquoc

repo: teracyhq/dev


text:
Activity data

This package is suitable for my project.
When will the "activity" feature be added to the package?
Thank you.

Wait for one or two days, pls.

https://github.com/teramonagi/fitbitr/pull/10

:+1:

authors: dichika teramonagi

repo: teramonagi/fitbitr


text:
image doesn't fit preload window, scrolled splash

First of all, thank you for making such an app. It works well on my Ubuntu 16.04 platform.
Splash screen or preload window image size unproportionate, so it scrolls the image to fit the window.
https://ibb.co/h1HAn6
I wonder if it's specific to my platform.
Regards.
Kenn

Added my own issue to this : also under Ubuntu 16.04 (Kubuntu) , no splash screen is been loaded at all.

authors: kensully martindariocernadas

repo: terkelg/ramme


text:
fix: Use correct write policy name for table and index autoscaling rules

Description
This fixes a bug where an incorrect rule for write capacity autoscaling would be created.
Motivation and Context
Write capacity autoscaling rules were named for read capacity.
Breaking Changes
No breaking. Only fixing!

Thanks @bangpound !
I really appreciate small and very spot-on fixes like you gave in this and previous PR!
v0.5.0 has been released.

authors: antonbabenko bangpound


text:
Connection refused when trying to add an additional subnet to a vpc

Description
Error: Get "http://localhost/api/v1/namespaces/kube-system/configmaps/aws-auth": dial tcp [::1]:80: connect: connection refused when trying to add an additional subnet to a vpc.
⚠ Note
Before you submit an issue, please perform the following first:

Remove the local .terraform directory (! ONLY if state is stored remotely, which hopefully you are following that best practice!): rm -rf .terraform/
Re-initialize the project root to pull down modules: terraform init
Re-attempt your terraform plan or apply and check if the issue still persists

Versions

Terraform: 0.14.10

Provider(s):

Module:

Reproduction

Steps to reproduce the behavior:
 Not using workspaces
 Have cleared local cache

I have an existing vpc created with the following code:
module "vpc" {
  source                 = "terraform-aws-modules/vpc/aws"
  version                = "2.78.0"
  name                   = "a-name"
  azs                    = ["us-east-1e", "us-east-1c"]
  cidr                   = "172.21.0.0/16"
  private_subnets        = ["172.21.1.0/24", "172.21.2.0/24", "172.21.3.0/24"]
  public_subnets         = ["172.21.101.0/24", "172.21.102.0/24", "172.21.103.0/24"]
  enable_nat_gateway     = true
  single_nat_gateway     = true
  one_nat_gateway_per_az = false
  enable_dns_hostnames   = true
  reuse_nat_ips          = true
  external_nat_ip_ids    = [aws_eip.nat_gw_elastic_ip.id]

I simply want to add an additional subnet:
  module "vpc" {
  source                 = "terraform-aws-modules/vpc/aws"
  version                = "2.78.0"
  name                   = "a-name"
  azs                    = ["us-east-1e", "us-east-1c"]
  cidr                   = "172.21.0.0/16"
  private_subnets        = ["172.21.1.0/24", "172.21.2.0/24", "172.21.3.0/24", "172.21.4.0/24"]
  public_subnets         = ["172.21.101.0/24", "172.21.102.0/24", "172.21.103.0/24"]
  enable_nat_gateway     = true
  single_nat_gateway     = true
  one_nat_gateway_per_az = false
  enable_dns_hostnames   = true
  reuse_nat_ips          = true
  external_nat_ip_ids    = [aws_eip.nat_gw_elastic_ip.id]

But, after performing a terraform plan, it refreshes the state but then throws the following:
Error: Get "http://localhost/api/v1/namespaces/kube-system/configmaps/aws-auth": dial tcp [::1]:80: connect: connection refused
Expected behavior
I would expect to be able to add a subnet to an existing vpc
Additional context
I am actually trying to add a subnet from a new secondary CIDR. The secondary CIDR has added itself fine. However, in the course of troubleshooting, I noticed that you can't add a subnet from the existing primary cidr. You also cannot delete existing subnets (it throws the same vague error).

It appears that the eks module is actually the root cause here. You cannot add a subnet to eks without re-creating it, this error is due to code in the eks module failing to capture this deletion requirement properly.

repo: terraform-aws-modules/terraform-aws-vpc


text:
add internal L7 LB submodule

https://cloud.google.com/load-balancing/docs/l7-internal

Related: https://github.com/terraform-google-modules/terraform-google-lb-internal/issues/38

Example: https://github.com/GoogleCloudPlatform/professional-services/tree/main/examples/terraform-ilb

authors: morgante naseemkullah


text:
chore(deps): update common-dev-assets digest to 58a2af7

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
05291e2 -> 58a2af7

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 1.5.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
chore(deps): update ci dependencies

This PR contains the following updates:

Package
Type
Update
Change

common-dev-assets

digest
5f5fd35 -> 4cda4ee

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
patch
v1.42.5 -> v1.42.6

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper (github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper)
v1.42.6
Compare Source
Bug Fixes

deps: update module github.com/gruntwork-io/terratest to v0.48.1 (#905) (511dc17)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

ℹ Artifact update notice
File name: tests/go.mod
In order to perform the update(s) described in the table above, Renovate ran the go get command, which resulted in the following additional change(s):

1 additional dependency was updated

Details:

Package
Change

github.com/gruntwork-io/terratest
v0.48.0 -> v0.48.1

/run pipeline

/run pipeline

ℹ Artifact update notice
File name: tests/go.mod
In order to perform the update(s) described in the table above, Renovate ran the go get command, which resulted in the following additional change(s):

1 additional dependency was updated

Details:

Package
Change

github.com/gruntwork-io/terratest
v0.48.0 -> v0.48.1

/run pipeline

/run pipeline


text:
chore(deps): update ci dependencies

This PR contains the following updates:

Package
Type
Update
Change

common-dev-assets

digest
2015ae9 -> d58fee1

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
minor
v1.31.8 -> v1.33.2

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper (github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper)
v1.33.2
Compare Source
Bug Fixes

nil to NULL (#814) (3522e90)

v1.33.1
Compare Source
Bug Fixes

bugs (27bbbf0)

v1.33.0
Compare Source
Features

enhancements to cloud project and stack testing (#812) (a8342e2)

v1.32.0
Compare Source
Features

added variable for passphrase protected ssh keys. (#771) (8dee786)

v1.31.9
Compare Source
Bug Fixes

Logging improvements (#807) (11a3f1a)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

/run pipeline

:tada: This PR is included in version 1.10.5 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
chore(deps): update common-dev-assets digest to 1e59e95

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
c71ed90 -> 1e59e95

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline


text:
chore(deps): update common-dev-assets digest to 27ef988

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
d9b8616 -> 27ef988

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, click this checkbox.

This PR has been generated by Renovate Bot.

:tada: This PR is included in version 2.0.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
chore(deps): update ci dependencies

This PR contains the following updates:

Package
Type
Update
Change

common-dev-assets

digest
89c38cb -> ce8fceb

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
patch
v1.30.3 -> v1.30.4

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper (github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper)
v1.30.4
Compare Source
Bug Fixes

create schematics tar file in correct temp dir (#783) (f0cd2ce)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

:tada: This PR is included in version 1.2.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
chore(deps): update common-dev-assets digest to 2285d99

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
0bb740c -> 2285d99

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 1.2.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
changes to variable name, description, & other display info changes..

changes to variable name, description, & other display info changes..

/run pipeline

/run pipeline

repo: terraform-ibm-modules/terraform-ibm-mas


text:
fix(deps): update terraform-module (major)

This PR contains the following updates:

Package
Type
Update
Change

terraform-ibm-modules/observability-agents/ibm (source)
module
major
1.29.1 -> 2.0.0

terraform-ibm-modules/observability-instances/ibm (source)
module
major
2.18.1 -> 3.1.0

Release Notes

terraform-ibm-modules/terraform-ibm-observability-agents (terraform-ibm-modules/observability-agents/ibm)
v2.0.0
Compare Source
Features

fully remove support for Log Analysis agent. Log Analysis is a deprecated service and has been replaced by IBM Cloud Logs (#411) (adf3256)

BREAKING CHANGES

No longer possible to provision the Log Analysis agent

v1.30.3
Compare Source
Bug Fixes

deps: update default logs agent version to 1.3.1 (#410) (4c4bb23)

v1.30.2
Compare Source
Bug Fixes

add validation to ensure cloud monitoring agent tags have no spaces (#405) (9d46d7f)

v1.30.1
Compare Source
Bug Fixes

revert back to supporting terraform >= 1.3.0 (#402) (9d858ad)

v1.30.0
Compare Source
Features

added support for the new cloud logs agent to send logs directly to a Cloud Logs instance. This is now the default logging agent deployed by this module as the Log Analysis service is deprecated (#368) (d5eecf8)

v1.29.2
Compare Source
Bug Fixes

Add priorityClass and maxUnavailable to sysdig-agent helm chart (#398) (88a1002)

terraform-ibm-modules/terraform-ibm-observability-instances (terraform-ibm-modules/observability-instances/ibm)
v3.1.0
Compare Source
Features

added support to create and use s2s auth policy for ATracker to Event Streams service (#584) (7cbc21e)

v3.0.2
Compare Source
Bug Fixes

add wait/depends on for cos auth policy (#588) (fb320fd)

v3.0.1
Compare Source
Bug Fixes

updated the service_endpoints input of the cloud_monitoring submodule to only allow the value public-and-private. Previouslly it incorrectly allowed values of public and private however it is not possible to create public only or private only Cloud Monitoring instances (#583) (d1ed5cf)

v3.0.0
Compare Source
Features

fully remove Log Analysis and Activity Tracker support (#582) (6b88ba2)

BREAKING CHANGES

Log Analysis and Activity Tracker support has been removed from this module since those services are deprecated and replace by IBM Cloud Logs and ATracker routes

v2.19.1
Compare Source
Bug Fixes

fix cycle error (#577) (4870caa)

v2.19.0
Compare Source
Features (#576) (db5a58f)

add support to enable platform logs with a boolean for cloud logs
The module no longer deploys the deprecated services Log Analysis or Activity Tracker by default

log_analysis_provision is now false by default
activity_tracker_provision is now false by default

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

/run pipeline

/run pipeline

/run pipeline


text:
chore(deps): update common-dev-assets digest to 038ee9e

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
12f782d -> 038ee9e

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

:tada: This PR is included in version 1.2.0 :tada:
The release is available on:

GitHub release
v1.2.0

Your semantic-release bot :package::rocket:


text:
chore(deps): update ci dependencies

This PR contains the following updates:

Package
Type
Update
Change

common-dev-assets

digest
005c876 -> 23a510d

github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper
require
minor
v1.34.1 -> v1.35.1

go (source)
toolchain
patch
1.22.3 -> 1.22.4

Release Notes

terraform-ibm-modules/ibmcloud-terratest-wrapper (github.com/terraform-ibm-modules/ibmcloud-terratest-wrapper)
v1.35.1
Compare Source
Bug Fixes

deps: update gomod (#816) (5918087)

v1.35.0
Compare Source
Features

add hook support (#817) (efe4d67)

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

:tada: This PR is included in version 1.6.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

repo: terraform-ibm-modules/terraform-ibm-scc


text:
chore(deps): update common-dev-assets digest to b3e214a

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
99dfba9 -> b3e214a

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

/run pipeline

/run pipeline

/run pipeline

Edited/Blocked Notification
Renovate will not automatically rebase this PR, because it does not recognize the last commit author and assumes somebody else may have edited the PR.
You can manually request rebase by checking the rebase/retry box above.
⚠ Warning: custom changes will be lost.

:tada: This PR is included in version 1.1.1 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
chore(deps): update common-dev-assets digest to a5cbc61

This PR contains the following updates:

Package
Update
Change

common-dev-assets
digest
866144e -> a5cbc61

Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.

[ ] If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

:tada: This PR is included in version 2.1.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


text:
Enabling require_code_owner_reviews also enables dismissal_restrictions

Terraform Version
Terraform v0.11.14

provider.github v2.2.0

Affected Resource(s)

github_branch_protection

Terraform Configuration Files
resource "github_branch_protection" "my-repo" {
  repository     = "my-repo.name"
  branch         = "master"
  enforce_admins = true

  required_pull_request_reviews {
    dismiss_stale_reviews      = true
    require_code_owner_reviews = true
  }
}

Expected Behavior
Requiring code owner reviews should not affect dismissal_restrictions.
Actual Behavior
dismissal_restrictions is enabled in GitHub console, but no one is listed as being able to dismiss:
Restrict who can dismiss pull request reviews
Specify people or teams allowed to dismiss pull request reviews.

If, furthermore, the restrictions apply to admins (enforce_admins), then absolutely no one except the reviewer will be able to dismiss.
If I then disable dismissal_restrictions in GitHub and refresh the plan, no changes are detected.
References

#50
https://github.com/google/go-github/pull/791#issuecomment-518994075

I'm having the same behavior. I think if the option is not defined the checkbox should stay unchecked.
Subscribing to this issue.

I verified that dismissal_restrictions can be disabled by setting it to an empty object:
curl -X PUT \
-H "Accept: application/vnd.github.v3+json" \
-H "Authorization: token :token" \
-d '{"dismiss_stale_reviews": true, "required_status_checks": null, "enforce_admins": null, "required_pull_request_reviews": {"dismissal_restrictions": {}}, "restrictions": null}' \
https://api.github.com/repos/:owner/:repo/branches/master/protection

Before running that command the dismissal_restrictions created by terraform looked like:
"dismissal_restrictions": {
  "users": [

  ],
  "teams": [

  ]
}

After running this command, dismissal_restrictions was no longer present in branch protection response.
Does the current terraform provider do the right thing? It's unclear from looking at the code

Yes this seems to be the correct behavior: https://developer.github.com/v3/repos/branches/#update-branch-protection

Specify which users and teams can dismiss pull request reviews. Pass an empty dismissal_restrictions object to disable. User and team dismissal_restrictions are only available for organization-owned repositories. Omit this parameter for personal repositories.

Case closed I guess ...

Ah now I see. The dismissal_restrictions is not available in the terraform github provider settings. So there's no way to uncheck the checkbox. I think some refactoring is needed to solve this in terraform.

Summarizing where I'm at now.
At one time terraform created this erroneous state, which prevents anyone from dismissing a review:
"dismissal_restrictions": {
  "users": [

  ],
  "teams": [

  ]
}

I don't know whether terraform continues to produce this state, but I do know that terraform is unable to clean up this state.
I verified that the go-github was broken wrt dismissal_restrictions but is now doing the right thing.

@joebowbeer It's still an issue with github provider 2.4.1

It's not just require_code_owner_reviews - the way it's structured, any usage of required_pull_request_reviews results in empty arrays being sent for dismissal_users and dismissal_teams which leads to the aforementioned setting on github.
I've dirty-fixed it so it doesn't write that state (https://github.com/jai/terraform-provider-github/commit/784033501f4fce4d72f508a6240714d06ac5ecc4), but still can't find a way to test it. Not sure if the test suite supports offline testing of resource <-> Github request internally. The way the acceptance tests are set up makes initial setup of test scenario seem super tedious.
Also need to fix it so it goes the other way around so that the incorrectly-written state can be removed.
The way dismissal_users and dismissal_teams is structured doesn't seem right to me given that ultimately it's 1 checkbox with 2 lists below it. Need to learn more about Terraform schema, then will propose a fix (and the corresponding tests).

hi @jai, are you working on this issue? I posted a PR that relates to this just now before reading your latest comment here with more detail. lmk if I can help in any way! Also, I can close my PR in favor of what you plan on working on :)

I made a tweak that I think fixes this specific issue, I forgot where I put it. Sorry it’s late 😴 I had to take a couple weeks’ break from devop’ing to do some Kotlin but I’m back on it, I’ll check out your PR shortly.

no worries (or rush) @jai ! just wanted to check I wasn't duplicating any work on this. I appreciate the review :)

authors: anGie44 jai joebowbeer thekbb verbruggenalex

license: MIT


text:
OCM-8194 | ci: Setup TF account/operator roles modules in tests manifests

What this PR does / why we need it:
Use TF modules for account/operator roles in e2e tests
Which issue(s) this PR fixes
https://issues.redhat.com/browse/OCM-8194
Change type

[ ] New feature
[ ] Bug fix
[ ] Build
[x] CI
[ ] Documentation
[ ] Performance
[ ] Refactor
[ ] Style
[ ] Unit tests
[ ] Subsystem tests

Checklist

[ ] Subject and description added to both, commit and PR.
[ ] Relevant issues have been referenced.

/hold

/hold

/lgtm

/approve

/hold cancel


text:
OCM-12071 | fix: remove rosa_creatorn_arn update validation

What this PR does / why we need it:
Which issue(s) this PR fixes (optional, use fixes #<issue_number>(, fixes #<issue_number>, ...) format, where issue_number might be a GitHub issue, or a Jira story (OCM-xxxx):
Fixes #
Change type

[ ] New feature
[x] Bug fix
[ ] Build
[ ] CI
[ ] Documentation
[ ] Performance
[ ] Refactor
[ ] Style
[ ] Unit tests
[ ] Subsystem tests

Checklist

[ ] Subject and description added to both, commit and PR.
[ ] Relevant issues have been referenced.

/lgtm

/test e2e-presubmits-rosa-sts-private-critical-high-presubmit

authors: gdbranco hunterkepley


text:
Helix diameter incorrect in tutorial documentation

see: https://github.com/terrapower/armi/blob/master/armi/tests/tutorials/anl-afci-177-blueprints.yaml#L12-L23
The helix diameter for the ANL-AFCI-177 inputs should be 0.8888 cm based on the Table 4.4 of https://publications.anl.gov/anlpubs/2008/05/61507.pdf, but currently is set to 0.84825 cm in the blueprints file. The helix diameter should be equivalent to the pin pitch, which is also defined as the Wire OD + Clad OD. Currently, the 0.84825 cm is calculated incorrectly as Wire OD / 2.0 + Clad OD.

Yeah I dunno if it'd be more clear in the helix component as helixdiameter = 2* helixradius = 2*(clad radius + wire radius) = 2*(cladOD/2 + wireOD/2) = cladOD + wireOD. Nice catch.

@ntouran, is there even a reason to have helixDiameter as a parameter since it seems over specified? What is it physically mean to have a helixDiameter smaller or larger than the Wire OD + Clad OD? Does larger imply "slop" in the pin lattice?

authors: jakehader ntouran

repo: terrapower/armi


text:
websites and APIs should provide useful information when servers are down

When data servers are down (e.g. /clowder, /thredds, /bety), they should redirect to terraref.org/maintenance
https://github.com/terraref/terraref.github.io/blob/master/maintenance.md
So that users are not getting unhelpful errors.
API should also send an appropriate message
Completion Criteria

[x] browsers redirect to terraref.org/maintenance
[x] API provides an appropriate error message

redirection see http://terraref.ncsa.illinois.edu/clowder-dev/
api not sure I want to redirect, I'd rather have it throw an error.

This will need to be fixed/updated when services are detected down.

authors: dlebauer robkooper

repo: terraref/computing-pipeline


text:
Add Google analytics to Workbench

Add TERRA project analytics ID to workbench instance for tracking purposes.
Completion criteria

[ ] Tracking ID added to webui configuration
[ ] Confirm tracking information appearing in analytics.

Spoke with Mike from Workbench team and we recommend that you have a single TERRA "Account" with multiple applications/properties.  We would just need the tracking ID that I can put in the webui container to start tracking.

Tracking ID sent via Slack PM
On Thu, May 11, 2017 at 10:07 AM Craig Willis notifications@github.com
wrote:

Spoke with Mike from Workbench team and we recommend that you have a
single TERRA "Account" with multiple applications/properties. We would just
need the tracking ID that I can put in the webui container to start
tracking.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/terraref/computing-pipeline/issues/312#issuecomment-300818796,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAcX5015FvH_Sm39bsIA-t2JMxMdi57Hks5r4yQYgaJpZM4NYIe4
.

Looking at the real-time report, this appears to be working.

authors: craig-willis dlebauer


text:
Fix malformed test case

PermissionRequirementsTest.createObservation was constructing a function to run
the test case when it should directly run the test case.

Current dependencies on/for this PR:

main

PR #1591   👈

This stack of pull requests is managed by Graphite.

repo: terraware/terraware-server


text:
SW-3000 Render reports as barebones HTML

In preparation for exporting submitted reports to Google Drive, add logic to
render report data as simple HTML, and allow the rendered reports to be viewed
using the admin UI.
The HTML includes references to photos and files. These are assumed to live in
the same directory as the exported HTML file. The admin UI includes endpoints
that serve the correct contents for those filenames.

Current dependencies on/for this PR:

main

PR #982

PR #983

PR #985

PR #986

PR #988

PR #989

PR #990

PR #991

Current dependencies on/for this PR:

main

PR #982

PR #983

PR #985

PR #986

PR #988

PR #989

PR #990

PR #991

I did close to no styling here; someone who's better at CSS than me (not hard) can follow up and make it look nicer. But all the information should be there.


text:
Paver is not rendering on mobile and tablet

Hello Terry, I'm having troubles with touch devices, In desktop all is working good but in my windows tablet and my android phone the panorama is not rendering. I only got this warn:

Hello

repo: terrymun/paver


text:
t2 provision enhancements

Migrating non-critical pieces of the t2 provision spec from https://github.com/tessel/t2-cli/issues/64

[ ] Should be run automatically
[ ] provision --remove
[x] Needs -f flag for overwriting existing SSH keys

@Frijol can we move these to #64? This issue seems redundant? Also, I believe we decided to not have Tessels automatically be provisioned so we can remove that checkbox.


text:
Define minimal tesseract dependancies

I tried to build (cmake&clang) tesseract with minimal dependencies, so I build leptonica without any dependencies (not even zlib). Build finished fine,  tesseract -v produced:
tesseract 4.1.0-rc1-97-g681e
 leptonica-1.78.0 (Mar 13 2019, 19:12:40) [MSC v.1915 LIB Release x64]
  (null)
 Found AVX2
 Found AVX
 Found SSE

But when I run tesseract test.pnm -  it produced following error messages and than it crashed:
Error in pixReadMemTiff: function not present
Error in pixReadMem: tiff: no pix returned
Error in pixaGenerateFontFromString: pix not made
Error in bmfCreate: font pixa not made
Warning: Invalid resolution 0 dpi. Using 70 instead.
Estimating resolution as 333
Error in pixWriteMemPng: function not present

These indicates that there are several must dependencies for running tesseract (tiff, png and therefore zlib...) and they have to be checked (bmfCreate and pixReadMem)  during configuring build.
More advance approach would to analyze if relevant code could be skipped - but than we should somehow distribute information about not available API (e.g. ProcessPagesMultipageTiff).

Looks like a bug in baseapi.cpp.

Leptonica is normally used as a shared library. So it is possible to provide a minimal liblept.so which obviously causes a crash or to use a full liblept.so which will work fine.
Therefore I think it is not a build problem, but a problem of the error handling at runtime (which should also be fixed, of course).

Leponica can handle pnm format without any dependency.

what about adding minimum versions of python (3.6) and bash (4.4) for training tools?

@Shreeshrii: we can put  info about minimum dependencies to README,md.
Maybe I found some time to rewrite python script to 3.5 compatible version (it should not be a big issue) or at least to check python version at the begin...

@amitdo : this was exactly reason why I use pnm format: I guess this minimal tesseract&leptonica version is needed by tesseract wrapper (python, java maybe C#) that will use its standard way for opening files and pass only image data to tesseract.

@stweil : you are right - I did not calculate with scenario with replacing shared leptonica with version with less features (which I did yesterday on linux "successfully").
But to do check at build time is IMO first step (that can actually hide this bug).
Anyway to have working tesseract and leptonica library without any other dependency should be finale target.

what about adding minimum versions of python (3.6) and bash (4.4) for training tools?

Why bash >= 4.4, has that actually been ascertained?

Here are more details if anybody would like to help it:

Building leptonica with libpng (and therefore zlib) support is sufficient to avoid crash.
Just api->Init("./tessdata", nullptr); will cause error messages (but not crash):

Error in pixReadMemTiff: function not present
Error in pixReadMem: tiff: no pix returned
Error in pixaGenerateFontFromString: pix not made
Error in bmfCreate: font pixa not made

api->SetImage(pixs) is working ok (at least PIX* check = api->GetInputImage() confirm it)
cash will be caused by calling outText = api->GetUTF8Text() (without png support):

Warning: Invalid resolution 0 dpi. Using 70 instead.
Error in pixWriteMemPng: function not present
Error in pixReadMem: Unknown format: no pix returned
src_pix != nullptr:Error:Assert failed:in file imagedata.cpp, line 232

Assert is because GetPixInternal did not return pix because pixReadMem did not find format of image_data_. Reason for it that image_data_  should be stored with png format which is not available...

Crash is fixed. Init is open for improvement.

authors: Shreeshrii amitdo bertsky stweil zdenop

repo: tesseract-ocr/tesseract


text:
[Bug]: MSSQL Container crashes on Ubuntu 24.04 (Colima)

Testcontainers version
3.9.0
Using the latest Testcontainers version?
Yes
Host OS
MacOS
Host arch
ARM
.NET version
8.0.302
Docker version
Client:
 Cloud integration: v1.0.35+desktop.10
 Version:           25.0.2
 API version:       1.44
 Go version:        go1.21.6
 Git commit:        29cf629
 Built:             Thu Feb  1 00:18:45 2024
 OS/Arch:           darwin/arm64
 Context:           colima

Server: Docker Engine - Community
 Engine:
  Version:          27.1.1
  API version:      1.46 (minimum version 1.24)
  Go version:       go1.21.12
  Git commit:       cc13f95
  Built:            Tue Jul 23 19:57:14 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.7.19
  GitCommit:        2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41
 runc:
  Version:          1.7.19
  GitCommit:        v1.1.13-0-g58aa920
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

Docker info
Client:
 Version:    25.0.2
 Context:    colima
 Debug Mode: false
 Plugins:
  buildx: Docker Buildx (Docker Inc.)
    Version:  v0.12.1-desktop.4
    Path:     /Users/wej2be/.docker/cli-plugins/docker-buildx
  compose: Docker Compose (Docker Inc.)
    Version:  v2.24.3-desktop.1
    Path:     /Users/wej2be/.docker/cli-plugins/docker-compose
  debug: Get a shell into any image or container. (Docker Inc.)
    Version:  0.0.22
    Path:     /Users/wej2be/.docker/cli-plugins/docker-debug
  dev: Docker Dev Environments (Docker Inc.)
    Version:  v0.1.0
    Path:     /Users/wej2be/.docker/cli-plugins/docker-dev
  extension: Manages Docker extensions (Docker Inc.)
    Version:  v0.2.21
    Path:     /Users/wej2be/.docker/cli-plugins/docker-extension
  feedback: Provide feedback, right in your terminal! (Docker Inc.)
    Version:  v1.0.4
    Path:     /Users/wej2be/.docker/cli-plugins/docker-feedback
  init: Creates Docker-related starter files for your project (Docker Inc.)
    Version:  v1.0.0
    Path:     /Users/wej2be/.docker/cli-plugins/docker-init
  sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
    Version:  0.6.0
    Path:     /Users/wej2be/.docker/cli-plugins/docker-sbom
  scout: Docker Scout (Docker Inc.)
    Version:  v1.3.0
    Path:     /Users/wej2be/.docker/cli-plugins/docker-scout

Server:
 Containers: 7
  Running: 0
  Paused: 0
  Stopped: 7
 Images: 8
 Server Version: 27.1.1
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Using metacopy: false
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 2bf793ef6dc9a18e00cb12efb64355c2c9d5eb41
 runc version: v1.1.13-0-g58aa920
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: builtin
  cgroupns
 Kernel Version: 6.8.0-39-generic
 Operating System: Ubuntu 24.04 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 6
 Total Memory: 3.818GiB
 Name: colima
 ID: 1a4caaf2-9a2c-418c-9e3e-afcd48b31029
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http://192.168.5.2:3128
 HTTPS Proxy: http://192.168.5.2:3128
 No Proxy: *.bosch.com,localhost,127.0.0.1
 Experimental: false
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: false

What happened?
Due to the fact that the Oracle XE test container is only available for x64 architectures ATM, we needed to use Colima. The oracle container works fine but the MSSQL does not start, when I just run the used image, I can see the following errors:
➜  colima docker run -e "ACCEPT_EULA=Y" -e "MSSQL_SA_PASSWORD=yourStrong\!Password" -e "MSSQL_PID=Evaluation" -p 1433:1433  --name sqlpreview --hostname sqlpreview mcr.microsoft.com/mssql/server:2019-CU18-ubuntu-20.04
SQL Server 2019 will run as non-root by default.
This container is running as user mssql.
To learn more visit https://go.microsoft.com/fwlink/?linkid=2099216.
This program has encountered a fatal error and cannot continue running at Fri Aug 30 12:20:26 2024
The following diagnostic information is available:

         Reason: 0x00000001
         Signal: SIGABRT - Aborted (6)
          Stack:
                 IP               Function
                 ---------------- --------------------------------------
                 00005657df105bec <unknown>
                 00005657df105632 <unknown>
                 00005657df104c41 <unknown>
                 00007c52aa724090 killpg+0x40
                 00007c52aa72400b gsignal+0xcb
                 00007c52aa703859 abort+0x12b
                 00005657df08e2a2 <unknown>
                 00005657df11a154 <unknown>
                 00005657df14f248 <unknown>
                 00005657df14f02a <unknown>
                 00005657df09a11a <unknown>
                 00005657df099d6f <unknown>
        Process: 9 - sqlservr
         Thread: 84 (application thread 0x140)
    Instance Id: 5ac0f825-a6d2-4c1a-a411-7c98228dcb7d
       Crash Id: 05a4bb87-7b7f-4f24-be19-0b4a95194baf
    Build stamp: f708684a2cfcb51177273c54f975ed8c62029cbc89aa962bf7d6b956f01a0c27
   Distribution: Ubuntu 20.04.5 LTS
     Processors: 6
   Total Memory: 4100014080 bytes
      Timestamp: Fri Aug 30 12:20:26 2024
     Last errno: 2
Last errno text: No such file or directory
Capturing a dump of 9
Successfully captured dump: /var/opt/mssql/log/core.sqlservr.8_30_2024_12_20_27.9
Executing: /opt/mssql/bin/handle-crash.sh with parameters
     handle-crash.sh
     /opt/mssql/bin/sqlservr
     9
     /opt/mssql/bin
     /var/opt/mssql/log/

     5ac0f825-a6d2-4c1a-a411-7c98228dcb7d
     05a4bb87-7b7f-4f24-be19-0b4a95194baf

     /var/opt/mssql/log/core.sqlservr.8_30_2024_12_20_27.9

Ubuntu 20.04.5 LTS
Capturing core dump and information to /var/opt/mssql/log...

Now, when I use mcr.microsoft.com/mssql/server:latest, it works (starting the container). I don't know which version "latest" actually is as the most recent version 2019-CU27-ubuntu-20.04 does NOT work some reason.,
However, this version is not compatible with the test container code.
To eventually get it running, I needed to change the wait strategy (notice the "-C" and the "mssql-tools18"):
  private sealed class WaitUntilMssql18Available : IWaitUntil
  {
    // command has moved from "mssql-tools" to "mssql-tools18" in more recent versions of the image
    // -C accepts self signed cert
    private readonly string[] _command = { "/opt/mssql-tools18/bin/sqlcmd", "-C", "-Q", "SELECT 1;" };

    /// <inheritdoc />
    public async Task<bool> UntilAsync(IContainer container)
    {
      var execResult = await container.ExecAsync(_command)
        .ConfigureAwait(false);

      return 0L.Equals(execResult.ExitCode);
    }
  }
}

Same when executing commands:
public static class ContainerExtension {
  public static async Task<ExecResult> ExecScriptAsyncPatched(this DockerContainer container, string scriptContent, CancellationToken ct = default)
  {
    var scriptFilePath = string.Join("/", string.Empty, "tmp", Guid.NewGuid().ToString("D"), Path.GetRandomFileName());

    await container.CopyAsync(Encoding.Default.GetBytes(scriptContent), scriptFilePath, Unix.FileMode644, ct)
      .ConfigureAwait(false);

    return await container.ExecAsync(new[] { "/opt/mssql-tools18/bin/sqlcmd", "-C", "-b", "-r", "1", "-U", "sa", "-P", "yourStrong(!)Password", "-i", scriptFilePath }, ct)
      .ConfigureAwait(false);
  }
}

So, with this rather ugly hack and hardcoding the credentials, the test container starts and my tests work.
So, would it be possible to update to the latest mssql container version and adjust the exec commands? I could provide a PR for the changes, if it helps.
Relevant log output
No response
Additional information
No response

I think it's actually related to
https://github.com/microsoft/mssql-docker/issues/881
So this seems to be a problem when MSSQL is running on Ubuntu 24.04 which colima apparently is:
wej2be@colima:/Users/wej2be/.config/colima$ cat /etc/*-release
...
PRETTY_NAME="Ubuntu 24.04 LTS"
...

How much memory does your Colima VM have? Increase it to at least 2GB.

@HofmeisterAn I start it with colima start --arch x86_64 --cpu 6 --memory 4 --disk 40, so 4GB.

@HofmeisterAn I start it with colima start --arch x86_64 --cpu 6 --memory 4 --disk 40, so 4GB.

👍 I noticed the Total Memory: 4100014080 bytes as well, but I wanted to double-check because I’ve seen similar issues in the past related to insufficient memory. However, those usually included information about an OOM. Sorry, I haven’t seen anything like this before — it’s probably an issue with Ubuntu 24.04, like you mentioned.

Now, when I use mcr.microsoft.com/mssql/server:latest, it works (starting the container). I don't know which version "latest" actually is as the most recent version 2019-CU27-ubuntu-20.04 does NOT work some reason.,

latest corresponds to: mcr.microsoft.com/mssql/server:2022-CU14-ubuntu-22.04.

Due to the fact that the Oracle XE test container is only available for x64 architectures ATM

Can't you enable the Virtualization Framework and (install) Rosetta 2 using Docker Desktop?

To eventually get it running, I needed to change the wait strategy (notice the "-C" and the "mssql-tools18"):

As mentioned, this issue has been resolved. There are two workarounds available: https://github.com/testcontainers/testcontainers-dotnet/issues/1220#issuecomment-2249508150 and one of them you are already kind of using.
➜  colima docker run -e "ACCEPT_EULA=Y" -e "MSSQL_SA_PASSWORD=yourStrong\!Password" -e "MSSQL_PID=Evaluation" -p 1433:1433  --name sqlpreview --hostname sqlpreview mcr.microsoft.com/mssql/server:2019-CU18-ubuntu-20.04

Since the container already crashes when using the CLI, I don't think this is specifically a Testcontainers issue. Microsoft or Colima will likely need to address the issue to fix it for older versions. I don't think there's much more I can help with, so I would prefer to close the issue.

latest corresponds to: mcr.microsoft.com/mssql/server:2022-CU14-ubuntu-22.04.

oh, I actually tried to find that information, but I  couldn’t find a list with hashed to compare.
But are you sure about this as ‘latest’ was having that mssql-tools regression you mentioned which I thought appeared in later versions.

Can't you enable the Virtualization Framework and (install) Rosetta 2 using Docker Desktop?

hmm, that is actually an interesting idea. I will try that. I think docker desktop even has a config flag for this. My colleague started this and I think he also found references to Colima in the testcontainers docs.

Since the container already crashes when using the CLI, I don't think this is specifically a Testcontainers issue. Microsoft or Colima will likely need to address the issue to fix it for older versions. I don't think there's much more I can help with, so I would prefer to close the issue.

Yes and know. From what I read, the problem is on mssql side. Colima just uses latest Ubuntu LTS. Mssql does some crazy stuff with memory management always has issues when the kernel changes.
coming back to testcontainers, as I found a way to get it working and I don’t know how long it will take for MS to fix it, I though my hacky changes could find its way into the next release.
as you mentioned, the mstools thing is fixed, so it would only be picking the right CU version.

Can't you enable the Virtualization Framework and (install) Rosetta 2 using Docker Desktop?

Just for reference, this does not work. There are a lot of post explaining that as of now you need to use colima to run the oracle on mac. I also just tried it with Docker Desktop and rosetta enabled but the container crashes.

I don't think there are any tasks left. Everything should be addressed in the next release.

Which version of the MSSQL image will be used for the next release?

Which version of the MSSQL image will be used for the next release?

We do not bump module versions to avoid breaking tests for existing Testcontainers users. We recommend that users pin the version according to their needs. Just set and override the image/version using WithImage(string).

The advise to pin a version has been around for like forever. I suggest to change the pinned version in the library to a version that it known to work, and everybody that did not pin it, might get an error.
Like mcr.microsoft.com/mssql/server:2019-CU28-ubuntu-20.04

authors: HofmeisterAn jwedel svrooij

repo: testcontainers/testcontainers-dotnet


text:
Values from docker-java.properties are ignored in EnvironmentAndSystemPropertyClientProviderStrategy

Seems that new releases of testcontainers broke my setup.
Here is a link with the problematic line and proposed solution:
https://github.com/testcontainers/testcontainers-java/commit/8e57ae60565f24c01ec7ef964dc37130a022eba4#r44075175

Hi @bojanv55,
Sorry for this regression! Would you like to submit a PR with a fix?

Also the problem with the configuration via maven-surefire-plugin
<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-surefire-plugin</artifactId>
    <configuration>
	    <systemPropertyVariables>
		    <DOCKER_HOST>tcp://172.31.139.72:2375</DOCKER_HOST>
        </systemPropertyVariables>
     </configuration>
</plugin>

The strategy is not applicable but DockerClientConfig successfully receives data from System.properties

authors: bojanv55 bsideup sgoryachkin

repo: testcontainers/testcontainers-java


text:
[legacy]: target 8 is depricated as of jdk 20

Module
Core
Testcontainers version
tip
Using the latest Testcontainers version?
Yes
Host OS
windows
Host Arch
x86
Docker version
Docker Desktop 4.18.0 (104112) is currently the newest version available.

What happened?
jdk 20 complains jdk8 is obsolate
Relevant log output
testcontainers-java\examples\redis-backed-cache>gradle test
Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for details

> Task :testcontainers-java:buildSrc:jar
:jar: No valid plugin descriptors were found in META-INF/gradle-plugins

> Task :testcontainers-java:testcontainers:compileJava
**warning: [options] source value 8 is obsolete and will be removed in a future release
warning: [options] target value 8 is obsolete and will be removed in a future release
warning: [options] To suppress warnings about obsolete options, use -Xlint:-options.
warning: unknown enum constant ImplementationVisibility.PACKAGE**
  reason: class file for org.immutables.value.Value$Style$ImplementationVisibility not found
C:\temp\ramu\testcontainers-java\core\src\main\java\org\testcontainers\images\AgeBasedPullPolicy.java:14: warning: Generating equals/hashCode implementation but without a call to superclass, even though this class does not extend java.lang.Object. If this is intentional, add '@EqualsAndHashCode(callSuper=false)' to your type.
@Value
^
warning: unknown enum constant ImplementationVisibility.PACKAGE
  reason: class file for org.immutables.value.Value$Style$ImplementationVisibility not found
warning: unknown enum constant ImplementationVisibility.PACKAGE
  reason: class file for org.immutables.value.Value$Style$ImplementationVisibili
Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.
ty not found
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.$ImplementationVisibili
ty not found
See https://docs.gradle.org/8.1.1/userguide/command_line_interface.html#sec:command_line_warningsith -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
BUILD SUCCESSFUL in 52slint:unchecked for details.
10 actionable tasks: 9 executed, 1 up-to-date

Additional Information
No response

There is no plan to drop support Java 8 for now. This is happening due to running with Java 20.

authors: eddumelendez nagkumar


text:
[Enhancement]: Publishing message to Rabbitmq test-container Queue and consuming it

Module
RabbitMQ
Proposal

Currently, looks like we don't support publishing message to Rabbitmq test-container Queue and consuming it.
Also, when this functionality is completed, we should have proper documentation around it.

Can you elaborate on this, please? Are you talking about utility methods to use rabbimq command inside the container?

I'm trying to write integration test for my Spring Application which uses Rabbitmq as Message Broker. In order to do that I have made below mentioned changes,

Adding Rabbitmq container details to the ConnectionFactory,

@Bean
  public CachingConnectionFactory connectionFactory() throws Exception {

    RabbitMQContainer rabbit =
        new RabbitMQContainer(DockerImageName.parse("rabbitmq:3.7.25-management-alpine"));
    rabbit.start();

    final RabbitConnectionFactoryBean rabbitConnectionFactoryBean =
        new RabbitConnectionFactoryBean();
    rabbitConnectionFactoryBean.setHost(rabbit.getHost());
    rabbitConnectionFactoryBean.setPort(rabbit.getAmqpPort());
    rabbitConnectionFactoryBean.setUsername(rabbit.getAdminUsername());
    rabbitConnectionFactoryBean.setPassword(rabbit.getAdminPassword());
    rabbitConnectionFactoryBean.setUseSSL(Boolean.parseBoolean(userSsl));
    rabbitConnectionFactoryBean.setSslAlgorithm(sslVersion);
    rabbitConnectionFactoryBean.setEnableHostnameVerification(false);
    rabbitConnectionFactoryBean.afterPropertiesSet();

    final CachingConnectionFactory connectionFactory =
        new CachingConnectionFactory(rabbitConnectionFactoryBean.getObject());

    return connectionFactory;

Similarly created RabbitTemplate, SimpleRabbitListenerContainerFactory  and using above mentioned connection factory
  @Bean
  public SimpleRabbitListenerContainerFactory rabbitListenerContainerFactory() throws Exception {
    SimpleRabbitListenerContainerFactory factory = new SimpleRabbitListenerContainerFactory();
    factory.setConnectionFactory(connectionFactory());
    factory.setMaxConcurrentConsumers(1);
       return factory;
  }

 @Bean
  public RabbitTemplate amqpTemplate() throws Exception {
    return new RabbitTemplate(connectionFactory());
  }

@Bean
  public Queue abc() {
    return new Queue("abc", false);
  }

Next I'm creating Exchange and Routing Key binding to Queues,

 @Bean
  public Declarables httpBinding() {
    val queue = QueueBuilder.durable("queue").build();
    val declarables = new Declarables(exchange, queue,
        bind(queue).to("exchange")
            .with("routingKey");
    return declarables;
  }

Now, I send message to the Rabbitmq

rabbitTemplate.convertAndSend(exchange, routingKey, "data");

But I don't see my Rabbitmq listener listening to this message here,
 @RabbitListener(id = "1",
      queues = "queue")
  public void listener(final Message message) throws DimensionException {
  // .......
  }

Am I missing something here, as per my understanding the only change that needs to be done is that ConnectionFactory should point to Rabbitmq test container, ryt?
Also, can we do more operations with RabbitMQContainer?
Even, I have bean created for the Queue, I'm getting this error in logs

2023-09-01 00:38:38,888 WARN  [1-1] listener.BlockingQueueConsumer (BlockingQueueConsumer.java:670) - Queue declaration failed; retries left=3
org.springframework.amqp.rabbit.listener.BlockingQueueConsumer$DeclarationException: Failed to declare queue(s):[abc]


text:
Fallback to getDefaultGateway() if "bridge" is unavailable.

Fixes #2239

This was released in https://github.com/testcontainers/testcontainers-java/releases/tag/1.14.0 🎉
Thanks for the contribution!

authors: bsideup rnorth


text:
Request body becomes empty for Content-Type: text/xml;charset=UTF-8

Describe the bug
I am mocking SOAP 1.1 server. My code under test set header to Content-Type: text/xml;charset=UTF-8 (as in spec). With such header my mock body parsing is not working, response.body is empty in logs.
To Reproduce
Steps to reproduce the behavior:

Mock File Content

{{log request.body}}
HTTP/1.1 200 OK

{
    "cid": "{{capture from='body' using='regex' selector='<customerId>(\d+)<\/customerId>'}}"
}

Folder Structure test\POST.mock
Put xml into bug1.xml:

<?xml version="1.0"?>
<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/">
  <soapenv:Header/>
  <soapenv:Body>
    <customerId>1000000000</customerId>
  </soapenv:Body>
</soapenv:Envelope>

Execute curl -vv -H 'Content-Type: text/xml;charset=UTF-8' --data-binary "@bug1.xml" -X POST  http://localhost:8080/test against this mock.
Error Stack Trace

camouflage       | 2022-09-01 15:20:37 debug: ERROR: No match found for specified regex <customerId>(\d+)<\/customerId>
camouflage       | 2022-09-01 15:20:37 debug: Using new line as \n
camouflage       | 2022-09-01 15:20:37 debug: Response Status set to 200
camouflage       | 2022-09-01 15:20:37 debug: Generated Response { "cid": "No match found."}
camouflage       | 2022-09-01 15:20:38 debug: HTTP POST /test :: Query Parameters: {} | Request Headers {"host":"localhost:8080","user-agent":"curl/7.68.0","accept":"*/*","content-type":"text/xml;charset=UTF-8","content-length":"214"} | Request Body {}

Expected behavior
customerId is recognised. It also pass when I changed header to Content-Type: application/x-www-form-urlencoded
Desktop (please complete the following information):

OS: Ubuntu 20.04.4 LTS, environment  from docker-compose (shubhendumadhukar/camouflage-filemanager:latest)

I can workaround it by adding
app.use(express.text({type: () => {return true}})); after https://github.com/testinggospels/camouflage/blob/develop/src/index.ts#L46
But it surely not the best option as it should be, as i am not the JS developer nor have the express insights.

That seems like a valid solution. By using express.text() you are parsing the request body into a plain string. If you want to continue using this solution, you may want to inject it as an external middleware.

Create a file middleware.js at the root of your camouflage project.
Install express globally. npm i -g express
Export NODE_PATH. If you are on mac/linux, run

export NODE_PATH=`npm root -g`

If you are on windows
npm root -g
set NODE_PATH="output of previous command"

Modify middleware.js file as follows:

var require = global.require || global.process.mainModule.constructor._load;
(() => {
    const express = require('express')
    this.app.use(express.text({ type: () => { return true } }));
    this.app.use("/", this.allRoutes);
})();

For more details on middleware injection, refer to the documentation.

Now it seems clear from docs that it can be used in my case too. Issue should be closed now! Thank you for your help.

authors: shubhendumadhukar woodwo

repo: testinggospels/camouflage


text:
wazevo(regalloc): map-free liveness for less memory pressure

this reduces the memory pressure/allocations drastically as you can see in the following result for zig stdlib test compilation:
goos: darwin
goarch: arm64
pkg: github.com/tetratelabs/wazero/internal/integration_test/stdlibs
                                        │   old.txt   │          new_old.txt           │
                                        │   sec/op    │   sec/op     vs base           │
Zig/optimizing/Compile/test-opt.wasm-10   6.200 ± ∞ ¹   4.788 ± ∞ ¹  ~ (p=1.000 n=1) ²
¹ need >= 6 samples for confidence interval at level 0.95
² need >= 4 samples to detect a difference at alpha level 0.05

                                        │    old.txt    │           new_old.txt            │
                                        │     B/op      │     B/op       vs base           │
Zig/optimizing/Compile/test-opt.wasm-10   745.6Mi ± ∞ ¹   583.6Mi ± ∞ ¹  ~ (p=1.000 n=1) ²
¹ need >= 6 samples for confidence interval at level 0.95
² need >= 4 samples to detect a difference at alpha level 0.05

                                        │   old.txt    │           new_old.txt           │
                                        │  allocs/op   │  allocs/op    vs base           │
Zig/optimizing/Compile/test-opt.wasm-10   2.249M ± ∞ ¹   1.249M ± ∞ ¹  ~ (p=1.000 n=1) ²
¹ need >= 6 samples for confidence interval at level 0.95
² need >= 4 samples to detect a difference at alpha level 0.05

which shows that allocation counts gets halved and the memory space gets reduced by like 160MB!

fuzzing time

repo: tetratelabs/wazero


text:
Required / optional fields structure

Current situation
(updated as we confirm/deny the structure)
name
latest
  version
  downloadUrlZip
legacy
  {semver}
      version
      downloadUrlZip

Required field proposals
TBA
Optional field proposals
Inside latest and {semver} blocks:

[ ] help (link to readme/docs site)
[ ] require:
  min {txpsemver}
  max {txpsemver}

Also of interest:

Are we going camelCase or snake_case for keys?
...

Back into this now. I have added a beta block into the example in the repo. That would be optional and also would be overrode by stable if the stable version was higher than the beta version's semver.
I'm trying to figure out the best way to do the download URL endpoints. I'm thinking something like:
"downloadUrlPhp":

Which points to a zip download that can be imported into Textpattern via the more modern plugins directory option. And:
"downloadUrlTxt":

Which points to a download that contains the older txt style file and/or zipped variant thereof.
Is that enough, and viable?
We have to assume that sometimes only one of the above options is available I guess. (i.e. a txt file is available but no source code (PHP), or source code is available but the author has not done a compiled txt file.

That sounds perfectly workable. Perhaps in the next core version we allow all plugin types to be uploaded via the browse... feature. And I'd like to show a preview for all content types, ideally, so that if anyone installs a plugin direct from an endpoint - be it github or via the plugins site - they have visibility of what's going to be installed. I think that's important for trust. If we can build in the option to opt in/out of various chunks during the verify step, even better.

I'm happy with the structure of this JSON file now. So closing this issue.

authors: Bloke philwareham


text:
chams in general glow and glow does not load

i restarted the game and injected and still nothing there is any solution?

i tested and some configs have the chams broken idk why that happens the glow still does not appear 😩

license: WTFPL


text:
ignore broken symlinks (issue #202)

quick fix for #202

Tested, and can confirm this fixes my #202 issue, thanks

Thank you!

authors: carpii revpc18 tfeldmann

repo: tfeldmann/organize


text:
Mssql does a rollback internally that knex doesn't take into account

As the title suggests I had a situation in my code where the following code would result in a TransactionError EABORTED from the internal mssql driver:
knex.transaction(async trx => {
   const id = await trx.do_something_that_errors();
   return await trx.do_something_correct(id);
});

Note: async/await is not the issue, the promise based solution works the same but is less clean
The above code works correctly when tested with sqlite (i.e. it returns a rejected promise based on the first function), but fails with the mssql driver. This would happen because the first database call would cause node-mssql to roll back internally, and then when the final function runs the "already aborted" error would be returned.
My patch fixes that by listening for the rollback event on the driver and ensuring that a rollback only runs once. I'm not sure if this is the fix that the maintainers feel most comfortable with (or if it is even correct) since I'm new to the codebase, but it works correctly for my project.

I've missed this completely... I was googling a bit, I suppose you have SET XACT_ABORT ON it is off by default. Either way this makes sense to support recognising implicit rollback.
This change looks correct, but is missing tests.
@Grimace1975 any comments about this mssql issue?

@RubenSlabbert Any chance you could write a test for this?

Apologies for the delay on this. It looks like this has already been fixed (with tests) in a different way in #1885. The fix seems functionally equivalent, however the linked PR makes it more clear what happened. I'll close this PR.

authors: RubenSlabbert elhigu kibertoad

repo: tgriesser/knex


text:
createData does not support inserting item with same hash key (but different sort key)

https://github.com/thanakijwanavit/nicHelper/blob/036734d5b14fe765dd367a13995c6895d3ecb97c/nicHelper/pynamodb.py#L178
this condition prevents item with the same hash key (but different sort key) to be created

workaround: use id_ as hash+sort and create additional index

repo: thanakijwanavit/nicHelper


text:
thanos query error (Error executing query: multiple matches for labels: grouping labels must ensure unique matches)

thanos version v1.10.0
prometheus version 2.17.1
promsql: sum(rate(container_cpu_usage_seconds_total{name=~"^k8s_.*",image!=""}[5m]) * on (node) group_left() kube_node_labels{label_cluster=~"test",label_region=~"prod"})
Thanos query results : Error executing query: multiple matches for labels: grouping labels must ensure unique matches
prometheus query results:  {} | 7.005033120204937 (In line with normal expectations)

Hi, thanks for your reporting. But I can't reproduce in my env. Are the series returned by metrics kube_node_labels{label_cluster=~"test",label_region=~"prod"} and rate(container_cpu_usage_seconds_total{name=~"^k8s_.*",image!=""}[5m]) as same as between thanos and your origin prometheus?

yes

kube_node_labels{label_cluster=~"test",label_region=~"prod"}

kube_node_labels{label_cluster=~"test",label_region=~"prod"}    the result is the same.
sum(rate(container_cpu_usage_seconds_total{name=~"^k8s_.",image!=""}[5m]))  the result is the same.
rate(container_cpu_usage_seconds_total{name=~"^k8s_.",image!=""}[5m])  too many(Warning! Fetched 14212 series, but displaying only first 10000.   )

Could you check the series returned from kube_node_labels, have multiple series with the same value of label node? If yes, you should aggregate them into one series group by label node.

not at all

not at all.
kube_node_labels{label_cluster=~"test",label_region=~"prod"}
prometheus (Total time series: 74)
thanos (Total time series: 74)

authors: jojohappy lixwlixw

repo: thanos-io/thanos


text:
Refactoring: merge 2 functions in one compact one.

Rationale/Description:
This is part of #2248 .
(/Reworked)
Using structs as refactor

@bwplotka  ok I agree that having structs is useful , I was thinking to add them later on.
How do you suggest to have such structs? Should I just bruteforce them as the actual big structure args we passed? tia :man_astronaut:

@bwplotka looking at the previous pr, one thing I don't understand:
a struct was put to
https://github.com/thanos-io/thanos/pull/2604/files#diff-97b997bb71cef88ab4f8ce34d5bfd5705222b47c7f3c4f91d462fd49a4c4503bR129
the other one https://github.com/thanos-io/thanos/pull/2604/files#diff-6c2257b871fd1196514f664bc7e44cb21681215e0929710d0ad5ceea90b8e122R532
before I will do the refactor,
can we agree that I create a struct with the whole vars here
	httpBindAddr, httpGracePeriod := extkingpin.RegisterHTTPFlags(cmd)
	grpcBindAddr, grpcGracePeriod, grpcCert, grpcKey, grpcClientCA := extkingpin.RegisterGRPCFlags(cmd)

	secure := cmd.Flag("grpc-client-tls-secure", "Use TLS when talking to the gRPC server").Default("false").Bool()
	cert := cmd.Flag("grpc-client-tls-cert", "TLS Certificates to use to identify this client to the server").Default("").String()
	key := cmd.Flag("grpc-client-tls-key", "TLS Key for the client's certificate").Default("").String()
	caCert := cmd.Flag("grpc-client-tls-ca", "TLS CA Certificates to use to verify gRPC servers").Default("").String()
	serverName := cmd.Flag("grpc-client-server-name", "Server name to verify the hostname on the returned gRPC certificates. See https://tools.ietf.org/html/rfc4366#section-3.1").Default("").String()

	webRoutePrefix := cmd.Flag("web.route-prefix", "Prefix for API and UI endpoints. This allows thanos UI to be served on a sub-path. Defaults to the value of --web.external-prefix. This option is analogous to --web.route-prefix of Prometheus.").Default("").String()
	webExternalPrefix := cmd.Flag("web.external-prefix", "Static prefix for all HTML links and redirect URLs in the UI query web interface. Actual endpoints are still served on / or the web.route-prefix. This allows thanos UI to be served behind a reverse proxy that strips a URL sub-path.").Default("").String()
	webPrefixHeaderName := cmd.Flag("web.prefix-header", "Name of HTTP request header used for dynamic prefixing of UI links and redirects. This option is ignored if web.external-prefix argument is set. Security risk: enable this option only if a reverse proxy in front of thanos is resetting the header. The --web.prefix-header=X-Forwarded-Prefix option can be useful, for example, if Thanos UI is served via Traefik reverse proxy with PathPrefixStrip option enabled, which sends the stripped prefix value in X-Forwarded-Prefix header. This allows thanos UI to be served on a sub-path.").Default("").String()

	requestLoggingDecision := cmd.Flag("log.request.decision", "Request Logging for logging the start and end of requests. LogFinishCall is enabled by default. LogFinishCall : Logs the finish call of the requests. LogStartAndFinishCall : Logs the start and finish call of the requests. NoLogCall : Disable request logging.").Default("LogFinishCall").Enum("NoLogCall", "LogFinishCall", "LogStartAndFinishCall")

	queryTimeout := extkingpin.ModelDuration(cmd.Flag("query.timeout", "Maximum time to process query by query node.").
		Default("2m"))

	maxConcurrentQueries := cmd.Flag("query.max-concurrent", "Maximum number of queries processed concurrently by query node.").
		Default("20").Int()

	lookbackDelta := cmd.Flag("query.lookback-delta", "The maximum lookback duration for retrieving metrics during expression evaluations. PromQL always evaluates the query for the certain timestamp (query range timestamps are deduced by step). Since scrape intervals might be different, PromQL looks back for given amount of time to get latest sample. If it exceeds the maximum lookback delta it assumes series is stale and returns none (a gap). This is why lookback delta should be set to at least 2 times of the slowest scrape interval. If unset it will use the promql default of 5m.").Duration()
	dynamicLookbackDelta := cmd.Flag("query.dynamic-lookback-delta", "Allow for larger lookback duration for queries based on resolution.").Hidden().Default("true").Bool()

	maxConcurrentSelects := cmd.Flag("query.max-concurrent-select", "Maximum number of select requests made concurrently per a query.").
		Default("4").Int()

	queryReplicaLabels := cmd.Flag("query.replica-label", "Labels to treat as a replica indicator along which data is deduplicated. Still you will be able to query without deduplication using 'dedup=false' parameter. Data includes time series, recording rules, and alerting rules.").
		Strings()

etc
into a struct called queryConfig which is in same go file as the others? Let me know and thx for review

@bwplotka  on my last commit I made some progress.
Just to clarify one point:
I think that having a method with struct, without state is an anti-pattern. https://github.com/thanos-io/thanos/pull/2267/files#diff-97b997bb71cef88ab4f8ce34d5bfd5705222b47c7f3c4f91d462fd49a4c4503bR22
Instead if we care about having a struct, we should pass it to the function as implemented it here.
A method in golang with struct should be used when it deals with modifying some struct, but in our case , the method is just a place older which is imho confusion.
So I think would be more coherent for us to use just the struct as per commit and then pass it to the functions. Of course we might need to adapt the other parts.

finally I think is ok to have structs but, I think the runQuery function could be also removed.
I could , take care of the other part of the code who introduce the "less" clear pattern so we uniform the code, but I believe that :

having 1 function
having struct
removing the run function

would be the way to proceed. I think since this is a technical debt, I think we might need to consider to fix it correctly everywhere in sake of clarity, even if we might take more time on re-changing the pattern. AFAIK we had only 1 PR which introduced that new pattern with the method

@bwplotka  yep I forgot to remove I think the Draft.. :grin:  I'm short on time this period, would be great if you could resolve the conflicts if possible otherwise I fear I could remove something wrong since I missed a bit the late development on the main branch.. tia

Hey @MalloZup 👋  We're going to cut a release candidate soon, is there any chance for you to push this to the finish line?

I think it just needs a rebase?

@kakkoyun right now unfortunately I don't have time to do this... :( could you as maintainer fix the small things remaining? that would help a lot. I'm sorry for the inconvenient but I am quite busy at moment. Greeting to you and your dog :)

@MalloZup 👍 Of course, thanks for letting us know.

authors: MalloZup kakkoyun


text:
Project Analysis on Thanos

project thanos.docx

@fpetkovski Pretty sure this one can be deleted (and I'm not touching a .docx from GitHub)

authors: VisakhMadathil jpds


text:
[Feature] Jenkins 및 Kubernetes 설정 추가 및 Git 관리 파일 정리

주요 변경 사항

Jenkins 설정 추가

CI/CD 환경 구축을 위한 Jenkinsfile 추가
Jenkins 서버 초기화 및 설정 파일 반영 (.gitconfig, .ssh 등)

Kubernetes 설정 추가

클러스터 환경 설정 및 관련 파일 반영
Docker 및 Kubernetes를 활용한 자동화 배포 워크플로우 준비

Git 관리 파일 정리

보안 유지를 위해 .ssh 디렉토리와 일부 설정 파일을 .gitignore에 추가
.bash_history 및 개인 설정 파일 제외

마스터 브랜치 병합

마스터 브랜치와 feature/jenkins-setup 브랜치의 이력을 병합
병합 시 발생한 충돌 해결 및 이력 정리

병합 목적

Jenkins 및 Kubernetes 환경 설정 파일을 마스터 브랜치에 통합하여 CI/CD 준비 완료
보안 관련 파일 관리 강화
프로젝트의 워크플로우 자동화를 위한 환경 정리

참고

.gitignore 업데이트 내역은 feature/jenkins-setup 브랜치의 커밋 기록에서 확인 가능
세부적인 Jenkins 및 Kubernetes 설정 내용은 프로젝트의 README에 추가 예정

Jenkins 및 Kubernetes 설정 작업 잘하셨습니다. CI/CD 환경 구축이 한층 더 체계화된 것 같아요. 보안 관련 파일 관리도 강화된 점이 좋습니다.

연결 및 병합작업 깔끔하게 잘 해주셨습니다. 수고하셨어요.

변경 사항 상세히 정리해주셔서 감사합니다.


text:
issue with dependency

Hi!
trying to get the code working and running into this issue.
go: finding github.com/thda/tablewriter v0.0.0-20180207080603-aedbbc0800df
Username for 'https://github.com':

We can do a go get github.com/thda/tds without any issues.
But when trying to use inside the project and doing go mod tidy, we get that prompt.
Is there is a dependency on the  private repo above?
thank!

Thanks for reporting. I'll fix this within two days.
I've removed the dependancy to this library so it should not try to resolve it.

Could you please update to v0.1.5 and tell me if it fixes your issue?

Fixed! thank you for quick response! Great work!

authors: barum thda

repo: thda/tds


text:
tag get removed on saving page.

-Laravel Version: 5.6
-Voyager Version: 1.x.dev
-PHP Version: 7.2
-Database Driver & Version: MySQL 5.7
Description:
 tag got removed while saving page from the admin panel. Editor needs update.
Steps To Reproduce:
Edit any page and add any  tag and save page. It will get removed after that.  tag is very important, most of theme using font-awesome nowadays.

This is a bug in TinyMCE HTML editor, but you may use:

Closing as a possible suggestion was given.
Maybe TinyMCE solved that issue as well.

authors: deep12650 ebelendez emptynick

repo: the-control-group/voyager


text:
Switch to python-volapi  instead of running whole browser under the hood

Volafile exposes a websocket API (engine.IO to be more specific) which makes interaction with it quite easy. I'm currently maintaining python-volapi. It covers everything you need for interacting with volafile rooms and getting files' download links. I wrote simple download script that utilizes wget2 as download program (works only on Unix-like systems so far). There is no documentation for python-volapi atm but most of the functions are commented. If you'd be interested in a rewrite, fell free to ask me for help.

https://github.com/kadranel/python-volafile-downloader ;)

authors: kadranel szero