text:
Bug Report: TranslateException Error in DJL Serving - Missing token_type_ids in Model Forward Method

Description
I'm experiencing a TranslateException error when sending requests to a BERT model deployed using DJL Serving. The error indicates a missing token_type_ids argument in the model's forward method.
Steps to Reproduce
1.Start the DJL Serving server with the BERT model loaded.
2.Send a POST request with text data, for example:
curl -X POST "http://localhost:8080/predictions/vector" -H "Content-Type: application/json" -d "[\"This is a test text\"]"

3.The server responds with a TranslateException error.
Expected Behavior
I expected the server to process the text input and return the model's predictions without any errors.
Actual Behavior
The request fails, resulting in the following error message:
{
  "code": 400,
  "type": "TranslateException",
  "message": "forward() is missing value for argument 'token_type_ids'. Declaration: forward(__torch__.transformers.models.bert.modeling_bert.BertModel self, Tensor input_ids, Tensor attention_mask, Tensor token_type_ids) -> Dict(str, Tensor)"
}

Error Messages and Logs
The error message suggests that the model's forward method requires token_type_ids as an argument, which seems to be missing in the request.
Environment Information
docker image: deepjavalibrary/djl-serving
version: 0.23.0-pytorch-cu118
Model used: BERT (GanymedeNil_text2vec-large-chinese)
Additional Context
my model directory contains:
config.json  eval_results.txt  model.py  README.md  serving.properties  special_tokens_map.json  tmparflkllc  tokenizer_config.json  tokenizer.json  traced_model.pt  vocab.txt

serving.properties:
pplication=nlp/text_vectorization
engine=PyTorch
translatorFactory=ai.djl.huggingface.translator.TextEmbeddingTranslatorFactory
option.modelName=traced_model

Attempted Solutions
I have tried different request formats but couldn't resolve the issue.
Reviewed the DJL Serving documentation for any related configuration but found no relevant information.
Requesting Assistance
I am seeking guidance on how to resolve this issue. Specifically, I need to understand if the error is due to a configuration issue on the server-side or if it requires changes in the request format. Any insights or solutions would be highly appreciated.

I got some confused about this doc:
https://github.com/deepjavalibrary/djl-demo/tree/master/djl-serving/workflows/python

It seems that I can load models based python with DJL Serving's workflow and it is unnecessary to use TranslatorFactory,right?

DJL support multiple engines, see: https://docs.djl.ai/docs/serving/serving/docs/modes.html
With Python engine, you can run any python code with model.py. However, run native PyTorch engine (C++) is much more efficient than Python.
You can add the following argument in serving.properties to fix your issue:
includeTokenTypes=true

Adding this in serving.properties can not fix my issue
application=text_vectorization
engine=PyTorch
includeTokenTypes=true
translatorFactory=ai.djl.huggingface.translator.TextEmbeddingTranslatorFactory
option.modelName=vector

when I post the following request
curl -X POST "http://localhost:8080/predictions/vector" -H "Content-Type: text/plain" -d "this is a test text"

Still report error as follows
{
  "code": 400,
  "type": "TranslateException",
  "message": "forward() is missing value for argument \u0027token_type_ids\u0027. Declaration: forward(__torch__.transformers.models.bert.modeling_bert.BertModel self, Tensor input_ids, Tensor attention_mask, Tensor token_type_ids) -\u003e Dict(str, Tensor)"
}

In addition,I would be grateful if you could tell me where the doc about serving.properties's usage is.Maybe you could provide your email or other links so that I could seek your advice.
Thanks a lot!

You can join our slack channel, see: https://github.com/deepjavalibrary/djl#community
Are you using Huggingface mode? Can should share the model_id?
Is that possible you share your model?

We have this model in our model zoo, you can use the following command to run with DJLServing:
djl-serving -m djl://ai.djl.huggingface.pytorch/GanymedeNil/text2vec-large-chinese

And it works with the following curl:
curl -X POST "http://localhost:8080/invocations" -H "Content-Type: text/plain" -d "this is a test text"

You can download the model from your model zoo:
curl -O https://mlrepo.djl.ai/model/nlp/text_embedding/ai/djl/huggingface/pytorch/GanymedeNil/text2vec-large-chinese/0.0.1/text2vec-large-chinese.zip

You can also trace your model with the following command by yourself:
git clone https://github.com/deepjavalibrary/djl.git
cd djl/extensions/tokenizers/src/main/python
pip install -r requirements.txt
python model_zoo_importer.py -m GanymedeNil/text2vec-large-chinese

``

authors: Quincynickyoung frankfliu

repo: deepjavalibrary/djl-serving


text:
Support freeze parameters

This adds a method to support freezing and unfreezing a parameter for transfer
learning. There is also a helper to (un)freeze all paremters in a block, but
without filtering. For more advanced use cases of (un)freezing part of the
parameters in a block, it should be implemented using block.getChildren(),
block.getDirectParameters() and/or block.getParameters().
fixes #392
fixes #1494

Codecov Report

Merging #1544 (45e89b3) into master (bb5073f) will decrease coverage by 1.28%.
The diff coverage is 50.84%.

@@             Coverage Diff              @@
##             master    #1544      +/-   ##
============================================
- Coverage     72.08%   70.79%   -1.29%
- Complexity     5126     5362     +236
============================================
  Files           473      500      +27
  Lines         21970    23373    +1403
  Branches       2351     2541     +190
============================================
+ Hits          15838    16548     +710
- Misses         4925     5552     +627
- Partials       1207     1273      +66

Impacted Files
Coverage Δ

api/src/main/java/ai/djl/modality/cv/Image.java
69.23% <ø> (-4.11%)
:arrow_down:

...i/djl/modality/cv/translator/BigGANTranslator.java
21.42% <ø> (-5.24%)
:arrow_down:

...odality/cv/translator/BigGANTranslatorFactory.java
33.33% <0.00%> (+8.33%)
:arrow_up:

...nslator/InstanceSegmentationTranslatorFactory.java
14.28% <0.00%> (-3.90%)
:arrow_down:

.../modality/cv/translator/YoloTranslatorFactory.java
8.33% <0.00%> (-1.67%)
:arrow_down:

...i/djl/modality/cv/translator/YoloV5Translator.java
5.69% <0.00%> (ø)

...odality/cv/translator/YoloV5TranslatorFactory.java
8.33% <0.00%> (-1.67%)
:arrow_down:

...pi/src/main/java/ai/djl/ndarray/BytesSupplier.java
54.54% <0.00%> (-12.13%)
:arrow_down:

...pi/src/main/java/ai/djl/repository/Repository.java
83.33% <ø> (ø)

...l/training/loss/SigmoidBinaryCrossEntropyLoss.java
64.00% <0.00%> (ø)

... and 209 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 33c29ed...45e89b3. Read the comment docs.

source: gharchive/pull-request

authors: codecov-commenter zachgk

repo: deepjavalibrary/djl

license_type: permissive

license_source: github-api


text:
Training of MobileNetV1 and MobileNetV2 on Mnist and Cifar10

I think the training all get good results and the accuracy seems pretty good as well.
It's just that After the training of Cifar10 with MBNv2 will cause an exception in the end...
Exception in thread "main" ai.djl.MalformedModelException: Unsupported encoding version: 3
at ai.djl.nn.SequentialBlock.loadMetadata(SequentialBlock.java:209)
at ai.djl.nn.AbstractBaseBlock.loadParameters(AbstractBaseBlock.java:288)
at ai.djl.nn.AbstractBaseBlock.loadParameters(AbstractBaseBlock.java:293)
at ai.djl.nn.AbstractBaseBlock.loadParameters(AbstractBaseBlock.java:293)
at ai.djl.BaseModel.readParameters(BaseModel.java:367)
at ai.djl.mxnet.engine.MxModel.loadParameters(MxModel.java:187)
at ai.djl.mxnet.engine.MxModel.load(MxModel.java:129)
at ai.djl.repository.zoo.BaseModelLoader.loadModel(BaseModelLoader.java:160)
at ai.djl.repository.zoo.Criteria.loadModel(Criteria.java:168)
at ai.djl.examples.training.transferlearning.TrainMobileNetV2WithCifar10.testSaveParameters(TrainMobileNetV2WithCifar10.java:199)
at ai.djl.examples.training.transferlearning.TrainMobileNetV2WithCifar10.runExample(TrainMobileNetV2WithCifar10.java:110)
at ai.djl.examples.training.transferlearning.TrainMobileNetV2WithCifar10.main(TrainMobileNetV2WithCifar10.java:69)

Codecov Report

Merging #1878 (ace9ca2) into master (bb5073f) will decrease coverage by 2.46%.
The diff coverage is 66.64%.

@@             Coverage Diff              @@
##             master    #1878      +/-   ##
============================================
- Coverage     72.08%   69.62%   -2.47%
- Complexity     5126     5634     +508
============================================
  Files           473      539      +66
  Lines         21970    24960    +2990
  Branches       2351     2706     +355
============================================
+ Hits          15838    17379    +1541
- Misses         4925     6246    +1321
- Partials       1207     1335     +128

Impacted Files
Coverage Δ

api/src/main/java/ai/djl/modality/cv/Image.java
69.23% <ø> (-4.11%)
:arrow_down:

...rc/main/java/ai/djl/modality/cv/MultiBoxPrior.java
76.00% <ø> (ø)

...rc/main/java/ai/djl/modality/cv/output/Joints.java
71.42% <ø> (ø)

.../main/java/ai/djl/modality/cv/output/Landmark.java
100.00% <ø> (ø)

...main/java/ai/djl/modality/cv/output/Rectangle.java
72.41% <0.00%> (ø)

...i/djl/modality/cv/translator/BigGANTranslator.java
21.42% <0.00%> (-5.24%)
:arrow_down:

...odality/cv/translator/BigGANTranslatorFactory.java
33.33% <0.00%> (+8.33%)
:arrow_up:

...nslator/InstanceSegmentationTranslatorFactory.java
14.28% <0.00%> (-3.90%)
:arrow_down:

.../cv/translator/SemanticSegmentationTranslator.java
0.00% <0.00%> (ø)

.../cv/translator/StyleTransferTranslatorFactory.java
40.00% <ø> (ø)

... and 441 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

authors: codecov-commenter warthecatalyst


text:
При отсутствии первичного стейта первое сообщение об ошибке некорректно

Строка
https://github.com/deeplay-io/retry-subscription/blob/6db204b90d8941e3e192f5bb025791a763b10515/src/retryCollectionSubscription.ts#L118
условие outerCount !== 0 приводит к вот такой последовательности в логе:
instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.414Z INFO Labels: Service started
props: { accountsPrx: Astrid2.DatabasePrx "Accounts/Database -t -e 1.1", defaultMaxHandsLimitPerTable: 80, … } 11 keys

instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.437Z DEBUG Labels: Selected 81 tables for this instance

instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.460Z DEBUG Labels: Subscription dropped, resubscribing
err: { name: "Error", message: "Unexpected 'undefined' value at key '235004417': previous value was already 'undefined'", … } 3 keys
subscription: "accountSessionTableIds"

instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.668Z DEBUG Labels: Subscription dropped, resubscribing
err: { name: "Error", message: "Unexpected 'undefined' value at key '235004417' in initial emission", … } 3 keys
subscription: "accountSessionTableIds"

instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.796Z DEBUG Labels: Subscription dropped, resubscribing
err: { name: "Error", message: "Unexpected 'undefined' value at key '235004417' in initial emission", … } 3 keys
subscription: "accountSessionTableIds"

instance_id=ultron-eco-stage-labels-58cc9d7b56-fmlrj
2022-08-26 08:15:22.907Z DEBUG Labels: Subscription dropped, resubscribing
err: { name: "Error", message: "Unexpected 'undefined' value at key '235004417' in initial emission", … } 3 keys
subscription: "accountSessionTableIds"

Первое сообщение об ошибке некорректное. Последующие верные.

Исправил в версии 📦 0.3.0
Кстати, обрати внимание, что это публичный репозиторий, так что инфу в логах стоит подчищать.

source: gharchive/issue

authors: aikoven eegiazarov

repo: deeplay-io/retry-subscription

license: MIT


text:
Error in transposei()

I found the following error, using the latest nd4j version, workaround is using the normal tranpose();
Demonstration code:
INDArray matrixtest = Nd4j.rand(3,5);
System.out.println("matrixtest: "+matrixtest.shape()[0]+"|"+matrixtest.shape()[1]);
matrixtest.transposei();
System.out.println("matrixtest: "+matrixtest.shape()[0]+"|"+matrixtest.shape()[1]);
matrixtest = matrixtest.transpose();
System.out.println("matrixtest: "+matrixtest.shape()[0]+"|"+matrixtest.shape()[1]);
Output:
matrixtest: 3|5
matrixtest: 3|5
matrixtest: 5|3

Transposed is fixed in the bugfixes branch.

license_source: bigquery


text:
Consider cleaning up preprocessor/normalizer interfaces (breaking changes)

As discussed in https://github.com/deeplearning4j/nd4j/pull/1547, with the introduction of normalization for MultiDataSet, the interface ecosystem has become a bit messy. There's quite some duplication between the interfaces, but unifying them would incur some breaking changes. We could consider this for 0.8.0.
The interface structure right now:
DataSetPreProcessor -> DataNormalization

MultiDataSetPreProcessor -> MultiDataNormalization

With the use of generics, these could be (partially) merged. Also, we could consider making method names more consistent here and there and removing redundant methods.

Next release is 0.8.0 so this might be a good pull request.

How much time do I have? :P

We are doing code freeze in about a week or so. If you want to get this in great if you can't it's not an issue.

Alright, I'll see what I can do. Sounds like it'll be right in time to get 0.8.0 in my production stack I'm building right now, so this would be nice to have for myself too.

@EdeMeijer updates here?

Sort of. I poked around but soon realized it's not as straightforward as I thought it would be. The biggest issue is that DataSet normalizers work with a single INDArray for features and labels while MultiDataSet normalizers work with INDArray[] arrays everywhere. This is not something that can be easily generalized with generics.
However, if there's still time, there's something else I'd like to do. I reworked the whole normalizer serde stuff to support all multi normalizer types and package everything in single files, but I realized it would be better to encode the normalizer's type in the serialized data, so it can be restored without having to know the type beforehand. This way, we could go back from a MultiNormalizerStandardizeSerializer, MultiNormalizerMinMaxScalerSerializer etc to just a NormalizerSerializer facade that works transparently for all types. Also, I'm missing a restore(InputStream) (only implemented restore(File)).
I think I can finish this in a few hours and should be a fairly safe change.

See also #1425 #1650

@AlexDBlack @eraly  is this still an issue? I remember there were normalizer-related changed some time ago...

Yeah, there was a PR that improved functionality for normalizers a long time ago.

authors: AlexDBlack EdeMeijer agibsonccc huitseeker raver119


text:
Fix broken links to docs and update broken function call

The PR includes two fixes:

Update incorrect links to documentation for utils_np.data_dicts_to_graphs_tuple in the "How to represent graphs as a graphs.GraphsTuple" section and the other for utils_tf.data_dicts_to_graph_tuple in the "Creating a constant tensor GraphsTuple from data dicts" section of the notebook.

The final cell, "Block Compositionality" calls the attribute graph_network.variables which throws an AttributeError and is replaced with the get_variables() method. I'm not sure if the goal is to just print the name and shape of the tf.Variables here but that is what it currently does.

I signed it!

I realize the commit essentially rewrites the entire notebook which may be problematic to review so if you need me to reapply the changes line-by-line (for easier reviewing), I'd appreciate pointers on how to go about it (otherwise I would just open the interactive online editor and apply these 3 changes).

Added two more fixes to the correct links within the documentation.

Thanks for the PR..
The documentation is auto generated, so it should fixed itself in the next release. I think the colab demo was already fixed internally, and was fixed externally in one of the bigger releases.
Thanks in any case, and please do not hesitate to submit more PRs!

authors: SwapneelM alvarosg


text:
Modelling a 360 degree view lidar sensor to detect obstacles in Mujoco environments

I want to test and compare various state-of-the-art robot navigation algorithms in Mujoco environments. To do so I want to use a 360 degree view laser range finder  as the master sensor for the robot to navigate in obstacle free space. Can anyone please let me know, if such a sensor is already modeled and available off the shelf for Mujoco. It would be of great help.
I agree that Gazebo simulator already provides such a feature, but the environment and robot model that I'm working on is built in Mujoco simulator. So, could anyone please help me out.
I also came across this safetyGym  where they've a mention about providing such sensor off the shelf. Not sure whether that would work. If anyone has already worked on this, it would of great help if you can share your experience.

I also want to make such a design. Have you solved it

Thank you. That's very helpful to me. I like it, but I do not kown how to fix it

repo: deepmind/mujoco


text:
BatchNorm of ResNet implementation initialized as zero

Hi, I find the scale of the last batch norm of each block is always initialized as zero: https://github.com/deepmind/sonnet/blob/v2/sonnet/src/nets/resnet.py#L93. This looks strange to me. Why don't we just initialize it as 1 instead of 0? Thank you.

Hi! The Sonnet ResNet implementation closely follows this TensorFlow implementation (which also initializes the last batch norm in the residual block to 0): https://github.com/tensorflow/tpu/blob/d35e48588cfdab24aaddd045e37d0e967166931f/models/official/resnet/resnet_model.py#L443.
As for why: for example the Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour paper mentions initializing the last batch norm to 0 for easier training. From section 5.1: Setting γ = 0 in the last BN of each residual block causes the forward/backward signal initially to propagate through the identity shortcut of ResNets, which we found to ease optimization at the start of training.
Does this answer your question?

Thanks @LenaMartens! Very nice explanations. That clears all of my questions.

authors: LenaMartens yzcjtr

repo: deepmind/sonnet


text:
Error in httpserver.cpp on Arch Linux

When installing on Arch Linux, I receive the following error:
make[3]: Leaving directory '/storage/deeponion'
  CXX      DeepOniond-bitcoind.o
  CXX      libbitcoin_server_a-addrdb.o
  CXX      libbitcoin_server_a-addrman.o
  CXX      libbitcoin_server_a-bloom.o
  CXX      libbitcoin_server_a-blockencodings.o
  CXX      libbitcoin_server_a-chain.o
  CXX      libbitcoin_server_a-checkpoints.o
  CXX      consensus/libbitcoin_server_a-tx_verify.o
  CXX      libbitcoin_server_a-httprpc.o
  CXX      libbitcoin_server_a-httpserver.o
httpserver.cpp:73:10: error: ‘deque’ in namespace ‘std’ does not name a template type
   73 |     std::deque<std::unique_ptr<WorkItem>> queue;
      |          ^~~~~
httpserver.cpp:32:1: note: ‘std::deque’ is defined in header ‘<deque>’; did you forget to ‘#include <deque>’?
   31 | #include <support/events.h>
  +++ |+#include <deque>
   32 |
httpserver.cpp: In member function ‘bool WorkQueue<WorkItem>::Enqueue(WorkItem*)’:
httpserver.cpp:91:13: error: ‘queue’ was not declared in this scope; did you mean ‘Enqueue’?
   91 |         if (queue.size() >= maxDepth) {
      |             ^~~~~
      |             Enqueue
httpserver.cpp:94:9: error: ‘queue’ was not declared in this scope; did you mean ‘Enqueue’?
   94 |         queue.emplace_back(std::unique_ptr<WorkItem>(item));
      |         ^~~~~
      |         Enqueue
httpserver.cpp: In member function ‘void WorkQueue<WorkItem>::Run()’:
httpserver.cpp:105:35: error: ‘queue’ was not declared in this scope; did you mean ‘Enqueue’?
  105 |                 while (running && queue.empty())
      |                                   ^~~~~
      |                                   Enqueue
httpserver.cpp:109:31: error: ‘queue’ was not declared in this scope; did you mean ‘Enqueue’?
  109 |                 i = std::move(queue.front());
      |                               ^~~~~
      |                               Enqueue
make[2]: *** [Makefile:7312: libbitcoin_server_a-httpserver.o] Error 1
make[2]: Leaving directory '/storage/deeponion/src'
make[1]: *** [Makefile:11630: install-recursive] Error 1
make[1]: Leaving directory '/storage/deeponion/src'
make: *** [Makefile:754: install-recursive] Error 1

I have attempted the installation with several different configurations:

./configure ## I attempted this with a source build of db4.8 in my $PATH, the AUR db4.8 in $PATH, and the db4.8 that comes with this package

./configure --disable-wallet --without-gui --without-miniupnpc ## As suggested in README.md

./configure --with-incompatible-bdb ## I attempted this with package (db5.3)[https://www.archlinux.org/packages/core/x86_64/db/] from Arch Linux repository

Regardless of the configuration flags, when I sudo make install I end up with the same error

This is an environment issue and not a code base issue, Have you tried the pre-compiled Linux version?
https://github.com/deeponion/deeponion/releases/download/v2.1.2/DeepOnion-2.1.2-x86_64-linux-gnu.tar.gz

I'll attempt it now. Do you know what the environment issue might be?

No really. The error in your logs would be an error in all builds if it were "true". Yet all Windows, OSX and Linux builds are currently passing the Travis CI.
If you really want to build from scratch, I would start the process from scratch again from a clean deeponion dir.

authors: AExept nezero

repo: deeponion/deeponion

license: mit


text:
Ollama: investigate/implement ChatGenerator

It should be possible to pass ChatMessages to LLMs served via Ollama, as done in OpenAIChatGenerator.
We should investigate whether this is feasible and if so create a ChatGenerator.

https://github.com/deepset-ai/haystack-core-integrations/pull/176 - Initial attempt here

Will need to create an integration tile but will be away for the next 2 days

done in #176

repo: deepset-ai/haystack-core-integrations


text:
Update README.md

THIS IS MY FIRST ATTEMPT......
CHANGE IN THE SIZE OF "Follow these simple steps:".

I had make some changes in the README.md file. Wish you to merge it....

repo: deepsourcelabs/good-first-issue


text:
Possibility to invalidate cache/force reload from database

I would like to do atomic operations in the database, like incrementing integers. This is for example possible with rethink db. This increment would be triggered in a RPC call using a direct connection to the database. The problem is the caching layer, how to tell deepstream that it should reload the data from the database to update the cache?

I would suggest that you create a service which sends messages to deepstream through the message connector.
I think a version of the UPDATE message could be used which only contains the record name (and optimally version) which would force deepstream to delete it from the cache and if there are any active subscribers, read it from storage.

Though I'm unsure how this would behave together with the strict versioning of records that deepstream uses...

This won't be possible due to how things are designed. Sorry =(

authors: ronag snc yasserf


text:
[BUG] Why Training on musdb16hq halts or does not complete

[x] I didn't find a similar issue already open.
[x] I read the documentation (README AND Wiki)
[x] I have installed FFMpeg
[x] My problem is related to Spleeter only, not a derivative product (such as Webapplication, or GUI provided by others)

Description

Step to reproduce

Installed using .pip install python..
Run as administrator...
Got .NO.. error

Output
After I run ...spleeter train -p 4stems-finetune.json -d E:\musdb18hq
I never get the training complete msg.

Environment

OS
Windows10

Installation type
pip

RAM available
16Gb

Hardware spec
GTX 760 GPU / CPU Intel(R) Core(TM) i5 CPU  750  @ 2.67GHz   2.66 GHz

Additional context
I ran training on musdb_config.json and 4stems-finetune.json many times repeatedly and its starts as expected then gets about midway or 3/4 of the ways then just hangs for hours doing nothing. I also tried using only half of the musdb dataset and did the same thing. After 1 week of trying to complete this task, with multiple downloads of the musdb dataset, it still keeps failing. All my datasets contains 100 train / 50 test files. I ran the evaluation on the incompleted training results and my table is way off, I'm not sure what's going on and why its halting midway or 3/4 of the way. Am I missing files?..or corrupt files?..incompatabilities?...I'm running python 3.8.10 and spleeter 2.3.0
Any help or suggestions would be appreciated.

Hi @deskstar90,
I can't reproduce your issue.
Is the musdb data actually found?
Do you have info message such as (you may need to use the --verbose option of the CLI to get them):
INFO:spleeter:Loading audio b'E:\musdb18hq/train/Triviul - Angelsaint/drums.wav' from 112.352109 to 124.352109
INFO:spleeter:Audio data loaded successfully
Otherwise, it may be a windows specific issue. Then, you may want to try to do this using docker: We currently don't provide up-to-date gpu image, but there are old deprecated ones (with legacy spleeter versions) such as researchdeezer/spleeter:3.7-gpu that should still work.

@romi1502 ,  This is the file with the --verbose arguement.  After 30hrs it reached 8000 checkpoints, I stopped the process as I don't know if this would take another 20yrs or so to complete. I also find it strange that in #215 the fact that "--verbose" arguement made the training start and without it in the CLI it did nothing..  same as my situation presently with my setups.
Maybe you can tell me what's going on. (I snipped the checkpoints part, otherwise its all redundant)
C:\Users\MCCM\AppData\Local\Programs\Python\Python38\Lib\site-packages\spleeter\configs>spleeter train --verbose -p 4stems-16kHz.json -d E:\musdb18hq
INFO:tensorflow:Using config: {'_model_dir': '4stems-16kHz', '_tf_random_seed': 3, '_save_summary_steps': 5, '_save_checkpoints_steps': 300, '_save_checkpoints_secs': None, '_session_config': gpu_options {
per_process_gpu_memory_fraction: 0.45
}
, '_keep_checkpoint_max': 2, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 10, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}
INFO:spleeter:Start model training
INFO:tensorflow:Not using Distribute Coordinator.
INFO:tensorflow:Running training and evaluation locally (non-distributed).
INFO:tensorflow:Start train and evaluate loop. The evaluate will happen after every checkpoint. Checkpoint frequency is determined based on RunConfig arguments: save_checkpoints_steps 300 or save_checkpoints_secs None.
WARNING:tensorflow:From c:\users\mccm\appdata\local\programs\python\python38\lib\site-packages\tensorflow\python\training\training_util.py:235: Variable.initialized_value (from tensorflow.python.ops.variables) is deprecated and will be removed in a future version.
Instructions for updating:
Use Variable.read_value. Variables in 2.X are initialized automatically both in eager and graph (inside tf.defun) contexts.
INFO:tensorflow:Calling model_fn.
INFO:tensorflow:Apply unet for vocals_spectrogram
WARNING:tensorflow:From c:\users\mccm\appdata\local\programs\python\python38\lib\site-packages\tensorflow\python\keras\layers\normalization.py:534: _colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Colocations handled automatically by placer.
INFO:tensorflow:Apply unet for drums_spectrogram
INFO:tensorflow:Apply unet for bass_spectrogram
INFO:tensorflow:Apply unet for other_spectrogram
INFO:tensorflow:Done calling model_fn.
INFO:tensorflow:Create CheckpointSaverHook.
INFO:tensorflow:Graph was finalized.
INFO:tensorflow:Running local_init_op.
INFO:tensorflow:Done running local_init_op.
INFO:tensorflow:Calling checkpoint listeners before saving checkpoint 0...
INFO:tensorflow:Saving checkpoints for 0 into 4stems-16kHz\model.ckpt.
INFO:tensorflow:Calling checkpoint listeners after saving checkpoint 0...
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Voelund - Comfort Lives In Belief/mixture.wav' from 150.32389551724137 to 170.32389551724137
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Faces On Film - Waiting For Ga/mixture.wav' from 49.4185455862069 to 69.4185455862069
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Snowmine - Curfews/mixture.wav' from 79.33290644827585 to 99.33290644827585
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Jokers, Jacks & Kings - Sea Of Leaves/mixture.wav' from 153.33673779310345 to 173.33673779310345
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Night Panther - Fire/mixture.wav' from 40.18501048275862 to 60.18501048275862
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/The Districts - Vermont/mixture.wav' from 186.06246172413793 to 206.06246172413793
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Port St Willow - Stay Even/mixture.wav' from 214.72627244827586 to 234.72627244827586
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/The Districts - Vermont/mixture.wav' from 150.37737293103447 to 170.37737293103447
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Faces On Film - Waiting For Ga/vocals.wav' from 49.4185455862069 to 69.4185455862069
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Clara Berry And Wooldog - Stella/mixture.wav' from 72.73108606896552 to 92.73108606896552
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/Voelund - Comfort Lives In Belief/vocals.wav' from 150.32389551724137 to 170.32389551724137
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Loading audio b'E:\musdb18hq\train/The Districts - Vermont/mixture.wav' from 43.32210655172413 to 63.32210655172413
INFO:spleeter:Audio data loaded successfully
INFO:spleeter:Audio data loaded successfully
...

Mine is training but not completing for some unknown mystery. Yours is not training at all because you're not pointing to the dataset properly.

@deskstar90
Hi! I downloaded musdB18 from the website,and the file called musdB18-HQ(I am not sure if it is the dataset you are using). it will be nice, if you can give me some suggestions .

repo: deezer/spleeter


text:
fix: allow host+subpath as the source registry for registry-override

Description
Instead of looking for refInfo.Host in the override map loop through the keys and values in i.RegistryOverrides, check if the refInfo.Reference begins with an override key and, if it does, replace that override text with the override value and set it back to actualSrc.
Do not use ImageTransformHostWithoutChecksum since we already have the parsed ref and all the info we need to do the replacement.
Related Issue
Fixes #2135
Type of change

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Other (security config, docs update, etc)

Checklist before merging

[ ] Test, docs, adr added or updated as needed
[x] Contributor Guide Steps followed

@AustinAbro321 signed off and squashed all the commits

This looks good to me. Will need approval from @Racer159 @lucasrod16 @Noxsios

@waveywaves You will need to sign your commits. You can follow this guide https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits. You should see verified next to the commit hash in the UI when it's signed successfully.

@AustinAbro321 done

failing tests updated, can we restart the tests ?

repo: defenseunicorns/zarf


text:
Cannot start platform, if etcd uses SSL

Due to the Security considerations  in our CoreOS cluster I configured etcd to use SSL and client certificates, it works fine, but I cannot make deisctl to start platform.
deisctl --etcd-cafile=/path/to/ca.pem --etcd-certfile=/path/to/cert.pem --etcd-keyfile=/path/to/key.pem --endpoint=https://1.2.3.4:4001 start platform
Configuring, listing, installing worked, but starting did not.
I have checked logs and the Unit Files (eg: deis-store-monitor.service), and I think it hangs at ExecStartPre=/bin/sh -c "etcdctl set /deis/store/hosts/$COREOS_PRIVATE_IPV4 hostname >/dev/null" because etcdctl cannot access etcd, and I have no idea how to tell etcdctl to use client certificate.
I would appreciate any idea, thanks.

I think you'd have to find any instance of etcdctl in any of our scripts and add the ca-file, cert-file, and key-file flags. Because many of our components use etcdctl inside their /bin/boot scripts, I'd think that you'd need to custom-build the components themselves and somehow pass through your cert and key, maybe bind-mounting the file in the container.
Simply put, it's a large undertaking. Thinking off the top of my head, a reasonable approach would be to propose a PR that makes all uses of etcdctl use an environment variable called $ETCD_OPTS or something, which could be passed into the running container. So, for example, the publish loop in a component changes from:
until etcdctl --no-sync -C $ETCD ls >/dev/null 2>&1; do

to
until etcdctl $ETCD_OPTS --no-sync -C $ETCD ls >/dev/null 2>&1; do

It's fine if it's blank, but users could add additional options.

Thanks for the reply, I will think it over next week.
As I see, there are three parts of the task.

UnitFiles and Dockerfiles are supposed to use newer version of etcdctl which already knows the cert options (0.4.6 does not know these options).
Implement $ETCD_OPTS you advised
This is the most difficult to solve simply: the cacert, the cert and the key must be accessible by the containers. Bind-mounting, or generate certs in the Dockerfiles. I will examine the possibilities. If it works I will make a PR.

This is the most difficult to solve simply: the cacert, the cert and the key must be accessible by the containers.

Agreed. I'm not sure how best to achieve this. Maybe we bind-mount /etc/certs or some path on the host into the container, but this starts to go down the route of specific functionality that most Deis users probably wouldn't use.

UnitFiles and Dockerfiles are supposed to use newer version of etcdctl which already knows the cert options (0.4.6 does not know these options).

I think using etcd version differs from the main version used by CoreOS hosts or by Deis containers cannot be maintainable, so a correct and useful PR could be proposed after upgrade of etcd at least v2.0 in the main entities. If this upgrade happens, I will make a PR. Do you think, if it happens in this spring?

but this starts to go down the route of specific functionality that most Deis users probably wouldn't use.

I think, in production enviroment the access to the etcd must be restricted. Using client certificates may be easier than maintain iptables continuously.

Do you think, if it happens in this spring?

We have no idea when CoreOS will release etcd 2.0 into the main release channels.

I think, in production enviroment the access to the etcd must be restricted

We already do that. etcd is currently binding to the private address space on boot such that users external to the cluster cannot access etcd through the node's public IP address, which is why @carmstrong thinks that most users probably wouldn't use this unless they were somehow exposing etcd to the world.

It also depends on how paranoid you are about your cloud provider's internal security. Case in point: Google now HTTPS encrypts traffic all the way through:
http://techcrunch.com/2014/03/20/gmail-traffic-between-google-servers-now-encrypted-to-thwart-nsa-snooping/
It really depends on how much you trust your cloud provider and the security of their network topologies.

I think it is not about the cloud provider's network topologies. For example: I run a wordpress container. WP has a security hole, the bot comes and uploads a php file with a system call inside: etcdctl ls --recursive. The container can reach the private network, so the attacker can read the whole etcd, can't he? Or do I misunderstand something?

that loophole will get closed up via #986, but essentially yes, the container can reach the private network so long as the attacker knows of a way to get the container's host IP address.

Arguably, the attacker only needs to know 172.17.42.1

there is no such thing as a "private" network, unless you're talking about privately monitored networks. I monitor my own subnets but I don't monitor beyond that. Just because you monitor it, doesn't mean you can trust it. All your hosts can and will be compromised. Chat with etsy, they're much better at explaining ramifications of monitoring vs protection than I.

@wenzowski, the mention of 172.17.42.1 was with regard to the default docker0 interface IP address on all CoreOS hosts. Also, that etcd by default binds to INADDR_ANY (0.0.0.0) port 4001, and is reachable from that 172.17.0.0/16 network that is used by all docker containers on a CoreOS host. Meaning, after you've gotten a toehold into your docker container that is your app (via the HTTP traffic that is routed to it), you have carte blanche to 172.17.42.1:4001, which is where the OP of this issue comes into play: using SSL certs restricts access to the etcd instances over the network in addition to enabling encryption of the traffic between them.

Yep exactly @ianblenke thanks for spelling that out. All it takes is one toehold. My point is that even with #986 this will still be a concern. Given this, encrypting etcd traffic seems very important: we should all probably be doing what OP is.

I think there might be an easier (and maybe a better) option: #3572

etcd will be going away in v2 and we won't be able to get to this for the LTS release so I'm going to close this, but thank you very much for posting this :)

It is fine, I am looking forward v2 ;)

authors: bacongobbler carmstrong ianblenke sitya wenzowski

repo: deis/deis


text:
support for parameter type bytes

The CNAB spec merged in https://github.com/deislabs/cnab-spec/pull/83/ to allow bytes as a supported parameter type. It would great to see this implemented in duffle so that other runtimes have an idea on how to support this use case.

@youreddy do you think this is still relevant with the move to JSON schema based definitions? I think that the proper way to handle this is with a string type parameter and appropratie contentEncoding.
We likely need to have some documentation for this.
Duffle could be nice and try and automatically un-encode when things are loaded into the invocation image, but maybe for 1.0 we just support the passing of encoded strings?

authors: jeremyrickard youreddy

repo: deislabs/duffle


text:
Ensure terms of unicode license are being followed

we are bringing in a significant amount of unicode data and algorithms in this project. Unicode license says we're fine BUT we need to include the license statement as per the license. Ensure this is done prior to release.

no, we do not need to do anyfin further. we use the data and facts, not the actual data files. we should be clear. revisit if we pull in the actual files in the future.
worth noting that at the time that this issue was created, we WERE using data files from unicode. but that is no longer the case.

repo: dekarrin/rosed


text:
Cover newer eXist-db versions in tests?

ciao @JKatzwinkel, are you still interested in adding what the summary says? together w/ #30 that'd make a nice release.
i'd find it useful to have a policy that lays out which eXist-db should be supported, but i'm completely unaware what their maintenance policy actually is.

yes i'll look into that next week

FYI: https://github.com/eXist-db/exist/blob/develop/exist-versioning-release.md

be aware of the announcement at the top of the README here, but i can't see any images at ghcr.io.

i dunno, maybe the policy here should be to test against all latest releases of each major branch which are available as container images and never to put effort in keeping support for an eXist-db that is older than two years.

this issue may yield relevant changes.

i dunno, maybe the policy here should be to test against all latest releases of each major branch which are available as container images and never to put effort in keeping support for an eXist-db that is older than two years.

I think this sounds reasonable.

how are we gonna keep track of the respective latest release numbers in each major branch tho? Should we schedule a gh actions workflow which compares the latest versions at https://api.github.com/repos/eXist-db/exist/releases with the ones covered by the ci pipeline?

i'd have said manually on occasion (so at least in preparation of a new release), but sure that check seems reasonable. couldn't it be done as a step on every test run? it could be an extra job, that the actual test executions is depending on (b/c it'd unnecessarily multiply over Python versions).
i doubt that my proposal in the issue mentioned above would be applied for the 3.x series.

solved in #46

authors: 03b8 JKatzwinkel funkyfuture

repo: delb-xml/snakesist


text:
Phone Model: Galaxy J3 Pro Android System Version: 7.0 Error: android.webkit.WebViewFactory$MissingWebViewPackageException: Failed to load WebView provider: No WebView installed

android.webkit.WebViewFactory$MissingWebViewPackageException: Failed to load WebView provider: No WebView installed
at android.webkit.WebViewFactory.getWebViewContextAndSetProvider(WebViewFactory.java:270)
at android.webkit.WebViewFactory.getProviderClass(WebViewFactory.java:330)
at android.webkit.WebViewFactory.getProvider(WebViewFactory.java:194)
at android.webkit.WebView.getFactory(WebView.java:2325)
at android.webkit.WebView.ensureProviderCreated(WebView.java:2320)
at android.webkit.WebView.setOverScrollMode(WebView.java:2379)
at android.view.View.(View.java:4331)
at android.view.View.(View.java:4473)
at android.view.ViewGroup.(ViewGroup.java:579)
at android.widget.AbsoluteLayout.(AbsoluteLayout.java:55)
at android.webkit.WebView.(WebView.java:627)
at android.webkit.WebView.(WebView.java:572)
at android.webkit.WebView.(WebView.java:555)
at android.webkit.WebView.(WebView.java:542)
at im.delight.android.webview.AdvancedWebView.(Unknown Source)
at java.lang.reflect.Constructor.newInstance0(Native Method)
at java.lang.reflect.Constructor.newInstance(Constructor.java:430)
at android.view.LayoutInflater.createView(LayoutInflater.java:652)
at android.view.LayoutInflater.createViewFromTag(LayoutInflater.java:794)
at android.view.LayoutInflater.createViewFromTag(LayoutInflater.java:734)
at android.view.LayoutInflater.rInflate(LayoutInflater.java:865)
at android.view.LayoutInflater.rInflateChildren(LayoutInflater.java:828)
at android.view.LayoutInflater.rInflate(LayoutInflater.java:873)
at android.view.LayoutInflater.rInflateChildren(LayoutInflater.java:828)
at android.view.LayoutInflater.inflate(LayoutInflater.java:525)
at android.view.LayoutInflater.inflate(LayoutInflater.java:427)
at android.view.LayoutInflater.inflate(LayoutInflater.java:378)
at oklik.flb.jkcash.com.ui.base.BaseActivity.createView(Unknown Source)
at oklik.flb.jkcash.com.ui.base.BaseActivity.onCreate(Unknown Source)
at android.app.Activity.performCreate(Activity.java:6958)
at android.app.Instrumentation.callActivityOnCreate(Instrumentation.java:1126)
at android.app.ActivityThread.performLaunchActivity(ActivityThread.java:2927)
at android.app.ActivityThread.handleLaunchActivity(ActivityThread.java:3045)
at android.app.ActivityThread.-wrap14(ActivityThread.java)
at android.app.ActivityThread$H.handleMessage(ActivityThread.java:1642)
at android.os.Handler.dispatchMessage(Handler.java:102)
at android.os.Looper.loop(Looper.java:154)
at android.app.ActivityThread.main(ActivityThread.java:6776)
at java.lang.reflect.Method.invoke(Native Method)
at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:1496)
at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:1386)

Please make sure Google Chrome or Android System WebView is installed on the device.

I am also getting same exception for android 7 (Naugat) on some random devices, want to know is there any way I can handle this exception, so that I can show users any message to install Android System WebView and chrome without crash app. Because main issue is this I am not able to reproduce same exception on my available devices or emulators and this error is coming in layout binding method onCreateView, from here it crashes.
@Override     public View onCreateView(LayoutInflater inflater, ViewGroup container,                              Bundle savedInstanceState) {         // Inflate the layout for this fragment        return inflater.inflate(R.layout.fragment_webview, false);  // _no webview installed exception here, it crash app_     }

repo: delight-im/Android-AdvancedWebView


text:
White screen and nothing shows

Hi,
Thank you for your efforts.
I'm trying to use your awesome library but I'm getting white page most of the time.
I tried it with m.facebook.com and my site doblist.com they are the same.
I'm trying the sample included with the library.
And I noticed that it's more slow than the original webView
I tried my m.facebook.com and my site on the original and they are working fine.
In the library it show a toast with "Finished loading" then a toast with the title but nothing shows in the webview.
Thank you very much

Thanks for your feedback!

If this was really a bug in this library, I think more people would have noticed it already. I don't see that wrong behavior myself, either. I could be wrong, but the more likely reason is that something in your configuration or setup is wrong. Can you check this again and compare with the README? Thank you.
Yes, checking against popular sites such as Facebook is always the bettermethod for debugging. Thanks for doing this!
I really doubt that this library is significantly slower than the original WebView. That's because this library here is just a very thin wrapper around the original component, and all the heavy lifting (parsing, rendering, etc.) is done in the original component. How did you arrive at this conclusion, by the way? Did you feel it or did you measure it?
What Android version are you running this on?

Hello @mwaclawek ,
Sorry for the late reply I'm so busy these days.

This issue is solved by itself I don't know how but most likely it was some wrong configuration or something related to my internet connection at that moment. But I'm still getting a white page during page loading and after title is received the page shows while in normal webview the page shows during loading and this is better for me

It's really slower than normal webview, it's very obvious for me that it takes longer time to load the page, note that I'm testing against the same page on both webviews. I felt it because it takes noticeable time that makes me sure. BTW how can I measure it? Is there any methods to do that?

I'm using my phone with android version 4.2.2.

Thank you very much for your great efforts and making this great library.
Have a nice day.

Thanks, great to hear that the issue has been resolved :)

Since you stated that you used the example included with this library, the white screen during page load is intentional. In the Activity, you can see that the WebView is hidden in onPageStarted(...) and only shown again in onPageFinished(...). If you don't want this to happen, just remove these lines.
--
In order to measure this, get the System.nanoTime() in onPageStarted(...). Then, in onPageFinished(...), get System.nanoTime() again. Check the difference and divide it by 1 million to get the duration in milliseconds. For the original WebView, you'd have to do this as well, but you'll find the two methods in WebViewClient only.
Maybe that goes away when you change the thing from (1).

authors: EgyptianM mwaclawek


text:
Upon automatic re-connect after a connection outage, a failure to automatically log back in does not update mLoggedInUserId and the Meteor class will therefore still think you are logged in

To replicate this issue, log in to the same user account with two different devices (one being an Android device using Android-DDP).  Configure your logout to use the Meteor.logoutOtherClients() method which will log out all devices for a certain account when one of the devices logs out.  Now, log out on your account on the non-Android device.  Due to the logout configuration stated above, the logout on the non-Android device will cause the Android device to be logged out.  When the Android device gets logged out, its DDP connection is lost and the Android-DDP library gracefully re-establishes the connection.  However, the login token is no longer valid and Android-DDP can't automatically log the Android device back in.  In this circumstance, the mLoggedInUserId field is not cleared and the Meteor class will still return true when isLoggedIn() is called.

Thank you so much!
Please see the following commit: https://github.com/delight-im/Android-DDP/commit/8f95c38f47fdcd12f644cf953205401675655530
I've incorporated your fix in a new commit because I thought it would fit into that callback even better -- and the token should probably be cleared as well :)
Does that make sense? Does it work as intended now?

Your commit looks good, and I agree that that is a better spot for the logic.  Thanks for getting that in there!  It works as intended now.

authors: joshuaswett mwaclawek

repo: delight-im/Android-DDP


text:
Embedded unisphere V9.1.0.15 error in function validate_unisphere

In common.py line 492 in get_uni_version, the return version is <class 'str'>, while with linux unisphere the return version is <class 'dict'>. The version_list = version['version'].split(',') will return TypeError: string indices must be integers

Hi There,
Following the guidelines in our documentation for issues (link) can you provide some additional information on your environment? I'll need them to confirm we are both looking at the same code and versions of requirements.
I have looked at the function and associated response from Unisphere 9.1.0.15...
https://github.com/dell/PyU4V/blob/master/PyU4V/common.py#L482
    def get_uni_version(self):
        """Get the unisphere version from the server.
        :returns: version and major_version e.g. "V9.1.0.2", "91" -- str, str
        """
        version, major_version = None, None
        response = self.get_resource(category=VERSION, no_version=True)
        if response and response.get('version'):
            version = response['version']
            version_list = version.split('.')
            major_version = version_list[0][1] + version_list[1]
        return version, major_version

In the code block above Unisphere returns the following for response = self.get_resource(category=VERSION, no_version=True):
{"version": "V9.1.0.15"}
Processing this response, and only doing so because there was a response and the version key was present, the version value is extracted from the response dict and the string split by . character.
Running this call I get the following returned:
('V9.1.0.15', '91')
Can you please confirm that you are seeing something different from what I outlined here, and if so include all the required details about your env as outlined in our guide for issues.
Thanks!
Michael

hi Michael,
in the linux installed unisphere or directly use array service processes ip unisphere they returned correctly
{"version": "V9.1.0.15"}
now powermax has embedded management unisphere. We will use this for performance metrics collection so using in band HBA fabric on linux server can be eliminated. when use none modified PyU4V connect to that it will return
('V9.1.0.15', '91')
as a result it return TypeError: string indices must be integers
details including the snippets of code and error on them were sent via internal email to Paul Martin, please check with him to see if he can forward you that.

Hi Tommy,
I checked embedded unisphere and it returns the same expected response from the rest API:
{"version": "V9.1.0.15"}
Is the problem that you are expecting to see this returned from get_uni_version() but instead you get returned ('V9.1.0.15', '91')?

Michael, check your email. just forward you the detail. Tommy

Hi Tommy,
Just had a look at the code snippet.
Similar to Paul's response in issue https://github.com/dell/PyU4V/issues/89 can you please com.emc.em.restapi.WrapJsonRoot to its default setting of False and try again?
PyU4V is developed to work out of the box, by setting WrapJsonRoot you are changing the Unisphere REST API response format which is going to impact most, if not all of the functions in PyU4V.
Thanks
Michael

Michael,
We did not change on embedded unisphere one so it should be default to False, and I don’t know how I can do it without Dell support help :) but I might changed your code somewhere for the debugging and forgot to change back. Let me check that later and let you know to confirm if that is the case.
Thanks, Tommy

Michael,
It appears I left the file changed after series debug to make it work. It looks good with embedded unisphere.  sorry for the confusion.

Hi Tommy,
Thanks for the update and letting us know, if you need any more help with any PyU4V problems just open an issue and we will investigate.
Thanks
Michael


text:
add and updatecopyright

Description
Add and update copyright for go files.
GitHub Issues
List the GitHub issues impacted by this PR:

GitHub Issue #

https://github.com/dell/csm/issues/491

Checklist:

[x] I have performed a self-review of my own code to ensure there are no formatting, vetting, linting, or security issues
[x] I have verified that new and existing unit tests pass locally with my changes
[x] I have not allowed coverage numbers to degenerate
[x] I have maintained at least 90% code coverage
[ ] I have inspected the Grafana dashboards to verify the data is displayed properly
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have maintained backward compatibility

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Please also list any relevant details for your test configuration

[ ] NA

Manual inspection of the GUI
I have verified that the dashboards show the data properly while generating I/O and storage resources

[ ] Yes
[x] No

e2e pass

e2e pass

repo: dell/csm-metrics-powerstore


text:
[BUG]: Force delete of pod kicks in late (pod in terminating state for a while)

Describe the bug
When testing a node reboot with a real application we observed that there were two pods as below in terminating state for quite some time and then got finally deleted after the CSI node pod came up running on that WN mm-pool01-blccdmm01-wn001.
eric-bss-em-fm-datbel01fop01-ftp-6dfcb5cfbc-s7n64            0/2     Terminating   0          7m32s               mm-pool01-blccdmm01-wn001
eric-bss-em-fm-datbel01nef01-5f6868cbf4-q5spf                0/4     Terminating   0          12m                 mm-pool01-blccdmm01-wn001

So we wanted to clarify that after the force delete is triggered by CSI which we saw in the logs does it need the CSI to be running to complete the deletion (release and unmount volumes) ?
How about the situation of WN shutdown in which case CSI node pod will be never be running on that node, will force delete work here ?
Did you test a WN total shutdown scenario ?
Is there a specific threshold after which the force delete is triggered ?

time="Fri, 17 Dec 2021 19:55:21 UTC" level=info msg="Deleting pod cembel01/eric-bss-em-fm-datbel01fop01-657c646df6-fmlqb force true"
time="Fri, 17 Dec 2021 19:56:22 UTC" level=info msg="Deleting pod cembel01/eric-bss-em-fm-datbel01nef01-5f6868cbf4-q5spf force true"
time="Fri, 17 Dec 2021 19:56:23 UTC" level=info msg="Deleting pod cembel01/eric-bss-em-fm-datbel01fop01-ftp-6dfcb5cfbc-s7n64 force true"
.
To Reproduce
Steps to reproduce the behavior:

Start about 50 pods with heavy IO.  Mix of pods sharing volumes with pod affinity rule.
Restart the WN.
Observe that few pods might be still in deleting state and force delete completes after the CSI node is up running again on the WN.
...
n. Step n See error

Expected behavior
All the pods must be cleaned successfully and should be stuck in deleting state for long time.
Screenshots
NA
Logs
Share on mail with Tom Watson.
System Information (please complete the following information):
OS/Version: Suse
Kubernetes 1.21
Attaching the logs
Additional context
Add any other context about the problem here.

Here is what we have found from the logs:

Podmon initiate pod cleanup.
Find that node connected status is false.
Podmon report two errors:

Not able to find the pod “level=error msg="Unable to get pod…. not found”
Not able to delete volumeattachment “error msg="Couldn't delete VolumeAttachment …. not found”

Because of above error, Podmon didn't issue delete pod command, hence we see pod still terminating state

Next steps:
Analysis why delete volumeattachment return errors? And also even though delete volumeattachment returns error, it seems there no more volumes to be detached, this also need to be analyzed.

Hello Team,
Is there any progress on the analysis of this issue ?

@eanjtab the team is looking at this and will update the defect.

I have a fix for the "Not able to delete volume attachment" that will be in the next release. I believe that will fix the issue.

Fix for this issue with pull request: https://github.com/dell/karavi-resiliency/pull/102 is merged.

repo: dell/csm


text:
Add requirements to setup.py

Right now pip-installing delphi is broken because it doesn't pull in dependencies. We need to specify runtime dependencies in setup.py (this will probably be mostly copying from requirements.txt)

assigned to Victor, let's try to make sure we're not duplicating the dependencies in both setup.py and requirements, maybe setup.py can just parse requirements.txt? not sure how to deal with them being split into cuda and non-cuda?

There are ways for setup.py to reference requirements.py, or vice versa, but there are also reasons to not do this. First among them being "development requirements (requirements.txt) and different from runtime requirements (setup.py)". For example, you don't need black or isort to run delphi.
https://stackoverflow.com/a/49684835
The cuda/nocuda split introduces an additional complication. I think the best way to handle this in setup.py is probably with extras_required, though I don't know if there's a clean way to get this to integrate with a specific requirements file.

authors: jaidhyani jettjaniak

repo: delphi-suite/delphi


text:
adding in StarRocks entry to integrations page

Adding in StarRocks, a database that can read delta lake. Database was mentioned at the DataBricks keynote this year. https://www.youtube.com/watch?v=CU8krhcNI2M&t=88s

I don't mind a smaller logo that others.  I'd rather keep the logo with the words because we are not well known yet.

@alberttwong note, the name "StarRocks" will be immediately under your logo so it will be seen. I can merge as is but from an esthetic point of view so folks can see your logo, would suggest only having the icon.

@dennyglee I made the changes but it seems like it's stuck on the build.

Sorry about that, the build is fixed now.  @alberttwong - please check https://deploy-preview-332--delta-io-beta.netlify.app/integrations and let me know if this works?  If so, I'll approve, and merge - thanks!

Looks good
On Thu, Aug 31, 2023 at 10:34 PM Denny Lee @.***> wrote:

Sorry about that, the build is fixed now. @alberttwong
https://github.com/alberttwong - please check
https://deploy-preview-332--delta-io-beta.netlify.app/integrations and
let me know if this works? If so, I'll approve, and merge - thanks!
—
Reply to this email directly, view it on GitHub
https://github.com/delta-io/website/pull/332#issuecomment-1702190071,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAFW4JPN5EMY2BEYRAS3LOLXYFXXDANCNFSM6AAAAAA32LTMHI
.
You are receiving this because you were mentioned.Message ID:
@.***>

authors: alberttwong dennyglee

repo: delta-io/website


text:
Add Motoko persistent storage example.

This implements the Motoko persistent storage example found here: https://github.com/dfinity/examples/tree/master/motoko/persistent-storage.
Closes #62

NOTE: the tests make use of the --upgrade-unchanged which needs (at least) DFX v0.10.0.

Hey! Thanks for contributing. There are some things all new contributors need to do: https://github.com/demergent-labs/azle#contributing

The PR for the agreement: #344

I'm working on getting outside PRs to be authorized with our CI/CD. If you could pull the latest from main and push those up to your branch hopefully the tests will be able to run.

Just leaving a note for myself, I think github.event.pull_request.head.ref in the GitHub action is causing the problem now. I have an idea of how to fix it, hang tight.

If you get the latest from demergent-labs/main and push again, the GitHub action tests should now run for you

You also need to change this line to get the correct version of DFX for your tests: https://github.com/demergent-labs/azle/blob/main/.github/workflows/test.yml#L136

It looks like the new version of dfx has broken all of the other tests. A couple options, let me know what you'd like to do. You can remove your example and the new dfx version from test.yml and we'll just merge it in and fix the tests ourselves later once we upgrade dfx across the board, or you can just leave this pull request open until we upgrade dfx across the board. That might be weeks of waiting

Hi @lastmjs, I'll just comment out the part of the test that depends on the latest DFX version.

Please reach out on Telegram, OpenChat, or Twitter @lastmjs and I can send you AZLE

@di-wu I made a mistake, we are asking for all commits to be signed and verified on GitHub before they are committed to the main branch. I accidentally bypassed the check which allowed me to include your unverified commits. Could you sign your commits and get them verified on GitHub, then reopen this pull request? We'll probably remove the commits from main.
The easiest way to sign your commits from the past, once you have GitHub verification and git commit signing setup, is probably to combine all of your commits for this pull request into one new commit for the new pull request.

Actually ignore this request, we'll just deal with the unverified commits for now. If you plan to contribute in the future please have your commits verified.

authors: di-wu lastmjs

repo: demergent-labs/azle


text:
[ci] Updating Catnap Workflow

Description
In this PR I update the workflow file for Catnap to match the configuration of our testing infrastructure.

Merging this PR because it does not introduce any changes in the code base.

repo: demikernel/demikernel


text:
Every component is refreshing

You are using react but why is every component refreshing
it is not optimize , this issue need to be fixed
https://github.com/deminearchiver/tab/assets/112775332/b4bbe32a-53b3-470c-b63f-0d5647e1f9e7

Good evening!
Are you sure you posted the issue in the correct repo? Because the extension I'm seeing is tabliss, to which I am unrelated. My extension uses SolidJS which doesn't re-render everything.

authors: Ayush-may deminearchiver

repo: deminearchiver/tab


text:
Release notes 22.12.0

Status
In Progress

@moishce Doc review completed.

authors: ShirleyDenkberg moishce

repo: demisto/content-docs


text:
Print argument descriptions for blueprint help

Running denali generate --help lists the available blueprints and their descriptions, but doesn't show descriptions for the available flags. Same for denali new and denali addon (which are essentially wrappers over denali generate app/addon).
Running any of those commands with --help should print out the names and descriptions of the available flags.

@davewasmer For this, currently flags are duplicated between commands and blueprints (which might turn into a maintenance headache in the long run).  Is that something you want to continue doing or should we adjust so that flags are static and retrieved from blueprints by both commands and blueprints?

I thought there was an allowExtraArgs flag on the command that would basically ignore additional arguments, so you didn't have to define them on both (the command would essentially define no arguments, and just pass through whatever was provided to the blueprint). Does that not work?

This is now fixed in denali-cli with yargs support.

authors: acorncom davewasmer

repo: denali-js/denali


text:
Updated timestamp does not update

Describe the bug
A clear and concise description of what the bug is.
The updated timestamp does not actually update
Context
Currently, Dendron doesn't modify the frontmatter after it has been created. This will be updated after the LSP migration (https://github.com/dendronhq/dendron/issues/234)

fixed in 0.12.8

repo: dendronhq/dendron


text:
Merge Notes command

Please Select if your Request is Either something new or an Enhancement

[ ] Enhancement of an existing Feature.
[x] Request of a new feature.

Please select the area your request applies to. (Multiple selections are Possible)

[ ] Onboard. Initial vault setup and import/export pods
[x] Create. Note creation, lookup, snippets and templates
[ ] Retrieve. Backlinks, references, graph view
[x] Structure. Refactoring, multi-vault and schemas
[ ] Publish. Sharing your repo with the world
[ ] Misc (Choose this if your not sure)

Is your feature request related to a problem? Please describe
I have instances where I want to merge notes. Perhaps one was a quick temporary effort and I want to combine it with a better developed one. Maybe I decided two notions belong together. If I paste the content into one of the two, and delete one of the notes, the links to it will be broken.
Describe the solution you'd like
Implement a command Merge Notes that would:

take note 1 and paste its content at the end of note 2
delete note 1
refactor links to point to note 2

Describe alternatives you've considered
One can do this via search/replace but this is slower

This could be useful, but I think the next-best workaround would be to use note references
Keeping links healthy should be a bit easier as the notes are more atomic this way, I think

Sure, possible in many cases. I am just looking at many notes taken in different situations that are all basically the same or are split opportunistically rather than logically. I want to merge them and then split them again as needed. Splitting is easy, merging is messy.

@SR-- interesting request, haven't heard of this before but I think this would make interesting new functionality.

Thanks for considering. Not a high-priority issues perhaps but is ideologically compatible with the dendron manifesto that promises to make organisational structures fungible.

I would love to see this as well!
Another use case would be when you need to export a series of notes as a single file. Say you are writing a book and each chapter is a separate note and when you are done, you want to import it into some other tool to format and make a .pdf or an .epub out of it. It would be easier if you could merge the notes and export/copy-paste just a single file.
Evernote has a Keep copy of original notes option when merging notes which doesn't destroy the original sources. This would be very useful in the use case above. I guess, with this option, the links pointing to the original notes will stay that way and shouldn't be repointed to the new, merged note.

Good point. Another example and related functionality comes to mind in the cases of teaching, or a reserach consultation, or a design/engineering project. If you want to give people an extract on a topic but the notes are not published, or the publishing is overwhelming for the target audience, you might want to give them a note by itself. But if the links are not functional, it might be constraining. So, one might want to import and merge the content of the links into this one note, with some control: all first order links, first and second order links, based on some filtering...

Another use case that prompts this functionality when there are multiple people creating notes independently and the likelihood of them creating a duplicate notes that later would be needed to merge is decently high.

This issue is featured in this week's round of CROP voting on Dendron's Discord server.

This feature has been shipped with v109.
Please give it a try and give us feedback if you think it could be improved in any way.
There has been many discussion points in this thread that are not implemented yet, and we are keeping a reference of those for later enhancements.

authors: SR-- aleksey-rowan hikchoi kpathakota nickolay-kondratyev teauxfu


text:
select error with NULL

when select columns follow a NULL column,all return ''.why?

I'd like to add that:
e.g: select a,b from table. when a,b both type of varchar(max) and b is NULL and a has a value  suggest "abc",the result find a is "" . i want to kown what is the matter?
when select a from table. a is "abc"

I'd like to add that:
e.g: select a,b from table. when a,b both type of varchar(max) and a is NULL and b has a value suggest "许某某",the result find b is "" . i want to kown what is the matter?
when select b from table. b is "许某某"

I got the same issue. I use rows.Scan() to store each column values into a struct. If a field value is NULL, then all the following columns get their zero value.

Interesting. I can try to reproduce this. @mingzhangyang is it possible to create a self contained example of this that reproduces the behavior?

@kardianos Thank you very much for your kind reply. I have resolved the problem. It has nothing to do with the driver. But one need to use sql.NullString etc. to make the Scan to proceed successfully as a NULL value encountered. I guess @wobuxiangtong got the similar trouble.

authors: kardianos mingzhangyang wobuxiangtong

repo: denisenkom/go-mssqldb


text:
Two references to the same object is considered cyclic reference

    class Program
    {
        class A
        {

        }

        class B
        {
            public A X { get; set; }
            public A Y { get; set; }
        }

        static void Main(string[] args)
        {
            var a = new A();
            var b = new B
            {
                X = a,
                Y = a
            };
            b.Should().BeNull();
        }
    }

Throws exception with message:
Expected object to be <null>, but found

FluentAssertionsBug1.Program+B
{
   X = FluentAssertionsBug1.Program+A
   {
   }
   Y = {Cyclic reference to type FluentAssertionsBug1.Program+A detected}
}.

But that is not a cyclic reference.

This is probably also related to #192

I doubt when to fix this since it requires API changes in the IValueFormatter interface.

authors: IharBury dennisdoomen

repo: dennisdoomen/FluentAssertions


text:
Consider to remove visibility=hidden when elements are not in viewport

Handle the potential side effects of removing the mentioned style rule (mainly flickering on initial rendering, before the CSS file is loaded). If side effects are present, consider other ways (eg. injecting style as needed using react-helmet)

This may be automatically fixed by #8

repo: dennismorello/react-awesome-reveal


text:
Gettin error while running idc_train.py

Error:
INFO:tensorflow:Using config: {'_task_type': None, '_task_id': 0, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0xd27c57c88>, '_master': '', '_num_ps_replicas': 0, '_num_worker_replicas': 0, '_environment': 'local', '_is_chief': True, '_evaluation_master': '', '_tf_config': gpu_options {
per_process_gpu_memory_fraction: 1.0
}
, '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_secs': 600, '_save_checkpoints_steps': None, '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_model_dir': None}
WARNING:tensorflow:From /Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/monitors.py:267: BaseMonitor.init (from tensorflow.contrib.learn.python.learn.monitors) is deprecated and will be removed after 2016-12-05.
Instructions for updating:
Monitors are deprecated. Please use tf.train.SessionRunHook.
INFO:tensorflow:No glove/vocab path specificed, starting with random embeddings.
Traceback (most recent call last):
File "", line 1, in
runfile('/Users/vinilthombrey/Downloads/chatbot-retrieval-master/udc_train.py', wdir='/Users/vinilthombrey/Downloads/chatbot-retrieval-master')
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/spyder/utils/site/sitecustomize.py", line 705, in runfile
execfile(filename, namespace)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/spyder/utils/site/sitecustomize.py", line 102, in execfile
exec(compile(f.read(), filename, 'exec'), namespace)
File "/Users/vinilthombrey/Downloads/chatbot-retrieval-master/udc_train.py", line 64, in
tf.app.run()
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 48, in run
_sys.exit(main(_sys.argv[:1] + flags_passthrough))
File "/Users/vinilthombrey/Downloads/chatbot-retrieval-master/udc_train.py", line 61, in main
estimator.fit(input_fn=input_fn_train, steps=None, monitors=[eval_monitor])
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 281, in new_func
return func(*args, **kwargs)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/estimators/estimator.py", line 430, in fit
loss = self._train_model(input_fn=input_fn, hooks=hooks)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/estimators/estimator.py", line 927, in _train_model
model_fn_ops = self._get_train_ops(features, labels)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/estimators/estimator.py", line 1132, in _get_train_ops
return self._call_model_fn(features, labels, model_fn_lib.ModeKeys.TRAIN)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/contrib/learn/python/learn/estimators/estimator.py", line 1103, in _call_model_fn
model_fn_results = self._model_fn(features, labels, **kwargs)
File "/Users/vinilthombrey/Downloads/chatbot-retrieval-master/udc_model.py", line 39, in model_fn
targets)
File "/Users/vinilthombrey/Downloads/chatbot-retrieval-master/models/dual_encoder.py", line 54, in dual_encoder_model
tf.concat(0, [context_embedded, utterance_embedded]),
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/ops/array_ops.py", line 1029, in concat
dtype=dtypes.int32).get_shape(
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 639, in convert_to_tensor
as_ref=False)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 704, in internal_convert_to_tensor
ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 113, in _constant_tensor_conversion_function
return constant(v, dtype=dtype, name=name)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/constant_op.py", line 102, in constant
tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape))
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/tensor_util.py", line 370, in make_tensor_proto
_AssertCompatible(values, dtype)
File "/Users/vinilthombrey/anaconda/lib/python3.6/site-packages/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible
(dtype.name, repr(mismatch), type(mismatch).name))
TypeError: Expected int32, got list containing Tensors of type '_Message' instead.

Same error, did you found a solution?

Changing tf.concat(0, [context_embedded, utterance_embedded]) to tf.concat([context_embedded, utterance_embedded], 0) resolved the issue

This should be counted as one of the errors caused by different version of tensorflow

authors: amycardoso nidhikamath91 seaweiqing thombrey-vinil

repo: dennybritz/chatbot-retrieval


text:
Implement common traits for TranspiledSource

I've recently run into the issue that TranspiledSource is not Clone, requiring me to manually clone each field. Considering that a derive is trivial here, it should hopefully save some headaches in the future.
I've also implemented all other relevant traits from STD, based on https://rust-lang.github.io/api-guidelines/interoperability.html#types-eagerly-implement-common-traits-c-common-traits.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

authors: CLAassistant cd-work


text:
Awx create credential

Hi all I am trying to create a credential with terraform to awx. I really don't know what I need to put in inputs field. Here is my code:
resource "awx_credential" "add_cred" {
credential_type_id = 29
inputs = "username"
name = "${var.hostname}"
organization_id = 1
}
I also tried:
inputs = [
password = "${var.password}"
username = "userneme"
]
Does someone have a sample code or a solution?

Here is what working for me, prob there is other way to do define the inputs but I have been sticking to this since.
resource "awx_credential" "ssh_user_test" {
  name               = "SSH User"
  credential_type_id = 1
  description        = "SSH user with KeyPair"
  organization_id    = 1
  inputs = jsonencode(
    {
      "ssh_key_data" : "",
      "username" : "local_user"
    }
  )
}

I really don't know what I need to put in inputs field

You can use AWX API to see which input fields are expected and required by each credential type:

Access AWX API https://<your awx domain.example.com>/api
List all the credential types to find the one you want to create a credential

https://<your awx domain.example.com>/api/v2/credential_types/

Then make sure on your terraform code you are providing at least the input fields listed under required and you should be fine

authors: Arjunasvr fivetran-joliveira survfate

repo: denouche/terraform-provider-awx


text:
Change title position

The title is here aligned left by default. is there a way to set it to align middle and change it's size

Looking for solution for the same issue..

That is also my question.

make new string value in strings.xml CENTER
and in com.denzcoskun.imageslider.ImageSlider set app:iss_text_align="@string/center"

make new string in strings.xml names center value CENTER
and in com.denzcoskun.imageslider.ImageSlider set app:iss_text_align="@string/center"

authors: PiyushKumarDongre mukesunke okpin piru72

repo: denzcoskun/ImageSlideshow


text:
[FR] Be able to configure version_requirement_updates differently for production and development dependencies

Hello there 👋
First of all thanks for this amazing tool, we've been using it on https://github.com/usabilla, inside our private repositories, for a while now, since #1230 👌
There's one feature that I'd like to share an idea with you about it: give the users the ability to configure the version_requirement_updates option differently for the two kinds of dependencies: production and development.
Something like this:
version: 1 # We are using `dependabot-preview` because of Private Repositories needs (see #2778 and https://github.com/dependabot/dependabot-core/issues/2297#issuecomment-655380840)
update_configs:
  - package_manager: "php:composer"
    directory: "/"
    update_schedule: "daily"
    default_labels:
      - "Dependencies"
    # version_requirement_updates: "auto" // This is how it's today
    version_requirement_updates:
      - match:
          dependency_type: "development"
          requirement_type: "increase_versions"
      - match:
          dependency_type: "production"
          requirement_type: "widen_ranges"

What do you think? And, can you point me to the code where I should do the change to propose a PR? :)

Thanks for the proposal @carusogabriel, I think your suggestion makes total sense. Currently we don't really have the bandwidth to tackle these sort of improvements, but we hope to have more time in a few months to make these kinds of improvements.
I appreciate your offer to tackle this in a PR, unfortunately the code that powers the config file etc is part of the private services we use to run Dependabot at GitHub.

authors: carusogabriel jurre

repo: dependabot/dependabot-core


text:
Re-add AutoMerge

In the dependabot preview there was an option to automatically merge the pr, why has this option been removed?

Closing as a dupe of #1973, which has the information you seek.


text:
General build.sh improvements

Some formatting cleanup
Get realpath of authkeyfile, as this checks its existance
and works after changing directories
turn repetitive blocks into loops
some simplifications
Fix shellcheck (and also run shellcheck on push)

Fixes #5

@bretton This should solve #5 and improve a couple of things. I haven't tested it myself at all though, as I have no setup to do so at the moment.

I tested the changes now (with the ISO changes to save some space on my small test rack). Created mfsBSD iso just fine, but I didn't check if it actually boots or not.

I tested the changes now (with the ISO changes to save some space on my small test rack).

build test works.
install test works, ax41

Thanks a bunch @grembo !

authors: bretton grembo

repo: depenguin-me/depenguin-builder


text:
Implement sorter for Shopware

Hi, @Schrank
I had trouble with dependency for sorting. Ended up deleting it. Please reimplement sorter here:
https://github.com/deployphp/deployer/blob/33bdaacfea8d8ecea41ec299d3556bfcdac10861/recipe/shopware.php#L121-L122
Thanks.

But why topological sort is needed?

Because the shopware plugins are composer packages and can have different dependencies, therefore we need to take care of the right order to activate and install them :-/

@Schrank lets create two recipes? :)

I’ll refactor current recipe to simple recipe. You more complex is needed, consider adding it too? It it okay with everyone?

Updated in b40c641ee21ef1e4cc5921a5dc704d21d8ffd7b5. Please verify in beta.39.

@antonmedv Is the documentation generated by hand or automatically? I would change This task is group task which contains next tasks: to This task is a group task which contains the following tasks:
I'll try the recipe out but on the first glance it looks good!

Yes, it’s generated. See src/Documentation.

authors: Schrank UlrichThomasGabor antonmedv

repo: deployphp/deployer


text:
corrected bug appointed by scrutinizer

Q
A

Bug fix?
Yes

New feature?
No

BC breaks?
No

Deprecations?
No

Fixed tickets
xx

Thank you!
This PR is merged by commit 897205a0825de442eb1c862fef07c253063f192a

authors: oanhnn royopa


text:
ui_script3d example issue

Could not open file /home/trsh/forks/armory_examples/ui_script3d/build_baisc3d/debug/krom/font_default.ttf.

I added droid_sans.ttf to assets and replaced in code, now:
Finished in 2.9882020950317383
Uniform N not found.
Uniform N not found.
Uncaught exception: Cannot cast Object Scene to {
	__name__ : true
}
		throw new js__$Boot_HaxeError("Cannot cast " + Std.string(o) + " to " + Std.string(t));
		^
Error: Cannot cast Object Scene to {
	__name__ : true
}
   at js_Boot.__cast (krom.js:22448:3)
   at sceneInit (krom.js:323:3)
   at Anonymous function (krom.js:6413:5)
   at Anonymous function (krom.js:6933:7)
   at Anonymous function (krom.js:6922:10)
   at iron_Scene.prototype.returnObjectLoaded (krom.js:7232:3)
   at iron_Scene.prototype.returnObject (krom.js:7188:4)
   at Anonymous function (krom.js:7028:5)
   at Anonymous function (krom.js:7545:4)
   at $hxClasses[iron.data.LightData] (krom.js:8780:3)

Will move this issue to the repository at https://github.com/armory3d/armory_examples, marking this one as deprecated and intended for b27 usage.

authors: luboslenco trsh

license: Zlib


text:
Breakpoints on functions not getting hit / getting hit too many times

In the process of implementing the breakpoints file feature I have come across a bug where breakpoints sometimes do not get hit or get hit many more times than excepted (ie. one breakpoint gets hit immediately after calling Continue without the debugged program making any progress).
I wrote a test that reproduces this problem, it's on this branch: https://github.com/aarzilli/delve/tree/continue-bug (it's forked from master, you should be able to pull it if you want). It doesn't happen every time, you will have to run the test repeatedly.
Unfortunately I can not figure out why it happens, it's not hardware breakpoints, btw, I tried disabling them.
Environment is go1.4.2 on linux, as usual.

So, here's what could be happening (although note I haven't dug in too deep yet):
I notice you're setting breakpoints directly on functions. A pure Go function is going to have a prologue that checks the stack size and allocates / copies if necessary. When that allocation is hit, it jumps back up to that prologue and checks again.
As an example of this (disassembled on OSX):
0000000000002000 <main.useless>:
    2000:	65 48 8b 0c 25 a0 08 	mov    %gs:0x8a0,%rcx
    2007:	00 00
    2009:	48 8d 44 24 a0       	lea    -0x60(%rsp),%rax
    200e:	48 3b 41 10          	cmp    0x10(%rcx),%rax
    2012:	77 07                	ja     201b <main.useless+0x1b>
    2014:	e8 27 e9 01 00       	callq  20940 <runtime.morestack_noctxt>
    2019:	eb e5                	jmp    2000 <main.useless>

So that morestack dance is likely what is causing the multiple breakpoint issue. Ideally if we are setting a breakpoint on function entry, we should skip the prologue. This could be done by setting the breakpoint at the first line inside the function instead, or directly after the prologue, which could still be considered the "entrypoint" of the function if it needs to adjust the stack pointer after the prologue is finished.

You seem to be correct about runtime.morestack_noctxt being the cause for the multiple breakpoints. The PR fixes it.
The part about breakpoints not being hit sometimes remains however that seems to actually be connected to hardware breakpoints (I've run TestContinueMulti for 3 hours without errors with hw breakpoints disabled), but it's also much more rare compared to the multiple breakpoint hits.

Fixed by https://github.com/derekparker/delve/commit/a0115e3a15d8a03b78fa23a5d74d1b92ea20b21c

authors: aarzilli derekparker

repo: derekparker/delve


text:
Version 8.1.42

tried 8.1.42 and the Logger errors out. This is probably due to the logback.xml file.

May have been an issue related to Gallo's repo.

I can't reproduce the same logger error.

repo: design-group/ignition-docker


text:
Donating Funds to Type Chain

Hi Type Chain maintainers. I'm Lucas, a core contributor to the Radworks project. https://radworks.org/
We've been using https://github.com/dethcrypto/TypeChain as part of Drips. It's in fact one of our most critical dependencies!
We really appreciate the work you all do and we want to make sure that you are all well-funded to keep doing it. For that reason, we have decided to donate some funds to your project through Drips (an initiative that is coming out of our organization for funding FOSS).
Who can I talk to about it?

Hi @krzkaczor
You can split without collecting. We encourage the recipients of funds to split x% (you could do 100% if you wanted) to their most critical dependencies (or those needing more funds).
Happy to assist in the process :)

repo: dethcrypto/TypeChain


text:
强子求改

雪碧图上不去啊

先补前几天没上传的

代码质量不错，继续努力

authors: devWayne zhjlty

repo: devWayne/SaturnWeb


text:
JupyterLab installed for Python 3.9 instead of Python 3.10 in Universal image

When trying to go through the codespaces-getting-started-ml sample repo in JupyterLab, we are failing to import some packages. This is due to us installing jupyterlab with python 3.9 instead of 3.10. The same does not happen in VS Code.
Repro:

Create a codespace using the repo mentioned above
Connect to JupyterLab using gh cs jupyter
Attempt to run the first cell and notice that it fails to import torch

Notes:

You can verify that this is the issue by running pip list to see that jupyterlab is missing from the list of python 3.10 packages and /usr/local/python/3.9.14/bin/pip list to see that it's installed under python 3.9`

cc. @jungaretti @samruddhikhandale

pip, pip3, python, and python3 are all pointing to the correct installation of Python:
which pip && which pip3 && which python && which python3 && python --version

/home/codespace/.python/current/bin/pip
/home/codespace/.python/current/bin/pip3
/home/codespace/.python/current/bin/python
/home/codespace/.python/current/bin/python3
Python 3.10.7

Notice that the output of pip list does not include jupyterlab:
pip list | grep jupyter

(No output)
However, /usr/local/python/3.9.14/bin/pip list | grep jupyter does include jupyterlab:
/usr/local/python/3.9.14/bin/pip list | grep jupyter

jupyter_client       7.3.5
jupyter-core         4.11.1
jupyter-server       1.18.1
jupyterlab           3.4.7
jupyterlab-pygments  0.2.2
jupyterlab_server    2.15.1

I suspect this is a bug in the Python feature that installs JupyterLab to the "additional version" of Python that we're installing here: https://github.com/devcontainers/images/blob/4690ca1ee6b0ea5c3bef39b14e46c0c33d01824f/src/universal/.devcontainer/devcontainer.json#L27

We use the Python feature's install_user_package helper to install JupyterLab: https://github.com/devcontainers/features/blob/ceb4544cc38d4882a0294c79f4ef8123435cb027/src/python/install.sh#L316-L319
install_user_package installs packages to whatever Python installation is specified by $INSTALL_PATH. Both install_from_source and install_using_oryx overwrite this variable. When we use install_python to install the extra version of Python (3.9), we overwrite $INSTALL_PATH to that installation.
When we install JupyterLab at the end of the script, it uses 3.9's $INSTALL_PATH instead of 3.10.

This is fixed in version 2.0.16 of the Universal image.

repo: devcontainers/images


text:
(chore) - POC tree-shakeable preact/utils

Provides a solution for: https://github.com/developit/preact/issues/1529
I'm going to make a dedicated test-suite for preact/src then because now we only test if it works in /compat
Another way of going about this could be to make the side-effects in compat part of createElement. I still think that webpack would have issues tree-shaking it though. Not quite sure.

Removed forwardRef since this relies on an internal in memo where we replace vnode.ref --> vnode.props.ref.

Coverage remained the same at 100.0% when pulling 0380cea87cd63b9569c90c1ff71de4e202646e0e on feat/utils into 4645f116c4751c4cd1b4cd8bb2ad22ade58a0809 on master.

authors: JoviDeCroock coveralls

repo: developit/preact


text:
add a config parameter for db instance size

Following up on discusion in #129.
While we wait for deployment of eoapi-cdk where database instance size is configurable, this makes it possible to specify the instance size via the CDK_EOAPI_DB_INSTANCE_SIZE environment variable.

🥳 thanks @hrodmn (appreciate the documentation update 🙏 )

authors: hrodmn vincentsarago

repo: developmentseed/eoAPI


text:
geojson-pydantic types expect dicts and not json

The JSON validator of Pydantic expect a string json-formatted.
I understand why it's a good thing to validate python dict object with a valid geojson structure, but what if I already have a geojson string and I want to validate this string with the geojson-pydantic types?
Sure I can json.loads() before but I think it should be automated by the pydantic type.
Also, validate string is coherent with the pydantic.Json validator.

@Vikka I'm not sure what you are trying to do, could you write down some pseudo code please?
pydantic comes with https://pydantic-docs.helpmanual.io/usage/models/#helper-functions which is maybe what you are looking for
from geojson_pydantic import Feature

f = '{"type": "Feature", "geometry": {"type": "Polygon", "coordinates": [[[13.38272, 52.46385], [13.42786, 52.46385], [13.42786, 52.48445], [13.38272, 52.48445], [13.38272, 52.46385]]]}}'

Feature.parse_raw(f)
Feature(type='Feature', geometry=Polygon(coordinates=[[(13.38272, 52.46385), (13.42786, 52.46385), (13.42786, 52.48445), (13.38272, 52.48445), (13.38272, 52.46385)]], type='Polygon'), properties=None, id=None, bbox=None)

FYI I'm going to move this over the discussion because I don't think this is an issue

authors: Vikka vincentsarago

repo: developmentseed/geojson-pydantic


text:
Update page-2.js Footer

Adding Footer to page2

As mentioned in #19

repo: devfolioco/devfolio-gatsby-starter


text:
Cannot get response for multiple outputs

ABI:
{
  "constant": true,
  "inputs": [],
  "name": "getReserves",
  "outputs": [
      {
          "internalType": "uint112",
          "name": "_reserve0",
          "type": "uint112"
      },
      {
          "internalType": "uint112",
          "name": "_reserve1",
          "type": "uint112"
      },
      {
          "internalType": "uint32",
          "name": "_blockTimestampLast",
          "type": "uint32"
      }
  ],
  "payable": false,
  "stateMutability": "view",
  "type": "function"
}

Response:
{
    "decoded": true,
    "methodName": "getReserves",
    "reference": "reserves",
    "returnValues": [
        {
            "hex": "0x8330a9f87e5dccbd7e545b",
            "type": "BigNumber"
        }
    ]
}

Code:
const contractCallContext = [
  {
    abi: PANCAKESWAP_PAIR_ABI,
    calls: [
      {
        methodName: 'getReserves',
        reference: 'reserves',
      },
    ],
    contractAddress: address.checksumAddress,
    reference: 'summary',
  },
];

const response = await multicall.call(contractCallContext);

Expected to have all 3 values in the response.

Turns out this library is a fork of https://www.npmjs.com/package/ethereum-multicall
The original library does not have these problems

repo: devgoeth/ethereum-bsc-multicall


text:
Ability to flip symbols

Hey guys,
The plugin works fine here, but unfortunately I can't flip symbols :/
As the use of symbols is becoming very popular with the recent versions of Sketch, you should consider flipping symbols as well.

+1 I'd like to include this in the next release.
Would you imagine this just using the 'Flip horizontal' command on all symbols, or should it require the user to prefix the symbols they want flipped with something like 'rtl_' in the layer name?

I'm already excited about the next release!
It's good to have a prefix or at least a way to choose only the symbols that I want to flip.
Not all the symbols need to be flipped.

Hey! Any update on that?

Haven't been on top of actively maintaining this repo I'm afraid, open to PRs with updates though.

Latest PR from @k1sina added symbol support. Closing as fixed.

OMG! It seems to work perfectly! It will save a lot of time for my design team!
Next week I have a big project to work on and it will help a lot!
Amazing update :)

I'm happy that I could help you to speed up your project process. 😉

repo: devinmancuso/sketch-rtl


text:
Lockbox instead of ActiveRecord encrypted attributes

Hey!
Is it possible to use lockbox gem instead of ActiveRecord encrypted attributes?

@alec-c4 it is possible to use with lockbox but you can't use the default otp_secret becuase it is encrypted by active record encryption mechanism, I ended up using another column/attribute called otp_secret_custom with lockbox, then in some methods related to this OTP gem you can pass it because the default one is otp_secret

repo: devise-two-factor/devise-two-factor