text:
Correction for raw affiliation ENGEES - École Nationale du Génie de l'Eau et de l'Environnement de Strasbourg (1 quai Koch - BP 61039 - 67070 Strasbourg Cedex - France); UMR GESTE - Gestion Territoriale de l'Eau et de l'environnement (1 quai Koch-BP 61039, F-67070 Strasbourg - France)

Correction needed for raw affiliation ENGEES - École Nationale du Génie de l'Eau et de l'Environnement de Strasbourg (1 quai Koch - BP 61039 - 67070 Strasbourg Cedex - France); UMR GESTE - Gestion Territoriale de l'Eau et de l'environnement (1 quai Koch-BP 61039, F-67070 Strasbourg - France)
raw_affiliation_name: ENGEES - École Nationale du Génie de l'Eau et de l'Environnement de Strasbourg (1 quai Koch - BP 61039 - 67070 Strasbourg Cedex - France); UMR GESTE - Gestion Territoriale de l'Eau et de l'environnement (1 quai Koch-BP 61039, F-67070 Strasbourg - France)
new_rors: 02jhjzd11;00pz29t13
previous_rors: 02jhjzd11;020g0rw41
works_examples: W3121963080;W3127461610;W4283719073;W4289874479
contact: 3f7e68f115f0ea29643e15bb64ff59cf:bd2204f291790df6559be1605c6991a39130 @ inrae.fr

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.

repo: dataesr/openalex-affiliations


text:
Comparatif par chapitre par rapport au français moyen

Ce serait bien à la fin d'avoir le comparatif par chapitre (alimentation, transport...) par rapport au français moyen !

La comparaison semble compliquée au vu des méthodes de calcul très différentes .. Mais l'idée est intéressante

Lié à #100

source: gharchive/issue

authors: Clemog publicodes

repo: datagir/nosgestesclimat-site

license: MIT

license_type: permissive

license_source: github-api


text:
Unexpected columns appear in 'Order and hide' columns dialog if scaffold tree viewer or structure filter is added

Steps to reproduce:

Open a table
Add Scaffold Tree as a viewer or add some structure filter to filters panel
Open 'Order and hide columns' dialog and scroll to the bottom

Expected results: No unexpected columns are added.
Actual results: Columns are added:

These columns are never shown in the actual table which make it more confusing.

DG 1.16.4

DG 1.16.4
Extra columns are stil present in some places:

Column selection for filters:

Column selection dropwdowns for various viewers:

Columns list in properties panel:

Expected: remove those columns in all places where they might unexpectedly appear.

1.16.5

authors: ahadzhanian katerina-stepanova

repo: datagrok-ai/public


text:
Viewers: Tile Viewer: Scroll reset and rendering issues after adding new viewer

[ ] When adding a Tile Viewer and scrolling to the middle, then adding another viewer, the scroll position resets, and the Tile Viewer fails to render. To trigger rendering, manual actions like scrolling or moving elements are required.
[ ] Molecule images flicker and are rendered twice, which should not happen. This issue needs further investigation to ensure smooth rendering.

This issue has been mirrored in Jira: https://reddata.atlassian.net/browse/GROK-17081

The same issue can be reproduced for NX custom viewer.

Hi @katerina-stepanova. Does the NX custom viewer use DG virtual item view?

@drizhina Our viewer is inherited from DG.JsViewer. Not sure what is the 'virtual item view', however our developers say they haven't used this feature, at least not explicitly.
Could you share a link to its documentation if there is any?

added to 1.23.0

The issue with tile viewer has been fixed.
After some investigation, we found the core issue, which is most probably the same in your custom viewers.
The Dock manager of datagrok (the system that docks different viewers together, enables resizing and dragging) physically rearranges the 'viewer nodes' in HTML to position different items in most convinient way. when this happens, the native scroll of rearranged nodes is reset. We fixed it for 'virtual item view', which is the backend of tiles viewer, and also Legend. If your custom viewers were using Virtual item view, then the issue will be fixed on your side as well.

DG 1.22.3 and 1.23.0

authors: LesiaPavlenko ahadzhanian dnillovna drizhina katerina-stepanova


text:
feat(hive): add delta lake support on hms

Current hive ingestion on Datahub cannot parse delta tables since the metadata information of these tables inside hms is limited.
See current behavior:

In this PR, I'm adding a fallback logic to delta lake ingestion when we detect the existence of a delta table registered on hive metadata server. This way, we'll be able to fetch full metadata of such tables.
See my message for the idea and why we are not directly using delta lake ingestion: https://datahubspace.slack.com/archives/C017W0NTZHR/p1680733512266989
Please review this pr for the overall approach to the problem. The code is not tested and I'm planning to refactor my current implementation to get only the table-related information from delta lake, but still using the container information and other related information from hive ingestion.

Hello, I also want to same thing. Can I contact for some discussion ? Thanks.

source: gharchive/pull-request

authors: lhtrong mmmeeedddsss

repo: datahub-project/datahub


text:
Tiles Meta Data Onboarding Process

This PR contains the tiles meta data onboarding process, where the detailed steps are as follows:
File Existence in S3:

The checkFileExistenceInS3 method verifies if a file exists in an S3 bucket by sending a HEAD request and checking the file size.
If the file size is greater than 0 KB, the file exists. If not, fail the process.

Resource Ownership Check:

Validate resource ownership using makeCatApiRequest from the collection onboarding process.

Collection Type Check:

Verify if the collection type is "feature". If it is, fail the process and prompt that this process is for tiles onboarding only. Use the features collection onboarding process for onboarding feature collections.If the collection_type is "map" or "vector", proceed with the process.

Collection Existence Check:

Maintain a boolean variable called pureTile and add it to the requestBody in the code.
If the collection is not present in the collection_details table (indicating a pure tile collection), set pureTile to true and proceed.
If the collection exists, check its type in the collection_type table. If the type is "feature" (indicating a feature + tile collection), set pureTile to false and proceed.
If the type is "map" or "vector", fail the process stating that the collection already exists.

Tile Matrix Set Check:

Ensures if the tileMatrixSet exists in the tms_metadata table by checking the tms_metadata table.

Onboarding Tile Meta Data:
Based on the pureTile boolean variable:

For both tiles-only and tiles + features collection types, insert into the collection_type table and tilematrixset_relation table with all required values.
If pureTile is true (indicating a tiles-only collection type), insert into the collection_details table and ri_details table with all required values.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Build finished.

Open @https://github.com/datakaveri/ogc-resource-server/pull/167

Build finished.

repo: datakaveri/ogc-resource-server


text:
:unique and :unique_index merge causes some inconsistencies

For a more complete look, see:
http://gist.github.com/434435
To summarize briefly:
If the @:unique@ option is used on more than one properties, the unique indicies created in the database and the validations created are either

Inconsistent with each other
Result in redundant queries being issued and/or redundant indicies being created

Created by Jonathan Stott (namelessjon) - 2010-06-11 13:18:17 UTC
Original Lighthouse ticket: http://datamapper.lighthouseapp.com/projects/20609/tickets/1316

@namelessjon is this still a problem?

repo: datamapper/dm-core

license: mit

license_source: bigquery


text:
IPAddr Property does not typecast Resolv::IPv4 / Resolv::IPv6 objects

If you create a Resolv::DNS object to query a specific nameserver, it will return Resolv::IPv4 / Resolv::IPv6 objects instead of Strings. The IPAddr Property does not typecast these objects.

ArgumentError: +value+ must be nil or a String
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-types-1.2.0/lib/dm-types/ip_address.rb:28:in `load'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-types-1.2.0/lib/dm-types/ip_address.rb:37:in `typecast_to_primitive'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/property.rb:686:in `typecast'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/property.rb:625:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource/persistence_state.rb:22:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource/persistence_state/transient.rb:14:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/model/property.rb:237:in `address='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource.rb:333:in `block in attributes='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource.rb:329:in `each'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource.rb:329:in `attributes='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/resource.rb:748:in `initialize'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/property/discriminator.rb:33:in `new'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/gems/dm-core-1.2.0/lib/dm-core/property/discriminator.rb:33:in `new'

Confirmed on master (ddf96829985c):

require 'dm-core'
require 'dm-types'
require 'resolv'

class Test
  include DataMapper::Resource

  property :id, Serial
  property :ip, IPAddress
end
DataMapper.finalize

ip = Resolv::DNS.new(:nameserver => '4.2.2.1').getaddress('www.google.com')
t = Test.new(:ip => ip)

ArgumentError: +value+ must be nil or a String
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-types-ddf96829985c/lib/dm-types/ip_address.rb:21:in `load'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-types-ddf96829985c/lib/dm-types/ip_address.rb:30:in `typecast'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/property.rb:618:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource/persistence_state.rb:22:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource/persistence_state/transient.rb:14:in `set'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/model/property.rb:237:in `ip='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource.rb:333:in `block in attributes='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource.rb:329:in `each'
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource.rb:329:in `attributes='
	from /home/hal/.rvm/gems/ruby-1.9.2-p290/bundler/gems/dm-core-d74ae6e8c4a3/lib/dm-core/resource.rb:748:in `initialize'
	from (irb):16:in `new'
	from (irb):16
	from /home/hal/.rvm/rubies/ruby-1.9.2-p290/bin/irb:16:in `'

repo: datamapper/dm-types


text:
Implement Datacontainer Element

Wir brauchen ein Container, welcher die Datenstruktur verwaltet, aus der sich die GUI bzw. API zusammensetzt und wieder aufbauen lässt.
Dazu soll der Container verschiedene Funktionen bereitstellen um neue Elemente zu registrieren und die entsprechenden Controller per Listener zu benachrichtigen wenn sich Änderungen ergeben haben.

Could the container listen for events on registered components?
So that a view would just emit events instead of calling functions of the container?

authors: datarize tobias-wormstaedt

repo: datarize/lewo


text:
Script to Download and include Supervised Learning

After the contribution of many people we built a gold standard as reference to indicate if a reimbursement is a generalization or not.
Example of generalization:
5635048.pdf
Not a generalization:
5506259.pdf
Our sample of reference consists in 1691 suspicious, and 1691 not suspicious reimbursements link. It was manually curated as explained in this video made by Felipe Cabral apoia.se
The goal of this dataset is to deal with this part of CEAP:

O documento que comprova o pagamento não pode ter rasura, acréscimos, emendas ou entrelinhas, deve conter data e deve conter os serviços ou materiais descritos item por item, sem generalizações ou abreviaturas, podendo ser:

Thus, this issue aims the following:

Transfer the files i have in google drive to Amazon S3
Create a script to download the above files in the toolbox. It could be a new category of datasets, e.g., Supervised Learning
Create a script to download pre-built Machine learn models to Rosie

First objective, find hereafter the files i have:
PNG images
CSV reference
Regarding the CSV files, we have to include the direct link to chamber of deputies. Right now it only has the link to Jarbas.
To easily do that, you have to take the document id from CSV file, and get the full link using a method like that:
def document_url(record):
    return 'http://www.camara.gov.br/cota-parlamentar/documentos/publ/%s/%s/%s.pdf' %\
        (record['applicant_id'],record['year'], record['document_id'])

The Dataset i used was this one:
data = pd.read_csv('../data/2016-11-19-last-year.xz',
                   parse_dates=[16],
                   dtype={'document_id': np.str,
                          'congressperson_id': np.str,
                          'congressperson_document': np.str,
                          'term_id': np.str,
                          'cnpj_cpf': np.str,
                          'reimbursement_number': np.str})

data=data[data['subquota_description']=='Congressperson meal']
data=data[data['document_id'].isin(doc_ids)]
# The doc_ids are retrieved from the csv file

The first objective will allow more people to have access to these curated files in order to replicate and create new experiments!
Second objective: The goal is to call some method like:
from serenata_toolbox.chamber_of_deputies.dataset import Dataset
chamber_of_deputies = Dataset(self.path)
chamber_of_deputies.fetch_supervised_learning()

It makes the integration of the mentioned files easily in other parts of project, e.g., Classifier using these files, Analyse using these data
Third objective, as you can see in the mentioned link: Classifier using these data](https://github.com/datasciencebr/rosie/pull/66)
To upload big files in git is not a good practice. Therefore to facilitate the contribution of new models to Rosie we have to create a method to specify which model we would like to retrieve.
Example right now:
 classifier.__name__ == 'MealGeneralizationClassifier':
 model = classifier()
 model.fit('rosie/chamber_of_deputies/classifiers/keras/model/weights.hdf5')

Proposed:
 classifier.__name__ == 'MealGeneralizationClassifier':
 model = classifier()
 model.fit(self._model('generalization'))

It will allows us in the future to include more models and re-training the existent ones to be more robust.
To this task find hereafter my model:
Meal Generalization
PS: To upload files we have this method in the toolbox remote.py

Thus, this issue aims the following:

Transfer the files i have in google drive to Amazon S3
Create a script to download the above files in the toolbox. It could be a new category of datasets, e.g., Supervised Learning
Create a script to download pre-built Machine learn models to Rosie

Hooray. Let's avoid reinventing the wheel.
Actually these 3 points are already here.. We have methods for that in serenata_toolbox.Datasets. The only detail is that uploading is not open to everybody for security reasons. What people usually do is to share in the PRs a link to a (temporary) storage such as WeTransfer, Dropbox, Google Drive etc. and then someone with the API keys to handle the upload puts the file there.
Also I don't think that by now we need a special directory, method or class for supervisioned learning files.
Finally downloading the PDF is already automated.
That said the focus of this issue is simply to foster the development of a script/method able to generate this file (i.e. port it from the other repository/notebook to the toolbox in case anyone willing to reproduce our steps wants to star for scratch). Basically the starting from .pdf to .png.

Hi @cuducos
Thanks so much for the remarks! I will try my best to highlight the differences i would like to point in this issue.

Actually these 3 points are already here.. We have methods for that in serenata_toolbox.Datasets

I totally agree with you that all methods to download a determined quantity of reimbursements or full datasets are already implemented as well the methods to upload it using proper credentials.
Therefore, the focus of this issue is not to reinventing the wheel, but to integrate these curated reimbursements and files to the serenata_toolbox.

Lets suppose we have a classifier to deal with handwrite reimbursements, and someone would like to test Rosie using these curated files. Since internet connection is always a problem in some regions of Brazil, download 700MB of images (or more) at once reduce the usability of this dataset. Therefore, after to discuss with @jtemporal  we thought that to have a csv file which allows smoothly reconstruct the structure of this dataset (training[positive, negative] | validation[positive/negative] | pos_validation[positive, negative]) could be could be an asset.

Backup of these files: The previous experiences showed that sometimes the chamber of deputies remove the invalid reimbursements.  So what will happen to download link is a mystery. I'm okay to have pdf or png filed stored. The only point is to convert pdf to png is time consuming too. Since we can have a backup of transformed files IMHO is better to have it in png.

Training phase: Since the model of this dataset is hardly changed, to train Rosie which new run to produce the same model is also time consuming. In my machine it took 3 hours. I guess we could have pre-built models that will be changed once a year.

Also I don't think that by now we need a special directory, method or class for supervisioned learning files.
I agree that right now could be early to it. We only have this curated dataset and one classifier. However in case more people build such models, the future architecture of the serenata-toolboox can smoothly deal with this demand. Furthermore, It could open the opportunity to receive new contributions to Rosie.

That said the focus of this issue is simply to foster the development of a script/method able to generate this file (i.e. port it from the other repository/notebook to the toolbox in case anyone willing to reproduce our steps wants to star for scratch). Basically the starting from .pdf to .png
As i mentioned in 1 and in my experience building these curated files, the removal of files in the chamber is always a surprise. While i was publishing the csv in google docs, me and felipe cabral have seen some reimbursements without the link for the pdf, even i had all these files in my computer because i downloaded it one month before.
So, more than reproduce the experiments we are losing curated reimbursements. I mean, we only have the link, not the pdf or image to show it in the chamber and ask for clarifications.
Maybe we could discuss and Restructure it better.

Ok… first a minor comment:

The only point is to convert pdf to png is time consuming too. Since we can have a backup of transformed files IMHO is better to have it in png.

I agree that we could have this receipts converted to PNG and stored. And we can upload anything we want to some storage like S3. The point is that anything uploaded there must be produced from scripts available in our repos ; )
That said, the issue is ver straightforward IMHO:

[ ] Bring fetch_receipt.py to the toolbox
[ ] Implement the code that trains Rosie as part of the toolbox (after all we need to allow most avid collaborators to generate their training models for whatever reason)
[ ] Maybe rename serenata_toolbox.Datasets to something like serenata_toolbox.Storage (to let ir clear that it handles any kind of files, and not only datasets; and TBH there's nothing in its implementation that limits it to datasets, it's basically a file management object).
[ ] Generate a version of the images and of the trained model to upload to the storage (S3)
[ ] Celebrate? ; )

Am I missing anything?
Many thanks for all the effort and clarification, @silviodc — let's tackle it!

Continuing...

The point is that anything uploaded there must be produced from scripts available in our repos ; )

Do you mean, you would like to do this workflow in our machine in order to upload the result to storage?
First workflow:

take the file csv with the references,
download the pdfs,
transform pdfs to png
generate the folder structure (training[positive, negative] | validation[positive/negative]
finally upload to storage?

Second workflow:

Download the previous reference
Train Rosie and upload the best generated model.

I'm okay with it. Even some recipes can not be download anymore, we still with a represent quantity of data.

Implement the code that trains Rosie as part of the toolbox (after all we need to allow most avid collaborators to generate their training models for whatever reason)

I didn't get your point here. Could you explain it better? I mean, once i have the reference data to generate a new model in my machine is easy.
The point i mentioned is: we should avoid the overhead to train references every time, since the model is hardly to change. I guess we have to allow people to download Rosie official models. I provided mine as base, however we can generate other.

Maybe rename serenata_toolbox.Datasets to something like serenata_toolbox.Storage
It's sounds much better now.

Generate a version of the images and of the trained model to upload to the storage (S3)

The version control of trained model is perfectly fine. However, if we change the image we also have to change the reference. It means curate again some parts of our gold standard. It is a laborious task to demand people to curate again something they have done before.
I think we could include new references, but never change the past curated.
What do you think?

Just clarifying the last part of my previous comment.

However, if we change the image we also have to change the reference. It means curate again some parts of our gold standard. It is a laborious task to demand people to curate again something they have done before. I think we could include new references, but never change the past curated.

Considering this part, take a look in this suspicious reimbursement found by Rosie
Probably at the beginning we will build the references classifying it as a positive suspicious. We will have a stored image and our models will use it during the training. What is fine.
However, as you can see the chamber changed the recipe. The deputy included an new page clarifying that this recipe is not suspicious. It is completely fine for the chamber's API. However for our robot or contributors it can brings some problems in the future if we always download the pdfs or use the csv reference alone.
That said, i also think we could provide the images in small blocks, e.g., [100MB]. To solve this:

Since internet connection is always a problem in some regions of Brazil, download 700MB of images (or more) at once reduce the usability of this dataset.

Furthermore, we have to say that these images reflects the csv references files, not if a reimbursement is suspicious or not in the chamber. It will avoid future surprises we can have using unclear terminologies/affirmations and the direct data from chamber's API.
We could go for a second phase of reclassification of these references, once a year and then change the entire reference. In IHMO it avoids inconsistence problems, that reflects in our training/predictions for supervised classifiers.

@silviodc Any news towards this issue?
Would you mind publishing your latest results and writing what's left so someone else could pick up?
CC @cuducos

authors: cuducos silviodc willianpaixao

repo: datasciencebr/serenata-toolbox


text:
Streaming Function calling support

Includes tool submission

green ci https://github.com/datastax/astra-assistants-api/actions/runs/8314199503

repo: datastax/astra-assistants-api


text:
Opinionated changes to internode tracking

Removed message count as bytes should really be the most important/accurate.
Tracked both inbound and outbound bytes, as writes take up inbound bytes, while reads take up outbound bytes.
Added internode sensors to custom params in the same place where we add the other sensors.
Added internode sensors for request.

@aymkhalil This should address the points previously discussed: https://github.com/datastax/cassandra/pull/1121/commits/a14504f9b42aff90382bc69580b902203ce3a0d8

repo: datastax/cassandra


text:
[#1291] Improvement (trino-connector) Add TPC-H and TPC-DS test sets to  trino-connector integration test

What changes were proposed in this pull request?
Add TPC-H and TPC-DS test set to trino-connector tester
Add Tester tools for run special test sets and tester.
Why are the changes needed?
Fix: #1291
Does this PR introduce any user-facing change?
NO
How was this patch tested?
IT

Is it possible some parts could be reused by spark-connector?

@jerryshao   Please take a review.
The default Trino integration test runs the basic catalog test sets and the TPC-H test set, which takes about 2 minutes. Alternatively, we can use the script integration-test/trino-test-tool/trino_test.sh to run all the test sets for Trino.

How to enable this test?

How to enable this test?

It is always enabled. The default test sets are parts of all test sets. The integration-test/trino-test-tool/trino_test.sh tool provides arguments to run all test sets or specific tests.

@jerryshao
Do you have any additional comments on the matter?

@jerryshao Do you have any additional comments on the matter?

@yuqi1129 you can approve and merge this PR when you feel OK, I don't have strong opinions.

repo: datastrato/gravitino


text:
Fixed typings for withTransaction

PR Checklist
Please check if your PR fulfills the following requirements:

[x] The commit message follows our guidelines: https://github.com/datorama/akita/blob/master/CONTRIBUTING.md#commit
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
Updated typings

[x] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] CI related changes
[ ] Documentation content changes
[ ] Other... Please describe:

What is the current behavior?
While withTransaction is called with a generic parameter. The generic type is not used and the parameter passed into withTransaction is implizit any.
Issue Number: N/A
What is the new behavior?
Parameter passed into withTransaction is now equal the generic type provided when calling withTransaction
Does this PR introduce a breaking change?
[ ] Yes
[x] No

Sry for the mess last time. This time I made sure both tests and build runs through.

repo: datorama/akita


text:
Run "menu" shows build tags (1) when there are none

Rough steps to reproduce:

create a play example
add a build tag
build
remove the build tag
observe the menu still thinks there's a build tag

Thanks! Should be fixed by https://github.com/dave/play/commit/3359b43ad60331af5a6feb2c92dc56ab3ac3a52a

authors: dave myitcv

repo: dave/play


text:
Add extension library for Roslyn workspaces

Add an extension library that can create an AdhocWorkspace (or add a Roslyn Project to an existing workspace) given a Buildalyzer ProjectAnalyzer

@JosephWoodward May want to take a look at this, I know you were talking about creating Workspaces from the build output earlier. Going to release it to NuGet, but my guess is that it'll probably need a couple more iterations to cover every case.

Nice, I'll give it a look later.

authors: JosephWoodward daveaglick

repo: daveaglick/Buildalyzer


text:
Update sbt-scalajs to 1.4.0

Updates org.scala-js:sbt-scalajs from 0.6.33 to 1.4.0.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scala-js", artifactId = "sbt-scalajs" } ]

labels: sbt-plugin-update, semver-major

Superseded by #140.

repo: davenverse/keysemaphore


text:
Update sbt-sonatype to 3.9.7

Updates org.xerial.sbt:sbt-sonatype from 2.6 to 3.9.7.
GitHub Release Notes - Release Notes - Version Diff
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Files still referring to the old version number
The following files still refer to the old version number (2.6).
You might want to review and update them manually.
.travis.yml

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.xerial.sbt", artifactId = "sbt-sonatype" } ]

labels: sbt-plugin-update, old-version-remains

Superseded by #190.

repo: davenverse/selection


text:
Error after deploying to production

I used NODE_ENV=production npm run compile. I have my ngnix configuration to redirect all traffic to dist/index.html and if i try to go to a url thats not the index, for example http://domain.com/about i get the following javascript error:
Uncaught SyntaxError: Unexpected token <
if i go the the index, http://domain.com/ and from there press a link to the about page it all works perfect.
any idea what can be wrong?

The issue was with me..
I added compiler_public_path     : '/', to the config/_production.js and now all works perfect.

Had the same issue and the above fixed it. Hosting on firebase btw.
Would love to know if there is a more fundamental issue here.
Thanks

Shoudn't we add compiler_public_path : '/', in config/_production.js by default?

Had the same issue when hosted on AWS s3. I have set the compiler_public_path : '/', in config/_production.js and it doesn't work. I'm using the 1.0.0 version of the starter kit. Can anyone help ?

having this same issue with Firebase hosting. Not sure if config/_production.js is a legacy file, as it's not in my project, but the config/environments.js file has this:
production: (config) => ({
    compiler_public_path: '/',
    compiler_fail_on_warning: false,
    compiler_hash_type: 'chunkhash',
    compiler_devtool: null,
    compiler_stats: {
      chunks: true,
      chunkModules: true,
      colors: true
    }
  })

Is this what above posters were referring to re: compiler_public_path?
If so, is there another fix? like OP, <Link>ing from my index page works fine, but navigating directly there works not-fine.

I am facing the same issue @brandonmp . Did you find any solution?

ah sorry @abhinavzspace , i must have found a solution b/c it works fine now, but i genuinely can't remember at all what i did :/ if I can remember I'll update here

@abhinavzspace What kind of history you use with React router ?
When I got this kind of issue a while back, I was using browserHistory. I switched to hashHistory and everything worked perfectly.
Unfortunately, I have no clear idea why this is so. I'll have to take a deep dive into React router histories myself.

Thanks! I will try hashHistory and let you know.

authors: ArnaudValensi abhinavzspace brancusi brandonmp maticrivo ranjithnori

repo: davezuko/react-redux-starter-kit


text:
Cannot paste code in console

I got the following message when I tried to paste the code: "Warning: Don’t paste code into the DevTools Console that you don’t understand or haven’t reviewed yourself. This could allow attackers to steal your identity or take control of your computer. Please type ‘allow pasting’ below to allow pasting."

How can I fixed it?

I got the following message when I tried to paste the code: "Warning: Don’t paste code into the DevTools Console that you don’t understand or haven’t reviewed yourself. This could allow attackers to steal your identity or take control of your computer. Please type ‘allow pasting’ below to allow pasting."

How can I fixed it?

Hi, that message its sent by instagram automatically, its nothing related to your browser or computer, you can ignore it and use the script. Its just a warning for other malicious code that you can found in internet or some hacker can send you to paste. In this case this code is open source and you can see what is doing.

But I can't paste the script, when I tried the warning appears. That's the problem.

But I can't paste the script, when I tried the previous warning appears. That's the problem.
Any solution?

I will try it tomorrow, but it should work.. its the chrome console. You have to paste it in the ">" arrow. Can you paste any other text there?

I can't paste anything, I guess the Instagram website may have disabled the paste command in the console.

SOLUCIÓN
DEJEN DE USAR UNA CUENTA INSTITUCONAL

To be able to paste anything to the console just type allow pasting as a command. Then paste whatever you wanted

That works! Thank you @2zlight.
Issue solved.

To be able to paste anything to the console just type allow pasting as a command. Then paste whatever you wanted

Mmm, are you using some special chrome to be able to use "allow pasting" command?

Mmm, are you using some special chrome to be able to use "allow pasting" command?

I'm using Arc browser, which is based on Chromium. But I checked the latest Chrome as well, and it worked there right after I tried to paste anything. After getting this warning allow pasting command starts working

Okay, what about Discord? I insert "allow pasting" and I get this : Uncaught SyntaxError: Unexpected identifier 'pasting'

Okay, what about Discord? I insert "allow pasting" and I get this : Uncaught SyntaxError: Unexpected identifier 'pasting'

Did you try to paste something firstly? You need to paste something into the console, then you'll get the notification I mentioned above. And only then you'll be allowed to introduce that command.
If you type allow pasting before getting the notification, it won't do anything

To be able to paste anything to the console just type allow pasting as a command. Then paste whatever you wanted

how to disable ?
  forbid pasting
  deny pasting
  block pasting

ERROR : VM450:1 Uncaught SyntaxError: Unexpected identifier 'pasting'

just type
'allow pasting'
in console
and paste the code or text you want to paste .
and it worked for me .

I got the following message when I tried to paste the code: "Warning: Don’t paste code into the DevTools Console that you don’t understand or haven’t reviewed yourself. This could allow attackers to steal your identity or take control of your computer. Please type ‘allow pasting’ below to allow pasting."

How can I fixed it?

Hi, that message its sent by instagram automatically, its nothing related to your browser or computer, you can ignore it and use the script. Its just a warning for other malicious code that you can found in internet or some hacker can send you to paste. In this case this code is open source and you can see what is doing.

just type
'allow pasting'
in console
and paste the code or text you want to paste .
and it worked for me .

I'm trying to "allow insertion" in the Opera browser, press "Enter", but I don't get the syntax error error: unexpected id "insert"


text:
When external content is added, scrolling behavior and resizing content doesn't work properly

When an external url brings in content from a content provider, we sometimes scroll and re-size the content before it comes in (since we don't know when the browser has fully loaded the content).

I'm not seeing this anymore now that we've gone to the CSS layout. If you can't reproduce, we can close this issue.

authors: davidfowl kiliman

repo: davidfowl/JabbR


text:
Problems loading RAM disk when booting from floppies on QEMU

Hey David, I'm trying to run your floppy images on QEMU and having some issues (I have the same/similar issues with the MINIX 1.7/2.0.4 images here):
For all of the floppy images, I can get to the boot monitor, but after typing "=" to start up I receive several "Unrecoverable disk error on device 2/0, block xxx" errors while the RAM disk is being loaded.
The specific errors after that are slightly different for each image (built with mkall):
(command: qemu-system-i386 -fda minix-x.0-combo-xxxxkB.img. )
-minix-2.0-combo-1440kB.img: reaches the login prompt, but typing "root" to log in fails silently and returns me to the "noname login" prompt.
-minix-2.0-combo-1200kB.img: never reaches the login prompt. After the "Ram disk loaded" message, it repeatedly prints out "init: console: Not a directory" and "init: ttyc1: Not a directory."
-minix-1.7-combo-1440kB.img: has a bunch of unrecoverable disk errors, but does allow me to login as root and cd around. As far as I can tell, all of the files from _root.manifest, _usr.manifest, and _core.manifest are there intact.
-minix-1.7-combo-1200kB.img: same as ^
qemu-system-i386 -version prints out:
QEMU emulator version 4.2.1 (Debian 1:4.2-3ubuntu6.24) on my Intel machine (but I've tried it with the latest QEMU 7.2.0 too, and it doesn't seem to work - I haven't managed to get an older version of QEMU to build yet).
I've stepped through the bootloader code with GDB, and weird things happen: when you get to the first int 13, ah=00 instruction, eip jumps to 0xd415 (a bunch of empty memory). To my understanding this isn't supposed to happen - I believe ah=00 means that the disk controller should be reset, which shouldn't (?) have an effect on eip?
I've also tried specifying the controller drive type manually using:
qemu-system-x86_64 -M q35 -drive if=none,id=f0,file=minix-2.0-combo-1440kB.img,format=raw -device isa-fdc,driveA=f0,bootindexA=1,fdtypeA=144 (the -M q35 is necessary due to the note here: https://www.spinics.net/linux/fedora/libvir/msg216157.html).
I also have checked the md5sums of the 2.0.4 images that I downloaded from the minix3.org site, and they match. The images also mount on my Linux machine.
I would like to know the QEMU command and version of QEMU you have used to run the floppy images (if you haven't been running them on hardware). From searching the comp.os.minix mailing list, I am pretty confident that some people have managed to do so in the past.
I have sent you a video of the errors I am experiencing to help clarify.

I've just tried this on my own system, and am seeing the same failures. At least the build pack (with runqemu) still works. This used to work, at least for me. My immediate guess is that something's changed with the drive geometry in qemu --- the unreadable blocks are 18 blocks apart, which is coincidentally the size of a track...

It's reading 1024B blocks with a single FDD transfer. These are two sectors each. Except, they're aligned at an odd number of sectors, meaning that there's always a block split across sectors. Minix always does a multi-sector read; the FDC will automatically switch heads when doing a multi-sector read, but it won't switch tracks, so this always fails when reading the block that spans head 1 sector 18 of one track and head 0 sector 1 of the next.
I have no idea why this is failing now. What qemu is doing looks like the correct behaviour, and it's Minix that's doing it wrong. But this works on real hardware!

No, wait --- I had that backwards. qemu is switching tracks, when it shouldn't be. Because it's moved the head, it sets the FDC status bit saying that a seek has happened. Minix isn't expecting this because seeks should happen during reads or writes, so it thinks it's an error and retries. It's a qemu bug!
On real hardware, the FDC will transfer one sector and stop. Minix then seeks to the next track and reads the other sector.
This is probably trivially workaroundable by changing the Minix source, but qemu really shouldn't be doing this...

I've reported this to qemu. https://gitlab.com/qemu-project/qemu/-/issues/1522

Done, thank you! I will have time to try fixing at the end of this week but it might take me a while to figure out.

authors: davidgiven o-oconnell


text:
Documentation issue

http://davidjbradshaw.github.io/iframe-resizer/
seems to be outdated and the linked ZIP and TGZ dont contain the current js.

Yeah they used to make it really easy to update it. I don't see the option anymore. If you can point me at it, I'll rerun the publish script.

repo: davidjbradshaw/iframe-resizer


text:
awesome repo! - couple of questions

This project is awesome!  I was exploring it and had a couple of questions.
With regard to the volumes, this will automatically create VMDK files on the datastore? Are those added to the VM running nomad, or are they connected via ISCSI inside the VM or how does that actually work?
These volumes need to be formatted, or is that automatically handled.
I have only worked with a NFS CSI implementation, that effectively just required a share, and it "worked"
I have all the pre-reqs ready to go to test this, so I am very interested in helping this project out.

I added information to the project readme about life cycles that contains answers to all your questions.
tl;dr;

this will automatically create VMDK files on the datastore

Yes! However the naming is a bit broken on my setup and I don't know if it's me or not yet. I opened an issue with vmware. Your disks may appear in fcd/uuid.vdmk instead of the folder you specify.

Are those added to the VM running nomad

Only as needed. During volume creation, it is temporarily connected for creation of ext4 file system. It's disconnected once the filesystem is created.

are they connected via ISCSI inside the VM
Exactly! The plugin is connecting the disk as an iSCSI device so it appears in /dev/sdX. This way it's high performance and the plugin has nothing else to do.

how does that actually work?

This entire plugin is literally 3 API calls being 'translated' from CSI to pyvmomi. Nomad and Vmware are doing 99% of the work.

These volumes need to be formatted, or is that automatically handled.
ext4 right now. Maybe I can add a parameter to control this, not sure if anyone cares

I have only worked with a NFS CSI implementation, that effectively just required a share, and it "worked"
I haven't worked with any CSI implementations other than this one, but I was surprised at how easily it 'just worked'.

I have all the pre-reqs ready to go to test this, so I am very interested in helping this project out.

Let me know if you have any other questions that might prevent you from testing.

Thank you so much for the quick reply!  I will close this, and if I have any further questions or changes, I'll open a PR or create an issue.

Don't hesitate to poke me if you have questions. I am also interested in any tests you do, even if they all succeed without issue.

authors: davidlublink rismoney

repo: davidlublink/vcenter-csi-driver


text:
freeagarbots.tk

Hello David once again! freeagarbots.tk is taking credit for your work! This is ur business not myn but I think u should take them down bcs i mean ur hard work goes to them not u! Good luck, Panda

@Butterflypanda  Open source repos are free to use for everyone and also to make business of it....

MIT LICENSE found here: https://github.com/davidmann4/ogar-feeder-bot/blob/master/LICENSE
nothing wrong with it - @hassanila97 it contains few pull requests from you - you did it?
please do not use it on official servers - you will get banned

Also did u steal a code from us the butterfly Clan? Because the userscript does belong to us, It was the UUID code improvement where u can just see it from the settings

puh UUID generator is from some stack overflow article ... can you link your butterfly clan script?

Yeah np and u can use ours instead of sending the info to the server every 100 milliseconds its reduced to 10 and makes gameplay a little less laggy

here ya go: https://www.dropbox.com/sh/0obaw9q9cjfo0rh/AACcpwLjGaJIJx3F9q2mZ6g-a?dl=0
:) :+1:

looks like an old version of my script -.-


text:
HUGE UPDATE PART 4

Features:
Better UI
Removed useless code
Offset calculation for normal agar.io servers (EPIC!)
renamed project to agario-feeder-bot

My code :P

@SrNicolas you stole the offset calc from me :P

@MasonBurdette skype Name? :D

@MasonBurdette Not my fault that i found the script on the web :package: http://hastebin.com/mavuyesati.avrasm

this gonna get patched isnt it?

Yep

Fuck

true

fuck him

@SrNicolas Nice EPIC release...

thx lol

use bots as much as possible before PATCH :)

true

Give me your skype or add me:  hassanila97@hotmail.com

nicolasdelito
^ my skype

Hello Moneyclip i am here xD

how do i install this ?

its just says invalid userscript

Is it just me or they go in random direction?

Party mode works perfectly

@SrNicolas Ok then I will check to see cache / cookies problems  THX

Why does it not work ? how do i install it

@quadwax Readme

but i get invalid user script

Remove any old userscript install new version from this repo: https://github.com/ItzLevvie/ogar-feeder-bot  ... goto Agar.io and press ctrl+f5

FIXED.. WORKING PERFECTLY ON PARTY MODE.... THX XD

Just get this error https://gyazo.com/89ff295f5ebe8bfef3c42be4bc7ca227

Got it also... fixed

how to fix that error ?

that did not fix my problem :)

send a full screenshot on Skype plz.   hassanila97@hotmail.com

ok

Confirm Working!!!

@quadwax goto agario-client.js and remove line 528

@ItzLevvie Please take it down before Moneyclip patches :/

Stupid
u Kid

^^

fuck this Little Anime Cunt

now we need to find another exploit if miniclips finds out

Or MoneyClip

Yeah tae it down :)

@ItzLevvie wtf haha myoffset cal is 4 lines and working perfectly....

@ItzLevvie and much easier....

Well done everyone, now miniclip will patch it.....

Fuck this stupid guy Levvie

Use the bot as much as you want, before if it's patched.

@philw1508 are u calling me stupid seriously. im just saying to everyone that it will be patched soon.

No it was @Levvie for sharing it!!

@philw1508 It doesn't really matter now.

Im just getting signed out when i use the bot ?

Was this fix patched because it is not working for me atm

Good job u fuckers for releasing

or i can say LEAKING

xDDDDDDDD relax modafucka

i still hate him

@MinersMC relax and save some coins because you will need pay for bots soon :)

merge ?

did not tested it - sounds like it worked - @ItzLevvie add me on skype: david.mann.rsa

YES!   MERGE NOW PLZ   FULLY WORKING 100%
On 26 March 2016 at 14:47, David Mann notifications@github.com wrote:

merge ?
—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
https://github.com/davidmann4/ogar-feeder-bot/pull/333#issuecomment-201825955

--
Med vänliga hälsningar
Hassan

People this code has leaked by me.

@Newpredator how? if its true i would feel sorry :D

@Newpredator And dude, the code that yiu found, was the Embryo bot userscript, the real offset caqlculation, was found later on hastebin

@mayed505 yes, It's true

@SrNicolas damn

authors: BeAsphyxia ItzLevvie MasonBurdette MinersMC Newpredator SrNicolas WJKH agarioBotDev davidmann4 hassanila97 mayed505 nicolaspielte philw1508 quadwax ravyn120


text:
Scrapable lists have all emptied

It seems like all of the scrapable .txt lists have been emptied. They just contain the standard intro block, but no domains, URLS or IPs are listed anymore.

Thanks for the advice.
It was a problem with my internal lab. I'm recovering the system.
More update to the repository in the late afternoon.

authors: constantinsb davidonzo

repo: davidonzo/Threat-Intel


text:
AUDIT NPM Packages - Vulnerability - Please fix by updating lodash

                   === npm audit security report ===

┌──────────────────────────────────────────────────────────────────────────────┐
│                                Manual Review                                 │
│            Some vulnerabilities require your attention to resolve            │
│                                                                              │
│         Visit https://go.npm.me/audit-guide for additional guidance          │
└──────────────────────────────────────────────────────────────────────────────┘
┌───────────────┬──────────────────────────────────────────────────────────────┐
│ Moderate      │ Prototype Pollution                                          │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Package       │ lodash                                                       │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Patched in    │ >=4.17.11                                                    │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Dependency of │ node-ec2-metadata                                            │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Path          │ node-ec2-metadata > lodash                                   │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ More info     │ https://nodesecurity.io/advisories/782                       │
└───────────────┴──────────────────────────────────────────────────────────────┘
┌───────────────┬──────────────────────────────────────────────────────────────┐
│ Low           │ Prototype Pollution                                          │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Package       │ lodash                                                       │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Patched in    │ >=4.17.5                                                     │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Dependency of │ node-ec2-metadata                                            │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ Path          │ node-ec2-metadata > lodash                                   │
├───────────────┼──────────────────────────────────────────────────────────────┤
│ More info     │ https://nodesecurity.io/advisories/577

It seems this was fixed in Oct 2018, but that version wasn't published.

authors: judahb oscarryz


text:
Which sensor control the battery charge/discharge?

I understand how p_deferrable0 works. I directly wire it to my load. Like for EV car - that value would go to "charge with X watts" control of EV station.
But what about battery? Should I use p_batt_forecast somehow? How?
Basically I need to map it to ~3 modes:

good buy price! charge to X% / N KWh stored
good sell price! discharge to Y% / M KWh stored
meeh. sustain the load, absorb excess PV if any

Any hints?
2024-04-28 19:06:40,424 - web_server - INFO - Publishing data to HASS instance
2024-04-28 19:06:40,476 - web_server - INFO - Successfully posted to sensor.p_pv_forecast = 2237.0
2024-04-28 19:06:40,507 - web_server - INFO - Successfully posted to sensor.p_load_forecast = 304.63
2024-04-28 19:06:40,539 - web_server - INFO - Successfully posted to sensor.p_deferrable0 = 0.0
2024-04-28 19:06:40,575 - web_server - INFO - Successfully posted to sensor.p_batt_forecast = -1932.37
2024-04-28 19:06:40,615 - web_server - INFO - Successfully posted to sensor.soc_batt_forecast = 65.48
2024-04-28 19:06:40,652 - web_server - INFO - Successfully posted to sensor.p_grid_forecast = 0.0
2024-04-28 19:06:40,685 - web_server - INFO - Successfully posted to sensor.total_cost_fun_value = 0.45
2024-04-28 19:06:40,708 - web_server - INFO - Successfully posted to sensor.optim_status = Optimal
2024-04-28 19:06:40,738 - web_server - INFO - Successfully posted to sensor.unit_load_cost = 0.086
2024-04-28 19:06:40,775 - web_server - INFO - Successfully posted to sensor.unit_prod_price = 0.0204

This will depend on your battery model and the available API.
I don't have a battery so I cannot test or provide a functional example. However a lot of people have been able to achieve this. Look at the community forum, I recall to see the example templates for this in the discussions. Try using the search function as there are many posts now.

authors: davidusb-geek vermut

repo: davidusb-geek/emhass-add-on


text:
项目引用了org.apache.logging.log4j:log4j-core@2.11.0等50个开源组件，存在3个漏洞，建议升级

大佬，看你这个项目调用了org.apache.logging.log4j:log4j-core@2.11.0等50个开源组件，存在3个安全漏洞，建议你升级下。
漏洞标题：Apache Log4j2 < 2.15.0远程代码执行漏洞
漏洞编号：CVE-2021-44228
漏洞描述：
Apache log4j是java中常用的日志记录组件，攻击者发现在小于2.15.0的版本中存在远程代码执行漏洞。
漏洞原因：
由于log4j2默认支持JNDI在内的Lookup查找机制，当日志内容中包含${foo.bar}样式的内容时，会查找相应的值进行替换。因此当用户请求中的内容通过log4j作为日志内容记录时，攻击者可能通过恶意构造的内容，触发log4j的lookup方法，进而执行恶意代码。

漏洞级别：严重
影响范围：[2.0-beta9, 2.15.0)
最小修复版本：2.17.0
引入路径：
org.rdlinux:luava-dcache:0.0.1.RS->org.rdlinux:luava-dcache-test@0.0.1.RS->org.apache.logging.log4j:log4j-core@2.11.0

另外2个漏洞 ，信息有点多我就不贴了，你自己看下完整报告：https://www.mfsec.cn/jr?p=i67531

@davinyue 大佬，你这个项目还在维护吗？有空辛苦处理下这个问题哈，有什么问题可以随时联系我。

repo: davinyue/luava-dcache


text:
🛑 dave.org.uk is down

In ec33e19, dave.org.uk (https://dave.org.uk/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: dave.org.uk is back up in 340662c after 19 minutes.

repo: davorg/uptime


text:
Invalid write to a sparse field doesn't give an error

https://github.com/dawn-ico/dusk/blob/ad57bd5a3a2568e83b3bd13aacc9daedbcdf86f4/tests/stencils/test_sparse_fill.py#L104-L112

will be fixed with (this dawn PR)[https://github.com/MeteoSwiss-APN/dawn/pull/1025]

repo: dawn-ico/dusk


text:
Test, and hopefully fix, incremental composite keys

resolves #143

Description
Setup to test, and then fix, the macro incremental_delete when an array is used with unique_key in model configuration.
Checklist

[x] I have run this code in development and it appears to resolve the stated issue
[x] This PR includes tests, or tests are not required/relevant for this PR
[ ] I have updated the CHANGELOG.md with information about my change

Nice work on this @lpezet -- I'm planning on reviewing this along with https://github.com/dbeatty10/dbt-mysql/pull/146 next week.


text:
Error "Object parameter [...] binding not supported" with IPv4 data type in ClickHouse

System information:

Linux Elementary
DBeaver version 21.2.5

Connection specification:

Driver name: ClickHouse
Do you use tunnels or proxies (SSH, SOCKS, etc)?  No

Describe the problem you're observing:
When try to delete row with IPv4 I receive error Object parameter [<IP>] binding not supported.
Steps to reproduce, if exist:

Create table: CREATE TABLE dbeaver_IPv4_test (IP_address IPv4) ENGINE = MergeTree() ORDER BY IP_address;;
Insert few values: INSERT INTO dbeaver_IPv4_test (IP_address) VALUES ('127.0.0.1'), ('127.0.0.2'), ('8.8.8.8'), ('1.1.1.1');;
Check:

SELECT * FROM dbeaver_IPv4_test;

SELECT *
FROM dbeaver_IPv4_test

Query id: dffd48f4-599f-46b6-b67e-c731ab87789d

┌─IP_address─┐
│ 1.1.1.1    │
│ 8.8.8.8    │
│ 127.0.0.1  │
│ 127.0.0.2  │
└────────────┘

4 rows in set. Elapsed: 0.002 sec.

Try to delete via dbeaver. Receive Object parameter [8.8.8.8] binding not supported;
Try via clickhouse console: ALTER TABLE dbeaver_IPv4_test DELETE WHERE IP_address == IPv4StringToNum('8.8.8.8');;
Check:

SELECT * FROM dbeaver_IPv4_test;

SELECT *
FROM dbeaver_IPv4_test

Query id: 5e45ccea-fb4e-4f70-9540-a3c7e7914fd3

┌─IP_address─┐
│ 1.1.1.1    │
│ 127.0.0.1  │
│ 127.0.0.2  │
└────────────┘

3 rows in set. Elapsed: 0.002 sec.

When I generate DELETE SQL for this table via dbeaver I receive this code:
ALTER TABLE dbeaver_IPv4_test DELETE
WHERE IP_address=?;

Try to put value:
ALTER TABLE disworks.dbeaver_IPv4_test DELETE
WHERE IP_address=IPv4StringToNum('127.0.0.2');

And this work. So maybe DBeaver don't use IPv4StringToNum?

IPv4 is new type based on UInt32 and maybe problem because values need convert from string to IPv4.
Describe of IPv4 type: https://clickhouse.com/docs/en/sql-reference/data-types/domains/ipv4/
Describe of function for working with IPv4: https://clickhouse.com/docs/en/sql-reference/functions/ip-address-functions/

thanks for the report

It works if you're using new driver(com.clickhouse.jdbc.ClickHouseDriver) in clickhouse-jdbc 0.3.2 or above. FYI, below query works as well:
-- below query will be translated to:
-- ALTER TABLE dbeaver_IPv4_test DELETE WHERE IP_address = IPv4StringToNum('8.8.8.8') settings mutations_sync=1
delete from dbeaver_IPv4_test where IP_address = IPv4StringToNum('8.8.8.8')

authors: MAH69IK uslss zhicwu

repo: dbeaver/dbeaver


text:
CSV import ignores escape characters in unquoted values

Description
The CSV import ignores escape characters in unquoted values (as in foo \ bar). This is incompatible with the CSV export (see https://github.com/dbeaver/dbeaver/issues/20644) as well as CSV exports produced by some database engines (e.g., PostgreSQL).
DBeaver Version
Community Edition 23.1.3.202307231901
Operating System
Windows 11 Pro, Version 22H2 (OS Build 22621.2861)
Database and driver

Database name and version: PostgreSQL 14.9 on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-18), 64-bit
Driver name and version: PostgreSQL standard driver, org.postgresql:postgresql:RELEASE [42.5.2]

Steps to reproduce

Create a sample PostgreSQL table.
CREATE TABLE public.test (a varchar NULL);
INSERT INTO public.test (a) VALUES ('foo \ bar');

(Option A) Create a sample CSV file by exporting a cell using PostgreSQL's COPY.
CREATE TABLE public.test (a varchar NULL);
INSERT INTO public.test (a) VALUES ('foo \ bar');
COPY public.test TO 'file.csv' CSV HEADER ESCAPE '\';

The file.csv looks like so. Note that the value is unquoted because it contains neither the quote nor the delimiter characters.
a
foo \ bar

(Option B) Export the table into CSV using DBeaver's CSV export (characters escape set to escape; otherwise default settings).
"a"
foo \ bar

Import the CSV into the table using DBeaver's CSV import (truncate; otherwise default settings).

Inspect the contents of the table
postgres=> COPY public.test TO STDOUT CSV HEADER ESCAPE '\';
a
foo  bar

The escape character \ is missing.

Additional context
The same behavior is present in more recent versions of OpenCSV as well.

@HauserV I don't quite understand this issue. Can you please specify what the expected behaviour is for this case?
From my perspective the fact that you are importing a string 'a \ b' and get a result of 'a  b' in the database is expected because we have a setting in the import to specify what is considered an escape char when csa content is being processed.

This synbol now is considere an esacape char for the purpose of scv processing so it won't be inserted into database itself. But if you change it to another sybol in the settings, the backslash will be actually imported to the database as an actual part of the string.
Maybe I misunderstood you, so I want to know how do you see the expected result of such import

Ultimately, I need is to have a way to consistently export and import CSVs using DBeaver. Currently, the exporter produces CSV that the importer can't import as demonstrated above.
In particular, my expectation is that the parser would behave just as PostgreSQL.

If the value contains the delimiter character, the QUOTE character, the NULL string, a carriage return, or line feed character, then the whole value is prefixed and suffixed by the QUOTE character, and any occurrence within the value of a QUOTE character or the ESCAPE character is preceded by the escape character.

Example

Input
Parsed

a \ b
a \ b

a \\ b
a \\ b

"a \ b"
a \ b

"a \\ b"
a \ b

"a \" b"
a " b

postgres=> CREATE TABLE public.test (a varchar);
CREATE TABLE
postgres=> COPY public.test FROM STDIN WITH CSV ESCAPE '\';
Enter data to be copied followed by a newline.
End with a backslash and a period on a line by itself, or an EOF signal.
>> a \ b
>> a \\ b
>> "a \ b"
>> "a \\ b"
>> "a \" b"
>> \.
COPY 5
postgres=> SELECT * FROM public.test;
   a
--------
 a \ b
 a \\ b
 a \ b
 a \ b
 a " b
(5 rows)

The alternative would be to escape both the quote and the escape characters during export but as @E1izabeth pointed out in https://github.com/dbeaver/dbeaver/issues/20644, that would likely cause more harm than good.

DBeaver will escape whatever symbol comes after the escape character, even if it's a space. This might be considered as a bug.
Regarding the provided escaping rules, I think rules should be independent of whether a string is quoted or not.

That is definately not a bug, but wee need to consider if we want to change how escape char is proceeded in import. We will use #22483 for that

@Matvey16, would it be possible to somehow warn users in the CSV export UI that the files produced with characters escape set to escape cannot be safely imported back?

authors: HauserV Matvey16 ShadelessFox


text:
Vertical editing zoom

Vertical editing has its own zoom,
if the main editor zoom has been changed from standard, into vertical editing mode the zoom is kept but reset. Exiting the vertical editing mode the zoom goes back to the previous defined.

This is the standard behavior of Eclipse StyledText control. I can't fix this.
Perhaps it makes sense to file a bug in Eclipse bugtracker (https://bugs.eclipse.org/bugs/) but I doubt that this issue will be resolved soon..

authors: georgethemarmot serge-rider


text:
JasperSoft SQL parameters format support

jaspeSWe need to support SQL variables in JasperSoft SQL format ($P{...} or $P!{...} )
That's quite easy to support. Extra config option also makes sense.
https://community.jaspersoft.com/documentation/tibco-jaspersoft-studio-user-guide/v60/using-parameters-queries

Hello, is this feature still working? I get the following message when calling a sql statement with jasper parameter.
select
raw.*
from
(select 'Test' testdata) raw
where
$P{testcall} like testdata

authors: serge-rider smatherx


text:
Misleading error message when network settings block driver download

I have installed DBeaver. I want to use my local mysql server. There is an Issue regarding the driver download. When I try to connect to the server, following Error occurs: Error resolving driver libraries
Cause:Error resolving driver libraries
Error resolving dependencies
Maven artifact 'maven:/mysql:mysql-connector-java:5.1.44' not found
When I try to download the required drivers, following Error pos up:
Can't create driver instance
Error creating driver 'MySQL' instance.
Most likely required jar files are missing.
You should configure jars in driver settings.
Reason: can't load driver class 'com.mysql.jdbc.Driver'
Error creating driver 'MySQL' instance.
Most likely required jar files are missing.
You should configure jars in driver settings.
Reason: can't load driver class 'com.mysql.jdbc.Driver'
com.mysql.jdbc.Driver
com.mysql.jdbc.Driver
Please Help

Using the DBeaver Version 7.1.4

Same issues here.

Could you check if it reproducible against 7.2.3?

It's not specific to the Driver, and it's easier for me to take down my Oracle service and restore it later, so I did so w/Oracle.

Still have the same issue. Double checked--no VPN enabled. : (

still cannot reproduce it.
Did you try Reset to default?
Thanks in advance

I'm unclear on exactly what you mean by Reset to default, but I believe I reset the maven config to default via a default button.
What's the procedure? I'll give it a try.

@reedjosh have you try "Reset to default" button in Edit Driver Settings dialog in Connection Settings?
Sometimes old dependencies remain in the list and the list needs to be updated.

there is no update on the issue for a long time.
If it is still actual - feel free to reopen it

there is no update on the issue for a long time.
If it is still actual - feel free to reopen it

I got same issues

I also have the same issues. Restore to default don't fix anything.

@widada @ayzesantos It looks like a problem with internet connection. Maybe you have VPN or proxy or even firewall blocking the connection. Can you verify that those are not the problem?

Fixed.
Now we will show network error if network access is unavailable

Verified

having issue myself to where it will not even let me hit the vendor website or download files

authors: LonwoLonwo Matvey16 RandomAsianBDA ayzesantos hhhaiai j-melara-oh reedjosh serge-rider uslss widada


text:
mlmym - frontend similar to old reddit for lemmy

link

easily copyable link
https://mlmym.org/

Thanks it's now added

authors: dbeley dredshep wiki-me

repo: dbeley/awesome-lemmy


text:
eval.py showing invalid load key error

Loading model...Traceback (most recent call last):
File "eval.py", line 1098, in
net.load_weights(args.trained_model)
File "/content/yolact/yolact.py", line 479, in load_weights
state_dict = torch.load(path)
File "/usr/local/lib/python3.7/dist-packages/torch/serialization.py", line 529, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
File "/usr/local/lib/python3.7/dist-packages/torch/serialization.py", line 692, in _legacy_load
magic_number = pickle_module.load(f, **pickle_load_args)
_pickle.UnpicklingError: invalid load key, '<'.

i'm facing the same issue. have you resolved this?

I fixed this issue by re-downloading the model file

authors: kenil-samyak timothyckl

repo: dbolya/yolact


text:
The error messages for un-fulfilled write and write_read calls is incorrect

They say read call instead of their respective actual calls:
https://github.com/dbrgn/embedded-hal-mock/blob/master/src/i2c.rs#L117
https://github.com/dbrgn/embedded-hal-mock/blob/master/src/i2c.rs#L136
Looks like a copy-pasta error :)

I'm working a PR for this now....

Good catch! A PR is welcome :slightly_smiling_face:

Yes, it definitely confused me!

authors: dbrgn jasonpeacock

repo: dbrgn/embedded-hal-mock


text:
Window functions ignoring partitions

Hi,
I tried to filter out some duplicates in an intermediate model to then use iceberg incremental in my fct model on the filtered data.
Do you know why Athena ignores my incremental where clause logic in my fct model and scanns like everything in my intermediate model. Is there a way to inject the filter parameters (date, name, whatever) to my parent intermediate model using dbt?
Thanks!
fct:
{{ config ... }}

select * from my_intermediate_model
where rn = 1
{% if is_incremental() %}
and col_1 = xyz and col_2 = abc
{% endif %}

my_intermediate_model:
select
col_1,
col_2,
col_3,
row_number() OVER (PARTITION BY col_3) AS rn
from my_source

👋🏻 Hello
Thanks for your issue. I would need more information to understand the problem. Can you provide the materalization / config of both models (for instance if there is any partitonning, etc)

Okay let me give you an example:
I have a src table on top a staging view and on top of this is a transformation view that contains:
with

smaller_table as (
    select
        *
    from {{ ref("stg_view") }}
    where not abc= 'done'
),

rank_transfer_time_for_each_xyz as (
    select
        *,
        rank() over (partition by abc_id order by my_timestamp desc) as abc_time_rank_desc
    from smaller_table
),

final as (
    select
        *
    from rank_transfer_time_for_each_xyz
)

select *
from final

Okay nothing fancy here I just want to rank based on an id ordered by an timestamp.
Now I have my marts model thats for this purpose a view and I need to filter the data down from there (this marts model is used in a BI Tool).
Here  we of course filter on partitioned  columns in this case on my_date so I only want the calculation of my transformation model based on the date range I provide with the where clause:
with

tr_model_filter as (
    select
        ...
        -- partition column
        my_date
    from {{ ref("tr_rank_transfer_time_for_each_xyz ") }}
where my_date between date '2023-01-01' and date '2023-01-31'
),

final as (
    select *
    from tr_model_filter
)

select *
from final

The problem is that the transformation model completely ignores the where clause and scans all data of my source.
Any idea how to fix this? Somehow I need to inject the where clause into my transformation model using dbt...

I have my marts model thats for this purpose a view and I need to filter the data down from there (this marts model is used in a BI Tool).
that's get tricky, as your mart model is based on a view that run on top of a table that is partitioned, that could get tricky and partition pruning might not work.

Did you tried to:

persist your mart model as partitioned table? (consider to use hive and ha=true)

when doing so, could you check that the queries issued by your BI tools are scanning less data?

@CommonCrisis I believe you have 2 options for that case:

materialise the mart table (as @nicor88 has mentioned) and connect to it using BI tool to get benefits from partition pruning
build kind of semantic layer on top of you stg table which will be responsible to build queries dynamically. To be honest, it's not simple way but you may try cube.dev for that.

And finally I don't think that the issue requires any changes in current adapter, available functionality should allow you to materialise the optimised mart.

I will give it a shot! Thanks!

authors: CommonCrisis Jrmyy nicor88 svdimchenko

repo: dbt-athena/dbt-athena


text:
Can't have multiple expression_is_true tests with the same expression but different condition

Describe the bug
When having a test like this:
tests:
  - dbt_utils.expression_is_true:
      expression: "is not null"
      config:
        where: "something > 0"
  - dbt_utils.expression_is_true:
      expression: "is not null"
      config:
        where: "something_else_complicated > 2"

It throws an error as it builds the test name based off the expression. It is possible to move these into an OR, but sometimes it's easier to have two tests as the logic can be complicated sometimes.
Steps to reproduce
Create two expression is true tests with the same expression.
Expected results
It works. I think since the change to 1.0.0, it no longer uses the expression in the file name?
Actual results
Screenshots and log output
  Since these resources have the same name, dbt will be unable to find the correct resource
  when running tests.

  To fix this, change the name of one of these resources:
  - test.foo.dbt_utils_expression_is_true_bar_something__is_not_null.b9c184509b (models/staging/xx/yy.yml)
  - test.foo.dbt_utils_expression_is_true_bar_something__is_not_null.b9c184509b (models/staging/xx/yy.yml)

System information
The contents of your packages.yml file:
packages:
  - package: dbt-labs/dbt_utils
    version: 1.0.0

Which database are you using dbt with?

[ ] postgres
[ ] redshift
[ ] bigquery
[x] snowflake
[ ] other (specify: ____________)

The output of dbt --version:
1.3.1
Additional context
This use to work, so it's technically a regression?
Are you interested in contributing the fix?
Sure?

Hey @joshuataylor! This can be handled by providing a custom name: https://docs.getdbt.com/reference/resource-properties/tests#define-a-custom-name-for-one-test

That makes sense, I checked the docs but missed that! Thanks so much!

I checked the docs but missed that!

I always struggle to track it down as well! Where did you look for it/what search terms did you use? I'll pass that on to the docs team and see if we can put pointers where people are looking

Maybe should be added as a warning to the migration notes?

Great point! Will do

authors: joellabes joshuataylor

repo: dbt-labs/dbt-utils


text:
Adding descriptions to tests no longer possible with 0.20.0

Describe the bug
In 0.19 the following would work (in a Model or Source):
     columns:
      - name: user_cohort
        tests:
          - not_null:
              severity: warn
              description: "severity reduced pending further investigation"

In 0.20 I get:
Runtime Error
  Compilation Error in test not_null_<test_name> (<model_yaml>)
    macro 'dbt_macro__test_not_null' takes no keyword argument 'description'

    > in macro test_not_null (macros/schema_tests/not_null.sql)

Steps To Reproduce
Add description: aaa under a test in a model or source.
Expected behavior
No compilation error
System information
Which database are you using dbt with?

[ ] postgres
[x] redshift
[ ] bigquery
[ ] snowflake
[ ] other (specify: ____________)

The output of dbt --version:
installed version: 0.20.0
   latest version: 0.20.0

Up to date!

Plugins:
  - bigquery: 0.20.0
  - snowflake: 0.20.0
  - redshift: 0.20.0
  - postgres: 0.20.0

The operating system you're using: macOS 11.4
The output of python --version: 3.9.5
Additional context
I have not found a mention of this in the release notes and to be fair the updated docs don't say this should be possible. But it did work before and I think its useful especially when you want to document why you downgraded a test to a warning instead of an error.

Thanks for opening @mirosval. As you note, this wasn't officially supported documented in previous versions of dbt. At the same time, it did sort-of work, and I totally get why it's desirable.
The description test argument (as in your code snippet above) couldn't reference doc blocks, and it wouldn't show up in the node-level description property in manifest.json; it would just be nested under test_metadata. We do want to support descriptions on tests, ultimately, in a way that's more consistent with descriptions on all other resource types: #2578, #3249.
In the meantime, I think a more general approach that could get you what you're after would be meta properties on tests: #3629.
I'm going to close this issue in favor of the meta approach in the shorter term, and real description support in the longer term.

repo: dbt-labs/dbt


text:
GoogleMaps.ready callback run twice upon hot-code push

In my mapOptions helper, I have a GoogleMaps.ready('myMap', callback) as in the readme.
Within the callback, I have a Tracker.nonreactive wrapping a cursor.observe({added: cb1, remove: cb2}).
Upon hot-code push, the added callback, cb1, is called twice, because two observers were run, because the callback in GoogleMaps.ready was called twice.
GoogleMaps.ready is not called twice upon manual-refresh. Only upon hot-code push. Is this behavior intended? I don't wanna run code in GoogleMaps.ready twice.

I'm a noob, got wrecked by my own source of duplication. problem solved though xdd

repo: dburles/meteor-google-maps


text:
Add Parser Util

This adds a ParserUtil which contains a function named combineParsers with this function it is possible to create a composable set of parsers which will return a flat list of items. In our use case this will be a set of transactions.
The util can be used like this:
const parser = ParserUtil.combineParsers([
  function (state) {
    return {
      type: SET,
      path: 'id',
      value: state.id
  },
  function (state) {
    return {
      type: SET,
      path: 'cmd',
      value: state.cmd
    };
  }
]);

const appDefinition = {
  id: 'test',
  cmd: 'sleep 100;'
};

console.log(parser(appDefinition));

// Will resolve into:
// [
//   {
//     type: SET,
//     path: 'id',
//     value: 'test'
//   },
//   {
//     type: SET,
//     path: 'cmd',
//     value: 'sleep 100;'
//   }
// ]);

A more complex example with some nesting is also possible:
const containerParser = function (state) {
  if (state.container != null && state.container.docker != null) {
    return ParserUtil.combineParsers([
      function (state) {
        return {
          type: SET,
          path: 'container.docker.image',
          value: state.container.docker.image
        };
      }
    ])(state);
  }
  return [];
};

let parser = ParserUtil.combineParsers([
  function (state) {
    return {
      type: SET,
      path: 'id',
      value: state.id
    }
  },
  containerParser
]);

let state = {
  id: 'docker',
  container: {
    docker: {
      image: 'nginx'
    }
  }
};

console.log(parser(state));

// Will result into:
// [
//   {
//     type: SET,
//     path: 'id',
//     value: 'docker'
//   },
//   {
//     type: SET,
//     path: 'container.docker.image',
//     value: 'nginx'
//   }
// ]

This will enable us to have a tree structure of parsers based on conditions. But the result will always be a flat list.

The combineParses have their use-case right now for transactions but, they are fairly free defined so you also could create something totally different.

I am not yet fully convinced that this is indeed so generic, but we can always rename it in the future if we really have that problem.
Good work sir, LGTM 🚢 💯 ✨

authors: Poltergeist wavesoft

repo: dcos/dcos-ui


text:
Fix ServiceActions integration tests

Fixed and faster.

run integration

run integration

run integration

run integration

@MatApple your integration tests have legit failures

One will be fixed by a rebase from master

@rcorral @mlunoe should have fixed that test related to ServiceActions-cy. It worked locally but think because the timing for checking when disabled/not disabled was a little flaky for the button, it wasn't reliable.

Works great for me!

authors: MatApple jfurrow mlunoe rcorral


text:
remove FULL_INTEGRATION_TEST

it looks like someone had the plan to rely on stubs to speed up local testing.
unfortunately that idea has not been shared enough that we make good use of
this. in fact we don't seem to make use of this at all anymore.
under the assumption that FULL_INTEGRATION_TEST is never truthy, then unreachable code has been removed as well. that's why clusterCleanup had to go as well.
you might want to review without whitespace changes!

:tada: This PR is included in version 2.102.5 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

authors: mesosphere-ci pierrebeitz


text:
Fix links in 1.8 blog post

The 1.8 release blog post contains invalid Markdown for named references. This corrects the issue.
cc @pyronicide

This will then need to be promoted to master.

Looks like this was fixed in #829.

repo: dcos/dcos-website


text:
Use same default linux spartan/dcos-net IP addresses

From linux: >cat /etc/resolv.conf
nameserver 198.51.100.1 nameserver 198.51.100.2 nameserver 198.51.100.3
Signed-off-by: Alin Gabriel Serdean aserdean@ovn.org

Please do not merge until a smoke CI run.
CC: @ionutbalutoiu

repo: dcos/dcos-windows


text:
Prevent dcos_vol_setup from formatting partitions while services are starting

High Level Description
This PR updates the dcos_vol_setup.service dependencies so that it starts as early as possible in the boot sequence. It also simplifies dcos_vol_setup.sh - the systemd manipulations and /var/log migration are no longer necessary now that dcos_vol_setup.service is running early.
Because dcos_vol_setup.service did not include DefaultDependencies=no, it was implicitly running with After=basic.target which is fairly late in the systemd targets. Many other services are started after basic.target - like dockerd and chrony - which in some cases were left in a bad state because file systems were being formatted while the services were initializing.
Coincidentally, dcos_vol_setup was failing prematurely because it was receiving SIGPIPE when trying to write to stdout/stderr when systemd-journald was restarted (https://bugs.freedesktop.org/show_bug.cgi?id=84923). systemd-journald was being restarted in two places:

dcos_vol_setup.sh - this PR removes all systemctl usage from dcos_vol_setup.sh
cloud-final.service - the userdata generated by dcos_generate_config.sh --aws-cloudformation includes a runcmd directive systemctl restart systemd-journald:

"runcmd":
- - |-
    systemctl
  - |-
    restart
  - |-
    systemd-journald.service
- - |-
...

Related Issues

DCOS_OSS-1043 dcos_vol_setup fails to set up /var/log - breaking cronyd and navstar

Checklist for all PR's

[  ] Included a test which will fail if code is reverted but test is not. If there is no test please explain here: This PR fixes an intermittent failure that happens early in the boot up of AWS instances and cannot be reproduced at will.
[ x] Read the DC/OS contributing guidelines
[ x] Followed relevant code rules Rules for Packages and Systemd: I recognize that Before, After, etc are discouraged, but I don't know of another way to ensure early execution of dcos_vol_setup.

Checklist for component/package updates:
If you are changing components or packages in DC/OS (e.g. you are bumping the sha or ref of anything underneath packages), then in addition to the above please also include:

[ ] Change log from the last version integrated (this should be a link to commits for easy verification and review): example
[ ] Test Results: [link to CI job test results for component]
[ ] Code Coverage (if available): [link to code coverage report]

PLEASE FILL IN THE TEMPLATE ABOVE / DO NOT REMOVE ANY SECTIONS ABOVE THIS LINE
Instructions and Review Process
What is the review process and when will my changes land?
All PRs require 2 approvals using github's pull request reviews.
Reviewers should be:

Developers who understand the code being modified.
Developers responsible for code that interacts with or depends on the code being modified.

It is best to proactively ask for 2 reviews by @mentioning the candidate reviewers in the PR comments area. The responsibility is on the developer submitting the PR to follow-up with reviewers and make sure a PR is reviewed in a timely manner. Once a PR has 2 ship-it's, no red reviews, and all tests are green it will be included in the next train.

systemd-analyze plot charts from before and after the changes in this PR were applied. Note the active period of dcos_vol_setup.service in relation to other systemd services.

@lloesche, please review. Do you know who else I might add to this review? Thanks.

Changes from https://github.com/dcos/dcos/pull/1818 should be merged into this PR. Specifically commit c9fc3769bd6457f6dcd7e70f61c1ce167eb0e577.

I think we would need more than -o pipefail if dcos_vol_setup is not running well in front of other services that use the filesystems it is formatting.
My understanding of -o pipefail is that it changes the way the shell sets the exit status for a pipeline: without pipefail set (the default), ${?} will be the exit status of the last command in the pipeline. With pipefail set, ${?} will be the exit status of the first process in the pipeline with a non-zero exit status.
The SIGPIPE that I observed by running dcos_vol_setup with trace would happen on single-command lines, like 'echo something' when writing to stdout, and would not be affected by -o pipefail
In either case, the random dcos_vol_setup deaths are prevented by not bouncing systemd-journald while dcos_vol_setup is active. This PR achieves that partly by removing the restart in the script and partly by running dcos_vol_setup before the cloud-init runcmd executes (in cloud-final.service).

Sorry you're right. What I intended was to trap '' PIPE so that when the script loses it's stdout reader it won't get killed. pipefail has nothing to do with that.
Like I mentioned we can't get rid of the journald restart because we're creating the /var/log/journal directory which makes it so that the journal is being persisted. Otherwise all previous logs will be gone after a reboot.

Thinking about it, we would now mount /var/log into a non-empty directory. It technically works but feels a bit dirty.
I could see users running into issues/it causing confusion in situations where for some reason the EBS is not present on the system, the mount fails but nobody notices and services start writing to the root device.
@lingmann what's your thoughts on this? Also could you be second reviewer please as you wrote the initial version of this script.

My latest commit incorporates everything that we discussed.

I did omit the explicit directory creation for chrony and audit, since these directories are created by the yum package. Now that we are migrating the original /var/log contents again, those directories and any others that were there are left intact.

I will admit that I'm not especially fond of the noncritical addition, although I do appreciate that it adds resiliency for activity that may be out of our control. Before this PR there were two places where journald was restarted, both of which we are now insulated from:

Within dcos_vol_setup. The latest commit uses systemctl kill --signal SIGUSR1 instead to achieve journal persistence.
From cloud-final.service (via userdata, assuming the CF templates created by --aws-cloudformation). The updated systemd dependency (on local-fs-pre) means that dcos_vol_setup is finished before cloud-final.service is activated.

Any tactics above and beyond these two changes are only there to protect against journald restarts that subsequent image layers might perform, which take place during local-fs-pre.target. I'm just not sure if the additional protection is worth the layer of obscurity and whatever weight may be imposed by toggling -e so frequently.

I discovered a way to more easily reproduce this issue: the SIGPIPE will only happen when the script is writing to stdout/stderr, so make it write often! The script/service failed for me 100% of the time if I added this line immediately after the systemctl restart:
for i in {1..100}; do echo "I'm speaking up. what are you going to do about it?"; done

And yes, the service did not fail when I replaced the systemctl restart with a SIGUSR1 poke.

So, I would appreciate if you would reconsider the noncritical change, but I'm generally happy with where this request is now. Let me know how your testing goes.

Thanks for the PR @scareything. I likely don't have time to review this week, but would like to expand the net and see if there are some other people that could take a look... @spahl @klueska @amitaekbote @BenWhitehead @mellenburg are all good candidates for a review. Any thoughts ya'll?

@mesosphere-mergebot bump-ee

@scareything can you rebase on master please?

@mesosphere-mergebot bump-ee

@mesosphere-mergebot label Ready For Review

Hello @lingmann, could I ask that you give this a look this week if you have time? Thanks!

Hello to anyone who is watching this PR, I'm hoping that one more approved reviewer can take a look at the changes to these two files.
@lingmann @spahl @klueska @amitaekbote @BenWhitehead @mellenburg
This is an important fix for my team, it causes us a lot of plain when we stand up or scale up DC/OS clusters.
I suspect a fair number of other DC/OS users may not be aware that they are affected by it. For example, when docker fails to start because of this issue it prevents the mesos agent from starting and the node never joins the cluster (even in an unhealthy state), so you end up paying for EC2 instances that are not joined to the cluster. Without a comprehensive monitoring solution it os very easy for this to go unnoticed.
Thanks for taking a look when you get a chance.

@scareything sorry this PR is taking longer than usual. We're currently all hands on deck releasing DC/OS 1.10.0. Which isn't an excuse for our lack of status updates. That said our Director of Test and Release Engineering let me know last week already that this PR will be included in 1.10.1. There's been quite a bit of activity around it in our Slack. Much more than is visible in the public Github. Unfortunately we're not exposing that activity very well.

@lingmann Yes, definitely.

authors: lingmann lloesche scareything

repo: dcos/dcos


text:
[2.2] Restart Docker only if restart file exists

High-level description
Only restart Docker if a restart file exists. This allows bootstrap to determine when a restart is necessary while keeping the certificate name the same.
Corresponding DC/OS tickets (required)

D2IQ-ID JIRA title / short description.

Related tickets (optional)

D2IQ-ID JIRA title / short description.

@mesosphere-mergebot test teamcity/dcos/build/dcos

@mesosphere-mergebot test teamcity/dcos/build/dcos

@mesosphere-mergebot test teamcity/dcos/build/dcos

@mesosphere-mergebot test all

@mesosphere-mergebot test all

@mesosphere-mergebot test all


text:
Change adminrouter ExecReload to work

Cuttent one doesn't work when a systemctl reload dcos-adminrouter is run (same fix applies to dcos-adminrouter-agent)
Internal JIRA: https://mesosphere.atlassian.net/browse/DCOS-10580

cc: @jgehrcke @vespian

:rocket:

authors: cmaloney jgehrcke


text:
🛑 Danbs is down

In a0e26dd, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 210 ms

Resolved: Danbs is back up in c197283 after 55 minutes.

repo: ddanbs/upptime


text:
🛑 Danbs is down

In 73dec15, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 242 ms

Resolved: Danbs is back up in 60b1da6 after 14 minutes.


text:
🛑 Danbs is down

In d624699, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 4055 ms

Resolved: Danbs is back up in ee83a3a after 24 minutes.


text:
🛑 Danbs is down

In 81c5f2c, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 258 ms

Resolved: Danbs is back up in a680101 after 6 minutes.


text:
🛑 Danbs is down

In d3782ff, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 165 ms

Resolved: Danbs is back up in c224305 after 14 minutes.


text:
🛑 Danbs is down

In d87d28b, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 181 ms

Resolved: Danbs is back up in c880501 after 5 minutes.


text:
🛑 Danbs is down

In bdfda09, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 143 ms

Resolved: Danbs is back up in 435fac4.


text:
🛑 Danbs is down

In 7e7d667, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 179 ms

Resolved: Danbs is back up in a63670c.


text:
🛑 Danbs is down

In 63dd80b, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 135 ms

Resolved: Danbs is back up in d170835.


text:
どこでエラーが起きたのかわからない

エラーにその行を含める

対応した

repo: ddddddO/gtree


text:
Add Github badge

Added a GitHub commit activity badge at the top right corner
Fixes #11

@mcaibad2 Can we use this one instead? http://tholman.com/github-corners/

@mashiromashi The library just wraps a svg in a component, making it prettier in our source code 😄

You should keep index.js as it is.

authors: FrederikBolding deamme mcaibad2

repo: deamme/usecrypto


text:
Add new Project : Temperature converter

Description
Hello sir,
I have made a new PR regarding Temperature Converter which I have made of HTML , CSS & JS .
Related Issue

Closes #43

Type of Change
Please check the type of change that applies to your PR:

[ ]  Bug Fix
[ ] New Feature
[ ] Enhancement (improvements, refactoring, etc.)
[ ] Documentation Update
[X] Other (please specify): New Project

Checklist
Before submitting your pull request, please ensure you've completed the following:

[x] I have read the CONTRIBUTING.md document and followed the contribution guidelines.
[x] My code follows the project's coding standards.
[x] I have added or updated the necessary documentation (if applicable).
[x] My changes do not introduce any new linting or test errors.
[x] All new and existing tests have passed.
[x] I have reviewed my code to ensure its quality.

Screenshots (if applicable)

Additional Information
Please take review of my PR & please (if possible) merge it under APERTRE'24.
Author's Note

@debarshee2004 Please take review of my PR & please (if possible) merge it under APERTRE'24.

Best of Luck and Happy Coding.


text:
docs: add new external oauth client

Summary
Add my Decap CMS OAuth backend for Github.
Test plan

Checklist

[x] I have read the contribution guidelines.

A picture of a cute animal (not mandatory but encouraged)

this is pretty straight forward: lgtm

authors: njfamirm xaiki

repo: decaporg/decap-cms


text:
Server folder

Hello!
Have you guys deleted server folder from the file?
I can't find POAP Handler.js
Can you upload the full POAP Booth folder, please?
It would be really nice of you if you can provide how to connect POAP handler.js and firebase API..
Looking forward to hear from you soon.

Hi,
the server that was once published in that "server" folder is no longer valid. The people at POAP are increasingly more cautious about players exploiting their services to farm tokens by the hundreds or thousands, so any server that connects to their services now needs to have a lot more security features
There will soon be a better alternative to handle this, in the meantime contact HPrivakos on Discord, who manages a server that does comply with all the required policies

authors: GreatCarls nearnshaw

repo: decentraland-scenes/Awesome-Repository


text:
Restricted action: interact w wallet

Add a new restricted action to smart wearables to control the use of the player's wallet. Smart wearables without this permission won't be able to interact with the player's wallet, to make transactions or to sign messages.
Content creators will need to add this new permission to the list of `requiredPermissions"  https://docs.decentraland.org/creator/development-guide/scene-metadata/#required-permissions

If the permission is not included, and the scene attempts to interact with the players wallet on the browser, the action will be blocked.

If the permission is not included, it should still be possible to use the player's ephemeral key via signedFetch()

This change should only affect SDK7. Smart wearables built with older versions won't be allowed to be published at all.
For reference to why, see:
https://www.notion.so/decentraland/RFC-Portable-experience-controlled-actions-fde77221063143fd9697aa7d69612f4d

The permission USE_WEB3_API already exists, but what remains is to test that it works as expected.
To do this, we need the preview of smart wearables to work for SDK7

@gonpombo8   I assigned you to this one, I think it's surely something that's already in the scope you're working on.
If you're confident this already works, we can close it.

repo: decentraland/sdk


text:
[QA] Flickering Trees When Facing North

Explorer Alpha build versions:

v0.29.0

Issue Description:
When facing north at coordinates (50, 110), trees flicker as the camera is moved.
LOGS:
Flickering issue.zip
STR:

Launch the explorer.
Use the command /goto 50,110.
Observe the trees while moving the camera.

❌ Actual Result
Trees flicker when the camera is moved while facing north.
https://github.com/user-attachments/assets/32acfe1b-c79c-494f-9f2a-f07d20853f2c
✅ Expected Result
Trees should render smoothly without flickering when the camera is moved.
Additional Notes:
Windows 11. 12th Gen Intel(R) Core(TM) i7-12650H 2.30 GHz. nvidia geforce RTX
Macbook M1 Pro Sonoma 14.5

it would seem to be this scene:

More specifically this asset:

repo: decentraland/unity-explorer


text:
sovrin ledger connection state stays in request state

Evernything worked until reached setting up connection. The state does not leave "request" to "active". The webhook log did not have enough details to see if ping was sent correctly.

I guess you are connecting to IBM?

Perhaps you could state the Env and steps you have executed?

Nope. Everything is our agent. IBM is a different story,

I followed exactly the steps in the Aries Playground description. No changes. The environment is ubuntu in Windows 10 (finally got it working) and postman. Will be glad to share postman scripts.

Not sure if I follow. It takes some time to get to state active.
In the other issue you state that you do get the connections to active?

I tested the flow and the connections come to active for both Test Center and Data4Life user

authors: JanLin lalc


text:
Some textures missing during gameplay

Errors messages:
Encountered this issue on latest master branch

:gobj(error): Texture::read() - couldn't read: ./wood.png
:gobj(error): Unable to find texture "./wood.png" on model-path /tmp:/home/work/dev/MASTER/pgdrive/pgdrive/assets/models:/tmp:/home/work/dev/MASTER/pgdrive/pgdrive/assets/models/ferra:/home/work/dev/MASTER/pgdrive:/home/work/anaconda3/envs/rl_dev/lib/python3.7/site-packages/panda3d/etc/..:/home/work/anaconda3/envs/rl_dev/lib/python3.7/site-packages/panda3d/etc/../models

Some textures seem to be missing during rendering (the green box), the game-play itself is not being affected.

Command used:
python -m pgdrive.examples.enjoy_expert

Use box.bam instead of box.egg can solve this problem when developing PGDrive. I recommend removing the box.egg in our repo

The attribute has been replaced in release/0.1.4 and merged into master.

ohhhh, that is weird... Some errors must exist in .egg/.bam model file.

@lqy0057 Is this issue still there?

authors: Edwardhk lqy0057 pengzhenghao

repo: decisionforce/pgdrive


text:
Handle Links to non-HTML Content

Some links on the page may be for downloadable assets that are not HTML content. Currently link resources are assumed to be HTML and inserted into the page.
Detect the content type of the link and force non-HTML content to save as a file download.
See http://stackoverflow.com/a/18197341.

Consider using the Cache API.
This would defer content type handling to the browser and fix the page load lifecycle caused by injecting HTML into the DOM.

The Cache API doesn't seem to actually affect the browser's internal cache. It is really just a storage location for fetch responses. Although I can construct a response object and put it in the cache, the navigation request ignores it.

The Service Worker spec now allows a custom webworker to intercept network requests and cache/proxy them arbitrarily.
https://developers.google.com/web/ilt/pwa/introduction-to-service-worker


text:
VNDA - Use appropriate variant images

I implemented a flag (useVariantImages) that will change the way the images are attached to each variant.
Currently, all images are attached to all variants (witch is not right at all, I think). Anyway, with the flag set to true, each variant will be associated only with the appropriate images.
See the same product in both ways:

useVariantImages = false
https://deco-sites-vip-capas.deno.dev/produto/produto-teste-10354?skuId=04

useVariantImages = true
http://localhost:8000/produto/produto-teste-10354?skuId=04

Steel need it? @AlanVncs

No activity/answer in the last month.

authors: AlanVncs guitavano matheusgr

repo: deco-cx/apps