text:
Could not spawn mod entity - Nether

From about line 52 down, it shows spamming of trying to spawn a mod entity in the nether. It has caused a few players to get a fatal error and disconnect.
http://pastebin.com/SxdSXGa8

what version are you using ?

in enderIO.cfg changed the below to false and restart server:
B:replaceWitherSkeletons=false

source: gharchive/issue

license_type: permissive

license_source: github-api


text:
Pressurized Fluid Conduits Voiding Lava

Issue Description:
Pressurized Fluid Conduits will void lava that is extracted from a tank. I have replicated this with multiple different tank holders. This also happens with regular fluid conduits.
What happens: Set the Pressurized Fluid Conduit to extract and the other end to insert, and it will instantly void every single drop of lava in the tank.
What you expected to happen: It to start extracting the liquid little by little and not void it.
Steps to reproduce:

Set the Pressurized Fluid Conduit to extract and the other end to insert, and it will instantly void every single drop of lava in the tank.
...

Affected Versions (Do not use "latest"):

EnderIO: 3.0.1.112
EnderCore: 2.0.4.1.55
Minecraft: 1.10.2
Forge: 2092

Your most recent log file where the issue was present:
[pastebin/gist/etc link here]

Does this also happen with other fluids eg water?
Are there any messages in the log?
What tank do you extract fro, where do you insert?

I have not seen it happen to anything other than lava. I have some conduits hooked up for nutrient distillation and water,but lava is the only one I have exclusively seen this happen to.
No messages in log, which is actually why I didn't attach it. I searched it beforehand the extra moment I had the issue. Nothing in the log noticeable.
I extracted from both an Ender IO Tank, along with a Mekanism Ultimate Fluid Tank. There were a couple others I've tried, but the two mentioned above are what I've used the most and seen it happen to the most.
I've inserted into many different things - other tanks same as what I'm extracting from, TiC smeltery, Deep Resonance tank, etc.
I have not tested successfully extracting and inputting lava so far. All tests have come back negative.

I cant reproduce this at all. I have tried every setup I can think of and never lose any lava. Would you be able to include a screen shot with the exact details of the conduit settings used?

Really? I can show you here. It doesn't happen with the Ender IO Tank anymore, but it still happens with Mekanism. I actually took a video of it so you can see it happen. From what I can tell, all of the settings look okay. Maybe it just happens with the Mekanism one.
Mekanism version is latest, 292.

This has been going on for some time but we've always ignored the issue because Mekanism is so incompatible with everything.  The issue is present with Mekanism 292, EIO 3.0.1.112, EnderCore 4.1.56.
Place down any Mek tank, lava and water are good examples, use an EIO fluid conduit to remove said Mek tank fluid into any container.  Voi la, the fluid has been scattered to the seven winds.

This is an issue in mekanism. There was an issue in EIO which has now been fixed (as you noticed).
It is working fine with all other modded fluid containers I have tested against (EIO, Forestry, TiC etc)

authors: CrazyPants JathTyki MatthiasMann utoc

repo: SleepyTrousers/EnderIO

license: Unlicense


text:
[Mod interaction] khndrel keght spawns from ender quarry + world hole upgrade

absolutely massive numbers of these things spawn even when giving a silk touch upgrade to the quarry.

This was fixed already, what version are you using?

I'll have to check. Was it a recent fix?

EnderZoo-1.7.10-1.0.14.31.jar
missed the newest version by a few days.

This also happens with a Mekanism Atomic Disassembler, latest version 1.0.15.32

@tgstyle Then the Mekanism Atomic Disassembler pretends to be a real player. Nothing we can do from our side, that'd be on Mekanism's end.

So it is a hand tool? Not really related to this issue...
A khndrel keght is spawned when a dirt or grass block is broken by a player using a tool that is not effective on dirt. To determine if it is effective, we ask the tool. Only if the tool answers that it is not effective, will we potentially spawn one.

So it is a hand tool? Not really related to this issue...
A khndrel keght is spawned when a dirt or grass block is broken by a player using a tool that is not effective on dirt. To determine if it is effective, we ask the tool. Only if the tool answers that it is not effective, will we potentially spawn one.

so anything other than a shovel will potentially spawn it. i get them all the time mining dirt by hand

repo: SleepyTrousers/EnderZoo

license_source: bigquery


text:
Fix Carthage import

Hi,
when trying to import ios-i18n using Carthage I got the error

Unknown type name "FOUNDATION_EXPORT"

So I've changed it to extern.

Hello?

source: gharchive/pull-request


text:
Ionide vim bindings are still using old which-key

https://github.com/Smaug123/nix-dotfiles/blob/ede76d2bc2a78569fe2e3b2442155e9ec43924f7/home-manager/nvim/ionide-vim.lua#L209

Fixed in #69

license: MIT


text:
🛑 NEOCP is down

In 6dcb5a9, NEOCP (https://minorplanetcenter.net/iau/NEO/toconfirm_tabular.html) was down:

HTTP code: 0
Response time: 0 ms

Resolved: NEOCP is back up in e6d8611 after 1 minute.

repo: Smithsonian/upptime


text:
🛑 NEOCP is down

In fe27149, NEOCP (https://minorplanetcenter.net/iau/NEO/toconfirm_tabular.html) was down:

HTTP code: 0
Response time: 0 ms

Resolved: NEOCP is back up in 5e0a572 after 1 minute.


text:
🛑 NEOCP is down

In 617ef9c, NEOCP (https://minorplanetcenter.net/iau/NEO/toconfirm_tabular.html) was down:

HTTP code: 0
Response time: 0 ms

Resolved: NEOCP is back up in 60d993c after 2 minutes.


text:
[FEATURE] Dispatch alarms trigger in game

For example 911 call of fire dispatcher can press a button on cad and select station and units
Using Text to speech api to generate message eg. *beep sound Station 1 Structure fire engine 1 truck 2
Use interact sound to play this sound in game at a specified fire station.

This might be possible to do in the CAD’s frontend. But I do not have the expertise in FiveM scripting so for now I will close this issue and put it in a backlog.

The FiveM server side is fairly simple. I can make the FiveM part when I get home I would just need a way to add a button which sends a http request to FiveM http wrapper and then the rest is done server side. I will make it and show you it and you can decide weather you would want to publicly implement it.

The FiveM server side is fairly simple. I can make the FiveM part when I get home I would just need a way to add a button which sends a http request to FiveM http wrapper and then the rest is done server side. I will make it and show you it and you can decide weather you would want to publicly implement it.

Custom action buttons/forms would be a really nice touch actually. Would allow us to integrate with resources like SmartSigns to send targeted traffic messages similar to the integration SonoranCAD has here.

Another way if the cad and FiveM server were both hosted on the same server you can use a local host redis pub sub to trigger events in game from the cad. (New to redis but could work)

authors: Dev-CasperTheGhost Vatoka jxckUK


text:
etl_openlineage error: emit only accepts RunEvent class

"/home/airflow/.local/lib/python3.7/site-packages/openlineage/client/client.py", line 61, in emit
raise ValueError("emit only accepts RunEvent class")
ValueError: emit only accepts RunEvent class
[2022-06-17, 17:50:29 UTC] {taskinstance.py:1288} INFO - Marking task as FAILED. dag_id=etl_openlineage, task_id=send_ol_events, execution_date=20220617T175013, start_date=20220617T175014, end_date=20220617T175029

In a chat with @rossturk:
Ross: my current working hypothesis is that client.emit has gotten pickier somehow since that example was written…we can prove/disprove that by pinning openlineage-airflow in Dockerfile to an older version. we can also include @fm100 who wrote this DAG, he might like to be part of this.
the runevent class check was added three months ago, so this is plausible


text:
feat: support custom ownership transfer for grants

Add new optional schema variable revert_ownership_to_role_name which allows granular control over which role ownership will transfer to when destroying generic grants (including destruction during update) such as the following:

database_grant
external_table_grant
file_format_grant
function_grant
integration_grant
masking_policy_grant
materialized_view_grant
pipe_grant
procedure_grant
row_access_policy_grant
schema_grant
sequence_grant
stage_grant
stream_grant
table_grant
tag_grant
task_grant
view_grant
warehouse_grant

Note: Grants that do not seem to have a concept of ownership such as resource_monitor_grant do not gain this optional variable.

Add RevokeOwnership method to *GrantExecutable interfaces and implement

Create new tests and modify existing ones as necessary

Fix small variable naming issues

AllGrantBuilder referred as fgb  => agb
ExistingGrantExecutable referred as fge  => ege

Test Plan

[x] acceptance tests (shouldn't be necessary considering these changes are theoretically backwards compatible)
[x] unit tets

References

should fix https://github.com/Snowflake-Labs/terraform-provider-snowflake/issues/1744
should fix https://github.com/Snowflake-Labs/terraform-provider-snowflake/issues/1060

I think it would make more sense to have an dedicated role_ownership_grant resource than to add an attribute which doesn't do anything most of the time. However, I do plan to deprecate these existing grant resources in the future, so i guess its okay. https://github.com/Snowflake-Labs/terraform-provider-snowflake/discussions/1470

@hexDoor there appears to be some merge conflicts which must be resolved through command line. Could you please fix this?
Also I would like to let you know about a redesign effort to make a more stable and testable SDK. Refer to: https://github.com/Snowflake-Labs/terraform-provider-snowflake/discussions/1767.

@sfc-gh-swinkler Apologies for the delay.
Marge conflicts have been resolved.

I think it would make more sense to have an dedicated role_ownership_grant resource than to add an attribute which doesn't do anything most of the time. However, I do plan to deprecate these existing grant resources in the future (see: #1470 for more info), so i guess its okay.

I agree but I found that this PR would be the least painful and disruptive way of implementing something that will unblock our project. I'll be happy to contribute to the discussion when I can.

Also I would like to let you know about a redesign effort to make a more stable and testable SDK. Refer to: #1767.

I have noted this if I need to implement new features in the future but I suggest continuing with the v1 design for this particular PR as it's meant to be more of a bandaid than a permanent fix. The aforementioned re-design of grant resources should remedy this in the future.

I have noted this if I need to implement new features in the future but I suggest continuing with the v1 design for this particular PR as it's meant to be more of a bandaid than a permanent fix. The aforementioned re-design of grant resources should remedy this in the future.

True, lets revisit this in the future. For now, i agree a bandaid solution is sufficient.

@hexDoor thank you for your contribution!

authors: hexDoor sfc-gh-swinkler


text:
Improvement request: make eq.js work with es6 import, add convinience method for eqjs.refreshNodes + eqjs.query

Thank you for a great library.
I use eq.js in a single page ES6 application. When I load a new page I call eqjs.refreshNodes and eqjs.query after rendering the new page fragment. It would be great to have a convenience method for this, for example. eqjs.load ().
It does not seem that ES6 import working correctly, import { eqjs } from 'eq.js', gives the following error message when I try to call a method: "Type Error: Can not read property 'refreshNodes' of undefined". If I use require, const eqjs = require ('eq.js'), everything works as expected.
Regards
Leif Olsen

Please split this up in to two issues

@leifoolsen When importing with ES6 simply use:
import eqjs from 'eq.js'
This imports the default export, which will bring its member functions with it, such as query(), refreshNodes(), etc. What you're trying to do is import a single member function of the default export.

@jonscottclark Thank you for spotting that. It was a copy/paste fault of mine. After ermoving the curly braces, es.js indeed works with ES6 import.

@Snugug Thank you for a great library. So far I have used eq.js to rewrite the Google Material Design Lite grid to use element queries, and have not experienced any problems in that process.
The import issue was not an issue at all, as @jonscottclark pointed out - so I just remove that from the heading text.

authors: Snugug jonscottclark leifoolsen

license: mit


text:
Download-CSVs-button

Add button to download XMLs converted to CSVs

 Add 'Download loaded data as a CSV' button


text:
fix: replace beneficiary unique constraint

Nom de branche plus court pour #515

Est ce que tu pourrais  lancer un hasura migrate squash ?

@lionelB vérifie que j'ai pas fait n'imp avec les migrations, par pitié.

ca me va, je laisserai l'index par contre

@lionelB quand tu peux valider, c'est top =)

:tada: This PR is included in version 1.77.5 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

authors: Augustin82 SocialGroovyBot lionelB

repo: SocialGouv/carnet-de-bord


text:
feat: rendre un champs optionnel

close jira (284)
https://jira-mcas.atlassian.net/browse/VAO-284?atlOrigin=eyJpIjoiY2U2YThlMTM3OWMyNDI2Y2IxNTM1YzMyMjU5ODM5MWIiLCJwIjoiaiJ9.
J'en ai profiter pour corriger une faute d'orthogaphe dans un mail

J'imagine qu'il faut aussi mettre un affichage conditionnel dans le pdf de la déclaration2mois

Tu veux dire comme ca ?
 {
                columns: [
                  {
                    text: "Mode de transport utilisé pour rejoindre cette étape :",
                    width: 250,
                  },
                  {
                    bold: true,
                    text: `${hebergement.informationsTransport.rejoindreEtape ?? ""}`,
                    width: "*",
                  },
                ],
              },

Je ne suis pas sûr que ces deux lignes doivent apparaître si le champ rejoindreEtape est null

authors: benjaminDNUM gweill-guigops

repo: SocialGouv/vao


text:
Random stops

@jordimas
Thanks for your effort to offer this great tool.
I've enjoyed it many times with diffferent audios and videos.
However, I've also encountered several stops, that the transcripting will stopped randomly at different localtions of a video, when I tried the 2nd or 3rd time by ending the 1st task, then it'll finish the transcripting that audio or video.
I'm using the Intel NUC11 with modified cooling fan (No GPU but will better cooling for CPU).
What's the possible reason and how to tackle it? Could you plz share your thoughts?
Thanks!

Hello. When Whisper get lots it uses random heuristics based on temperature.
Try to use the parameter "--temperature_increment_on_fallback None" to see if makes any difference.

Thanks for your comments.
I've already been using this parameter, it still stops sometimes, especially when Windows gets into the sleep mode.
Below is the full command I'm using in Total Commander (a windows file manager):
"whisper-ctranslate2 %P%S --model medium --temperature_increment_on_fallback None --language en --compute_type int8 --vad_filter True --output_format srt  --output_dir %P"
Now I'm trying a small App called "Don't sleep" which will prevent the computer from going to sleep by monitor the CPU usage constantly.
(If CPU usage is higher than the setting value, it'll keep the windows awake)

authors: goodenn jordimas


text:
webmethods-io example custom connector for home automation

Hello Peter,
please find a possible contribution to the webmethodsio-examples repository in this pull request.
It's showing a custom connector to a Netatmo Security camera that can trigger events based on motion detection or detection of identified persons. As an example, I have added a small worflow to trigger ligthing events in the Philips Hue platform.
Feedback welcome.
Peter B.

Hi Peter, thanks for the submission! Its quite large, is it possible to exclude the dependencies with a .gitignore?

Hi Peter, right - sorry, missed to gitignore node_modules, done now.
Peter

authors: pbrosi-sag peterlamar

repo: SoftwareAG/webmethodsio-examples


text:
LSP Auto-complete Issues

Hi,
first of all a big thank you for building this, I very much appreciate the effort and usability that's already there!
I am running into a couple of issues when using VSCode and the LSP with regards to Auto-complete:
Structs

Having a struct instance that’s initialized via the literal syntax .{} breaks the auto-completion.
Reproduction:

My_Struct :: struct {
    my_value : int;
}
my_struct : My_Struct = .{my_value = 5}; // This breaks auto-complete

my_struct : My_Struct; // For comparison, this works with auto-complete
my_struct.my_value = 5;

Having a struct with using or #as using breaks the auto-completion.
Reproduction:

My_Struct :: struct {
    using other : My_Other_Struct;
    my_value : int;
}

My_Other_Struct :: struct {
    other_value : string;
}
my_struct : My_Struct;
my_struct.my_value = 5; // This works with auto_complete
my_struct.other_value = "test"; // This does not work with auto-complete for other_value

#import auto-complete
EDIT: It seems like the newest Jai version (0.1.086) fixed the auto-complete of the module I was using again, thankfully.
However, I have one quality of life issue:
When importing my Raylib module via rl :: #import "raylib";
and then using rl., the auto-completion list includes everything, including other module's namespaces, like e.g. the Basic module, etc.
It would be great if this could be fixed somehow, as rl.log does not make any sense / does not exist, but is still suggested as a valid auto-completion.

I can confirm I have had these problems too.

Instead of creating another autocomplete feature request, I'll just add it here:
Stuff from preload is always in the global scope. But I have to explicitly import it with #import "Preload" to get autocompletion for things like Type_Info_Struct and friends. And explicitly importing Preload is quite discouraged by the compiler!

Instead of creating another autocomplete feature request, I'll just add it here:
Stuff from preload is always in the global scope. But I have to explicitly import it with #import "Preload" to get the autocompletion for things like Type_Info_Struct and friends. And explicitly importing Preload is quite discouraged by the compiler!

Jails currenty does not include Preload or Runtime_Support by default in its analyzer. I´ve already start to work on this.

authors: SogoCZE konsuko valignatev wijiler

repo: SogoCZE/Jails


text:
Wrong HTTP Status Code on Auth Failed

When an authentication fails Auth0 is returning 500 status code instead of 401

@matiastucci is it done?

Nope

Fixed with PR #35

repo: Solidalert/api


text:
Goldstone server RPM packaging part deux

Would like to have a solution similar to what @slashk has done with goldstone-agent.  Should:

use versioning format consistent with agent
integrate with CircleCI (talk to @heidecke)
build the opensource version as RPM (no compliance submodule installed)
build the enterprise version as RPM (compliance submodule installed)

Decide where to store the RPMS.  Enterprise should go to bintray (secured).  OpenSource could go to one or more of a) CircleCI artifacts, b) github releases page, c) bintray (unsecured)

Current status (circleci build 213):

ported semver.sh for consistent versioning
circle.yml updated to build gs and gse packages. packages currently at circleci artifacts.

Currently status/bugs:

versioning of packages differs between local and circleci ( local: goldstone-server-0.7.2-SNAPSHOT.498.gb8a2e5f.rpm.el7.x86_64.rpm, circleci: goldstone-server-new-SNAPSHOT.dashboard.162.gc4be4a9.rpm.el7.x86_64.rpm). i think that it is getting the -new instead of tag from pulling as a detached head. @heidecke thoughts ?
need to do real integration tests on resulting rpm -- they pass smoke tests in containers.

authors: jxstanford slashk

repo: Solinea/goldstone-server


text:
refresh token

Is there any way to get a refresh token? , normally the tokens do not last more than 12 hours, and I need to re-inspect the requests to get the token, so I saw discord has a ws where the token is passed. access to start

This problem has gone unnoticed by me until recently when I tried to run the library on an account with a verified phone number. There is no logic to refresh the token nor is there a callback that is called on all discord events so you can do it yourself. For now, you or anyone else with the same problem should edit the library's code on their local machine to add the needed logic. Thank you for bringing this to my attention, I will fix this in the next update of Discord User Bots.

authors: Sopur dbrab

repo: Sopur/Discord-user-bots


text:
problems accessing to template refs with composition API

following the v-for array refs and the template ref array with composition API examples I found that the template references array doesn't work as expected like with v-for, so we can't have acces correctly to the draggable elements references on the script
<Draggable
  tag="transition-group"
  item-key="id"
  :component-data="{ tag: 'ul' }"
  :list="array"
>
  <template #item="{ element }">
    <div :ref="setAccountRef" >{{ element.id }} - {{ element.text }}</div>
  </template>
</Draggable>

<script setup lang="ts">
import { ref, reactive, onBeforeUpdate, onUpdated, watch } from 'vue';
import Draggable from 'vuedraggable';

const elements = reactive([1, 2, 3, 4, 5].map((el) => ({ id: el, text: `Element ${el}` })));
const elementRefs = ref<Element[]>([]);

onBeforeUpdate(() => {
  elementRefs.value = [];
});

onUpdated(() => {
  console.log('element refs', elementRefs.value);
});

function setElementRefs(refs: Element) {
  if (refs) elementRefs.value.push(refs);
}
</script>

👩🏻🔬 I used the base vite-vue-ts template to replicate the issue in this stackblitz, the two components VForRefs.vue and DraggableRefs.vue shows the working v-for example and the other one using the vuedraggable component
🔥 we should have access to the elements ref, but the beforeUpdate and the updated lifecycle hooks doesn't seems to be triggered properly after modify the elements list when using composition API reactive and ref
System info
macOS v11.2.3
Node v16.13.1
npm 8.1.2
Packages
vue 3.2.25
vuedraggable 4.1.0
Builder
vite 2.7.2
@vitejs/plugin-vue 2.0.0
typescript 4.4.4
vue-tsc 0.29.8
Browser
Chrome 97.0.4692.99

Same problem here.
Are there any solutions/ workarounds for getting a NodeList from the draggable component?

I've been looking an answers on how to use refs with the next version of vuedraggable but I cannot find it online. By following the v-for Array Refs documentation I came up with this solution. See stackblitz example
https://stackblitz.com/edit/nuxt-starter-gcqtdj?file=app.vue

authors: ReaganM02 StefanFlaschko salazarr-js


text:
Preset stuff is wrong

StyleCI's presets are NOT the same as php-cs-fixer levels I'm afraid.

Could you elaborate?
I especially avoid the recommended preset, but what about the symfony one? Could I have the diff?
And maybe, could we have a more convenient solution like a preset that respect php-cs-fixer and another one with a custom name?

@GrahamCampbell At least, I can maybe work to get fixers and preset from your own repositories instead of CS fixer but we have to get this working for PHP 5.3+. Could this be possible?
Related: https://github.com/Soullivaneuh/php-cs-fixer-styleci-bridge/issues/6#issuecomment-142296204

Partially fixed on #9.

authors: GrahamCampbell Soullivaneuh


text:
lhapdf-deploy/ARCH=x86_64,GCC_VERSION=6.3.0,NAME=LHAPDF,OPENMPI_VERSION=1.8.8,OS=u1610,SITE=generic,VERSION=6.2.0 #5 failed

Build 'lhapdf-deploy/ARCH=x86_64,GCC_VERSION=6.3.0,NAME=LHAPDF,OPENMPI_VERSION=1.8.8,OS=u1610,SITE=generic,VERSION=6.2.0' is failing!
Last 50 lines of build output:
[...truncated 43.90 KB...]
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec
 There seems to be a download currently under way, will check again in 5 sec

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
Build step 'Execute shell' marked build as failure
[WARNINGS] Skipping publisher since build result is FAILURE

Changes since last successful build:
View full output

Build was fixed!

repo: SouthAfricaDigitalScience/lhapdf-deploy


text:
Correccion alets por Toast

-Cambio alert(),  por -> toast.type

correccion completa

repo: SouthThunder/FrutCol


text:
[Robot] Prevent arm from slamming into the grid

This PR forces the arm to move up first before moving over or over first before moving down. Instead of taking the most direct path, it takes a path that shouldn't hit the grid if we start moving it while close to the snap point.
Tested and working in the simulator.

This is now tested and working IRL as well.


text:
Add API Docs to the Dev Hub

Need some help on the top margin. The navbar sits on top of it until you first scroll.
Also, I had to add the embed script to the head include. I don't like that every page now loads it. Need to figure out how to conditionally load it.

Will need to make sure we can put a redirect in place from the marketing site so we don't break links on KB articles.

Resolved the head include issue.

I updated the margin issue - can you take a quick look to confirm it looks OK?

authors: aydrian richleland


text:
Input file for SVM

upload enwiki-doc file

this is optional. i remove it from the SVM/bin/gen_data.sh

repo: SparkTC/spark-bench


text:
Return single file status, when globber has no path pattern (Spark Streaming fix)

Developer's Certificate of Origin 1.1
   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

@gilv I tested this with Spark Streaming and it works. The only thing we have to change is we specify the directory as "swift2d://directory.service/" instead of "swift2d://directory.service/*"

@djalova I think "swift2d://directory.service/*" is fine, i am not sure we need "swift2d://directory.service/". There is no spec i think for this

@djalova can you please explain this pull request? We already return single file status, in
if (candidates == null) {         return new FileStatus[0];       }

@gilv I think both ways should work. When you make the call you pass in the path of a directory so it should be possible to pass in a single directory path. For the second point we were actually returning a list of paths before, so I changed it to getFileStatus in case we wanted to get the file status for the root directory.

@djalova so what this commit changes comparing to previous code? What it improves? Thanks

@gilv Previously we would query for a list of FileStatuses when we only needed one. This patch is an improvement because now we only query for the FileStatus we need.
Also ifObjectStoreGlobber.glob("swift2d://container.service/) is ever called (without any pattern). We need to return a FileStatus for the root directory. Currently this will return the first item in the container, which is incorrect.

@djalova thanks. merged

authors: djalova gilv

repo: SparkTC/stocator


text:
🛑 Yiffed Main is down

In c38d925, Yiffed Main (https://yiffed.net/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Yiffed Main is back up in 695b365 after 8 minutes.

repo: SparksTheFolf/STF-Uptime-Status


text:
batch load - basic DWCA occurrence records

Our museum staff uses GBIF's spreadsheet to record occurrence (specimen) data.
We pared the columns down to the essentials (for us) and added a few to facilitate georeferencing. All column headers in our sheet are Darwin Core terms:

catalogNumber
scientificName
taxonRank
family
kingdom
individualCount
organismQuantity
organismQuantityType
basisOfRecord
eventDate
recordedBy
verbatimLocality
locationRemarks
associatedTaxa
occurrenceRemarks
countryCode
stateProvince
county
municipality
locality
decimalLatitude
decimalLongitude
coordinateUncertaintyInMeters
georeferencedBy
georeferenceProtocol
georeferenceRemarks
geodeticDatum
collectionID
occurrenceID

We upload these sheets (.csv) to SCAN (Symbiota) and would like to load them into our TaxonWorks project as well. Our current workflow is to populate a sheet with about 2000-3000 rows' worth of specimens, transcribed straight from the labels. We then use OpenRefine to clean it up and cluster certain localities for efficient georeferencing. We're starting to see many of the same localities pop up again and again. It would be great if we could apply our prior georeferencing effort to current and future specimens. Maybe a workflow like this:

A person transcribes labels into a spreadsheet
Spreadsheet is loaded into TaxonWorks, which checks to see that each catalog number is unique (if matches one in database already maybe the user is asked whether this is an update or should be ignored)
verbatimLocality is matched against what is in the database already (which hopefully is georeferenced) and suggests (or automatically applies?) lat/long/error for each locality
Unmatched localities get added to a "to do" list (i.e., georeference these localities)

References:
Our blank spreadsheet
Our protocol

In-process design document: https://docs.google.com/document/d/18iTlim9lLQXXTdkNUJGXP1WIPcRbYNfkz8dkLUq1YFw/edit?usp=sharing

Closed in merge of #144.  Open new issues as problems arise.  Let's patch directly on development.

authors: TuckerJD adeans mjy

repo: SpeciesFileGroup/taxonworks


text:
DWCA Importer - Geographic Areas not imported

Can we use combo of Country, State, County to match to one/two default Geographic Area in TW Gazeteer?
Alternatively, we could have them select one Gazeteer to match against.
This is mainly an issue when specimens have extremely little location data (e.g. "California") and their collecting event is imported as almost empty, since Geographic Area is not imported. In these cases, at the very least, if no geographic area imported, then whatever geographic areas are indicated in "Country/State/County" should be imported to verbatim Locality to create a slightly better Collecting Event
The extent of Collecting Event information reported in DWCA table:

Example "bad" collecting event created:

Is this done? Current imports don't seem like they match to Geoareas.

No, it still resolving through latitude/longitude.
Would this require something similar to the namespace mapper to select which GeographicArea is each chunk of text?

Maybe? I'd be fine with that personally, but it should definitely be an option, not required. Could have an option to "auto-create" if georeferences are included (solution for Brian's large dataset)? I've only got 12 areas in my latest dataset, and many of the ones I'm importing only have one or two geographic areas total so a selector would be really easy.

What if we do something like this?

Where we just specify the Geographic Area ID from Taxonworks?

Shouldn't we use Global id for the geographic area?

@adrik29 really wants this for a large dataset import

@tmcelrath -- I sure do. It would be desirable to maximized the fields you can import, once we have all the trouble to prepare the foreign databases, at least you can make it count.

Easier to implement (but at the same time reasonable for the user) would be using globally unique IDs and possibly allow to scope to a specific gazetteer (TDWG, NE, GADM).

@LocoDelAssembly Let's revisit this please.  At minimum I think we need one of these options.  For reference here are (some) of the fields in question:
    # locationID: [Not mapped]
    # higherGeographyID: [Not mapped]
    # higherGeography: [Not mapped]
    # continent: [Not mapped]
    # waterBody: [Not mapped]
    # islandGroup: [Not mapped]
    # island: [Not mapped]
    # country: [Not mapped]
    # countryCode: [Not mapped]
    # stateProvince: [Not mapped]
    # county: [Not mapped]
    # municipality: [Not mapped]
    # locality: [Not mapped]

Potential options:
1 - @tmcelrath's suggestion for a custom Geographic area ID should be straightforward to implement I hope.  Maybe we could add a UI checkbox to turn that option (or any of below on/off, or something like "Geographic area mode")
2 - I wonder if we can do a lookup option, if user provides any of country/state/county and we have an exact match within geographic areas (GeographicArea.with_name_and_parent_names(['Champaign', 'Illinois', 'United States'])).  We would use the fields in this case to be ['county',  'stateProvince', 'country'].compact.  Feels like this could be the easiest to implement.
3 - One mode could be "higherGeographyID matches TaxonWorks GeographicArea ID"? This would be a one-to-one mapping.
4 - We could provide an option to do a post-import delayed job setup where GeographicArea is set by Georeference.  Specific gazeteers could be supplied.  I have the code for this type of lookup coming on the cached map branch.
5 -  We could/should likely add an import mode that adds the fields above as data-attributes if selected.
6 - We could write a new task that seeks to assign a GeographicArea from some combination of attributes (again, possible "Mode" here).  The scope can be limited to a CollectingEvent filter query.  For example:

Match on Georeference
Match on DataAttributes
Match on ... ?

Considerations

Validation times on/off during import (doing the spatial checks)
@jlpereira we could write a new task that batch matches Georeferenced records to a GeographicArea to assign them.

@bpescador, @ChrisGrinter, @rich-keller,  @debpaul

In almost all cases, number 2 above should work.  It would be interesting to see how many of our entries are not an exact match from other gazetteers.

Any of the above would work. I will say we need to make sure nothing is matched to the geographic areas without shapes e.g. https://sfg.taxonworks.org/geographic_areas/26421
I would support number 2 for sure but then either number 1 or 3 for datasets where the geoarea is all the same or there are a limited number of geoareas to set. E.g. most of the datasets I've done so far have 1 or 2 unique Geographic Areas in the whole dataset, and manually doing them pre-import would save massive amounts of time.

Good call with the consideration for preference/requirement of shapes.
@LocoDelAssembly Maybe we need to have Redis caching to speed some aspects of the import up (i.e. once found don't hit DB but rather a memory store)?

With something like #2 (the lookup option), it seems like there should be an optional setting to specify which gazetteer(s) to search. (@LocoDelAssembly also mentioned scoping by gazetteer above.) A given project may want to standardize on a specific gazetteer for all their CEs. (In fact, specifying a standard gazetteer for a project would also simplify filtering by geographic area in the UI, where it is confusing to have multiple counties/states/countries returned from multiple gazetteers. But this is a different issue...) I also like the flexibility to map explicitly to a specific geographic area ID as @tmcelrath suggested.

authors: LocoDelAssembly adrik29 bpescador mjy rich-keller tmcelrath


text:
Hover Effect, Bug, Logo size

Describe the issue: 1. he navbar looks simple, this can be more creative and effective for user experience to add hover in navbar.
2. The content of landing page is mixing with image, the last two lines of content is going to mislead image.
3. Size of logo of website is too small then navbar at least and other content of website.
How to reproduce the issue: I can add hover in navbar, Fix bug, can increase the size of logo so that logo can be seen easly.
Proof of issue(Screenshot/Location where to find the issue): Mention where to find the issue, also attach proof of issues is available

Bug :

Please assign this issue to me under gssoc21.

Hi @RuchiGitHu! You can proceed with the issue, however, the hover action is not required. So please implement the rest of the changes.
Thank you.

repo: Spectrum-CETB/LesKollab


text:
MedGui Reborn v0.109 error when going to Advanced Setting for any system

See image for error:

This happens right after the message "Detected a specific console config, global settings will be ingored" pops up.  The settings still show up underneath that error message and pressing the continue button makes the message go away.  I haven't noticed anything detrimental about doing that.
Here's what the details say:
See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.
************** Exception Text **************
System.InvalidCastException: Conversion from string "phr256blend_auto512" to type 'Integer' is not valid. ---> System.FormatException: Input string was not in a correct format.
at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
at System.Number.ParseDouble(String value, NumberStyles options, NumberFormatInfo numfmt)
at System.Double.Parse(String s, NumberStyles style, NumberFormatInfo info)
at System.Double.Parse(String s, NumberStyles style, IFormatProvider provider)
at Microsoft.VisualBasic.CompilerServices.Conversions.ParseDouble(String Value, NumberFormatInfo NumberFormat)
at Microsoft.VisualBasic.CompilerServices.Conversions.ToInteger(String Value)
--- End of inner exception stack trace ---
at Microsoft.VisualBasic.CompilerServices.Conversions.ToInteger(String Value)
at MedGuiR.MgrSetting.EnableSetOptions()
at MedGuiR.MgrSetting.add_tabs()
at MedGuiR.MedGuiR.improm()
at MedGuiR.MedGuiR.AdvancedSettingToolStripMenuItem_Click(Object sender, EventArgs e)
at System.Windows.Forms.ToolStripItem.RaiseEvent(Object key, EventArgs e)
at System.Windows.Forms.ToolStripMenuItem.OnClick(EventArgs e)
at System.Windows.Forms.ToolStripItem.HandleClick(EventArgs e)
at System.Windows.Forms.ToolStripItem.HandleMouseUp(MouseEventArgs e)
at System.Windows.Forms.ToolStripItem.FireEventInteractive(EventArgs e, ToolStripItemEventType met)
at System.Windows.Forms.ToolStripItem.FireEvent(EventArgs e, ToolStripItemEventType met)
at System.Windows.Forms.ToolStrip.OnMouseUp(MouseEventArgs mea)
at System.Windows.Forms.ToolStripDropDown.OnMouseUp(MouseEventArgs mea)
at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
at System.Windows.Forms.Control.WndProc(Message& m)
at System.Windows.Forms.ScrollableControl.WndProc(Message& m)
at System.Windows.Forms.ToolStrip.WndProc(Message& m)
at System.Windows.Forms.ToolStripDropDown.WndProc(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
************** Loaded Assemblies **************
mscorlib
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8806 (QFE.050727-8800)
CodeBase: file:///C:/Windows/Microsoft.NET/Framework/v2.0.50727/mscorlib.dll
MedGuiR
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Users/Balthier/Documents/EMU/MedGui%20Reborn/MedGuiR.exe
Microsoft.VisualBasic
Assembly Version: 8.0.0.0
Win32 Version: 8.0.50727.8007 (FX35W81RTMGDR.050727-8000)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/Microsoft.VisualBasic/8.0.0.0__b03f5f7f11d50a3a/Microsoft.VisualBasic.dll
System
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8806 (QFE.050727-8800)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System/2.0.0.0__b77a5c561934e089/System.dll
System.Windows.Forms
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8015 (FX35W81RTMGDR.050727-8000)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Windows.Forms/2.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
System.Drawing
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8019 (FX35W81RTMGDR.050727-8000)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Drawing/2.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
System.Runtime.Remoting
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8771 (QFE.050727-8700)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Runtime.Remoting/2.0.0.0__b77a5c561934e089/System.Runtime.Remoting.dll
System.Configuration
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8007 (FX35W81RTMGDR.050727-8000)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Configuration/2.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
System.Xml
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8773 (QFE.050727-8700)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Xml/2.0.0.0__b77a5c561934e089/System.Xml.dll
DiscTools
Assembly Version: 1.0.25.0
Win32 Version: 1.0.25
CodeBase: file:///C:/Users/Balthier/Documents/EMU/MedGui%20Reborn/DiscTools.DLL
System.Management
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8766 (QFE.050727-8700)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/System.Management/2.0.0.0__b03f5f7f11d50a3a/System.Management.dll
SevenZipSharp
Assembly Version: 0.64.3890.29348
Win32 Version: 0.64.3890.29348
CodeBase: file:///C:/Users/Balthier/Documents/EMU/MedGui%20Reborn/SevenZipSharp.DLL
Accessibility
Assembly Version: 2.0.0.0
Win32 Version: 2.0.50727.8007 (FX35W81RTMGDR.050727-8000)
CodeBase: file:///C:/Windows/assembly/GAC_MSIL/Accessibility/2.0.0.0__b03f5f7f11d50a3a/Accessibility.dll
FTPclient
Assembly Version: 1.0.0.0
Win32 Version: 1.0.0.0
CodeBase: file:///C:/Users/Balthier/Documents/EMU/MedGui%20Reborn/FTPclient.DLL
************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.
For example:

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.
Quick edit:  I did a search for "phr256blend_auto512" and the only google result was from here: https://mednafen.github.io/documentation/snes_faust.html
Something about the "snes_faust.h_filter", but I don't emulate SNES with mednafen, just PC Engine mostly.  I guess I should also add that I only use stable builds of Mednafen, which right now I have v1.22.2.  I guess this snes faust is some new thing.

Thanks for report the bug, this version should solve the problem:
MedGuiR.zip
This version fix a problem with per-config console file detection and change the behavior of rom file finder.

Good to know that this time it wasn't my pc being a piece of junk and fussing :P  Thanks!

Np, when you have the time, can you confirm that the problem is solved?

The bug seem solved, at the moment i close the issue

repo: Speedvicio/MedGuiReborn


text:
Add a switch to use the old parrying formula

Old parrying formula available here: http://web.archive.org/web/20000306210936/http://uo.stratics.com:80/parr.htm

Shouldn't be the default formula for AR with Shields when Combat Elemental engine is disabled?

Right now the displayed AR doesn't change with the parrying skill, also the shield is counted as hand armor, i think someone would like to add that to the global armor instead

Yes it's related to this change from MArch 2016
Changed: Slightly changed armor % distribution between layers to match old T2A style.
-Distribution on shields is now 7% of ARMOR value instead [Item ARMOR * (Char PARRYING / 10)]. This could reduce a lot of ARMOR on shields, but there's no problem since shields are used to block the entire damage (parrying) and not to raise ARMOR.

repo: Sphereserver/Source-experimental


text:
有关于一些使用上的问题

谢谢您之前对我的指导，现在问题解决了，我翻看了您之前对其它一些同学解答的问题，可谓是比较详细的解答的，但是其中对于刚入门的我还是有点使用上的问题想向您请教，第一个图是您回答的一个issue,我不太理解”使用task dump中配置文件初始化一个dee_task，之后导入已训练好的模型权重“这句话（使用上的流程），期待您的回复

请查看 inference.py 文件。另外工具使用类issue请务必按照template进行提问。


text:
Use APR inside modsec-sdbm-util

This is a big patch that uses APR's API instead mix of posix and APR functions. Instead getopt, apr_getopt is used, so that util can be used on multiple platforms. I have added Windows nmake file, so the util can be build with MSVC.

Hi @mturk.
Sorry for not reply that promptly. Thank you for the pull request. Any specific reason why you have it closed?

There were no response for more then a year, so I presumed such a big change is not acceptable to upstream community. Code is still here in case someone needs a portable version of the util.

authors: mturk zimmerle

repo: SpiderLabs/modsec-sdbm-util


text:
Add Typing and Update Docstrings

I used Sequence in the typing since list and array would work as sequences, but I think Sequence could confuse beginners, so I left list or np.array in most of the docstrings. I could alternatively change everything to Union[list, np.ndarray], but that is a bit verbose.

Codecov Report
Patch coverage: 94.54% and project coverage change: +0.01% :tada:

Comparison is base (949da47) 88.32% compared to head (d45bfa3) 88.33%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the GitHub App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #214      +/-   ##
==========================================
+ Coverage   88.32%   88.33%   +0.01%
==========================================
  Files          10       10
  Lines        1644     1646       +2
==========================================
+ Hits         1452     1454       +2
  Misses        192      192

Files Changed
Coverage Δ

src/probeinterface/probe.py
92.34% <91.42%> (+0.01%)
:arrow_up:

src/probeinterface/generator.py
98.24% <100.00%> (ø)

src/probeinterface/io.py
86.73% <100.00%> (ø)

src/probeinterface/library.py
100.00% <100.00%> (ø)

src/probeinterface/utils.py
94.28% <100.00%> (ø)

src/probeinterface/wiring.py
64.28% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Overall it was a draft, because I forgot I did it. Haha. I'll respond to your comments on each comment.

As long as people are okay with | notation I would also prefer to switch from Sequence (since although it is probably the better type for developers) it is more confusing for end-users
@h-mayorquin?

Yeah, I prefer to switch away from sequence as well.

@h-mayorquin
I think I hit all of your comments, but if I missed something just let me know.

This is ready to me, @alejoe91, do you want to take a look?

Looking good on my end too! Let's merge :)

repo: SpikeInterface/probeinterface


text:
Artifact the protodata- prefix to published artifacts

This PR updates the publishing settings to add protodata- to the names of the published artifacts (addressing #54).

Got build failure on CI, while locally it passed. Going to look into this later today.

repo: SpineEventEngine/ProtoData


text:
Fix desc.ref parsing using an incorrect newline symbol.

This PR closes https://github.com/SpineEventEngine/base/issues/329.
When the desc.ref file is parsed, names of the referenced JARs are being split by a platform-dependent line separator, which causes build failures when the actual platform separator is different from the line separator of the platform that the desc.ref file is built on.

@armiol, PTAL.

@armiol, PTAL.

@armiol, I have applied the changes discussed vocally, PTAL.

@armiol, PTAL.

repo: SpineEventEngine/base


text:
Update

Provide a description of what has been changed
Checklist

[ ] When introducing a new scaler, I agree with the scaling governance policy
[ ] I have verified that my change is according to the deprecations & breaking changes policy
[ ] Tests have been added
[ ] Changelog has been updated and is aligned with our changelog requirements
[ ] A PR is opened to update our Helm chart (repo) (if applicable, ie. when deployment manifests are modified)
[ ] A PR is opened to update the documentation on (repo) (if applicable)
[ ] Commits are signed with Developer Certificate of Origin (DCO - learn more)

Fixes #

Relates to #

/run-e2e eventemitter

/run-e2e eventemitter

repo: SpiritZhou/keda


text:
Update VineBuilder from core:invalid

Located in: core:invalid
Part of: builders
This is part of the upgrade process for Sponge and is likely involving some work and investigation.
Advice and tips include:

Sometimes things are just a simple method name change
Might be a new class or field
Understanding what the original intention of the target code had
Analyzing whether the functionality achieved by the target class/mixin still exists
Understanding the new functionality in the new Minecraft version that requires rewriting for the functionality
The SpongeAPI usage could very well have gone missing out the window if functionality was deemed unnecessary for release

Closed in https://github.com/SpongePowered/SpongeCommon/commit/c4781d0bd176182a0dedfbf9551f409e69fef2e4

authors: Zidane gabizou

repo: SpongePowered/SpongeCommon


text:
wip: Add targeted repair

Repair part of #225
Depends on #240 (which must be merged first). @khaes-kth I've implemented this to use violation IDs on the form <rule-key>:<filepath>:<line-nr>. All of that information is available to the miner, so that's the minimum we need to implement targeted repair. The miner is however missing a convenience method in RuleViolation, see the code comments.
We can discuss this further at the meeting.

This is on hold until #245 is fixed, the test failure in CI is related

I will replace this with a new PR.

repo: SpoonLabs/sorald


text:
Range Calculator

Hey @Srijita-Mandal, I would like to open this issue under JWOC. I wish  to add a calculator which will calculate the range of a population/stream by

initially sorting the array
then applying this formula:
Range(arr) = Max(arr) - Min(arr)

Kindly assign 😀

@ritika728 go for it.

repo: Srijita-Mandal/fix-your-nums


text:
is ddp valid in training code?

i want to ask whether DDP stragegy is valid in training code. In train, the function save_model_checkpoint seemed only save model that global_rank equals to 0. The training code is like training two model parallelly using different data, but only save the first model when using two gpus

DDP replicates the model across all GPUs, but during the backward pass, the gradients are synchronized across all these copies, ensuring that the models remain identical. Since all model copies are synchronized and identical, saving the model on only global_rank == 0 avoids saving redundant checkpoints from other ranks and is valid.

repo: Srijith-rkr/Whispering-LLaMA


text:
[ISSUE - 222] Add Margin to Social Links

Description
Add Margin to Social Links in the footer of the landing page.
Category

[x] User Interface

Related Issue

Fixes #222

Checklist

[x] I have gone through the CONTRIBUTING guide
[ ] The name of the resource is spelled correctly (if applicable)
[ ] The link to the resource is working (if applicable)
[ ] The resource is added in the correct format (if applicable)
[x] I have tested changes on my local computer (if applicable)

@Sriparno08 This pull request is ready for review and merge. Additionally, I kindly request you to consider adding the "JWOC" and "Difficulty" labels to this pull request.


text:
Training code for the Adversarial Diffusion Distillation(ADD) not available?

I was not able to find the code for the ADD training mechanism, when will the code be released?

Looking forward to  update the training code.

Same question. Is the training code planned to be released soon?

Actually, if you look at the ADD paper, they train StyleGAN-T++ for 2M iterations at batch size 2048 on 128 A100s. This suggests that the project had a budget that allows for ~100K USD experiments. So I highly doubt the ordinary person is going to be able to replicate their result, even with the training code available.
It is probably more appropriate to think of the ADD model as training an SD model almost from scratch. The problem it learns is much harder than LCM - they have to go from noise straight to a highly polished image.
LCM never manages to do that as the original training process of SD is not designed to do few-step denoising, so my hypothesis is that ADD has to learn a lot of new "concepts".

@jon-chuang , thanks for your feedback, I tired to implement a similar training mechanism as what ADD is doing, but it seem to having have a lot of instability in the training, which doesn't yeild good images, but looking at the papers, I think they mention that they train for 4k iterations on batch size 128 right(details in ADD paper, page 6, table 1)?

@Mohan2351999 , Have you achieved good results with your ADD training? I've also tried training a ADD, but the images generated after a few training looked terrible, like those from a failed GAN training.

@fingerk28 I was getting a similar image which becomes complete noise, with longer training, which probably could be due to instability in the training, I still face the issue of 'nan' in the grad_norm of the discriminator while training. Please let me know if you find any success with your training. thanks.

I think they mention that they train for 4k iterations on batch size 128 right(details in ADD paper, page 6, table 1)?

Ok, you're right, colour me surprised. I expected stability AI (and all major labs) to retract details like that.

but it seem to having have a lot of instability in the training,

I have the same result (and others I've talked to have reported the same).
But GAN training is generally very hard to tune.

I still face the issue of 'nan' in the grad_norm of the discriminator while training.

I think in the ADD paper they mention using R1 gradient penalty as regularization. I have yet to try this.

Btw @Mohan2351999 do shoot me an email at chuang dot jon at gmail dot com if you want to chat about this more offline. I'm quite determined to have this ADD training suceed.

Hi @jon-chuang, thanks for your answers, I have already tried including the R1 gradient penality, but still couldn't get rid of the "nan" in the gradient norm for the discriminator.
Thanks for sharing your contact, I will send you an email soon.

@Mohan2351999 @jon-chuang I have also tried reproduced ADD recently, and I have some doubts about the training data. Is it the Laion dataset ? Will the quality of training data have a significant impact on adversarial training？

@jon-chuang @Mohan2351999  Hi, have you obtained good generation results? I used the training method of ADD, but the generated images have color issues, such as oversaturation...
Just like this

And I don't know what the problem is...

Hey, there!
While the code for ADD is still unpublished, I started working on my own implementation.
In a couple of weeks I will be able to train and test my model. For my tests I have trained my own (toy) UNet on food101 dataset. And will further distill it.
Will be glad to receive any comments and pieces of advice on my work!
https://github.com/leffff/adversarial-diffusion-distillation/

Hi, the paper says that the step size of the teacher model is set to 1. I think this is unreasonable. I tried to use ddpm CIFAR10 to conduct ADD experiments. When the teacher model step size is 1, sampling is performed, and the result is a picture of completely random noise. Or is it that their teacher model is already sufficient to generate higher quality images in step 1?

you're right. The single step teacher is quite useless. You can see this from Table 1 d) by comparing the first and second row

Here are screenshots form the paper, proving they do only 1 teacher step, which is in my opinion unreasonable as we force student to produce samples of the best quality possible but in 4 steps instead of all the steps of the teacher, meaning, the teacher should make more steps.
But imagine, teacher makes less steps than the student. This means, generation quality of the teacher is worse than students'. Then why do we want students' predictions to be as close as possible to teachers'.
I do not understand this moment yet.
in this video https://www.youtube.com/watch?v=ZxPQtXu1Wbw the author says that the teacher makes 1000 steps)

@leffff I also have the same question. The experiments in the paper also show that the discriminator plays the main role. Do you currently have any results on code reproduction? I used part of your code to try to reproduce the uncondition situation on CIFAR10. The training time may be longer than I thought. If there is any progress, we can communicate at any time. Thanks, bro!

@leffff I also have the same question. The experiments in the paper also show that the discriminator plays the main role. Do you currently have any results on code reproduction? I used part of your code to try to reproduce the uncondition situation on CIFAR10. The training time may be longer than I thought. If there is any progress, we can communicate at any time. Thanks, bro!

I will soon change my UNet and dataset and switch either to Imagenet or Cifar10! If I succeed I will inform you! Waiting for your results :)

Okay I've figured out the answer.
The main contribution to distillation is made by the discriminator, while teacher is there to prevent overfitting and this is the reason the teacher only does 1 step.

@leffff Thanks for the explanation! Did you uncover any training hacks that were not mentioned in the paper? And are you getting good results for a single step?

authors: Mohan2351999 MqLeet YangPanHZAU digbangbang fingerk28 jon-chuang jonaskohler leffff m-muaz tnickMoxuan

repo: Stability-AI/generative-models


text:
Add QR-DQN

Implement QR-DQN
Description

Paper: https://arxiv.org/abs/1710.10044

[x] Implement QR-DQN
[x] Add quantile_huber_loss to sb3_contrib.common.utils
[x] Add document for QR-DQN
[x] Add benchmark

Context

[x] I have raised an issue to propose this change (required)

closes #12
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] Documentation (update in the documentation)

Checklist:

[x] I've read the CONTRIBUTION guide (required)
[ ] The functionality/performance matches that of the source (required for new training algorithms or training-related features).
[x] I have updated the tests accordingly (required for a bug fix or a new feature).
[x] I have included an example of using the feature (required for new features).
[x] I have included baseline results (required for new training algorithms or training-related features).
[ ] I have updated the documentation accordingly.
[x] I have updated the changelog accordingly (required).
[x] I have reformatted the code using make format (required)
[x] I have checked the codestyle using make check-codestyle and make lint (required)
[x] I have ensured make pytest and make type both pass. (required)

Note: we are using a maximum length of 127 characters per line
Benchmark

Environments
QRDQN
DQN

logs_qrdqn/

Breakout
413 +/- 21
~300

Pong
20 +/- 0
~20

Environments
DQN
QRDQN

logs_qrdqn/
logs_qrdqn/

CartPole
386 +/- 64
500 +/- 0

MountainCar
-111 +/- 4
-107 +/- 4

LunarLander
168 +/- 39
195 +/- 28

Acrobot
-73 +/- 2
-74 +/- 2

@araffin
Hi, I have implemented QR-DQN roughly, and I have some points I want to discuss.
1
I named some classes and variables like QuantileNetwork and current_quantile, however in TQC there are some variables like next_z. Could you tell me what names do you prefer?
2
I added quantile_huber_loss to sb3_contrib.common.utils. However, if you plan to add IQN(paper) later, tau should be an argument. What do you think?
3
I didn't inherit any classes from DQN's for simplicity. I'm familiar with RL, but not with software architecture, and I'm not sure if I should inherit and re-use it. Could you give me any advice?
4
I don't have enough computational resources to benchmark on Atari.
Could you help me test the performance once I finish implementing it?
(I only have 16GB of RAM and I usually store images as a list of LazyFrames, which uses 4 times less memory. Maybe it's better to add such a feature to reduce memory usage?)
Thanks ;)

, however in TQC there are some variables like next_z. Could you tell me what names do you prefer?

current_quantile is must better ;) (please change TQC too so the two matches, probably next_quantiles if it is next_z)

I added quantile_huber_loss to sb3_contrib.common.utils. However, if you plan to add IQN(paper) later, tau should be an argument. What do you think?

what is tau exactly? (it would be nice if we have a better name, I'm quite new to quantile regression, so everything is not too clear yet)
yes, it sounds good if it does not add too much complexity.
(I need to re-read IQN later)

I didn't inherit any classes from DQN's for simplicity.

that's fine ;)
It is part of the design choices we made for SB3.
We favor simplicity and readability over modularity. (even though we try to avoid code duplication when possible)

Could you help me test the performance once I finish implementing it?

yes ;) but please test it first on simpler env and with a smaller replay buffer size.

I only have 16GB of RAM and I usually store images as a list of LazyFrames, which uses 4 times less memory. Maybe it's better to add such a feature to reduce memory usage?

Look at the zoo and the replay buffer, we have a optimize_memory_usage argument for that ;)

please change TQC too so the two matches, probably next_quantiles if it is next_z

We favor simplicity and readability over modularity. (even though we try to avoid code duplication when possible)

yes ;) but please test it first on simpler env and with a smaller replay buffer size.

Sure, thank you for your advice.

what is tau exactly?

We model the quantile function, which is the mapping from the cumulative probability to the quantile value.
tau is the cumulative probabilities, which are fixed at equal intervals in TQC and QR-DQN (not in IQN).
So, cum_p or cum_prob would be a good candidate?

Look at the zoo and the replay buffer, we have a optimize_memory_usage argument for that ;)

I didn't notice it. It seems it stores the next observation and observation as the same array, and so efficient 👍

I'm not sure for the lazy frame, but if it is simple enough to implement,

LazyFrames is a list of arrays, and convert a list into a (frame-stacked) array when called. Because we store it as a list of arrays, which exactly is a list of references to arrays, it never store the same frame twice.
It's really simple to implement as this, but it is a little bit slow.
Thank you for your kind response.

tau is the cumulative probabilities, which are fixed at equal intervals in TQC and QR-DQN (not in IQN).

thanks for the refresher =).
So, if I remember correctly, this is the case for QR-DQN because each quantile is a "unit quantile" (in the sense each of them have the same weights)?

cum_prob would be a good candidate?

yep + a comment ;) (in case of doubt, more verbose name is always good ;))

I didn't notice it. It seems it stores the next observation and observation as the same array, and so efficient +1

yes, it is not as memory efficient as LazyFrame but it is as fast as a normal buffer and works also without frame stacking at the cost of some complexity (that's why it is False by default).

It's really simple to implement as this, but it is a little bit slow.

how much slower? (1.2x or ~2x slower)

So, if I remember correctly, this is the case for QR-DQN because each quantile is a "unit quantile" (in the sense each of them have the same weights)?

Yes 👍

how much slower? (1.2x or ~2x slower)

I will test it again in a couple of days.

I pushed some commits to rename them, what do you think?
(I modified TQC's code somewhat to make it easy to understand, sorry about that...)

Overall looks good ;) (I will check in details later)

Also, how should I evaluate QR-DQN?
The evaluation protocol of sb3 seems different from the paper.
(The paper reported the best agent's score within 125k steps(500k frames))

True, the good news is that we can compare to Intel Coach.
I would first compare on simple env (CartPole-v1, LunarLander-v2) and then go for Pong and then Breakout.
For the simpler env, you can probably take a look at dopamine or Intel Coach.
Choose the one which is easier to setup and to tweak, for instance, I did that (integrating SB3 EvalCallback) to compare SB3 TD3 performance to original implementation.

Anyway, I really appreciate your kind support ;)

your welcome =)

I quickly tested on BreakoutNoFrameskip-v4 to compare with coach. (I killed processes due to the limited resource.)
blue: max_grad_norm=10.0(default), orange: max_grad_norm: np.inf(paper)

It seems fine compared to coach. So could you help me test QR-DQN in detail?
Here are the things I want to discuss.

It's redundant if we clip the norm of the grad with np.inf. So maybe it's good if max_grad_norm can be disabled and we skip clipping? BTW, why DQN in sb3 uses max_grad_norm=10.0 by default?

Is it okay that the evaluation protocol for Atari is different from the paper?
I think (i) and (ii) can be applied to sb3.

stop episodes at 27k steps
use epsilon-greedy for evaluation (smaller epsilon than training, like 0.001)
run for 125k steps and report the best episode score.

it's redundant if we clip the norm of the grad with np.inf. So maybe it's good if max_grad_norm can be disabled and we skip clipping? BTW, why DQN in sb3 uses max_grad_norm=10.0 by default?

yes, we can make it optional, especially if it is not mentioned in the paper.
The value comes from OpenAI Baselines implementation.

Is it okay that the evaluation protocol for Atari is different from the paper?

yes, it should be at least the same as the one we used for checking DQN implementation:
so training for 1e7 steps (and periodic evaluation).

stop episodes at 27k steps

why 27k steps?

use epsilon-greedy for evaluation (smaller epsilon than training, like 0.001)

yes, we need to adapt the EvalCallback but I will do one run without first.

EDIT: I used the code below.

Please create a branch in the rl-zoo next time, as mentioned in the contributing guide ;) (I think I will do it)

Add the argument sum_over_quantiles(or other name)? Should I make cum_prob the optional argument for IQN?

sum_over_quantiles sounds good.
For the cum_prob, yes, make it probably an optional argument that you compute if not provided.

why 27k steps?

Double DQN paper mentioned it as below, and most papers follow this evaluation protocol.

We start an evaluation episode from each of these starting points and run the emulator for up to 108,000 frames (30 mins at 60Hz including the trajectory before the starting point).

Please create a branch in the rl-zoo next time, as mentioned in the contributing guide ;) (I think I will do it)

Sorry about that, and thank you ;)

The RL-Zoo branch is here ;)  https://github.com/DLR-RM/rl-baselines3-zoo/tree/feat/qr-dqn

I really appreciate your help ;)

My results on 3 seeds (Breakout and Pong) without smoothing window and with the default hyperparameters (so the exploration fraction is wrong and the epsilon for the evaluation is the same as for training):

Overall, it looks good as it matches Intel Coach results (+ a nice boost in final performance ~400 vs ~300 for DQN on Breakout) but as mentioned by @Miffyli that would nice to have at least one run with the original evaluation setting.

Thank you for your support ;)

but as mentioned by @Miffyli that would nice to have at least one run with the original evaluation setting.

Yeah, but it needs some changes to evaluation callbacks and takes some time.
Maybe, is it good to make another PR to add the evaluation callback for Atari, and add results of DQN, QR-DQN, and other discrete algorithms?

Maybe, is it good to make another PR to add the evaluation callback for Atari, and add results of DQN, QR-DQN, and other discrete algorithms?

yes, probably a good addition for another PR. But I would need @Miffyli advice on that if it is worth implementing ;) (as I'm mostly focused on Continuous Control and not really Atari games with discrete control...)

I hope to have more time end of this week or next week to finish the review ;)
Anyway thank you already for your good work =)

Thank you so much ;)

only missing to add the benchmark to the doc

Could you do this for me, or should I update the doc?

Could you do this for me, or should I update the doc?

done ;)
I also added a small benchmark (5 seeds, tuned hyperparameters) on classic control tasks.
@Miffyli I let you decide if we need more experiments (even though we match Intel Coach results), or we merge ;)

@araffin
Visually comparing results here vs. original paper the Breakout and Pong results seem to match up till the trained 10e6, so I would trust this implementation enough to use it as QR-DQN myself and believe we can merge it :).
Just two things: docs should mention what we compared against (Intel Coach and, very roughly, original paper) and also update zoo-instructions once we merge the branch.

@araffin @Miffyli
Thank you for your kind support ;)

Hate to post on very late, but is there a specific reason that we cannot use action_noise in QRDQN? Was looking to use it for exploration rather than a exploration scheduler, and would prefer using action noise over noisy nets for now.

Hate to post on very late, but is there a specific reason that we cannot use action_noise in QRDQN? Was looking to use it for exploration rather than a exploration scheduler, and would prefer using action noise over noisy nets for now.

QRDQN supports only Discrete action spaces, and there is no action_noise for Discrete spaces (at least no ones implemented in SB3 as of writing).

My results on 3 seeds (Breakout and Pong) without smoothing window and with the default hyperparameters (so the exploration fraction is wrong and the epsilon for the evaluation is the same as for training):
Environments 	QRDQN
logs_qrdqn/
Breakout 	413 +/- 21
Pong 	20 +/- 0

Overall, it looks good as it matches Intel Coach results (+ a nice boost in final performance ~400 vs ~300 for DQN on Breakout) but as mentioned by @Miffyli that would nice to have at least one run with the original evaluation setting.

@araffin I tried to reproduce those results, but it did not work out. Which version of the games were used in your benchmark? https://www.gymlibrary.ml/environments/atari/ is documenting 3 versions (v0, v4, v5) and there a couple of different options for the v5 setting as well as different versions of the environment for v4. I tried "Breakout-v5" with default options as well as "BreakoutNoFrameskip-v4" however my learning curves do not look anything comparable to yours.
Code for reproduction (I know I could use make_atari_env directly, however for usage with my own monitoring wrappers not included in this example I need to build the environment manually in order to have proper access to the env without vec wrapper and stacking):
import gym
#from rl_utils.monitor import Monitor #my custom monitor
from sb3_contrib import QRDQN

from stable_baselines3.common.atari_wrappers import AtariWrapper
from stable_baselines3.common.env_util import make_atari_env
from stable_baselines3.common.vec_env import VecFrameStack, DummyVecEnv

env = gym.make('BreakoutNoFrameskip-v4')
#gym.make('ALE/Breakout-v5', full_action_space=False, frameskip=1)
env = AtariWrapper(env)
env = DummyVecEnv([lambda: env])
env = VecFrameStack(env, n_stack=4)
#env = Monitor(env, params, "./results") # commented out, this is my custom monitor for recording learning curves
#env = make_atari_env(env, n_envs=1, seed=0)
model = QRDQN("CnnPolicy", env, verbose=1,
                             exploration_fraction=0.025,   # match QRDQN PR
                             seed=100)
model.learn(total_timesteps=10000000, log_interval=4)

My results looked like the following:

Would really appreciate if you could give me hints on reproducing your baseline.

Hello @hh0rva1h  ,

Which version of the games were used in your benchmark?

we always use the NoFrameskip-v4 (and gym 0.21).

I tried to reproduce those results, but it did not work out.

Please use the RL Zoo for that, we have instructions in the documentation:
https://sb3-contrib.readthedocs.io/en/master/modules/qrdqn.html#how-to-replicate-the-results
Instructions are also on huggingface hub: https://huggingface.co/sb3/qrdqn-BreakoutNoFrameskip-v4
and detailed hyperparameters are here: https://github.com/DLR-RM/rl-baselines3-zoo/blob/master/hyperparams/qrdqn.yml#L1

however for usage with my own monitoring wrappers not included in this example

I think your issue may come from the monitoring, please read https://github.com/DLR-RM/stable-baselines3/issues/181.
You should at least use make_vec_env and pass your custom wrappers.

we always use the NoFrameskip-v4 (and gym 0.21).

any chance you have the reasoning in mind? I thought v4-noframeskip was to be avoided due to the "memorizing sequences" problem (even with up to 30 noops I suspect it just memorizes 31 sequences)

any chance you have the reasoning in mind?

You can read more about why in the PR on updating gym:

https://github.com/DLR-RM/stable-baselines3/pull/572
https://github.com/DLR-RM/stable-baselines3/pull/734

TL;DR: the new atari v5 were not yet benchmarked and as we have everything using NoFrameskip-v4, it is best to keep it like that so we can compare apples to apples.

due to the "memorizing sequences" problem

Do you have a reference for that?

Revisiting the Arcade Learning Environment, Machado et al
page 7: The Arcade Learning Environment is also fully deter-
ministic – each game starts in the same state and outcomes are fully determined by the
state and the action. As such, it is possible to achieve high scores by learning an open-loop
policy, i.e., by simply memorizing a good action sequence, rather than learning to make
good decisions in a variety of game scenarios (Bellemare, Naddaf, Veness, & Bowling, 2015).
page 14 -> Initial Noops ... The environment remains deterministic beyond the choice of starting state. Brute-like methods still perform well.
And to verify: train a model using NoFramskip-v4 and evaluate on v4 (stochasitcity via frameskip) or v5 (stochasticity via stickies) -> it will transfer poorly.
and then other way round: train of v4 or v5 and evaluate it on  NoFramskip-v4 -> good transfer.
I imagine a more sophisitcated approach would be to take randomly some i from 1-30 and use those Noop only in evaluation but not training. If model performs poorly on those frameskips on which it was not trained -> we know it just memorized.

@hh0rva1h

Do you have by any chance baselines curves at hand for the v4 or v5 scenarios? Would be really great to have more baselines apart from the NoFrameskip-v4.

Not with qrdqn (yet). working on it. With PPO i have quite a few, but mostly with a non-standard wrapper configuration. But that would go off-topic from this PR. you can have a look at my work on tuning & env selection. Short answer: without an aimbot I get to score of 180 and with aimbot to 220 (on 1e7 training steps).I havent found a PM functionality in github - if you want a discussion on that feel free to open an issue/discussion and add me there.

Also, do you know by any chance how would one exactly match the atari setting as used in the the DQN and QR-DQN papers? ... would be closer to the paper setup than the baselines wrappers, would you agree?
Sorry, no & don't know. I was just testing models on breakout and wanted to check my results with others. Found this thread showing scores of 400 - but then realizing it is in the deterministic environment the excitement level dropped.

Thanks @mreitschuster for the links!

stochasitcity via frameskip

The RL Zoo models are using frameskip (via the MaxAndSkip wrapper) but the frame skipping is not stochastic, is that what you meant? (see https://github.com/DLR-RM/stable-baselines3/blob/a6f5049a99a4c21a6f0bcce458ca3306cef310e0/stable_baselines3/common/atari_wrappers.py#L223)

train a model using NoFrameskip-v4 and evaluate on v4

you need to be careful when you do that, because as mentioned before, if you use atari wrapper, there is frame skipping.

stochasticity via stickies

by sticky actions you mean randomly repeating actions?

@araffin

The RL Zoo models are using frameskip (via the MaxAndSkip wrapper) but the frame skipping is not stochastic, is that what you meant?
It is my understanding that we have two different frameskips available - stochastic frameskip (randomly skip frames) which is inbuilt into *-v4 (but deactivated when using *NoFrameskip-v4). it is also not active in v5 (which injects stochasticity diffferently).

and then there is the deterministic frameskip - found in sb3 atariwrapper as well as in the environment *Deterministic-v4.

you need to be careful when you do that, because as mentioned before, if you use atari wrapper, there is frame skipping.

yes you are right, but the wrapper provides determinstic frameskip (for speeding up the game), not the stochastic one (to train more transferable skills)

by sticky actions you mean randomly repeating actions?
yes.

i think if we want to deepen this (and i would be very happy to) it should be a seperate discussion.

authors: Miffyli Squeemos araffin hh0rva1h ku2482 mreitschuster


text:
Remove chatops command

How do you unregister a chatops command? I registered the run remote command from the documentation, which works. However, unregistering does either not work or the process is not straightforward. Removing the file from the my-chatops/aliases and running st2ctl reload --register-all does not work. service st2chatops restart doesn't help either.
Is this a bug or just not documented?
Edit:
I figured out that
st2 run packs.uninstall packs=my-chatops
service st2chatops restart
does the trick. Is there a way to remove single commands from a pack without removing the whole thing?

You can remove individual aliases with st2 action-alias delete

authors: LindsayHill roberterdin


text:
Implement CAIP 122

Scope
Make SIWT compliant with CAIP-122 and message signing TZIPs
Work done

Modify the message with the required parameters as per CAIP-122
Introduce ABNF definition and parser
Update verify function adapt to the new format
Update tests

without Terms and Conditions & Privacy Policy

with Terms a

nd Conditions & Privacy Policy

Got an error but can't reproduce...

Tagging @bumblefudge as you are interested in the implementation of CAIP-122 :)

authors: dansan566 jdsika royscheeren

repo: StakeNow/SIWT


text:
Srtest

Added bitstream checker to the flow, see your email for details.  Passes all existing tests.

Ha ha pull request build FAILED because of randomness in PNR which uncovered a bug.  I fixed the bug and restarted the build, hopefully it passes this time...

Lenny, that's actually good feedback; I will add a comment to the makefile before merging.  Something like "hackdiff compares PNR bitstream intent (encoded as annotations to the bitstream) versus a separately-decoded version of the bitstream, to make sure they match"
Steve
  From: Leonard (Lenny) Truong <notifications@github.com>

To: StanfordAHA/CGRAFlow CGRAFlow@noreply.github.com
Cc: steveri steveri@steveri.com; Assign assign@noreply.github.com
Sent: Wednesday, August 2, 2017 10:29 AM
Subject: Re: [StanfordAHA/CGRAFlow] Srtest (#24)
@leonardt approved this pull request.Makefile changes look good to me, although I have no idea what CGRAGenerator/bitstream/decoder/hackdiff.csh does, so I'll have to trust that it works properly—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or mute the thread.

repo: StanfordAHA/CGRAFlow


text:
Master pipeline

TODO: Implement a master pipeline that includes all currently implemented pipelines.

Current all pipeline works. For the potential case where one pipeline runs a segmentation that another pipeline needs, make sure that that segmentation is not run again.


text:
start be failed.

Steps to reproduce the behavior (Required)

CREATE TABLE '...'
INSERT INTO '....'
SELECT  '....'

Expected behavior (Required)
Real behavior (Required)
start time: Sat Jan 28 19:54:13 CST 2023
=================================================================
==25914==ERROR: AddressSanitizer: new-delete-type-mismatch on 0x6040476b1e90 in thread T603 (compact_pool):
  object passed to delete has wrong type:
  size of the allocated type:   47 bytes;
  size of the deallocated type: 31 bytes.
    #0 0x9253c97 in operator delete(void*, unsigned long) ../../.././libsanitizer/asan/asan_new_delete.cpp:172
    #1 0x94f49d6 in __gnu_cxx::new_allocator<char>::deallocate(char*, unsigned long) /usr/include/c++/10.3.0/ext/new_allocator.h:133
    #2 0x94ef588 in std::allocator_traits<std::allocator<char> >::deallocate(std::allocator<char>&, char*, unsigned long) /usr/include/c++/8/bits/alloc_traits.h:462
    #3 0x1354b58f in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_destroy(unsigned long) /usr/include/c++/8/bits/basic_string.h:230
    #4 0x1354b10f in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::_M_dispose() /usr/include/c++/8/bits/basic_string.h:225
    #5 0x1354a84d in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >::~basic_string() /usr/include/c++/8/bits/basic_string.h:661
    #6 0xffb47f0 in google::protobuf::internal::ArenaStringPtr::DestroyNoArena(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const*) /var/local/thirdparty/installed/in
clude/google/protobuf/arenastring.h:358
    #7 0x10115b66 in starrocks::ZoneMapPB::SharedDtor() /root/starrocks/gensrc/build/gen_cpp/segment.pb.cc:2857
    #8 0x100f3796 in starrocks::ZoneMapPB::~ZoneMapPB() /root/starrocks/gensrc/build/gen_cpp/segment.pb.cc:2851
    #9 0xeddbf8d in starrocks::ZoneMapIndexWriterImpl<(starrocks::FieldType)51>::flush() /root/starrocks/be/src/storage/rowset/zone_map_index.cpp:144
    #10 0xec005a7 in starrocks::ScalarColumnWriter::finish_current_page() /root/starrocks/be/src/storage/rowset/column_writer.cpp:518
    #11 0xec042f5 in starrocks::ScalarColumnWriter::append(unsigned char const*, unsigned char const*, unsigned long, bool) /root/starrocks/be/src/storage/rowset/column_writer.cpp:753
    #12 0xec02094 in starrocks::ScalarColumnWriter::append(starrocks::vectorized::Column const&) /root/starrocks/be/src/storage/rowset/column_writer.cpp:615
    #13 0xda3c328 in starrocks::SegmentWriter::append_chunk(starrocks::vectorized::Chunk const&) /root/starrocks/be/src/storage/rowset/segment_writer.cpp:300
    #14 0xf1cffe1 in starrocks::HorizontalRowsetWriter::add_chunk(starrocks::vectorized::Chunk const&) /root/starrocks/be/src/storage/rowset/rowset_writer.cpp:367
    #15 0xf19f094 in starrocks::HorizontalCompactionTask::_compact_data(int, starrocks::vectorized::TabletReader&, starrocks::vectorized::Schema const&, starrocks::RowsetWriter*) /root/starrocks/be/src
/storage/horizontal_compaction_task.cpp:135
    #16 0xf19d357 in starrocks::HorizontalCompactionTask::_horizontal_compact_data(starrocks::Statistics*) /root/starrocks/be/src/storage/horizontal_compaction_task.cpp:69
    #17 0xf19b987 in starrocks::HorizontalCompactionTask::run_impl() /root/starrocks/be/src/storage/horizontal_compaction_task.cpp:23
    #18 0xf196521 in starrocks::CompactionTask::run() /root/starrocks/be/src/storage/compaction_task.cpp:109
    #19 0xdd61c37 in starrocks::BackgroundTask::start() /root/starrocks/be/src/storage/background_task.h:17
    #20 0xdd57fef in operator() /root/starrocks/be/src/storage/compaction_manager.cpp:81
    #21 0xdd5f935 in __invoke_impl<void, starrocks::CompactionManager::_schedule()::<lambda()>&> /usr/include/c++/10.3.0/bits/invoke.h:60
    #22 0xdd5f521 in __invoke_r<void, starrocks::CompactionManager::_schedule()::<lambda()>&> /usr/include/c++/10.3.0/bits/invoke.h:110
    #23 0xdd5efdf in _M_invoke /usr/include/c++/10.3.0/bits/std_function.h:291
    #24 0x93d9bb1 in std::function<void ()>::operator()() const /usr/include/c++/10.3.0/bits/std_function.h:622
    #25 0xf82c619 in starrocks::FunctionRunnable::run() /root/starrocks/be/src/util/threadpool.cpp:44
    #26 0xf82941b in starrocks::ThreadPool::dispatch_thread() /root/starrocks/be/src/util/threadpool.cpp:536
    #27 0xf845027 in void std::__invoke_impl<void, void (starrocks::ThreadPool::*&)(), starrocks::ThreadPool*&>(std::__invoke_memfun_deref, void (starrocks::ThreadPool::*&)(), starrocks::ThreadPool*&)
/usr/include/c++/10.3.0/bits/invoke.h:73
    #28 0xf844980 in std::__invoke_result<void (starrocks::ThreadPool::*&)(), starrocks::ThreadPool*&>::type std::__invoke<void (starrocks::ThreadPool::*&)(), starrocks::ThreadPool*&>(void (starrocks::
ThreadPool::*&)(), starrocks::ThreadPool*&) /usr/include/c++/10.3.0/bits/invoke.h:95
    #29 0xf843d77 in void std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>::__call<void, , 0ul>(std::tuple<>&&, std::_Index_tuple<0ul>) /usr/include/c++/10.3.0/functional:416
    #30 0xf8426d9 in void std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>::operator()<, void>() /usr/include/c++/10.3.0/functional:499
    #31 0xf83f73d in void std::__invoke_impl<void, std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>&>(std::__invoke_other, std::_Bind<voi
d (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>&) /usr/include/c++/10.3.0/bits/invoke.h:60
    #32 0xf83d0a1 in std::enable_if<is_invocable_r_v<void, std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>&>, void>::type std::__invoke_r<void, std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>&>(std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()>&) /usr/include/c++/10.3.0/bits/invoke.h:110
    #33 0xf83910a in std::_Function_handler<void (), std::_Bind<void (starrocks::ThreadPool::*(starrocks::ThreadPool*))()> >::_M_invoke(std::_Any_data const&) /usr/include/c++/10.3.0/bits/std_function.h:291
    #34 0x93d9bb1 in std::function<void ()>::operator()() const /usr/include/c++/10.3.0/bits/std_function.h:622
    #35 0xf812ffa in starrocks::Thread::supervise_thread(void*) /root/starrocks/be/src/util/thread.cpp:326
    #36 0x7fbb871a4ea4 in start_thread (/lib64/libpthread.so.0+0x7ea4)
    #37 0x7fbb867bf8dc in __clone (/lib64/libc.so.6+0xfe8dc)

0x6040476b1e90 is located 0 bytes inside of 47-byte region [0x6040476b1e90,0x6040476b1ebf)
allocated by thread T603 (compact_pool) here:
    #0 0x9252e77 in operator new(unsigned long) ../../.././libsanitizer/asan/asan_new_delete.cpp:99
    #1 0x94f4a1a in __gnu_cxx::new_allocator<char>::allocate(unsigned long, void const*) /usr/include/c++/10.3.0/ext/new_allocator.h:115
    #2 0x967c3ff in starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> >::allocate(unsigned long) /root/starrocks/be/src/util/raw_container.h:44
    #3 0x9679f96 in std::allocator_traits<starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::allocate(starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> >&, unsigned long) /usr/include/c++/10.3.0/bits/alloc_traits.h:314
    #4 0x9679084 in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::_M_create(unsigned long&, unsigned long) /usr/include/c++/10.3.0/bits/basic_string.tcc:153
    #5 0x96775d4 in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::_M_mutate(unsigned long, unsigned long, char const*, unsigned long) /usr/include/c++/10.3.0/bits/basic_string.tcc:317
    #6 0x96768f0 in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::_M_replace_aux(unsigned long, unsigned long, unsigned long, char) /usr/include/c++/10.3.0/bits/basic_string.tcc:412
    #7 0x9675a13 in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::append(unsigned long, char) /usr/include/c++/10.3.0/bits/basic_string.h:1252
    #8 0x9674096 in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::resize(unsigned long, char) /usr/include/c++/10.3.0/bits/basic_string.tcc:352
#9 0x9673b7d in std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >::resize(unsigned long) /usr/include/c++/10.3.0/bits/basic_
string.h:940
    #10 0x9670daf in starrocks::raw::make_room(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, unsigned long) /root/starrocks/be/src/util/raw_container.h:159
    #11 0xf44c619 in starrocks::vectorized::timestamp::to_string[abi:cxx11](long) /root/starrocks/be/src/runtime/time_types.cpp:540
    #12 0xf608306 in starrocks::vectorized::TimestampValue::to_string[abi:cxx11]() const /root/starrocks/be/src/types/timestamp_value.cpp:836
    #13 0xd952aac in starrocks::ScalarTypeInfoImpl<(starrocks::FieldType)51>::to_string[abi:cxx11](void const*) /root/starrocks/be/src/storage/types.cpp:890
    #14 0xd94d3d5 in starrocks::ScalarTypeInfo::to_string[abi:cxx11](void const*) const /root/starrocks/be/src/storage/types.cpp:107
    #15 0xedafabf in starrocks::Field::to_zone_map_string[abi:cxx11](char const*) const /root/starrocks/be/src/storage/field.h:133
    #16 0xedafde6 in starrocks::ZoneMap::to_proto(starrocks::ZoneMapPB*, starrocks::Field*) const /root/starrocks/be/src/storage/rowset/zone_map_index.cpp:56
    #17 0xeddbdc6 in starrocks::ZoneMapIndexWriterImpl<(starrocks::FieldType)51>::flush() /root/starrocks/be/src/storage/rowset/zone_map_index.cpp:145
    #18 0xec005a7 in starrocks::ScalarColumnWriter::finish_current_page() /root/starrocks/be/src/storage/rowset/column_writer.cpp:518
    #19 0xec042f5 in starrocks::ScalarColumnWriter::append(unsigned char const*, unsigned char const*, unsigned long, bool) /root/starrocks/be/src/storage/rowset/column_writer.cpp:753
    #20 0xec02094 in starrocks::ScalarColumnWriter::append(starrocks::vectorized::Column const&) /root/starrocks/be/src/storage/rowset/column_writer.cpp:615
    #21 0xda3c328 in starrocks::SegmentWriter::append_chunk(starrocks::vectorized::Chunk const&) /root/starrocks/be/src/storage/rowset/segment_writer.cpp:300
    #22 0xf1cffe1 in starrocks::HorizontalRowsetWriter::add_chunk(starrocks::vectorized::Chunk const&) /root/starrocks/be/src/storage/rowset/rowset_writer.cpp:367
    #23 0xf19f094 in starrocks::HorizontalCompactionTask::_compact_data(int, starrocks::vectorized::TabletReader&, starrocks::vectorized::Schema const&, starrocks::RowsetWriter*) /root/starrocks/be/src
/storage/horizontal_compaction_task.cpp:135
    #24 0xf19d357 in starrocks::HorizontalCompactionTask::_horizontal_compact_data(starrocks::Statistics*) /root/starrocks/be/src/storage/horizontal_compaction_task.cpp:69
    #25 0xf19b987 in starrocks::HorizontalCompactionTask::run_impl() /root/starrocks/be/src/storage/horizontal_compaction_task.cpp:23
    #26 0xf196521 in starrocks::CompactionTask::run() /root/starrocks/be/src/storage/compaction_task.cpp:109
    #27 0xdd61c37 in starrocks::BackgroundTask::start() /root/starrocks/be/src/storage/background_task.h:17
    #28 0xdd57fef in operator() /root/starrocks/be/src/storage/compaction_manager.cpp:81
    #29 0xdd5f935 in __invoke_impl<void, starrocks::CompactionManager::_schedule()::<lambda()>&> /usr/include/c++/10.3.0/bits/invoke.h:60

Thread T603 (compact_pool) created by T0 here:
    #0 0x91fcb72 in __interceptor_pthread_create ../../.././libsanitizer/asan/asan_interceptors.cpp:214
    #1 0xf81244e in starrocks::Thread::start_thread(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std:
:allocator<char> > const&, std::function<void ()> const&, unsigned long, scoped_refptr<starrocks::Thread>*) /root/starrocks/be/src/util/thread.cpp:281
    #2 0xf82fc1a in starrocks::Status starrocks::Thread::create<void (starrocks::ThreadPool::*)(), starrocks::ThreadPool*>(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>
> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, void (starrocks::ThreadPool::* const&)(), starrocks::ThreadPool* const&, scoped_refptr<starrocks::Threa
d>*) /root/starrocks/be/src/util/thread.h:55
    #3 0xf82a6b9 in starrocks::ThreadPool::create_thread() /root/starrocks/be/src/util/threadpool.cpp:587
    #4 0xf823b88 in starrocks::ThreadPool::init() /root/starrocks/be/src/util/threadpool.cpp:254
    #5 0xf820845 in starrocks::ThreadPoolBuilder::build(std::unique_ptr<starrocks::ThreadPool, std::default_delete<starrocks::ThreadPool> >*) const /root/starrocks/be/src/util/threadpool.cpp:81
    #6 0xdd57805 in starrocks::CompactionManager::schedule() /root/starrocks/be/src/storage/compaction_manager.cpp:49
    #7 0xde58889 in starrocks::StorageEngine::start_bg_threads() /root/starrocks/be/src/storage/olap_server.cpp:164
    #8 0x9293c32 in main /root/starrocks/be/src/service/starrocks_main.cpp:283
    #9 0x7fbb866e3554 in __libc_start_main (/lib64/libc.so.6+0x22554)

SUMMARY: AddressSanitizer: new-delete-type-mismatch ../../.././libsanitizer/asan/asan_new_delete.cpp:172 in operator delete(void*, unsigned long)
==25914==HINT: if you don't care about these errors you may set ASAN_OPTIONS=new_delete_type_mismatch=0
==25914==ABORTING

StarRocks version (Required)

You can get the StarRocks version by executing SQL select current_version()

mysql> select current_version();
+-------------------------+
| current_version()       |
+-------------------------+
| BRANCH-2.5-ASAN 18d2bb6 |
+-------------------------+
1 row in set (0.03 sec)

When allocate string, using starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> >, which will allocate extra 16bytes
std::__cxx11::basic_string<char, std::char_traits<char>, starrocks::raw::RawAllocator<char, 16ul, std::allocator<char> > >

But, when deallocate string, using std::allocator<char>, which will cause memory leak.
std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >

cause by link with C++20 ABI

authors: luohaha stdpain yongbingwang

repo: StarRocks/starrocks