text:
Groupwise Transform

More of a question than an issue. But I suppose this is the best avenue.
When performing a groupwise registration. Is it possible to obtain the transformation that was performed on each volume? I have registered a set of intensity images using groupwise from a small population and now want to apply that transformation to each respective labelmap (segmentation).
Anyone done something similar and have any suggestions?
Thanks,
Anthony.

One approach is to construct a 4D image of labels using the same sequence as for the intensity images and then warp with transformix. Assuming you have already run registration, do something along the lines of
transformParameterMapVector = SimpleElastix.GetTransformParameterMap()

# Turn off interpolation for labels (a bug in SWIG wrapping prevents us from writing directly to a parameter map in a vector so we have unwrap it first)
transformParameterMap = transformParameterMapVector[0]
transformParameterMap["ResampleInterpolator"] = ["FinalNearestNeighborInterpolator"]
resultLabel = sitk.Transformix(label4d, transformParameterMap)

I have just tried to run this on my own system and I see a big memory leak when the image is being warped. Let me know if you experience the same problem.

Thanks for the reply. I had seen your post elsewhere about GetTransformParameterMap() but somehow had my brain stuck that there would be one for each individual volume. Joining the labels together in the same fashion makes a lot more sense.
So, I tried it this way and I actually got another pixel/4D error, attached:
`resultLabel = sitk.Transformix(labelImage, transformParameterMap)
Traceback (most recent call last):
File "", line 1, in
resultLabel = sitk.Transformix(labelImage, transformParameterMap)
File "/Users/gattia/anaconda2/envs/sitkConda4D/lib/python2.7/site-packages/SimpleITK-0.9.1.dev21-py2.7-macosx-10.5-x86_64.egg/SimpleITK/SimpleITK.py", line 9059, in Transformix
return _SimpleITK.Transformix(*args)
RuntimeError: Exception thrown in SimpleITK Transformix: /Users/gattia/Programming/Elastix/SimpleElastix/Code/Elastix/src/sitkSimpleTransformix.cxx:90:
sitk::ERROR: SimpleITK does not support the combination of image type "16-bit signed integer" (short) and dimension 4`

Ah, I forgot, SimpleTransformix support for 4D has been disabled because of said memory leak. Add
  m_MemberFactory->RegisterMemberFunctions< BasicPixelIDTypeList, 4, SimpleTransformixAddressor< MemberFunctionType > >();

here.

I have a question about CMake... sorry its somewhat off topic. I find that whenever I make a change to the SimpleElastix folder i.e. this case or a git pull that simply going back into ccmake . in my build directory and regenerating and then doing another make -jx doesn't do the trick. I find that I need to make an entire new build directory and do a new build for the changes to work. Is this normal?  I've tried the quick approach and it didn't allow me to do the transform so I am about to do another build directory but wanted to check if there is a quicker way as a new build takes quite a while.

Yes, this happens if you are in the top-level SuperBuild directory. After SimpleElastix has been build the first time, you can step into the SimpleITK-build directory and work from there. Running make in this directory will pick up any changes :)

Thanks for that. Made things a little easier.
So. I do get an error on the transform.

runfile('/Users/gattia/Programming/Segmentation/PCApython/importRegisterDisplay.py',

wdir='/Users/gattia/Programming/Segmentation/PCApython')
Traceback (most recent call last):

File "", line 1, in
runfile('/Users/gattia/Programming/Segmentation/PCApython/importRegisterDisplay.py', wdir='/Users/gattia/Programming/Segmentation/PCApython')

File "/Users/gattia/anaconda2/envs/sitkConda4D/lib/python2.7/site-packages/spyderlib/widgets/externalshell/sitecustomize.py", line 699, in runfile
execfile(filename, namespace)

File "/Users/gattia/anaconda2/envs/sitkConda4D/lib/python2.7/site-packages/spyderlib/widgets/externalshell/sitecustomize.py", line 81, in execfile
builtins.execfile(filename, *where)

File "/Users/gattia/Programming/Segmentation/PCApython/importRegisterDisplay.py", line 137, in
resultLabel = sitk.Transformix(labelImage, transformParameterMap)

File "/Users/gattia/anaconda2/envs/sitkConda4D/lib/python2.7/site-packages/SimpleITK-0.9.1.dev21-py2.7-macosx-10.5-x86_64.egg/SimpleITK/SimpleITK.py", line 9059, in Transformix
return _SimpleITK.Transformix(*args)

RuntimeError: Exception thrown in SimpleITK Transformix: /Users/gattia/Programming/Elastix/SimpleElastix/Code/Elastix/src/sitkSimpleTransformix.hxx:62:
sitk::ERROR: Errors occured in transformix. If you do not see any other error message, set LogToConsoleOn() or LogToFolder("path/to/folder") to view transformix output.`

and when looking at the console log there are a bunch of warnings and then an error:

transformix is started at Fri Mar  4 14:53:56 2016.

Installing all components.
InstallingComponents was successful.

ELASTIX version: 4.801
Command line options from ElastixBase:
-out      output_path_not_set
-threads  unspecified, so all available threads are used
-def      unspecified, so no input points transformed
-jac      unspecified, so no det(dT/dx) computed
-jacmat   unspecified, so no dT/dx computed<

Reading input image ...
Reading input image took 0.000012 s
Calling all ReadFromFile()'s ...
WARNING: The parameter "BSplineTransformSplineOrder", requested at entry number 0, does not exist at all.
The default value "3" is used instead.
WARNING: The parameter "NumberOfSubTransforms", requested at entry number 0, does not exist at all.
The default value "2" is used instead.
WARNING: The parameter "StackOrigin", requested at entry number 0, does not exist at all.
The default value "5.3475e-314" is used instead.
WARNING: The parameter "StackSpacing", requested at entry number 0, does not exist at all.
The default value "2.08601e-308" is used instead.
WARNING: The parameter "GridSize", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 0, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 0, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSize", requested at entry number 1, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 1, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 3, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 4, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 5, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSize", requested at entry number 2, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 2, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 6, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 7, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 8, does not exist at all.
The default value "1" is used instead.

--------------- Exception ---------------

itk::ExceptionObject (0x285216db8)
Location: "unknown"
File: /Users/gattia/Programming/Elastix/sitkConda4D/elastix/src/Components/Transforms/StackTransform/itkStackTransform.hxx
Line: 51
Description: itk::ERROR: StackTransform(0x28520fce0): Number of parameters does not match the number of subtransforms * the number of parameters per sub transform.

Errors occurred

I assume you are trying to warp the 4D label image (correct me if I'm wrong). Can you double check that there is an equal amount of label images in the 4D label as in the 4D image and that the field of view for corresponding images are the same?

You are correct. And they are the same. I went through and they are all the same dimensions: 94,512,512,10. They even have the same origin, direction, index to point, and inverse direction matrices.

Looking at the log, it says StackOrigin is equal to 5.3475e-314 and StackSpacing is equal to 2.08601e-308. These values are probably misconfigured by elastix. What happens if you set these to zero manually? To test this add them to the parameter map like this
parameterMap["StackOrigin"] = ["0.0"]`

(Python)

Thanks for the help... and sorry it took so long to finally give it a try. So, I tried that and it changed things up... but there is still an issue. Im not sure what the side-effects or presentation of a memory leak is but that might be what it is. Anyways, I got an error in my console indicating that

It seems the kernel died unexpectedly. Use 'Restart kernel' to continue using this console.

It did run for a little while before giving this error. Probably ran for longer than it should have, as I am guessing just applying the transform should be relatively quick (?).
and the kernel log gave the same/similar info as previously.

transformix is started at Wed Mar 23 09:54:50 2016.

Installing all components.
InstallingComponents was successful.

ELASTIX version: 4.801
Command line options from ElastixBase:
-out      output_path_not_set
-threads  unspecified, so all available threads are used
-def      unspecified, so no input points transformed
-jac      unspecified, so no det(dT/dx) computed
-jacmat   unspecified, so no dT/dx computed

Reading input image ...
Reading input image took 0.000013 s
Calling all ReadFromFile()'s ...
WARNING: The parameter "BSplineTransformSplineOrder", requested at entry number 0, does not exist at all.
The default value "3" is used instead.
WARNING: The parameter "NumberOfSubTransforms", requested at entry number 0, does not exist at all.
The default value "1035248976" is used instead.
WARNING: The parameter "GridSize", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 0, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 0, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 0, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSize", requested at entry number 1, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 1, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 1, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 3, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 4, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 5, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSize", requested at entry number 2, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridIndex", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridSpacing", requested at entry number 2, does not exist at all.
The default value "1" is used instead.
WARNING: The parameter "GridOrigin", requested at entry number 2, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 6, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 7, does not exist at all.
The default value "0" is used instead.
WARNING: The parameter "GridDirection", requested at entry number 8, does not exist at all.
The default value "1" is used instead.

Look there is something wrong with the way elastix pick up the number of sub transforms. Will have to take a closer look. In the meantime, what happens when you manually set "NumberOfSubTransforms" to the number of images in your groupwise registration?

This issue should now be fixed on the develop branch. Let me know if you try it out and anything goes wrong

Closing issue. Feel free to reopen if your problem was not fixed.

authors: gattia kaspermarstal

repo: kaspermarstal/SimpleElastix


text:
Report Generator - Unable to generate HTML Report

Good day,
I am unable to generate an HTML Report for the Task. It Fails with the following error.
2017-09-26T08:08:06.5578098Z Generating the report...
2017-09-26T08:08:06.6359156Z (node:4928) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): TypeError: Cannot read property 'name' of undefined

I can generate an MD Report but it also displays a warning.

Thank you for reporting this issue @jodachecallan  Will look in to this and release an update to fix this with in few days, I'll keep this thread updated with the progress.

Hi,
Same issue for me. I've tried with all the report types, but get the same error in all cases.
Any timeline on a fix/workaround for this?
Thanks

Hi,
Same issue for me. I've tried with all the report types, but get the same error in all cases.
Any timeline on a fix/workaround for this?
Thanks

@kasunkv I'm also getting this error as well. Any idea on a timeline in order to fix this? Not being able to publish the report from the task is a big issue.

FYI... Reporting options used are below. Tried HTML and XML but both fail.
Report filename: OWASP-ZAP-Report-$(Build.BuildId)
Destination Folder: $(System.DefaultWorkingDirectory)/MyAppName

@AshleyPoole have you tried executing the scan and generating the report form the ZAP tool? just to eliminate the possibility of missing files.
Does the MD files also not generate?

The scan is running from the task, it's just the report that isn't working.
I've actually already switched to using the alerts endpoint to download the report for a particular base url myself. Maybe the VSTS task should have an option to disable the report creation, or another option to use the alerts endpoint instead?

Also coming up with this error. Has there been any progress on how to fix or get around this? Selecting html report fails the build, where xml and the MD file options don't fail the build, but the same error occurs in a way that the build agent doesn't care about

Any update on this, im also getting this issue.....

Hi Guys, Really sorry for the late update. Couldn't find time to get around to work on this. But, the v2.0.5 is not released.  It contains the fix for the HTML report issue and few other fixes. Check it out now and let me know of the status. Thanks for your patience.

Hi @kasunkv I am using the latest v2.0.6, I have issue generating HTML and XML report, Markdown report works fine.
Here is the error when generating HTML report:
2018-05-07T22:48:28.9636359Z Generating the report...
2018-05-07T22:48:30.0466918Z ##[error]Task Failed. Error: "Cannot read property 'host' of undefined"
Here is the error when generating XML report:
2018-05-07T20:58:46.8365970Z Generating the report...
2018-05-07T20:58:49.0396146Z (node:3604) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 1): TypeError: Cannot read property 'host' of undefined
Please let me know if you need more info.
Thanks,
Dennis

Same issue for me. The Markdown report is working, but the XML/HTML is producing a "Cannot read property 'host' of undefined" error.

@kasunkv Confirmed that with v2.0.7, the html and xml reports can be generated now. and the result is correct now.  this bug can be closed.

source: gharchive/issue

authors: AshleyPoole RXtr denhsu jjburr jodachecallan kasunkv luismenco pnevill

repo: kasunkv/owasp-zap-vsts-task

license: mit

license_type: permissive

license_source: bigquery


text:
Backport github: Enable github actions

This PR enables github actions for this repository.
Fixes #875
Signed-off-by: Gabriela Cervantes gabriela.cervantes.tellez@intel.com

/test-ubuntu

/test-ubuntu

source: gharchive/pull-request

repo: kata-containers/agent

license_source: github-api


text:
pkg/katautils: Do not set init in the kernel command line

Currently kata sets the init process to systemd even when it isn't installed,
the criteria to determinate whether systemd is used as init or not
is very odd, since kata only checks whether the image option is set in the
configuration file, unfortunately not all images have systemd installed.
Instead kata should rely on the guest kernel and osbuilder to use the right
init process. osbuilder creates a symbolic link to systemd or kata-agent
depending on the AGENT_INIT environment variable.
fixes #1937
Signed-off-by: Julio Montes julio.montes@intel.com

/test

repo: kata-containers/runtime


text:
virtcontainers: Don't create vfio devices in the guest

vfio devices hotplugged in the VM are expected to be handled by the kernel
driver in the guest, hence the char vfio devices shouldn't appear in the
container under /dev/vfio/.
fixes #2539
Signed-off-by: Julio Montes julio.montes@intel.com

@amorenoz  please take a look, this should fix #2539

/test-ubuntu

/test

@devimc Does this need to be backported to 1.10?

@amshinde  yes, @chavafg already backport it

authors: amshinde devimc lifupan


text:
Numbering of solutions doesn't work in drafts

Every solution has number 1.
https://adaptarr.naukosfera.com/drafts/3f3175f8-cfbc-4a8e-af4e-5bf0a7170f66

Do they stay at 1 after you focus (place cursor in) the editor?

@MartaSztuka Could you check if this issue still occurs?

Issue does not occur anymore.

authors: MartaSztuka PiotrKozlowski aiwenar uskka

repo: katalysteducation/cnx-designer

license: MIT


text:
To Do List (Phase 4)

These changes were based on my morning session partners.
The only changes made was separating all the functions into another HS files to use them as a module, as it would increase the website running performance.

Project Complete ✅
Now the project can be merge so it can be used for the next assignment, which is testing.

repo: katarighe/to-do-list


text:
Wavesurfer on ready returns undefined as duration

In your documentation
https://wavesurfer-js.org/docs/events there is an event ready: [duration: number];. However it doesn't return a duration number, instead it returns undefined. Is there mistake in the docs?
wavesurfer.on('ready', (duration) => {
  console.log(duration) //undefined
})

This doesn't happen to me with other events such as audioprocess and it returns currentTime correctly.

Can you paste your entire code?

Can you paste your entire code?

https://jsfiddle.net/wn0f2kxm/

Prior to v7-beta, the ready event indeed didn't return anything. In your example, it's using wavesurfer v1.2.3.
Here's a v7 example: https://stackblitz.com/edit/typescript-4ggbcn?file=index.ts


text:
fix: we fixed a bug where the progress bar could not be reached to 10…

…0%. This is easy to see when the audio file is small.

commit

Coverage decreased (-0.4%) to 69.404% when pulling 69bacc928886ac2a4525d63e28b66afe1a1edf9b on tai-fe:local into b6e333c7676108909eb1c7dc9b5389c3ace66479 on katspaugh:master.

Coverage decreased (-0.4%) to 69.404% when pulling 69bacc9 on tai-fe:local into b6e333c on katspaugh:master.

Or there is no bug after pulling this version for tinny audio , i didn`t read the whole code to improve the coverage , if it takes some bug , please tell me . Thanks .


text:
lets rename to idris2?

to follow up https://github.com/kayhide/tree-sitter-idris/issues/1
the nvim-lspconfig will only work if current lifetype is idris2 https://github.com/neovim/nvim-lspconfig/blob/54617a18f4cf46f0c2f6d024fa6feb7515fe036d/lua/lspconfig/configs/idris2_lsp.lua#L6

but treesitter will throw if I name it idris2 (it creates filetype I think) https://github.com/nvim-treesitter/nvim-treesitter/pull/7274#issuecomment-2431873309 (because in grammar.js name is idris, but and this name should be the same as list.NAME)
and then I map filetype of file here https://github.com/AstroNvim/astrocommunity/pull/1258/files#diff-384113bdcc604154d09233d86ed93b355db3d4f98a6bb7b8f5635d9a64a1b840R40
and to make lsp work I make it boot on idris filetype too https://github.com/AstroNvim/astrocommunity/pull/1258/files#diff-384113bdcc604154d09233d86ed93b355db3d4f98a6bb7b8f5635d9a64a1b840R64

THEREFORE:
we can either

rename this repo from  https://github.com/kayhide/tree-sitter-idris to https://github.com/kayhide/tree-sitter-idris2 (most importantly - the name in grammar.js)
or can make pr to https://github.com/neovim/nvim-lspconfig/blob/54617a18f4cf46f0c2f6d024fa6feb7515fe036d/lua/lspconfig/configs/idris2_lsp.lua#L6 and change filetypes = { 'idris2' }, to filetypes = { 'idris' }, and then delete https://github.com/AstroNvim/astrocommunity/pull/1258/files#diff-384113bdcc604154d09233d86ed93b355db3d4f98a6bb7b8f5635d9a64a1b840R64
leave https://github.com/AstroNvim/astrocommunity/pull/1258/files#diff-384113bdcc604154d09233d86ed93b355db3d4f98a6bb7b8f5635d9a64a1b840R64 as is

I think better to 1. rename this repo, bc https://github.com/neovim/nvim-lspconfig/blob/54617a18f4cf46f0c2f6d024fa6feb7515fe036d/lua/lspconfig/configs/idris2_lsp.lua#L6 was first to define it as idris2
P.S. and then maybe as Helix to change language from idris to idris2 https://github.com/helix-editor/helix/blob/38faf74febf3332fb119302324bfd21229d39e14/languages.toml#L2350 (idris has keywork postulate, idris2 - doesnt, it uses %unsafe\nfoo : MyType instead)

except, I wonder if https://github.com/idris-community/idris2-lsp/blob/81e70d48b7428034b8bc1fa679838532232b5387/src/Server/ProcessMessage.idr#L396 will continue working

You are missing the point here. If the language name is idris (as specified in the grammar.js), you'll need to add it to nvim-treesitter under the same name. This has nothing to do with Vim filetypes; there is a separate function mapping between filetypes and languages.

@srghma Thanks for the suggestions.
But first, please consider what @clason said.
If it does not solve your issue, come back here and let's think how to address it.

ok here is my proposal

rename this repo from https://github.com/kayhide/tree-sitter-idris to https://github.com/kayhide/tree-sitter-idris2
merge https://github.com/srghma/tree-sitter-idris/commit/901b55d5851a98859f9aa632577f0036b80a87f8 to this repo
merge https://github.com/nvim-treesitter/nvim-treesitter/commit/803178d298ce5b15d58037ae85382169e7b54222
to make everything work - I have added

      -- will make ```idris foo = 1 + 2 ``` in markdown work
      -- when idris3 will be released - just replace idris2 with idris3
      vim.treesitter.language.register('idris2', 'idris')

https://github.com/AstroNvim/astrocommunity/pull/1258/files
reason
maybe there will be idris 3 - https://discord.com/channels/827106007712661524/827106088343175180/1271141058289598619

@clason why thumb down?

Because there's a lot of noise here about nothing. As long as Idris2 and Idris (and the -- so far -- mythical Idris3) are not completely incompatible languages, there's no point in renaming the grammar. (You don't have different parsers for Python 2 and Python 3, either.)

I agree
Should I then propose to change https://github.com/neovim/nvim-lspconfig/blob/bc6ada4b0892b7f10852c0b8ca7209fd39a6d754/lua/lspconfig/configs/idris2_lsp.lua#L6 with 'idris' instead of 'idris2'?
@clason

No, why? As long as there's no official filetype, all this is just pointless busywork.

@clason so, You propose

treesitter - should work in files with idris filetype
nvim-lsp
b. (if ever will be released) idris-lsp in idris filetypes
a. idris2-lsp should (and is) work in idris2 filetype
b. (if ever will be released) idris3-lsp in idris2 filetypes
marrying 1. and 2. together should done in some pluin, e.g. https://github.com/AstroNvim/astrocommunity/pull/1258/files#diff-384113bdcc604154d09233d86ed93b355db3d4f98a6bb7b8f5635d9a64a1b840

P.S. I propose to at least rename this repo from https://github.com/kayhide/tree-sitter-idris to https://github.com/kayhide/tree-sitter-idris2 because it doesnt support idris1
P.P.S. will ask in discord to provide more input from community

🤓 Well, there is https://github.com/Joakker/tree-sitter-json5 (and https://github.com/dbt-labs/tree-sitter-jinja2).
For the record, there already is an idris2 parser: https://github.com/gwerbin/tree-sitter-idris2 (archived, though).

But since the OP and the comments are a bit all over the place, let me summarize the situation from the Neovim side:

No matter what the parser is called, things will work; there are standard methods in place to deal with parser name and filetype being different.
That being said, the official filetype in Vim/Neovim is (now) idris2, so having the language be the same name would simplify things slighty. (But again, to be very clear, it's not a big deal either way. Lots of languages are in the same situation.)

So in the end, it boils down what makes most sense for the language community. In my view, a different name is only necessary if you need or want to have different parsers for different language versions -- which doesn't seem like it's the case. The only aspect might be discoverability: Having it named "idris2" would be a clear signal that the parser supports Idris2, possibly preventing questions about it. Whether that's worth the hassle of going through a full rename (potentially breaking existing consumers) is another question.

Umm, json5 is a really poor example ;-) since the 5 is an integral part of the language name, json5 is at version 2 right now (https://github.com/json5/json5/tree/v2.2.3), but you don't see the grammar name as json52, it is still json5 ;-)  You are right on jinja2 though.

Yeah, that was tongue in cheek, in case it wasn't clear.

Umm, json5 is a really poor example

I dont like this too, I wish it was called just idris, but

they have separate websites (bc this is a research language)
everyone are naming their projects idris2-xxx now

@kayhide Since https://github.com/vim/vim/pull/15987 was merged and https://github.com/kayhide/tree-sitter-idris doesnt support idris2,
could You rename https://github.com/kayhide/tree-sitter-idris to https://github.com/kayhide/tree-sitter-idris (I dont have access)
and then I will make pr to rename name = "idris" to name = "idris2" in grammar.js
and we can close this issue

Thank you for the discussion, but I am on the side of NOT changing the name as @srghma suggested.
And there may be one misundersting, let me clarify.
I just said that I have not tested for idris1. That does not exclude supporting idris1. If anybody willing to contribute supporting it, I am open to take it.
Aside the discussion above, it seems twisted to make such a change on parser's side for the sake of editor's convenience.
It reminds me a web browser updating for supporting non-standard htmls just because there exist such web pages in the wild. The result was disastrous.

....css vendor prefixes
I was thinking about this too
@kayhide do You think I should make pr and change https://github.com/vim/vim/pull/15987/files
to
au BufNewFile,BufRead *.idr			setf idris
au BufNewFile,BufRead *.lidr			setf lidris

?

No, you should not make such a change! I am frankly getting annoyed at all these pointless "let's change this!" comments. Things are fine exactly how they are now.

@srghma Well, if you have a good reason for that change.
Your idea is not backward compatibie, meaning it causes loss to the users.
So at least, you need a reason which compensates the loss.
Otherwise, it is natural that your proposal getting not accepted.

authors: alexaandru clason kayhide srghma

repo: kayhide/tree-sitter-idris


text:
does not get locally scoped CSS classes

Setting a class to a component in Svelte normally adds a special class that is used to make it locally scoped (see https://svelte.dev/docs#style). This doesn't work with <Link>.
This Svelte code:

Red link

produces this result:

Red link

This code:

<Link href="/link" className="link">Red link</Link>

produces this result:

Red link

so the link stays unstyled.

I don't think that's possible in Svelte at the moment (passing generated CSS classes down to nested components).
But you can achieve the styling by using :global() CSS modifier:

  <Link href="/link" className="link">Red link</Link>

Interesting... I'm new to Svelte and didn't know that this is not possible.

Yep, the whole idea behind scoped CSS is that you get it stuck at your component level. If you really need to set it loose, you can use :global(), but there isn't much more than that.
You could always file an Issue in Svelte repo, if you believe that's an important feature.

repo: kazzkiq/svero


text:
Changes for new Kafaka WS event

The new kafka handler uses wsid instead of accgrp.  There may be some other changes as well.

Can you remerge this from master?
There might be some conflicts now.

Done.

authors: jayrbolton scanon

repo: kbase/IndexRunner


text:
Reverse items display

I positioned the button at the top right of the screen, is there a way to display the items from top to bottom instead of the current behavior?

you can set this  : floaty.verticalDirection = .down

repo: kciter/Floaty


text:
Enhancement: Add Contributing.md for kpm(kcl package management tool)

Enhancement
kpm is cli based application integrated on top of kcl mod command. Currently there are no supporting documentation for making contributions to kpm.
I can see a similar implementation of CLI tool here based on kpm's implementation just the difference is it uses spf13/cobra for its implementation.
If the issue got approved I will going to add some sub-tasks to this issue itself for achieving a well-designed documentation. I need views on this from kcl community and kpm maintainers.
cc:  @Peefy @zong-zhe

Hi @Manoramsharma 😃
Thanks for bringing this. We appreciate your interest in making contributions to kpm and your initiative to improve its documentation. You can continue to finish this part of the work.

authors: Manoramsharma zong-zhe

repo: kcl-lang/kpm


text:
feat: GitDownloader supports cache

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

[ ] N
[x] Y

re #384

2. What is the scope of this PR (e.g. component or file name):

3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

[x] Affects user behaviors
[ ] Contains syntax changes
[ ] Contains variable changes
[ ] Contains experimental features
[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Other

4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

[x] N
[ ] Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

[x] Unit test
[ ] Integration test
[ ] Benchmark (add benchmark stats below)
[ ] Manual test (add detailed scripts or steps below)
[ ] Other

Pull Request Test Coverage Report for Build 11551094997
Details

55 of 109 (50.46%)  changed or added relevant lines in 4 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.2%) to 41.697%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

pkg/git/getter.go
5
9
55.56%

pkg/downloader/source.go
11
16
68.75%

pkg/git/git.go
0
7
0.0%

pkg/downloader/downloader.go
39
77
50.65%

Totals

Change from base Build 11477327992:
0.2%

Covered Lines:
3651

Relevant Lines:
8756

💛  - Coveralls

authors: coveralls zong-zhe


text:
✨ Rebase to 0.19

Rebased kcp-0.18 on top of kcp-0.19 (currently the branch from upstream).
This is currently needed for two reasons:
Pull in lastest changes from controller-runtime.
There was a signature change in utilruntime.PanicHandlers (0.31.0)
NOTE: supersedes https://github.com/kcp-dev/controller-runtime/pull/59

/retest

/approve

authors: sttts tnthornton

repo: kcp-dev/controller-runtime


text:
bug: It's Possible to Break Our Generated API Resource Schemas

Describe the bug
If you change the Go types and also change the generated APIResourceSchemas to perfectly match what the generator would have created, the result is that the generator won't know that the name of the APIRS needs to be bumped (generated values are equal to previous on-disk values).
Steps To Reproduce
Update a comment on a type. Update the API Resource Schema to have the new comment. Run make codegen and see no changes.
Expected Behaviour
If you change the body of a generated APIRS but not the name, something should fix that for you.
Additional Context
No response

cc @ncdc

At the very least, we should have CI verify that if a generated APIResourceSchema has diffs, metadata.name is included

authors: ncdc stevekuznetsov

repo: kcp-dev/kcp


text:
Not working for Opera

Library dosen't find opera gx and it's history

Fast check, and it doesn't get history for anything but chrome


text:
🛑 Personal I is down

In 6030b79, Personal I (https://karsten.dambekalns.de/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Personal I is back up in b5406f4.

repo: kdambekalns/uptime-monitoring


text:
fix: [message] 修复组件视觉样式

修复组件视觉样式

pass

repo: kdcloudone/kdesign


text:
Skip if the record is the same

skip updating the record if the record is the same as the current ip.

closed with 128ea80

repo: kdpuvvadi/cloudflare-ddns-powershell


text:
Slow-ish phantomjs interaction times (a single fill_in takes ~500ms)

This is with current master, elixir 1.4.0, erlang 19.1 and phantomjs version 2.1.1 (installed via npm install -g phantomjs-prebuilt) on Linux Mint 18.1 (basically Ubuntu 16.04).
I wrote an acceptance test for our application and noticed how our tests took so much longer, at first I thought it was the phantomjs startup but then measured just in the test - it took 12 seconds. Now the test is pretty thorough, and fills out a big form.
Still, that is way longer than it should take in my opinion (and feel like it'd take with capybara in ruby but of course I haven't tested it, maybe I'm just sensitive to test run times in our elixir applications).
I created a little reproduction script for wallaby:
{:ok, server} = Wallaby.TestServer.start
Application.put_env(:wallaby, :base_url, server.base_url)

use Wallaby.DSL

{:ok, session} = Wallaby.start_session

session = visit(session, "forms.html")

IO.puts "fill_in start"
{time, _} = :timer.tc fn -> fill_in(session, Query.text_field("name"), with: "Chris") end
IO.puts "Finale fill in time #{time / 1000} ms"

Wallaby.end_session(session)

I also added a couple of targeted timers to see where the slowness is coming from (you can check them out on my slowness branch)
The result is somewhat as expected, the slowdown seems to come from the communication with the phantomjs browser:
fill_in start
make_request of driver - 76.92 -body: {"value":".//*[self::input | self::textarea][not(./@type = 'submit' or ./@type = 'image' or ./@type = 'radio' or ./@type = 'checkbox' or ./@type = 'hidden' or ./@type = 'file')][(((./@id = \"name\" or ./@name = \"name\") or ./@placeholder = \"name\") or ./@id = //label[contains(normalize-space(string(.)), \"name\")]/@for)] | .//label[contains(normalize-space(string(.)), \"name\")]//.//*[self::input | self::textarea][not(./@type = 'submit' or ./@type = 'image' or ./@type = 'radio' or ./@type = 'checkbox' or ./@type = 'hidden' or ./@type = 'file')]","using":"xpath"}
make_request of driver - 48.024 -body: {"type":"browser"}
driver find_elements 125.729
make_request of driver - 78.834 -body:
make_request of driver - 47.898 -body: {"type":"browser"}
Browser.execute_query execution time 256.394 ms
make_request of driver - 72.57 -body:
make_request of driver - 46.537 -body: {"type":"browser"}
make_request of driver - 73.669 -body: {"value":["Chris"]}
make_request of driver - 44.03 -body: {"type":"browser"}
Element.fill_in time: 239.773 ms
Full fill_in time 496.354 ms

E.g. It seems every interaction takes ~ 250ms - first finding the element (first Browser.execute_query) takes that time and then filling in an element takes about the same time as well.
Can anything be done here? Are these times normal and  I'm just unaware of it and everything is slow? ;P
E.g. could some of these requests be saved? Is there a faster way of interaction? Could look to capybara/hound for checking what might be done.

Other than getting the number of requests down, it seems like there are different interaction methods: http://phantomjs.org/inter-process-communication.html
If my glance at the code didn't betray me poltergeist (the capybara phantomjs driver) uses the socket interaction out of all of these.

Poltergeist is somewhat different in that it implements an entire client in javascript and then connects to the tests via websockets. I would definitely like to speed up test times as much as we can but building a bespoke client hasn't seemed worth it yet :).
I think there are a couple of ways to help optimize wallaby + phantom. The first is to remove the explicit checks for JS logs. We should be able to get those from the phantom server as output. That will save us an extra http request per operation which should be an easy time savings.
We also do several extra queries during "finding". This is typically stuff like checking for inner text or visibility. We could probably optimize some of that as well. We would need to do more profiling first obviously.

Couldn't we also just "borrow" the poltergeist JS client and then just implement the elixir websocket part of it? Would save us some of the trouble... hoping that wallaby's requirements can be satisified with whatever poltergeist can do :) (I'm an optimist, but enough of a realist to fear that there is some very capybara specific stuff in there)
Thanks for the quick answer!
I'm also happy to add benchee and a couple of relevant benchmarks :)

Having benchmarks with benchee would be awesome! I think we should start there so that we know what we're dealing with. If we can optimize in a few places then we might be able to avoid implementing our own version of webdriver.
If we do need to start thinking about going the poltergeist route then its probably worth looking at what they have for inspiration. Right now we check a lot of properties on an element whenever we query for something. Each of those checks is an http call. We also have to retry a lot to stay in sync with the browser. I've thought for a while that it might make sense to send over queries and actions to the browser but do all of the synchronization and querying in the browser. That removes all of the overhead of extra http calls and also makes syncing easier. It would also allow us to handle some of the issues with webdriver.
I've also thought about automatically transforming all queries into xpath queries. Right now you might end up doing an http call to check visibility or to check text (counting is done in elixir without needing to do an webdriver call). We could do all of that with xpath. That would eliminate all the other webdriver calls and it would help to reduce some of the issues with checking all these elements.
Anyway those are just some ideas. I'm open to lots of solutions. We should benchmark and see if there are some easy wins. At least that way we'll know what we're dealing with.

As an update here I ran and wrote benchmarks for capybara and wallaby, hound still needs some work: https://github.com/PragTob/acceptance_test_speed
TLDR; is filling a form field in is almost a hundred times faster atm with capybara, so we have some space to improve (that's the full blown poltergeist appraoch though which will take A_LOT of time when/if we get to it)

Hey guys,
I'm sorry for what I'm about to say. Unfortunately, despite I love Wallaby's syntax, I'm going to have to switch back to Hound mostly due to the following issues

Constant connection refused errors. I don't know if something related to how the :poolboy stuff is being handled by PhantomJS crashes and I it's really complicated to debug. It's so weird that for example, these tests sometimes work when I take_screenshot but other don't.
Tests in Wallaby are very slow compared to Hound. I'm running scenarios for a SPA and the difference is about 60 secs.

That said, I'm keeping an eye on this project and on this issue in particular because I think I'd like to contribute to it to try to fix the above mentioned issues.
Besides, I was trying to write a Driver for NightmareJS but currently that's something beyond my time and abilities, and also because NightmareJS API is mostly for scripting and not actually a web driver or something you can make requests to.

@hisapy If Hound suits your needs then you should use it. Its a fine library. If you want to provide more detail about the connection refused issues I can take a look at it. If PhantomJS is crashing then that seems like a major issue. I haven't seen that before so it would be good to know about.
If you ever want to contribute feel free to just jump in. If you have any questions I'm sure all of us would be happy to help. 👍

:wave:
With the new benchee version with hooks I could finally benchmark hound vs. wallaby and yup we are indeed slower :'( Full results/benchmarks at https://github.com/PragTob/acceptance_test_speed
This is the direct comparison result:
##### With input filling a form field #####
Name              ips        average  deviation         median         99th %
hound            7.28      137.30 ms     ±1.62%      136.02 ms      144.03 ms
wallaby          2.79      358.74 ms     ±1.13%      356.10 ms      376.06 ms

Comparison:
hound            7.28
wallaby          2.79 - 2.61x slower

##### With input find css by id #####
Name              ips        average  deviation         median         99th %
hound           22.63       44.18 ms     ±1.95%       44.00 ms       48.01 ms
wallaby          5.66      176.66 ms     ±1.04%      176.00 ms      187.55 ms

Comparison:
hound           22.63
wallaby          5.66 - 4.00x slower

##### With input visit url #####
Name              ips        average  deviation         median         99th %
hound           19.02       52.59 ms     ±2.69%       52.01 ms       56.06 ms
wallaby         10.35       96.66 ms     ±1.65%       96.00 ms      103.97 ms

Comparison:
hound           19.02
wallaby         10.35 - 1.84x slower

-> For my simplish scenarios we are ~2 to 4 times slower than hound. Especially a find operation seems to be expensive.  We are a lot slower there than hound and do about 6 iterations per second. As an (even worse) comparison capybara with poltergeist does more than 1200 - so it's 200 times faster.
So, we have quite some potential for improvements :D

@stevegraham What do you mean when you say "adding a visibility check to the Path query"? I generated some flame graphs a while ago and wallaby spends the majority of its time checking for visibility of elements. This is because checking for visibility is pretty hard. Its not enough to check the element itself. The algorithm also needs to check each of the elements parent elements. I'm nervous to remove the visibility check altogether because it may allow tests to interact with dom elements that are hidden. We should test that out though and ensure that my assumptions are correct. If we could remove the visibility check altogether I believe that would give us a pretty substantial speed increase. Maybe you can benchmark that on your branch to confirm that assumption?

I'm not making any assumptions. I'm asking questions.

Sorry! I didn't mean to imply that you were making assumptions. More that I've made assumptions and those assumptions might be wrong. You're totally correct to ask those questions. I wrote this code a while ago and I can't quite remember why I made all of the decisions that I made :heart:

@hisapy @stevegraham We now have a way to skip checking element visibility with the visible: :any option. Additionally if tests are very slow when written in a declarative way, if there are multiple interactions with one element, and the element on the page is not modified in the DOM, a possible optimization is finding the element first and memoizing the Element struct instead of always passing the query. Let us know if you have any ideas on what we can do to improve Wallaby performance, all feedback and ideas are very appreciated!
@PragTob @keathley We need to check if the issue in question affects WebDriver as well. There's a plan to deprecate PhantomJS backend altogether (see #437)

@michallepicki I'm pretty sure it affects web driver as well as iirc the root cause I found is us making a lot of requests and the requests just taking its time. In my experience webdriver was even slower than phantomjs which is why I wasn't on the "deprecate phantom" wagon too early. I fear the only way to make it really fast would be a different architecture. Short term what you mentioned and/or other APIs for mass interactions could alleviate the problem.

authors: PragTob hisapy keathley michallepicki stevegraham

repo: keathley/wallaby


text:
provide valuable logs

zalogovat len jednu hlasku na konci jobu je dost malo, na debug chyby to nestaci. Ak chcem zistit ktora tabulka robi problemy napr tu:

Tak z toho logu nic nevycitam a musim to pustat tabulku po tabulke co pri 10-15 tabulkach zaberie cas, navyse ta chyba naznacuje ze sa na server vobec nepripojil.

máš stack trace v PT ne?

není tam takže to je chyba v handlování chyb

zřejmě to spadlo sem https://github.com/keboola/db-writer-mysql/blob/2a096f028769bacc59e7abb069efec68ebe234d6/run.php#L51

^ takže fixnout tohle primárně

Ja by som pridal logovanie zaciatku a konca zapisu tabulky do db, niec ako
start writing table xyz
finished writing table xyz

potom by v tomto pripade bolo zrejme ktora tabulka robi problem, v internal error vidim len MySQL server has gone away [] [] ale nie id tabulky pri ktorej to spadlo.

jo jak píšu tak to logování internal erroru je špatně to základní problém.

Jinak at to za běhu klidně loguje start a konec...

je to přesně to samé co tady https://github.com/keboola/php-component/issues/29 bohužel většina ex i db writerů to má špatně a jsou nedebugovatelný

jasne treba minimalne vyriesit logovanie tej chyby, no ak by tam bolo aj info a zaciatku a konci zapisu tak by to imho klient vydebugoval sam bez ticketu na zd

Fixed in https://github.com/keboola/db-writer-mysql/commit/8bbf369b68a67adc7fa6ec1bc01d512386000b95

authors: Halama MiroCillik kacurez

repo: keboola/db-writer-mysql


text:
Possible memory leak in Keda-operator with Kafka scaler

Hi everyone,
I started to use keda with the kafka scaler, defined it pretty simple according to the example and after deploying it to production, I noticed that every 3 days the pod reaches the kubernetes limits and get OOM. The memory increasing constantly and I'm not really sure why.
This is the deployment description (I added few parameters such as limits, priorityClass and others):
Name:                   keda-operator
Namespace:              keda
CreationTimestamp:      Mon, 27 Apr 2020 12:56:42 +0300
Labels:                 app=keda-operator
                        app.kubernetes.io/component=operator
                        app.kubernetes.io/name=keda-operator
                        app.kubernetes.io/part-of=keda-operator
                        app.kubernetes.io/version=1.4.1
Annotations:            deployment.kubernetes.io/revision: 2
Selector:               app=keda-operator
Replicas:               1 desired | 1 updated | 1 total | 1 available | 0 unavailable
StrategyType:           RollingUpdate
MinReadySeconds:        0
RollingUpdateStrategy:  25% max unavailable, 25% max surge
Pod Template:
  Labels:           app=keda-operator
  Service Account:  keda-operator
  Containers:
   keda-operator:
    Image:      docker.io/kedacore/keda:1.4.1
    Port:       <none>
    Host Port:  <none>
    Command:
      keda
    Args:
      --zap-level=info
    Limits:
      cpu:     100m
      memory:  200Mi
    Requests:
      cpu:     100m
      memory:  200Mi
    Environment:
      WATCH_NAMESPACE:
      POD_NAME:          (v1:metadata.name)
      OPERATOR_NAME:    keda-operator
    Mounts:             <none>
  Volumes:              <none>
  Priority Class Name:  line-of-business-service
Conditions:
  Type           Status  Reason
  ----           ------  ------
  Progressing    True    NewReplicaSetAvailable
  Available      True    MinimumReplicasAvailable
OldReplicaSets:  <none>
NewReplicaSet:   keda-operator-fd678455c (1/1 replicas created)
Events:          <none>

The Heap starts at around 30-40M and rinse till almost 200M, jumps to 240 and up and get OOM and restarted by the kubernetes daemon set.
Steps to Reproduce the Problem

create a scaledObject to read from a Kafka topic.
After hours of running the memory keeps increasing till it reached the pod limit

Specifications

KEDA Version: 1.4.1
Platform & Version: Kafka 2.3.0
Kubernetes Version: 1.15
Scaler(s): Kafka

@jeli8-cor thanks for submitting the issue. Are you willing to help a little bit with tracking donw the bug? Could you please ping me on slack and we can sync?

Sure, I would love to help with that. How can I find you in slack?

@jeli8-cor great, you can find me on kubernetes slack, #keda channel

Following a few tests and debugs with the dear friend @zroubalik here, I'm updating about the issue:
The issue exists in versions: 1.3.0, 1.4.0, 1.4.1 (these are the ones I checked).
The issue resolved in version V2 , still in alpha, but currently the pod runs over 3 hours now without even a minor jump in memory.
The scaler I used was Kafka and I tested it with increasing the lag, increasing the throughput, and "trigger" the scale up and down of the scaler.
According to my checks I test only Kafka scaler and prometheus scaler. Not sure 100%, but I think it's in prometheus scaler too.

@jeli8-cor thanks a lot for the testing!
We should speed up development (and release) of v2, in case we are not able to find the cause and proved a fix for this issue in v1.

Adding note that this should be included in changelog, so we don't forget.

also experienced the same memory leak issues using keda v1.4.1 with the redis list scaler, but I upgraded to v1.5.0 and looks like that resolved it

@zroubalik Yeah, we have 23 scaledobjects of which 17 use a kafka trigger and 6 a redis trigger

+1 to CPU and memory usage rising over time. 1000 SO exclusively using the Kafka scaler:

also experienced the same memory leak issues using keda v1.4.1 with the redis list scaler, but I upgraded to v1.5.0 and looks like that resolved it

Having only redis scalers and running on 2.0 I can confirm it is still existing for me.

Will try 2.1 and if it still is a thing create some own issue on that as is don't see a reference to redis directly in this one.

@lallinger-arbeit I think this was the same root cause as https://github.com/kedacore/keda/issues/1565 fixed in https://github.com/kedacore/keda/pull/1572

authors: MaxWinterstein ahmelsayed eexwhyzee jeli8-cor lallinger-arbeit mariusgrigoriu zroubalik

repo: kedacore/keda


text:
feat(ci): add ci in coverage

Pull Request type

Please check the type of change your PR introduces:

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, renaming)
[x] Refactoring (no functional changes, no API changes)
[ ] Build-related changes
[ ] Documentation content changes
[ ] Other (please describe):

What is the current behavior?

Issue Number: N/A
What is the new behavior?

Add coverage in the ci

Does this introduce a breaking change?

[ ] Yes
[x] No

Other information

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@6df312d). Click here to learn what that means.
Patch has no changes to coverable lines.

Additional details and impacted files
@@          Coverage Diff           @@
##             main     #26   +/-   ##
======================================
  Coverage        ?   2.67%
======================================
  Files           ?      17
  Lines           ?     224
  Branches        ?       0
======================================
  Hits            ?       6
  Misses          ?     218
  Partials        ?       0

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

authors: LucasLvy codecov-commenter

repo: keep-starknet-strange/beerus


text:
[feat] Check if transaction output is provably unspendable

[#185 ] resolves #
[X] follows contribution guide
[ ] code change includes tests

Adding all the validations to the respective files path that were specified on the issue description.

That error related to the hex import, dont know why is that happening.

Great! Please add some tests and we'll merge

repo: keep-starknet-strange/raito


text:
An exception when running program

I most often get this exception.
Do you have any idea? I am using your samples but weaving everything...
Unhandled Exception: System.ArgumentNullException: Value cannot be null.
Parameter name: nameSpace
at CrossCutterN.Base.Metadata.Execution..ctor(String assemblyFullName, String nameSpace, String classFullName, String className, Int32 hashCode, String fullName, String name, String returnType)
at CrossCutterN.Base.Metadata.MetadataFactory.InitializeExecution(String assemblyFullName, String nameSpace, String classFullName, String className, Int32 hashCode, String fullName, String name, String returnType)

Hi RoozBehid:
Thanks for your feedback. Could you please send the source code or dll that triggers this issue, together with your CrossCutterN configuration files to keeper013@gmail.com? So I can reproduce and fix the issue?
Thanks.

no following up.


text:
Sprint Goal tab limited to 60 characters

It seems that the allowed number of characters for the tab is 60. We have a sprint goal description that needs more characters.

Fixed in release 2.0.7.


text:
Suggestion: TQDM Progress-bars w/ Detailed Search Log

Implementation of TQDM to use a progress bar whilst searching sources, maybe an additional print for each site it is searching to know which part of the repository the program is at in terms of scans for the matching Udemy course.

That's a good idea, I'll try implementing that in the near future.

Pushed a commit with a progressbar to the dev branch

Pushed to master

authors: RHQ-Rusty keethesh

repo: keethesh/UdemyCourseGrabber


text:
Add Multi Camera Support v2

Task
https://github.com/kefniark/UnityBarcodeScanner/projects/1#card-233636
Description

Add a IWebcam to manage multiple camera at the same time (front/back/ ...)
Add a sample to test this feature

To Inspect

Call of Scan() multiple times with different camera seems to crash unity on android. Need to investigate why and how it can be avoided (it really looks like a unity issue ^^)

09-25 17:16:49.372   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 109 0, native 1, mapped 1 1
09-25 17:16:49.413   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 110 0, native 1, mapped 1 1
09-25 17:16:49.455   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 111 0, native 1, mapped 1 1
09-25 17:16:49.497   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 112 0, native 1, mapped 1 1
09-25 17:16:49.539   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 113 0, native 1, mapped 1 1
09-25 17:16:49.581   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 114 0, native 1, mapped 1 1
09-25 17:16:49.622   219 27171 E mm-camera: module_faceproc_port_event_func:886] MCT_EVENT_MODULE_BUF_DIVERT 131074, Cannot start FD, active 20003, frameid 115 0, native 1, mapped 1 1
09-25 17:16:49.648   800  1534 W MediaFocusControl:   AudioFocus   audio focus client died
09-25 17:16:49.648   800   892 W InputDispatcher: channel '26d5fbe com.ganbaranai.BarcodeScanner/com.unity3d.player.UnityPlayerActivity (server)' ~ Consumer closed input channel or an error occurred.  events=0x9
09-25 17:16:49.648   800   892 E InputDispatcher: channel '26d5fbe com.ganbaranai.BarcodeScanner/com.unity3d.player.UnityPlayerActivity (server)' ~ Channel is unrecoverably broken and will be disposed!
09-25 17:16:49.649   800  1531 I WindowState: WIN DEATH: Window{26d5fbe u0 com.ganbaranai.BarcodeScanner/com.unity3d.player.UnityPlayerActivity}
09-25 17:16:49.649   800  1531 W InputDispatcher: Attempted to unregister already unregistered input channel '26d5fbe com.ganbaranai.BarcodeScanner/com.unity3d.player.UnityPlayerActivity (server)'
09-25 17:16:49.650   800  1531 W WindowManager: Force-removing child win Window{767fca6 u0 SurfaceView} from container Window{26d5fbe u0 com.ganbaranai.BarcodeScanner/com.unity3d.player.UnityPlayerActivity}
09-25 17:16:49.650   800  1534 I MediaFocusControl: AudioFocus  removeFocusStackEntry(): removing entry for android.os.BinderProxy@4a556e7
09-25 17:16:49.652   203 21665 E Camera2Client: notifyError: Error condition 0 reported by HAL, requestId -1
09-25 17:16:49.652   203 27195 E Surface : queueBuffer: error queuing buffer to SurfaceTexture, -32
09-25 17:16:49.653   203 27195 E Camera3-OutputStream: returnBufferCheckedLocked: Stream 0: Error queueing buffer to native window: Broken pipe (-32)
09-25 17:16:49.653   203 27195 E Camera3-Device: Can't return buffer to its stream: Broken pipe (-32)
09-25 17:16:49.653   203 27197 D QCamera3Stream: static void* qcamera::QCamera3Stream::dataProcRoutine(void*): Exit

Too old and not updated.
Can be redone in another PR

repo: kefniark/UnityBarcodeScanner

license: WTFPL


text:
Update planner.py

improved accel

I will use the other PR you submitted and merge that into main branches

repo: kegman/openpilot


text:
smoke test fails

When I run the curl command against any of my workers, it fails. How do I go about troubleshooting? I'm able to kubectl exec into the nginx containers so I know nginx is running.
$ curl http://23.236.52.15:31972
curl: (7) Failed to connect to 23.236.52.15 port 31972: Connection refused
$ gcloud compute instances list
NAME         ZONE           MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP      STATUS
controller0  us-central1-c  n1-standard-1               10.240.0.20  104.197.2.56     RUNNING
controller1  us-central1-c  n1-standard-1               10.240.0.21  104.197.12.79    RUNNING
controller2  us-central1-c  n1-standard-1               10.240.0.22  104.197.232.99   RUNNING
etcd0        us-central1-c  n1-standard-1               10.240.0.10  104.197.137.217  RUNNING
etcd1        us-central1-c  n1-standard-1               10.240.0.11  104.154.102.172  RUNNING
etcd2        us-central1-c  n1-standard-1               10.240.0.12  104.197.183.71   RUNNING
worker0      us-central1-c  n1-standard-1               10.240.0.30  130.211.169.241  RUNNING
worker1      us-central1-c  n1-standard-1               10.240.0.31  23.236.52.15     RUNNING
worker2      us-central1-c  n1-standard-1               10.240.0.32  130.211.181.18   RUNNING
$ gcloud compute firewall-rules list
NAME                         NETWORK     SRC_RANGES      RULES                         SRC_TAGS  TARGET_TAGS
default-allow-icmp           default     0.0.0.0/0       icmp
default-allow-internal       default     10.128.0.0/9    tcp:0-65535,udp:0-65535,icmp
default-allow-rdp            default     0.0.0.0/0       tcp:3389
default-allow-ssh            default     0.0.0.0/0       tcp:22
kubernetes-allow-api-server  kubernetes  0.0.0.0/0       tcp:6443
kubernetes-allow-healthz     kubernetes  130.211.0.0/22  tcp:8080
kubernetes-allow-icmp        kubernetes  0.0.0.0/0       icmp
kubernetes-allow-internal    kubernetes  10.240.0.0/24   tcp:0-65535,udp:0-65535,icmp
kubernetes-allow-rdp         kubernetes  0.0.0.0/0       tcp:3389
kubernetes-allow-ssh         kubernetes  0.0.0.0/0       tcp:22
kubernetes-nginx-service     kubernetes  0.0.0.0/0       tcp:31972

Nevermind... I had changed the token but missed updating /var/lib/kubelet/kubeconfig. After I fixed that, I restarted kubelet but didn't restart kube-proxy. Once I restarted that, the curl command worked.
I discovered the issue by checking the status of kube-proxy on one of the workers:
warrenv@worker1:~$ sudo systemctl status kube-proxy --no-pager
● kube-proxy.service - Kubernetes Kube Proxy
Loaded: loaded (/etc/systemd/system/kube-proxy.service; enabled; vendor preset: enabled)
Active: active (running) since Sun 2016-07-10 00:48:51 UTC; 1h 23min ago
Docs: https://github.com/GoogleCloudPlatform/kubernetes
Main PID: 4603 (kube-proxy)
Tasks: 6
Memory: 6.0M
CPU: 5.747s
CGroup: /system.slice/kube-proxy.service
└─4603 /usr/bin/kube-proxy --master=https://10.240.0.20:6443 --kubeconfig=/var/lib/kubelet/kubeconfig --proxy-mode=iptables --v=2
Jul 10 02:11:59 worker1 kube-proxy[4603]: E0710 02:11:59.242005    4603 reflector.go:205] pkg/proxy/config/api.go:33: Failed to list *api.Endpoints: the server has aske... endpoints)
Jul 10 02:11:59 worker1 kube-proxy[4603]: E0710 02:11:59.242703    4603 reflector.go:205] pkg/proxy/config/api.go:30: Failed to list *api.Service: the server has asked ...t services)
Jul 10 02:12:00 worker1 kube-proxy[4603]: E0710 02:12:00.244339    4603 reflector.go:205] pkg/proxy/config/api.go:33: Failed to list *api.Endpoints: the server has aske... endpoints)
Jul 10 02:12:00 worker1 kube-proxy[4603]: E0710 02:12:00.245384    4603 reflector.go:205] pkg/proxy/config/api.go:30: Failed to list *api.Service: the server has asked ...t services)
J

repo: kelseyhightower/kubernetes-the-hard-way


text:
modified exists function to work with dirs

this would fix kelseyhightower/confd#273 for all confd backends.

this may need some fixes so that it don't return true if the path is not complete.

@HeavyHorst Thanks for hacking on this!
etcd is the only backend that I know of that supports directories and I think that's going away in the v3 API. So I'm going to close the upstream issue, which means we won't need this PR. The current way exists works should be fine for all other backends, and should cover the 80% use case until etcd v3 rolls out.

authors: HeavyHorst kelseyhightower

repo: kelseyhightower/memkv


text:
Dynamics 365 Login/Metadata Issue

I'm having an issue with the login process with Dynamics 365.  When I try to login to Dynamcis 365, it looks like it recognizes my login, but it automatically returns me back to the login page without prompting me for the Azure AD login (which I was expecting) or downloading any metadata.  I'm able to connect no problem with Dynamics CRM 2016 Online in two different tenants, so it seems to be specific to Dynamics 365 and/or the 8.2 version of the Web API.  Any suggestions?

please try the latest version (1.3) and let me know if it works

Can you please let me know, where I can download the 1.3 version? Has this to be build from source?

You can download from inside LINQPad or from release tab of this GitHub repo.
Easiest way is to download from LINQPad.
Open LINQPad and click "add connection"
Click "View more drivers"
You find CRM Driver from there.

Awesome!  Thank you!  Worked like a charm!

cool :)

That was the first thing I tried. But is it actually thee most recent release? It says it was updated in April.
https://github.com/kenakamu/CRMLinqPadDriverWebAPI/releases/tag/Latest
http://www.linqpad.net/richclient/datacontextdrivers.aspx

That was the way I downloaded it (from Linqpad just about an hour ago).  It updated the driver automatically with version 1.3.0.0.

The reason is that I need to keep the module link static so that LINQPad can pointing to same address.

Tried it on my personal laptop, even though it doesn't work on my work laptop (possibly some firewall rules). Thank for the the new release.

It should only use https port though

authors: dipinb kenakamu rajyraman

repo: kenakamu/CRMLinqPadDriverWebAPI


text:
changed wording around possibly double counting page load and added the ...

..._gaq.push(['_trackPageview']); line

Awesome, thanks!

authors: dericcrago kendagriff


text:
Is there a way to connect to multiple slaves?

I couldn't find it in the guide, is it possible to do with Slavery?

At this moment, Slavery does not support multiple slaves. It's certainly doable with an API like:
User.on_slave(:replica2).all

Pull requests are welcome! 😎
Also keep in mind that 3-level DB config is coming.

It's supported in v3.0

authors: kenn larryzhao

repo: kenn/slavery


text:
urlib3.HTTPResponse.stream would confuse gzip content originally not encoded utf8

Hi, i was using requests for get gziped web page which originally encoded in gbk.
as requests would try their best decoding gziped pages but as originally not by utf-8 would make the result weried and hard to debug :(

@yupbank Sorry, I didn't fully understand this message. Can you post some code that demonstrates the problem?

basically
i figured the correct way:
zlib.decompress(requests.get('http://zhongyanghuachengzs.fang.com/', stream=True).raw.read(), zlib.MAX_WBITS|32).decode('gbk'))
as the page is encoded in gbk and  gziped.
also due to the fact that requests would auto decompress gzip, this would give weird results.
requests.get('http://zhongyanghuachengzs.fang.com/')

I don't believe this is a urllib3 bug: nothing unexpected is happening here.
As you've correctly spotted, requests is transparently decompressing the gzip. This is working perfectly, nothing unexpected is happening. However, I suspect you're then using response.text, which is trying to decode the response body. Because there's no header explaining what encoding was used, requests falls back on the spec which claims that text/html should be served in ISO-8859-1. This is wrong for this page, and so it breaks the rendering.
All you need to do is:
requests.get('http://zhongyanghuachengzs.fang.com/').content.decode('gbk')

That'll work perfectly. =)

thanks a lot, i should follow the document carefully :)

authors: Lukasa yupbank

repo: kennethreitz/requests


text:
fix(): remove openpyxl warning by properly accessing cells

see there https://bitbucket.org/openpyxl/openpyxl/src/0f8537998f95c9d8d44913c2edb367516b799d4a/openpyxl/worksheet/worksheet.py?at=default&fileviewer=file-view-default#worksheet.py-303
Raising warning in production :(

Approved, this removes an Openpyxl warning. Test failures are unrelated.

This PR will resolve https://github.com/kennethreitz/tablib/issues/298

Is there any work I can help with to progress this to merging?
If I understand the CI failure correctly, the issue there is that the openpyxl dependency no longer supports python 2.6, while Travis still runs the tests against 2.6 too. However, tablib's setup.py doesn't promise 2.6 support?

Openpyxl no longer supports Python 2.6

we support 2.7 to 3.5

This would help explain the failing test in the Travis job Exception: Python >= 2.7 is required.

@kennethreitz it would be great if you could push out a new release containing this fix, as this is preventing people from using the latest openpyxl release.
I tried to use your cash.me link to support your open source work, but unfortunately it doesn't seem to support my Mastercard (or my European debit card). If you have a Patreon or PayPal, I'll gladly use that instead. As a fellow open source maintainer, I know all about the stress that maintainership can entail. 👍

authors: andrewgy8 claudep djc gbataille rooterkyberian yungchin

repo: kennethreitz/tablib


text:
Could not resolve node:fs

mdx-bundler version: 8.0.0
node version: 16.6.1
npm version: 8.1.4

Relevant code or config
import { bundleMDX } from "mdx-bundler";

What you did:
I try to do the remix blog tutorial, but instead of .md, I try to do it with .mdx files with mdx-bundler.
As soon as I import it - it is not called just imported - and run remix dev, it blows up with the message below.
What happened:
  > node_modules/mdx-bundler/node_modules/xdm/lib/integration/esbuild.js:16:29: error: Could not resolve "node:fs" (mark it as external to exclude it from the bundle)
    16 │ import {promises as fs} from 'node:fs'
       ╵                              ~~~~~~~~~

  > node_modules/mdx-bundler/node_modules/xdm/lib/integration/esbuild.js:17:20: error: Could not resolve "node:process" (mark it as external to exclude it from the bundle)
    17 │ import process from 'node:process'
       ╵                     ~~~~~~~~~~~~~~

Package.json
{
  "private": true,
  "name": "remix-app-template",
  "description": "",
  "license": "",
  "scripts": {
    "build": "remix build",
    "dev": "remix dev",
    "postinstall": "remix setup node",
    "start": "remix-serve build"
  },
  "dependencies": {
    "@remix-run/react": "^1.0.6",
    "@remix-run/serve": "^1.0.6",
    "add": "^2.0.6",
    "esbuild": "^0.14.0",
    "front-matter": "^4.0.2",
    "mdx-bundler": "^8.0.0",
    "react": "^17.0.2",
    "react-dom": "^17.0.2",
    "remix": "^1.0.6",
    "tiny-invariant": "^1.2.0"
  },
  "devDependencies": {
    "@remix-run/dev": "^1.0.6",
    "@types/react": "^17.0.24",
    "@types/react-dom": "^17.0.9",
    "typescript": "^4.1.2"
  },
  "engines": {
    "node": ">=14"
  },
  "sideEffects": false
}

I ran into this exact problem yesterday (with the one exception that I do have to call the function, not just import it) while working through the Remix tutorial and trying to implement mdx-bundler (since it's one of the suggestions elsewhere in their docs). I ended up banging my head against it for several hours without any meaningful progress.
I tried a few versions each of node and esbuild to make sure it wasn't a compatibility issue. I also spent a good chunk of time poring over the source of Kent's own site to understand his own environment and implementation (including migrating my Remix example over to express for parity's sake), but I wasn't ever able to replicate a successful build.
For completeness, here's where my package.json ended up by the time I gave up, in case it points out an obvious issue:
{
  "private": true,
  "name": "remix-app-template",
  "description": "",
  "license": "",
  "scripts": {
    "build": "remix build",
    "dev": "remix watch",
    "postinstall": "remix setup node",
    "start": "cross-env NODE_ENV=production node server/index.js",
    "start:dev": "cross-env NODE_ENV=development node server/index.js"
  },
  "dependencies": {
    "@remix-run/express": "^1.0.6",
    "@remix-run/react": "^1.0.6",
    "compression": "^1.7.4",
    "cross-env": "^7.0.3",
    "express": "^4.17.1",
    "front-matter": "^4.0.2",
    "morgan": "^1.10.0",
    "react": "^17.0.2",
    "react-dom": "^17.0.2",
    "remix": "^1.0.6",
    "tiny-invariant": "^1.2.0"
  },
  "devDependencies": {
    "@remix-run/dev": "^1.0.6",
    "@types/react": "^17.0.24",
    "@types/react-dom": "^17.0.9",
    "typescript": "^4.1.2"
  },
  "engines": {
    "node": ">=14"
  },
  "sideEffects": false
}

Just had the issue today and found the "trick" in Kent's codebase.
Make sure to only import mdx-bundler within a file with the suffix .server.ts(x) like mdx.server.ts you can even just export { bundleMDX } from 'mdx-bundler' then in your route import from this file instead, or use it to wrap bundleMDX and predefine settings etc like Kent is doing
More at data-loading#basics

Thanks for that @CanRau! That got me where I needed to go and it seems to be working just fine now.
I had a feeling from the fact that the modules in the error were from node that it had to do with the division between server and client, but I hadn't absorbed the way the .server.{js,ts,tsx} suffix was used in Remix.

@CanRau it gives me then another error:
mdx-bundler warning: esbuild maybe unable to find its binary, if your build fails you'll need to set ESBUILD_BINARY_PATH. Learn more: https://github.com/kentcdodds/mdx-bundler/blob/main/README.md#nextjs-esbuild-enoent
There was an error running the data loader for route routes/$article
Error: No "exports" main defined in /Users/mateusz.kwiatkowski/Playground/remix-mantine/node_modules/periscopic/package.json
    at new NodeError (node:internal/errors:371:5)
    at throwExportsNotFound (node:internal/modules/esm/resolve:453:9)
    at packageExportsResolve (node:internal/modules/esm/resolve:671:7)
    at resolveExports (node:internal/modules/cjs/loader:482:36)
    at Function.Module._findPath (node:internal/modules/cjs/loader:522:31)
    at Function.Module._resolveFilename (node:internal/modules/cjs/loader:919:27)
    at Function.Module._load (node:internal/modules/cjs/loader:778:27)
    at Module.require (node:internal/modules/cjs/loader:1005:19)
    at require (node:internal/modules/cjs/helpers:102:18)
    at node_modules/@mdx-js/mdx/lib/plugin/recma-document.js (/Users/mateusz.kwiatkowski/Playground/remix-mantine/node_modules/@mdx-js/mdx/lib/plugin/recma-document.js:42:23)
GET /dolor-lorem-ipsum-1 500 - - 161.983 ms

authors: CanRau kwiat1990 nbrombal szmarci

repo: kentcdodds/mdx-bundler


text:
Update package.json

So this components shows up on http://react.parts/web

Of course, you may not want that but I had to track this down through a GitHub search and your original slider.

repo: kenwheeler/nuka-carousel


text:
Event while dragging

Is there an event that is called during dragging?
on('swipe') seems to be called only when the dragging is released. I'm trying to do a few things while dragging already: Changing the background-color of the page while dragging and dragging another slider along simultaneously with asNavFor (as opposed to only when I let go of the first slider).
Is there an event for this or any other way to do this?

Closing due to not following CONTRIBUTING.md

authors: kenwheeler nilssolanki

repo: kenwheeler/slick


text:
Disable Color for Compare and Compare Headers

This PR adds feature that disables color for the "Compare" and "Compare Headers" functions in the application.
Issue Fixed:#4
@shivamsouravjha, could you please review this PR?

Hi @ayush3160 @shivamsouravjha , I hope you're doing well! Could you kindly let me know if there’s anything I can improve  to help get it merged?

repo: keploy/jsondiff


text:
Add redirect to the GSoC website

Redirects keptn.sh/gsoc to https://github.com/keptn/community/blob/main/mentorship/gsoc where all the content resides at the moment
Signed-off-by: Oleg Nenashev o.v.nenashev@gmail.com

@oleg-nenashev your changes look good to me, but what is actually the reasoning why you would like to have this redirect? From where is the user coming?

@oleg-nenashev your changes look good to me, but what is actually the reasoning why you would like to have this redirect? From where is the user coming?

It is for a link on GSoC public materials and in the org profile. The redirect should be helpful if we decide to move the content over to the website

The redirect doesn't seem to work in the preview...

Indeed...

authors: johannes-b oleg-nenashev


text:
Error scraping target: proto: wrong wireType = 0 for field Metric

Hello, when updating my testing environment to Prometheus 3.0 I came across this problem:
Error scraping target: proto: wrong wireType = 0 for field Metric
Is it possible to adjust this in the exporter?

To correct the problem, it is necessary to update to version 3.0.1 of Prometheus and set the following field in the job.
fallback_scrape_protocol: PrometheusText0.0.4

repo: kerams/docker-exporter


text:
Image classification with EANet (External Attention Transformer) - Converted to Keras Core by @freedomtan

fixed imports
removed tfa dependency
converted tf ops in external_attention() to ops in keras_cores.ops

cf. a3fc061

Duplicate of #529

close this since there is  https://github.com/keras-team/keras-core/pull/529

authors: anas-rz freedomtan

repo: keras-team/keras-core


text:
Add Masked language modeling with Bert example

Uses pretrained bert-base-uncased from HuggingFace transformers and their tokenizers.
Train Masked Language Bert Model on the IMDB dataset.

@fchollet  Thanks for your review.
I have updated it, according to your guidance. One doubt I have, with SparseCategoricalCrossentropy sample_weight argument. I have used -1(target tensor) to identify and ignore unmasked token while calculating loss. So, if I use SparseCategoricalCrossentropy with sample_weight then the loss function output would be nan.
Should I use a non-negative number to represent unmasked token and then use SparseCategoricalCrossentropy sample_weight?

Hi @fchollet
I have tried to implement SparseCategoricalCrossentropy with sample_weight parameter and I am able to run on CPU and GPU Successfully but it's not running on TPU, below is the error
Invalid argument: {{function_node __inference_train_function_196061}} Compilation failure: Detected unsupported operations when trying to compile graph broadcast_weights_assert_broadcastable_is_valid_shape_has_valid_nonscalar_shape_true_195924_const_0[] on XLA_TPU_JIT: DenseToDenseSetOperation (No registered 'DenseToDenseSetOperation' OpKernel for XLA_TPU_JIT devices compatible with node {{node broadcast_weights/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}){{node broadcast_weights/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape/has_invalid_dims/DenseToDenseSetOperation}}
    [[broadcast_weights/assert_broadcastable/is_valid_shape/has_valid_nonscalar_shape]]
    [[broadcast_weights/assert_broadcastable/is_valid_shape]]
   TPU compilation failed
    [[tpu_compile_succeeded_assert/_18335038187613310273/_6]]
    [[tpu_compile_succeeded_assert/_18335038187613310273/_6/_265]]

TPU Failed Version Colab: https://colab.research.google.com/drive/19U0VJkd9nOIn2vwZ0dcNflmNoV-CZ5Zz?usp=sharing
Please see the code

Hi @fchollet
Thanks for your guidance, I have implemented BERT from scratch using tf-nightly. I used TextVectorization and MultiHeadAttention layer. And also implemented the end-to-end export method.
Thanks

Thanks a lot, I will review shortly.
Here's an update about the TPU failure: it is due to the fact that the TPU client is using tf-nightly while the TPU worker is using TF 2.3. In the general case, it is not safe to use TPU in Colab with tf-nightly, you should always use them with the latest stable TF version instead.

Hi @fchollet
According to your feedback, I have updated the file.

Used  tf.data.Dataset
Refactored variable names
Refactored package import format

I have one doubt, What is the good way to add '[MASK]' token (or list of the special token)into the vectorizer layer.

Hi @fchollet
Please review my latest update.

Please reapply black formatting, and trying running the code again. You may want to adjust the number of epochs used for the fine-tuning part, as well as the learning rate of the optimizer.
What classification accuracy do you get?

I have done the following update:

Added custom_standardization for vectorizer
Implemented little Generic BERT Model using Keras Subclass API
Implemented Custom Callback to check mask model using sample input

The following accuracy I got:

Masked Language Model

Input: "i have watched this [mask] and it was awesome"
top_k= 5  #top 5 prediction
Epoch 1/5
1563/1563 [==============================] - ETA: 0s - loss: 7.2558
{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'this',
 'prediction': 'i have watched this this and it was awesome',
 'probability': 0.04289173}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'movie',
 'prediction': 'i have watched this movie and it was awesome',
 'probability': 0.04171709}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'i',
 'prediction': 'i have watched this i and it was awesome',
 'probability': 0.034618173}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'a',
 'prediction': 'i have watched this a and it was awesome',
 'probability': 0.03268459}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'to',
 'prediction': 'i have watched this to and it was awesome',
 'probability': 0.031339437}
1563/1563 [==============================] - 152s 97ms/step - loss: 7.2556
Epoch 2/5
1563/1563 [==============================] - ETA: 0s - loss: 6.5399
{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'movie',
 'prediction': 'i have watched this movie and it was awesome',
 'probability': 0.36367047}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'film',
 'prediction': 'i have watched this film and it was awesome',
 'probability': 0.101376995}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'is',
 'prediction': 'i have watched this is and it was awesome',
 'probability': 0.054904718}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'one',
 'prediction': 'i have watched this one and it was awesome',
 'probability': 0.047664806}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'was',
 'prediction': 'i have watched this was and it was awesome',
 'probability': 0.03694917}
1563/1563 [==============================] - 151s 96ms/step - loss: 6.5398
Epoch 3/5
1563/1563 [==============================] - ETA: 0s - loss: 5.8020
{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'movie',
 'prediction': 'i have watched this movie and it was awesome',
 'probability': 0.27628118}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'film',
 'prediction': 'i have watched this film and it was awesome',
 'probability': 0.1621771}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'time',
 'prediction': 'i have watched this time and it was awesome',
 'probability': 0.023138938}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'one',
 'prediction': 'i have watched this one and it was awesome',
 'probability': 0.018522203}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'review',
 'prediction': 'i have watched this review and it was awesome',
 'probability': 0.015409218}
1563/1563 [==============================] - 151s 97ms/step - loss: 5.8019
Epoch 4/5
1563/1563 [==============================] - ETA: 0s - loss: 5.1151
{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'movie',
 'prediction': 'i have watched this movie and it was awesome',
 'probability': 0.41562507}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'film',
 'prediction': 'i have watched this film and it was awesome',
 'probability': 0.19526063}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'one',
 'prediction': 'i have watched this one and it was awesome',
 'probability': 0.035126403}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'night',
 'prediction': 'i have watched this night and it was awesome',
 'probability': 0.025516002}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'time',
 'prediction': 'i have watched this time and it was awesome',
 'probability': 0.024052398}
1563/1563 [==============================] - 151s 97ms/step - loss: 5.1150
Epoch 5/5
1563/1563 [==============================] - ETA: 0s - loss: 4.7227
{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'movie',
 'prediction': 'i have watched this movie and it was awesome',
 'probability': 0.46062306}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'film',
 'prediction': 'i have watched this film and it was awesome',
 'probability': 0.12770538}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'one',
 'prediction': 'i have watched this one and it was awesome',
 'probability': 0.051738814}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'miniseries',
 'prediction': 'i have watched this miniseries and it was awesome',
 'probability': 0.025324458}

{'input_text': 'i have watched this [mask] and it was awesome',
 'predicted mask token': 'show',
 'prediction': 'i have watched this show and it was awesome',
 'probability': 0.015968936}
1563/1563 [==============================] - 152s 97ms/step - loss: 4.7226

Our mask model looks good to me.

Classification Model: I am getting classification accuracy b/w 84-86%

Hi @fchollet
Sorry for the delayed response,  This is the first time, I am implementing from scratch in Keras (preprocessing->model building->callback->custom training-> end_to_end). I have learned a lot and still learning and trying to improve my code.
Please review and suggest me if there is anything I missed.

Hi @fchollet
I have updated it according to your guidance.

Refactored Code i.e used Functional API
Refactored Callback with NumPy function
Used softmax inside the model
Refactored variable names

I have tried to use the loss tracker in the custom Model Class constructor but I was facing an issue in saving (.save('model.h5)) because the model added the Mean Layer. So for simplicity I keet it outside. Please guide me if anything I need to refactor.

I was facing an issue in saving (.save('model.h5)) because the model added the Mean Layer.

What was the issue?

I made a dummy notebook. https://colab.research.google.com/drive/1GH-WxghmkhgLSO2vVcSKgQ4UI3WX6GKC?usp=sharing
Sorry problem is not with not saving (i misspelled). It's in the loading of the model.
model.save('model.h5')

new_model = keras.models.load_model('model.h5', custom_objects={'CustomModel': CustomModel})

usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/utils/generic_utils.py in class_and_config_for_serialized_keras_object(config, module_objects, custom_objects, printable_module_name)
294   cls = get_registered_object(class_name, custom_objects, module_objects)
295   if cls is None:
--> 296     raise ValueError('Unknown ' + printable_module_name + ': ' + class_name)
297
298   cls_config = config['config']
ValueError: Unknown layer: Mean

new_model = keras.models.load_model('model.h5', custom_objects={'CustomModel': CustomModel, 'Mean':keras.metrics.Mean})

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/saving/hdf5_format.py in load_weights_from_hdf5_group(f, layers)
684                      'containing ' + str(len(layer_names)) +
685                      ' layers into a model with ' + str(len(filtered_layers)) +
--> 686                      ' layers.')
687
688   # We batch weight value assignments in a single backend call
ValueError: You are trying to load a weight file containing 2 layers into a model with 3 layers.

Thanks for the report. That's a bug, which we will fix.

Hi @fchollet
Thank you very much for your guidance. I have added generated files. I am very happy that I have contributed to Keras. I am using Keras for the past 3years and it is a very awesome package and you are a great mentor(saying from bottom of my heart) :)
Regards,
Ankur

repo: keras-team/keras-io


text:
How to  convert list of 2D tensors to a 3D tensor?

Hi. I am trying to make a  few changes to the Recurrent class so that if the input_length is provided, the RNN will be unrolled. Pseudo code:
X = input
X = K.permute_dimensions(X, (1, 0, 2))
input_length  = self.input_shape[1]
outputs = []
states = bla bla bla
for i in range(input_length):
    x = X[i]
    y, states = self.step(x, states)
    outputs.append(y)
if self.return_sequences:
     #TODO
else:
     return outputs[-1]

If  return_sequences = True, how  do  I  convert the outputs, which is a list of 2D tensors, to a  3D tensor? Should be using the Kears  backend functions.. no theano code.  Thanks.
cc: @fchollet

You can use T.concatenate(tensors, axis=1), followed by a T.reshape...

Ohh..Why didnt' I think of that..

It was actually T.stack() and tf.pck() btw.

I am doing same thing but not able to get it.
Please tell me the code.
Instead of:
outputs = []
states = bla bla bla
for i in range(input_length):
x = X[i]
y, states = self.step(x, states)
outputs.append(y)
what should be done to create 3d tensor

how to use T.stack()

If your list does not have too many elements, you can first use RepeatVector layer to expand every 2D tensor into 3D tensor, and then use Concatenate layer to merge them into one.
t1 = RepeatVector(1)(t1)
t2 = RepeatVector(1)(t2)
T = Concatenate()([t1,t2])

repo: keras-team/keras


text:
Clearer errors for add_metric

It's really weird to drop add_metric when you still have add_loss, but alright
If you are not planning to improve compatibility with 'niche functionality' of the past, then please produce clearer errors that it does not work. Right now when you try passing any parameters to add_metric, it fails with a type error:

TypeError: Exception encountered when calling MyMetric.call().

Layer.add_metric() takes 1 positional argument but 2 were given

Arguments received by MyMetric.call():
  • y_true=tf.Tensor(shape=(2, 6), dtype=int32)
  • y_pred=tf.Tensor(shape=(2, 8), dtype=int32)
  • args=<class 'inspect._empty'>
  • kwargs=<class 'inspect._empty'>

From this error it's not exactly clear that the method:

takes no arguments
is deprecated / not implemented

To actually understand that the method is not even supposed to work you have to either inspect the source code, or rummage through the github, none of which is super obvious.
Suggestions:

remove the method altogether (if it's not supported, why have it in the first place?)
make it accept anything (*args, **kwargs), and then throw a NotImplementedError, possibly add suggestions on how to use the updated API instead

A Colab notebook for reference: https://colab.research.google.com/drive/1FO-GstSFwU0V0cTeCCjtCuL2NUmFB2tq

This is a legacy problem of keras 2, keras 3 does not have this problem.

Hi @DLumi, thank you for filing this issue. I agree this could be more readable. The method is being kept for backwards compatibility but a better error is an improvement here.

authors: DLumi Grvzard grasskin


text:
feat(backend): add name param for concatenate

Summary
add name parameter
Related Issues
PR Overview

[ ] This PR requires new unit tests [y/n] (make sure tests are included)
[ ] This PR requires to update the documentation [y/n] (make sure the docs are up-to-date)
[x] This PR is backwards compatible [y/n]
[x] This PR changes the current API [y/n] (all API changes need to be approved by fchollet)

Thanks for the PR. I believe that we have named scopes to do just that. Can you check?

Thanks for the PR!
In general, our backend ops don't have a name argument, because they are made of multiple underlying TF ops. To be consistent, we don't use name even if there is only a single TF op.
We have name as an arg for things that clearly need a name: variable, placeholders, constant tensors.
The exception to that rule is identity and the map_fn set of functions. I believe that was a oversight on our part, not having names there would have been more consistent (no need to change it now though).

authors: fchollet fsx950223 gabrieldemarmiesse


text:
From "wiki": "Every bot uses the same GUID for authentication..."

wiki -> native Go Plugins ...
"

Example plugin .go file:

package main
import "fmt"
var Utterances = []string{"test plugin"}
var Name = "Test Plugin"
func Action(transcribedText string, botSerial string) string {
fmt.Println("(in testPlugin) Transcribed text: " + transcribedText ", serial number: " + botSerial)
return "intent_imperative_praise"
}
The plugin should be built with sudo /usr/local/go/bin/go build -buildmode=plugin plugin.go (has to be built with the same version of Go wire-pod is using and same user)
The resulting .so should be placed in ~/wire-pod/chipper/plugins/. wire-pod will load it upon startup.
.> ... blablabla..
Every bot uses the same GUID for authentication:
tni1TRsTRTaNSapjo0Y+Sw==

"
WTF? Why ???

Node-red also performs this function much more easily with a serial number...

What is it that all vectors use the same GUID authentication? Is this meant to be a joke?

Weather commands are easy to setup via weatherapi.com or > openweathermap.org
Knowledge-graph ("I have a question") commands are easy to setup via houndify

Node-Red without chipper same..

If you want to make wire-pod run in the background (as a daemon), run the following commands (press CTRL+C to stop wire-pod if you are running it):
sudo ./setup.sh daemon-enable
sudo systemctl start wire-pod

./setup.sh daemon-enable <-- ??? Really?  this is not  a typo?

I couldn't figure out the relation between the client token and token hashes. If/when I figure that out, I will probably implement unique GUIDs for every authenticated bot. Otherwise, it shouldn't affect functionality and that is all that matters to me right now.
This is not a node-red alternative.
May you point out the typo to me? A more descriptive/accurate command would be ./setup.sh daemon-install but it isn't very different


text:
I cant login and register

Can you give me database structere, can you export firebase database?

The Database structure is provider and very visible to-date @ketanchoyal  has updated the repo structure...to help you with the logic of login  just deal with the login flow as shown in the dbstructure folder (it contains picture of almost every steps)    and you will be able to login
Duplicate of #9

@nonameclub  close this issue

authors: cradlesnatcher kzawadi nonameclub

repo: ketanchoyal/Academic-Connect


text:
Finish Create Endpoint

Include created, modified, and deleted timestamps to read model as well as history array.

Fixed in mentioned PR.

repo: kevin-benton/issue-tracker


text:
Fix yarl version requirements

Closes #485
So weird that yarl installed an alpha release on CI but not on local testing in tox. Can't get it to install 1.4 even if I want it to.
Anyway... added version check to address the upcoming version support issue where yarl 1.4 only support >3.6

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@0d623ae). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master     #489   +/-   ##
=========================================
  Coverage          ?   89.39%
=========================================
  Files             ?       24
  Lines             ?     1546
  Branches          ?      215
=========================================
  Hits              ?     1382
  Misses            ?      135
  Partials          ?       29

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0d623ae...dbd6f2c. Read the comment docs.

authors: codecov-io neozenith