text:
Sui Code Bug: std::debug

Steps to Reproduce Issue

Installed 0.8.0 binaries on mac m1 max... OK
Build existing package/module (sui move build) that never failed before... OK
Attempt to test using separate module using test scenario (sui move test) that has debug:

module suitrack::basetest {
    use sui::test_scenario::{Self};
    use std::debug::{Self as Debug};

// Elsewhere

       test_scenario::next_tx(scenario,&USER_ADDRESS);
        {
            let accum = test_scenario::take_owned<Tracker>(scenario);
            Debug::print(&accum);
            test_scenario::return_owned(scenario, accum)
        }

This now fails with:
fastfrank@~/frankc01/sui-track $ sui move test
INCLUDING DEPENDENCY MoveStdlib
INCLUDING DEPENDENCY Sui
BUILDING SuiTrack
Running Move unit tests
2022-09-03T09:53:05.008565Z ERROR move_vm_runtime::logging: [VM] Unexpected verifier/deserialization error! This likely means there is code stored on chain that is unverifiable!
Error: VMError { major_status: MISSING_DEPENDENCY, sub_status: None, message: None, exec_state: None, location: Module(ModuleId { address: 0000000000000000000000000000000000000001, name: Identifier("debug") }), indices: [(FunctionHandle, 0)], offsets: [] }
[ FAIL    ] 0x0::basetest::test_basic_pass

Test failures:

Failures in 0x0::basetest:

┌── test_basic_pass ──────
│ ITE: An unknown error was reported. Location:
│ VMError (if there is one): VMError {
│     major_status: UNEXPECTED_VERIFIER_ERROR,
│     sub_status: None,
│     message: Some(
│         "Unexpected verifier/deserialization error! This likely means there is code stored on chain that is unverifiable!\nError: VMError { major_status: MISSING_DEPENDENCY, sub_status: None, message: None, exec_state: None, location: Module(ModuleId { address: 0000000000000000000000000000000000000001, name: Identifier(\"debug\") }), indices: [(FunctionHandle, 0)], offsets: [] }",
│     ),
│     exec_state: None,
│     location: Module(
│         ModuleId {
│             address: 0000000000000000000000000000000000000001,
│             name: Identifier(
│                 "debug",
│             ),
│         },
│     ),
│     indices: [
│         (
│             FunctionHandle,
│             0,
│         ),
│     ],
│     offsets: [],
│ }
└──────────────────

Test result: FAILED. Total tests: 1; passed: 0; failed: 1

Expected Result
Expected no failure with use of debug
Actual Result
see above
System Information

OS: Monterey 12.5.1 (M1 Max)
Compiler:sui-move 0.1.0

Still broken in binaries 0.9.0

This should have been fixed in https://github.com/MystenLabs/sui/pull/4356. If it still does not work, please provide the entire codebase that's needed to repro.

What devnet binary version is this planned for?

repo: MystenLabs/sui


text:
Sui staking testnet

unable to add any funds to stake any sui tokens on all validators  please see attached photo the stake part where you input the amount you wish to stake does not allow anything to be put in on all validators

I think you need to update the wallet and give it a try

Update your wallet: Manage extension---->Developer Mode------>Click on Update

Try to stake less amount < 0.1, like 0.05

But it seems like the problem you don't know where to enter amount. White panel above "Staking rewards start"

Hi ya
I sent a photo with the area highlighted showing where it won't input , did
you see that hopefully that will make it clearer its not letting you put
any amount in 👌
If you could give me another way of getting tokens as explained discord is
not secure and  has a number a security issues so If you could advise where
I can more tokens that will be great
Thank you
On Wed, 8 Feb 2023, 09:45 Steve Lewis, @.***> wrote:

No the enter amount will not allow me to input any amount on all
validators
Kind regards
Steve
On Wed, 8 Feb 2023, 03:09 0xWhiteGod, @.***> wrote:

Update your wallet: Manage extension---->Developer Mode------>Click
on Update
2.
Try to stake less amount < 0.1, like 0.05
But it seems like the problem you don't know where to enter amount. White
panel above "Staking rewards start"
—
Reply to this email directly, view it on GitHub
https://github.com/MystenLabs/sui/issues/8140#issuecomment-1421918463,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3ZIVP7IQWEISLLRBDPG5RLWWME7TANCNFSM6AAAAAAUT7PIW4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Thank you 😊
On Tue, 7 Feb 2023, 20:03 Ghazwan Ahmed Ali, @.***>
wrote:

I think you need to update the wallet and give it a try
—
Reply to this email directly, view it on GitHub
https://github.com/MystenLabs/sui/issues/8140#issuecomment-1421368527,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3ZIVPY7AMOWJFYLDIIHF6LWWKS73ANCNFSM6AAAAAAUT7PIW4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Give me your wallet ill send you some

Hi
Great thank you 😊 🙏 I let you know what happens
0x3102603cc0119e8eb0dbc5287a43ae1c54b16475
Kind regards
Steve
On Wed, 8 Feb 2023, 12:24 0xWhiteGod, @.***> wrote:

Give me your wallet ill send you some
—
Reply to this email directly, view it on GitHub
https://github.com/MystenLabs/sui/issues/8140#issuecomment-1422513170,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3ZIVP5A3HJV7JADTA6U5Y3WWOGALANCNFSM6AAAAAAUT7PIW4
.
You are receiving this because you authored the thread.Message ID:
@.***>

0x3102603cc0119e8eb0dbc5287a43ae1c54b16475

Did 2 transactions

Thank you
I'm just out at moment but will be back and try it out thank you again its
really appreciated 🙏
On Wed, 8 Feb 2023, 13:48 0xWhiteGod, @.***> wrote:

0x3102603cc0119e8eb0dbc5287a43ae1c54b16475
Did 2 transactions
—
Reply to this email directly, view it on GitHub
https://github.com/MystenLabs/sui/issues/8140#issuecomment-1422626977,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3ZIVP4QW7ESBTHCZM2C76TWWOP2TANCNFSM6AAAAAAUT7PIW4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Author

No need to do that sir, was glad to help you

Hi
Thank you for sending coins unfortunately the test net staking still not
working I raised a query and took some screen shots I will try again later
, but again many thanks
One question if I'm not on discord is there any other way of getting coins
as I cant test namesake as my balance is still too low
Thank you again for all help 🙏
On Wed, 8 Feb 2023, 14:39 0xWhiteGod, @.***> wrote:

Author
No need to do that sir, was glad to help you
—
Reply to this email directly, view it on GitHub
https://github.com/MystenLabs/sui/issues/8140#issuecomment-1422699077,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A3ZIVP3TM4O2ENIXPPJS6XDWWOV2HANCNFSM6AAAAAAUT7PIW4
.
You are receiving this because you authored the thread.Message ID:
@.***>

Thank you @0xWhiteGod !

staking working now thank you :)

source: gharchive/issue

license_type: permissive

license_source: github-api


text:
fix: update strong type

Description
updates to include: https://github.com/MystenLabs/fastcrypto/pull/751
Test Plan
How did you test the new or updated feature?

If your changes are not user-facing and do not break anything, you can skip the following section. Otherwise, please briefly describe what has changed under the Release Notes section.
Type of Change (Check all that apply)

[ ] protocol change
[ ] user-visible impact
[ ] breaking change for a client SDKs
[ ] breaking change for FNs (FN binary must upgrade)
[ ] breaking change for validators or node operators (must upgrade binaries)
[ ] breaking change for on-chain data layout
[ ] necessitate either a data wipe or data migration

Release notes

looks good except the changes to the openrpc spec

first time looking at this, do you know much how the jsonschema trait works? is it derived from the serialize trait?
the test for an serialized zklogin signature itself suggests that the format didn't change

looks good except the changes to the openrpc spec

first time looking at this, do you know much how the jsonschema trait works? is it derived from the serialize trait?
the test for a fixed serialized zklogin signature itself still passes, i wonder if the format indeed didn't change

I don't know how that works, but afaik its not derived from the serialization trait, but rather done in parallel with it assuming you just used serde_derive to do the ser/de impls. The format won't have changed but this spec is used from documentation and possibly for generating client impls in other languages

looks good except the changes to the openrpc spec

first time looking at this, do you know much how the jsonschema trait works? is it derived from the serialize trait?
the test for a fixed serialized zklogin signature itself still passes, i wonder if the format indeed didn't change

I don't know how that works, but afaik its not derived from the serialization trait, but rather done in parallel with it assuming you just used serde_derive to do the ser/de impls. The format won't have changed but this spec is used from documentation and possibly for generating client impls in other languages

Revised in fastcrypto: https://github.com/MystenLabs/fastcrypto/pull/754 PTAL

source: gharchive/pull-request

authors: bmwill joyqvq


text:
Jetson clocks has to be set to on, for better performance

I noticed when I run my code with jetson clocks turned off (variable CPU frequency), the conversion to the RAW16 format sometimes takes too long. Depending on the CPU clock frequency, it takes 1ms to 5ms, or even longer (compiler set to debug, in release mode it is in between 0.5-2ms). 5ms is too long, and the next segment is read out too late and causes the communication to go out of sync and therefor you lose some frames.
If you set the jetson clocks on, the CPU stays at the max frequency and the conversion takes constantly 1ms (compiler set to debug, in release mode it is 0.5ms) and the loss of sync is less likely.
I think it would be nice if this information is added to the README.

README updated with a note in the Prerequisites. Thank you for pointing out

authors: Myzhar ma-ludw

license: MIT


text:
ExpandPatterns must handle embedded range

Currently we have a host gpu-4-ib.fox, and there's also 5 and 6, so the host name pattern is gpu-[4-6]-ib.fox.  This pattern is not expanded  correctly by go-utils/hostglob/ExpandPatterns.  That breaks naicreport.  The workaround is to expand this manually in the config file for now.
(The pattern is also not compressed correctly.)

Probably do this in concert with #247.

Per #247, ExpandPattern must return an error if it encounters *, because a pattern with a wildcard is a thing but it cannot ever be expanded.  There should be limited clients of ExpandPattern anyway.

repo: NAICNO/Jobanalyzer


text:
[Enhancement Proposal] Make nifi url dynamic

Currently nifi url is hardcoded in evaluation.nifi_automation.NifiAutomation. See:
https://github.com/NASA-IMPACT/data-transfer-evaluation/blob/master/evaluation/nifi/nifi_automation.py#L30
I think we need to pass this url in the constructor instead of hard-coding.

Solved in #9

repo: NASA-IMPACT/data-transfer-evaluation


text:
Update README.md Test Dependabot

🗒 Summary
Add clarifications for test dependabot section.

Was reviewing this, but didn't get to submit my review suggestion:
Can you update this so we rely on nvm use instead to ensure that we're using the appropriate Node.js version? The Node.js version is currently set to lts/gallium in .nvmrc.

authors: anilnatha eddiesarevalo

repo: NASA-PDS/wds-react-legacy


text:
Change extension from .nc to .vdc

In some cases I left the ability to use .nc extensions for usability. For example, in the Open Dataset dialog on OSX where disabling it would force users to rename their files. The sphinx documentation needs to be re-generated to include the changes but that can be done at the next release.
Fix #2248

@StasJ this PR changes the help messages issued such that the extension ".nc" is replaced by ".vdc", but that is all it does. I guess I was expecting the conversion utilities to automatically append a ".vdc", if none was present, when generating a .vdc file. What do @sgpearse and @shaomeng think?

I don't have a rigid stance on this.  In my experience, other command-line file editing tools like NCO let users name generated files whatever they want.
I can't think of a reason why all .vdc files must always have only one extension, but maybe you guys can.  Conversly, enforcing .vdc adds more code to maintain.

@clyne this PR keeps the same behavior that we've had with the .nc extension. The functionality you suggested can be added but was not mentioned previously.

@clyne this PR keeps the same behavior that we've had with the .nc extension. The functionality you suggested can be added but was not mentioned previously.

The issue that you opened, #2248, states "possibly forcing them to use .vdc output files". I guess possibly is the operative word here. I would think that if we don't do something like automatically changing the output file to include the extension we probably won't accomplish much.

@clyne Fair point. I was referring to the fact that I didn't realize that was a requirement/expectation for this PR but I have no problem adding it.
There are 2 options:

We automatically append a .vdc extension if the file does not have one, i.e. if a user specifies out.nc, we output out.nc.vdc. This behavior mimics the system file save dialog.
We abort with an error code if the extension is not .vdc

1 seems more convenient to me however the advantage of 2 is that if a user has a script, this will clearly let them know we have started enforcing this file extension whereas option 1 may cause their script to silently fail and they have to debug it.

@StasJ per our discussion this afternoon let's just add a warning message if the .vdc extension is not used.

vapor doesn't seem to recognize the .vdc extension when the file is specified on the command line. The application starts, but the data set isn't loaded.

That was never actually a feature that vapor supported. I just threw in some basic support for this for my own convenience when testing so I did not bother updating it here. I can clean up that code a bit and update it if we want to make it a feature.

I find it to be a highly useful feature. Please make it work.

Done

@clyne That came across wrong. I was just explaining why I didn't update it initially. I put that there when I was developing a feature a long time ago. Since I had already been using .vdc for a while it didn't work for me and I considered it old development code. It now works for vdc, netcdf, and wrf files.

authors: StasJ clyne sgpearse

repo: NCAR/VAPOR


text:
non-ipynotebook version

Need instrucion to install native Linux OS

bash script should be able to specify where the file is.
This wold be difficult from inside the docker.  But it should work if (1) no docker at all or (2) use docker, but not from inside the container, use it as as a postgis server.

This is pretty much done, but i made changes here and there in the main code in code_anaconda.  So need to make sure that notebook part is not broken.  Once that's that, this nrt branch will be marged into master.

#36

repo: NCAR/finn-preprocessor


text:
R code for cnv calling and plots using "gsrc"

Write R code using the package "gsrc".  Since we have a working pipeline to generate LRR and BAF in PennCNV format, start your code by reading the PennCNV input file into R.  You can find an example file in our repo here "files/pennTest2.txt".
Take this input file and do CNV calling using "gsrc".  Write CNV calls to a file, preferably in bed or bedgraph format.  This will allow for easy comparison with PennCNV output using bedtools or similar, as well as easy upload to UCSC browser for further visualization with genomic context.  Also write code to output some plots of CNV calls.
I'm asking you to do your CNV calling one sample at a time (each input file only has data from one sample).  This may not be possible.  For PennCNV, for example you need to generate a reference file using many samples before you can do CNV calling one sample at a time.  I'm going to have generating the PennCNV reference file as it's own module.  If there is a step like this in "gsrc" we can add this to the same module as the PennCNV reference.  So please split this off into separate code.
Put R code files into the "R/" directory in our repo.  Make a new .R file for each separate task, and clearly define required input files and output files.

The R script gsrcCNVcalling.R in R/ will take in a directory with the pennTest-like files and an output directory as input and output a bed file with char/start/end/num_probes/avg_signal. No header. Let me know if I should change the input.
I'm working on assigning the copy states as well within the same script.
The plot features from 'gsrc' require defined synteny blocks which requires extra processing and mapping and things. So all the pretty plots at the end of https://cran.r-project.org/web/packages/gsrc/vignettes/introduction.html won't work without synteny blocks.

@ngiangre, I had to change the header line for the txt file.  Can you change your code to work with the new header line?
I deleted the old txt file and added "files/201274980046_R04C02.PennCNV_in.txt" to the repo.  It has the new header line.
Thanks!

Yup, I can change the script to adapt to the new header line
From: Eric Karlins notifications@github.com
Reply-To: NCBI-Hackathons/Global_Screening_Arrays reply@reply.github.com
Date: Tuesday, March 21, 2017 at 10:42 PM
To: NCBI-Hackathons/Global_Screening_Arrays Global_Screening_Arrays@noreply.github.com
Cc: Nick Giangreco nick.giangreco@gmail.com, Mention mention@noreply.github.com
Subject: Re: [NCBI-Hackathons/Global_Screening_Arrays] R code for cnv calling and plots using "gsrc" (#10)
@ngiangre, I had to change the header line for the txt file. Can you change your code to work with the new header line?
I deleted the old txt file and added "files/201274980046_R04C02.PennCNV_in.txt" to the repo. It has the new header line.
Thanks!
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

R script was adapted to new headers, assign cnv state to region if consistent across probes in region, and was tested successfully on ubuntu with
"/opt/R-3.3.1/bin/Rscript gsrcCNVcalling.R /home/ubuntu/ngiangre/Global_Sc
reening_Arrays/files /home/ubuntu/ngiangre/Global_Screening_Arrays/files/output"
outputs bed file with: chr, start, end, number of probes, avg probe value, and deletion (-1)/duplication (+1)/no change (0) status.
Will now work on manuscript and slide describing R cnv calling approach

updating R script to assign cnv state to cna regions without excessive looping (its faster)

The gsrc plotting functions are too specific for their data-looking at other functions/packages instead

Playing with ggplot for plotting of bed files currently

finished for now. Start new issue later for R plotting/CNV calling

authors: ekarlins ngiangre


text:
Added check for "https" in sysmeta update functions

resolve #47  Came up with 3 potential fixes, chose the first to keep the code style consistent.  The other two are included in case you prefer one.  They would need to be amended for the multiple subjects case in set_access
if (grepl("https", subject)) {
stop("https format for subject not accepted, change to http")
}
if(grepl("https", subject)){
subject <- gsub("https", "http", subject)
}

Thanks for PR'ing this!
I think I like stoping, instead of fixing, for two reasons:

Helps train the team member that they've done something wrong and how to fix it
Avoids making a choice for them they might not want

I see in your examples above, your stop condition is when https: is found in the subject but that, in the commits you've put in this PR, your stop condition is when http: is found. A few things:

I think the code should make their parent functions stop when a subject is passed in with "https:", not "http:"
grepl returns a logical vector of the same size as the x argument so the if statement, as written, should not quite work as expected and also produce a warning. I suggest wrapping it inside a call to any().
I've used stopifnot a lot in my code but I've realized that it makes for hard to understand error messages for the team so I've tried to write more helpful messages, aimed at a hypothetical new data team member. Could you add that too?
grepl, and related functions, support regular expressions so the grepl call can be more specific. To catch subjects that start with https:, we'd write grepl("^https:", x) and we can be even more specific by using grepl("^https:\\/\\/orcid\\.org", x)

What do you think about all that?

That all makes sense.  Thanks for the thoughtful response!

I only need to wrap grepl inside a call to any for the possible multiple subjects input in set_access right?

When you mention "could you add that too" would you like me to update all the initial stopifnot calls to if(..){stop(..)} format?  Most of the stopifnot error messages make enough sense, like is.character(pids) is not TRUE, even if they don't explicitly spell out the error in layman's terms.  But I'd be happy to update those if you'd like.

grepl("^https:\\/\\/orcid\\.org", x) is much cleaner, I like it!

Yes
Yes please. You can just add more commits to your fork and this PR will update. From a perspective of someone who's a relatively experienced but once inexperienced data team member, do you think it's worth the time to write out such helpful error messages?
👍

Ok sounds good.  It's probably not worth updating every function, but I'll add the messages for publish_update and publish_object - the two most frequently used functions (at least in my experience).

I don't totally follow what the update to those two functions would be. I was thinking you'd just modify the relevant functions in access.R. What kind of changes were you thinking about?

Just changing the initial stopifnot calls to produce error messages.  For instance lines 247-276 in editing.R.  But I'm happy to stick to modifying the relevant functions in access.R

Ah, gotcha. For those, I'd appreciate a separate PR just to keep things simple.

PS: When you get to it, please add yourself as a contributor in the DESCRIPTION file.

Understood, I'm still getting up to speed with conventions, thanks for the patience / detailed explanations!

Hey @amoeba I just ran into an unintended consequence of this fix.  If an orcid with a https URI is already in the system metadata it's difficult to update/remove it because set_rights_and_access (and other related functions) won't accept it as an argument input.
What do you think about changing the stop calls to warning and having the functions change https to http?  We'd originally agreed stop was better for the following reasons:
- Helps train the team member that they've done something wrong and how to fix it
- Avoids making a choice for them they might not want

Now I'm not sure it's better as it's pretty difficult to work with packages that contain https URI's in the sysmeta.  I'd be happy to PR this if you want to go this route.
Alternatively we could query all the ADC objects and convert https to http all at once (not sure how sane this idea is)!

repo: NCEAS/arcticdatautils

license_source: bigquery


text:
Saved Search Returns Unsorted

When testing #15 , organization names are not returned alphabetically on saved searches.  It forces the user to possibly tab through each page to find the organization they are looking for.  For example, 45 organizations were returned from a saved search.  Alphabetically the organization I was looking for should have been on page 1, but appeared on page 4.
Reference item 89

It's not strictly an issue with Saved Searches: the default sort order for Organizations (from a Search and from an Advanced Search, thus also from a Saved Search) is on createdAt DESC which may not be ideal.
For the other object types, the (default) sort orders are:

Reports: engagementDate DESC
People: name ASC
Positions: name ASC
Locations: name ASC
PoAMs: shortName ASC

which all seem to be OK. So only the (default) sort order for Organizations from needs to change, to shortName ASC.
I will update the issue title accordingly.

To make this issue more generic (and include #172), we should provide a sensible default, stable ordering on Search (incl. Saved and Advanced) for all object types.
Note: stable means that we must include a field with guaranteed unique values in the order by clauses. In general this means we should add an ordering on the id field at the end. Proposed default ordering:

Reports: engagementDate DESC, id DESC
People: name ASC, id ASC
Organizations: shortName ASC, longName ASC, id ASC
Positions: name ASC, id ASC
Locations: name ASC, id ASC
PoAMs: shortName ASC, longName ASC, id ASC

authors: dspCarlson gjvoosten

repo: NCI-Agency/anet

license: mit


text:
Modifica layout das notícias e casos de sucesso

Obs.: Não adicionei o scroll horizontal nos casos de sucesso, pois como há uma página dedicada somente à eles, acredito que não faça sentido a página ter somente esse scroll horizontal.

fixes #37

fixes #38

authors: AmonVanderlei felipe-adeildo

repo: NES-Collaborate/nes-website


text:
Modal & location back bug

Version
1.0.0
Environment
ng-zorro-antd
Reproduction link
https://stackblitz.com/edit/angular-ax7ofd?file=src/main.ts
Steps to reproduce
无需打开重现链接

打开官网  https://ng.ant.design/docs/introduce/zh
选择 Modal对话框 ，点开一个示例modal
不要关闭 modal，点击浏览器右上角的返回键（或者mac滑动返回）
此时任何页面都无法滚动了

What is expected?
经过复现操作后可以滚动
What is actually happening?
经过复现操作后无法滚动
Other?
应该是某个蒙层没有销

感谢反馈

authors: shhdgit vthinkxie

repo: NG-ZORRO/ng-zorro-antd


text:
Cascader级联选择选择框在屏幕右边是会被屏幕挡住

Reproduction link
https://ng-zorro-antd-start-vcobp1.stackblitz.io
Steps to reproduce
将Cascader 放在最右边，选择框超出屏幕后会被挡住
What is expected?
选择框能移动到屏幕内来
What is actually happening?
选择框超出屏幕后会被挡住

Environment
Info

ng-zorro-antd
9.0.2

Browser
chrome

重现链接是 8.xx 版本，没办法重现

Hi @2693252993. I could not open your reproduction link. Would you please provide the editable link?

@wendellhu95  https://stackblitz.com/edit/ng-zorro-antd-start-fgzvcs


text:
Button nzLoading cannot prevent following click anymore

Reproduction link
https://stackblitz.com/edit/angular-nvhudg
Steps to reproduce

Click the button constantly
Check the console

What is expected?

console is empty, click events are prevented

What is actually happening?

click events are not prevented

Environment
Info

ng-zorro-antd
13.0.1

Browser
Chrome latest

It is introduced by ant design style syncing in https://github.com/NG-ZORRO/ng-zorro-antd/commit/5cd40b4956e40dce82a1b6f81cc2323dfc6fae22  components/button/style/index.less

Does ant-design also support this? ng-zorro-antd should follow the rules of ant-deign :)

Does ant-design also support this? ng-zorro-antd should follow the rules of ant-deign :)

ant-design does not support

I tried to solve this issue by javascript like what React version does but it didn't work. https://github.com/ant-design/ant-design/blob/106acb7d5ba63a5a9095550b240b2cfe37a15a11/components/button/button.tsx#L209
Help needed

I tried to solve this issue by javascript like what React version does but it didn't work. https://github.com/ant-design/ant-design/blob/106acb7d5ba63a5a9095550b240b2cfe37a15a11/components/button/button.tsx#L209 Help needed

I submit a new pr, may be can help you


text:
EDNS information logging in log

I have implemented EDNS on two unbound.
The first unbound correctly sends the subnet information to the front-end unbound.
This is the debug on the front-end server
Jun  2 19:23:18 dns unbound: [8351:1] debug: answer has edns subnet 192.168.1.0/24 scope /0
Jun  2 19:23:18 dns unbound: [8351:1] debug: EDNS lookup known=1 vs=0
Jun  2 19:23:18 dns unbound: [8351:1] debug: reply has edns subnet 192.168.1.190/32 scope /0
Jun  2 19:23:18 dns unbound: [8351:0] debug: query has edns subnet 192.168.1.190/32 scope /0
Jun  2 19:23:18 dns unbound: [8351:0] debug: reply has edns subnet 192.168.1.190/32 scope /0
Jun  2 19:23:18 dns unbound: [8351:1] debug: reply has edns subnet 192.168.1.190/32 scope /0
Jun  2 19:23:24 dns unbound: [8351:3] debug: query has edns subnet 127.0.0.1/32 scope /0
Jun  2 19:23:24 dns unbound: [8351:3] debug: EDNS lookup known=1 vs=0

How can I force Unbound to write the EDNS subnet information to the Unbound requests logs?
I can't figure out how?
The DNS service still log the IP address of the first Unbound server

The unbound that wants to log queries, there the edns subnet mod prints query has edns subnet ... and this is the subnet information for the incoming query.
The set up sounds similar to the use of proxy-protocol. With that the downstream IP address would be logged with log-queries: yes, due to the proxy protocol carrying that to the server. Proxy protocol processing, if that sort of load balancing towards some servers is considered as useful, is enabled with proxy-protocol-port: <port> for the server that performs recursion.

hi
Make sense...
This is one of the methods I wanted to implement, but it doesn't work in a purely "unbound" ecosystem.
In fact, I didn't see the possibility of enabling the proxy protocol in forward-addr/stub-addr
When you have Unboud backends servers  to Unboud front-ends, this architecture using Proxy-Protocol doesn't currently seem to be supported.
For PowerDNS/DnsDist to Unboud, no problem.
However, I was able to answer this question using DNSTAP where EDNS can be extracted.

Hello ,
You can do that easily with dnstap !
You may use a dnstap collector on the same server and configure unbound to forward queries to the collector. You will be able to see all details including EDNS/ECS. Plus, this is much less resource expensive in contrast with normal query logging.

authors: Hexen1988 dtouzeau wcawijngaards

repo: NLnetLabs/unbound


text:
unbound 1.19 cause FreeBSD 14.0-RELEASE panic

unbound 1.19, FreeBSD 14.0-RELEASE
Because I am running multiple unbound instance in same host with different config file, I am not sure which one cause panic. I will keep updating this thread.
Here is panic info,
Fatal trap 12: page fault while in kernel mode
cpuid = 8; apic id = 00
fault virtual address   = 0xb8
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff80d4f743
stack pointer           = 0x28:0xfffffe01add20c50
frame pointer           = 0x28:0xfffffe01add20ce0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 2863 (unbound)
rdi: ffffffff818ca280 rsi: ffffffff818ca280 rdx: 0000000000010200
rcx: 0000000000000000  r8: fffff8063843b900  r9: 00000000c1df0200
rax: fffff80b9a4ab000 rbx: 000000000000c1df rbp: fffffe01add20ce0
r10: 0000000000000000 r11: fffffe006c36b700 r12: fffff8033d9d68c0
r13: fffff802c2961000 r14: fffff8033d9d6970 r15: 0000000000000000
trap number             = 12
panic: page fault
cpuid = 8
time = 1702272950
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01add20930
vpanic() at vpanic+0x132/frame 0xfffffe01add20a60
panic() at panic+0x43/frame 0xfffffe01add20ac0
trap_fatal() at trap_fatal+0x40c/frame 0xfffffe01add20b20
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe01add20b80
calltrap() at calltrap+0x8/frame 0xfffffe01add20b80
--- trap 0xc, rip = 0xffffffff80d4f743, rsp = 0xfffffe01add20c50, rbp = 0xfffffe01add20ce0 ---
in_pcbbind_setup() at in_pcbbind_setup+0x233/frame 0xfffffe01add20ce0
in_pcbbind() at in_pcbbind+0x58/frame 0xfffffe01add20d10
udp_bind() at udp_bind+0xc8/frame 0xfffffe01add20d50
sobind() at sobind+0x32/frame 0xfffffe01add20d70
kern_bindat() at kern_bindat+0xc5/frame 0xfffffe01add20dc0
sys_bind() at sys_bind+0x9b/frame 0xfffffe01add20e00
amd64_syscall() at amd64_syscall+0x109/frame 0xfffffe01add20f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01add20f30
--- syscall (104, FreeBSD ELF64, bind), rip = 0x82632312a, rsp = 0x829110bb8, rbp = 0x829110c10 ---

This seems like a FreeBSD kernel error.
From Unbound's side I see that this may happen during a UDP bind() call.
Do I understand correctly that unbound.conf.1 has multiple instances with setfib, while unbound.conf.2 has only one?
Do you see these often? And am I correct to assume that this happens during startup/reload?
Does the same setup work reliably with older versions?
Things you could try:

Have only one of each instance then the unbound.pid file could shed more light into which one it is.
Try combinations of setfib and the so-reuseport configuration.

Hmm, I tested unbound-1.17.1, and it caused kernel panic too. I think it is an OS bug.
The system does not crash during startup/reload of unbound. It happens irregularly.
Now I am running unbound 1.19 with "so-reuseport: no" for testing. And I saved the PID information of all unbound processes.

This is not unbound bug. It is FreeBSD kernel bug. And it looks very similar to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273890 Please see details and try the patch.

"so-reuseport: no" only reduces the occurrence of the problem, it can still lead to kernel panic.
I am testing the kernel patch now.

Interested if this was the fix for you @hshh? Did you get it done?

Interested if this was the fix for you @hshh? Did you get it done?

Yes, the system has become stable after applying the kernel patch. The uptime is 16 days now.
I hope it can be merged into 14.0-RELEASE, @glebius .

It can't be merged into 14.0-RELEASE, since the release happened in the past. We might make a Errata Notice and a patch level for the releng branch.

Closing this as a non-issue for Unbound then :)

authors: glebius gthess hshh wravoc


text:
Provide access to the parsed template for structured log events

Type (choose one): Feature request
NLog version: 4.5-alpha01
Platform: .NET 4.5, others
When processing a structured log event, the underlying Template object is useful for a few reasons.

Targets that want to pretty-print output need to iterate over the individual template tokens, e.g. see https://github.com/serilog/serilog-sinks-literate and https://github.com/logary/logary/pull/155
Targets that capture the template itself for later offline rendering need to pre-render Holes that have a Format associated with them, see: https://github.com/datalust/nlog-targets-seq/issues/2

It'd be nice not to have to parse the template twice in this situation, since it's already parsed in LogEventInfo.CalcFormattedMessage().
A simple way to do this would be to add a lazily-initialized Template property to LogEventInfo.
To avoid extending the Template's lifetime (potentially hurting GC performance), a GetTemplate() method might be a better option. This would internally parse the template, then call the equivalent of CalcFormattedMessage() passing the parsed Template as an argument, before returning it from GetTemplate() (no backing _template field would thus be needed).

Will implement this soon :)

Also in alpha 2!
GetMessageTemplate.

Awesome :-) will update ASAP for this and #1963.

@304NotModified just one slight issue- the method is cased GetmessageTemplate() - lowercase 'm'

Oops gonna fix that. Was also thinking I should return an interface eventually.

This is Fixed in alpha3

repo: NLog/NLog


text:
WhenRepeatedFilter filtering out logs that are not similar and only output one

Type:
Bug
NLog version:
4.7.0
Platform:
.NET 4.7.2
I wanted to test the WhenRepeatedFilter as it sounded exactly like the filter I was looking for.
There might be something I have missed, but it seems to be bugged?
I wrote a very small test case to see if I could use the filter (see screenshot)

As you can see in the screenshot, the second error log only came out once and with the wrong "hit count"
After the initial log of it, it does not seem to be logged anymore?

My eyes does not see well, but it look like you are assigning Layout to static string CsvLayout:
var whenRepeated = new WhenRepeatedFilter
{
    Layout = "CsvLayout"
}

WhenRepeatedFilter checks the output rendered by Layout and compares to previous result. When using a static string, then the output rendered is always the same.
Can you explain what you expect should be happening?

@snakefoot Forgive my ignorance, but I thought this would use the "CsvLayout" layout that is shipped with NLog. As you can see from the screenshot I actually get one line with the second log?

When using the CsvLayout, then you need to make an instance of the CsvLayout-class and configure it:
https://nlog-project.org/documentation/v4.7.0/html/T_NLog_Layouts_CsvLayout.htm
https://nlog-project.org/documentation/v4.7.0/html/T_NLog_Layouts_CsvColumn.htm
Btw. it is not very optimal to use CsvLayout as filtering-logic. Can you explain why CsvLayout would be good to use as filter in WhenRepeatedFilter ?
Usually one would use this as filter:
var whenRepeated = new WhenRepeatedFilter()
{
     Layout = "${message}${exception:format=Type,Message}";
     Action = FilterResult.Ignore,
     TimeoutSeconds = 5,
}

It was a simple sample, not production code :-)
If I do this:
var layout = new CsvLayout();
var whenRepFilter = new WhenRepeatedFilter
{
TimeoutSeconds = 5, Action = FilterResult.Ignore, FilterCountMessageAppendFormat = " (Hits: {0})", Layout = layout
};
I get the same result as before, but if I use your layout string it works fine.
It might just be something I am not comprehending.

A newly created CsvLayout without any columns will not generate any output. So again you have just configured a static-string. Now "" instead of "CsvLayout".
Happy to hear my example is working. Can you explain why CsvLayout would be good to use as filter in WhenRepeatedFilter ?

@snakefoot As I mentioned above, this was just a very fast put together sample to see if the WhenRepeatedFilter would be able to solve log spamming.
In our real environment there is already a proper layout.
Regards from a fellow dane :-)

Little strange  you create a bug report about NLog feature not working, but have skipped the actually configuration. And then say it is because it is "not production code".
The best way to avoid log spamming is not to do log-spamming. Don't spend time on logging stuff that is not needed. NLog WhenRepeatedFilter is intended for actual end-users (not application developers), so they can work-around a broken application (application developers can fix the application logging).
I think it is bad idea to use CsvLayout as your Layout-filter, since it spends a lot of time of formatting and correctness (Honor the Csv standard). All that validation work is only needed when writing to an actual output target (Filtering doesn't care about correctness). Filtering only cares about uniqueness.
Anyway happy you got WhenRepeatedFilter working, after you gave it a Layout that actually reacted and didn't produce static output. Held og lykke med dit nye kode eventyr :)

Yea, it should have been a question, my bad.
I totally agree that logging should not be spammed, but having 50+ people across many teams working on the same product and not all know how to properly log, then something like this is needed until there is a general agreement about logging only being ment for spotting errors.
Please understand that the csv logging was me being lazy in this sample and not providing a proper layout :-)

authors: Azagatoth snakefoot


text:
Dev opt agree

Utilize windowed reading/calculating/writing to help eliminate potential memory issues during the AGREE dem process.
After enabling windowed reading/calculating/writing ran fim_run using this command
/path to /fim_run.sh -u /path/to/the/dev_fim_ble.lst -n tsg_dev_opt_agree -j 13 -c /path/to/params_template.env -e FR
Upon successful completion, I did a comparison using gdalcompare.py between the AGREE rasters with the latest dev run (52d0298_fr & e8f2a88fr) and this feature branch and no differences were found across all 49 hucs for all agree related rasters ('agree_bufgrid.tif', 'agree_bufgrid_allo.tif', 'agree_bufgrid_dist.tif', 'agree_smogrid.tif', 'agree_smogrid_allo.tif', 'agree_smogrid_dist.tif', 'dem_burned.tif').
The main benefit to this new feature branch is that it reduces the memory needed.

11130304
11130304

Dev
dev-alt-agree

User time   (seconds): 63.90
User time (seconds):   68.23

System time   (seconds): 11.15
System time   (seconds): 8.31

Percent of CPU   this job got: 100%
Percent of CPU this   job got: 100%

Elapsed (wall   clock) time (h:mm:ss or m:ss): 1:14.61
Elapsed (wall clock)   time (h:mm:ss or m:ss): 1:16.51

Average shared   text size (kbytes): 0
Average shared text   size (kbytes): 0

Average   unshared data size (kbytes): 0
Average unshared data   size (kbytes): 0

Average stack   size (kbytes): 0
Average stack size   (kbytes): 0

Average total   size (kbytes): 0
Average total size   (kbytes): 0

Maximum   resident set size (kbytes): 4,305,636
Maximum resident set   size (kbytes): 1,565,080

Average   resident set size (kbytes): 0
Average resident set   size (kbytes): 0

Major   (requiring I/O) page faults: 0
Major (requiring I/O)   page faults: 0

Minor   (reclaiming a frame) page faults: 2,339,641
Minor (reclaiming a   frame) page faults: 1,273,528

Voluntary   context switches: 9661
Voluntary context   switches: 11525

Involuntary   context switches: 68661
Involuntary context   switches: 115779

Swaps: 0
Swaps: 0

File system   inputs: 0
File system inputs: 0

File system   outputs: 7523256
File system outputs:   7523256

Socket   messages sent: 0
Socket messages sent:   0

Socket   messages received: 0
Socket messages   received: 0

Signals   delivered: 0
Signals delivered: 0

Page size   (bytes): 4096
Page size (bytes):   4096

Exit status: 0
Exit status: 0

Time  = 74sec
Time  = 76sec

Cumulative_Time   = 124sec
Cumulative_Time =   128sec

8040203
8040203

Dev
dev-alt-agree

User time (seconds): 130.68
User time (seconds): 140.85

System time (seconds): 22.26
System time (seconds): 14.89

Percent of CPU this job got: 99%
Percent of CPU this job got: 99%

Elapsed (wall clock) time (h:mm:ss or   m:ss): 2:33.92
Elapsed (wall clock) time (h:mm:ss or m:ss): 2:36.36

Average shared text size (kbytes): 0
Average shared text size (kbytes): 0

Average unshared data size (kbytes): 0
Average unshared data size (kbytes): 0

Average stack size (kbytes): 0
Average stack size (kbytes): 0

Average total size (kbytes): 0
Average total size (kbytes): 0

Maximum resident set size   (kbytes): 9,235,064
Maximum resident set size (kbytes): 3,287,844

Average resident set size (kbytes): 0
Average resident set size (kbytes): 0

Major (requiring I/O) page faults: 1
Major (requiring I/O) page faults: 0

Minor (reclaiming a frame)   page faults: 5,080,526
Minor (reclaiming a frame) page faults: 2,487,347

Voluntary context switches: 30439
Voluntary context switches: 20670

Involuntary context switches: 103682
Involuntary context switches: 139061

Swaps: 0
Swaps: 0

File system inputs: 8
File system inputs: 0

File system outputs: 16081336
File system outputs: 16081336

Socket messages sent: 0
Socket messages sent: 0

Socket messages received: 0
Socket messages received: 0

Signals delivered: 0
Signals delivered: 0

Page size (bytes): 4096
Page size (bytes): 4096

Exit status: 0
Exit status: 0

Time    = 154sec
Time  = 156sec

Cumulative_Time = 295sec
Cumulative_Time = 300sec

Script Modified:
agreedem.py --> read, calculate, write using rasterio windows and close datasets when not needed.

Once I can compare metrics I will post results to that. Otherwise, the only files that were modified were associated with the AGREE process and these files are identical (this feature branch compared to current dev e8f2a88).

@nickchadwick-noaa
Would you please merge this feature branch in with dev.

repo: NOAA-OWP/cahaba


text:
[21pt] Update FIM 4 inundation to the HydroVIS method

Use the same method HydroVIS is using to inundate GMS. We'll probably have to add one or two libraries to our docker image; I know of rioxarray, but there might be more. Here's a few notes of things we'll need to keep in mind:

Use a class structure for the new inundation script

It might be worth making a method for inundate and the composite step a method in the same class

Before we get too far into making the class, let's test the new inundate method to make sure that it's faster than our current version
Try to minimize impact on other tools that use Inundate_gms(). Let's keep inputs and outputs as close to the same as possible. We'll have to update these scripts to make sure we don't break our other tools:

tools/composite_inundation.py
tools/run_test_case.py
unit_tests/gms/inundate_gms_unittests.py
gms_pipeline.sh

We found that there is sometimes a difference in stage arising from the SRC interpolation in a looped rating curve. To fix this discrepancy, HydroVIS will start using the np.interp() function to align with the FIM teams' inundation technique.

repo: NOAA-OWP/inundation-mapping


text:
Qlat looping dynamic #3

This is the third PR involving looping that will follow after the integration of the previous two. It mimics the functionality of the dynamic da block creation and creates the same exact structure used in the yaml file previously in an automatic way. NTS is also created in this looping. This way nothing in the compute functionality changes and instead we can just create the blocked test segments of qlat files quickly at the start of the model process and save it for later.
def build_qlat_date_range(forcing_parameters):  and def build_qlat_sets(forcing_parameters,dates): within the .io file achieves most of this. Need to preserve block approach or dynamic approach for qlat input file blocks.

replaced by another PR with dynamic parity

repo: NOAA-OWP/t-route


text:
New Device Library structure for easily saving custom devices

Is your feature request related to a problem? Please describe.
Users would like to have more streamlined ways of importing their own devices (wind turbines, wave energy converters, etc.) to the device library files so that they can be saved in the library for future use.
Describe the solution you'd like
A different storage system for device libraries that would not be overwritten by SAM patches or tied to the release version.
Describe alternatives you've considered
UI widgets could be used to modify the existing device libraries but these changes would be overwritten every time a SAM version is issued a patch.
Additional context
We have had requests from NREL marine energy and wind teams about this type of functionality.

@cpaulgilman Just a placeholder issue for thoughts on device libraries. There have now been requests for the wave energy converter library and the wind turbine library.

The current implementation of the weather file library for solar resource data stores data outside of the SAM installation folder so that it can be used by different versions of SAM. We could use a similar approach for equipment libraries.
The module and inverter libraries contain data that is not provided in the CEC Excel file or on manufacturer datasheets, but that can be generated by SSC compute modules. The "with user-entered specifications" options on the Module and Inverter input page could be used as a tool to add items to a user library: The user populates inputs on the UI form and then clicks an "Add to Library" button.
Equipment data should be stored in a standard format that is easily editable (CSV, JSON, or similar).
Need to consider how/whether to maintain an "official" library with data generated by the NREL SAM team separately from a user-generated library.
Could generate and store NREL library data online so that it can be maintained independently of SAM releases, and potentially by users and partners outside of the NREL SAM team. Would require a "Check for Updates" function in SAM, perhaps a button on the relevant input page.
Should check in with other organizations with equipment databases for potential collaboration or integration. Some examples:

Solar Power World Online: https://www.solarpowerworldonline.com/solar-power-worlds-2016-list-of-solar-inverter-models/ (seems like CEC data and out of date)

ENF: https://www.enfsolar.com/pv/solar-system

Photon: https://www.photon.info/en/photon-databases

I agree that this is a large effort. I think we can keep it as an issue to address when we have the resources.

authors: cpaulgilman mjprilliman

repo: NREL/SAM


text:
Tidal turbine power curve generation

Description
-Modify ssc equation generating tidal turbine power curves to have rated power based on capacity factor calculations rather than an input power
-Show calculated power per rotor
-For patch 2, using a fixed capacity factor of 0.3 in ssc; for release expose capacity factor as an additional UI input
-todo for release: rename UI variables for improved clarity.
-See email for test materials
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update
[ ] This change modifies variables in existing compute modules. Please see Checking for PySAM Incompatible API Changes.

Checklist:
If you have added a new compute module in a SSC pull request related to this one, be sure to check the Process Requirements.

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[ ] I have checked my code and corrected any misspellings

The functionality looks good.
When I choose the option to design the tidal converter, I see both the tidal design inputs and the inputs for the “choose tidal converter from library” option. The power curve table is technically disabled, but it is so prominent that I think most users will not know to ignore it, in spite of the red text at the top of the page. I think this should be set up like a battery dispatch page where the radio buttons are in a separate top panel and control what appears in the bottom panel.

I can't replicate this. When I switch to the tidal turbine design I only see the design page.

@cpaulgilman Are you testing this on a Mac? I'm noticing the mac and Linux tests failing on SAM here (although only the pull_request) and I wanted to make sure there's not any differences across platforms. Also are you checking out the same branch name in ssc (https://github.com/NREL/ssc/pull/1181)?

@mjprilliman The distinguishing feature seems to be that the pull request builds are failing and the push builds are passing. The pull request builds are building against patch of ssc:

which seems incorrect in this case. I think it's safe to ignore it in this case and @dguittet and I can double check the CI scripts to fix this in the future.

@mjprilliman The distinguishing feature seems to be that the pull request builds are failing and the push builds are passing. The pull request builds are building against patch of ssc:

which seems incorrect in this case. I think it's safe to ignore it in this case and @dguittet and I can double check the CI scripts to fix this in the future.

Thanks. I was looking for this yesterday but was looking in the wrong place. I had to rebase these branches to patch (manually, not using the git rebase command) if that is helpful in troubleshooting the CI.

Ok I think the issue is that the PR workflow should also use the related ssc branch if it's available. I'll make that change.

authors: brtietz dguittet mjprilliman


text:
Added unit tests for LCSSMatcher forward_merge

Added the first unit test for LCSSMatcher forward merge. Related to issue #9

This pull request will also close issue #59

This can close issue #59 but don't close issue #9 as only part of the issue is completed in this pull request.

repo: NREL/mappymatch


text:
Possible logic bug in SolarField::radialStaggerPositions?

g++ warns that:
../solarpilot/SolarField.cpp:2473:40: warning: logical not is only applied to the left hand side of comparison [-Wlogical-not-parentheses]

That line reads:
 && !Htv->is_round.mapval() == var_heliostat::IS_ROUND::ROUND) {

It's not clear to me if what is meant was to invert the mapval() result and then test equality with ROUND or if what was meant was !(expr == ROUND) or, simply, expr != ROUND.
If someone can please clarify, I'll fix it either way.

I dug in some more and found that mapval() returns an enum that has only two possible values (0, 1). Hence the code happens to work either way -- you can invert the enum value and test it against ROUND or you can test the original enum value against ROUND and invert the equality result.  I will submit a patch to clear it up.

repo: NREL/ssc


text:
ENH: seperate xpdAcq profile

It might be good to have an xpdAcq profile. This way we can symlink the DAMA supported profile over and add the xpdAcq files on top. This would prevent some of the issues from today about commenting out xpdAcq code.
Can we do this without ipython balking?

@mrakitin

That may be not a bad idea. However, if something is not working in 999*-.py, it makes a little difference between renaming the files to .999-*.py and removing the symlinks in the profiles. Also, now you will have to make sure that everything is in sync on all the beamline machines, which adds more complexity in maintaining two separate profiles (tagging may become out of sync easily). I invite @danielballan and @tacaswell to discuss.

How often is the xpcacq profile changed interactively? Composing (in the sense of "combining") profiles seems like we are starting to stretch what profiles are meant for. I think it would be easier to maintain something like:
import xpdacq
xpdacq.configure(get_ipython.user_ns)  # adds objects to namespace

akin to what we do with nslsii.configure_base. What do you think of that design, @CJ-Wright?

authors: CJ-Wright danielballan mrakitin


text:
Rename 'sleep' -> 'nap' and 'input' -> 'async_input'. (Old names warn, for now.)

Closes #578

3.5 passed; 3.4 failed on the infamous ramp_plan test.

Current coverage is 82.97% (diff: 71.42%)

No coverage report found for master at af457d3.

Powered by Codecov. Last update af457d3...90577a8

To record Tom's verbal counterargument to this renaming:

There is precedent for having functions that share the same name as common built-ins: for example, asyncio.sleep.

I'm reasonably convinced by that. The advantage of having the same name is, it correctly suggests that bluesky.plans.sleep is like time.sleep but for plans. Likewise for input. The disadvantage, of course, is that people aren't used to thinking about scope can get confused.
For now we will not make this change, but we'll revisit if people keep shooting themselves in the foot with this. In the meantime, scientists can always alias nap = bluesky.plans.sleep in their startup files.

To record Tom's verbal counterargument to this renaming:

There is precedent for having functions that share the same name as common built-ins: for example, asyncio.sleep.

I'm reasonably convinced by that. The advantage of having the same name is, it correctly suggests that bluesky.plans.sleep is like time.sleep but for plans. Likewise for input. The disadvantage, of course, is that people aren't used to thinking about scope can get confused.
For now we will not make this change, but we'll revisit if people keep shooting themselves in the foot with this. In the meantime, scientists can always alias nap = bluesky.plans.sleep in their startup files.

authors: codecov-io danielballan

repo: NSLS-II/bluesky


text:
MNT: update to deal with API change in ME

This allows our code to work with ME current-master and
pymongo v3
There is a bug in v0.10.0 & pymongo 3 due to a renaming of
disconnect -> close on pymongo collections.
This should not be merged until we have a plan to roll out ME/pymongo updates.
We should probably do this soon as there is a 2x speed up on read speed due to going from pymongo 2.8 -> 3.0.

ME == mongoengine?

(in the PR title)

Yes
On Mon, Sep 14, 2015 at 4:46 PM Eric Dill notifications@github.com wrote:

(in the PR title)
—
Reply to this email directly or view it on GitHub
https://github.com/NSLS-II/metadatastore/pull/170#issuecomment-140200957
.

Don't you need to change https://github.com/NSLS-II/metadatastore/blob/master/metadatastore/odm_templates.py#L148 to remove the _id from the db_field kwarg?

No, that is one of the api changes in ME that made us pin at 0.8.7.
On Tue, Sep 15, 2015 at 12:24 PM Eric Dill notifications@github.com wrote:

Don't you need to change
https://github.com/NSLS-II/metadatastore/blob/master/metadatastore/odm_templates.py#L148
to remove the _id from the db_field kwarg?
—
Reply to this email directly or view it on GitHub
https://github.com/NSLS-II/metadatastore/pull/170#issuecomment-140450970
.

I can confirm that this works on pymongo 3.2rc0 and mongoengine 0.10.1

:tada:

These failures are from trying to build the conda package, the tests all pass.

authors: arkilic ericdill tacaswell

repo: NSLS-II/metadatastore


text:
Can not navigate through $H_2SO_4$ in MathCAT Demo site

In MathCAT Demo, type $H_2SO_4$ in Math Input Area, press Generate Speech and Braille,
click into Display Math rectangle, we CANNOT navigate through formula and the web page can not response any more.
But if replace $H_2SO_4$ with $h_2so_4$,  we can navigate through.

Thanks. I found the problem in the navigation that caused the crash, but the real problem is a bug in the code corrects the output to be correct for Chemistry -- it is generating some garbage MathML and that caused the navigation code to crash because an assumption it had wasn't true for the bad code.

repo: NSoiffer/MathCAT


text:
Support for MathML DTD's named entity definitions?

Will MathCAT be adding support for the named entity definitions in the MathML DTD (, ⅆ, ⅇ, ∬, , ±, etc.)?
I started creating test sets of MathML to look at the ClearSpeak and braille output compared to that produced by the SRE and noticed MathCat returns "XML parsing error at xx: {UnknownNamedReference}" when the provided MathML includes named entities.
For examples, please see:

https://brichwin.pages.iu.edu/tests/tests0001.html#ex59
https://brichwin.pages.iu.edu/tests/tests0001.html#ex60
https://brichwin.pages.iu.edu/tests/tests0001.html#ex64
https://brichwin.pages.iu.edu/tests/tests0001.html#ex65

No plans to support them because:

The XML DOM parser I have doesn't support that
They were deprecated in MathML 2. I think the reason was because it is not compatible with HTML. "∫" is part of HTML, but I don't think I can make that work because the underlying library I'm using doesn't support it.

I was wrong about '2'. They weren't deprecated but instead moved into HTML. The full list is here. However, my first point stands -- the library I have doesn't support them. I could do a strsubstitution

Confirmed working in MathCAT 0.1.23. The previous examples now render:

https://brichwin.pages.iu.edu/tests/tests0001-0.1.23.html#ex59
https://brichwin.pages.iu.edu/tests/tests0001-0.1.23.html#ex60
https://brichwin.pages.iu.edu/tests/tests0001-0.1.23.html#ex64
https://brichwin.pages.iu.edu/tests/tests0001-0.1.23.html#ex65

authors: NSoiffer brichwin


text:
WIP: Tor integration (testing needed)

Tor integration. Do not merge, testing needed.
You cannot test it on your local machine, since a Tor exit node cannot access your localhost.
I set up a tumbler server, use that instead:
tumbler.server=http://146.185.160.175:5000
Lines added to the client.config file:
tor.use=true
tor.host=127.0.0.1
tor.socksport=9050
tor.controlport=9051
tor.controlportpassword=ILoveBitcoin21

Tor instructions

Download Tor Expert Bundle: https://www.torproject.org/download/download
Download the torrc config file sample: https://github.com/nopara73/DotNetTor/blob/master/torrc
Place torrc in the proper default location (depending on your OS) and edit it:

Optionally uncomment and edit the SocksPort, if you don't uncomment it will default to 9050 port anyway
The default ControlPort in the sample is 9051, optionally edit it.
Modify the password hash

To run my tests, for the ControlPortPassword = "ILoveBitcoin21" the hash should be: HashedControlPassword 16:0978DBAF70EEB5C46063F3F6FD8CBC7A86DF70D2206916C1E2AE29EAF6
For your application you should use different one, a more complicated one. Then start tor like this: tor --hash-password password
where password is the password you've chosen. It will give you the HashedControlPassword.

Start tor, it will listen to the ports you set in the config file.

Here's an error I sometimes encounter only with Tor. Probably after I stop the client with ctrl+c.
info: Configuration[0]
      Downloading tumbler information of http://146.185.160.175:5000/
fail: Configuration[0]
      Unterminated string. Expected delimiter: ". Path 'voucherKey', line 1, position 1024.
dbug: Configuration[0]
         at NTumbleBit.CLI.Program.Retry[T](Int32 count, Func`1 act) in /home/user/NTumbleBit/NTumbleBit.CLI/Program.cs:line 211
         at NTumbleBit.CLI.Program.Main(String[] args) in /home/user/NTumbleBit/NTumbleBit.CLI/Program.cs:line 111

can you rebase ?

I'd wait until NTumbleBit upgrades to the new .NET Core. I don't want to spend half a day to figure out how to have both on my system.

can you rebase now I updated the project ?

a Tor exit node cannot access your localhost

If you allow it (in torrc) it can, though. But I'll test it as per the instructions.

authors: NicolasDorier nopara73 unsystemizer

repo: NTumbleBit/NTumbleBit


text:
Qwen-7B build failed on Windows with trtllm-0.9.0

System Info

Platform: Windows
version: trtllm-0.9.0

Who can help?
No response
Information

[ ] The official example scripts
[ ] My own modified scripts

Tasks

[ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)

Reproduction
I have built the qwen-7b engine successfully with trtllm-0.7.1, but when i upgrade the trtllm to 0.9.0 version, i can build the qwen engine successfully, but there is a problem when infer with it.
when run this:
python ../run.py --input_text "你好，请问你叫什么？" --max_output_len=50 --tokenizer_dir ./tmp/Qwen/7B/ --engine_dir=./trt_engines/weight_only_int4/

Expected behavior
the error messages are follows:
no entry found for key
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Traceback (most recent call last):
  File "D:\apps\trtllm_0.9\TensorRT-LLM\examples\run.py", line 564, in <module>
    main(args)
  File "D:\apps\trtllm_0.9\TensorRT-LLM\examples\run.py", line 484, in main
    print_output(tokenizer,
  File "D:\apps\trtllm_0.9\TensorRT-LLM\examples\run.py", line 278, in print_output
    output_text = tokenizer.decode(outputs)
  File "D:\anaconda\envs\trtllm_env_new\lib\site-packages\transformers\tokenization_utils_base.py", line 3782, in decode
    return self._decode(
  File "C:\Users\nv\.cache\huggingface\modules\transformers_modules\Qwen-7B-Chat\tokenization_qwen.py", line 276, in _decode
    return self.tokenizer.decode(token_ids, errors=errors or self.errors)
  File "D:\anaconda\envs\trtllm_env_new\lib\site-packages\tiktoken\core.py", line 258, in decode
    return self._core_bpe.decode_bytes(tokens).decode("utf-8", errors=errors)
pyo3_runtime.PanicException: no entry found for key
[TensorRT-LLM][ERROR] class tensorrt_llm::common::TllmException: [TensorRT-LLM][ERROR] CUDA runtime error in ::cudaFreeHost(ptr): driver shutting down (C:\Users\tejaswinp\workspace\tekit\cpp\tensorrt_llm/runtime/tllmBuffers.h:169)

actual behavior
I found it may because the generated token by qwen engine is beyond qwen tokenizer scope.
additional notes
What i can do to solve this problem?

应该是量化模型有问题，或者微调阶段就出问题了

Hi @bigbigQI
Couple of more follow-ups Qs.

When peforming trtllm-build, do you use the default commands? If so, can you see what happens with passing --context_fmha disable and then doing the inference with run.py like you are doing now?
Alternatively, you can upgrade to trt-llmv0.10 (released yesterday) where a potential bug with context FMHA plugin is fixed and default trt-llm build commands would work (with perf corresponding to the context plugin)
See here for install instructions. Thanks!

Hi @bigbigQI
Couple of more follow-ups Qs.

When peforming trtllm-build, do you use the default commands? If so, can you see what happens with passing --context_fmha disable and then doing the inference with run.py like you are doing now?
Alternatively, you can upgrade to trt-llmv0.10 (released yesterday) where a potential bug with context FMHA plugin is fixed and default trt-llm build commands would work (with perf corresponding to the context plugin)
See here for install instructions. Thanks!

Hi @tp5uiuc,
I tried add --context_fmha false, and it worked. Thanks.

Cool, marking as closed. Feel free to re-open if you face additional issues thanks

repo: NVIDIA/TensorRT-LLM


text:
How to get the newly generated tokens only?

Hi, I'm trying to get the newly generated tokens. It looks like currently the model returns all the token ids including input.
I tried to update the postprocessing model to take in REQUEST_INPUT_LEN from preprocessing model, however I'm receiving error E1101 04:46:29.381834 3651 model_repository_manager.cc:563] Invalid argument: in ensemble ensemble, step of model 'ensemble' receives inputs originated from different decoupled models.
This appears to be that postprocessing model tries to take input from both the decouple model tensorrt_llm and non-decoupled model preprocessing. Ensemble loads if I set model_transaction_policy.decoupled of model tensorrt_llm to false.
I could also do some tokenizations outside of the model ensemble but that is duplicated calculations. Any suggestions?

@yunfeng-scale  thanks for reporting this. Several customers also report the similar request. We already have an internal MR to support this which is being under reviewed. After it is done, it will be released correspondingly and there also will be release announcement mentioning this.
Thanks
June

Hi @yunfeng-scale , we pushed an update to the main branch for both TensorRT-LLM and TensorRT-LLM backend, including the feature to only get newly generated tokens.
Closing, please feel free to re-open if you have any questions, thanks.

@kaiyux would you mind link the PR to this issue?

@yunfeng-scale Please see the newly added parameter exclude_input_in_output in https://github.com/triton-inference-server/tensorrtllm_backend/pull/101
Note that the team is doing the development in internal repos, and sync the changes to GitHub periodically, so we do not have a dedicated PR on GitHub to fix this issue.
If you are still seeing the issue, please feel free to ask and we will reopen the issue. Thanks.

authors: juney-nvidia kaiyux yunfeng-scale


text:
In-flight batching and mixed batch

According to the document it seems like the packed & mixed batch is the default behavior of TensorRT-LLM.
So I've conducted an experiment to see the effect of mixed batching by changing the max_num_tokens to appropriate size.
Other setups are as follows:

benchmarked with 1024 samples

random generated fixed-length input tokens of length 1024
fixed-length output tokens of length 1024 (done by ignoring the EOS token)

max_batch_size set to 256
llama3 8B model
request arrival rate set to infinite (all requests are sent at the start)

And here are the results of max_num_tokens set to 2048, 2050, 2064 and 2176 respectively:

max_num_tokens
avg TTFT (ms)
avg TPOT (ms)
avg token throuput (token/sec)

2048
265435.6
67.22
3323.19

2050
265873.7
67.00
3319.35

2064
268012.8
67.49
3291.81

2176
265234.8
66.75
3325.43

I expected max_num_tokens 2048 will batch only 2 summarization phase sequences whereas 2050, 2064 and 2176 will batch extra generation phase sequences up to 2, 16 and 128.
The results show marginal change, and shows no clear evidence of mixed batching. Note that the TTFT results are quite broken as benchmark was done with request rate(or Query Per Second) set to infinite.
So,
Q1: Is mixed batch(batching sequence in summarization phase and generation phase in a single batch) still enabled by default?
Q2: If true, then why couldn't I see the difference and how should I design an experiment to see the impact of mixed batching.
Q3: If not, how can I enable it, and what was the reason to drop it from the default option?
Q4: Are there any materials including the code to get a better understanding of the batch manager(the request scheduler) in TensorRT-LLM, as for me, nothing seems to be open.

Hi there,
Yes, packed and mixed batch is still the default behaviour of TRTLLM. Let's consider the first case with 2048 tokens:

In the first iteration, two batches will be scheduled as they add up to 2048 tokens.
In the second iteration, (2 + 1024) two gen phases and one context phase to stay under the 2048 limit.
Going forward, we'll have (3 + 1024), (4 + 1024), ... until (255 + 1024), as that's when the 256 batch size limit will be hit. From that point onwards, 256 batches will run.

In the other cases, the ramp up is done slightly faster. Considering 2050 tokens:

First iteration is the same, (1024 + 1024) two context phases.
Second iteration would run (2 + 1024 + 1024), two gen phases and two context phases.
From the third generation onwards, where we'd have (4 + 1024), everything is the same as the other experiment.

So from your experiments one would expect the ramp up to be faster as the max_num_tokens gets higher. If you add many more samples I would expect this effect to become negligible though, which might explain why you don't see a difference.
The batch manager is not open source at the moment. The resources you mentioned are the ones that are available currently.

I initially thought that TensorRT-LLM prioritized prefills over decode, similar to vLLM. So I expected the schedule for a max token count of 2050 to look like this:

first iteration: prefill: 2024, decode: 0
subsequent iterations: prefill: 2024, decode: 2

But if TensorRT-LLM behaves as you explained, it makes sense that I didn’t observe a difference in my experiment.
Thanks for the clarification! I’ll run another experiment to validate my understanding.

Could see the evidence of mixed batching thx

@huijjj Could you please share how to calculate TPOT from the benchmark?

@huijjj Could you please share how to calculate TPOT from the benchmark?

@Jacob0226
The values are simply obtained from the output log of gptManagerBenchmark. It is refered as inter_token_ latency in the log though. However, it is basically the same thing as it is calculated as follows:
(end-to-end latency of request - TTFT of request) / (# of generated tokens of request -1)

authors: Jacob0226 dcampora huijjj


text:
Qwen2-1.5B-Instruct convert_checkpoint.py failed

System Info

CPU: x86_64
GPU: A10 (24G)

Who can help?
No response
Information

[x] The official example scripts
[ ] My own modified scripts

Tasks

[x] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
[ ] My own task or dataset (give details below)

Reproduction
I execute convert script in docker:

nvcr.io/nvidia/tritonserver:24.09-trtllm-python-py3

command:

python3 convert_checkpoint.py --model_dir <Qwen2-1.5B-Instruct_PATH> --output_dir   <Qwen2-1.5B-Instruct_PATH>/tllm --dtype float16

model file:

https://huggingface.co/Qwen/Qwen2-1.5B-Instruct

exception stack:
[10/29/2024-17:08:19] [TRT-LLM] [W] Found pynvml==11.5.3 and cuda driver version 470.182.03. Please use pynvml>=11.5.0 and cuda driver>=526 to get accurate memory usage.
[TensorRT-LLM] TensorRT-LLM version: 0.13.0
0.13.0
229it [00:02, 93.96it/s]
Traceback (most recent call last):
  File "/home/tensorrtllm_backend/tensorrt_llm/examples/qwen/convert_checkpoint.py", line 303, in <module>
    main()
  File "/home/tensorrtllm_backend/tensorrt_llm/examples/qwen/convert_checkpoint.py", line 295, in main
    convert_and_save_hf(args)
  File "/home/tensorrtllm_backend/tensorrt_llm/examples/qwen/convert_checkpoint.py", line 251, in convert_and_save_hf
    execute(args.workers, [convert_and_save_rank] * world_size, args)
  File "/home/tensorrtllm_backend/tensorrt_llm/examples/qwen/convert_checkpoint.py", line 258, in execute
    f(args, rank)
  File "/home/tensorrtllm_backend/tensorrt_llm/examples/qwen/convert_checkpoint.py", line 241, in convert_and_save_rank
    qwen = QWenForCausalLM.from_hugging_face(
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/models/qwen/model.py", line 427, in from_hugging_face
    loader.generate_tllm_weights(model)
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/models/model_weights_loader.py", line 357, in generate_tllm_weights
    self.load(tllm_key,
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/models/model_weights_loader.py", line 278, in load
    v = sub_module.postprocess(tllm_key, v, **postprocess_kwargs)
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/layers/linear.py", line 391, in postprocess
    weights = weights.to(str_dtype_to_torch(self.dtype))
AttributeError: 'NoneType' object has no attribute 'to'
Exception ignored in: <function PretrainedModel.__del__ at 0x7f778f992050>
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/models/modeling_utils.py", line 453, in __del__
    self.release()
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/models/modeling_utils.py", line 450, in release
    release_gc()
  File "/usr/local/lib/python3.10/dist-packages/tensorrt_llm/_utils.py", line 471, in release_gc
    torch.cuda.ipc_collect()
  File "/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py", line 901, in ipc_collect
    _lazy_init()
  File "/usr/local/lib/python3.10/dist-packages/torch/cuda/__init__.py", line 330, in _lazy_init
    raise DeferredCudaCallError(msg) from e
torch.cuda.DeferredCudaCallError: CUDA call failed lazily at initialization with error: 'NoneType' object is not iterable

Expected behavior
convert success
actual behavior
convert failed
additional notes
tensorRT-llm 0.13.0

Hi @1994 , you may try apply below hot fix for qwen2 1.5B model with latest code base.

@1994  do u still have further issue or question now? If not, we'll close it soon.


text:
Change exception text ensuring we mention GPU OOM

This changes the exception text for RetryOOM, SplitAndRetryOOM and Java's OutOfMemory exception to make sure we say that this is a GPU out of memory. They also remove the task language in Retry and SplitAndRetry because the plugin may not catch the exception at all, so a user may be the end consumer.

build

repo: NVIDIA/spark-rapids-jni


text:
[gcs-benchmark workflow] post ops enhancement

if previous run failed to create cluster, that one would be leave there as "ERROR" state

and then following run like https://github.com/NVIDIA/spark-rapids-ml/actions/runs/5971636373/attempts/2 would fail
ERROR: (gcloud.dataproc.jobs.submit.pyspark) FAILED_PRECONDITION: Multiple validation errors:
 - No agent on master node(s) reported to be be active
 - Unable to submit job, cluster 'runner-spark-rapids-ml-gpu' is in state ERROR and cannot accept jobs.

Some we should do

change cluster name to some dynamic one for CI usage
post-clean up cluster if error

For now if similar issue, we delete cluster runner-spark-rapids-ml-gpu manually to unblock following CI

repo: NVIDIA/spark-rapids-ml


text:
add deploy.sh script

This is intentionally minimalistic and is only lightly tested, since it's hard to test outside of the CI/CD environment.  It is assumed to be running inside the CI docker container (w/ required dependencies).

build

build


text:
Link some cuda libraries statically to be compatible different cuda environments

libcusolver.so has changed since cuda11.1, which means the jar built in cuda11.0 cannot run on cuda11.1 or later if we link this library dynamically. And vice versa so we need to provide both jar-cuda11.0 and jar-cuda11.1+.
To solve this problem, we can link related libraries statically.
This cannot go in until https://github.com/NVIDIA/spark-rapids-ml/pull/19 gets merged.
Signed-off-by: Allen Xu allxu@nvidia.com

Hi @NvTimLiu, after this PR, there's no need for 2 cuda classifier. We can build it only in cuda11.5.


text:
[BUG] cast can throw NPE

Describe the bug
When I try to run an user query on GPU, there is a NullPointerException.
java.lang.NullPointerException
at com.nvidia.spark.rapids.GpuCast.castStringToInts(GpuCast.scala:674)
at com.nvidia.spark.rapids.GpuCast.$anonfun$recursiveDoColumnar$39(GpuCast.scala:404)
at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
at com.nvidia.spark.rapids.GpuUnaryExpression.withResource(GpuExpressions.scala:156)

It happened in V21.06.0

From looking at the stack trace it appears that if we are casting one array to another and the input array has no data column in it (because all the values were null or because all of the arrays were empty), then we can get a null pointer exception.

repo: NVIDIA/spark-rapids


text:
[BUG] Test Parquet nested unsigned int: uint8, uint16, uint32 FAILED in spark 320+

Describe the bug
seems related to recent cudf parquet reader changes https://github.com/rapidsai/cudf/commits/branch-22.08
UT failed in spark 32X, and 33X. 31X skip this test by default https://github.com/NVIDIA/spark-rapids/blob/branch-22.08/tests/src/test/scala/com/nvidia/spark/rapids/ParquetScanSuite.scala#L162
cudf/cpp/src/table/table.cpp:42: Column size mismatch: 4 != 2 failed jni submodule targets to https://github.com/rapidsai/cudf/commit/406bce7efb808330e4d3b1c02c909582402f561e
11:20:39  - Test Parquet nested unsigned int: uint8, uint16, uint32 *** FAILED ***
11:20:39    org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 250.0 failed 1 times, most recent failure: Lost task 0.0 in stage 250.0 (TID 1124) (jdk11-nightly-jdk11-nightly-dev-gk0s9-w40x3 executor driver): ai.rapids.cudf.CudfException: cuDF failure at: /home/jenkins/agent/workspace/jenkins-spark-rapids-jni_nightly-dev-166-cuda11/thirdparty/cudf/cpp/src/table/table.cpp:42: Column size mismatch: 4 != 2
11:20:39  	at ai.rapids.cudf.Table.readParquet(Native Method)
11:20:39  	at ai.rapids.cudf.Table.readParquet(Table.java:1019)
11:20:39  	at com.nvidia.spark.rapids.MultiFileParquetPartitionReader.$anonfun$readBufferToTable$1(GpuParquetScan.scala:1805)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
11:20:39  	at com.nvidia.spark.rapids.FilePartitionReaderBase.withResource(GpuMultiFileReader.scala:254)
11:20:39  	at com.nvidia.spark.rapids.MultiFileParquetPartitionReader.readBufferToTable(GpuParquetScan.scala:1804)
11:20:39  	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readToTable$1(GpuMultiFileReader.scala:814)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
11:20:39  	at com.nvidia.spark.rapids.FilePartitionReaderBase.withResource(GpuMultiFileReader.scala:254)
11:20:39  	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.readToTable(GpuMultiFileReader.scala:810)
11:20:39  	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readBatch$1(GpuMultiFileReader.scala:784)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
11:20:39  	at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
11:20:39  	at com.nvidia.spark.rapids.FilePartitionReaderBase.withResource(GpuMultiFileReader.scala:254)
11:20:39  	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.readBatch(GpuMultiFileReader.scala:766)
11:20:39  	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.next(GpuMultiFileReader.scala:752)
11:20:39  	at com.nvidia.spark.rapids.PartitionIterator.hasNext(dataSourceUtil.scala:29)
11:20:39  	at com.nvidia.spark.rapids.MetricsBatchIterator.hasNext(dataSourceUtil.scala:46)
11:20:39  	at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:37)
11:20:39  	at org.apache.spark.sql.rapids.GpuFileSourceScanExec$$anon$1.hasNext(GpuFileSourceScanExec.scala:420)
11:20:39  	at org.apache.spark.sql.rapids.execution.GpuShuffleExchangeExecBase$$anon$1.partNextBatch(GpuShuffleExchangeExecBase.scala:287)
11:20:39  	at org.apache.spark.sql.rapids.execution.GpuShuffleExchangeExecBase$$anon$1.hasNext(GpuShuffleExchangeExecBase.scala:304)
11:20:39  	at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:140)
11:20:39  	at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
11:20:39  	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
11:20:39  	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
11:20:39  	at org.apache.spark.scheduler.Task.run(Task.scala:131)
11:20:39  	at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:506)
11:20:39  	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1462)
11:20:39  	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:509)
11:20:39  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
11:20:39  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
11:20:39  	at java.base/java.lang.Thread.run(Thread.java:829)
11:20:39
11:20:39  Driver stacktrace:
11:20:39    at org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages(DAGScheduler.scala:2403)
11:20:39    at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2(DAGScheduler.scala:2352)
11:20:39    at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2$adapted(DAGScheduler.scala:2351)
11:20:39    at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
11:20:39    at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
11:20:39    at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
11:20:39    at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:2351)
11:20:39    at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1(DAGScheduler.scala:1109)
11:20:39    at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1$adapted(DAGScheduler.scala:1109)
11:20:39    at scala.Option.foreach(Option.scala:407)
11:20:39    ...
11:20:39    Cause: ai.rapids.cudf.CudfException: cuDF failure at: /home/jenkins/agent/workspace/jenkins-spark-rapids-jni_nightly-dev-166-cuda11/thirdparty/cudf/cpp/src/table/table.cpp:42: Column size mismatch: 4 != 2
11:20:39    at ai.rapids.cudf.Table.readParquet(Native Method)
11:20:39    at ai.rapids.cudf.Table.readParquet(Table.java:1019)
11:20:39    at com.nvidia.spark.rapids.MultiFileParquetPartitionReader.$anonfun$readBufferToTable$1(GpuParquetScan.scala:1805)
11:20:39    at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
11:20:39    at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
11:20:39    at com.nvidia.spark.rapids.FilePartitionReaderBase.withResource(GpuMultiFileReader.scala:254)
11:20:39    at com.nvidia.spark.rapids.MultiFileParquetPartitionReader.readBufferToTable(GpuParquetScan.scala:1804)
11:20:39    at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readToTable$1(GpuMultiFileReader.scala:814)
11:20:39    at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
11:20:39    at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
11:20:39    ...

Steps/Code to reproduce bug
mvn clean test -Dbuildver=320 -DwildcardSuites=com.nvidia.spark.rapids.ParquetScanSuite

cc @res-life to help investigate

It's related to cuDF change, see comment:  https://github.com/rapidsai/cudf/pull/11252#issuecomment-1192428770

Bug identified. Fix being tested.

@res-life After looking at this a bit, there's something very odd with this file.  It appears to be partially malformed.  Basically:

The pages for several non-nested columns say they contain 4 values, which corresponds to 4 rows.
There is only 1 row group in the file containing 2 rows.   Because of this, there is no legitimate reason for any non-list pages to contain more than 2 values.

How was this file created?   @jlowe  says that Spark can't produce parquet files containing unsigned types.  Was this file created via the gpu writer in cudf by any chance?   I'd like to determine if this is something that can actually happen in the wild, or if we're just dealing with a singular bogus file.

Fixed with:
https://github.com/rapidsai/cudf/pull/11353

authors: nvdbaranec pxLi res-life


text:
QualificationTool. Add speedup information to AppSummaryInfo

Signed-off-by: Ahmed Hussein (amahussein) a@ahussein.me
fixes #5449
Splitting the scope of #5176 and the pending PR #5407

The changes are small. However, the total files affected by the change increased because of the CSV file expectations.

Adds the following fields to QualificationSummaryInfo
    longestSqlDuration: Long,
    nonSqlTaskDurationAndOverhead: Long,
    estimatedDuration: Double,
    unsupportedDuration: Long,
    speedupDuration: Long,
    speedupFactor: Double,
    totalSpeedup: Double,
    speedupBucket: String

Moved gpuMode and jobIdToInfo to AppBase because it is common between Qualification and Profiling tool

Moved some common code to EventProcessorBase

Added the new fileds to the CSV schema of QualificationSuite and updated all the expectations. Note that those values are generated as a stub and not accurate.

Updated QualOutputWriter to dump the new fields and the Recommendation to the summary

Added UI flag to the arguments. It is false by default and enabling it has no effect until the static code generation gets merged.

build

authors: amahussein tgravescs


text:
Remove unnecessary -m argument from linker invocations

And a few other clean ups.

Thanks Timm!
Would you mind signing your git commits please? As per CONTRIBUTING.md, use git commit -s or manually add "Signed-off-by: $user.name <$user.email>" to the commits. Also if its not too much trouble, add a line to the changelog.

This doesn't really fit my usual git workflow, let me try again.

authors: kmittman tbaederr

repo: NVIDIA/yum-packaging-precompiled-kmod


text:
Obs submission not working

It keeps spinning on submission page with Cancel submission button and spinny wheel. If I navigate away from that tab and come back to it later, the state doesnt seem to change.  (I can also edit fields in the submission which I probably shouldn't be able to do?)
if I click the back button next to "submit observation" header at the top of page that takes me back to the main obs screen and if I go to submit a new obs my previous one appears to have been lost.

You get no toasts showing up, right?

correct, no other screens just the spinning symbol on the cancel button

(I can also edit fields in the submission which I probably shouldn't be able to do?)
I created #428 to track this separately

The bad submission behavior should be fixed in #424 . I suspect the base issue here was that we weren't supplying the new obs_source param which became required.

authors: floatplane stevekuznetsov yuliadub

repo: NWACus/avy


text:
Pluto zoning tweaks

A couple things were discovered in #972 for ztl that are the same for pluto

Bug in special districts - sorting wrong order. This changes about 60 lots - outside of the lots that have their ordering manually set for the specific combo of special districts, there are luckily very few that are in multiple
Use grouping logic in commercial overlay just like we do for zoning districts. This ends up only affecting a few rows as well

Running build here to compare to nightly_qa. Differences are

40 sp dist flips (expected). I need to confirm with GIS about these (and ordering in ztl)
12 commercial dist changes (expected) - due to grouping by commercial overlay (so if there are two smaller C-2 overlays, that's captured)
1 splitzone change (due to a commercial overlay change)
25 lottype changes - unexpected. See #1012

Got go-ahead from GIS on these changes

No, I used Pluto's QA queries. So

checking total row counts
checking total number of changes per column (changes identified by bbl)
investigating changed rows for rows with changes in columns found above (1 column at a time)

merge?

Going over one more time with Casey today (who was out previously), so figured I'd hold off. Will get this merged as-is or with tweaks today!

authors: fvankrieken sf-dcp

repo: NYCPlanning/data-engineering


text:
Move facets from query context to filter context

For user-entered strings we should use query context. For facets selected from menus, we should use filter context.
Related to issue in discovery-front-end

Current query body for faceted keyword search looks something like this:
query: {
    query_string: {
      default_field: 'title',
      query: 'france subject:"France Description and travel."',
      default_operator: 'AND',
      sort: ['_score']
    }
}

Should become something like this:
query: {
    bool: {
        must: [
            {
                query_string: {
                    default_field: 'title',
                    query: 'france',
                    default_operator: 'AND',
                    sort: ['_score']
                }
            }
        ],
        filter: [
            { term: { 'subject': 'France Description and travel.' } }
        ]
    }
}

@nonword - does this make sense?

yeah that looks right

authors: beefoo nonword

repo: NYPL-discovery/discovery-api


text:
This creepy color needs to be fixed!

Make the teeth white, please. It's weird...

Fixed.

license: WTFPL


text:
feat:versionコマンドのCommit情報追加

Commit情報の取得方法変更
hashとmessageも取得する
embedのfields追加
commit messageを出力する為

ミスった...🙇♂

[memo]
本PR上でのCommitでhttps://github.com/NamagomiNetwork/Namagomi-bot/pull/55/commits/b01b2bf4cc16b1a8eb4a973d750245c3ac0a99ac はrevertし、
別PR（formatteかけるだけ）に切り出しを行う

@ikazuchizero ,@yuuki1293
Review指摘お願いしまーす

@yuuki1293 再確認おなしゃす

イメージも一応貼っとく

BLT

@ikazuchizero
適当な時にMergeしといてください～

repo: NamagomiNetwork/Namagomi-bot


text:
hyprland?

Just wondering if you've been using hyprland. How's stability been? 0.1.0beta just came out

Hey, thanks for the question!
I don't use it right now as it's taking me some time to setup, but I've tested it and it was working quite nicely
I would say that it's probably not as stable as i3 or sway, but it's getting there, give it a try if you have some time! it's really comfy ;)

authors: Narice dmadisetti

repo: Narice/nixos-system


text:
improve build script for any platforms

Target Platforms

[x] macOS
[x] iOS
[x] Android
[x] Windows
[x] Linux

reference

OpenCV

https://github.com/opencv/opencv

use cmake.


text:
[BUG]

Which Glance version and IDEA version?
1.5.7 Rider 2022.3

Could you show Glance config picture and minimap picture?

What steps will reproduce the issue?
Throws an error for line comment
//MARK: - tag1
Works ok for block comment
/*MARK: - tag2
*/

ok,will be fixed tomorrow

try this
CodeGlance Pro-1.5.8-SNAPSHOT.zip

it worked, thanks!

authors: Nasller clearskystudio

repo: Nasller/CodeGlancePro


text:
Make the user know that their image has been uploaded ✅

The aim of the crowdsourcer is to send images to Pyronear in order to improve their early wildfire detection algorithm.
When the user clicks on the "Send" button, the image should be sent to a Pyronear bucket.
Once the image is sent, the user should know that the image has been uploaded. We could :

make a new page that says "Nice ! You're done ! Thanks for helping us protecting our forests 🤗"
make a component popping ahead of the page and saying "Nice ! You're done ! Thanks for helping us protecting our forests 🤗"

repo: Nastaliss/pyro-crowd


text:
動畫沒跑完就檢測時間

這時會把露出來那一點棕色當作是字

什么版本 这个修过 https://github.com/NateScarlet/auto-derby/commit/0ed876e6b54c038e0d454cb6801730cc2b9fbb7d

那试试开发分支 最近的修改都是等这个界面的动画

好的，我再試試開發分支

改成不靠时间 出错最多重试10次 看行不行

authors: NateScarlet Small-Ku

repo: NateScarlet/auto-derby


text:
support alerts

This is a feature request rather than an issue.
What would it take to support alerts in this kind of panel?
It would be very handy to use grafana alerts in monitoring some equipment.
Thanks in advance :)

any news on this feature request?

authors: crvio watcherkb

repo: NatelEnergy/grafana-discrete-panel