text:
Schemas option not available

Description
Hi,
On my work computer I have the option to create a schema inside a database, however when I try to do this on dbeaver installed on my personal computer the option to create a new schema isn't available. Even the folder "Schemas" doesn't appear.
DBeaver Version
Community Edition 23.0.1
Operating System
Windows 11
Database and driver
Database: mysql
Steps to reproduce
No response
Additional context
No response

Hello @mjossany
Please check your connection settings. Choose custom or Advanced for you connection "without schemas".

There has been no update for a long time.
If the issue is still actual for you - feel free to reopen it with additional info.

authors: LonwoLonwo mjossany uslss


text:
Autocomplete stoped working with table alias after upgrade

Description
After upgrading Dbeaver to the latest version (24.1.5.202408181605), columns autocomplete stoped working when using alias.

It works perfectly fine when I don't use alias.

I have already enabled to "Use Global Searching" on database connection.

I even tried to downgrade dbeaver version, but the problem still goes on.
Any suggestions?
DBeaver Version
Community Edition 24.1.5.202408181605 (then, downgraded to 24.0.5)
Operating System
macOS Sonoma 14.5
Database and driver
PostgreSQL 16.1
Steps to reproduce
No response
Additional context
No response

Please remove empty lines between parts of query or change ‘Blank line is statement’ elimiter setting from ‘Always’ to ‘Smart’.

That worked fine, Elizabeth! Thanks so much for helping!

source: gharchive/issue

repo: dbeaver/dbeaver

license_type: permissive

license_source: github-api


text:
New version 24.2.3 has a bug, copy as SQL '' not Escaping.

Description
When I used the latest version of SQL replication, I found data anomalies after execution. The reason is that there is a JSON field containing the character '\', but the copied SQL did not escape it, which caused my JSON to report an error.
DBeaver Version
Community Edition 24.2.3
Operating System
Windows 11
Database and driver
Mysql
Steps to reproduce

connect mysql
query something
copy as SQL

Additional context
No response

of course.
Firstly, create a table and insert a piece of data
CREATE TABLE IF NOT EXISTS `test` (
  `id` bigint(20) unsigned NOT NULL COMMENT 'ID',
  `json_txt` varchar(64) NOT NULL COMMENT 'json'
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COMMENT='test';
insert into test(`id`, `json_txt`) values(1, 'This is a paragraph \\n containing line breaks');

you can get a error sql.
INSERT INTO test (id,json_txt) VALUES
  (1,'This is a paragraph \n containing line breaks');

hi @vv-ziwen , could you provide data sample to reproduce the issue? thanks in advance

cc

thanks for the report

authors: uslss vv-ziwen


text:
PostGIS: Single point isn't shown on Value panel

System information:

Operating system (distribution) and version win 10x64
DBeaver version 6.1.4 EA

Connection specification:

Database name and version PostgreSQL 10

Describe the problem you're observing:
If I choose only one geometry point from the table it will not be shown on Value panel. Please, see behavior on the attached gif

verified


text:
PostgreSQL at version 12 not support column hasoids in pg_catalog.pg_class

Dbeaver 7.1.4
PostgreSQL 12
https://postgresql.verite.pro/blog/2019/04/24/oid-column.html
Can't get column 'relhasoids': The column name relhasoids was not found in this ResultSet.

Using checkbox "hasoids" in Table Properties results in an error.
Need to remove the reading of this column for version 12

checkbox "hasoids" in table editor removed for Postgres version >= 12

verified

authors: LonwoLonwo uslss


text:
-N parameter lead to crash

I found that if I use -N parameter for parallel run, results are much much more different compared to that without -N parameter, and most are crash.

Can you give more detail, please.
What component does crash?
Which tool do you execute? Which limitations? Which benchmark?
Does your tool itself depend on being executed as a single instance?
Does your tool produce any output with a hard-coded filename (and thus multiple instances write to the same file?

My tool's name is ceagle_absref，I only set time limit with -T 90 for testing on bitvector, float and recursive set. My tool produce output with input name as prefix. What do you mean by being exectuted as single instance？

There are some tools, that can only be executed as "single instance", because one of the following points is valid:

The tool (or some of its sub-processes) writes into temporary files with equal names. Either overridden or deleted content might cause a crash. This is the reason for most tools.
The tool requires a special port (network), which can be used to communicate. A second instance of the tool might crash, because the port is blocked by the first instance.
The tool contains some evil kill-method like "killall xyz", where "xyz" is a sub-process of the tool. A second instance also kills the first instance.

Can you provide a stack-trace or a error-message?

I figure out the problem is that one component of my tool writing by my coauthor write a hard coding temp file...

authors: cgcgbcbc kfriedberger

repo: dbeyer/benchexec

license_source: bigquery


text:
[CT-2961] Add flag to inform partial parsing to skip file diff computation

In cloud environments, computing the file diff prior to partial parsing may be a costly operation. Provide a flag to skip computing a file diff that can be used to speed up parsing if the execution environment knows that no files have changed between dbt invocations.

Let's hide the flag from the CLI --help text, since I think it will be confusing clutter for 99% of end users. Same as we did for #7911

repo: dbt-labs/dbt-core


text:
New structure test

This is a:

[ ] bug fix PR with no breaking changes
[x] new functionality

Description & motivation

Changed fct_staging_directories to fct_model_directories and created new fct_source_directories
Integration Test Screenshot

Checklist

[ ] I have verified that these changes work locally on the following warehouses (Note: it's okay if you do not have access to all warehouses, this helps us understand what has been covered)

[ ] BigQuery
[ ] Postgres
[ ] Redshift
[x] Snowflake

[x] I have updated the README.md (if applicable)
[x] I have added tests & descriptions to my models (and macros if applicable)
[ ] I have added an entry to CHANGELOG.md

Would love feedback on the logic for this! Not sure if there's an easier way to accomplish the same thing (especially because we are doing a lot of similar calculations in int_all_dag_resources.

As discussed in package sync - moved the logic for directory-related fields into int_all_graph_resources.

I just noticed we use subfolder and subdirectory rather interchangeably. Should we standardize on one?

source: gharchive/pull-request

repo: dbt-labs/dbt-project-evaluator


text:
convert unix timestamp

this works for redshift:
{% macro convert_unix_timesetamp(field_name) -%}
timestamp 'epoch' + {{field_name}} * interval '1 second'
{%- endmacro %}

would be great to have a cross-database compatible version.

Above micro will not work in redshift. this worked for me:
{% macro convert_unix_timestamp(field_name) -%}
timestamp 'epoch' + {{field_name}}/1000 * interval '1 second'
{%- endmacro %}

i think you can use this query directly to get the desired results
:
select
*,
timestamp 'epoch' + unixdate::INT * INTERVAL '1 second' as test
from {{ source("yourmodel","table_name")}}

authors: Kalidaas23 devrang jthandy

repo: dbt-labs/dbt-utils


text:
update docs redirects

What are you changing in this pull request and why?
Asana
https://app.asana.com/0/1200099998847559/1204356742185160/f
Fix redirect chains and loops
You can see all of the changes here:
https://github.com/dbt-labs/docs.getdbt.com/pull/3271/commits/a63f819dd80bf611da49df77c8fdf9ff4a7e366c

Hi @zesuma!
I don't know if Emily called this out in their spreadsheet, but in Jason's PR, I noted there might be a redirect chain in this file:
https://github.com/dbt-labs/docs.getdbt.com/pull/3284#issuecomment-1525791335
Can you take a look at that?
Also note that Jason's PR is going to be merged first, so you will need to deal with any merge conflicts or changes from moving the location of the redirects file.

Hi @zesuma!
I don't know if Emily called this out in their spreadsheet, but in Jason's PR, I noted there might be a redirect chain in this file: #3284 (comment)
Can you take a look at that?
Also note that Jason's PR is going to be merged first, so you will need to deal with any merge conflicts or changes from moving the location of the redirects file.

Hi @lfracalossiFA  responding to: https://deploy-preview-3284--docs-getdbt-com.netlify.app/guides/getting-started/building-your-first-project
if you search for "/guides/getting-started/building-your-first-project" in the _redirects file, it appears both as the source and destination of a few different redirects. Might want to check and see if we can remove a step there.
Here are all of the source/redirects i found in _redirects for this url...:
/guides/getting-started/building-your-first-project      /docs/get-started/getting-started/building-your-first-project/build-your-first-models 301
/tutorial/building-your-first-project/*      /guides/getting-started/building-your-first-project/:splat 301
/guides/getting-started/building-your-first-project/build-your-first-models      /docs/get-started/getting-started/building-your-first-project/build-your-first-models 301
/guides/getting-started/building-your-first-project/schedule-a-job      /docs/get-started/getting-started/building-your-first-project/schedule-a-job 301
/guides/getting-started/building-your-first-project/test-and-document-your-project      /docs/get-started/getting-started/building-your-first-project/test-and-document-your-project 301
/tutorial/test-and-document-your-project       /guides/getting-started/building-your-first-project/test-and-document-your-project 301
/tutorial/build-your-first-models      /guides/getting-started/building-your-first-project/build-your-first-models 301
/tutorial/deploy-your-project      /guides/getting-started/building-your-first-project/schedule-a-job 301
Looks like the first one is the only one with that exact url so I think we should be good on this?

authors: lfracalossiFA zesuma


text:
fix #50

The fix is 7d747bc51deca90eb4442f7ae43b81ebaddc04c2, then there is an additional small fix at fed5329664f2a41da2e59991246fcc2dceffc566, and a refactor to make the thing more understandable. You can skip the refactor if you want.
This is the current fix I'm using and it seems to work, tests pass, but that's it. Not sure if it covers all corner cases.

I did some testing and it indeed seems to fix the issue you reported. Thanks for sending the fix! And also thanks for making the code more readable.

Thanks. I have some more fixes in my own fork if you're interested (maybe you don't care about the extra features I added there but you can take a look, they're documented in the help file).
Some more fixes would be:
50b1bc1ce5f2284e6b9d4b49670b106f3c9be6fc: eval result could be userdata and would throw an error)
2d77d89f05dfacb496332c7da155e6ddbf37b373: wordbound expansion doesn't work correctly, for example (pf<tab> could not expand pf in your current master
ced6c0471de6679fbaa4c270a4256fa6147badb1: better directory & runtimepath detection, also with support for project-local snippets (fixes #4)

And also:

lua/snippy/mapping.lua: so that keys can be mapped to functions

Thanks. I have some more fixes in my own fork if you're interested (maybe you don't care about the extra features I added there but you can take a look, they're documented in the help file).
Some more fixes would be:
50b1bc1: eval result could be userdata and would throw an error

Looks good. Please send it if you can.

2d77d89: wordbound expansion doesn't work correctly, for example (pf<tab> could not expand pf in your current master. Note that I removed autotrigger in my fork so there will be conflicts.

I get what you mean. Current word-based expansion is overtly simplistic and doesn't seem to conform to Ultisnips' behavior either. I open an issue about it and take your changes into consideration.

ced6c04: better directory & runtimepath detection, also with support for project-local snippets (fixes #4)

Seems a bit complicated but I do recognize its value. I will have to think about it.

And also:  lua/snippy/mapping.lua: so that keys can be mapped to functions (example here)

Not allowing functions as RHS values was a design choice, actually. Now with vim.keymap.set() I think it's even less necessary to have a mapping utility in a snippet manager, but that's my opinion, of course.

c4b1318: auto-reload snippets

For me it already auto-reloads. Could you explain in what way it works differently than the line below?
https://github.com/dcampos/nvim-snippy/blob/9ccb48a8c89e8053ff97f6617123a35f94bf2ca4/lua/snippy.lua#L533

For me it already auto-reloads. Could you explain in what way it works differently than the line below?

You're right, I didn't see it, I was looking for it in ftdetect file.

Not allowing functions as RHS values was a design choice, actually. Now with vim.keymap.set() I think it's even less necessary to have a mapping utility in a snippet manager, but that's my opinion, of course.

No problem then, even if I don't understand it as a design choice, it makes it much easier to integrate with completion plugins. vim.keymap.set() is nvim 0.7, not stable.

Seems a bit complicated but I do recognize its value. I will have to think about it.

I reworked it in the meanwhle. It's not complicated, it's essentially this. You really don't want manual management of snippets directories I think, like using priorities as someone suggested. There is just a single order that makes sense: plugins/packages, then user snippets, then snippets in after, then project snippets (I like them a lot, some pieces of code are specific to projects and repeated many times inside of it and nowhere else).

Not allowing functions as RHS values was a design choice, actually. Now with vim.keymap.set() I think it's even less necessary to have a mapping utility in a snippet manager, but that's my opinion, of course.

No problem then, even if I don't understand it as a design choice, it makes it much easier to integrate with completion plugins. vim.keymap.set() is nvim 0.7, not stable.

I thought vim.keymap was already in stable, my mistake. Regarding integration with completion managers, if you use nvim-cmp there's also a way to use cmp's setup to configure snippet mappings:
https://github.com/hrsh7th/nvim-cmp/wiki/Example-mappings#nvim-snippy

Seems a bit complicated but I do recognize its value. I will have to think about it.

I reworked it in the meanwhle. It's not complicated, it's essentially this. You really don't want manual management of snippets directories I think, like using priorities as someone suggested. There is just a single order that makes sense: plugins/packages, then user snippets, then snippets in after, then project snippets (I like them a lot, some pieces of code are specific to projects and repeated many times inside of it and nowhere else).

I see the point. For loading local snippets, you could also detect a directory change in your config and add the local snippets directory to snippet_dirs or add a local .vim to runtimepath (which is what I do personally).

repo: dcampos/nvim-snippy

license: MIT


text:
Attachment Count

I've added the ability to view the attachment count within the emails stored within the database.

Perhaps instead of editing this file, I would create a migration like 'update_sent_emails_table.php' where I would add this column, allowing those who already have the component installed to run it otherwise it would have no effect.

Yes, please add a new migration rather than editing the existing one.

authors: RichieMcMullen dcblogdev

repo: dcblogdev/laravel-sent-emails


text:
vue单页应用中跳转页面没有初始化上拉加载的方法？

mounted() {
const self = this;
mui.init({
pullRefresh: {
container: '#pullrefresh',
up: {
contentrefresh: '正在加载...',
callback: self.pullupRefresh
}
}
});
}
刷新之后可以了，离开之后又回到这个单页，又不行了？

单页应用是无刷新机制的，你在生命周期mounted中初始化下来刷新没有被触发，说明这个时候的mounted并没有被触发，你具体怎么跳转也不知道，你可以试试改变一下初始化上拉加载的策略

在mounted里调用:
mui('#pullRefresh').pullRefresh({
up: {
contentrefresh: '正在加载',
contentnomore: '没有更多',
callback: function() {
				}
			},
			down: {
				callback: function() {
					setTimeout(function() {
						window.location.reload()
					}, 1000)
				}
			}
		})

authors: laurensmartz nearwmy zhongxiaopang

repo: dcloudio/mui

license: mit


text:
function to return Message objects as JSON string?

Hi,
Is there a way to get a Message object content as a JSON string?
when doing console.log(), it outputs the object in JSON format in the console
when doing Message.Attribute, I can get the value of  Attributes
but I can't find a way to get the full JSON representation of the Message object.
Although close to it, the .toRaw() function does not provide pure JSON representation
Thanks,

JSON cannot represent bytes fields, so you need to decide how to represent these. The Message#toRaw function accepts two arguments for this: Message#toRaw(binaryAsBase64, longsAsStrings)
Try
var jsonString = JSON.stringify(myMessage.toRaw(true, true));

authors: carbip dcodeIO


text:
CheckboxInput followup: added hint text to toggle input

I asked the design team about this pattern:

They said clicking the hint text should not toggle the input. I made it possible to pass hintContent to an individual CheckboxInput, and automatically render the correct styling and functionality.
This might have been annoying to do manually in a consumer application, and prone to layout bugs if we changed the size of the toggle input.

The hint for CheckboxInput looks different than other hints (for example SelectInput) because of the bigger padding. Is this on purpose?

Good catch!
The top padding is actually the same (4px). The extra space appears to be caused by the line-height of the div that wraps the hint content.

@mperrotti , it is still the same for me.

Resolved conflicts.
@GeorgiSTodorov - the extra space between the text and the checkbox is caused by the height of the checkbox. Here are screenshots showing the hint text with a top border to illustrate:

@mperrotti , I think I meant the left padding of the text.

Ohhh. That's intentional to align with the text instead of the checkbox :)

Clicking on the invisible label triggers a click on the checkbox. Is this intentional?

Good catch on the invisible label. I'll fix that

authors: GeorgiSTodorov mperrotti

repo: dcos-labs/ui-kit


text:
DCOS-11754: Style badges inside buttons

This PR adds styling for .badge elements when nested inside buttons and dropdown list items.

run unit tests

Great stuff

authors: jfurrow mlunoe

repo: dcos/dcos-ui


text:
Adding missing property

A property was missing to be added to the ServiceConfigDisplay. This PR amends that.
Warning from console:
Warning: Failed propType: Required prop `onEditClick` was not specified in `ServiceConfigDisplay`. Check the render method of `ServiceConfiguration`.
warning @ warning.js?8a56:45
checkPropTypes @ ReactElementValidator.js?a599:189
validatePropTypes @ ReactElementValidator.js?a599:208
createElement @ ReactElementValidator.js?a599:242
render @ ServiceConfiguration.js?dc74:283
(anonymous) @ makeAssimilatePrototype.js?c7d8:15
_renderValidatedComponentWithoutOwnerOrContext @ ReactCompositeComponent.js?cd59:587
_renderValidatedComponent @ ReactCompositeComponent.js?cd59:607
ReactCompositeComponent__renderValidatedComponent @ ReactPerf.js?ef93:66
_updateRenderedComponent @ ReactCompositeComponent.js?cd59:560
_performComponentUpdate @ ReactCompositeComponent.js?cd59:544
updateComponent @ ReactCompositeComponent.js?cd59:473
ReactCompositeComponent_updateComponent @ ReactPerf.js?ef93:66
performUpdateIfNecessary @ ReactCompositeComponent.js?cd59:421
performUpdateIfNecessary @ ReactReconciler.js?6bfa:102
runBatchedUpdates @ ReactUpdates.js?ce09:129
perform @ Transaction.js?6dff:136
perform @ Transaction.js?6dff:136
perform @ ReactUpdates.js?ce09:86
flushBatchedUpdates @ ReactUpdates.js?ce09:147
ReactUpdates_flushBatchedUpdates @ ReactPerf.js?ef93:66
closeAll @ Transaction.js?6dff:202
perform @ Transaction.js?6dff:149
batchedUpdates @ ReactDefaultBatchingStrategy.js?ef70:62
enqueueUpdate @ ReactUpdates.js?ce09:176
enqueueUpdate @ ReactUpdateQueue.js?fd2c:24
enqueueForceUpdate @ ReactUpdateQueue.js?fd2c:143
ReactComponent.forceUpdate @ ReactComponent.js?702a:86
store_onStoreChange @ StoreMixin.js?a69d:181
EventEmitter.emit @ events.js?7c71:92

Checklist

[ ] Did you add a JIRA issue in a commit message or as part of the branch name?
[ ] Did you add new unit tests?
[ ] Did you add new integration tests?
[ ] If this is a regression, did you write a test to catch this in the future? Handled by prop-checking

:ship:


text:
Implement new breadcrumb based on job objects

This is work extracted from #3016 to ship small chunks. It is needed to unblock the job overview PR, not as part of this work, but preparing this.
Checklist

[X] Did you add a JIRA issue in a commit message or as part of the branch name?
[X] Did you add new unit tests?
[ ] Did you add new integration tests?
[ ] If this is a regression, did you write a test to catch this in the future?

@juliangieseke @nLight updated accordingly 👍

@nLight @juliangieseke I updated this PR and added a JIRA


text:
chore(deps): update node.js to v10.20.1

This PR contains the following updates:

Package
Type
Update
Change

node
devDependencies
minor
10.19.0 -> 10.20.1

Release Notes

nodejs/node
v10.20.1
Compare Source
Notable changes
Due to release process failures, Node.js v10.20.0 shipped with source
and header tarballs that did not properly match the final release
commit that was used to build the binaries. We recommend that Node.js
v10.20.0 not be used, particularly in any applications using native
add-ons or where compiling Node.js from source is involved.
Node.js v10.20.1 is a clean release with the correct sources and is
strongly recommended in place of v10.20.0.
v10.20.0
Compare Source
macOS package notarization and a change in builder configuration
The macOS binaries for this release, and future 10.x releases, are now
being compiled on macOS 10.15 (Catalina) with Xcode 11 to support
package notarization, a requirement for installing .pkg files on macOS
10.15 and later. Previous builds of Node.js 10.x were compiled on macOS
10.10 (Yosemite) with a minimum deployment target of macOS 10.7 (Lion).
As binaries are still being compiled to support a minimum of macOS 10.7
(Lion) we do not anticipate this having a negative impact on Node.js
10.x users with older versions of macOS.
Notable changes

buffer: add {read|write}Big[U]Int64{BE|LE} methods (garygsc) #19691
build: macOS package notarization (Rod Vagg) #31459
deps:

update npm to 6.14.3 (Myles Borins) #32368
upgrade openssl sources to 1.1.1e (Hassaan Pasha) #32328
upgrade to libuv 1.34.2 (cjihrig) #31477

n-api:

add napi_get_all_property_names (himself65) #30006
add APIs for per-instance state management (Gabriel Schulhof) #28682
define release 6 #32058
turn NAPI_CALL_INTO_MODULE into a function (Anna Henningsen) #26128

tls:

expose keylog event on TLSSocket (Alba Mendez) #27654
support TLS min/max protocol defaults in CLI (Sam Roberts) #27946

url: handle quasi-WHATWG URLs in urlToOptions() (cjihrig) #26226

Commits

[64744a282e] - (SEMVER-MINOR) buffer: add {read|write}Big[U]Int64{BE|LE} methods (garygsc) #19691
[8a0ed8f1ff] - build: macOS package notarization (Rod Vagg) #31459
[42af3b861a] - build,win: fix goto exit in vcbuild (João Reis) #30931
[b164a2e3bf] - console: add trace-events for time and count (James M Snell) #23703
[04cd67f85e] - deps: upgrade npm to 6.14.4 (Ruy Adorno) #32495
[8d85a43d99] - deps: update term-size with signed version (Rod Vagg) #31459
[76033c5495] - deps: update archs files for OpenSSL-1.1.1e (Hassaan Pasha) #32328
[64c184836b] - deps: adjust openssl configuration for 1.1.1e (Hassaan Pasha) #32328
[c8f5ab2089] - deps: upgrade openssl sources to 1.1.1e (Hassaan Pasha) #32328
[bf26c44c92] - deps: remove *.pyc files from deps/npm (Ben Noordhuis) #32387
[c2b3cf61ce] - deps: update npm to 6.14.3 (Myles Borins) #32368
[8cae4dde91] - deps: upgrade npm to 6.14.1 (Isaac Z. Schlueter) #31977
[47046aa5a9] - deps: openssl: cherry-pick 4dcb150 (Adam Majer) #32002
[098704c85d] - deps: upgrade to libuv 1.34.2 (Colin Ihrig) #31477
[4b1cccc4ce] - deps: upgrade to libuv 1.34.1 (Colin Ihrig) #31332
[fff6162693] - (SEMVER-MINOR) deps: upgrade to libuv 1.34.0 (Colin Ihrig) #30783
[6826ef0568] - deps: upgrade to libuv 1.33.1 (Colin Ihrig) #29996
[aed7ca4fb0] - deps: upgrade to libuv 1.32.0 (Colin Ihrig) #29508
[794abbc758] - deps: upgrade to libuv 1.31.0 (Colin Ihrig) #29070
[ed71f55a54] - deps: upgrade to libuv 1.30.1 (Colin Ihrig) #28511
[7cde563235] - deps: upgrade to libuv 1.30.0 (Colin Ihrig) #28449
[b53ce6e6c5] - deps: upgrade to libuv 1.29.1 (Colin Ihrig) #27718
[9b2b66b7d8] - deps: V8: cherry-pick d89f4ef (Milad Farazmand) #31753
[7eac95981e] - deps: upgrade npm to 6.13.7 (Michael Perrotte) #31558
[db24641fbe] - deps: upgrade npm to 6.13.6 (Ruy Adorno) #31304
[2e3d511cff] - doc: correct version metadata for Readable.from (Dave Vandyke) #32639
[34c1c2a82b] - doc: add missing version metadata for Readable.from (Anna Henningsen) #28695
[aa7d369c72] - doc: update releaser list in README.md (Myles Borins) #32577
[05f5b3ecc4] - doc: remove em dashes (Rich Trott) #32080
[ffa9f9bd1b] - doc: fix changelog for v10.18.1 (Andrew Hughes) #31358
[0177464b0e] - doc,tools: get altDocs versions from CHANGELOG.md (Richard Lau) #27661
[e9c590ea00] - (SEMVER-MINOR) n-api: define release 6 (Gabriel Schulhof) #32058
[239377b654] - (SEMVER-MINOR) n-api: correct instance data tests (Gabriel Schulhof) #32488
[ecbb331be0] - (SEMVER-MINOR) n-api: add napi_get_all_property_names (himself65) #30006
[f29fb14cf6] - (SEMVER-MINOR) n-api: add APIs for per-instance state management (Gabriel Schulhof) #28682
[20177b9946] - n-api: turn NAPI_CALL_INTO_MODULE into a function (Anna Henningsen) #26128
[017909b847] - test: fix tool path in test-doctool-versions.js (Richard Lau) #32645
[1ea70d641d] - test: fix flaky doctool and test (Rich Trott) #29979
[89692ff19b] - test: end tls connection with some data (Sam Roberts) #32328
[9bd1317764] - test: mark empty udp tests flaky on OS X (Sam Roberts) #31936
[5484e061b5] - test: scale keepalive timeouts for slow machines (Ben Noordhuis) #30834
[3f9cec3f51] - test: add debugging output to test-net-listen-after-destroy-stdin (Rich Trott) #31698
[f1a8791316] - test: allow EAI_FAIL in test-http-dns-error.js (Colin Ihrig) #27500
[4b9a77909b] - test: mark tests as flaky (João Reis) #30848
[a8fd8a1a61] - test: mark http2 tests as flaky on 10.x (AshCripps) #31887
[2315270cb6] - test: try to stabalize test-child-process-fork-exec-path.js (Refael Ackermann) #27277
[a2b0e9ef6a] - (SEMVER-MINOR) tls: expose keylog event on TLSSocket (Alba Mendez) #27654
[1cfb45732a] - (SEMVER-MINOR) tls: support TLS min/max protocol defaults in CLI (Sam Roberts) #27946
[a175b8d3a7] - tools: only fetch previous versions when necessary (Richard Lau) #32518
[3756be8511] - tools: add NODE_TEST_NO_INTERNET to the doc builder (Joyee Cheung) #31849
[ac1ea7312a] - tools: make doctool work if no internet available (Richard Lau) #30214
[f235eea8b3] - tools: unify make-v8.sh for ppc64le and s390x (Richard Lau) #31628
[61e2d4856d] - tools: use CC instead of CXX when pointing to gcc (Milad Farazmand) #30817
[4390674624] - url: handle quasi-WHATWG URLs in urlToOptions() (Colin Ihrig) #26226
[dc61e09feb] - v8: fix load elimination liveness checks (Ben Noordhuis) #31613

Renovate configuration
:date: Schedule: At any time (no schedule defined).
:vertical_traffic_light: Automerge: Disabled by config. Please merge this manually once you are satisfied.
:recycle: Rebasing: Whenever PR becomes conflicted, or if you modify the PR title to begin with "rebase!".
:no_bell: Ignore: Close this PR and you won't be reminded about this update again.

[ ] If you want to rebase/retry this PR, check this box

Available now for Enterprise: Renovate Pro with real-time webhook handling and priority job queue.

:tada: This PR is included in version 5.0.19 :tada:
The release is available on:

v5.0.19
GitHub release

Your semantic-release bot :package::rocket:

authors: mesosphere-ci mesosphere-renovate


text:
[master] Automated Bump DC/OS UI v2.40.10

High-level description
What features does this change enable? What bugs does this change fix?
Corresponding DC/OS tickets (obligatory)
These DC/OS JIRA ticket(s) must be updated (ideally closed) in the moment this PR lands:
DCOS-46279 DCOS-44814
Related tickets (optional)
Other tickets related to this change:
DCOS-46279 DCOS-44814
Checklist for all PRs

[ ] Added a comprehensible changelog entry to CHANGES.md or explain why this is not a user-facing change:
[ ] Included a test which will fail if code is reverted but test is not. If there is no test please explain here:
[ ] Read the DC/OS contributing guidelines
[ ] Followed relevant code rules Rules for Packages and Systemd

Checklist for component/package updates:
If you are changing components or packages in DC/OS (e.g. you are bumping the sha or ref of anything underneath packages), then in addition to the above please also include:

[ ] Change log from the last version integrated (this should be a link to commits for easy verification and review): example
[ ] Test Results: [link to CI job test results for component]
[ ] Code Coverage (if available): [link to code coverage report]

PLEASE FILL IN THE TEMPLATE ABOVE / DO NOT REMOVE ANY SECTIONS ABOVE THIS LINE
Instructions and review process
What is the review process and when will my changes land?
All PRs require 2 approvals using GitHub's pull request reviews.
Reviewers should be:

Developers who understand the code being modified.
Developers responsible for code that interacts with or depends on the code being modified.

It is best to proactively ask for 2 reviews by @mentioning the candidate reviewers in the PR comments area. The responsibility is on the developer submitting the PR to follow-up with reviewers and make sure a PR is reviewed in a timely manner. Once a PR has 2 ship-it's, no red reviews, and all tests are green it will be included in the next train.

@mesosphere-mergebot bump-ee

@mesosphere-mergebot label [Ready for Review]

repo: dcos/dcos


text:
🛑 Danbs is down

In 466dc7f, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 195 ms

Resolved: Danbs is back up in a72c740.

repo: ddanbs/upptime


text:
🛑 Danbs is down

In 803647e, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 159 ms

Resolved: Danbs is back up in 5bb33ff after 327 days, 15 hours, 46 minutes.


text:
🛑 Danbs is down

In 88221f0, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 3180 ms

Resolved: Danbs is back up in 794a53c after 328 days, 20 hours, 55 minutes.


text:
🛑 Danbs is down

In 7e9c0e2, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 173 ms

Resolved: Danbs is back up in beca335.


text:
🛑 Danbs is down

In 2f97edd, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 193 ms

Resolved: Danbs is back up in e710b6f after 6 minutes.


text:
🛑 Danbs is down

In c43ae5c, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 3601 ms

Resolved: Danbs is back up in 3c44011 after 15 minutes.


text:
🛑 Danbs is down

In 9a4615e, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 223 ms

Resolved: Danbs is back up in 3b04456.


text:
🛑 Danbs is down

In abfc376, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 222 ms

Resolved: Danbs is back up in cb050f8.


text:
🛑 Danbs is down

In e982109, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 131 ms

Resolved: Danbs is back up in 76e8736.


text:
🛑 Danbs is down

In 5e9686e, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 175 ms

Resolved: Danbs is back up in ba61928.


text:
🛑 Danbs is down

In 7f2c515, Danbs (https://danbs.net) was down:

HTTP code: 404
Response time: 3012 ms

Resolved: Danbs is back up in ef51d71.


text:
gocodeサブコマンド消せそう

gonewでテンプレプロジェクト作れるようにしたから、gocodeサブコマンド消してよさそう
readmeも合わせて掃除
https://github.com/ddddddO/gtree#library---programmable-tree-structure
や、cliのディスクリプションも

対応した

repo: ddddddO/gtree


text:
Update to GitHub API v3

Fixes https://github.com/ddollar/github-backup/issues/6
Highlights:

Uses octokit to provide v3 compatibility
Improves repository listing (can now get private org repos if authenticated)

Thank you!

authors: ddollar garethrees

repo: ddollar/github-backup


text:
questions

this is more or a question...  do we need any certain webserver for this?
and could we set it up to redirect after claiming to maybe play a game?

the faucet is a executable jar file with included tomcat server ... (will not work with kind of php webhosting)
to redirect after claim, the code has to be changed at https://github.com/de-luxe/burstcoin-faucet/blob/master/src/main/java/burstcoin/faucet/controller/FaucetController.java#L248
basically it redirects to itself with a message parameter currently.

thank you,  can i redirect to php hosted site tho?  sorry for my confusion...
normally upload files etc to a server lol

nope sry do not know a php faucet.
this faucet was made for burstcoin, so the same technology as the core wallet was used ... as a running wallet is needed to send coins anyway, i expected the faucet to be run on same server/environment.

nope sry do not know a php faucet.
this faucet was made for burstcoin, so the same technology as the core wallet was used ... as a running wallet is needed to send coins anyway, i expected the faucet to be run on same server/environment.

thanks so sorry for another question and if this is already posted some where im sorry and you can point me right direction but i should run this locally so that it takes from my wallet then?   do you have a install guide? i may have missed it

thanks so sorry for another question and if this is already posted some where im sorry and you can point me right direction but i should run this locally so that it takes from my wallet then?   do you have a install guide? i may have missed it

for running on localhost, you only need to specify wallet and pass of faucet account in faucet.properties https://github.com/de-luxe/burstcoin-faucet/blob/master/faucet.default.properties
for running on another domain you will need to get google recaptcha keys
just execute run.bat/exe or included command

for running on localhost, you only need to specify wallet and pass of faucet account in faucet.properties https://github.com/de-luxe/burstcoin-faucet/blob/master/faucet.default.properties
for running on another domain you will need to get google recaptcha keys
just execute run.bat/exe or included command

authors: de-luxe dynamitemedia

repo: de-luxe/burstcoin-faucet


text:
The default certificate length is too small

When trying to run npm run start-dev it complains about SSL, that the length is too small

I just instead edit their code to use localhost, check the commit history
[https://github.com/deadlyjack/acode-plugin/pull/39]

repo: deadlyjack/acode-plugin


text:
Sign in with Google temporarily disabled for this app

Date: Feb 8, 2020
Browser: Chrome
I downloaded the Alfred workflow and tried to set up the workflow but I was greeted with following error messages:
Sign in with Google temporarily disabled for this app
This app has not been verified yet by Google in order to use Google Sign In.
Is this workflow retired or if it working, how to circumvent the error?
Thanks for this awesome workflow, hope there are some workarounds.

#33
#48
#51

authors: bhishanpdl deanishe

repo: deanishe/alfred-gcal


text:
Update flyway-core to 9.14.1

Updates org.flywaydb:flyway-core from 9.1.6 to 9.14.1.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.flywaydb", artifactId = "flyway-core" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.flywaydb", artifactId = "flyway-core" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:1

Superseded by #155.


text:
[ci] improving integration tests (back-port)

Improving integration tests. This PR should adress the flowing JIRAs:

DBZ-7539
DBZ-7540
DBZ-7542
DBZ-7543
DBZ-7556

There seems to be a problem with the caching of the build-core results between branches? Here 2.6 branch builds fail with incompatible type compilaton errors. In Migrationsverket repo, main branch fails and 2.6 pass...

repo: debezium/debezium-connector-informix


text:
eth.hyperverse.dev

another path that shows to go to eth.hyperverse.dev and what that entails (UI creating a tenant, cloning a blank template, storybook, etc.)

I need to fix the panel

Left as is. INFO box leads to the other page to show Ethereum UI and the panels lead to sections for create-next-app and using monorepo within the same page.

authors: ShainDholakiya joenyzio

repo: decentology/hyperverse-docs


text:
chore: define base node engine support to v12

This is necessary because node.js <V12 doesn't support usage of globalThis and throws an error. If someone wished to use this library with a version of node below V12 they'd need to remove support for globalThis.

@csuwildcat anyone on your team that can help review this?

Sorry, will take a look today

authors: csuwildcat kdenhartog

repo: decentralized-identity/ion-tools


text:
latest universalregistrar/uni-registrar-web not working

Caused by:

java.lang.ClassNotFoundException: foundation.identity.did.DIDDocument
	at org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy.loadClass(SelfFirstStrategy.java:50)
	at org.codehaus.plexus.classworlds.realm.ClassRealm.unsynchronizedLoadClass(ClassRealm.java:271)
	at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:247)
	at org.codehaus.plexus.classworlds.realm.ClassRealm.loadClass(ClassRealm.java:239)
	at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:555)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)

@peacekeeper

@fqutishat we had to make some breaking changes in the did-common-java library to better align with JSON-LD and the latest developments in the DID Core spec (e.g. publicKey has been renamed to verificationMethod). If you first rebuild did-common-java and then universal-registrar, I think it should work?
@BernhardFuchs is now creating release versions of various components to reduce the use of SNAPSHOT dependencies to avoid such problems in the future.
Sorry that this is causing troubles for you.. Let us know (here or in the DIF Slack) if you still have problems or other questions...

@fqutishat are you still having problems, or can we close this issue?

authors: fqutishat peacekeeper


text:
Sending Decred page needs margin fix

The margins on the top of the Sending Decred page don't match the margins on the other pages, the text is too close to the edge. The fonts in the lower part of the page (Fee, Estimated Size, Balance After) also seem overly large, but seem to have proper margins.

I can't reproduce the error described.

Closed in #391

authors: C-ollins beatljuice crux25

repo: decred/dcrandroid

license: ISC


text:
please upgrade it

Please upgrade these launcher,it is more comfortable

this repo seems to be abandoned.

repo: dedepete/FreeLauncher


text:
Add instructions for source install on M1 Mac

Adds instructions for installing from source on M1 Mac since default system Python is built for both Arm64 and x86_64 and that Anaconda does not have Arm64 compatible Python versions

Since Anaconda now supports M1, making virtual environments and working with Arm64 Python is much easier. Only a few notes were required and merged in #202

repo: deepanshs/mrsimulator


text:
No such file or directory: 'data/DeepBD/features'

Hello there,
Thanks a lot for providing such a nice tool to use. I am writing to inquire an error encountered when running this tool. Here is the error message I received:
 python3 src/deepbindiff.py --input1 experiment_data/coreutils/binaries/coreutils-7.6-O0/ls --input2 experiment_data/coreutils/binaries/coreutils-7.6-O3/ls --outputDir output/
....
....
Initialized
Average loss at step  0 :  134.17404174804688
Average loss at step  2000 :  5.122461198568344
Average loss at step  4000 :  3.3189247410297393
Average loss at step  6000 :  3.2604737248420714
Traceback (most recent call last):
  File "src/deepbindiff.py", line 230, in <module>
    main()
  File "src/deepbindiff.py", line 223, in main
    copyEverythingOver(outputDir, 'data/DeepBD/')
  File "src/deepbindiff.py", line 172, in copyEverythingOver
    copyfile(src_dir + node_features, dst_dir + node_features)
  File "/usr/lib/python3.6/shutil.py", line 121, in copyfile
    with open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: 'data/DeepBD/features'

Can anyone shed some lights on this? Thank you very much!

Hi, I believe this is due to the hard-code path 'data/DeepDB/' missing. Had to admit my code is a bit messy. Could you please create the directory 'data/DeepDB' and try again?

@yueduan thank you for your prompt reply. I make the directory data/DeepDB but still, the same error occurs:
Average loss at step  6000 :  3.260503334522247
Traceback (most recent call last):
  File "src/deepbindiff.py", line 230, in <module>
    main()
  File "src/deepbindiff.py", line 223, in main
    copyEverythingOver(outputDir, 'data/DeepBD/')
  File "src/deepbindiff.py", line 172, in copyEverythingOver
    copyfile(src_dir + node_features, dst_dir + node_features)
  File "/usr/lib/python3.6/shutil.py", line 121, in copyfile
    with open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: 'data/DeepBD/features'

Hi, Could you please make sure there exists a file 'features' in your --outputDir? Ln.221 in deepbindiff.py is supposed to generate 'features' file. And then the 'copyEverythingOver' function can copy it into another 'data/DeepDB' directory.

Hello,
Indeed, I do find a features in the output dir:
➜  DeepBinDiff git:(master) ✗ python3 src/deepbindiff.py --input1 experiment_data/coreutils/binaries/coreutils-7.6-O0/ls --input2 experiment_data/coreutils/binaries/coreutils-7.6-O3/ls --outputDir output/
➜  DeepBinDiff git:(master) ✗ ls output
data  edgelist  edgelist_merged_tadw  features  nodeIndexToCode

And I have also created an empty features as the output:
➜  DeepBinDiff git:(master) ✗ touch data/DeepDB/features
➜  DeepBinDiff git:(master) ✗

This has not been fixed and shouldn't be closed until the fix is merged in. Creating the data/DeepDB dir and creating an output dir fixed it for me. I did not have to explicitly create the 'features' file once I had the output dir.

authors: jecompton random-friendly-dude yueduan

repo: deepbindiff/DeepBinDiff


text:
🛑 Provider IFCA-LCG2   eu.indigo-datacloud.mesos is down

In 8c6ad2a, Provider IFCA-LCG2   eu.indigo-datacloud.mesos (https://mesos.cloud.ifca.es/mesos) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Provider IFCA-LCG2   eu.indigo-datacloud.mesos is back up in 0263b62.

repo: deephdc/status


text:
deep equilibrium example not working

The DEQ example is not working, and a plot showing the reconstructed images is missing.

#282

this seems to be solved with #282

repo: deepinv/deepinv


text:
More MRI MaskGenerators

Add Cartesian mask generators for:

Uniform random sampling RandomMaskGenerator (i.e. existing deepinv.physics.generator.mri.AccelerationMaskGenerator)
Gaussian sampling GaussianMaskGenerator
Uniform (equispaced) sampling UniformMaskGenerator
Base class for enforcing same acceleration factor logic
Support for k-t sampling in all the above, e.g. with random time-varying mask or sheared mask etc.

Also fix #204
Checks to be done before submitting your PR

[x] python3 -m pytest tests/ runs successfully.
[x] black . runs successfully.
[x] make html runs successfully (in the docs/ directory).
[x] Updated docstrings related to the changes (as applicable).
[x] Added an entry to the CHANGELOG.rst.

TODO: add Julian's changes from #206

TODO: add Julian's changes from #206

authors: Andrewwango eseaoutdoorsuk


text:
Fix NPE bug in block.toString() function

Change-Id: I2aa8bc6c8d36d01cc00c02778907b040d782330c
Description
Brief description of what this PR is about

If this change is a backward incompatible change, why must this change be made?
Interesting edge cases to note here

Codecov Report

Merging #1076 (122c355) into master (7a7f41f) will decrease coverage by 0.06%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master    #1076      +/-   ##
============================================
- Coverage     70.05%   69.99%   -0.07%
+ Complexity     5231     5228       -3
============================================
  Files           511      511
  Lines         23339    23341       +2
  Branches       2492     2493       +1
============================================
- Hits          16350    16337      -13
- Misses         5660     5679      +19
+ Partials       1329     1325       -4

Impacted Files
Coverage Δ

api/src/main/java/ai/djl/nn/AbstractBlock.java
64.51% <100.00%> (+0.46%)
:arrow_up:

...ain/java/ai/djl/tensorflow/engine/TfNDManager.java
84.37% <0.00%> (-3.91%)
:arrow_down:

...gine/src/main/java/ai/djl/dlr/engine/DlrModel.java
53.12% <0.00%> (-3.13%)
:arrow_down:

api/src/main/java/ai/djl/util/Platform.java
43.47% <0.00%> (-2.18%)
:arrow_down:

api/src/main/java/ai/djl/repository/Artifact.java
89.65% <0.00%> (-1.73%)
:arrow_down:

...g/src/main/java/ai/djl/serving/util/Connector.java
55.40% <0.00%> (-1.36%)
:arrow_down:

...ngine/src/main/java/ai/djl/mxnet/jna/LibUtils.java
42.23% <0.00%> (-1.25%)
:arrow_down:

.../main/java/ai/djl/benchmark/AbstractBenchmark.java
91.22% <0.00%> (-1.17%)
:arrow_down:

...mark/src/main/java/ai/djl/benchmark/Arguments.java
78.08% <0.00%> (-0.57%)
:arrow_down:

.../djl/training/listener/MemoryTrainingListener.java
76.62% <0.00%> (ø)

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7a7f41f...122c355. Read the comment docs.

authors: codecov-commenter frankfliu

repo: deepjavalibrary/djl


text:
Cache the PyTorch "files.txt".

The cached "files.txt" ensures DJL will still run when the machine is offline, and the native torch jar is not added to the classpath.
Description
Projects that run DJL pytorch models might not work if the machine cannot access "https://publish.djl.ai/pytorch/files.txt" when the "detected" platform is a placeholder (for example the native torch jar is not added to the project).

If this change is a backward incompatible change, why must this change be made?
Interesting edge cases to note here

I don't think this is necessary. If the cache folder already exist, DJL won't access network to retrieve files.txt. The only case it will try to download files.txt is you run DJL on GPU machine which CUDA version is not support (e.g. 9.2). In this case, DJL will try to access files.txt and fallback to CPU. The workaround in this case is to set an environment variable:
export PYTORCH_FLAVOR=cpu

Then DJL will directly load cpu version from cache folder.

I don't think this is necessary. If the cache folder already exist, DJL won't access network to retrieve files.txt. The only case it will try to download files.txt is you run DJL on GPU machine which CUDA version is not support (e.g. 9.2). In this case, DJL will try to access files.txt and fallback to CPU. The workaround in this case is to set an environment variable:
export PYTORCH_FLAVOR=cpu

Then DJL will directly load cpu version from cache folder.

The files.txt is also accessed when only the CUDA minor version is "mismatched, for example on a particular machine I have the "detected" flavor = "cu117", which gets matched to "cu116" from the files.txt and I can still run DJL on GPU even in offline mode.

When you create PR, would you please check "Allow edits and access to secrets by maintainers", so that I can push changes to your branch.

"Allow edits and access to secrets by maintainers"

I think I did that ->

authors: demq frankfliu


text:
Added support for setGraphExecutorOptimize with torchscript models.

Description
This PR adds support for torch::jit::setGraphExecutorOptimize which allows the user to prevent model "warmup" periods while torchscript optimizes the model on GPU.
Users can disable the torchscript optimization with the following code:
System.setProperty("ai.djl.pytorch.setGraphExecutorOptimize", "false");

Since this feature is enabled by default in torchscript, it will only enable/disable optimize when the system property has been set.
This change is backwards compatible and does not alter the usage of any existing code.

@frankfliu I created it as a draft pull request as this is my first pull request. Please have a look and you can mark it ready for review.

After doing some testing, there is currently a bug with multi-threaded inference where it will have the same multi-second delay after a few inferences. It does not happen single threaded.
I have fixed it by running PyTorchLibrary.LIB.setGraphExecutorOptimize(false); before every time PyTorchLibrary.LIB.moduleForward is called. This indicates that when using multiple threads, the value of the setGraphExecutorOptimize is being reset in the JNI code or it is not being respected.
I propose that we add another parameter to PyTorchLibrary.LIB.moduleForward which takes in whether setGraphExecutorOptimize is true or false and sets it each time.
I am going to continue investigating to see if I can figure out why the value is not being respected when set in the PtSymbolicBlock on the first inference and only when using more than one thread.

I was able to resolve this by calling JniUtils.setGraphExecutorOptimize(false); in each thread I planned to use. I do not have much experience with JNI, but it seems that because each thread provides its own environment to each JNI call, this causes the reset.
I think the best course of action would to be add a parameter to PyTorchLibrary.LIB.moduleForward as I mentioned above. Let me know what you think.

It might be a good idea to just allow the developer to utilize the JNI function how they want rather than focusing it one way or another. This flexibility will be needed in some situations, like if you want to load models on one thread with optimization and another set of models without optimization. With this global approach, it is much less flexible and it doesn't enforce any changes.
I just reverted my changes to PtSymbolBlock as I think flexibility is the way to go.

Codecov Report

Merging #904 (6ddac4b) into master (e819389) will decrease coverage by 0.09%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master     #904      +/-   ##
============================================
- Coverage     70.34%   70.24%   -0.10%
+ Complexity     5085     5076       -9
============================================
  Files           501      501
  Lines         22432    22437       +5
  Branches       2332     2335       +3
============================================
- Hits          15779    15761      -18
- Misses         5412     5433      +21
- Partials       1241     1243       +2

Impacted Files
Coverage Δ
Complexity Δ

...ine/src/main/java/ai/djl/pytorch/jni/JniUtils.java
90.57% <0.00%> (-0.30%)
194.00 <0.00> (ø)

...c/main/java/ai/djl/pytorch/jni/PyTorchLibrary.java
100.00% <ø> (ø)
1.00 <0.00> (ø)

api/src/main/java/ai/djl/util/Platform.java
43.47% <0.00%> (-5.36%)
8.00% <0.00%> (ø%)

...djl/training/listener/LoggingTrainingListener.java
83.18% <0.00%> (-5.31%)
22.00% <0.00%> (-6.00%)

api/src/main/java/ai/djl/repository/Artifact.java
89.65% <0.00%> (-3.45%)
36.00% <0.00%> (-2.00%)

...gine/src/main/java/ai/djl/dlr/engine/DlrModel.java
53.12% <0.00%> (-3.13%)
4.00% <0.00%> (ø%)

api/src/main/java/ai/djl/training/Trainer.java
91.83% <0.00%> (-3.07%)
33.00% <0.00%> (-1.00%)

...g/src/main/java/ai/djl/serving/util/Connector.java
55.40% <0.00%> (-1.36%)
21.00% <0.00%> (ø%)

...ngine/src/main/java/ai/djl/mxnet/jna/LibUtils.java
42.23% <0.00%> (-1.25%)
15.00% <0.00%> (ø%)

...rc/main/java/ai/djl/paddlepaddle/jni/LibUtils.java
51.14% <0.00%> (ø)
14.00% <0.00%> (ø%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e819389...6ddac4b. Read the comment docs.

authors: codecov-commenter hodovo


text:
Bug with reshape after permute

When I do a reshape after a permute, I don't get the same result than if I do an inplace permutation.
INDArray a = Nd4j.linspace(1, 2, 8).reshape(new int[] { 2, 2, 2 });
INDArray b = a.dup();
int[] rearrange = new int[] { 0, 2, 1 };
a = a.permute(rearrange);
b = b.permutei(rearrange);
System.out.println(a.equals(b));// > return true
int[] newShape = new int[] { 4, 2 };
a = a.reshape(newShape);
b = b.reshape(newShape);
System.out.println(a.equals(b));// >return false :/

@Jajawah Very good find. Real deal bug. Thank you!

https://github.com/deeplearning4j/nd4j/pull/1130

authors: Jajawah agibsonccc eraly


text:
Very high CPU usage

First, thx for the open-source code! But when I run the example run_dqn.py under directory examples/atari/, I find the CPU usage is very high, about 1900%,  details are listed below:
VIRT                  RES                  SHR S           %CPU          %MEM          TIME+ COMMAND
74.715g          0.011t          839564 R          1962                  36.6          107:35.79      run_dqn.py
And the info of CPU is listed below:
cat /proc/cpuinfo| grep "physical id"| sort| uniq| wc -l
1

cat /proc/cpuinfo | grep "cpu cores" | uniq
cpu cores	: 10

cat /proc/cpuinfo| grep "processor" | wc -l
20

So can somebody tell me this situation is normal or not? And I find the program also uses gpu. If this situation is abnormal, how can I fix the code?
BTW, I want to know when I run programs on Atari game, how much memory do programs need ? When I run run_dqn.py on my PC with 32G RAM, it always breaks down because of memory burst.

Hi all!
I did not experience such high CPU values, however, I did observe a high memory usage. In order to mitigate this situation a bit, I tweaked the reverb related parameters that can be found in the acme.datasets.reverb module (around these lines):
https://github.com/deepmind/acme/blob/f17b91c03aed5ecf25df1b5c01970ebe68b2c733/acme/datasets/reverb.py#L105-L121
By doing this I was able to control the number of spawned threads. This was something I had to consider because I am running multiple copies of the framework in parallel and, thus, I need to somehow limit a bit the resources used by each instance. However, notice that these changes will most surely affect performance.
Finally, note that I'm just a mere user, not a contributor.
(and I am not running the framework on Atari games)

Hi @LQNew, I'm a bit surprised to see your CPU usage is so high. Reverb's dataset does spawn multiple threads to parallelize data reads, so perhaps tuning the parameters @PPSantos mentioned along with max_workers_per_iterator could help. Are you certain that the GPU is being used for training and inference?
As for memory usage, without compression and using the default parameters for run_dqn.py the replay will take approximately 1e6 * 84 * 84 * 4 bytes = 28.224 GB (this is the size of one observation multiplied by the max replay size). However compression should significantly reduce this, I ran a quick experiment with snappy and found the compression ratio is approximately 0.06, so the data should only take up ~1.7 GB.

@PPSantos , thx for your reply! I also run some examples on other envs, such as running the example run_dqn.py under directory examples/bsuite, in the bsuite env, find aroud 400% ~ 800% CPU usge on my PC, compared to above 1900% CPU usage with DQN running on the Atari games, CPU usage is greatly reduced.

@fastturtle, thx for your detailed and nice reply! I'm sure that the GPU is used for trainning and inference, by typing nvidia-smi in the terminal to observe GPU staus, I find the program uses 1460 MiB GPU memory and with around 30% Volatile GPU-Util.
Also, I have done some extra experiments, I find in other envs, by running other examples, the highest CPU usage is around 800%, compared to above 1900% CPU usage with DQN running on the Atari games, CPU usage is greatly reduced.  I suspect that in Atari games, with default settings in Acme, CPU usage is actually high. Later, I will try tuning the parameters of reverb to test results according to your suggestion, but as for your mentioned parameter num_workers_per_iterator, I think in DQN agent, the place I can change is here: replay_client = reverb.TFClient(address) # initialize DQN replay client, but I find that the parameter num_workers_per_iterator can't be changed in class TFClient , so am I right or there exists other place to change the parameter num_workers_per_iterator ?
I feel very excited about the usage of snappy, so will Acme release the code of running code in snappy or just examples? I look forward to enjoying the usage of snappy in the near future!!

@LQNew thanks for the question and sorry if it was not sufficiently well answered.
I'll be closing the issue as it's been a while since there was any action on it and I assume it may not be relevant. Please submit a separate one if you still have problems and we'll try to answer to the best of our abilities.

authors: LQNew PPSantos fastturtle nikolamomchev

repo: deepmind/acme