text:
Towards an automated syntax formatting for our projects

This is an exmaple of usage of the google-code-format tool as a build plugin.
It lets us :

specify exactly our house style, in contrib/formatter.xml
For now this initial version is taken from the Google style
described here https://google.github.io/styleguide/javaguide.html
implemented here https://github.com/google/styleguide
In this PR, the file setting this up is here
The values can be tested and explored in WYSIWYG fashion in Eclipse, but they're
pretty sefl-explanatory

ultimately, we can enforce this style at the build's CI checks.
For that, we would just add a commit to this PR that uncomments the following:
            <plugin>
            <groupId>net.revelc.code.formatter</groupId>
            <artifactId>formatter-maven-plugin</artifactId>
            <version>2.0.0</version>
            <!-- <executions> -->
            <!--   <execution> -->
            <!--     <goals> -->
            <!--       <goal>validate</goal> -->
            <!--     </goals> -->
            <!--   </execution> -->
            <!-- </executions> -->
            <configuration>
              <configFile>${eclipseFormatterStyle}</configFile>
            </configuration>
          </plugin>

the first commit does not change anything, except that it sets up the plugin
for action, giving you access to the goals described here:
http://code.revelc.net/formatter-maven-plugin/plugin-info.html

Note this formatting can be obtained automatically, either with the Eclipse formatter equipped with the profile mentioned above (in formatter.xml), using the IntelliJ plugin, or on the CLI, using the google-java-formatter

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build triggered. sha1 is merged.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/284/Failed Tests: 8nd4j_PR/org.nd4j:nd4j-aeron: 1org.nd4j.aeron.ipc.response.AeronNDArrayResponseTest.testResponsend4j_PR/org.nd4j:nd4j-cuda-8.0: 1org.nd4j.linalg.LoneTest.testArgMax[0: backend(org.nd4j.linalg.jcublas.JCublasBackend)={1}]nd4j_PR/org.nd4j:nd4j-gson: 4org.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayIsRankFive_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_HaveCommaInsideNumbers_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayHasOnlyOneRowWithColumns_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_PassInInRank3Array_ExpectCorrectDeserializationnd4j_PR/org.nd4j:nd4j-parameter-server-client: 1org.nd4j.parameterserver.client.ParameterServerClientPartialTest.testServernd4j_PR/org.nd4j:nd4j-parameter-server-node_2.10: 1org.nd4j.parameterserver.node.ParameterServerNodeTest.org.nd4j.parameterserver.node.ParameterServerNodeTest

Build finished. 1960 tests run, 47 skipped, 8 failed.

Build started sha1 is merged.

Build finished. 1960 tests run, 47 skipped, 8 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/285/Failed Tests: 8nd4j_PR/org.nd4j:nd4j-aeron: 1org.nd4j.aeron.ipc.response.AeronNDArrayResponseTest.testResponsend4j_PR/org.nd4j:nd4j-cuda-8.0: 1org.nd4j.linalg.LoneTest.testArgMax[0: backend(org.nd4j.linalg.jcublas.JCublasBackend)={1}]nd4j_PR/org.nd4j:nd4j-gson: 4org.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayIsRankFive_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_HaveCommaInsideNumbers_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayHasOnlyOneRowWithColumns_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_PassInInRank3Array_ExpectCorrectDeserializationnd4j_PR/org.nd4j:nd4j-parameter-server-client: 1org.nd4j.parameterserver.client.ParameterServerClientPartialTest.testServernd4j_PR/org.nd4j:nd4j-parameter-server-node_2.10: 1org.nd4j.parameterserver.node.ParameterServerNodeTest.org.nd4j.parameterserver.node.ParameterServerNodeTest

So I'm in the house formatter guy. Question on this:
I usually have a few problems with:
spaces: I do int i = 0; i < 5; i++
I see:
i=0;i<5;i++
throughout our codebase and fix it.
I don't do c style braces:
{
}
I do {
}
Does this enforce that? If not how do we configure it?

Same story with braces style.

Don't worry about the conflict. The conflicting commit is the reformatting commit, which is tool-generated. It can therefore be re-generated easily.
Yes, the Google Java code style enforces Kernighan-Ritchie style braces:
https://google.github.io/styleguide/javaguide.html#s4.1-braces
One example of this enforcement:
https://github.com/deeplearning4j/nd4j/pull/1626/files?w=1#diff-8d2fccb98469a00ac2329f974b6e2155R1548
One exception : empty blocks, which are opened and closed on the same line:
https://github.com/deeplearning4j/nd4j/pull/1626/files?w=1#diff-1d2730056e767a63c72da5bba6ca95c1R160
See https://google.github.io/styleguide/javaguide.html#s4.1.3-braces-empty-blocks
Spaces : yes, they are enforced
https://google.github.io/styleguide/javaguide.html#s4.6.2-horizontal-whitespace
See : https://github.com/deeplearning4j/nd4j/pull/1626/files?w=1#diff-8d2fccb98469a00ac2329f974b6e2155R1573

Could we put that on .gitignore then?

Beyond that I'm happy merging this.

Build triggered. sha1 is merged.

Build started sha1 is merged.

You may want to have a look at this PR without whitespace.
Bonus to get all the benefits of this PR:
Also, the further value of this is in having automated checks for formatting, i.e. uncommenting the automatic validation I talk about above. That's only possible if everybody has gone in a sub-project and run a mvn formatter:format to convince themselves that when formatting fails their build, it's a one-command fix to make the formatting go and their build pass again.

Build finished. 1960 tests run, 47 skipped, 10 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/293/Failed Tests: 10nd4j_PR/org.nd4j:nd4j-aeron: 1org.nd4j.aeron.ipc.response.AeronNDArrayResponseTest.testResponsend4j_PR/org.nd4j:nd4j-cuda-8.0: 2org.nd4j.serde.jackson.NdArraySerializerTest.testSerdeorg.nd4j.linalg.LoneTest.testArgMax[0: backend(org.nd4j.linalg.jcublas.JCublasBackend)={1}]nd4j_PR/org.nd4j:nd4j-gson: 4org.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayIsRankFive_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_HaveCommaInsideNumbers_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_ArrayHasOnlyOneRowWithColumns_ExpectCorrectDeserializationorg.nd4j.serde.gson.GsonDeserializationUtilsTest.deserializeRawJson_PassInInRank3Array_ExpectCorrectDeserializationnd4j_PR/org.nd4j:nd4j-native: 1org.nd4j.serde.jackson.NdArraySerializerTest.testSerdend4j_PR/org.nd4j:nd4j-parameter-server-client: 1org.nd4j.parameterserver.client.ParameterServerClientPartialTest.testServernd4j_PR/org.nd4j:nd4j-parameter-server-node_2.11: 1org.nd4j.parameterserver.node.ParameterServerNodeTest.org.nd4j.parameterserver.node.ParameterServerNodeTest

And @agibsonccc this is not what I meant by tool-generated — I meant the commit is tool-generated. It touches files that should be under version control.
I think we may want to wait until merging this one that https://github.com/deeplearning4j/nd4j/pull/1551 has gone in — the rebase will be easier for me than @raver119

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build finished. 1977 tests run, 49 skipped, 17 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/297/Build result: FAILURE[...truncated 4.66 MB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/9166a3879486134e2bb521b575a7828ad4f788e3	at sun.reflect.GeneratedConstructorAccessor62.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/9166a3879486134e2bb521b575a7828ad4f788e3	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

I'm in favour of this PR, and generally support using the google style guide, and enforcing the style guide at build time. I imagine the latter component (enforce style) will take some effort to get the codebase to comply?
Looking through the google code style guide, it's a great starting point, but there's a few things I would want to change:

Allow wildcard imports: more upsides than downsides IMO https://google.github.io/styleguide/javaguide.html#s3.3.1-wildcard-imports
+4 instead of +2 indentation: I could survive with +2, but we've been using +4 forever, and I see no reason to change https://google.github.io/styleguide/javaguide.html#s4.2-block-indentation
120 or 140 instead of 100 character column limit: default in intellij is 120, 100 is too narrow IMO given modern monitors etc. Github seems to be 140 (estimated from looking at code on github , couldn't find a reference for this)  https://google.github.io/styleguide/javaguide.html#s4.4-column-limit

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build finished. 69 tests run, 2 skipped, 0 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/299/Build result: FAILURE[...truncated 805.75 KB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/a453467b92cf82a8b3161635e31943eef5ff4802	at sun.reflect.GeneratedConstructorAccessor62.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/a453467b92cf82a8b3161635e31943eef5ff4802	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

I changed linewrap, wildcard import and indentation preferences.

I can merge this if we get rid of the conflicts.

Build triggered. sha1 is merged.

Build triggered. sha1 is original commit.

Build started sha1 is original commit.

Build triggered. sha1 is merged.

Updated /cc @agibsonccc

Build finished. 1 tests run, 1 skipped, 0 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/305/Build result: FAILURE[...truncated 481.29 KB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/7c2d43bf67304d6fc61cdfd73203b0ca497e14ed	at sun.reflect.GeneratedConstructorAccessor308.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/7c2d43bf67304d6fc61cdfd73203b0ca497e14ed	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

Build started sha1 is merged.

Build finished. No test results found.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/306/

Build triggered. sha1 is merged.

Updated /cc @agibsonccc

Build started sha1 is merged.

Build finished. 968 tests run, 24 skipped, 0 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/307/Build result: FAILURE[...truncated 2.12 MB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/399e1c8aa1b3bbb60a014754b326f714c8643f51	at sun.reflect.GeneratedConstructorAccessor308.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/399e1c8aa1b3bbb60a014754b326f714c8643f51	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build finished. 1 tests run, 1 skipped, 0 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/308/Build result: FAILURE[...truncated 470.39 KB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/b0fc1ef213620ebb075c2fc204161d5aba00f679	at sun.reflect.GeneratedConstructorAccessor308.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/b0fc1ef213620ebb075c2fc204161d5aba00f679	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

Build triggered. sha1 is merged.

Build started sha1 is merged.

Build finished. 968 tests run, 24 skipped, 0 failed.

Refer to this link for build results (access rights to CI server needed):
/job/nd4j_PR/309/Build result: FAILURE[...truncated 2.12 MB...]	at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)	at hudson.model.ResourceController.execute(ResourceController.java:98)	at hudson.model.Executor.run(Executor.java:405)Caused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/7313eef55ca7f5245b418adab270be84ea725baf	at sun.reflect.GeneratedConstructorAccessor48.newInstance(Unknown Source)	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1890)	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1885)	at java.security.AccessController.doPrivileged(Native Method)	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1884)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1457)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254)	at org.kohsuke.github.Requester.parse(Requester.java:535)	at org.kohsuke.github.Requester._to(Requester.java:262)	... 12 moreCaused by: java.io.FileNotFoundException: https://api.github.com/repos/deeplearning4j/nd4j/statuses/7313eef55ca7f5245b418adab270be84ea725baf	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1836)	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1441)	at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)	at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:338)	at org.kohsuke.github.Requester.parse(Requester.java:525)	... 13 more

authors: AlexDBlack SusanBot agibsonccc huitseeker raver119


text:
How to resolve core dumped issue while running the alphafold2 latest version?

python3 docker/run_docker.py --fasta_paths=T1050.fasta --max_template_date=2020-05-14 --data_dir=/data/hkumar1/software/AlphaFold2/DataBase/ --output_dir=/data/hkumar1/software/alphafold/OutputAlphafold
Error:
I1118 10:38:26.208927 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/alphafold -> /mnt/fasta_path_0
I1118 10:38:26.209047 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/uniref90 -> /mnt/uniref90_database_path
I1118 10:38:26.209110 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/mgnify -> /mnt/mgnify_database_path
I1118 10:38:26.209167 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2 -> /mnt/data_dir
I1118 10:38:26.209252 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/pdb_mmcif -> /mnt/template_mmcif_dir
I1118 10:38:26.209304 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/pdb_mmcif -> /mnt/obsolete_pdbs_path
I1118 10:38:26.209372 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/pdb70 -> /mnt/pdb70_database_path
I1118 10:38:26.209445 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/uniclust30/uniclust30_2018_08 -> /mnt/uniclust30_database_path
I1118 10:38:26.209513 139676556441408 run_docker.py:87] Mounting /data/hkumar1/software/AlphaFold2/DataBase/bfd -> /mnt/bfd_database_path
I1118 10:38:57.066114 139676556441408 run_docker.py:226] I1118 16:38:57.064508 139655916111680 templates.py:857] Using precomputed obsolete pdbs /mnt/obsolete_pdbs_path/obsolete.dat.
I1118 10:38:57.425003 139676556441408 run_docker.py:226] I1118 16:38:57.423916 139655916111680 xla_bridge.py:232] Unable to initialize backend 'tpu_driver': Not found: Unable to find driver in registry given worker:
I1118 10:38:57.754481 139676556441408 run_docker.py:226] I1118 16:38:57.753208 139655916111680 xla_bridge.py:232] Unable to initialize backend 'tpu': Invalid argument: TpuPlatform is not available.
I1118 10:38:57.763273 139676556441408 run_docker.py:226] LLVM ERROR: pthread_create failed: Resource temporarily unavailable
I1118 10:38:57.763638 139676556441408 run_docker.py:226] Fatal Python error: Aborted
I1118 10:38:57.763949 139676556441408 run_docker.py:226]
I1118 10:38:57.764223 139676556441408 run_docker.py:226] Current thread 0x00007f042d454740 (most recent call first):
I1118 10:38:57.764483 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 369 in backend_compile
I1118 10:38:57.764747 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 87 in compile_or_get_cached
I1118 10:38:57.765006 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 798 in from_xla_computation
I1118 10:38:57.765314 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 770 in compile
I1118 10:38:57.765562 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 654 in _xla_callable_uncached
I1118 10:38:57.765806 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 335 in xla_primitive_callable
I1118 10:38:57.766059 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/_src/util.py", line 180 in cached
I1118 10:38:57.766300 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/_src/util.py", line 187 in wrapper
I1118 10:38:57.766541 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/interpreters/xla.py", line 312 in apply_primitive
I1118 10:38:57.766820 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/core.py", line 624 in process_primitive
I1118 10:38:57.767814 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/core.py", line 272 in bind
I1118 10:38:57.768077 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/_src/lax/lax.py", line 481 in _convert_element_type
I1118 10:38:57.768325 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/jax/_src/numpy/lax_numpy.py", line 3601 in array
I1118 10:38:57.768575 139676556441408 run_docker.py:226] File "/app/alphafold/alphafold/model/utils.py", line 80 in flat_params_to_haiku
I1118 10:38:57.768822 139676556441408 run_docker.py:226] File "/app/alphafold/alphafold/model/data.py", line 39 in get_model_haiku_params
I1118 10:38:57.769085 139676556441408 run_docker.py:226] File "/app/alphafold/run_alphafold.py", line 380 in main
I1118 10:38:57.769331 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/absl/app.py", line 258 in _run_main
I1118 10:38:57.769576 139676556441408 run_docker.py:226] File "/opt/conda/lib/python3.7/site-packages/absl/app.py", line 312 in run
I1118 10:38:57.769820 139676556441408 run_docker.py:226] File "/app/alphafold/run_alphafold.py", line 427 in
I1118 10:39:17.716646 139676556441408 run_docker.py:226] /app/run_alphafold.sh: line 3:     8 Aborted                 (core dumped) python /app/alphafold/run_alphafold.py "$@"

This seems to be a docker issue related to resource contention on the server your instance is running on. Is there any way you can free more resources on the host?

Closing this issue for now, feel free to reopen if this is still a problem.

source: gharchive/issue

repo: deepmind/alphafold

license_type: permissive

license_source: bigquery


text:
TypeError: expected str, bytes or os.PathLike object, not NoneType

I tried to install dm_control by pip install git+git://github.com/deepmind/dm_control.git.
However, I can import dm_control successfully, but when I used 'from dm_control import suite', error came.
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\suite_init_.py", line 28, in
from dm_control.suite import acrobot
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\suite\acrobot.py", line 26, in
from dm_control import mujoco
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco_init_.py", line 18, in
from dm_control.mujoco.engine import action_spec
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\engine.py", line 43, in
from dm_control.mujoco import index
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\index.py", line 94, in
from dm_control.mujoco.wrapper import util
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\wrapper_init_.py", line 23, in
from dm_control.mujoco.wrapper import mjbindings
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\wrapper\mjbindings_init_.py", line 28, in
from dm_control.mujoco.wrapper.mjbindings import wrappers
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\wrapper\mjbindings\wrappers.py", line 14, in
from dm_control.mujoco.wrapper import util
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\wrapper\util.py", line 57, in
"~/.mujoco/mjpro150/bin", _get_shared_library_filename())
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\site-packages\dm_control\mujoco\wrapper\util.py", line 47, in _get_shared_library_filename
libc_filename = os.path.split(libc_path)[1]
File "C:\Users\bzdli\Anaconda3\envs\drl\lib\ntpath.py", line 204, in split
p = os.fspath(p)
TypeError: expected str, bytes or os.PathLike object, not NoneType
I's using windows 10 and python 3.6.  Can someone figure this out?

I have also faced this issue... Has anyone found a solution yet?  Many thanks!

Ok, I have noticed there is a fix in pull request 'Load shared library properly on windows.'

Has anyone managed to fix this?

@bzdlity @fcampos Do you have any solution to fix the problem?
I also use Win10 and python 3.6.

I believe this was fixed in ebc6442646c711ec5b908b6fc32befaea48da7fb - please comment if the error still occurs.

authors: Pizzafarmer alimuldal bzdlity fcampos zovathio


text:
"master" is no longer the default git branch in Github

Describe the bug/feature
New repositories in github no longer have a default "master" branch. It has been renamed to "main".
To Reproduce
Steps to reproduce the behavior:

Configure a remote inventory

Use a newly created repository.
parameters:
  kapitan:
    vars:
      target: ${target_name}
    inventory:
      - type: git
        source: https://github.com/myspotontheweb/kapitan-demo.git
        subdir: inventory/classes
        output_path: classes/

Run a compile

$ kapitan compile --fetch
[WARNING] Reclass class not found: 'myorg.apps.staging.app1'. Skipped!
[WARNING] Reclass class not found: 'myorg.apps.staging.app1'. Skipped!
Inventory https://github.com/myspotontheweb/kapitan-demo.git: fetching now
Inventory https://github.com/myspotontheweb/kapitan-demo.git: successfully fetched
Unknown (Non-Kapitan) Error occurred
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "multiprocessing/pool.py", line 121, in worker
  File "kapitan/dependency_manager/base.py", line 120, in fetch_git_dependency
  File "git/cmd.py", line 542, in <lambda>
  File "git/cmd.py", line 1005, in _call_process
  File "git/cmd.py", line 822, in execute
git.exc.GitCommandError: Cmd('git') failed due to: exit code(1)
  cmdline: git checkout master
  stderr: 'error: pathspec 'master' did not match any file(s) known to git.'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "kapitan/targets.py", line 108, in compile_targets
  File "kapitan/remoteinventory/fetch.py", line 74, in fetch_inventories
  File "kapitan/remoteinventory/fetch.py", line 74, in <listcomp>
  File "multiprocessing/pool.py", line 748, in next
git.exc.GitCommandError: Cmd('git') failed due to: exit code(1)
  cmdline: git checkout master
  stderr: 'error: pathspec 'master' did not match any file(s) known to git.'

Cmd('git') failed due to: exit code(1)
  cmdline: git checkout master
  stderr: 'error: pathspec 'master' did not match any file(s) known to git.'

Note the "master" branch is not found

'error: pathspec 'master' did not match any file(s) known to git.'

This is hard coded in the python code here
Expected behavior
Expected Kapitan to download the remote inventory.
** If it's a bug (please complete the following information):**

python --version:
pip3 --version:
Are you using pyenv or virtualenv?

$ which kapitan
/usr/local/bin/kapitan

$ kapitan --version
0.29.3

Additional context
N/A

Work-around
I reverted my repository's default branch from "main" back to "master".

Hi @myspotontheweb, Thanks for reporting this! Until this is fixed, maybe you can specify ref: main in the target files to save yourself the trouble of manually changing the default branch.
e.g
parameters:
  kapitan:
    vars:
      target: ${target_name}
    inventory:
      - type: git
        source: https://github.com/myspotontheweb/kapitan-demo.git
        subdir: inventory/classes
        output_path: classes/
        ref: main

repo: deepmind/kapitan

license_source: github-api


text:
research_dqn_pytorch.ipynb  uses TensorFlow, not pytorch

The title is pretty straightforward, was looking for a DQN example with PyTorch, and the notebook research_dqn_pytorch.ipynb in fact uses TensorFlow. i didn't see a file in open_spiel/python/examples either that met this criteria. do you have any suggestions? Or could this be modified to used pytorch?

Thanks, we will fix that. Best place to start is https://github.com/deepmind/open_spiel/blob/master/open_spiel/python/pytorch/dqn_pytorch_test.py. @Asugawara, what do you think about adding a simple example to python/examples that shows it solving catch?

I think research_dqn_pytorch.ipynb uses Pytorch. dqn_pt defined on cell 1 and used on cell 4.
Is there something wrong??
ref:https://github.com/deepmind/open_spiel/blob/master/open_spiel/colabs/research_dqn_pytorch.ipynb

what do you think about adding a simple example to python/examples that shows it solving catch?

It's a nice idea!
I think it would be good to make one based on　python/examples/subgle_agent_catch.py.

Oops I did not actually check. @balloch can you help us understand? Thanks.

Ah, I see my mistake. It has Pytorch, but it also has Tensorflow (tf_main, I presume so that the person running the notebook can compare the results from the two frameworks?). I understand now. Thanks!

authors: Asugawara balloch lanctot


text:
Sort alphabetically data/repositories.toml to avoid conflicts

Right now new repositories are added at the end of the list, and it causes git conflicts when couple PR are on the way. Requirement to have the list sorted will almost remove these conflicts.

can i contribute on this?

@PRAy-d you can help (if you can) by making PR #165 merged. What I did here is just sorted them in vim using :sort.

authors: PRAy-d kmorcinek

repo: deepsourcelabs/good-first-issue

license: MIT


text:
Running Spleeter from Windows

Windows 10 Home (current with updates)
Dell Inspiron 5759
16 gig RAM
Intel HD Graphics 520 (Dell)
4096MB ATI AMD Radeon R5 M335 (Dell)
CrossFire Disabled
Python 3.7.3 (v3.7.3:ef4ec6ed12, Mar 25 2019, 22:22:05) [MSC v.1916 64 bit (AMD64)] on win32
Installed using
pip install spleeter

Even just trying to get the help info I get...
D:>spleeter -h
Traceback (most recent call last):
File "c:\python\lib\site-packages\pkg_resources_init_.py", line 583, in build_master
ws.require(requires)
File "c:\python\lib\site-packages\pkg_resources_init.py", line 900, in require
needed = self.resolve(parse_requirements(requirements))
File "c:\python\lib\site-packages\pkg_resources_init_.py", line 791, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (setuptools 40.8.0 (c:\python\lib\site-packages), Requirement.parse('setuptools>=41.0.0'), {'tensorboard'})
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Python\Scripts\spleeter-script.py", line 6, in
from pkg_resources import load_entry_point
File "c:\python\lib\site-packages\pkg_resources_init_.py", line 3191, in
@call_aside
File "c:\python\lib\site-packages\pkg_resources_init.py", line 3175, in call_aside
f(*args, **kwargs)
File "c:\python\lib\site-packages\pkg_resources_init.py", line 3204, in _initialize_master_working_set
working_set = WorkingSet.build_master()
File "c:\python\lib\site-packages\pkg_resources_init.py", line 585, in _build_master
return cls.build_from_requirements(requires)
File "c:\python\lib\site-packages\pkg_resources_init.py", line 598, in build_from_requirements
dists = ws.resolve(reqs, Environment())
File "c:\python\lib\site-packages\pkg_resources_init.py", line 791, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.ContextualVersionConflict: (setuptools 40.8.0 (c:\python\lib\site-packages), Requirement.parse('setuptools>=41.0.0'), {'tensorboard'})

While I am not associated with the project, it seems like (from the error) that you need to install setuptools 41.0.0 or greater? Obviously ideally pip would correctly install this dependency, but does installing that package manually unblock you?

python -m pip install --upgrade pip setuptools
did the upgrade from 40.x to 41.x and it works now. Thanks.

We added the good setuptools dependency to the package requirements and the next release will fix that up.

How long should a run take? I started a run against a song (2:48 duration) this afternoon and it is still running at 9:25 pm. Here is what it shows so far:
D:>spleeter separate -i test.mp3
INFO:tensorflow:Downloading model archive https://github.com/deezer/spleeter/releases/download/v1.4.0/2stems.tar.gz
INFO:tensorflow:Using config: {'_model_dir': 'pretrained_models\2stems', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': gpu_options {
per_process_gpu_memory_fraction: 0.7
}
, '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_service': None, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0x00000196FADC2B38>, '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}
INFO:tensorflow:Calling model_fn.
WARNING:tensorflow:From c:\python\lib\site-packages\spleeter\model\functions\unet.py:29: The name tf.keras.initializers.he_uniform is deprecated. Please use tf.compat.v1.keras.initializers.he_uniform instead.
INFO:tensorflow:Apply unet for vocals_spectrogram
INFO:tensorflow:Apply unet for accompaniment_spectrogram
INFO:tensorflow:Done calling model_fn.
WARNING:tensorflow:From c:\python\lib\site-packages\tensorflow\python\ops\array_ops.py:1354: add_dispatch_support..wrapper (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
INFO:tensorflow:Graph was finalized.
WARNING:tensorflow:From c:\python\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
INFO:tensorflow:Restoring parameters from pretrained_models\2stems\model
INFO:tensorflow:Running local_init_op.
INFO:tensorflow:Done running local_init_op.
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.string
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int32
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.string
INFO:tensorflow:Loading audio b'test.mp3' from 0.0 to 600.0
Spleeter.exe is still shown as running but is using 0% cpu. It did get as far as creating the following directory and files:
D:>dir pretrained_models /s
Volume in drive D is D-Data
Volume Serial Number is 366A-6FA3
Directory of D:\pretrained_models
2019-11-06  13:04              .
2019-11-06  13:04              ..
2019-11-06  13:04              2stems
0 File(s)              0 bytes
Directory of D:\pretrained_models\2stems
2019-11-06  13:04              .
2019-11-06  13:04              ..
2019-10-24  03:35               176 ._checkpoint
2019-11-06  13:04                 2 .probe
2019-10-24  03:35                67 checkpoint
2019-10-24  03:35        78,614,080 model.data-00000-of-00001
2019-10-24  03:35             5,244 model.index
2019-10-24  03:35           805,575 model.meta
6 File(s)     79,425,144 bytes
 Total Files Listed:
           6 File(s)     79,425,144 bytes
           5 Dir(s)  776,089,026,560 bytes free

How long should a run take? I started a run against a song (2:48 duration) this afternoon and it is still running at 9:25 pm. Here is what it shows so far:
D:>spleeter separate -i test.mp3
INFO:tensorflow:Downloading model archive https://github.com/deezer/spleeter/releases/download/v1.4.0/2stems.tar.gz
INFO:tensorflow:Using config: {'_model_dir': 'pretrained_models\2stems', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': gpu_options {
per_process_gpu_memory_fraction: 0.7
}
, '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_service': None, '_cluster_spec': <tensorflow.python.training.server_lib.ClusterSpec object at 0x00000196FADC2B38>, '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}
INFO:tensorflow:Calling model_fn.
WARNING:tensorflow:From c:\python\lib\site-packages\spleeter\model\functions\unet.py:29: The name tf.keras.initializers.he_uniform is deprecated. Please use tf.compat.v1.keras.initializers.he_uniform instead.
INFO:tensorflow:Apply unet for vocals_spectrogram
INFO:tensorflow:Apply unet for accompaniment_spectrogram
INFO:tensorflow:Done calling model_fn.
WARNING:tensorflow:From c:\python\lib\site-packages\tensorflow\python\ops\array_ops.py:1354: add_dispatch_support..wrapper (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.where in 2.0, which has the same broadcast rule as np.where
INFO:tensorflow:Graph was finalized.
WARNING:tensorflow:From c:\python\lib\site-packages\tensorflow\python\training\saver.py:1276: checkpoint_exists (from tensorflow.python.training.checkpoint_management) is deprecated and will be removed in a future version.
Instructions for updating:
Use standard file APIs to check for files with this prefix.
INFO:tensorflow:Restoring parameters from pretrained_models\2stems\model
INFO:tensorflow:Running local_init_op.
INFO:tensorflow:Done running local_init_op.
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.string
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.int32
WARNING:tensorflow:The dtype of the watched tensor must be floating (e.g. tf.float32), got tf.string
INFO:tensorflow:Loading audio b'test.mp3' from 0.0 to 600.0
Spleeter.exe is still shown as running but is using 0% cpu. It did get as far as creating the following directory and files:
D:\>dir pretrained_models /s
 Volume in drive D is D-Data
 Volume Serial Number is 366A-6FA3

 Directory of D:\pretrained_models

2019-11-06  13:04    <DIR>          .
2019-11-06  13:04    <DIR>          ..
2019-11-06  13:04    <DIR>          2stems
               0 File(s)              0 bytes

 Directory of D:\pretrained_models\2stems

2019-11-06  13:04    <DIR>          .
2019-11-06  13:04    <DIR>          ..
2019-10-24  03:35               176 ._checkpoint
2019-11-06  13:04                 2 .probe
2019-10-24  03:35                67 checkpoint
2019-10-24  03:35        78,614,080 model.data-00000-of-00001
2019-10-24  03:35             5,244 model.index
2019-10-24  03:35           805,575 model.meta
               6 File(s)     79,425,144 bytes

     Total Files Listed:
               6 File(s)     79,425,144 bytes
               5 Dir(s)  776,089,026,560 bytes free

Same issue.
btw, I am not using the original sample, but a mp3-form audio from my music collection.
ffmpeg and ffplay can read the file successfully, but spleeter keeps stuck on reading the file,
and spleeter works on the given sample(audio_example.mp3) well.

Duplicate with #30 and #29 please retry with the new version released. It fixes FFmpeg reading.

OK. This is now officially awesome.

authors: Faylixe Reverend-Jim Saltflow awesomer

repo: deezer/spleeter


text:
suggestion to allow user to specify what resource pack to use

hey there, what if i want to convert a resource pack that i already downloaded? like newer versions of Faithful that has textures based on JAPPA's textures, what if i want to convert that resource pack?

hi, sure, i think it easy enough to implement that

it's working now!
tested with faithful for 1.14
mind you, it only copies the textures and not any model
you also need to actually use the 1.14 pack alongside the converted one

repo: deirn/resource-backports


text:
docs(managing_deis): Add notes on persisting CoreOS upgrades

closes #3149
closes #3155

This passed the docs tests in Jenkins and is ready for review.

lgtm! These are good changes.

LGTM.

source: gharchive/pull-request

authors: bacongobbler carmstrong mboersma

repo: deis/deis


text:
chore(cli): Add semver to CLI

This adds semantic versioning (based on git tag) to k8s-claimer. This will allow other Docker builds that reference it (e.g. e2e-runner or go-dev) to pick a version by semver instead of an opaque git sha.

Current coverage is 55.96% (diff: 100%)

Merging #90 into master will not change coverage

@@             master        #90   diff @@
==========================================
  Files            21         21
  Lines           520        520
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
  Hits            291        291
  Misses          190        190
  Partials         39         39

Powered by Codecov. Last update e4dcc16...a536fed

Tested, looks good here:
$ make bootstrap build-cli
go build -ldflags "-s -X main.version=git-a536fed" -o k8s-claimer-cli ./cli
$ ./k8s-claimer-cli --version
k8s-claimer version git-a536fed
$ git tag 1.2.3 && make build-cli
go build -ldflags "-s -X main.version=1.2.3" -o k8s-claimer-cli ./cli
$ ./k8s-claimer-cli --version
k8s-claimer version 1.2.3

@mboersma fwiw, I also tested with the build-cli-cross target that Travis executes.

authors: codecov-io krancour mboersma


text:
Deis Workflow v2.9.1 deis pull deis/example-go -a  Error

I'm trying to test Deis Workflow. My cluster is good and running fine, but when i try to do
deis pull deis/example-go -a  molten-electron
I'm getting error
Creating build... Error: Unknown Error (400): {"detail":"'NoneType' object is not iterable"}
When i look into the logs for deis-controller using
kubectl logs -f deis-controller-2092062600-xdd1g --namespace=deis
i get error
INFO Pulling Docker image deis/example-go:latest
INFO Tagging Docker image deis/example-go:latest as localhost:5555/molten-  electron:v2
INFO Pushing Docker image localhost:5555/molten-electron:v2
INFO Pulling Docker image localhost:5555/molten-electron:v2
INFO Pulling Docker image localhost:5555/molten-electron:v2
INFO [molten-electron]: adding 5s on to the original 120s timeout to account   for the initial delay specified in the liveness / readiness probe
INFO [molten-electron]: This deployments overall timeout is 125s - batch timout is 125s and there are 1 batches to deploy with a total of 1 pods
INFO [molten-electron]: waited 10s and 1 pods are in service
INFO [molten-electron]: waited 20s and 1 pods are in service
INFO [molten-electron]: waited 30s and 1 pods are in service
INFO [molten-electron]: waited 40s and 1 pods are in service
INFO [molten-electron]: waited 50s and 1 pods are in service
INFO [molten-electron]: waited 60s and 1 pods are in service
INFO [molten-electron]: waited 70s and 1 pods are in service
INFO [molten-electron]: waited 80s and 1 pods are in service
INFO [molten-electron]: waited 90s and 1 pods are in service
INFO [molten-electron]: waited 100s and 1 pods are in service
INFO [molten-electron]: waited 110s and 1 pods are in service
INFO [molten-electron]: waited 120s and 1 pods are in service
ERROR:root:'NoneType' object is not iterable
Traceback (most recent call last):
File "/app/api/models/build.py", line 65, in create self.app.deploy(new_release)
File "/app/api/models/app.py", line 545, in deploy
release.cleanup_old()
File "/app/api/models/release.py", line 267, in cleanup_old
for controller in controllers['items']:
TypeError: 'NoneType' object is not iterable

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/rest_framework/views.py", line 474, in dispatch
response = handler(request, *args, **kwargs)
File "/app/api/views.py", line 185, in create
return super(AppResourceViewSet, self).create(request, **kwargs)
File "/usr/local/lib/python3.5/dist-packages/rest_framework/mixins.py", line 21, in create
self.perform_create(serializer)
File "/app/api/viewsets.py", line 21, in perform_create
self.post_save(obj)
File "/app/api/views.py", line 268, in post_save
self.release = build.create(self.request.user)
File "/app/api/models/build.py", line 79, in create
raise DeisException(str(e)) from e
api.exceptions.DeisException: 'NoneType' object is not iterable
10.2.50.10 "POST /v2/apps/molten-electron/builds/ HTTP/1.1" 400 46 "Deis Client v2.9.1"

Can you guys please help what went wrong?

This error occurs on kubernetes v1.5.1. Can you try this using Workflow v2.9.1? We explicitly rolled that out yesterday for 1.5.1 compatibility.

for reference: https://github.com/deis/controller/pull/1178

I'm using Deis v2.9.1 and
kubernetes version is
Client Version: version.Info{Major:"1", Minor:"4", GitVersion:"v1.4.6", GitCommit:"e569a27d02001e343cb68086bc06d47804f62af6", GitTreeState:"clean", BuildDate:"2016-11-12T05:22:15Z", GoVersion:"go1.6.3", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"5", GitVersion:"v1.5.1+coreos.0", GitCommit:"cc65f5321f9230bf9a3fa171155c1213d6e3480e", GitTreeState:"clean", BuildDate:"2016-12-14T04:08:28Z", GoVersion:"go1.7.4", Compiler:"gc", Platform:"linux/amd64"}
But still getting the issue

Can you confirm with deis version --all? That exact code:
for controller in controller['items']:
Was what was fixed in v2.9.1.

when i did deis version --all i get

Workflow CLI Version:            v2.9.1
Workflow CLI API Version:        2.3
Workflow Controller API Version: 2.3

can you please tell me how to upgrade the version. do I need to update deis version or only Controller api version, Im already using deis v2.9.1

Your client is v2.9.1 but you need to upgrade the platform as well.
You'll need to follow the upgrading documentation to upgrade the platform. You'll want to upgrade to v2.8 or v2.9 via helm-classic, then use the workflow-migration project to migrate over to helm. From there you'll want to run helm upgrade to bring the platform up to v2.9.1.
Hope this helps!

Just an FYI that you might want to upgrade your kubectl client as well. Your kubernetes cluster is at v1.5.1 but your client is at v1.4.6.

i did
helm upgrade chucky-bucky  deis/workflow --version=v2.9.1
but i got
Fetched deis/workflow to workflow-v2.9.1.tgz
Error: UPGRADE FAILED: release: not found

That's why I said

You'll want to upgrade to v2.8 or v2.9 via helm-classic first, then use the workflow-migration project to migrate over to helm. From there you'll want to run helm upgrade to bring the platform up to v2.9.1.

I did
helm list
and got back

NAME          	REVISION	UPDATED                 	STATUS  	CHART
xrayed-unicorn	1       	Fri Dec 16 20:59:08 2016	DEPLOYED	workflow-migration-v1.0.0
yucky-gecko   	2       	Fri Dec 16 21:39:36 2016	DEPLOYED	workflow-v2.9.1

i guess i have updated deis :) . how to verify it

use deis version --all again.

its saying

Workflow CLI Version:            v2.9.1
Workflow CLI API Version:        2.3
Workflow Controller API Version: 2.3

but earlier

yucky-gecko 2 Fri Dec 16 21:39:36 2016	DEPLOYED	workflow-v2.9.1

was

yucky-gecko 2 Fri Dec 16 21:39:36 2016	DEPLOYED	workflow-v2.9.0

I'd check your client settings and ensure it's targeting the right endpoint. You might be hitting a different cluster then. Check the troubleshooting docs if you're having more trouble.
$ cat ~/.deis/client.json
$ deis login http://blahblah...

It worked I'm now able to deploy the application.
I setup coreos cluster in Virtual box and then Kubernetes and then deis, now everything is working fine,
Thanks a lot 👍.
Now i want to see the deis workflow dashboard for monitoring loging and cluster health, can you point me in right direction.
Thanks :)

https://deis.com/docs/workflow/managing-workflow/platform-monitoring/
https://deis.com/docs/workflow/managing-workflow/platform-logging/

authors: bacongobbler dinkarthakur

repo: deis/workflow

license: mit


text:
Chore: bump version to v0.4.0

@devigned Do we want to follow the runtimeclass and shim binary versioning scheme described in https://github.com/deislabs/containerd-wasm-shims/pull/16?

@devigned Do we want to follow the runtimeclass and shim binary versioning scheme described in #16?

Remind me. Did we determine that existing workloads will not run with the latest versions of the shims?

Also reminds me to get the #16 updated and merged. I'll do that today.

@devigned Do we want to follow the runtimeclass and shim binary versioning scheme described in #16?

Remind me. Did we determine that existing workloads will not run with the latest versions of the shims?

I believe the existing slight workloads will not run with the v0.4.0 slight shim. The reason for that is we renamed http to http-server to accomondate the addition of htto-client capability.

authors: Mossaka devigned

repo: deislabs/containerd-wasm-shims


text:
执行felix sshw启动报错

root@debian:/opt/goproject/src/github.com/dejavuzhou/felix# felix sshw
panic: interface conversion: interface {} is string, not []uint8 [recovered]
panic: interface conversion: interface {} is string, not []uint8
goroutine 1 [running]:
github.com/jinzhu/gorm.(*Scope).callCallbacks.func1(0xc00016d900)
/opt/goproject/src/github.com/jinzhu/gorm/scope.go:884 +0xb0
panic(0xc85400, 0xc00018d080)
/opt/soft/go/src/runtime/panic.go:522 +0x1b5
github.com/dejavuzhou/felix/models.(*JsonArrayUint).Scan(0xc00008c560, 0xc37ce0, 0xc0003f0d30, 0x7ff00783d238, 0xc00008c560)
/opt/goproject/src/github.com/dejavuzhou/felix/models/j_array_uint.go:16 +0xa3
database/sql.convertAssignRows(0xcc2d20, 0xc00008c560, 0xc37ce0, 0xc0003f0d30, 0xc00016da00, 0xc00008c560, 0x0)
/opt/soft/go/src/database/sql/convert.go:378 +0x189a
database/sql.convertAssignRows(0xc000066a00, 0xc000010aa0, 0xc37ce0, 0xc0003f0d30, 0xc00016da00, 0x0, 0x0)
/opt/soft/go/src/database/sql/convert.go:421 +0xf2f
database/sql.(*Rows).Scan(0xc00016da00, 0xc0000c22a0, 0xe, 0xe, 0xc000074798, 0xc000010aa0)
/opt/soft/go/src/database/sql/sql.go:2955 +0x212
github.com/jinzhu/gorm.(*Scope).scan(0xc00016d900, 0xc00016da00, 0xc0000c2000, 0xe, 0xe, 0xc00016db00, 0xf, 0x10)
/opt/goproject/src/github.com/jinzhu/gorm/scope.go:532 +0x55b
github.com/jinzhu/gorm.queryCallback(0xc00016d900)
/opt/goproject/src/github.com/jinzhu/gorm/callback_query.go:79 +0x5f8
github.com/jinzhu/gorm.(*Scope).callCallbacks(0xc00016d900, 0xc0001a1520, 0x3, 0x4, 0x0)
/opt/goproject/src/github.com/jinzhu/gorm/scope.go:888 +0x88
github.com/jinzhu/gorm.(*DB).First(0xc0003e7110, 0xcec7e0, 0xc0001aae10, 0x0, 0x0, 0x0, 0xc68ce0)
/opt/goproject/src/github.com/jinzhu/gorm/main.go:331 +0x128
github.com/jinzhu/gorm.(*DB).FirstOrCreate(0xc0003e7110, 0xcec7e0, 0xc0001aae10, 0x0, 0x0, 0x0, 0xc0003e7110)
/opt/goproject/src/github.com/jinzhu/gorm/main.go:425 +0x9c
github.com/dejavuzhou/felix/models.(*User).CreateInitUser(0xc0001aae10, 0xc0001aae10, 0x9)
/opt/goproject/src/github.com/dejavuzhou/felix/models/m_users.go:107 +0xfd
github.com/dejavuzhou/felix/models.CreateSqliteDB(0x0)
/opt/goproject/src/github.com/dejavuzhou/felix/models/db.go:41 +0x5a8
github.com/dejavuzhou/felix/cmd.initFunc()
/opt/goproject/src/github.com/dejavuzhou/felix/cmd/root.go:53 +0x2c
github.com/spf13/cobra.(*Command).preRun(0x1861240)
/opt/goproject/src/github.com/spf13/cobra/command.go:856 +0x49
github.com/spf13/cobra.(*Command).execute(0x1861240, 0x18ca6c8, 0x0, 0x0, 0x1861240, 0x18ca6c8)
/opt/goproject/src/github.com/spf13/cobra/command.go:792 +0x146
github.com/spf13/cobra.(*Command).ExecuteC(0x185ecc0, 0xc000021200, 0x18a9680, 0x0)
/opt/goproject/src/github.com/spf13/cobra/command.go:914 +0x2fc
github.com/spf13/cobra.(*Command).Execute(...)
/opt/goproject/src/github.com/spf13/cobra/command.go:864
github.com/dejavuzhou/felix/cmd.Execute(0x0, 0x0, 0x0, 0x0)
/opt/goproject/src/github.com/dejavuzhou/felix/cmd/root.go:37 +0x7c
main.main()
/opt/goproject/src/github.com/dejavuzhou/felix/main.go:8 +0x51

应该是sqlite3 json 字段的问题, 删除 users 这种表 让gorm自动迁移一次 或者执行 felix flush 命令

执行felix clean 删除之前的sqlite数据

authors: JJJJJJJerk mojocn zhengerfu

repo: dejavuzhou/felix


text:
Facebook redirection is loading the whole website without logging in the user

I clicked on the button of facebook to login with it; it opened a new windows to log in facebook but after providing all the information it that window and successfully log in facebook, it loaded by going to the link : https://mydomain.com/index.php#=
I have configured my redirection url in my app dashboard to : https://mydomain.com/index.php-
| Yii2 version      |
| Yii2-user 0.9.12|
| PHP 7       |

You can make a PR?

authors: MagSag thiagotalma


text:
Error when attempting to run Pacman effect

I just got a second set of Tiles, set them up and stacked them on top of the first set, resulting in two parallel horizontal lines. When I attempt to run the Pacman effect, I get an TypeError: 'float' object cannot be interpreted as an integer. Previously, with one set of Tiles, the effect ran without issue.

Ok, are you able to run this command and give me the results:
lifx lan:get_device_chain --silent
And I'll see if I can replicate it

actually, I should have tried to run it first, the same thing happens on my tiles already!

So do you want to see the results of the command you asked me to run?
“Wise men speak because they have something to say; Fools because they have to say something.” -Plato

On Aug 13, 2020, at 10:12 PM, Stephen Moore notifications@github.com wrote:
authored

just a heads up, I get the same error when attempting to run Marquee

yeah, I should have enough information.
Marquee is essentially the same code so it makes sense that'd be broken too

That literally took me a minute to figure out lol

I have released 0.30.3 with this fix :)

Awesome. Now I have to see if I can remember the command to update... feel free to tell me.

On Aug 14, 2020, at 7:49 PM, Stephen Moore notifications@github.com wrote:

I have released 0.30.3 with this fix :)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

When you've activated your virtualenv
pip install lifx-photons-core -U
:)

Thanks again Brother

On Aug 15, 2020, at 12:17 AM, Stephen Moore notifications@github.com wrote:

When you've activated your virtualenv
pip install lifx-photons-core -U
:)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

You're welcome!

Got one more for ya, wherein my playlist used to end and go back to the command line,  I’m suddenly seeing this

On Aug 15, 2020, at 12:19 AM, Stephen Moore notifications@github.com wrote:

You're welcome!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

I feel that reply is incomplete, either way, please make a new issue for it :)

authors: MyEyesHaveSeen delfick

repo: delfick/photons


text:
Qr Scanner

how to add Qr scanner in AdvancedWebview

That is not part of this library and not related in any way, it seems. Sorry!

authors: ocram tegarkurniawan

repo: delight-im/Android-AdvancedWebView


text:
README differs from docker-compose.yml

A change was merged recently that moved nginx servers from port 8080 to 8082, but the documentation was not updated to match.
Can this be fixed?

Also, the default ports in the Python scripts are still 8080

Sorry to be confusing, it was my fault. My local 8080 was occupied, so I changed it, and forgot to change it back in the PR.

repo: delimitrou/DeathStarBench


text:
Do not load full source into RAM on write_to_deltalake

Description
In python/lib.rs, the first thing that happens on write_to_deltalake is to collect to batches to a Vec. This loads all RecordBatches into RAM, no? This seems like not a good thing to me. I think the main reason is that write.rs tries to get the schema from the batches, but the schema would have been known in python anyway, so why not pass it directly?
Use Case
I don't want to waste resources ;)
Related Issue(s)

@aersam correct, it's not the efficient way to do that :) Will already mentioned an improvement over that, which I've logged here https://github.com/delta-io/delta-rs/issues/1984

I can pick it up, but I'd rather do it on the write.rs operation

@aersam that's fine!

Ok, I see partioning makes this quite complicated 🙂 And MemoryExec of DataFusion is not helpful, so might take some time

authors: aersam ion-elgreco

repo: delta-io/delta-rs


text:
fix(python): fix schema conversion of FixedSizeBinaryArray

Description
Map FixedSizeBinaryType to BinaryArray, since Delta does not support fixed arrays.
Related Issue(s)
None.
Documentation
N/A
Minimal Example
I've noticed this error when doing subsequent calls to like so:
import deltalake as dl
import pyarrow as pa

schema = pa.schema([
    ("field_a", pa.binary(4)),
    # To simulate fix, switch this line to: ("field_a", pa.binary()),
])
table = pa.Table.from_pylist(
    [
        {"field_a": val.to_bytes(4, "little")}
        for val in range(0, 100)
    ],
    schema=schema
)

# This works
dl.write_deltalake(
    "bad_table",
    data=table,
    mode="append",
)

# This fails
dl.write_deltalake(
    "bad_table",
    data=table,
    mode="append",
)

with error:
ValueError: Schema of data does not match table schema
Data schema:
field_a: fixed_size_binary[4]
Table Schema:
field_a: binary

@balbok0 can you extend the tests also to include this fixedSizedBinary

I changed one test case to include a check for fixed binary. I think it should be enough (unit test-wise), since it's a really small change, but let me know if you would like more checks, just in case.
For more-integration like, is there a test case with repeated write to a tmp_path or existing_table that I can reference? I tried looking for it, but couldn't find any.

I changed one test case to include a check for fixed binary. I think it should be enough (unit test-wise), since it's a really small change, but let me know if you would like more checks, just in case.
For more-integration like, is there a test case with repeated write to a tmp_path or existing_table that I can reference? I tried looking for it, but couldn't find any.

Actually, I just found the same exact issue with pa.FixedSizeListType, so bundled a fix with this PR.

Actually, I just found the same exact issue with pa.FixedSizeListType, so bundled a fix with this PR.

You need to set the type hints properly in the functions and also define the stubs

Hi, sorry for being slow on resolving issues. I've fixed a typo on one of the tests I added. Just to be sure:

I've noticed a lot of currently existing tests failing/erroring. I assume these are not related?
Is it ok to skip the integration tests in this case?

@balbok0 no the tests are related, I suggest you execute it locally to debug. Decimal is hit as a false positive while doing the schema change, so the logic needs fixing

Ok, switched it to type instead of isinstance, which will not include DecimalType from pyarrow. As far as I tested locally tests should pass.


text:
Update Delta to support Apache Spark 3.2

With the upcoming Spark 3.2 release, ensure Delta can support the latest release.

Resolved by https://github.com/delta-io/delta/commit/5571d95966e3b03c4699dcfa1a5cd86bb16447dc
We will make a release soon.

This is awesome~ Would that be possible to cross-build for 2.13 since Spark 3.2 supports it?

@ghostdogpr Yep. #823 is updating the code for Scala 2.13

Hi,
I see v1.1.0 release is ready, I'm curious if there will be a compiled jar on Maven like for v1.0.0, or we'll have to switch to compiling ourselves for a while?
And thanks for all the great work you are doing!

authors: dennyglee george-zubrienko ghostdogpr zsxwing

repo: delta-io/delta


text:
Draft: Embed GitHub gist

This aims to solve #33
I had it laying here for a while but didn't get to finish. I'll do some touch ups and update the description with images
No styles as of now. Github endpoint provides a stylesheet url but I haven't got around how to use it without writing a webcomponent, neither writing a webcomponent lol, yet. I think this needs default styling to make it easier to just use without having to write CSSfor each possible syntax.
TODO:

[ ] Add matcher file
[ ] Add tests

Thank you
Styled:

Unstyled:

Master

authors: christianlantin vasfvitor

repo: delucis/astro-embed


text:
Issue with Set Process Stage

Sorry to bother you, but I seem to be having a problem with the "Set Process Stage".  I always get a "Business Process Error" when I attempt to run a workflow with the "Set Process Stage" step in it.  We are running Dynamics 365 on premise v 8.2.0.749, and I installed version 1.0.38.0 of your Workflow Tools.  In the configuration of the "Set Process Stage" step, I have the Record URL set of the same entity that the workflow is part of; the Business Process Flow of the same entity is selected in the "Process" field, and the Process Stage Name is the stage I want to change to.  The error details do not really help, but here they are...
ErrorDetails.txt
Any ideas?

Hi EivionSW, I just tested on a Dynamics 365 environment and works fine.
check the documentation here: https://github.com/demianrasko/Dynamics-365-Workflow-Tools/blob/master/docs/Set Process Stage.md
and then check:

if the parameters are ok (please share)
Check if the Stage name (third parameter) is not the name you see in the process on the record form, it must be the name on the name on the BPF configuration:

Hope this helps, otherwise, please share me more details.
regards!

Thanks for your reply…here are the details:
Properties of “Set Process Stage”
[cid:image001.png@01D2B1D8.4F26C980]
Business Process Flow: (the primary entity for the BPF is called “Education Benefit Application”
[cid:image002.png@01D2B1D8.4F26C980]
From: Demian Adolfo Raschkovan [mailto:notifications@github.com]
Sent: Saturday, April 08, 2017 7:06 PM
To: demianrasko/Dynamics-365-Workflow-Tools Dynamics-365-Workflow-Tools@noreply.github.com
Cc: Williams, Sean (ITS) Sean.Williams@its.ny.gov; Author author@noreply.github.com
Subject: Re: [demianrasko/Dynamics-365-Workflow-Tools] Issue with Set Process Stage (#3)
ATTENTION: This email came from an external source. Do not open attachments or click on links from unknown senders or unexpected emails.
Hi EivionSW, I just tested on a Dynamics 365 environment and works fine.
check the documentation here: https://github.com/demianrasko/Dynamics-365-Workflow-Tools/blob/master/docs/Set Process Stage.md
and then check:

if the parameters are ok (please share)
Check if the Stage name (third parameter) is not the name you see in the process on the record form, it must be the name on the name on the BPF configuration:
[image]https://cloud.githubusercontent.com/assets/18124945/24833146/a380a26e-1cc0-11e7-8991-9fd1bf135d95.png

Hope this helps, otherwise, please share me more details.
regards!
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/demianrasko/Dynamics-365-Workflow-Tools/issues/3#issuecomment-292751836, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AZuykiFFPu1T5K_Bhs8ZRjg6jdsTsp6qks5ruBLcgaJpZM4M2IzM.

Hi EivionSW, I cannot see the images...

That’s okay, Demian…I’ve decided to go in a slightly different direction.  The “Set Process” works perfectly, and I can use this instead.  Thanks for your help!
From: Demian Adolfo Raschkovan [mailto:notifications@github.com]
Sent: Monday, April 10, 2017 10:40 AM
To: demianrasko/Dynamics-365-Workflow-Tools Dynamics-365-Workflow-Tools@noreply.github.com
Cc: Williams, Sean (ITS) Sean.Williams@its.ny.gov; Author author@noreply.github.com
Subject: Re: [demianrasko/Dynamics-365-Workflow-Tools] Issue with Set Process Stage (#3)
ATTENTION: This email came from an external source. Do not open attachments or click on links from unknown senders or unexpected emails.
Hi EivionSW, I cannot see the images...
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/demianrasko/Dynamics-365-Workflow-Tools/issues/3#issuecomment-292969648, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AZuykoiRmKbI1oJ7F21pZWnBgrpXKtgIks5ruj8mgaJpZM4M2IzM.

authors: EivionSW demianrasko

license: MS-PL


text:
Update README.md

Status

[ ] In Progress
[ x ] Ready
[ ] In Hold - (Reason for hold)

Related Issues
N/A
Description
Fix link to Remote Env. guide, as the old did not exist anymore.
Does it break backward compatibility?

[ ] Yes

Further details:

[x] No

Must have

[ x ] Tests
[ x ] Documentation

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thank you for the contribution!

authors: CLAassistant ilaner pensivepaddle

repo: demisto/vscode-extension


text:
Enable nested code-samples to be highlighted

The former code chose every n-th "pre"-element, which was a direct child of the slide's section-element. It has been modified to query all "pre"-elements in the slide and choose the n-th element. This allows code-fragements to be displayed beside each other using e.g. flexbox.
Because querySelectorAll() uses pre-order traversal, the numbering would match the html-definition:

Thanks for this! I'll look at it again to see if there's a better way, otherwise I'll merge it soon!

authors: demoneaux j-moeller

repo: demoneaux/reveal-code-focus


text:
Forking logic using Result.Error

So i've got this logic:
  cacheGet
    | Success -> return data
    | Failure ->
        apiGet
        |> cacheSet

So if cacheGet is successful, then we just return the data.
If cacheGet fails, then we just go straight to the API, once the data comes back, if that is successful, cache it, otherwise filter the data through....
Obviouly this is a little trickier because everything is basically a return function ('a -> Task<Result<'b'c>>) and we're replacing the error branch with further successes....
I don't know if this problem is resonating with anyone, but to solve, I've created
module TaskResult =
   // inspired by the Result.valueOf
  let bindValueOr f res = // ('a -> Task<Result<'b,'c>>) -> Result<'b,'a> -> Task<Result<'b, 'c>>
    match res with
    | Ok x -> Task.singleton (Ok x)
    | Error x -> f x

  let bindTRValueOr f taskResult = // ('a -> Task<Result<'b,'c>>) -> Task<Result<'b,'a>> -> Task<Result<'b,'c>>
    taskResult |> Task.bind (bindValueOr f)

and usage:
  let apiGet = // () -> Task<Result<'a,'b>>
  let apiGetThenCache = // Task<Result<'a,'c>>
    apiGet()
        |> TaskResult.bind (fun (a, b) ->
            Caching.cacheData b  |> Task.map (fun _ -> Ok a) // I want to store b, but return a, a is the deserialised form
          )

  Caching.hasCachedData
  |> Task.bindTRValueOr apiGetThenCache

I don't know if this is sparking anyone's thoughts - or if I've completely misused the suite of functions.... if there is a simpler way with existing
If there isn't - what would be the appropriate way/hunger to incorporate this into the current library?

Sorry for the late response:
I think the term we'd want to go with is orElse which I think is used in the Option.OrElse module.


text:
Making TaskResult and JobResult libraries

It was requested via twitter to have a TaskResult added to this library.  I do believe this would be a good idea, as I also work with task heavy CE workloads and rely on the Result type.
As mentioned in that tweet thread, since the main library wants to be Fable compatible, it would have to be its own separate library. FsToolkit.ErrorHandling.Tasks (something something naming is hard).
In addition to this, I use Hopac quite a bit and have authored the Chessie.Hopac. Similar to the above, it would be its own library FsToolkit.ErrorHandling.Hopac.
I'd be willing to implement both of these libraries if this proposal makes sense.

It makes sense to have them as separate libraries and keep this one only depends on FSharp.Core.
How do you want to go about it? Can we have it as a mono-repo here with the build script publishing three different packages or separate repositories in your GitHub account? I am fine with whatever works for you.

Agree that separate libraries should be used here.
Since Task is hot (as opposed to Async being cold), are there any composability concerns relevant here? I think I remember someone claiming in a blog post or some such that Task being hot makes it less composable than Async, though I can't immediately see exactly how (provided similar combinators for Task as for Async).

@demystifyfp  I think keeping it in this repository makes sense.  Easier for the dependent libraries to adjust to changes.
@cmeeren Yeah 99% of Tasks are started or "hot" by the time you get a reference to them, so yes they are less composable. Also there's other downsides like they're not tail call optimized. The main benefit of using Task over Async is the speed bonus.  However it may remain to be seen if having taskResult keeps speed up.  I would probably need to make a benchmark for that as well.

so yes they are less composable

But why/how, in concrete terms? And are there any concerns of relevance to usage of a taskResult CE?

Well some people's definition of composable implies laziness/cold so you're dealing with slightly different semantics about how your FuturesObject will behave.  But really it's not less "composable" in the strict sense of the word.

Thanks, @TheAngryByrd for initiating this. Feel free to let me know If there is any help required.

@TheAngryByrd Have you seen this https://github.com/crowded/ply ?

Yes it's pretty awesome work. Not sure if I'll use it quite yet.

Would be quite a lot of builders! taskResult, taskResultOption, vtaskResult, etc...

authors: TheAngryByrd cmeeren demystifyfp


text:
🛑 DC Main is down

In 2013e07, DC Main (https://www.dencap.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: DC Main is back up in 11484b6.

repo: dencap/Upptime


text:
Sponsored Products version 3 migration >> Campaigns

[PLANNED DEPRECATION 6/30/2023]
Migration Guide

#130

repo: denisneuf/python-amazon-ad-api


text:
Upgrade to Methadone 1.9.1

As discussed in https://github.com/davetron5000/methadone/pull/95
Merged upstream changes from tab v1.9.1 and fixed the build to pass.

tests pass but seems that the coverage report is failing.
Finished in 1.316846085 seconds.
140 tests, 76 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications
100% passed
106.31 tests/s, 57.71 assertions/s
Coverage report generated for Unit Tests to /home/travis/build/dennisjbell/methadone-clinic/coverage. 668 / 687 LOC (97.23%) covered.
Ambiguous match of "the directory "tmp/newgem" does not exist":
aruba-0.9.0/lib/aruba/cucumber/file.rb:56:in /^(?:a|the) directory(?: named)? "([^"]*)" does not exist$/' features/step_definitions/bootstrap_steps.rb:4:in /^the directory "([^"]*)" does not exist$/'
You can run again with --guess to make Cucumber be more smart about it

repo: dennisjbell/methadone-clinic


text:
feat: enhance dynamic import with template argument

We now support dynamic imports with template arguments:
import("./a/${test}/.mod.ts")

This will include all files matching ./a/**/mod.ts.
The problem:
Many libraries that use Deno FFI require multiple files compiled for specific platforms. For example:
Library entry:

https://jsr.io/@scope/mylib/0.0.1/mod.ts

const lib = await import(`./ffi/${Deno.build.target}/ffi.ts`);

The files compiled for multiple platforms:

https://jsr.io/@scope/mylib/0.0.1/ffi/aarch64-apple-darwin/ffi.ts
https://jsr.io/@scope/mylib/0.0.1/ffi/x86_64-unknown-linux-gnu/ffi.ts
https://jsr.io/@scope/mylib/0.0.1/ffi/x86_64-pc-windows-msvc/ffi.ts
...

In our project:
// main.ts
import xxx from "jsr:@scope/mylib"
...

Then use deno compile:
deno compile --unstable-ffi  --include ... main.ts

Currently, we have to manually --include all the files regardless of the actual platform it will run on:
deno compile --unstable-ffi  --include https://jsr.io/@scope/mylib/0.0.1/ffi/aarch64-apple-darwin/ffi.ts --include https://jsr.io/@scope/mylib/0.0.1/ffi/x86_64-unknown-linux-gnu/ffi.ts main.ts

This is inconvenient, especially after updating jsr:@scope/mylib, as we have to carefully --include the correct version:

- --include https://jsr.io/@scope/mylib/0.0.1/ffi/aarch64-apple-darwin/ffi.ts
+ --include https://jsr.io/@scope/mylib/0.0.2/ffi/aarch64-apple-darwin/ffi.ts

It also increases the bundle size since we actually need only one of the files.

Another option is to statically import all the FFI files, as shown here:

it will be more complicated to maintain the library, and also will incrase the compiled bundle size.
Proposal
Analyze the expressions in the template argument in specific cases if they are known at compile time:
import(`./${Deno.build.target}/mod.ts`)

We can replace ${Deno.build.target} with correct target
import("./aarch64-apple-darwin/mod.ts")

which then become statically analyzable.
Proof of work
I have created a patch and some tests for deno_graph which rely on this PR:
https://github.com/denoland/deno_graph/compare/main...Mutefish0:deno_graph:feat-enhance-dynamic-import#diff-7ff815b68943f08bef79f083c09e55ca8c18db8e25033034b12fa31f1d43dab4R438
Related Issues
https://github.com/denoland/deno/issues/24871

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


text:
Prevent panic: Custom error class must have a builder registered: Uncaught null

Note: This isn't so much a fix (yet) but a starting point for discussion.
We've been running into a panic in to_v8_error: Custom error class must have a builder registered: Uncaught null. This panic has the unfortunate side effect of being unrecoverable, taking down one of our production services.
Here's a stack trace from lldb:
Unexpectedly panicked!: Custom error class must have a builder registered: Uncaught null
...
fatal runtime error: failed to initiate panic, error 5
Process 34421 stopped
* thread #21, stop reason = signal SIGABRT
    frame #0: 0x000000019e462a60 libsystem_kernel.dylib`__pthread_kill + 8
libsystem_kernel.dylib`__pthread_kill:
->  0x19e462a60 <+8>:  b.lo   0x19e462a80    ; <+40>
    0x19e462a64 <+12>: pacibsp
    0x19e462a68 <+16>: stp    x29, x30, [sp, #-0x10]!
    0x19e462a6c <+20>: mov    x29, sp
(lldb) bt
* thread #21, stop reason = signal SIGABRT
  * frame #0: 0x000000019e462a60 libsystem_kernel.dylib`__pthread_kill + 8
    frame #1: 0x000000019e49ac20 libsystem_pthread.dylib`pthread_kill + 288
    frame #2: 0x000000019e3a7a20 libsystem_c.dylib`abort + 180
    frame #3: 0x00000001064e8ffc my_project`std::sys::pal::unix::abort_internal::h7fdb07780559b948 at mod.rs:369:14 [opt]
    frame #4: 0x00000001064e2a80 my_project`rust_panic at panicking.rs:832:5 [opt]
    frame #5: 0x00000001064e26d0 my_project`std::panicking::rust_panic_with_hook::h84760468187ddc85 at panicking.rs:801:5 [opt]
    frame #6: 0x00000001064e2034 my_project`std::panicking::begin_panic_handler::_$u7b$$u7b$closure$u7d$$u7d$::he666a5eb600a7203 at panicking.rs:657:13 [opt]
    frame #7: 0x00000001064e0b38 my_project`std::sys_common::backtrace::__rust_end_short_backtrace::h592f44d2bf9f843f at backtrace.rs:171:18 [opt]
    frame #8: 0x00000001064e1dac my_project`rust_begin_unwind at panicking.rs:645:5 [opt]
    frame #9: 0x0000000106595280 my_project`core::panicking::panic_fmt::h98bbf7bdf4994454 at panicking.rs:72:14 [opt]
    frame #10: 0x0000000103e021cc my_project`core::panicking::panic_display::h49a5f85cc12b168a(x=0x0000000171fe9230) at panicking.rs:197:5
    frame #11: 0x000000010656e3f8 my_project`deno_core::error::to_v8_error::panic_cold_display::h5afd472d602e0190(arg=0x0000000171fe9230) at panic.rs:99:13
    frame #12: 0x0000000103dbedc4 my_project`deno_core::error::to_v8_error::h815a6b2d2ccf79fc(scope=0x0000000171feaf78, get_class=&dyn core::ops::function::Fn<(&anyhow::Error), Output=&str> @ 0x0000000171fe9388, error=0x0000000171feb6e8) at error.rs:130:7
    frame #13: 0x0000000100192fa0 my_project`my_project_ext::bindings::op_sign_ecdsa::op_sign_ecdsa::v8_fn_ptr::h37d3f58f24cd364b [inlined] my_project_ext::bindings::op_sign_ecdsa::op_sign_ecdsa::slow_function_impl::hc80cd1f40c0a8958(info=0x0000000171fed778) at bindings.rs:255:1
    frame #14: 0x000000010018faf8 my_project`my_project_ext::bindings::op_sign_ecdsa::op_sign_ecdsa::v8_fn_ptr::h37d3f58f24cd364b(info=0x0000000171fed778) at bindings.rs:255:1
    frame #15: 0x0000000105342f98 my_project`Builtins_CallApiCallbackGeneric + 184
    frame #16: 0x0000000105340ef0 my_project`Builtins_InterpreterEntryTrampoline + 272
    frame #17: 0x0000000105340ef0 my_project`Builtins_InterpreterEntryTrampoline + 272
    frame #18: 0x0000000105340ef0 my_project`Builtins_InterpreterEntryTrampoline + 272
    frame #19: 0x0000000105340ef0 my_project`Builtins_InterpreterEntryTrampoline + 272
    frame #20: 0x000000010533ec0c my_project`Builtins_JSEntryTrampoline + 172
    frame #21: 0x000000010533e8f4 my_project`Builtins_JSEntry + 148
    frame #22: 0x000000010432e080 my_project`::Invoke() at execution.cc:418:22 [opt]
    frame #23: 0x000000010432e660 my_project`::CallScript() at execution.cc:515:10 [opt]
    frame #24: 0x00000001042236d8 my_project`::Run() at api.cc:2170:7 [opt]
    frame #25: 0x0000000103e50e84 my_project`v8::script::_$LT$impl$u20$v8..data..Script$GT$::run::_$u7b$$u7b$closure$u7d$$u7d$::hc55df96f0e9b0c0f((null)={closure_env#0} @ 0x0000000171fede38, sd=0x00006000021245b0) at script.rs:94:29
    frame #26: 0x0000000103db1654 my_project`v8::script::_$LT$impl$u20$v8..data..Script$GT$::run::ha661a3fa3c29b130 [inlined] v8::scope::HandleScope$LT$$LP$$RP$$GT$::cast_local::h2648d36164639866(self=0x0000000171fee3d8, f={closure_env#0} @ 0x0000000171fedf68) at scope.rs:239:21
    frame #27: 0x0000000103db1374 my_project`v8::script::_$LT$impl$u20$v8..data..Script$GT$::run::ha661a3fa3c29b130(self=0x000000015405da48, scope=0x0000000171fee3d8) at script.rs:94:7
    frame #28: 0x0000000103f25450 my_project`deno_core::runtime::jsrealm::JsRealm::execute_script::hc4f0f80d4eb346fa(self=0x0000000171ff4c98, isolate=0x00000001380b0000, name=FastString @ 0x0000000171fee950, source_code=FastString @ 0x0000000171fee968) at jsrealm.rs:289:11
    frame #29: 0x000000010273864c my_project`deno_core::runtime::jsruntime::JsRuntime::execute_script::haf61263922869892(self=0x0000000171ff4c80, name=(data_ptr = "<user_provided_script>Uncaught Error: execution terminatedError running worker.execute_script(): Your function exceeded the maximum runtime of ms and was terminated.Your function exceeded the maximum memory of  MB and was terminated.Event loop has completed: ", length = 22), source_code=String @ 0x0000000171fef2f0) at jsruntime.rs:1346:5
    frame #30: 0x0000000100130ff8 my_project`my_project_server::runtime::execute_js::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h343ae0eabc6afa3b((null)=0x0000000171ff41c0) at runtime.rs:302:21
...

For context: We've implemented ops that communicate with another process via gRPC. If that other process disconnects for whatever reason, the panic is (sometimes?) triggered. In that case to_v8_error receives this error from tonic:
Error {
    context: "op_sign_ecdsa",
    source: Disconnected,
}

And the JsError inside the has_caught block looks like this:
JsError {
    name: None,
    message: None,
    stack: None,
    cause: None,
    exception_message: "Uncaught null",
    frames: [],
    source_line: None,
    source_line_frame_index: None,
    aggregated: None,
}

As you can see in the diff, I've added a workaround that works for us but is likely not a proper fix.
I honestly don't know what "custom error class" means here or why it only fails in this particular case.
This problem has existed since at least Deno v1.37, with the difference that the affected ops now require to be marked as reentrant.
I can provide more info if needed. ✌

Rebased

@mlafeldt this seems reasonable, could you add a unit test that exercises this code path?

@mlafeldt this seems reasonable, could you add a unit test that exercises this code path?

@bartlomieju I'm trying. :)
However, as mentioned, I've yet to understand what's going on exactly.
The Uncaught null situation seems to occur when a reentrant op fails (in our case due to a closed flume channel) and the runtime is aborted by isolate.terminate_execution() at the same time. And it seems to happen for any error type (casting to generic_error did not help), so "Custom error class must have a builder registered" might not be the actual problem.

Interesting, any chance you could try to reproduce similar setup? It might be easier to do so in the checkin directory which is sort of a standalone runtime, than trying to do a unit test.

Thanks for the tip. Will take another look.
My main question right now is why maybe_exception ends up being None despite Uncaught null (even in case of a generic error), which triggers the panic.
https://github.com/denoland/deno_core/blob/c106dd1f639d8e18ed8ca9586dcba86b8f5a9183/core/error.rs#L145-L157

I'm not entirely sure, it might be a bug in rusty_v8 that improperly casts null into None.

@mlafeldt sorry for a slow turn-around. Do you have a test case for this particular panic? If so, can you please link it and I'll look into the problem. I'm really not a fan of matching on string repr of the error to change behavior (even though we already do it in a few places 😬).

authors: bartlomieju mlafeldt


text:
feat(realms): Support ESM extensions in realms

This PR adds support for ESM snapshots and preserve_snapshotted_modules to realms, as well as fixing a few bugs where JsRuntime::init_extension_js was using JsRuntime methods instead of JsRealm methods in ESM extension-related code.
It also adds realm-specific variants of a few ESM extensions tests.

LGTM -- we can resolve the conflict either by re-applying or using #[allow(deprecated)] for now. We should allow for direct source to be allowed in the extension! macro to avoid having to use the builder for this case.

LGTM -- we can resolve the conflict either by re-applying or using #[allow(deprecated)] for now. We should allow for direct source to be allowed in the extension! macro to avoid having to use the builder for this case.

I was already fixing the conflicts and changing any other new tests to use the Extension struct rather than the builder.

Thanks! I filed #90 to allow us to use the extension! macro more easily for these tests.

authors: andreubotella mmastrac


text:
getting-started page borken/incomplete

The getting-started page of the docs cuts off before explaining what the deno.json does and its nav link at the bottom of the page directs to itself.

Oh nevermind, reloading the page for some reason fixed both of these issues.

Oh nevermind, reloading the page a few times fixed both of these issues

repo: denoland/fresh


text:
assertEquals fails when comparing various Temporal instances with polyfill or --unstable-temporal flag

Describe the bug
assertEquals fails when comparing various Temporal instances with polyfill or --unstable-temporal flag.
Steps to Reproduce
deno repl --unstable-temporal

import { assert, assertEquals, assertThrows } from 'jsr:@std/assert@1.0.6'
assertEquals(Temporal.PlainDate.from('1999-09-09'), Temporal.PlainDate.from('1212-12-12'))
// doesn't throw assertion error

Equivalent results can be observed with unequal instances of Temporal.Instant, Temporal.ZonedDateTime, etc.
Expected behavior
assertEquals to throw when the instances are not value-equal.
Environment
OS: Ubuntu 20.04, WSL on Windows 11
deno version: 2.0.3
std version: assert@1.0.6

It looks like it's because objects are compared using own-properties, but all the properties of Temporal instances are defined on the prototype instead. I suspect this also means similar bugs exist for many other built-in and user-defined classes.
Possible means of patching for Temporal could include comparing toString or valueOf; a more generic fix could include comparing non-own properties up the prototype chain (not sure about perf implications though).

Possible means of patching for Temporal could include comparing toString or valueOf;

Adding special path for builtin Temporal makes sense to me (We already have special handling for Date). I don't think we need to do special things about polyfills.

Adding special path for builtin Temporal makes sense to me (We already have special handling for Date). I don't think we need to do special things about polyfills.

I agree that there should be no special handling for polyfills, but also any solution for built-in Temporal should work seamlessly for any correctly implemented polyfill. I only mentioned that the issue also affects the polyfill to rule out the possibility it could be a bug in the V8 harmony Temporal implementation.
I'm not sure to what extent special-casing Temporal really makes sense, except maybe implementing a fast path if that noticeably improves perf. Notably, URL and RegExp are similarly special-cased as well as Date, but other built-ins that library consumers might reasonably want to compare, such as URLSearchParams and URLPattern, are not (upon further testing, they also fail to throw when unequal).

Upon further testing, URLSearchParams and URLPattern also fail to throw when unequal do work correctly within Deno, but it seems that's only thanks to Deno's non-standard addition of own-property symbols to instances of those objects (e.g. URLPattern having a Symbol("components") property). So such comparisons work correctly within Deno, but fail in the browser. I'm not sure what the rationale was for adding those symbol properties in the first place, but it might be worth revisiting their use (e.g. switching to WeakMaps) given that it introduces inconsistency between Deno and browsers. Looks like there's an issue for this already: https://github.com/denoland/deno/issues/11720

Fair enough. Dependency to Deno's specific implementation doesn't sound great. #6153 makes sense to me.

repo: denoland/std


text:
Pull in upstream changes

Update all functions using new weight struct and new account id parameters
Fixes for changed extrinsic indicies in system pallet
Add installation docs
Remove pallets that are no longer in DENTNet:

Democracy
PhragmenElection
Claims
Bounties
ChildBounties
Tips

Ignore changes in deps/ folder, it's coming from a git subtree update

Superseded by new PR #9

repo: dentnet/ledger-dentnet