text:
[BUG] Databricks pass through authentication doesn’t work for any read operation

When using Rapids plugin with Databricks pass through authentication doesn’t work for any read operation (outside of dbfs)
when selecting from delta tables “Security Token Expired” error is displayed.
Steps/Code to reproduce bug
When creating Databricks cluster enable pass through authentication on standard cluster. Issue select statement on any delta table which is not on dbfs.
Expected behavior
Pass through authentication should work.
Environment details (please complete the following information)

Environment : Databricks 8.2 runtime on Azure

Spark configuration settings related to the issue
Pass through authentication enabled on Databricks runtime environment 8.2

Additional context
Add any other context about the problem here.
All functionality works as intended when data is on dbfs

@jlowe You are right.
I just used latest 21.12 snapshot jars and verified that https://github.com/NVIDIA/spark-rapids/issues/3903 is fixed.
However when writing dataframe to blob storage using passthrough auth, the issue still exists.
Here is my reproduce statement:
dfcustomer.write.mode("overwrite").format("delta").save("abfss://containerxxx@storagexxx.dfs.core.windows.net/delta/tablename")

It will fail with:
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 25.0 failed 4 times, most recent failure: Lost task 1.3 in stage 25.0 (TID 488) (10.13.1.6 executor 0): java.util.concurrent.ExecutionException: com.databricks.backend.daemon.data.client.adl.AzureCredentialNotFoundException: Could not find ADLS Gen2 Token
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readPartFiles$7(GpuMultiFileReader.scala:820)
	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readPartFiles$7$adapted(GpuMultiFileReader.scala:819)
	at scala.collection.Iterator.foreach(Iterator.scala:941)
	at scala.collection.Iterator.foreach$(Iterator.scala:941)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
	at scala.collection.IterableLike.foreach(IterableLike.scala:74)
	at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
	at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readPartFiles$4(GpuMultiFileReader.scala:819)
	at com.nvidia.spark.rapids.Arm.closeOnExcept(Arm.scala:87)
	at com.nvidia.spark.rapids.Arm.closeOnExcept$(Arm.scala:85)
	at com.nvidia.spark.rapids.FilePartitionReaderBase.closeOnExcept(GpuMultiFileReader.scala:236)
	at com.nvidia.spark.rapids.MultiFileCoalescingPartitionReaderBase.$anonfun$readPartFiles$1(GpuMultiFileReader.scala:804)
	at com.nvidia.spark.rapids.Arm.withResource(Arm.scala:28)
	at com.nvidia.spark.rapids.Arm.withResource$(Arm.scala:26)
	at com.nvidia.spark.rapids.FilePartitionReaderBase.withResource(GpuMultiFileReader.scala:236)

As @jlowe shared, setting spark.rapids.sql.format.parquet.reader.type=PERFILE can workaround this issue.
When spark.rapids.sql.format.parquet.reader.type=COALESCING or MULTITHREADED, the issue can be reproduced.

Moving to the backlog as the PERFILE option resolved the issue for the time being.

Moving to the backlog as the PERFILE option resolved the issue for the time being.

Has there been any performance measurements done on the workaround?  PERFILE will likely perform noticeably worse than the default, and that may influence the priority.

authors: ad895d jlowe sameerz viadea


text:
[BUG] JVM agent crashed SIGFPE cudf::detail::repeat in integration tests

Describe the bug
this was first seen in databricks runtimes (321db, 330db, there could be more repro in other scenarios)
rapids_databricks_nightly-pre_release-github, ID: 295
and more in premerge CIs.
JNI commit: https://github.com/NVIDIA/spark-rapids-jni/commit/64dd1e5ca1bc1fa7e1683c30914a8680db672fd2 w/ submodule cudf commit: https://github.com/rapidsai/cudf/commit/5b3e3abeaacc6069bc6ea9d92ebc28408b82ff37 (as jni submodule sync-up CI was blocked by other issue in last 2 days, the previous successful cudf commit was https://github.com/rapidsai/cudf/commit/12acf9258896626d7ebd51b159a70c6dc3f16c1b)
JVM agent crashed quickly and failed all following cases, first failed case is  ../../src/main/python/array_test.py::test_array_repeat_with_count_scalar
= 8625 failed, 4380 passed, 1105 skipped, 1350 xfailed, 24 xpassed, 4 warnings, 5100 errors in 5127.53s (1:25:27) =
core dump,
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGFPE (0x8) at pc=0x00007f9cda4994a1, pid=2604, tid=0x00007f9cd1026700
#
# JRE version: OpenJDK Runtime Environment (Zulu 8.64.0.19-CA-linux64) (8.0_345-b01) (build 1.8.0_345-b01)
# Java VM: OpenJDK 64-Bit Server VM (25.345-b01 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [cudf6880483908328430155.so+0x16424a1]  cudf::detail::repeat(cudf::table_view const&, int, rmm::cuda_stream_view, rmm::mr::device_memory_resource*)+0x21
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://www.azul.com/support/
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00007f9dc008b800):  JavaThread "Executor task launch worker for task 2.0 in stage 121.0 (TID 486)" daemon [_thread_in_native, id=3088, stack(0x00007f9cd0f26000,0x00007f9cd1027000)]

siginfo: si_signo: 8 (SIGFPE), si_code: 1 (FPE_INTDIV), si_addr: 0x00007f9cda4994a1

Registers:
RAX=0x000000007fffffff, RBX=0x00007f9c64f7a410, RCX=0x0000000000000200, RDX=0x0000000000000000
RSP=0x00007f9cd10229f0, RBP=0x00007f9cfff7bf08, RSI=0x0000000000000000, RDI=0x00007f9cd1022a98
R8 =0x00007f9c64f7a410, R9 =0x0000000000000002, R10=0x00007f9d2ebc4be0, R11=0x00007f9dc96c8a60
R12=0x00007f9cd1022a98, R13=0x00007f9d2ebc4be0, R14=0x0000000000000000, R15=0x00007f9cfff7bf10
RIP=0x00007f9cda4994a1, EFLAGS=0x0000000000010246, CSGSFS=0x002b000000000033, ERR=0x0000000000000000
  TRAPNO=0x0000000000000000

Top of Stack: (sp=0x00007f9cd10229f0)
0x00007f9cd10229f0:   0000000000000000 00007f9e00000000
0x00007f9cd1022a00:   0000000000000000 00007f9cfff7bf08
0x00007f9cd1022a10:   00007f9cd1022a98 00007f9cda4995a3
0x00007f9cd1022a20:   0000000000000000 00007f9e2152acd5
0x00007f9cd1022a30:   00007f9c6efa41d0 00007f9c64f7a410
0x00007f9cd1022a40:   00007f9dc008ba60 00007f9d2ebc4be0
0x00007f9cd1022a50:   0000000000000000 00007f9cd1022a98
0x00007f9cd1022a60:   00007f9e21c4bc10 00007f9cda00ec6c
0x00007f9cd1022a70:   0000000000000000 0000000000000000
0x00007f9cd1022a80:   0000000000000000 0000000000000000
0x00007f9cd1022a90:   00007f9d2ebb8ae8 0000000000000000
0x00007f9cd1022aa0:   0000000000000000 0000000000000000
0x00007f9cd1022ab0:   0000000000000000 00007f9d2ebb8ac0
0x00007f9cd1022ac0:   00007f9d2ebb8ac0 00007f9cb4a9e5e8
0x00007f9cd1022ad0:   00007f9cd1022b58 0000000000000000
0x00007f9cd1022ae0:   00007f9cb4a9e5e8 00007f9cd1022b88
0x00007f9cd1022af0:   00007f9dc008b800 00007f9e0d018527
0x00007f9cd1022b00:   00007f9cd1022b60 0000000000000000
0x00007f9cd1022b10:   00007f9d2ebcdac0 00007f9cd1022b18
0x00007f9cd1022b20:   0000000000000000 00007f9cd1022b88
0x00007f9cd1022b30:   00007f9cb4ac15d8 0000000000000000
0x00007f9cd1022b40:   00007f9cb4a9e5e8 0000000000000000
0x00007f9cd1022b50:   00007f9cd1022b78 00007f9cd1022be0
0x00007f9cd1022b60:   00007f9e0d007e80 00000000c1deb858
0x00007f9cd1022b70:   00007f9e0d011b5b 0000000000000000
0x00007f9cd1022b80:   00007f9d2ebc4be0 00007f9d2ebc31a0
0x00007f9cd1022b90:   00000000f4bc1770 00000000f4bc1770
0x00007f9cd1022ba0:   00007f9cd1022ba0 00007f9cb4aa21d1
0x00007f9cd1022bb0:   00007f9cd1022bf8 00007f9cb4ac15d8
0x00007f9cd1022bc0:   0000000000000000 00007f9cb4aa21f8
0x00007f9cd1022bd0:   00007f9cd1022b78 00007f9cd1022bf0
0x00007f9cd1022be0:   00007f9cd1022c48 00007f9e0d007e80

Instructions: (pc=0x00007f9cda4994a1)
0x00007f9cda499481:   54 55 48 83 ec 18 85 d2 0f 88 b9 8f 7f ff b8 ff
0x00007f9cda499491:   ff ff 7f 49 89 f2 89 d6 49 89 c9 99 41 8b 4a 18
0x00007f9cda4994a1:   f7 fe 39 c8 0f 8c 6b 8f 7f ff 49 89 fc 85 c9 74
0x00007f9cda4994b1:   04 85 f6 75 1a 4c 89 e7 4c 89 d6 e8 af 3d 68 ff

Register to memory mapping:

RAX=0x000000007fffffff is an unknown value
RBX=0x00007f9c64f7a410 is an unknown value
RCX=0x0000000000000200 is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x00007f9cd10229f0 is pointing into the stack for thread: 0x00007f9dc008b800
RBP=0x00007f9cfff7bf08: _ZGVZN5nvtx36domain3getIN4cudf14libcudf_domainEEERKS0_vE1d+0 in /tmp/cudf6880483908328430155.so at 0x00007f9cd8e57000
RSI=0x0000000000000000 is an unknown value
RDI=0x00007f9cd1022a98 is pointing into the stack for thread: 0x00007f9dc008b800
R8 =0x00007f9c64f7a410 is an unknown value
R9 =0x0000000000000002 is an unknown value
R10=0x00007f9d2ebc4be0 is an unknown value
R11=0x00007f9dc96c8a60 is an unknown value
R12=0x00007f9cd1022a98 is pointing into the stack for thread: 0x00007f9dc008b800
R13=0x00007f9d2ebc4be0 is an unknown value
R14=0x0000000000000000 is an unknown value
R15=0x00007f9cfff7bf10: _ZZN5nvtx36domain3getIN4cudf14libcudf_domainEEERKS0_vE1d+0 in /tmp/cudf6880483908328430155.so at 0x00007f9cd8e57000

Stack: [0x00007f9cd0f26000,0x00007f9cd1027000],  sp=0x00007f9cd10229f0,  free space=1010k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [cudf6880483908328430155.so+0x16424a1]  cudf::detail::repeat(cudf::table_view const&, int, rmm::cuda_stream_view, rmm::mr::device_memory_resource*)+0x21

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  ai.rapids.cudf.Table.repeatStaticCount(JI)[J+0
j  ai.rapids.cudf.Table.repeat(I)Lai/rapids/cudf/Table;+9
j  org.apache.spark.sql.rapids.GpuArrayRepeat.$anonfun$doColumnar$40(ILcom/nvidia/spark/rapids/GpuColumnVector;Lai/rapids/cudf/ColumnVector;Lai/rapids/cudf/Table;)Lai/rapids/cudf/ColumnVector;+5
j  org.apache.spark.sql.rapids.GpuArrayRepeat$$Lambda$4762.apply(Ljava/lang/Object;)Ljava/lang/Object;+16
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
j  org.apache.spark.sql.rapids.GpuArrayRepeat.$anonfun$doColumnar$39(Lcom/nvidia/spark/rapids/GpuColumnVector;ILai/rapids/cudf/ColumnVector;)Lai/rapids/cudf/ColumnVector;+29
j  org.apache.spark.sql.rapids.GpuArrayRepeat$$Lambda$4760.apply(Ljava/lang/Object;)Ljava/lang/Object;+12
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
j  org.apache.spark.sql.rapids.GpuArrayRepeat.doColumnar(Lcom/nvidia/spark/rapids/GpuColumnVector;Lcom/nvidia/spark/rapids/GpuScalar;)Lai/rapids/cudf/ColumnVector;+94
J 23060 C1 com.nvidia.spark.rapids.GpuBinaryExpression.$anonfun$columnarEval$3(Lcom/nvidia/spark/rapids/GpuBinaryExpression;Ljava/lang/Object;Lorg/apache/spark/sql/vectorized/ColumnarBatch;Ljava/lang/Object;)Ljava/lang/Object; (453 bytes) @ 0x00007f9e10a23144 [0x00007f9e10a204c0+0x2c84]
J 21279 C1 com.nvidia.spark.rapids.GpuBinaryExpression$$Lambda$4676.apply(Ljava/lang/Object;)Ljava/lang/Object; (17 bytes) @ 0x00007f9e0d54b4cc [0x00007f9e0d54b440+0x8c]
J 16918 C1 com.nvidia.spark.rapids.Arm$.withResourceIfAllowed(Ljava/lang/Object;Lscala/Function1;)Ljava/lang/Object; (430 bytes) @ 0x00007f9e0e60d77c [0x00007f9e0e60d700+0x7c]
J 21278 C1 com.nvidia.spark.rapids.GpuBinaryExpression$$Lambda$4675.apply(Ljava/lang/Object;)Ljava/lang/Object; (13 bytes) @ 0x00007f9e0ea4d24c [0x00007f9e0ea4c700+0xb4c]
J 16918 C1 com.nvidia.spark.rapids.Arm$.withResourceIfAllowed(Ljava/lang/Object;Lscala/Function1;)Ljava/lang/Object; (430 bytes) @ 0x00007f9e0e60d77c [0x00007f9e0e60d700+0x7c]
J 21275 C1 org.apache.spark.sql.rapids.GpuArrayRepeat.columnarEval(Lorg/apache/spark/sql/vectorized/ColumnarBatch;)Ljava/lang/Object; (6 bytes) @ 0x00007f9e0f6c48e4 [0x00007f9e0f6c3fa0+0x944]
J 22446 C1 com.nvidia.spark.rapids.GpuAlias.columnarEval(Lorg/apache/spark/sql/vectorized/ColumnarBatch;)Ljava/lang/Object; (15 bytes) @ 0x00007f9e10701784 [0x00007f9e10701340+0x444]
J 18215 C1 com.nvidia.spark.rapids.GpuProjectExec$$$Lambda$4530.apply(Ljava/lang/Object;)Ljava/lang/Object; (12 bytes) @ 0x00007f9e0f8ac5a4 [0x00007f9e0f8ac420+0x184]
J 16272 C1 com.nvidia.spark.rapids.RapidsPluginImplicits$MapsSafely.$anonfun$safeMap$1(Lscala/collection/mutable/Builder;Lscala/Function1;Ljava/lang/Object;)V (285 bytes) @ 0x00007f9e0f28ecb4 [0x00007f9e0f28ebc0+0xf4]
J 14462 C1 com.nvidia.spark.rapids.RapidsPluginImplicits$MapsSafely$$Lambda$4531.apply(Ljava/lang/Object;)Ljava/lang/Object; (13 bytes) @ 0x00007f9e0e9bc4ec [0x00007f9e0e9bc480+0x6c]
J 10256 C2 scala.collection.immutable.List.foreach(Lscala/Function1;)V (32 bytes) @ 0x00007f9e0e5c12a4 [0x00007f9e0e5c1200+0xa4]
J 25014 C1 com.nvidia.spark.rapids.RapidsPluginImplicits$AutoCloseableProducingSeq.safeMap(Lscala/Function1;)Lscala/collection/Seq; (19 bytes) @ 0x00007f9e0e7b2e7c [0x00007f9e0e7b26e0+0x79c]
j  com.nvidia.spark.rapids.GpuProjectExec$.project(Lorg/apache/spark/sql/vectorized/ColumnarBatch;Lscala/collection/Seq;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+29
j  com.nvidia.spark.rapids.GpuTieredProject.$anonfun$project$2(Lorg/apache/spark/sql/vectorized/ColumnarBatch;Lscala/collection/Seq;Lai/rapids/cudf/NvtxRange;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+5
j  com.nvidia.spark.rapids.GpuTieredProject$$Lambda$4528.apply(Ljava/lang/Object;)Ljava/lang/Object;+12
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
j  com.nvidia.spark.rapids.GpuTieredProject.recurse$2(Lscala/collection/Seq;Lorg/apache/spark/sql/vectorized/ColumnarBatch;Z)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+79
j  com.nvidia.spark.rapids.GpuTieredProject.project(Lorg/apache/spark/sql/vectorized/ColumnarBatch;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+7
j  com.nvidia.spark.rapids.GpuTieredProject.$anonfun$projectAndCloseWithRetrySingleBatch$3(Lcom/nvidia/spark/rapids/GpuTieredProject;Lorg/apache/spark/sql/vectorized/ColumnarBatch;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+2
j  com.nvidia.spark.rapids.GpuTieredProject$$Lambda$4527.apply(Ljava/lang/Object;)Ljava/lang/Object;+8
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
j  com.nvidia.spark.rapids.GpuTieredProject.$anonfun$projectAndCloseWithRetrySingleBatch$2(Lcom/nvidia/spark/rapids/GpuTieredProject;Lcom/nvidia/spark/rapids/SpillableColumnarBatch;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+15
j  com.nvidia.spark.rapids.GpuTieredProject$$Lambda$4519.apply(Ljava/lang/Object;)Ljava/lang/Object;+8
j  com.nvidia.spark.rapids.RmmRapidsRetryIterator$AutoCloseableAttemptSpliterator.next()Ljava/lang/Object;+57
j  com.nvidia.spark.rapids.RmmRapidsRetryIterator$RmmRapidsRetryIterator.next()Ljava/lang/Object;+128
j  com.nvidia.spark.rapids.RmmRapidsRetryIterator$RmmRapidsRetryAutoCloseableIterator.next()Ljava/lang/Object;+18
j  com.nvidia.spark.rapids.RmmRapidsRetryIterator$.drainSingleWithVerification(Lscala/collection/Iterator;)Ljava/lang/Object;+18
j  com.nvidia.spark.rapids.RmmRapidsRetryIterator$.withRetryNoSplit(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object;+26
j  com.nvidia.spark.rapids.GpuTieredProject.projectAndCloseWithRetrySingleBatch(Lcom/nvidia/spark/rapids/SpillableColumnarBatch;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+17
j  com.nvidia.spark.rapids.GpuProjectExec.$anonfun$internalDoExecuteColumnar$2(Lorg/apache/spark/sql/vectorized/ColumnarBatch;Lcom/nvidia/spark/rapids/GpuTieredProject;Lcom/nvidia/spark/rapids/NvtxWithMetrics;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+16
j  com.nvidia.spark.rapids.GpuProjectExec$$Lambda$4499.apply(Ljava/lang/Object;)Ljava/lang/Object;+12
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
j  com.nvidia.spark.rapids.GpuProjectExec.$anonfun$internalDoExecuteColumnar$1(Lcom/nvidia/spark/rapids/GpuMetric;Lcom/nvidia/spark/rapids/GpuTieredProject;Lcom/nvidia/spark/rapids/GpuMetric;Lcom/nvidia/spark/rapids/GpuMetric;Lorg/apache/spark/sql/vectorized/ColumnarBatch;)Lorg/apache/spark/sql/vectorized/ColumnarBatch;+41
j  com.nvidia.spark.rapids.GpuProjectExec$$Lambda$4419.apply(Ljava/lang/Object;)Ljava/lang/Object;+20
J 5282 C2 scala.collection.Iterator$$anon$10.next()Ljava/lang/Object; (19 bytes) @ 0x00007f9e0dd00680 [0x00007f9e0dd00620+0x60]
J 20857 C1 com.nvidia.spark.rapids.ColumnarToRowIterator.$anonfun$fetchNextBatch$2(Lcom/nvidia/spark/rapids/ColumnarToRowIterator;Ljava/lang/Object;Lcom/nvidia/spark/rapids/NvtxWithMetrics;)Lscala/None$; (69 bytes) @ 0x00007f9e1014547c [0x00007f9e101451e0+0x29c]
j  com.nvidia.spark.rapids.ColumnarToRowIterator$$Lambda$4452.apply(Ljava/lang/Object;)Ljava/lang/Object;+12
J 22535 C1 com.nvidia.spark.rapids.Arm$.withResource(Ljava/lang/AutoCloseable;Lscala/Function1;)Ljava/lang/Object; (60 bytes) @ 0x00007f9e10830dd4 [0x00007f9e10830cc0+0x114]
J 23986 C1 com.nvidia.spark.rapids.ColumnarToRowIterator.fetchNextBatch()Lscala/Option; (85 bytes) @ 0x00007f9e10e590f4 [0x00007f9e10e586a0+0xa54]
J 24002 C1 com.nvidia.spark.rapids.ColumnarToRowIterator.loadNextBatch()V (75 bytes) @ 0x00007f9e10e83814 [0x00007f9e10e83740+0xd4]
J 13608 C2 com.nvidia.spark.rapids.ColumnarToRowIterator.hasNext()Z (62 bytes) @ 0x00007f9e0e34a4cc [0x00007f9e0e34a460+0x6c]
J 20958 C2 org.apache.spark.sql.execution.collect.UnsafeRowBatchUtils$.encodeUnsafeRows(Lscala/collection/Iterator;IZ)Lscala/Tuple2; (270 bytes) @ 0x00007f9e101f443c [0x00007f9e101f3b40+0x8fc]
J 20763 C1 org.apache.spark.sql.execution.collect.Collector$$Lambda$3637.apply(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object; (16 bytes) @ 0x00007f9e100e44dc [0x00007f9e100e40e0+0x3fc]
J 23890 C1 org.apache.spark.scheduler.ResultTask$$Lambda$3638.apply()Ljava/lang/Object; (20 bytes) @ 0x00007f9e10ddb374 [0x00007f9e10ddb160+0x214]
J 21455 C1 com.databricks.spark.util.ExecutorFrameProfiler$.record(Ljava/lang/String;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object; (88 bytes) @ 0x00007f9e0e6d0d64 [0x00007f9e0e6d0540+0x824]
j  org.apache.spark.scheduler.ResultTask.$anonfun$runTask$1(Lorg/apache/spark/scheduler/ResultTask;Lorg/apache/spark/TaskContext;)Ljava/lang/Object;+210
j  org.apache.spark.scheduler.ResultTask$$Lambda$3622.apply()Ljava/lang/Object;+8
J 21455 C1 com.databricks.spark.util.ExecutorFrameProfiler$.record(Ljava/lang/String;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object; (88 bytes) @ 0x00007f9e0e6d0d64 [0x00007f9e0e6d0540+0x824]
j  org.apache.spark.scheduler.ResultTask.runTask(Lorg/apache/spark/TaskContext;)Ljava/lang/Object;+14
j  org.apache.spark.scheduler.Task.doRunTask(JILscala/Option;)Ljava/lang/Object;+151
j  org.apache.spark.scheduler.Task.$anonfun$run$1(Lorg/apache/spark/scheduler/Task;JILorg/apache/spark/metrics/MetricsSystem;Lscala/collection/immutable/Map;Lscala/Enumeration$Value;Lscala/Option;)Ljava/lang/Object;+116
j  org.apache.spark.scheduler.Task$$Lambda$3568.apply()Ljava/lang/Object;+28
J 21455 C1 com.databricks.spark.util.ExecutorFrameProfiler$.record(Ljava/lang/String;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object; (88 bytes) @ 0x00007f9e0e6d0d64 [0x00007f9e0e6d0540+0x824]
j  org.apache.spark.scheduler.Task.run(JILorg/apache/spark/metrics/MetricsSystem;Lscala/collection/immutable/Map;Lscala/Option;Lscala/Enumeration$Value;)Ljava/lang/Object;+23
j  org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$13(Lorg/apache/spark/executor/Executor$TaskRunner;Lscala/runtime/BooleanRef;)Ljava/lang/Object;+43
j  org.apache.spark.executor.Executor$TaskRunner$$Lambda$3562.apply()Ljava/lang/Object;+8
J 17113 C1 org.apache.spark.util.Utils$.tryWithSafeFinally(Lscala/Function0;Lscala/Function0;)Ljava/lang/Object; (207 bytes) @ 0x00007f9e0f4fe31c [0x00007f9e0f4fe2a0+0x7c]
j  org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Lorg/apache/spark/executor/Executor$TaskRunner;)V+1007
j  org.apache.spark.executor.Executor$TaskRunner$$Lambda$3540.apply$mcV$sp()V+4
J 20933 C2 scala.runtime.java8.JFunction0$mcV$sp.apply()Ljava/lang/Object; (10 bytes) @ 0x00007f9e0f91a45c [0x00007f9e0f91a420+0x3c]
J 21455 C1 com.databricks.spark.util.ExecutorFrameProfiler$.record(Ljava/lang/String;Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object; (88 bytes) @ 0x00007f9e0e6d0d64 [0x00007f9e0e6d0540+0x824]
j  org.apache.spark.executor.Executor$TaskRunner.run()V+38
j  java.util.concurrent.ThreadPoolExecutor.runWorker(Ljava/util/concurrent/ThreadPoolExecutor$Worker;)V+95
j  java.util.concurrent.ThreadPoolExecutor$Worker.run()V+5
j  java.lang.Thread.run()V+11
v  ~StubRoutines::call_stub

Steps/Code to reproduce bug
Run integration test.
Expected behavior
Pass the test

this is also failing branch-23.08

I can repeat this in local mode on Spark 3.2.1

Triggered by static array count of <= 0.  Filed https://github.com/rapidsai/cudf/issues/13458

https://github.com/rapidsai/cudf/issues/13458 has been merged, I will revert https://github.com/NVIDIA/spark-rapids/pull/8424 later when new JNI w/ the fix is available

source: gharchive/issue

authors: jlowe pxLi

repo: NVIDIA/spark-rapids

license_type: permissive

license_source: github-api


text:
Restore hash partitioning of arrays

Fixes #2330
Now that https://github.com/rapidsai/cudf/issues/8098 has been fixed, this restores support for hash partitioning for arrays that was removed in #2319.

build

did we have any specific tests for this?

Yes, they were added when the support was disabled to prove that we weren't calling through cudf otherwise the tests would fail.  Which reminds me, I need to remove the exclusions on shuffle that @revans2 added recently for those tests.

build

build

build

source: gharchive/pull-request

authors: abellina jlowe


text:
[auto-merge] branch-22.06 to branch-22.08 [skip ci] [bot]

auto-merge triggered by github actions on branch-22.06 to create a PR keeping branch-22.08 up-to-date. If this PR is unable to be merged due to conflicts, it will remain open until manually fix.

SUCCESS - auto-merge


text:
Theme removes the "remove embeds" button

When this theme is enabled, the "Remove embeds" button that Discord shows when you post a website link is missing:
Default theme:

Couve:

Will be fixed in the next push

license: MIT


text:
Support custom output formats on GetCaptions

3play API is kinda weird in this situation, so the paths for custom and
standard formats are different.
The custom format is in the form ".". The included test
has an example.

Codecov Report

Merging #36 into master will increase coverage by 1.05%.
The diff coverage is 81.25%.

@@            Coverage Diff             @@
##           master      #36      +/-   ##
==========================================
+ Coverage   73.83%   74.89%   +1.05%
==========================================
  Files           5        5
  Lines         214      231      +17
==========================================
+ Hits          158      173      +15
- Misses         32       35       +3
+ Partials       24       23       -1

Impacted Files
Coverage Δ

captions.go
75.6% <81.25%> (+8.94%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5c34fa6...c926287. Read the comment docs.

authors: codecov-io fsouza

repo: NYTimes/threeplay


text:
Which of the methods below does NOT change the array it is called on?

Which of the methods below does NOT change the array it is called on?
A/ .pop()
B/ .push()
C/ .slice()
D/ .shift()

I chose C/ .slice()


text:
Should this test for custom error handler be failing?

i've recently been upgrading my Nancy 0.23.1 references up to 1.1 and all my tests pass save for one.
There seems to be a related breaking change moving Negotiation to the INancyModule that i suspect i need to adjust my test for, but i'm not sure how my test should look in light of this change. And i'm pretty sure my error handler doesn't work the way it's supposed to now.
Would anyone mind taking a look at it and seeing what's wrong? Can you suggest a fix?
:trollface: In vb because i know you love it :trollface:
:cry: also that's what i often have to code in here at work :cry:
My test:
    <Fact> _
    Public Sub Internal_server_error_returns_500_page()
        Dim errorView As String = "Error/500"
        Dim errorModule As New ConfigurableNancyModule(Sub(use)
                                                           use.Get("/", Function()
                                                                            Return HttpStatusCode.InternalServerError
                                                                        End Function)
                                                       End Sub)

        Dim testViewFactory = Substitute.For(Of IViewFactory)()
        testViewFactory.RenderView(errorView, Arg.Any(Of Object), Arg.Any(Of ViewLocationContext)) _
            .Returns(errorView)

        Dim browser As New Browser(Sub(use)
                                       use.ApplicationStartup(Sub(container, pipelines)
                                                                  pipelines.OnError.AddItemToEndOfPipeline( _
                                                                      Function(ctx, exception)
                                                                          ctx.Items.Add("OnErrorException", exception)
                                                                          Return ctx.Response
                                                                      End Function)
                                                              End Sub)
                                       use.ViewFactory(testViewFactory)
                                       use.Module(errorModule)
                                       use.StatusCodeHandler(Of InternalServerErrorHandler)()
                                   End Sub)

        Dim response = browser.Get("/", Sub(use)
                                            use.HttpRequest()
                                        End Sub)

        Assert.Equal(HttpStatusCode.InternalServerError, response.StatusCode)
        Assert.True(response.Body.AsString.Contains(errorView))
        Ensure.HTML(response)
    End Sub

My custom error handler:
    ''' <summary>
    ''' If there was an <c>HttpStatusCode.InternalServerError</c>, then send the user a friendly error message
    ''' </summary>
    ''' <param name="statusCode">The HTTP status code of the current response</param>
    ''' <param name="context">The current nancy context</param>
    Public Sub Handle(statusCode As HttpStatusCode, context As NancyContext) Implements IStatusCodeHandler.Handle
        Try
            Dim response = New Negotiator(context)

            ' Log a 500 error to the trace output which will show up in the Nancy debugging tools.
            Dim exceptionDetails As String = context.GetExceptionDetails
            context.WriteTraceLog(Function(s) s.AppendLine(exceptionDetails))

            ' Build up the ErrorViewModel
            Dim errorVM As New ErrorPageViewModel
            If context.Items.ContainsKey("OnErrorException") Then
                Dim ex As Exception = context.Items("OnErrorException")
                errorVM.ErrorMessage = ex.Message
                errorVM.FullException = ex.ToString
                errorVM.StackTrace = ex.StackTrace
            Else
                errorVM.ErrorMessage = exceptionDetails
            End If

#If DEBUG Then
            errorVM.Debug = True
#End If

            ' Negotiate the response
            response = response.WithModel(errorVM).WithStatusCode(statusCode).WithView("Error/500")

            ' Set the final response to the negotiated response we just made
            Dim errorResponse As Response = _responseNegotiator.NegotiateResponse(response, context)

            context.Response = errorResponse

        Catch ex As Exception
            ' Log a 500 error to the trace output
            context.WriteTraceLog(Function(s) s.AppendLine(String.Format("Exception hit while processing an issue: {0} -- {1}", ex.Message, ex.StackTrace)))

        End Try
    End Sub

PS: also, i'm guessing i should post support-y questions here?

:+1: First test I've ever seen in vb code :trollface:

@albertjan you're welcome! They're particularly ugly.

OK! After more review, i'm finding that i'm hitting something that has already been discovered as an issue.
It seems to remain an issue as of v1.1.
This issue is really a duplicate of #1560 and #1663. So i'm going to close this.

Eeeek! MY :eyes: :mask: OK, @jugglingnutcase. I think I have something over at #1560 that works :smile:

Eeeek!  MY EYES!

hehe, it's not that bad! OK, it's not good either though. You should see my NancyModules if you want your eyes to bleed!

Thanks @khellang!

authors: albertjan jugglingnutcase khellang

repo: NancyFx/Nancy


text:
Allow automatic login using cookie only without passing username and password interactively

Prerequisites

[x] Did you read FAQ section?
[x] Did you test with the latest releases or commit ?

Description
I am trying to run PixivUtil unattended using python3 PixivUtil2.py -s 5 with only a cookie stored in config.ini. Doing so requires user input though (pressing enter twice to get past username and password prompt) before the action starts.
I had a quick look at the code and it appears that support for unattended running is there, but only if there is a stored username and password in config.ini. Would it be possible to add support for doing this by cookie only?
Steps to Reproduce

Store cookie in config.ini, ensure no username or password are there
Run PixivUtil2.py with -s option

Expected behavior: PixivUtil runs using the cookie without requiring user input
Actual behavior: PixivUtil requires user input (press enter twice to pass empty username and password) before running
Versions
As reported by PixivUtil2.py --help: PixivDownloader2 version 20200103-beta2

Not sure why you would wanna do that though, my opinion, for current situation:
If you just want to use cookie only to login, you can put some random username/password combination in the config I guess?

@Missingmew assuming you only want to login using cookie, then you can supply dummy username/password in the config.ini to avoid pressing enter twice.

Okay, using a dummy user and pass works. You might want to make a note of this somewhere for people using cookies/sessions as primary login method.

authors: Missingmew Nandaka bluerthanever


text:
Bumped the version to v0.1.3

With the package.json file broken for v0.1.2, it would be good to bump the package version.
Semantically, I can't see any new features or breaking changes so should be v0.1.3. I've tagged the commit "v0.1.3", so that it can be referenced easily when installing via npm or yarn, but I'm not sure if the tag will come across with the PR.

Travis is failing without a config file, I assume you were planning to lint the js. Any thoughts on preferred style?

Any chance of tagging the commit?
$ git tag v0.1.3 e64af6c
$ git push origin --tags

should work and will make using it a little easier.

repo: Nanonid/rison


text:
Limit of Qualification Error

When running my data through the Bioconductor GeoMxWorkFlow pipeline I am constantly getting an error message that the LOQ_mat object is empty and the following error message:
Error in h(simpleError(msg, call)) :
error in evaluating the argument 'x' in selecting a method for function 't': undefined columns selected
I am not sure what is going wrong in my target_dataset that is not allowing the LOQ for-loop to work.

Hi @garswart,
Thank you for reaching out. Our customer support team will be able to help you with this. Please email geomxsupport@nanostring.com with your issue.
Thanks,
Nicole

authors: NicoleEO garswart

repo: Nanostring-Biostats/GeoMxWorkflows


text:
Twitter

Criar uma função que receba  e escreva em um embended cada um dos ultimos tweets de um

Acredito que irei usar o Twitterscraper

Verificar se o modulo suporta funcionar com deploy no heroku. Acabei optando pelo twint que não permitia isso.

repo: Natanlimap/python-discord-bot


text:
[FR] support native terminal launching for gdb

Is your feature request related to a problem? Please describe.
I am unable to SSH into localhost and do not have local admin.
Describe the solution you'd like
I'd be nice for Ghidra to support the native environment and either spawn a shell in which to run gdb or use the native terminal emulators such as iTerm2, gnome-terminal, or Terminator
Describe alternatives you've considered
If that is not feasible, would it be possible to connect to a raw socket locally exposed via some mechanism such as
nc -nvlp 12345 -e /bin/bash

@tbennett6421 Could you provide a little more info about what your native environment is?  Also, have you tried the GADP or IN-VM agents?

I was using OS X big sur at work. That's the only thing I have tried out the debugger on. I only saw the one option for debugging via gdb over ssh and no other selections were available. I'm not sure how to use GADP or IN-VM agents or how to configure them. They weren't listed so I figured gdb was the only option.
Later on today I will try it on Windows 10 Pro, Ubuntu Desktop 20.04, and Kali Linux rolling, to see what options are there. Perhpahs it works fine out the box for those platforms, I was just reporting my experience under OS X. Generally Kali Linux, Windows 10 Pro or Ubuntu Desktop are my go-to for using Ghidra.

OK, so on the OS X front, 10.1 will probably solve your problem - likely out sometime next month.  On Windows or Linux, I think the other options are what you are looking for.  GADP spawns a separate process that wraps the gdb MI2 interface;  IN-VM does the same from within the VM use by Ghidra (which, of course, means, if the debugger dies, Ghidra goes with it).  Give them a spin and let us know if they do what you're hoping for.

Okay, I tried the debugger on windows and it seemed to work okay. I just wasn't sure on the options for OS X.

For OSX, you'll need to wait for 10.1 unless you're interested in building gdb on OSX.

okay, I just raised this since I thought that was the only method. Feel free to close it if this should be resolved in the next release

repo: NationalSecurityAgency/ghidra


text:
Hitachi/Renesas SH2 float support improvements

Two small changes for SuperH processor module:

typo in fsub instruction (substract two float values)
calling convention for float arguments. I took this info from real firmware, and it looks compatible with gcc (see gcc link in wiki)

I am tested it with firmware from Mazda engine computer, works fine.

WIll be in master and 9.2 soon.  Thanks for the PR!

authors: emteere esaulenka


text:
Added preview feature & Refactor/Changes to optimize/fix bugs in form…

1). Removed/commented the culprit calls and Called it directly in initState() to avoid problems.
2). I implement a debounce mechanism using the Timer class to optimize the method further. This ensures that the updateStyle method is called only once after a short delay, preventing rapid successive calls that could lead to performance issues.
3). Removing the temp Global Variable to Prevent Memory Leaks and Improve State Management

I call updateStyle in initState to set the initial styles when the widget is first created & using setState() instead of using temp!.updateStyle() in later code snippets.

4). Improved UI of export parameter and added fullScreenPreview via introducing a new class called: FullPreviewScree

Thank You

No need of any thank you man!
On Sun, Jul 14, 2024 at 10:29 PM Imad Laggoune @.***>
wrote:

Thank You
—
Reply to this email directly, view it on GitHub
https://github.com/Native-Bits-Team/M-Flow/pull/7#issuecomment-2227413715,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AZW2423Z7NRBGARBI4BIHZ3ZMKU7JAVCNFSM6AAAAABK3HVDY6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRXGQYTGNZRGU
.
You are receiving this because you authored the thread.Message ID:
@.***>

repo: Native-Bits-Team/M-Flow


text:
Css sync not working with livereload and groceries tutorial

From @vekexasia on August 12, 2016 12:4
Dear friend, we, the rest of the NativeScript community really
appreciate your feedback! While we are doing all we can to take care of every
issue, sometimes we get overwhelmed. Because of that, we will consider issues
that are not constructive or problems that cannot be reproduced "dead".
Additionally, we will treat feature requests or bug reports with unanswered
questions regarding the behavior/reproduction for more than 20 days "dead". All
"dead" issues will get closed.
Which platform(s) does your issue occur on?
Android
Please provide the following version numbers that your issue occurs with:

CLI: 2.2.0
Cross-platform modules: android 2.1.1
Runtime(s): "tns-android": {
"version": "2.2.0"
}
Plugin(s):

{
    "@angular/common": "2.0.0-rc.3",
    "@angular/compiler": "2.0.0-rc.3",
    "@angular/core": "2.0.0-rc.3",
    "@angular/http": "2.0.0-rc.3",
    "@angular/platform-browser": "2.0.0-rc.3",
    "@angular/platform-browser-dynamic": "2.0.0-rc.3",
    "@angular/platform-server": "2.0.0-rc.3",
    "@angular/router": "3.0.0-alpha.7",
    "nativescript-angular": "0.2.0",
    "tns-core-modules": "2.1.0"
  }

Please tell us how to recreate the issue in as much detail as possible.
I just started an emulator (PLAIN emulator not genymotion), followed the getting started groceries tutorial till Chapter 2.5 Global CSS. When changing app.css Trying to apply a simple color to Button i see this in console
Executing before-prepare hook from /home/abaccega/tmp/nativescript/sample-Groceries/hooks/before-prepare/nativescript-dev-typescript.js
Project successfully prepared (android)
Transferring project files...
Successfully transferred app.css.
Applying changes...
Successfully synced application org.nativescript.groceries on device emulator-5554.

Unfortunately the changes are not there. If I restart the app within the emulator the css gets applied.
Is there code involved? If so, please share the minimal amount of code needed to recreate the problem.
Just the tutorial till 2.5
Copied from original issue: NativeScript/NativeScript#2573

HI @vekexasia,
I have noticed that you are using old modules and  new CLI. Could you try to upgrade tns-core-modules and nativescript-angular to latest available using the below described steps:

tns plugin remove tns-core-modules
tns plugin add tns-core-modules@2.2.0
tns plugin remove nativescript-angular
tns plugin add nativescript-angular@0.3.0

Then remove the platform using tns platform remove android and  run  tns run android.
I hope this will solve your problem.

Hello @tsonevn i followed your instructions and it works :)
I noticed that @angular was updated to rc.4 when running android:
The depedency located at /home/abaccega/tmp/nativescript/sample-Groceries/node_modules/@angular/common with version  2.0.0-rc.3 will be replaced with dependency located at /home/abaccega/tmp/nativescript/sample-Groceries/node_modules/nativescript-angular/node_modules/@angular/common with version 2.0.0-rc.4

but it ddidn't save it to my package.json where i still have alll @angular -rc.3 instead of -rc.4

Hi @vekexasia ,
You could upgrade to rc4 by increasing the version from rc3 to rc4 in your package.json file. You should also  remove node_modules from your project folder  and remove the platform  using tns platform remove android.
I hope this helps.

authors: tsonevn vekexasia

repo: NativeScript/nativescript-angular


text:
Segmentation fault Error

First of all, thank you for the good code.
Running the robag file works very well, but running ./demo to segment the pcd file causes the following error.
Do you know the solution?
My current environment is as follows.
cuda: 11.8
cudnn: 8.6.0
tensorrt: 8.6.0.12

Do you use Ubuntu22.04？If yes, then SIGSEGV will happen in the pcl_viewer.  https://github.com/Natsu-Akatsuki/RangeNetTrt8/blob/main/src/network/netTensorRT.cpp#L161

No, I'm using Ubuntu 20.04.
Can the pcl_viewer issue also occur on Ubuntu 20.04?

Do you use Ubuntu22.04？If yes, then SIGSEGV will happen in the pcl_viewer. https://github.com/Natsu-Akatsuki/RangeNetTrt8/blob/main/src/network/netTensorRT.cpp#L161

No, I'm using Ubuntu 20.04.
Can the pcl_viewer issue also occur on Ubuntu 20.04?

Actually, in my experiment, the issue caused by pcl_viewer did not occur in Ubuntu 20.04. You should use gdb/lldb to locate the bug.

@smileyr99 It seems that you use non-KITTI point cloud instead of provided demo. Does your point cloud obey RangeNet point cloud input requirement?

I couldn't download the provided model and data files, so I converted a KITTI ROS bag file into a PCD file and used that instead.
Where can I find the requirements for the RangeNet Point Cloud in terms of the PCD file?
Can you send me an example file containing the model and data via email?
My email address is yr2819@dgu.ac.kr.
Thank you.

See README, we have provided the download link through Baidu Netdisk.
The data file and model file has been sent into your email.
Naturally, the PCD file, that you export from the KITTI ROS bad file is legal. The point cloud input requirement seems to be satisfied.
According to your latest statement and previous log, the solution is to use our provided model file to generate the engine.

Try git pull. The latest repository has supported TensorRT 8.6.


text:
uh oh

Spore update incomin' that updates the SSL certificates.

false alarm

repo: NeDether/Rattler-Spore


text:
🛑 Becpl Angular UI is down

In 280e476, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 196d620 after 5 minutes.

repo: NehalDamania/becpl-uptime


text:
🛑 Becpl Angular UI is down

In 56d0862, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in a170a35 after 5 minutes.


text:
🛑 Becpl Angular UI is down

In c681775, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 546b679 after 12 minutes.


text:
🛑 Becpl Angular UI is down

In 7b61b7b, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 30dc782 after 12 minutes.


text:
🛑 Becpl Angular UI is down

In 0776f88, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 2d054d7 after 5 minutes.


text:
Library shows incorrect media on search

The title. Rn I have 3 Your Name. entries pointing to your name, re zero, and another random one completely unrelated to your name.

Looks like Mappings objects aren't being created/updated in the local DB so duplicate entries are created if the corresponding Mappings object didn't exist.

If you change providers, the original issue is still there.

This'll probably require a rewrite of the getBulkMedia utility function

repo: Nekidev/Naoka


text:
Internal (not in pypi) packages not ignored, even when instructed to

Command that causes the issue
pip-rating analyze-file src/requirements_prod.in
pip-rating analyze-file src/requirements_prod.in --ignore-package hj-nekobasu
pip-rating analyze-file src/requirements_prod.in --ignore-package hj-nekobasu==3.0.7

Expected behavior
I would expect for dependencies that cannot be found to be listed as errors in the report, which it does:
ERROR: Getting report for hj-nekobasu==3.0.7 failed with output:
ERROR: Could not find a version that satisfies the requirement hj-nekobasu==3.0.7 (from versions: none)
ERROR: No matching distribution found for hj-nekobasu==3.0.7

And then for it to proceed without trying further.
Actual behavior
The tool seems to have kept on trying to get info about the packages that are not available and then stopped running.
Traceback
Traceback (most recent call last):
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/pipper.py", line 281, in
_get_package_report
    out = stream_bash_command(args)
          ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/pipper.py", line 85, in
stream_bash_command
    raise subprocess.CalledProcessError(retcode, args, output=out)
subprocess.CalledProcessError: Command '['/Users/jacobo.devera/.local/pipx/venvs/pip-rating/bin/python', '-m', 'pip', 'install',
'-qq', '--no-deps', '--ignore-installed', '--disable-pip-version-check', '--dry-run', '--cache-dir',
'/Users/jacobo.devera/Library/Caches/pip/wheels/pip-rating', '--report', '-', 'hj-nekobasu==3.0.7']' returned non-zero exit
status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/jacobo.devera/.local/bin/pip-rating", line 8, in <module>
    sys.exit(manage())
             ^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/management.py", line 206, in
manage
    catch(cli)()
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/exceptions.py", line 45, in
wrap
    fn(*args, **kwargs)
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/management.py", line 160, in
analyze_file
    results.show_results(dependencies, format_name)
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/results.py", line 294, in
show_results
    self.show_packages_results(dependencies)
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/results.py", line 307, in
show_packages_results
    global_rating_score = self.get_global_rating_score(dependencies)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/results.py", line 277, in
get_global_rating_score
    global_rating_score = dependencies.get_global_rating_score()
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/dependencies.py", line 137, in
get_global_rating_score
    packages = dict(self.get_packages()).values()
                    ^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/dependencies.py", line 124, in
get_packages
    for dependency_node in self.dependencies_tree.children:
                           ^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/functools.py", line
1001, in __get__
    val = self.func(instance)
          ^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/dependencies.py", line 105, in
dependencies_tree
    for package, version in self.version_solution.decisions.items():
                            ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/functools.py", line
1001, in __get__
    val = self.func(instance)
          ^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating/dependencies.py", line 94, in
version_solution
    return solver.solve()
           ^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/version_solver.py",
line 74, in solve
    if not self._run():
           ^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/version_solver.py",
line 90, in _run
    next_package = self._choose_package_version()
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/version_solver.py",
line 359, in _choose_package_version
    term = self._next_term_to_try()
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/version_solver.py",
line 345, in _next_term_to_try
    zip(unsatisfied, self._threadpool.map(_get_min, unsatisfied))
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File
"/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/pool.py", line
367, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File
"/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/pool.py", line
774, in get
    raise self._value
  File
"/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/pool.py", line
125, in worker
    result = (True, func(*args, **kwds))
                    ^^^^^^^^^^^^^^^^^^^
  File
"/opt/homebrew/Cellar/python@3.11/3.11.6/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/pool.py", line
48, in mapstar
    return list(map(*args))
           ^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/version_solver.py",
line 331, in _get_min
    versions = self._source.versions_for(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/libs/mixology/package_source.py",
line 77, in versions_for
    return self._versions_for(package, constraint)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/package_source.py", line 185, in
_versions_for
    self.discover_and_add(package.req.__str__())
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/package_source.py", line 146, in
discover_and_add
    to_create = discover_dependencies_and_versions(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/pipper.py", line 462, in
discover_dependencies_and_versions
    report = _get_package_report(
             ^^^^^^^^^^^^^^^^^^^^
  File "/Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pipgrip/pipper.py", line 289, in
_get_package_report
    raise RuntimeError("Failed to get report for {}".format(package))
RuntimeError: Failed to get report for hj-nekobasu==3.0.7

Pip-rating version
pip-rating 0.2.2
  🔝 This is the latest version.
  🐍 Python version: 3.11.6
  💻 Platform: macOS-13.5.2-arm64-arm-64bit
  📦 Installation path: /Users/jacobo.devera/.local/pipx/venvs/pip-rating/lib/python3.11/site-packages/pip_rating
  📁 Current path: /Users/jacobo.devera/devel

Other details
pip-rating installed via pipx.
Checklist

[X] The error is in the project's code, and not in my own.
[X] I have searched for this issue before posting it and there isn't an open duplicate.
[X] I ran pip install -U pip-rating and triggered the bug in the latest version.

I apologize for the delay, I haven't had the PC available to look at this, but I hope to be able to debug it this week to give you an answer as soon as possible, thank you!

The bug has been confirmed, thanks!

@jdevera-hj, there is already a version available to try that fixes this bug. It is still under testing. If you want you can check if it works for you. Thank you!
https://github.com/Nekmo/pip-rating/tree/pip-rating-50

authors: Nekmo jdevera-hj

repo: Nekmo/pip-rating


text:
Fix error params in process.lua

Instead of concatenating it's passing the inspected object as a second parameter.
That's throwing an error when files are staged or branches switched from outside Neogit.

good catch, though I can't recreate it by staging or switching outside neovim. Still, the second argument should be the level, not another string.

Fwiw, I've seen it happen in three scenarios:

Staging the file using vim-fugitive's :GWrite
Cherry-picking from within a neovim terminal
Switching into remote branches

authors: CKolkey davidmh

repo: NeogitOrg/neogit


text:
Quantization takes a very long time

Using TGI or Lorax eetq quantization takes several minutes (Eg 10 minutes for Mixtral) every time the launcher is run .
As a reference bitsandbytes nf4 quant takes 1 minute.
Is there any way to store and directly load the eetq model?

And thank for this, I've been wishing for high-speed 8bit inference for quite some time :-)

@timohear It is very convenient to use eetq for model saving and loading, just like this

@timohear It is very convenient to use eetq for model saving and loading, just like this
from eetq.utils import eet_quantize eet_quantize(torch_model) torch.save(torch_model, "xxx_eetq.pt") ... torch.load(torch_model)
But it has not been adapted in TGI yet, your suggestion is very useful. We can optimize and test the loading eetq model process in TGI.

Late to the party as I'm upgrading eetq at the moment.  (TGI maintainer here).
We're not going to enable pickle pytorch at all, however safetensors save definitely.
I think all we have to do is save the model like regularly and add in the config quantization_config a quant_method: eetq and that's it.

authors: Narsil SidaZh timohear

repo: NetEase-FuXi/EETQ


text:
[BUILD] Fix CI profile kyuubi-extension-spark_3.1

Why are the changes needed?

How was this patch tested?

[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[ ] Run test locally before make a pull request

Codecov Report

Merging #645 (f676731) into master (66dcf45) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head f676731 differs from pull request most recent head 1499d5b. Consider uploading reports for the commit 1499d5b to get more accurate results

@@           Coverage Diff           @@
##           master     #645   +/-   ##
=======================================
  Coverage   79.87%   79.87%
=======================================
  Files         120      120
  Lines        4671     4671
  Branches      562      562
=======================================
  Hits         3731     3731
  Misses        624      624
  Partials      316      316

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 66dcf45...1499d5b. Read the comment docs.

repo: NetEase/kyuubi


text:
Task Search

Currently there is Workflow Search API, I was wondering if there are plans on having the Task Search as well?
Thanks,
Corey

@cquon Yes, this is in the plans.  We have the framework in place, but needs some work and testing to expose this via services and in the UI.

repo: Netflix/conductor

license_source: bigquery


text:
typeMapping does no import types to graphql schema

Since we are new to the codegen project (not to DGS itself) i'am trying to first state my motivation (not that it is an issue of expectations here).
My motivation is, that i have Java Types (mostly DTO's and Enums) which are used outside of GraphQL / DGS too, thus those are defined in the java project itself. That said, i want to use those types in GraphQL without redefining them (especially an issue for enums). So basically, generated graphql types from java types (dry DTOs and Enums).
For that we expected that using typeMapping would import / declare a java type for graphql, so for example for Enums it will create a EnumTypeDefinition which is then used by the graphql validator.
This seems not to work right now.
Steps to reproduce
type Query {
   appleKinds: `ApplesKindsDTO`
}

And now the java types
package
@Data
@AllArgsConstructor
@NoArgsConstructor
public class ApplesKindsDTO {
   List<AppleKind> kinds;
}

And the enum
public enum AppleKind {
  PinkLady,
  SquareOnes,
  TriangleOnes
}

Finally we configure those types to be mapped
typeMapping = [
  "ApplesKindsDTO": "org.example.dto.ApplesKindsDTO",
  "AppleKind": "org.example.AppleKind"
]

Now when just running/smoke testing the application, the DGS validation will fail with
Caused by: SchemaProblem{errors=[The field type 'ApplesKindsDTO' is not present when resolving type 'ApplesKindsDTO' [@1:1]]}
	at graphql.schema.idl.SchemaGenerator.makeExecutableSchema(SchemaGenerator.java:82)
	at com.apollographql.federation.graphqljava.Federation.transform(Federation.java:50)
	at com.netflix.graphql.dgs.internal.DgsSchemaProvider.schema(DgsSchemaProvider.kt:145)
	at com.netflix.graphql.dgs.autoconfig.DgsAutoConfiguration.schema(DgsAutoConfiguration.kt:192)

The type mapping is used to specify the graphql type (as defined in the schema) to map to corresponding Java type. In teh example you provided, "ApplesKindsDTO" is a java type, and is not in your schema.
Note that codegen generates POJOs based on the types in the graphQL schema, so you will need that.

thank you @srinivasankavitha for re-approving that we mis-understood codegen and actually had to learn that we need to integrate a code 2 schema library for types in our project in addition to DGS, since DGS is schema 2 code.
Thank you for helping out!

authors: EugenMayer srinivasankavitha

repo: Netflix/dgs-codegen


text:
Create MANIFEST to resolve missing files

Created MANIFEST.in in order to include additional files that are missing after building docker image. This may be too inclusive though since I just added everything in the src/dispatch folder, so adjust as necessary. Not familiar enough with the code to know what can or cannot be excluded.
This should resolve #59 and #60

Great catch, thank you!

authors: daniel-gallagher kevgliss

repo: Netflix/dispatch


text:
Feature/mock oncall plugin

Well, simply kills the oncall function to allow us to test gitlab plugin, yet, i saw mock where talked about in #55,
this Should solve the problem and let us start without a victor ops plugin. helping testing the other PR faster.

@xdecock we already have an oncall plugin we use for testing in this directory. In order to avoid adding more mocked plugins, we should move all test plugins under a new directory called dispatch_default (or something like that) in the Dispatch plugins directory and then import them where needed.

@xdecock see #100

authors: mvilanova xdecock


text:
Reduce calls to TokenMapSupplier

At the startup, the client was talking to every node in the dynomite cluster to get token information.
This was done at 3 places. This lead to slow client startup and also too many calls to the underlying token database,
This is a simple optimization to skip talking to remaining hosts if the client received the information for all the hosts
specfied.

done.
On Fri, Jun 1, 2018 at 2:57 PM, Shashi Madappa notifications@github.com
wrote:

@smadappa commented on this pull request.
In dyno-core/src/main/java/com/netflix/dyno/connectionpool/impl/lb/
AbstractTokenMapSupplier.java
https://github.com/Netflix/dyno/pull/224#discussion_r192525109:

@@ -144,12 +140,18 @@ public AbstractTokenMapSupplier(int port) {
// to a dynomite server
// hence trying them all
Set allTokens = new HashSet();

   Set<Host> remainingHosts = new TreeSet<>(activeHosts);

Can change this to HashSet as TreeSet will not buy us anything additional?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/Netflix/dyno/pull/224#pullrequestreview-125328377,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ALle58WBrfgZvI1a7SAkKiamznousaTBks5t4bjGgaJpZM4UXNzp
.

@ipapapa The new releases have not made to the actual maven repo.
https://mvnrepository.com/artifact/com.netflix.dyno/dyno-core
Can we please push it there for us to use?

I can see it there in Bintray: https://bintray.com/netflixoss/oss-candidate/dyno/1.6.4-rc.4
According to the instructions if you do compile 'com.netflix.dyno:dyno-client:1.6.4-rc.4' in your Gradle, it would work. Did you try?

Hi @ipapapa
I see two issues here

The jar files are not there yet in http://jcenter.bintray.com/com/netflix/dyno/dyno-jedis/
When setting repo url to https://bintray.com/netflixoss it downloads the new rc jars, however the jars seems to be corrupted.

The dyno-core jar file size in new rc 3 and 4 seems to be wrong and rc2 is bigger

@rspieldenner Has there been any change in the way we publish the artifacts?

@ipapapa  and @rspieldenner  Any update here? Can we please fix the jar issues and push to the repo?

Dyno is configured to publish candidate jars to the special oss-candidate repo so we don't leak candidate code to the jcenter repo. We can configure it to publish candidates to jcenter if thats the desired behavior.
Having all the jars and poms the same size is suspect. Looking at that now.

when downloaded via gradle

repositories {
    jcenter()
    maven {
        url 'https://dl.bintray.com/netflixoss/oss-candidate/'
    }
}

dependencies {
    compile 'com.netflix.dyno:dyno-core:1.6.4-rc.4'
}```

```➜  1.6.4-rc.4 tree
.
├── bb571c351619111b6c3483a647eccb3b2e07c884
│   └── dyno-core-1.6.4-rc.4.pom
└── c31cbf420235b4498150647559a53f469a23ef99
    └── dyno-core-1.6.4-rc.4.jar

2 directories, 2 files
➜  1.6.4-rc.4 ls -hl bb571c351619111b6c3483a647eccb3b2e07c884/dyno-core-1.6.4-rc.4.pom
-rw-r--r--  1 rspieldenner  staff   4.0K Jun 12 12:50 bb571c351619111b6c3483a647eccb3b2e07c884/dyno-core-1.6.4-rc.4.pom
➜  1.6.4-rc.4 ls -hl c31cbf420235b4498150647559a53f469a23ef99/dyno-core-1.6.4-rc.4.jar
-rw-r--r--  1 rspieldenner  staff   188K Jun 12 12:52 c31cbf420235b4498150647559a53f469a23ef99/dyno-core-1.6.4-rc.4.jar```

Thanks @rspieldenner
With the change to the repo url to https://dl.bintray.com/netflixoss/oss-candidate/ the downloaded jars looks ok. Earlier I had https://bintray.com/netflixoss
So is it safer to assume now that there wont be any more rc's published to maven repo at https://mvnrepository.com/artifact/com.netflix.dyno/dyno-core ?
It was convenient when using maven to download it from
https://mvnrepository.com/artifact/com.netflix.dyno/dyno-core and we have all our existing rc's with rc2. Only 3 and 4 are missing. Please let me know.

authors: balajivenki ipapapa rspieldenner shailesh33

repo: Netflix/dyno


text:
Eureka REST operations

Hi all, how it's going?
I am on the development of a monitoring services status based on spring. I developed a scheduled method so with getServices retrieves all the services are in the network, and look if som service is missing
The problem is that when I run a service that is registered in Eureka, and when I retrieve all the services I don't see the service I runned before, but if I enter the to de dashboard and next time I run getServices (from EurekaDiscoveryClient) I get the service I runned before

Is it possible better to retrieve the services via rest endpoints?  (GET /eureka/v2/apps gives me NOT FOUND https://github.com/Netflix/eureka/wiki/Eureka-REST-operations)

Thanks in advance

The code I use to monitor the services is that
@Scheduled(fixedDelay = 900000)
public List<String> listServices() throws TelegramApiException {
List<String> servicesActive = client.discoveryClient.getServices();

for (String service : services) {
	if (!servicesActive.contains(service)) {
		System.out.println("El servicio " + service + " esta caido");
		SendMessage message = new SendMessage();
		message.setChatId("-12343123446");
		message.setText("El servicio " + service + " esta caido");
		bot.execute(message);
	}
}

return servicesActive;
}

I'm not sure how we can help, getServices() is not a method from Eureka, if this is a SBN thing I suggest asking there. But honestly the use case and the problem is unclear anyway, if you could provide a minimal example with expected vs actual data I could at least point you in the right direction.

The problem is:

I run a spring server that is integrated with eureka (at this point eureka should have registered the service)
I call getServices method from discoveryClient, this method returns a list of all services that eureka registered, but I don't get the service I runned (and I should)
I enter the dashboard and i see my service in the dashboard listed
I call another time getServices and appears my service listed

I am trying to use eureka so I can be sure all the services are running, for this, I use the getservices method
Theoretically I should see in the step 2 my service I recent runned, but I see nothing, only after entering in the dashboard, next, in the getServices output I see my service listed
This problem can be fixed with the rest operations (I think) but I get a 404 when I make a request to /eureka/v2/apps, therefore I asked this here, I don't know why I am getting 404 code
Any help please?

You may not be getting all the expected services because of a race?
Regarding the RESTful endpoint, it's GET /eureka/v2/apps by default, so that's correct, I can't say why you're getting a 404 without knowing how you setup your server.

Insert this in your main class (Eureka Server):
public @Bean FilterRegistrationBean<?> corsFilter() {
	UrlBasedCorsConfigurationSource source = new UrlBasedCorsConfigurationSource();
	CorsConfiguration config = new CorsConfiguration();
	config.setAllowCredentials(true);
	config.addAllowedOrigin("http://localhost:4200");
	config.addAllowedMethod("*");
	config.addAllowedHeader("Accept");
	source.registerCorsConfiguration("/**", config);
	FilterRegistrationBean<Filter> bean = new FilterRegistrationBean<Filter>(new CorsFilter(source));
	bean.setOrder(Ordered.HIGHEST_PRECEDENCE);
	return bean;
}

Full example: https://github.com/EffNox/spring_eureka-rest-operations-angular

You may not be getting all the expected services because of a race?
Regarding the RESTful endpoint, it's GET /eureka/v2/apps by default, so that's correct, I can't say why you're getting a 404 without knowing how you setup your server.

v2 does not exist - the path only works without it.

authors: EffNox dmakvh sarmancoder troshko111

repo: Netflix/eureka


text:
metric other than sample count

Thanks, great tool.
It would be interesting to have the heat map present other metrics than cpu sample count.
For example throughput and especially some latency statistic (eg median, 99th etc).
The data would come from elsewhere so would need to follow some predefined format, at the right interval.
Expect It likely not be possible to collect this kind of data from production systems. Test/ Benchmark systems may be able to though.
It might be a problem to marry up the perf kernel timestamps to userspace timestamps. it might fall on the perf record end to get the right clock.
$ perf record -h 2>&1|grep -i clock
    -k, --clockid <clockid>
                          clockid to use for events, see clock_gettime()```

Thanks for the suggestion @ceeaspb ! We already did it with a few other metrics internally and might be able to share something in the future.
In cases like that, what worked for us is adding a tools directory in the repo, with scripts to collect the data and format it in a way FlameScope can understand. If you have something specific in mind, we're open to PRs.

New profile formats should resolve this issue. See https://github.com/Netflix/flamescope/issues/69 for details. Closing to centralize discussion.

authors: ceeaspb spiermar

repo: Netflix/flamescope


text:
Add a suggestion to start flamescope on host = '0.0.0.0' (bind to all interfaces)

versus 127.0.0.1
a lot of folks will have this age-old issue.
(trying to prevent people from having a bad initial experience.)

Thanks for the suggestion @cfregly

authors: cfregly spiermar


text:
Entrust cross signed sub ca

Entrust provides support for cross-signed subCAS. One can set ENTRUST_CROSS_SIGNED_RSA to the respective cross-signed subCA PEM, such as L1K, Lemur will replace the retrieved subCA with ENTRUST_CROSS_SIGNED_RSA.

Coverage decreased (-0.01%) to 60.693% when pulling d914d37e6b04fdc849732cdbbff82c1d8eae7fd4 on hosseinsh:entrust-cross-signed-subCA into 88e587af1155fb053e5423e19d7bbf4a0695a7c7 on Netflix:master.

Coverage decreased (-0.01%) to 60.693% when pulling d914d37e6b04fdc849732cdbbff82c1d8eae7fd4 on hosseinsh:entrust-cross-signed-subCA into 88e587af1155fb053e5423e19d7bbf4a0695a7c7 on Netflix:master.

authors: coveralls hosseinsh

repo: Netflix/lemur


text:
IAM check misses '*' when found within a list.

https://github.com/Netflix/security_monkey/blob/master/security_monkey/auditors/iam/iam_policy.py#L71
The IAMPolicyAuditor class is the parent class to the IAMUser, IAMRole, IAMGroup, and ManagedPolicy Auditors.  This class contains a method library_check_iamobj_has_star_privileges() to look for statements where the action is '*':
def check_statement(statement):
        if "Action" in statement and statement["Action"] == "*":
            if statement["Effect"] == "Allow":
                self.add_issue(10, tag, iamobj_item, notes=json.dumps(statement))

This code fails when the asterick is an item in a list of the allowed actions:
"userpolicies": {
    "admin": {
      "Version": "2012-10-17",
      "Statement": [
        {
          "Action": [
            "*"
          ],
          "Resource": [
            "*"
          ],
          "Effect": "Allow",
          "Sid": "Stmt"
        }
      ]
    }
  },

So it misses:
"Action": [
            "*"
          ],

But catches:
"Action": "*"

The library function should be extended to work in both scenarios.  The other checks should also be checked for this bug.
Tests should be added for these cases.

FYI - the check for iam:* appears to handle this more correctly:
    def check_statement(statement):
        if statement["Effect"] == "Allow":
            if "Action" in statement and type(statement["Action"]) is list:
                for action in statement["Action"]:
                    if action.lower() == "iam:*":
                        self.add_issue(10, tag, iamobj_item, notes=json.dumps(statement))
            else:
                if "Action" in statement and statement["Action"].lower() == "iam:*":
                    self.add_issue(10, tag, iamobj_item, notes=json.dumps(statement))

Merged fix in @228.


text:
Backport IgorProIO into 0.4.x?

@apdavison  I'm interested in using the IgorProIO module and possibly expanding it to include other IgorPro file formats (such as importing all traces from a given path in a .pxp file).  Would you let me backport it into 0.4.x?  Or do I need to suck it up and get my projects working with 0.5 first?

@rgerkin Here's the deal: if you add .pxp support in 0.5* you have my permission to backport it to 0.4 (-;
*which should be easy since the underlying igor module supports .pxp already

@apdavison
I've added preliminary support for importing data from .pxp files here, demonstrated here.
Could you assign this issue to me, so I can see it in my dashboard and be sure to finish it?

Implemented in #363 (and I no longer need to backport to neo 0.4 since I am moving my things to 0.5).

authors: apdavison rgerkin

repo: NeuralEnsemble/python-neo


text:
Fixed detection of warnings in test_blackrockio.py (#568)

See #568
Now the position of the warning in the list of warnings is not assumed anymore.
Instead the test checks if the warning is in the list of warnings.
Apart from that the warnings.simplefilter filter should only be changed within
the context of catch_warnings here in order to ensure it being set to its original
state afterwards. This was done as well.

Hello @bjoern1001001! Thanks for submitting the PR.

In the file neo/test/iotest/test_blackrockio.py, following                are the PEP8 issues :

Line 318:82: E225 missing whitespace around operator
Line 320:38: E127 continuation line over-indented for visual indent

Coverage decreased (-0.006%) to 49.58% when pulling 4bfc171f1c8461edb6f913afadfeee8173f71806 on bjoern1001001:fix/warn_tests into 00d94e51f520b8836bcd89f532c09f495f974f67 on NeuralEnsemble:master.

The other failing tests are due to some more changes in numpy and will be incorporated here if PR https://github.com/bjoern1001001/python-neo/pull/1 is accepted by @bjoern1001001.

Thank you @JuliaSprenger, I had not noticed that.
Seems like it's working now.


text:
Add group ID to clipboard on click

Allow for users to click on the group id and send to clipboard

Allow for users to click on the group id and send to clipboard

Legit was just moments from posting that exact thing.

Great minds think alike haha

authors: Ferrariic Maskloss

repo: NeverScapeAlone/never-scape-alone


text:
Update(.ajaja): 응원 리마인드 알림톡 방식 적용

🔍 어떤 PR인가요?

응원 리마인드에 알림톡 스케줄링 방식을 적용하였습니다.
계획 스케줄링 코드들을 일부 개선하였습니다.
리마인드 테이블에 엔드포인트 필드를 추가하였습니다.

😋 To Reviewer

기존 ncp 요청 시 템플릿 이름이 잘못 들어가는 오류가 있어서 수정하였습니다. -> 9279f12a8da9048d689c46176a315206efdf4e99
비동기 처리를 담당하는 메소드가 많이 중복되어서 유틸 클래스 같은 걸로 빼면 어떨지 고민입니다..
기존에 논의되었던 리마인드 필드를 하나 추가했습니다.
리마인드 전송 오류에 5회 이내는 로그만 찍고 최대 요청 횟수가 초과되면 그때 리마인드 예외 핸들러를 호출하도록 하였습니다. (최종적으로 전송을 실패했을 경우만)

✅ 작성한 테스트

send_Success_WithNoException
send_Fail_ByExternalApiFailed
send_Success_WithNoException
send_Fail_ByExternalApiFailed

아좌좌 애그리거트를 좀 의미있게 만들어보고 싶어서 아좌좌 쪽 코드를 수정하였습니다! -> 86ffb442ecae98c1f0ea582f91b8c7bd65cd80b2
변경 사항은 다음과 같습니다.

아좌좌 리마인드 전송 시에 필요한 값들을 추가하였습니다. (ex. 유저 정보, 타겟 정보)
해당 값이 추가됨에 따라서 로직들이 일부 변경되었습니다.
그에 따라 테스트 코드 또한 수정되었습니다.
@JuwoongKim @kys0411 한번 확인해보시면 좋을 것 같습니다!

@Hejow 리뷰에 남겨주신 피드백들 모두 반영하였습니다!

@JuwoongKim 변경된 ajaja 애그리거트에 맞게 발자취 객체 생성자 매개변수를 변경하였습니다! -> b340f84efb7a3b1c1b75d5c75c7a78338fa661b9
@Hejow 리뷰 남겨주신 내용 코멘트 남겨드렸습니다! 추상화 작업도 바로 진행해보겠습니당

추상 클래스에 공통 인터페이스를 적용하는 작업을 일부 진행해보았습니다! -> 2a5ab247c4c83d2ba8321eb57e80a3f9f3449ad8
다만 아직 인터페이스 부분이 좀 부족한 상황인데, 구현적인 문제에 좀 부딪혔습니다 ㅠ
추상 클래스에 있는 send() 메서드에서 리마인드를 전송하는 로직을 구현해보려고 하였으나 구현체(adapter)에 있는 전송 로직을 어떻게 가져올 지 고민이 많이 되었습니다.
그래서 인터페이스를 구현한 추상 클래스는 예를 들어 send(class<?> sender) 라는 메소드를 가지고 리플렉션을 적용해서 처리하려고 했는데 예외 처리가 급격히 늘어나서 일단 보류해놓은 상황입니다!
아니면 혹시 제가 너무 어렵게 생각하고 있을 걸까요.. 피드백 주고 받으면서 계속 보완해보겠습니다!

repo: New-Barams/This-Year-Ajaja-BE


text:
Markup Errors When Running A Second Time From CLI

After running markup for a second time from the CLI this error generates:
markup
Ø Running markup
Ø Markup: ✔ All done!
Ø markup
Ø Running markup
Ø Markup: ✔ All done!
Ø Error running task sequence: { task: 'markup',
duration: 0.000308413,
hrDuration: [ 0, 308413 ],
message: 'markup catch',
err: [TypeError: Object html has no method 'join'] }
Object html has no method 'join'TypeError: Object html has no method 'join'
at Gulp. (/Users/ed.long/Sites/edolyne.com/node_modules/norma-markup/package.coffee:71:30)
at module.exports (/Users/ed.long/Sites/edolyne.com/node_modules/gulp/node_modules/orchestrator/lib/runTask.js:34:7)
at Gulp.Orchestrator._runTask (/Users/ed.long/Sites/edolyne.com/node_modules/gulp/node_modules/orchestrator/index.js:273:3)
at Gulp.Orchestrator._runStep (/Users/ed.long/Sites/edolyne.com/node_modules/gulp/node_modules/orchestrator/index.js:214:10)
at Gulp.Orchestrator.start (/Users/ed.long/Sites/edolyne.com/node_modules/gulp/node_modules/orchestrator/index.js:134:8)
at runNextSet (/Users/ed.long/Sites/edolyne.com/node_modules/norma-markup/node_modules/run-sequence/index.js:74:16)
at runSequence (/Users/ed.long/Sites/edolyne.com/node_modules/norma-markup/node_modules/run-sequence/index.js:85:2)
at Gulp. (/Users/ed.long/Sites/edolyne.com/node_modules/norma-markup/package.coffee:112:7)
at module.exports (/usr/local/lib/node_modules/normajs/node_modules/gulp/node_modules/orchestrator/lib/runTask.js:34:7)
at Gulp.Orchestrator._runTask (/usr/local/lib/node_modules/normajs/node_modules/gulp/node_modules/orchestrator/index.js:273:3)
at Gulp.Orchestrator._runStep (/usr/local/lib/node_modules/normajs/node_modules/gulp/node_modules/orchestrator/index.js:214:10)
at Gulp.Orchestrator.start (/usr/local/lib/node_modules/normajs/node_modules/gulp/node_modules/orchestrator/index.js:134:8)
at runNextSet (/usr/local/lib/node_modules/normajs/node_modules/run-sequence/index.js:64:16)
at runSequence (/usr/local/lib/node_modules/normajs/node_modules/run-sequence/index.js:75:2)
at runTask (/usr/local/lib/node_modules/normajs/lib/methods/watch.coffee:32:5)
at /usr/local/lib/node_modules/normajs/lib/methods/watch.coffee:105:9
at Interface. (/usr/local/lib/node_modules/normajs/lib/utilities/prompt.coffee:121:5)
at Interface.EventEmitter.emit (events.js:117:20)
at Interface._onLine (readline.js:202:10)
at Interface._line (readline.js:531:8)
at Interface._ttyWrite (readline.js:760:14)
at ReadStream.onkeypress (readline.js:99:10)
at ReadStream.EventEmitter.emit (events.js:98:17)
at emitKey (readline.js:1095:12)
at ReadStream.onData (readline.js:840:14)
at ReadStream.EventEmitter.emit (events.js:95:17)
at ReadStream. (stream_readable.js:745:14)
at ReadStream.EventEmitter.emit (events.js:92:17)
at emitReadable (_stream_readable.js:407:10)
at emitReadable (_stream_readable.js:403:5)
at readableAddChunk (_stream_readable.js:165:9)
at ReadStream.Readable.push (_stream_readable.js:127:10)
at TTY.onread (net.js:528:21)
Ø

This error is now showing each time you run markup from the cli

repo: NewSpring/norma-markup

license: mit


text:
Pulldown-Menü geht nicht

Hallo.
Bei den Einstellungen des Adapters steht KIA, Hyundai kann nicht mehr ausgewählt werden.

Hast du ein Hyundai Fahrzeug?

authors: Michaelnorge Newan


text:
03-pages > 01-building-your-application > 06-configuring > 06-mdx.mdx

기여자용
문서 개선

PR을 열기 전에 pnpm prettier-fix를 실행하여 서식 문제를 해결합니다. - 문서 기여 가이드를 읽고 문서 지침을 따르는지 확인하세요: https://github.com/Nextjs-kr/Nextjs.ko/blob/main/packages/next/README.md

Progress

[x] pnpm prettier-fix
[x] 번역 초안 작성 (Draft translation)
[x] 공통 스타일 가이드 확인 (Check the common style guide)
[x] 모범사례 확인 (Check best practices)
[x] 용어 확인 (Check the term)
[x] 맞춤법 검사 (Spelling check)
[ ] 리뷰 반영 (Resolve reviews)

@hjy0951 리뷰 이후 작업이 몇일 동안 이뤄지지 않아 9월 13일까지 작업이 없을 경우 이슈를 close하고 새로운 분에게 할당하겠습니다!


text:
CSRF Token error using Nginx Proxy Manager

Hi, guys
I'm very new to NPM (Nginx Proxy Manager) yesterday I setup NPM with Docker and hosted my Laravel apps,
At first I was getting Mixed Content error (The page was loaded over HTTPS but requested assets over HTTP)
I managed to fix that by following this tutorial (https://geekscircuit.com/how-to-add/)
But now I'm getting many errors like Laravel's CSRF token mismatch, Meilisearch's API Authorization header missing.

I think it has something to do with some headers or something.
But I really don't know how to configure it properly.
My docker-compose.yml
version: '3'
services:
  app:
    image: 'jc21/nginx-proxy-manager:latest'
    container_name: "Nginx-Proxy-Manager-GUI"
    restart: unless-stopped
    ports:
      - '80:80'
      - '81:81'
      - '443:443'
    environment:
      X_FRAME_OPTIONS: "sameorigin"
    volumes:
      - ./data:/data
      - ./letsencrypt:/etc/letsencrypt
      -  ./_hsts.conf:/app/templates/_hsts.conf:ro # I've just added this from this article (https://geekscircuit.com/how-to-add/)

Many thanks in advance :)

Same here, other setup though.
Is this problem still consisting?
If yes, I'll keep you up to date if I figure something out :)

Hello, I encountered the same issue while running NGINX Proxy Manager with a Django app. I resolved it by placing Cloudflare Tunnels in front of my NGINX Proxy Manager and handling the routing through Cloudflare Tunnels. Not a solution to the problem, but a workaround. Any chance this will be resolved in the near future?

authors: Aniket-IN EscGoatZA SpyTVofficial

repo: NginxProxyManager/nginx-proxy-manager


text:
Temp workaround (that works for me!) for SSL certificate renewal bug

I know there are already lots of issues on this topic - I've tried to link to most of them below. I've just had to renew 16 sites on one server (running the latest v.2.10.2) and thought I'd go through the process that seemed to work reliably for me in case it helps others (with thanks to posters in other issues where I've gleaned this info from!).
Given how it works I suspect the issue is the the requests to the ACME endpoint not being allowed through when force SSL is enabled (as mentioned in some bug reports) and I'm hopeful @jc21 can merge in #2038 that seems to be an option (but is unfortunately now based off an older base).
Symptom

SSL certificates do not automatically renew and you receive a warning email from LetsEncrypt about an upcoming expiring certificate (typically I seem to get them when <20 days left to go).  Attempts to manually review end up just showing an 'Internal server error'
Workaround
Part 1 - clear any certbot.lock files
I've found there is sometime an error caused by a a duplicate instance of CertBot running. You can check whether there are .certbot.lock files in your system:
find / -type f -name ".certbot.lock"

If there are, you can remove them:
find / -type f -name ".certbot.lock" -exec rm {} \;

(from https://community.letsencrypt.org/t/solved-another-instance-of-certbot-is-already-running/44690/2)
Part 2 - turn off Force SSL and then renew

After clearing any certbot lock, I then went through site by site and 1) disabled Force SSL on the proxy host page then 2) requested certificate renewal on the SSL page and then 3) re-enabled SSL and all sub-options back on the proxy host page.
As I say it takes a while and is frustrating but I found it worked reliably and they're all now renewed for the next 3 months.  If you don't switch off Force SSL then you just end up with an internal error.
Related issues on this topic (in the hope that once this issue is resolved these can all be closed)
#1771 #1816 #1856 #2048 #2251 #2258 #2267 #210 #2418 #2499 #2593 #2642 #2713 #2860

It really works thanks. Certs were before normally renewed, found out that it stopped working when I updated to the latest version. When it will be fixed?

Agree, @ririko5834 - it used to work fine for me but seemed to stop a few version ago. Hopefully the PR can be merged in to the latest codebase....

Just did this, thanks for the workaround writeup.

Hmm, for me, no such files were found, hence, didn't work for me

@jc21 any word on when a fix might be coming for this SSL cert renewal issue? That's me having to manually renew another 10 sites this evening 😭

Hmm, for me, no such files were found, hence, didn't work for me

Neither I found any lock file but the trick disabling force SSL its the important part! Try anyway

Hmm, for me, no such files were found, hence, didn't work for me

@jhalak1984 did you try part 2? The main bit seems to be force SSL not allowing an ACME exclusion, the first bit is just to ensure no conflicting certbot instances running.

Thanks to the work from @the1ts in #2038 and the comments from @Whoopsadaisy re regex on that PR https://github.com/NginxProxyManager/nginx-proxy-manager/pull/2038#issuecomment-1372833078 I've created a new PR that combines their comments to stop /.well-known/acme-challenge requests from being redirected to https.
The new PR has been build (you can access it in a docker compose file by commenting our your current image and using image: 'jc21/nginx-proxy-manager:github-pr-3121' instead). The only change I made was to the one force-ssl-.conf file, but it is based off the current develop branch (2.10.4 as of today) so will include any other changes on there.
I've tried it on two servers that I run - on the first I was now enable to renew OK just by clicking 'renew now' on the SSL page. On the other one I initially still got the internal error but when I ran the first bit of the code in my OP above I found 3 certbot instances running so once I cleared them it seemed to renew OK. Out of interest I've only renewed one certificate on that server to see if the rest renew OK!
If you're happy to do so then please test it out - it is showing as OK to merge so if this merges hopefully it'll be accepted by @jc21 😃

with "docker exec 4346c32b69a7 find / -type f -name ".certbot.lock""
I get
find: '/proc/tty/driver': Permission denied
find: '/sys/kernel/debug': Permission denied

Thanks to the work from @the1ts in #2038 and the comments from @Whoopsadaisy re regex on that PR #2038 (comment) I've created a new PR #3121 that combines their comments to stop /.well-known/acme-challenge requests from being redirected to https.
The new PR has been build (you can access it in a docker compose file by commenting out your current image and using image: 'jc21/nginx-proxy-manager:github-pr-3121' instead). The only change I made was to the one force-ssl-.conf file, but it is based off the current develop branch (2.10.4 as of today) so will include any other changes on there.
I've tried it on two servers that I run - on the first I was now enable to renew OK just by clicking 'renew now' on the SSL page (something that previously errored out). On the other one I initially still got the internal error but when I ran the first bit of the code in my OP above I found 3 certbot instances running so once I cleared them it seemed to renew OK. Out of interest I've only renewed one certificate on that server to see if the rest renew OK automatically. In both cases everything still seems to redirect to https OK and the regex seems to check out OK - (https://regex101.com/r/H58N25/1)
If you're happy to do so then please test it out - it is showing as OK to merge so if this merges hopefully it'll be accepted by @jc21 😃
PS - I checked back 10-15 min later and it seems that all the other certs have autorenewed too so that saved me quite a bit of work switching force SSL off/on for each one!

So what do I need to do to get this working with Nginx Proxy Manager Addon running on HomeAssisant? I got yesterday the mails that my certs will expire soon. I do not know what went wrong, but I can not renew them and currently, the certs are also not accepted anymore by the Android App (I guess I messed something up by adding my subdomains to the DuckDns Addon).

@Panoramiac sorry I'm running it on VPS with Docker/Portainer so can easily specify a different image to use - I'm not 100% sure re Home Assistant how to do that (I do run HA but only on my NAS on my home network) - might be worth asking in the HA forums if someone knows how to specify a different image to use?

hmm for me it does not work. received a mail about expiring certs. went and try to renew. didnt work. looked up on the internet and found this workaround. but for me it does not work. there are not certbot.lock files in my docker container. and disabling ssh also does not do anything. tried rebooting the container, the vps and all steps here. not quite sure where to go from here.

@mtojay did you try the different version in the PR I submitted? I've been running it since I created it and all auto-renewals going through fine for me.

thx for your answer @EDIflyer, but yeah i tried taht. i pulled the docker image with your PR, but i still get "Internal Error". After recreating the container with the new image i tried looking for locked Certbots, but i dont get any. I dont know what i am doing wrong, but i cant get new ceritificates no matter how often i try what had been suggested here in this thread.
I probably have an unrelated issue. If my certs expire in t he coming days i will retry again.

Ah OK, sorry to hear that @mtojay. At least you've ruled out locked Certbots. Is there anything more in the NPM logs that you can see when you try to renew and get the error?  The issue at https://github.com/NginxProxyManager/nginx-proxy-manager/issues/1816 goes through some of what others found.  Sorry I can't help more!

this workaround is not working for me to, i change the image to image: 'jc21/nginx-proxy-manager:github-pr-3121' still can't get it work, i follow the instruction and delete and reinstall NPM still can't create SSL cert or renew the cert, please help.

Hmm weird, I'm still using that one and it works OK. Does it pull the image down OK?

Hmm weird, I'm still using that one and it works OK. Does it pull the image down OK?

yup it did pull the image without any error.

OK - I presume port 80 is open on your firewall to allow the certbot requests to get through to the acme endpoint? I'm afraid I don't have many other ideas!

I guess I experience the same problem, the certs aren't renewing in my instance too. docker logs gives this:
[11/10/2023] [7:55:11 AM] [SSL      ] › ✖  error     Error: Command failed: certbot renew --non-interactive --quiet --config "/etc/letsencrypt.ini" --work-dir "/tmp/letsencrypt-lib" --logs-dir "/tmp/letsencrypt-log" --preferred-challenges "dns,http" --disable-hook-validation
Another instance of Certbot is already running.

    at ChildProcess.exithandler (node:child_process:402:12)
    at ChildProcess.emit (node:events:513:28)
    at maybeClose (node:internal/child_process:1100:16)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:304:5)

I guess a fix will be released in near future?

@peterge1998 it's been like this for months so sadly I'm not sure a fix is imminent. Did you try the code posted above re duplicate certbot instances or running the PR version I created? Worth a shot but no guarantees it'll help I'm afraid!

@peterge1998 it's been like this for months so sadly I'm not sure a fix is imminent. Did you try the code posted above re duplicate certbot instances or running the PR version I created? Worth a shot but no guarantees it'll help I'm afraid!

How can I run the PR version with docker?

How can I run the PR version with docker?
If you replace the normal image with image: 'jc21/nginx-proxy-manager:github-pr-3121' in your docker compose (or tweak appropriately for docker run) command then that should do the trick.

I get this error with the image of your pr now when renewing certs:
[11/10/2023] [7:21:42 PM] [SSL      ] › ℹ  info      Command: certbot renew --force-renewal --config "/etc/letsencrypt.ini" --work-dir "/tmp/letsencrypt-lib" --logs-dir "/tmp/letsencrypt-log" --cert-name "npm-14" --preferred-challenges "dns,http" --no-random-sleep-on-renew --disable-hook-validation
[11/10/2023] [7:21:42 PM] [Express  ] › ⚠  warning   Command failed: certbot renew --force-renewal --config "/etc/letsencrypt.ini" --work-dir "/tmp/letsencrypt-lib" --logs-dir "/tmp/letsencrypt-log" --cert-name "npm-14" --preferred-challenges "dns,http" --no-random-sleep-on-renew --disable-hook-validation
Another instance of Certbot is already running.
Ask for help or search for solutions at https://community.letsencrypt.org. See the logfile /tmp/certbot-log-9kceqaqh/log or re-run Certbot with -v for more details.

Deleting and adding it again works...

Damn, sorry to hear that. The weird thing is it's still working OK on mine with that PR version. I assume port 80 is open to allow challenge requests through? Did you run the command in the container to clear the other certbot instances too? I'm afraid I'm out of ideas after that!

+1'ing.
Made the manual change this PR makes in my own setup and can confirm it fixes my issue.
Thank you, @EDIflyer

For me it was a combination of the following that caused the error:

I've used DNS challenge with Namecheap API
Namecheap demands whitelisting IPs for anything that wants to access its APIs
My IP is dynamic

Once I've whitelisted my current IP, the renewal worked even with all of my hosts having "Force SSL" enabled.

Turning off "Force SSL" didn't work at first.
I found out that I had reached the validation limit

All issuance requests are subject to a Failed Validation limit of 5 failures per account, per hostname, per hour (using a sliding window).
After waiting for an hour, it worked.

Btw. I couldn't find/delete any ".certbot.lock" files in the container.

What worked for me was to temporary add a forward rule on the router to enable port 80 traffic to the website. Because apparently there were problems with the accessibility of the website from Let's Encrypt. After the refresh I turned off the forward rule to port 80 again.

Turning "Force SSL" off worked.. unfortunately this issue after almost 2 years (probably more) is still present. Turning "Force SSL" off/on every 3 months is not very convenient, especially if you 20-30 domains or more.

@apoorv569 have you tried the version in my PR #3121 ?  If turning off SSL worked for you that should hopefully fix it for renewals.

@apoorv569 have you tried the version in my PR #3121 ? If turning off SSL worked for you that should hopefully fix it for renewals.

Sorry for the late response.
Fix as in I have apply a PR to my install?

@apoorv569 as in running the Docker container generated by the PR instead of latest

@jc21 I see some PRs are being accepted, any chance of merging this one in? Thanks!


text:
UPDATE project.godot TO VERSION 4.3 YOU OUTDATED F

This pull request includes a small change to the project.godot file. The change updates the config/features to use version "4.3" instead of "4.2".

project.godot: Updated config/features to PackedStringArray("4.3", "Forward Plus") from PackedStringArray("4.2", "Forward Plus").

bro i don't care abt godot updates look Visual Basic Script just updated and Java 26 is out! :steamhappy:

can this be rewritten in visual basic @everyone

This pull request includes a small change to the project.vbproj file. The change updates the config/features to use version "4.3" instead of "4.2".

project.vbproj: Updated config/features to use version "4.3" instead of "4.2".

authors: Nibbl-z Shuflduf