text:
HBASE-23324 Deprecate clients that connect to Zookeeper

Our objective is to remove ZooKeeper from our public interface, remaking it as an internal concern. Connecting to a cluster via ZooKeeper quorum will be considered deprecated starting in 2.6. Our default connection mechanism will switch to via RPC in 3.0 And finally we intend to remove the ZooKeeper connection mechanism from client-facing APIs in 4.0.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 27s
Docker mode activated.

-0 :warning:
yetus
0m  2s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 39s
master passed

+1 :green_heart:
compile
0m 32s
master passed

+1 :green_heart:
shadedjars
5m 40s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 27s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 26s
the patch passed

+1 :green_heart:
compile
0m 30s
the patch passed

+1 :green_heart:
javac
0m 30s
the patch passed

+1 :green_heart:
shadedjars
5m 26s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 25s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 50s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 21s
hbase-client in the patch passed.

23m 33s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 3e26cbf3550c 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Temurin-1.8.0_352-b08

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/testReport/

Max. process+thread count
366 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 37s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 59s
master passed

+1 :green_heart:
compile
1m 17s
master passed

+1 :green_heart:
checkstyle
0m 31s
master passed

+1 :green_heart:
spotless
0m 43s
branch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
1m 17s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 45s
the patch passed

+1 :green_heart:
compile
1m 12s
the patch passed

-0 :warning:
javac
0m 39s
hbase-client generated 1 new + 34 unchanged - 0 fixed = 35 total (was 34)

-0 :warning:
checkstyle
0m 17s
hbase-common: The patch generated 1 new + 1 unchanged - 0 fixed = 2 total (was 1)

-0 :warning:
checkstyle
0m 16s
hbase-client: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
4m 55s
Patch does not cause any errors with Hadoop 3.3.6.

-1 :x:
spotless
0m 14s
patch has 23 errors when running spotless:check, run spotless:apply to fix.

+1 :green_heart:
spotbugs
1m 33s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 21s
The patch does not generate ASF License warnings.

25m 38s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile

uname
Linux 2e5b83778bf9 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-11.0.17+8

javac
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-client.txt

checkstyle
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-common.txt

checkstyle
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-client.txt

spotless
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-general-check/output/patch-spotless.txt

Max. process+thread count
79 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/console

versions
git=2.34.1 maven=3.8.6 spotbugs=4.7.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
4m 28s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
3m 43s
master passed

+1 :green_heart:
compile
0m 57s
master passed

+1 :green_heart:
shadedjars
5m 50s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 38s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 10s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 13s
the patch passed

+1 :green_heart:
compile
0m 50s
the patch passed

+1 :green_heart:
javac
0m 50s
the patch passed

+1 :green_heart:
shadedjars
5m 19s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 36s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 14s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 28s
hbase-client in the patch passed.

31m 25s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 230c16749409 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-17.0.10+7

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/testReport/

Max. process+thread count
398 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 15s
Docker mode activated.

-0 :warning:
yetus
0m  2s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
4m  4s
master passed

+1 :green_heart:
compile
0m 51s
master passed

+1 :green_heart:
shadedjars
7m 20s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 48s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 14s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
4m  0s
the patch passed

+1 :green_heart:
compile
0m 49s
the patch passed

+1 :green_heart:
javac
0m 49s
the patch passed

+1 :green_heart:
shadedjars
6m 48s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 47s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 51s
hbase-common in the patch passed.

+1 :green_heart:
unit
2m 10s
hbase-client in the patch passed.

32m 46s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux fe18f8c99b25 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-11.0.17+8

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/testReport/

Max. process+thread count
388 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/1/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 26s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 10s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 27s
master passed

+1 :green_heart:
compile
0m 30s
master passed

+1 :green_heart:
shadedjars
5m 25s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 26s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 21s
the patch passed

+1 :green_heart:
compile
0m 31s
the patch passed

+1 :green_heart:
javac
0m 31s
the patch passed

+1 :green_heart:
shadedjars
5m 25s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 26s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 51s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 20s
hbase-client in the patch passed.

22m 58s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux b93556f09cfa 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Temurin-1.8.0_352-b08

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/testReport/

Max. process+thread count
376 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 35s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 57s
master passed

+1 :green_heart:
compile
0m 42s
master passed

+1 :green_heart:
shadedjars
5m 13s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 36s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 49s
the patch passed

+1 :green_heart:
compile
0m 41s
the patch passed

+1 :green_heart:
javac
0m 41s
the patch passed

+1 :green_heart:
shadedjars
5m  9s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 36s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 12s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 27s
hbase-client in the patch passed.

24m 56s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 0864cf2b0f47 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-17.0.10+7

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/testReport/

Max. process+thread count
396 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 37s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+0 :ok:
mvndep
0m 11s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 52s
master passed

+1 :green_heart:
compile
1m 11s
master passed

+1 :green_heart:
checkstyle
0m 33s
master passed

+1 :green_heart:
spotless
0m 42s
branch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
1m 16s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 45s
the patch passed

+1 :green_heart:
compile
1m 12s
the patch passed

-0 :warning:
javac
0m 39s
hbase-client generated 1 new + 34 unchanged - 0 fixed = 35 total (was 34)

-0 :warning:
checkstyle
0m 15s
hbase-common: The patch generated 1 new + 1 unchanged - 0 fixed = 2 total (was 1)

-0 :warning:
checkstyle
0m 16s
hbase-client: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
4m 46s
Patch does not cause any errors with Hadoop 3.3.6.

-1 :x:
spotless
0m 15s
patch has 23 errors when running spotless:check, run spotless:apply to fix.

+1 :green_heart:
spotbugs
1m 34s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 20s
The patch does not generate ASF License warnings.

25m 30s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile

uname
Linux eb4c3ea5eb98 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-11.0.17+8

javac
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-general-check/output/diff-compile-javac-hbase-client.txt

checkstyle
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-general-check/output/diff-checkstyle-hbase-common.txt

checkstyle
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-general-check/output/diff-checkstyle-hbase-client.txt

spotless
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-general-check/output/patch-spotless.txt

Max. process+thread count
82 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/console

versions
git=2.34.1 maven=3.8.6 spotbugs=4.7.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 13s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 11s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
3m 19s
master passed

+1 :green_heart:
compile
0m 38s
master passed

+1 :green_heart:
shadedjars
6m 32s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 37s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 13s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
3m 30s
the patch passed

+1 :green_heart:
compile
0m 42s
the patch passed

+1 :green_heart:
javac
0m 42s
the patch passed

+1 :green_heart:
shadedjars
6m 22s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 40s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 59s
hbase-common in the patch passed.

+1 :green_heart:
unit
2m  4s
hbase-client in the patch passed.

29m 36s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 3f94e1ce8bf3 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-11.0.17+8

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/testReport/

Max. process+thread count
388 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/2/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 26s
Docker mode activated.

-0 :warning:
yetus
0m  2s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 11s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 22s
master passed

+1 :green_heart:
compile
0m 30s
master passed

+1 :green_heart:
shadedjars
5m 27s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 26s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 21s
the patch passed

+1 :green_heart:
compile
0m 30s
the patch passed

+1 :green_heart:
javac
0m 30s
the patch passed

+1 :green_heart:
shadedjars
5m 26s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 25s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 52s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 22s
hbase-client in the patch passed.

23m  0s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 2e4bb3b50e4d 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Temurin-1.8.0_352-b08

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/testReport/

Max. process+thread count
363 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 36s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 46s
master passed

+1 :green_heart:
compile
1m 12s
master passed

+1 :green_heart:
checkstyle
0m 32s
master passed

+1 :green_heart:
spotless
0m 42s
branch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
1m 17s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 12s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 46s
the patch passed

+1 :green_heart:
compile
1m 13s
the patch passed

-0 :warning:
javac
0m 39s
hbase-client generated 1 new + 34 unchanged - 0 fixed = 35 total (was 34)

+1 :green_heart:
checkstyle
0m 32s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
4m 45s
Patch does not cause any errors with Hadoop 3.3.6.

+1 :green_heart:
spotless
0m 43s
patch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
1m 31s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 19s
The patch does not generate ASF License warnings.

25m 52s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile

uname
Linux 3c6a9156c23c 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-11.0.17+8

javac
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/artifact/yetus-general-check/output/diff-compile-javac-hbase-client.txt

Max. process+thread count
79 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/console

versions
git=2.34.1 maven=3.8.6 spotbugs=4.7.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 34s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+0 :ok:
mvndep
0m 10s
Maven dependency ordering for branch

+1 :green_heart:
mvninstall
2m 46s
master passed

+1 :green_heart:
compile
0m 41s
master passed

+1 :green_heart:
shadedjars
5m  9s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 35s
master passed

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 11s
Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 51s
the patch passed

+1 :green_heart:
compile
0m 43s
the patch passed

+1 :green_heart:
javac
0m 43s
the patch passed

+1 :green_heart:
shadedjars
6m 29s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 37s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 40s
hbase-common in the patch passed.

+1 :green_heart:
unit
1m 38s
hbase-client in the patch passed.

26m 38s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 10635003c081 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 2306820df8

Default Java
Eclipse Adoptium-17.0.10+7

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/testReport/

Max. process+thread count
400 (vs. ulimit of 30000)

modules
C: hbase-common hbase-client U: .

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/3/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

FYI @stoty

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 13s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 34s
master passed

+1 :green_heart:
compile
0m 23s
master passed

+1 :green_heart:
shadedjars
6m 40s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 22s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
2m 52s
the patch passed

+1 :green_heart:
compile
0m 22s
the patch passed

+1 :green_heart:
javac
0m 22s
the patch passed

+1 :green_heart:
shadedjars
6m 12s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 17s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 31s
hbase-client in the patch passed.

23m 59s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 5d3d0dc4dbe1 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Temurin-1.8.0_352-b08

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/testReport/

Max. process+thread count
290 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 41s
Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s
No case conflicting files found.

+1 :green_heart:
hbaseanti
0m  0s
Patch does not have any anti-patterns.

+1 :green_heart:
@author
0m  0s
The patch does not contain any @author tags.

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 27s
master passed

+1 :green_heart:
compile
0m 59s
master passed

+1 :green_heart:
checkstyle
0m 21s
master passed

+1 :green_heart:
spotless
0m 57s
branch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
0m 47s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m  7s
the patch passed

+1 :green_heart:
compile
0m 51s
the patch passed

-0 :warning:
javac
0m 51s
hbase-client generated 1 new + 34 unchanged - 0 fixed = 35 total (was 34)

+1 :green_heart:
checkstyle
0m 19s
the patch passed

+1 :green_heart:
whitespace
0m  0s
The patch has no whitespace issues.

+1 :green_heart:
hadoopcheck
4m 54s
Patch does not cause any errors with Hadoop 3.3.6.

+1 :green_heart:
spotless
0m 42s
patch has no errors when running spotless:check.

+1 :green_heart:
spotbugs
0m 53s
the patch passed

_ Other Tests _

+1 :green_heart:
asflicense
0m 10s
The patch does not generate ASF License warnings.

24m 28s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/artifact/yetus-general-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile

uname
Linux 1dc2114b68ab 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Eclipse Adoptium-11.0.17+8

javac
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/artifact/yetus-general-check/output/diff-compile-javac-hbase-client.txt

Max. process+thread count
79 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/console

versions
git=2.34.1 maven=3.8.6 spotbugs=4.7.3

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 29s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 52s
master passed

+1 :green_heart:
compile
0m 27s
master passed

+1 :green_heart:
shadedjars
6m 31s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 23s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m 11s
the patch passed

+1 :green_heart:
compile
0m 24s
the patch passed

+1 :green_heart:
javac
0m 24s
the patch passed

+1 :green_heart:
shadedjars
6m 12s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 23s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 49s
hbase-client in the patch passed.

24m 43s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 187ecae8082c 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Eclipse Adoptium-17.0.10+7

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/testReport/

Max. process+thread count
316 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 17s
Docker mode activated.

-0 :warning:
yetus
0m  2s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
3m 39s
master passed

+1 :green_heart:
compile
0m 27s
master passed

+1 :green_heart:
shadedjars
6m 27s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 17s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
3m  4s
the patch passed

+1 :green_heart:
compile
0m 21s
the patch passed

+1 :green_heart:
javac
0m 21s
the patch passed

+1 :green_heart:
shadedjars
6m 35s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 20s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 14s
hbase-client in the patch passed.

24m 59s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux a7f15b4b40dc 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Eclipse Adoptium-11.0.17+8

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/testReport/

Max. process+thread count
303 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/4/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 36s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
2m 55s
master passed

+1 :green_heart:
compile
0m 21s
master passed

+1 :green_heart:
shadedjars
5m 16s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 19s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
2m 49s
the patch passed

+1 :green_heart:
compile
0m 21s
the patch passed

+1 :green_heart:
javac
0m 21s
the patch passed

+1 :green_heart:
shadedjars
5m 13s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 18s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
1m 30s
hbase-client in the patch passed.

20m 39s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux ad8b232edf16 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Eclipse Adoptium-11.0.17+8

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/testReport/

Max. process+thread count
283 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Comment

+0 :ok:
reexec
0m 52s
Docker mode activated.

-0 :warning:
yetus
0m  3s
Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck

_ Prechecks _

_ master Compile Tests _

+1 :green_heart:
mvninstall
4m 26s
master passed

+1 :green_heart:
compile
0m 31s
master passed

+1 :green_heart:
shadedjars
7m  4s
branch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 23s
master passed

_ Patch Compile Tests _

+1 :green_heart:
mvninstall
4m  8s
the patch passed

+1 :green_heart:
compile
0m 32s
the patch passed

+1 :green_heart:
javac
0m 32s
the patch passed

+1 :green_heart:
shadedjars
7m 39s
patch has no errors when building our shaded downstream artifacts.

+1 :green_heart:
javadoc
0m 26s
the patch passed

_ Other Tests _

+1 :green_heart:
unit
2m 18s
hbase-client in the patch passed.

29m 29s

Subsystem
Report/Notes

Docker
ClientAPI=1.44 ServerAPI=1.44 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile

GITHUB PR
https://github.com/apache/hbase/pull/5745

Optional Tests
javac javadoc unit shadedjars compile

uname
Linux 0b12765de283 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/hbase-personality.sh

git revision
master / 91354a0003

Default Java
Eclipse Adoptium-17.0.10+7

Test Results
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/testReport/

Max. process+thread count
317 (vs. ulimit of 30000)

modules
C: hbase-client U: hbase-client

Console output
https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5745/5/console

versions
git=2.34.1 maven=3.8.6

Powered by
Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

authors: Apache-HBase ndimiduk


text:
[SUPPORT] Cannot create numer field name

Describe the problem you faced
Is Hudi considering supporting numeric field names? In version 0.14, the table schema is still based on Avro format. If a field name starts with a number, such as "19", there is an exception when creating the table because Avro does not support field names that start with a number.

Hudi doesn't support column names starting with integer as avro schema validation will fail for this.
Please refer the 10553 issue for more details.

source: gharchive/issue

authors: muyihao rangareddy

repo: apache/hudi

license_type: permissive

license_source: github-api


text:
[SUPPORT] Bad Request for s3a target in DeltaStreamer

The Problem
I'm getting a Bad Request response when trying to run a spark job to push data from remote Kafka source to S3 bucket using DeltaStreamer. I'm mostly following the latest Docker Setup documentation & S3 Filesystem doc on https://hudi.apache.org/ with the few changes mentioned below...
Additional Info

I've tried changing to the compatible versions of aws packages to com.amazonaws:aws-java-sdk-s3:1.10.6,org.apache.hadoop:hadoop-aws:2.8.4 but reverted due to Exception in thread "main" java.lang.IllegalAccessError: tried to access method org.apache.hadoop.metrics2.lib.MutableCounterLong.<init>(Lorg/apache/hadoop/metrics2/MetricsInfo;J)V from class org.apache.hadoop.fs.s3a.S3AInstrumentation
I'm using hadoop-aws:2.7.3 as mentioned in https://hudi.apache.org/docs/s3_hoodie, but changed to aws-java-sdk:1.7.4 instead of aws-java-sdk:1.10.34 on getting Exception in thread "main" java.lang.NoSuchMethodError: com.amazonaws.services.s3.transfer.TransferManagerConfiguration.setMultipartUploadThreshold(I)V error
Changing to s3 instead of s3a resulted in Exception in thread "main" org.apache.hudi.exception.HoodieIOException: Failed to get instance of org.apache.hadoop.fs.FileSystem error

To Reproduce
Steps to reproduce the behaviour: (after following initial steps on https://hudi.apache.org/docs/docker_demo.html)

Comment out Kafka & Zookeeper containers in docker-compose_hadoop284_hive233_spark244.yml
Changed schema.avsc to match the incoming JSON.
Modified kafka-source.properties to:

add group.id=hudi_test_group
change bootstrap server to remote kafka server, change topic, schemas & key & partition fields.

Replaced stock_ticks with test1 in most files (except the ones containing the Hive queries) such as compaction*, hive-table-check.commands, sparksql-bootstrap-prep-source.commands, get_min_commit_time_cow.sh.
./setup_demo.sh
Create S3 bucket by same name as target-table & verify aws s3 ls s3a://test inside the adhoc-2 container.
docker exec -it adhoc-2 /bin/bash & run the following spark-submit cmd in docker container:

    --packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.3 \
    --conf spark.hadoop.fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem \
    --conf spark.hadoop.fs.s3a.endpoint=s3.ap-south-1.amazonaws.com \
    --conf spark.hadoop.fs.s3a.access.key='A.A' \
    --conf spark.hadoop.fs.s3a.secret.key='W.5' \
    --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE \
    --table-type COPY_ON_WRITE \
    --source-class org.apache.hudi.utilities.sources.JsonKafkaSource \
    --source-ordering-field cloud.account.id \
    --target-base-path s3a://test/test1_cow \
    --target-table test1_cow \
    --props /var/demo/config/kafka-source.properties \
    --hoodie-conf hoodie.datasource.write.recordkey.field=cloud.account.id \
    --hoodie-conf hoodie.datasource.write.partitionpath.field=cloud.account.id \
    --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider

Expected behavior
Expecting DeltaStreamer to start consuming data from the Kafka topic mentioned in kafka-source.properties and start pushing them to the S3 bucket.
Environment Description

Hudi version : 0.8.0

Spark version : 2.4.4

Hive version : 2.3.3

Hadoop version : 2.8.4

Storage (HDFS/S3/GCS..) : S3

Running on Docker? (yes/no) : yes

Stacktrace
21/07/26 12:58:53 INFO SparkContext: Added JAR file:///root/.ivy2/jars/org.hamcrest_hamcrest-core-1.3.jar at spark://adhoc-2:38511/jars/org.hamcrest_hamcrest-core-1.3.jar with timestamp 1627304333052
21/07/26 12:58:53 INFO SparkContext: Added JAR file:///root/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.2.3.jar at spark://adhoc-2:38511/jars/com.fasterxml.jackson.core_jackson-core-2.2.3.jar with timestamp 1627304333052
21/07/26 12:58:53 INFO SparkContext: Added JAR file:/var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-utilities.jar at spark://adhoc-2:38511/jars/hoodie-utilities.jar with timestamp 1627304333052
21/07/26 12:58:53 INFO Executor: Starting executor ID driver on host localhost
21/07/26 12:58:53 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34463.
21/07/26 12:58:53 INFO NettyBlockTransferService: Server created on adhoc-2:34463
21/07/26 12:58:53 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
21/07/26 12:58:53 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, adhoc-2, 34463, None)
21/07/26 12:58:53 INFO BlockManagerMasterEndpoint: Registering block manager adhoc-2:34463 with 366.3 MB RAM, BlockManagerId(driver, adhoc-2, 34463, None)
21/07/26 12:58:53 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, adhoc-2, 34463, None)
21/07/26 12:58:53 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, adhoc-2, 34463, None)
21/07/26 12:58:55 INFO SparkUI: Stopped Spark web UI at http://adhoc-2:4040
21/07/26 12:58:55 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
21/07/26 12:58:55 INFO MemoryStore: MemoryStore cleared
21/07/26 12:58:55 INFO BlockManager: BlockManager stopped
21/07/26 12:58:55 INFO BlockManagerMaster: BlockManagerMaster stopped
21/07/26 12:58:55 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
21/07/26 12:58:55 INFO SparkContext: Successfully stopped SparkContext
Exception in thread "main" com.amazonaws.services.s3.model.AmazonS3Exception: Status Code: 400, AWS Service: Amazon S3, AWS Request ID: ZVR44DYE, AWS Error Code: null, AWS Error Message: Bad Request, S3 Extended Request ID: GLMmbnyWTXS8=
	at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:798)
	at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:421)
	at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:232)
	at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3528)
	at com.amazonaws.services.s3.AmazonS3Client.headBucket(AmazonS3Client.java:1031)
	at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:994)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:297)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2669)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
	at org.apache.hudi.common.fs.FSUtils.getFs(FSUtils.java:97)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:106)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.main(HoodieDeltaStreamer.java:501)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
21/07/26 12:58:55 INFO ShutdownHookManager: Shutdown hook called
21/07/26 12:58:55 INFO ShutdownHookManager: Deleting directory /tmp/spark-15bb32a0-6e2a-41d9-ad10-c90d84a92e4b
21/07/26 12:58:55 INFO ShutdownHookManager: Deleting directory /tmp/spark-c2357491-ac77-4394-8ed4-d6bce0c7cabd

@vinaypatil18 @codope

@GitSpree23 Can you try to set the following options while submitting deltastreamer job.
spark-submit --conf spark.driver.extraJavaOptions='-Dcom.amazonaws.services.s3.enableV4' \
    --conf spark.executor.extraJavaOptions='-Dcom.amazonaws.services.s3.enableV4' \
    ... (other spark options)

I have not yet had chance to reproduce this issue. But, apart from setting fs.s3a.endpoint, it seems we need to set extra options if you're on an older version of aws sdk. Refer: https://stackoverflow.com/a/57928724

That worked, thanks!
Unfortunately, I'm getting the following error:
Exception in thread "main" org.apache.hudi.exception.TableNotFoundException: Hoodie table not found in path s3a://spruha-test/sms_test1_cow/.hoodie
	at org.apache.hudi.exception.TableNotFoundException.checkTableValidity(TableNotFoundException.java:57)
	at org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:112)
	at org.apache.hudi.common.table.HoodieTableMetaClient.<init>(HoodieTableMetaClient.java:73)
	at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:582)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.<init>(HoodieDeltaStreamer.java:568)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:142)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:106)
	at org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.main(HoodieDeltaStreamer.java:501)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.FileNotFoundException: No such file or directory: s3a://spruha-test/sms_test1_cow/.hoodie
	at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:993)
	at org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:77)
	at org.apache.hudi.common.fs.HoodieWrapperFileSystem.lambda$getFileStatus$17(HoodieWrapperFileSystem.java:393)
	at org.apache.hudi.common.fs.HoodieWrapperFileSystem.executeFuncWithTimeMetrics(HoodieWrapperFileSystem.java:100)
	at org.apache.hudi.common.fs.HoodieWrapperFileSystem.getFileStatus(HoodieWrapperFileSystem.java:387)
	at org.apache.hudi.exception.TableNotFoundException.checkTableValidity(TableNotFoundException.java:51)
	... 19 more
21/07/27 13:51:23 INFO ShutdownHookManager: Shutdown hook called
21/07/27 13:51:23 INFO ShutdownHookManager: Deleting directory /tmp/spark-a5994f06-d41c-40cd-b605-88a2b236f0ed
21/07/27 13:51:23 INFO ShutdownHookManager: Deleting directory /tmp/spark-e24bdb95-7b0d-4b7e-8e65-21dbff39632d

Am I missing some steps here? I've simply created an s3 bucket & am pointing to it...

Quoting from the user on Slack:

This is resolved!
Just needed to modify the paths:
--target-base-path s3a://test/hudi/test1_cow
--target-table hudi.test1_cow \

Closing the issue.


text:
[HUDI-4997] use jackson-v2 replace jackson-v1 import.

Change Logs
HoodieWriteCommitCallbackUtil uses ObjectMapper, but uses jackson-v1 import, jackson-v1 has security risks, replace import with jackson-v2.
JIRA: HUDI-4997: use jackson-v2 replace jackson-v1 import.
Impact
Bundle dependency changes.
Risk level (write none, low medium or high below)
Bundle dependency changes.
Documentation Update
NA
Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

@xushiyan Can you help review this pr? Thank you very much! This change avoids the use of jackson-v1 to reduce security risks.
We can read this article below:
https://cowtowncoder.medium.com/on-jackson-cves-dont-panic-here-is-what-you-need-to-know-54cd0d6e8062

@slfan1989 thanks for the fix! while we are at this, would you mind extending HUDI-4997 's scope to removing org.codehaus.jackson.* completely? by a global search, i see jackson v1 still included in a few bundles. cc @codope any context why presto/trino bundle include v1 jackson libs?

@slfan1989 thanks for the fix! while we are at this, would you mind extending HUDI-4997 's scope to removing org.codehaus.jackson.* completely? by a global search, i see jackson v1 still included in a few bundles. cc @codope any context why presto/trino bundle include v1 jackson libs?

Thank you for your help reviewing the code, I will continue to work on it.

@xushiyan Can you help review the code again? Thank you very much! I saw the JunitTest error report has nothing to do with this change.

@xushiyan Thank you very much for helping to review the code!

source: gharchive/pull-request


text:
[HUDI-5904] support more than one update actions in merge into table

upport more than one update actions in merge into table
Change Logs
NA
Impact
NA
Risk level (write none, low medium or high below)
low
Documentation Update
NA
Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

@danny0405  @XuQianJin-Stars have a review please

Will cause data quality problems if we only remove the check, if source table without precombineField, look like hudi will add the first updateAction assignments vlaue expre which key is target precombineField to source df, because we need dedup before use payload And need add more test: cow/mor

different updateAction with diff precombine field expr
source table without precombineField (like target.precombineField = source.otherfield)
a simple test like this:

merge into $cowTableName t0
using (
  select 1 as id, 'a1_n_6' as name, 6 as price, 1010 as v_ts, '1' as flag union
  select 2 as id, 'a2_n_6' as name, 6 as price, 1010 as v_ts, '2' as flag union
  select 6 as id, 'a3_n_6' as name, 6 as price, 1010 as v_ts, '1' as flag
  ) s0
   on s0.id = t0.id
   when matched and flag = '1' then update set
   id = s0.id, name = s0.name, ts = 1003
   when matched and flag = '2' then update set
   id = s0.id, price = s0.price, ts = s0.v_ts + 2
   when not matched and flag = '1' then insert *

yes，but mostly business is upsert only one record. i thought this is not impact bussiness in one record upsert

@hudi-bot run azure

@hudi-bot run azure


text:
Improve compaction doc

Change Logs
Describe context and summary for this change. Highlight if any code was copied.
Impact
Documentation Update
Redid the compaction documentation.

Describe any necessary documentation update if there is any new feature, config, or user-facing change

The config description must be updated if new configs are added or the default value of the configs are changed
Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the instruction to make
changes to the website.

Contributor's checklist

[ ] Read through contributor's guide
[ ] Change Logs and Impact were stated clearly
[ ] Adequate tests were added if applicable
[ ] CI passed

cc @bhasudha @danny0405 @nsivabalan if anyone of you want to review.  I'll add a jira ticket shortly.


text:
feat: podman support

Close #474
This PR adds podman support by updating the get "Os/Arch" code in docker.rs and some configuration tricks.
In addition,

"links" keyword is refactored to be "network"
std::net::IpAddr and SocketAddr are used for better type safety
Podman documentation is also added.
"expose" keyword used throughout, as opposed to "ports"

Tested on arm64 MacOS with OrbStack and amd64 RHEL 8 with podman, docker compose.
Some minor concerns:

What is the purpose of ARG BUILDPLATFORM and when/where should that be used? It was only present in one of the Dockerfiles, so I removed it.
Is there a cleaner way of having "CONTRIBUTING.MD" appear in the website and as a toplevel file in the github? It's a little tricky getting both the "github.com" version and the "rust.iceberg.apache.org" version to render links correctly.

Is there a cleaner way of having "CONTRIBUTING.MD" appear in the website and as a toplevel file in the github? It's a little tricky getting both the "github.com" version and the "rust.iceberg.apache.org" version to render links correctly.

I think we can create a link in website like ln -s ../CONTRIBUTING.md CONTRIBUTING.md

repo: apache/iceberg-rust


text:
[AIRFLOW-2074] Fix log var name in GHE auth

Make sure you have checked all steps below.
JIRA

[x] My PR addresses the following Airflow JIRA issues and references them in the PR title. For example, "[AIRFLOW-XXX] My Airflow PR"

https://issues.apache.org/jira/browse/AIRFLOW-2074

Description

[x] Here are some details about my PR, including screenshots of any UI changes:

The refactor in https://github.com/apache/incubator-airflow/commit/a7a518902dcf1e7fd4bf477cf57cee691f181b29#diff-a1e98b59fef0a4c044aa9b1def8eee90R32 changed the logger name from _log to log, but didn't update callers. This makes the GHE auth backend unusable due to:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1982, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1614, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1517, in handle_user_exception
    reraise(exc_type, exc_value, tb)
  File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1612, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python2.7/site-packages/flask/app.py", line 1598, in dispatch_request
    return self.view_functions[rule.endpoint](**req.view_args)
  File "/usr/local/lib/python2.7/site-packages/flask_admin/base.py", line 69, in inner
    return self._run_view(f, *args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/flask_admin/base.py", line 368, in _run_view
    return fn(self, *args, **kwargs)
  File "/usr/local/lib/python2.7/site-packages/airflow/www/views.py", line 674, in login
    return airflow.login.login(self, request)
  File "/usr/local/lib/python2.7/site-packages/airflow/contrib/auth/backends/github_enterprise_auth.py", line 232, in login
    return login_manager.login(request)
  File "/usr/local/lib/python2.7/site-packages/airflow/contrib/auth/backends/github_enterprise_auth.py", line 122, in login
    _log.debug('Redirecting user to GHE login')
NameError: global name '_log' is not defined

This PR changes callers from _log to log so that GHE auth backend works again.
Tests

[*] My PR adds the following unit tests OR does not need testing for this extremely good reason:

No need for tests as this relates to logs.
Commits

[*] My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":

Subject is separated from body by a blank line
Subject is limited to 50 characters
Subject does not end with a period
Subject uses the imperative mood ("add", not "adding")
Body wraps at 72 characters
Body explains "what" and "why", not "how"

[*] Passes git diff upstream/master -u -- "*.py" | flake8 --diff

Codecov Report

Merging #3011 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3011   +/-   ##
=======================================
  Coverage   73.25%   73.25%
=======================================
  Files         175      175
  Lines       12337    12337
=======================================
  Hits         9038     9038
  Misses       3299     3299

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 772dbae...23c9e6d. Read the comment docs.

This fix works on our internal Airflow.

Thanks @cmlad, something must have gone wrong with refactoring

authors: Fokko cmlad codecov-io

repo: apache/incubator-airflow

license_source: bigquery


text:
Updating the UDP logger to use the batch processor util

Summary
Updates the UDP logger to use the batch processor util

@membphis The following PR is also updated with the review comments of the tcp logger

@sshniro please rebase your branch

@membphis rebased.

I have now restarted Travis's job and failed before.

authors: membphis sshniro

repo: apache/incubator-apisix


text:
Bugfix: change dir  apisix into incubator-apisix

Bugfix: change dir  apisix into incubator-apisix
Summary
Makefile

fix bug: https://github.com/apache/incubator-apisix/issues/763

fix bug: #763

You can set this action in the top description, or it will not be trigged.

Here is the keywords usage description:  https://help.github.com/en/github/managing-your-work-on-github/closing-issues-using-keywords


text:
Minor Cleanups in the Direct Runner

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[x] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[ ] Make sure tests pass via mvn clean verify. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
[x] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[x] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

Consistent use of clock.
Add a new test for DirectRunner Pipeline Reuse
Remove unnecessary assignment.

R: @kennknowles

LGTM. Will merge based on Jenkins since Travis is a bit overloaded and likely to flake anyhow in our current situation.

authors: kennknowles tgroh

repo: apache/incubator-beam


text:
Simple streaming text sink with windowing

mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--output=./streaming-output-0 --runner=DirectRunner"
It reads from unbounded counting source, groups inputs to one minute window, and writes each window to a file under ./streaming-output-0 .

Closing
I was trying to share this code, and shouldn't actually create this PR.


text:
[Bug][Github Plugin] API call to remote-scopes returns a list of 1 and no github data

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
When calling plugins/github/connections/[github_conn]/remote-scopes?groupId=[github_org] with a connection enabled with a GithubApp the response returns a page size of 1 and the returning result is missing data.
{
    "children": [
        {
            "type": "scope",
            "parentId": "org",
            "id":  [some_id],
            "name": "repo",
            "fullName": "org/repo",
            "data": null
        }
    ],
    "nextPageToken": "eyJwYWdlIjoyLCJwZXJfcGFnZSI6MTAwfQ=="
}

When calling the same API with the github connection setup with a token I a full response with the data populated correctly.
What do you expect to happen
I expected to see the same result as with a token.
How to reproduce
I have recently upgraded from v0.20 to v1.0.0 beta 5.
Setup two github connections one using an API key and the other using a token.  They are both enabled to use the graphql API.
Anything else
No response
Version
v1.0.0-beta5
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Sounds like some essential permissions are missing.
Did you following this guide and set up the required permissions?

authors: andyflatt klesh

repo: apache/incubator-devlake


text:
[Feature][SPI] Implement WeChat Alert Plugin

Implement WeChat Alert Plugin
#3049
I will finish it.

done

repo: apache/incubator-dolphinscheduler


text:
[BUG] fix bug for vectorized compaction

Proposed changes
Issue Number: close #9343
Problem Summary:
Describe the overview of changes.
Checklist(Required)

Does it affect the original behavior: (Yes/No/I Don't know)
Has unit tests been added: (Yes/No/No Need)
Has document been added or modified: (Yes/No/No Need)
Does it need to update dependencies: (Yes/No)
Are there any changes that cannot be rolled back: (Yes/No)

Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

cc @HappenLee

Oh, I noticed that now the compaction operation is go through vmerge_rowsets directly without checking if vectorized is enabled. Is it safe? @Gabriel39 @HappenLee

Oh, I noticed that now the compaction operation is go through vmerge_rowsets directly without checking if vectorized is enabled. Is it safe? @Gabriel39 @HappenLee

Config enable_vectorized_compaction has been added in last commit. Please review again @morningman

repo: apache/incubator-doris


text:
中国地图实现如何实现鼠标滑过省，省单独的区域regionHeight发生变化？

What problem does this feature solve?
在中国地图中设置regionHeight，中国地图整体的高度会发生变化，设置China 整体的regionHeight有效果，独立的区域高度不生效，设置鼠标点击区域颜色发生变化是有效的。
例如 China 的 regionHeight =2，如何实现鼠标滑过某个省，例如鼠标滑过北京，北京这个单独的区域 regionHeight = 8 高度会凸起。
What does the proposed API look like?
设置中国地图某个city 的高度

@pissang 你好，请问题主提到的这个功能现在支持了吗？ API没找到相关配置呀

@luohong123 前端时间经过查询GL配置API，发现Echarts本身已经支持某个data项目凸起，例如官方DEMO：【https://echarts.apache.org/examples/zh/editor.html?c=map3d-wood-city&gl=1】
官方API：

repo: apache/incubator-echarts


text:
echarts4 中 series[i]-graph 下设置 zoom有效，但我没有在任何地方找到这个属性的说明

Version
4.4.0
Steps to reproduce
我知道4.x版本支持大多数配置的向下兼容,但series[i]-graph下的zoom属性(控制整体缩放)在现在的文档中没有提及，在版本记录中也找不到相关改动说明
What is expected?
了解这个配置以及更多“隐藏”的配置
What is actually happening?
无

Please provide a simple demo https://gallery.echartsjs.com/editor.html


text:
Add dimIndex for callback formatter

Close #10403
Close #10180

Hi there,
I think this pull request will also close my request
https://github.com/apache/incubator-echarts/issues/9618
where I wanted to get the yAxisIndex returned in the callback formatter.
Best regards,
Sergios.


text:
[ISSUE #1208]: fix ZipkinTraceService NullPointerException

Fixes #1208.
Motivation
Explain the content here.
Explain why you want to make the changes and what problem you're trying to solve.
fix ZipkinTraceService NullPointerException
Modifications
Describe the modifications you've done.
fix ZipkinTraceService NullPointerException
Documentation

Does this pull request introduce a new feature? ( no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

@BigXin0109 please check the CI fail tasks.

@BigXin0109 please fix the conflicts.

repo: apache/incubator-eventmesh


text:
GEODE-1617: Regions can be created with a variety of characters that are unsupported

Updated the pull request for this ticket after several unit tests failed.

I'm running this change through precheckin.

I think it's probably safe to get the storage team involved to review this PR.

There are still a lot of failures including most of the geode-lucene tests (apparently they use # character in all of their region names). See http://precheckin.gemfire.pivotalci.info:8080/pipelines/gemfire-precheckin-klund-precheckin-geode-1617-pr-201-003/jobs/DeveloperTest/builds/1

The example in the docs for how to create a dynamic region on the server no longer works in M3 due to this fix.
http://geode.docs.pivotal.io/docs/developing/region_options/dynamic_region_creation.html
Removing an underscore from "__regionAttributesMetadata" does the trick.
I'm happy to make a PR against the docs to fix this, but it doesn't seem like there is an M3 branch

Good catch.
@davebarnes97 @karensmolermiller Can either of you follow up on this?  Looks like we've a page out of date.

@seankarson @kjduling The document has been updated. Thanks for the heads up!

authors: jinmeiliao joeymcallister kirklund kjduling seankarson

repo: apache/incubator-geode


text:
GUACAMOLE-50: Update Docker container to use Java 8

I've tested this with the MySQL auth against and RDP EC2 instance, seems to work fine.
I've also been running Guacamole in production on Java 8 for over 6 months with no known issues.

What's the process for getting this updated on Docker Hub?
Let me know if there's anything I can do to assist.

repo: apache/incubator-guacamole-client


text:
[INLONG-2056] The metric of DataProxy append a dimension(minute level) of event time, supporting audit reconciliation of minute level.

Title Name: [INLONG-2056][Inlong-DataProxy] The metric of DataProxy append a dimension(minute level) of event time, supporting audit reconciliation of minute level.
Fixes #2056
Motivation
Explain here the context, and why you're making that change. What is the problem you're trying to solve.
Modifications
Describe the modifications you've done.
Verifying this change

[ ] Make sure that the change passes the CI checks.

(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)

Added integration tests for end-to-end deployment with large payloads (10MB)
Extended integration test for recovery after broker failure

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

Codecov Report

Merging #2057 (10b4bd7) into master (53ecd86) will increase coverage by 0.00%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master    #2057   +/-   ##
=========================================
  Coverage     12.26%   12.26%
+ Complexity     1157     1155    -2
=========================================
  Files           413      413
  Lines         35215    35215
  Branches       5542     5542
=========================================
+ Hits           4318     4320    +2
  Misses        30125    30125
+ Partials        772      770    -2

Impacted Files
Coverage Δ

.../client/producer/qltystats/BrokerStatsItemSet.java
67.44% <0.00%> (-4.66%)
:arrow_down:

.../producer/qltystats/DefaultBrokerRcvQltyStats.java
44.14% <0.00%> (-1.18%)
:arrow_down:

.../java/org/apache/flume/sink/tubemq/TubemqSink.java
55.42% <0.00%> (+4.00%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 53ecd86...10b4bd7. Read the comment docs.

authors: codecov-commenter luchunliang

repo: apache/incubator-inlong


text:
Install missing libraries in kogito-ci-build image

Outbox example in incubator-kie-kogito-examples is failing consistently due to docker container startup. There are log entries complaining about missing nc tool, so installing this in kogito-ci-build might resolve the issues.
line 1: /dev/tcp/localhost/8083: Cannot assign requested address
/bin/sh: line 1: nc: command not found
/bin/bash: connect: Cannot assign requested address
/bin/bash: line 1: /dev/tcp/localhost/8083: Cannot assign requested address
/bin/sh: line 1: nc: command not found
/bin/bash: connect: Cannot assign requested address
/bin/bash: line 1: /dev/tcp/localhost/8083: Cannot assign requested address
/bin/sh: line 1: nc: command not found

Another problem is in
org.kie.kogito.examples.OpenVinoRestIT.testOpenvino
libGL.so.1: cannot open shared object file: No such file or directory

Fixed through apache/incubator-kie-kogito-pipelines#1106

repo: apache/incubator-kie-issues


text:
Remove jobs-service-common by default CORS setup

Describe the bug
Jobs service core mustn't enable CORS by default. Instead it must be enabled if required in the module that needs it.
Expected behavior
No response
Actual behavior
No response
How to Reproduce?
No response
Output of uname -a or ver
No response
Output of java -version
No response
GraalVM version (if different from Java)
No response
Kogito version or git rev (or at least Quarkus version if you are using Kogito via Quarkus platform BOM)
No response
Build tool (ie. output of mvnw --version or gradlew --version)
No response
Additional information
No response

Fixed by: #2104

repo: apache/incubator-kie-kogito-apps


text:
[NO ISSUE] Update maven-plugin-plugin version to fix Java 17 compilation

The version of maven-plugin-plugin was not compatible with Java 17. After the upgrade, the compilaton works.

PR job #1 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer
build-chain build full_downstream  -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u https://github.com/apache/incubator-kie-kogito-runtimes/pull/3340 --skipParallelCheckout
NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3340/1/display/redirect
Test results:

PASSED: 2428
FAILED: 1

Those are the test failures:

org.kie.kogito.quarkus.workflows.ExpressionRestFromImageIT.testExpressionRest
java.lang.IllegalStateException: Unable to determine the status of the running process. See the above logs for details

I disabled another test - here is an issue for it https://github.com/apache/incubator-kie-issues/issues/788

@baldimir What was not compiling with previous maven plugin version?

Not sure if I'd disable the test on this PR, but approving to fix the build

@fjtirado the build of kogito-maven-plugin failed on unsupported class format.

@baldimir Lets disable the test with a different PR

PR job #2 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer
build-chain build full_downstream  -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u https://github.com/apache/incubator-kie-kogito-runtimes/pull/3340 --skipParallelCheckout
NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3340/2/display/redirect
Test results:

PASSED: 3330
FAILED: 1

Those are the test failures:

org.kie.kogito.quarkus.workflows.ExpressionRestFromImageIT.testExpressionRest
java.lang.IllegalStateException: Unable to determine the status of the running process. See the above logs for details

authors: baldimir fjtirado kie-ci3 pefernan

repo: apache/incubator-kie-kogito-runtimes


text:
NO-ISSUE: Upgrade Angular to v18 and use local BPMN editor on examples/webapp

Upgraded Angular to 18.1.2;
Simplified the ping-pong-view-angular implementation;
Fixed zone.js polyfill messing up with Promise prototype;
Changed BPMN Editor on examples/webapp to use the local version instead of the latest published release.

@thiagoelg Can we update syncpack.json to remove the exception now that everything is upgraded?

authors: thiagoelg tiagobento

repo: apache/incubator-kie-tools


text:
Refactor Trim/Split/Split2KV functions in util.h

Solve #581
Refactor Split and Split2KV
Optimize some signature to const reference
Add some unit test for string utils

Generally looks good. One comment:
It seems that Trim will update the input string while Split doesn't. This looks inconsistent.
Also, if Split with empty delim, we may return the input string as is.

Thanks @tisonkun !

Trim will update the input string while Split doesn't
Trim takes a copy of the first argument, not a reference.

if Split with empty delim, we may return the input string as is.
done~

Thanks everyone! Merging...

repo: apache/incubator-kvrocks


text:
distributed kvstore bug in MXNet

I'm using distributed kvstore with Gluon trainer. I found the two following bugs:

Initializing trainer = gluon.Trainer(update_on_kvstore=True) doesn't work. Inspecting trainer._update_on_kvstore shows that the value is still set to False.

When distributed kvstore is used, by default gluon.Trainer doesn't work with mx.optimizer.LRScheduler if a worker has more than 1 GPU. To be more specific, the trainer updates once per GPU, the LRScheduler object is shared across GPUs and get a wrong update count.

This means one cannot train imagenet classification using resnet with gluon trainer.

+1

Working on this. Will update my findings.

@sandeep-krishnamurthy is this issue fixed with #12786 ?
If so - please close the issue or comment.

Initializing trainer = gluon.Trainer(update_on_kvstore=True) doesn't work. Inspecting trainer._update_on_kvstore shows that the value is still set to False.

This is fixed.

When distributed kvstore is used, by default gluon.Trainer doesn't work with mx.optimizer.LRScheduler if a worker has more than 1 GPU. To be more specific, the trainer updates once per GPU, the LRScheduler object is shared across GPUs and get a wrong update count.

This needs to be fixed.

As mentioned in https://github.com/apache/incubator-mxnet/pull/12786 the fix for the 1st problem has issues on the v1.3.x release branch.

authors: eric-haibin-lin lebeg lupesko ragavvenkatesan sandeep-krishnamurthy

repo: apache/incubator-mxnet


text:
CI: Remove building from Unit Test-Jobs

At the moment the compile-stages are kept pretty generic while language-specific builds are being executed during the Unit Test-Stage. In order to improve future scalability these two steps should be two separate jobs. This can be done in two ways:

Add an second build-stage which executes language-specific actions. Disadvantage: This increases the total duration as all jobs have to finish until the next stage can be started.
Nested jobs: If a Unit Test requires previous actions, split it into two jobs which are getting executed in sequence. This will allow in future to execute CPU-heavy tasks on a CPU-instance and GPU-tests on a GPU-instance.

Execution in separate jobs allows reusing the created artifacts if multiple jobs exist for the same language.
For examples consider looking in the Jenkinsfile at R: CPU/GPU, Scala: CPU and Perl: CPU/GPU (perl-package.test.sh).

Also consider splitting up tests like tests/python/unittest and tests/python/train in order to allow parallel execution.

@KellenSunderland

@marcoabreu I believe our existing Jenkins setup does this separation of unit test jobs for different language bindings.
Can this issue be closed then ?

This is still valid. Languages like scala, clojure, R and probably a few more compile their native counterparts and dependencies during unit test stage instead of compile stage.

Aah. I see. Thanks!

authors: cjolivier01 marcoabreu piyushghai


text:
Update script to use new im2rec command line arguments

As changed here:
https://github.com/apache/incubator-mxnet/commit/89b4fa0648405d755355957f99a2c794a3555f46
see https://discuss.mxnet.io/t/bug-with-running-im2rec-py/792

needs JIRA


text:
Incorporate IP configuration files into netinit.

Summary
Uses logic from apps/fsutils/ipcfg to obtain the IP address configuration from a file, if available.  This only effects the behavior of netinit if CONFIG_FSUTILS_IPCFG is selected and if an IP configuration file is available on a file system. Otherwise, it reverts to the preceding behavior.
Also adds definitions to apps/include/fsutils/ipcfg.h to formalize a bit encoding of the prototype which was already in use, but not documented.
This PR also corrects a few problems with fsutils/ipcfg:

Corrects some bad assertions (duplicated in PR #420, we can close that PR if this one is merged first.
Corrects some inconsitent variable naming between apps/includes/fsutils/ipcfg.c and apps/fsutils/ipcfg/ipcfg_text.c

Impact
Obviously, the apps/netutils/netinit logic is affected.  The use of the ipcfg IP configuration file is conditional so, if all was done right, there should be no impact.
Testing
Everything tests out.  Due to complexities of different test setups, only a few configurations could be verified:
Test strategy

Create an ASCII IP configuration file on an SD card using an editor.  The name of the IP configuration file must be ipcfg-eth0.

Use stm32f4discovery:netnsh configuration.  This configuration already supports IPv4 networking, the netinit thread, and SD card.  It has this default IP configuration:
CONFIG_NETINIT_IPADDR=0x0a000002
CONFIG_NETINIT_DRIPADDR=0x0a000001
CONFIG_NETINIT_NETMASK=0xffffff00
CONFIG_NETINIT_IPv6ADDR_1=0xfc00
CONFIG_NETINIT_IPv6ADDR_2=0x0000
CONFIG_NETINIT_IPv6ADDR_3=0x0000
CONFIG_NETINIT_IPv6ADDR_4=0x0000
CONFIG_NETINIT_IPv6ADDR_5=0x0000
CONFIG_NETINIT_IPv6ADDR_6=0x0000
CONFIG_NETINIT_IPv6ADDR_7=0x0000
CONFIG_NETINIT_IPv6ADDR_8=0x0002
CONFIG_NETINIT_DRIPv6ADDR_1=0xfc00
CONFIG_NETINIT_DRIPv6ADDR_2=0x0000
CONFIG_NETINIT_DRIPv6ADDR_3=0x0000
CONFIG_NETINIT_DRIPv6ADDR_4=0x0000
CONFIG_NETINIT_DRIPv6ADDR_5=0x0000
CONFIG_NETINIT_DRIPv6ADDR_6=0x0000
CONFIG_NETINIT_DRIPv6ADDR_7=0x0000
CONFIG_NETINIT_DRIPv6ADDR_8=0x0001
CONFIG_NETINIT_IPv6NETMASK_1=0xffff
CONFIG_NETINIT_IPv6NETMASK_2=0xffff
CONFIG_NETINIT_IPv6NETMASK_3=0xffff
CONFIG_NETINIT_IPv6NETMASK_4=0xffff
CONFIG_NETINIT_IPv6NETMASK_5=0xffff
CONFIG_NETINIT_IPv6NETMASK_6=0xffff
CONFIG_NETINIT_IPv6NETMASK_7=0xffff
CONFIG_NETINIT_IPv6NETMASK_8=0x0000

Enable IPv6 and ICMPv6

Enable IPCFG with Text file support
CONFIG_IPCFG_WRITABLE=y
# CONFIG_IPCFG_BINARY is not set
CONFIG_IPCFG_PATH="/ipcfg"

Build and execute with SD card in place

Mount the SD card prior to running NSH and netinit (requires a small code change to the board bring-up logic).

Use the NSH ifconfig command to see if the network is properly configured.

diff --git a/boards/arm/stm32/stm32f4discovery/src/stm32_bringup.c b/boards/arm/stm32/stm32f4discovery/src/stm32_bringup.c
index fedd8ecec0..80cd76fa94 100644
--- a/boards/arm/stm32/stm32f4discovery/src/stm32_bringup.c
+++ b/boards/arm/stm32/stm32f4discovery/src/stm32_bringup.c
@@ -526,5 +526,12 @@ int stm32_bringup(void)
     }
 #endif /* CONFIG_LPWAN_SX127X */

+  ret = mount("/dev/mmcsd0", CONFIG_IPCFG_PATH, "vfat", 0, NULL);
+  if (ret < 0)
+    {
+      int errcode = errno;
+      _err("ERROR: Failed to mount " CONFIG_IPCFG_PATH "\n: %d", errcode);
+    }
+
   return ret;
 }

Testing only with a text file is not limitation since the unit under test is netinit, not ipcfg.  Various text files can be created with an editor and many possible IP configurations can be verified.  For example,
IPv4PROTO=static
IPv4IPADDR=10.0.0.42
IPv4NETMASK=255.255.0.0
IPv4ROUTER=10.0.0.77
IPv4DNS=10.0.0.32
IPv6PROTO=static
IPv6IPADDR=fc00::42
IPv6NETMASK=ffff:ffff::
IPv6ROUTER=fc00::77

Test Result
Without SD card inserted, we get the configured default settings:
eth0    Link encap:Ethernet HWaddr 00:e0:de:ad:be:ef at UP
        inet addr:10.0.0.2 DRaddr:10.0.0.1 Mask:255.255.255.0
        inet6 addr: fc00::2/112
        inet6 DRaddr: fc00::1/112

With SD card inserted, we get the settings from the ipcfg-eth0 file:
eth0    Link encap:Ethernet HWaddr 00:e0:de:ad:be:ef at UP
        inet addr:10.0.0.42 DRaddr:10.0.0.77 Mask:255.255.0.0
        inet6 addr: fc00::42/32
        inet6 DRaddr: fc00::77/32

@patacongo As soon as I can I will take a look.

I have finished verification of this change.  Looks good.

@patacongo - thank you for this!

@patacongo - thank you for this!

You are welcome.  I am of the belief that if you are going to bitch and moan about someone else's solution, then it is your responsibility to provide a better one.  My complaints about boardctl() cost me several days of effort!

repo: apache/incubator-nuttx-apps


text:
Supporting BIOC_FLUSH in littlefs_sync_block()

Hi, we are trying to port littlefs with your vfs layer code (lfs_vfs.c)
littlefs_sync_block() in lfs_vfs.c makes an MTD_IOCTL call with cmd = BIOC_FLUSH
For the case of imxrt1064 board, the ioctl calls are supported in function imxrt_flexspi_nor_ioctl()
This function does not seem to have BIOC_FLUSH support, hence it would return -ENOTTY
BIOC_FLUSH is supported in ftl.c with the help of rwbuffer.c
However, it's IOCTL base is _BIOC
Request you to kindly clarify the following please: -

With MTD_IOCTL, would the control flow reach ftl.c ?
Why is a BIOC command used with and MTD_IOCTL call ?
Is the BIOC_FLUSH supported properly or is it intended to return -ENOTTY ?

Kindly excuse any mistakes in my understanding.

Hi, we are trying to port littlefs with your vfs layer code (lfs_vfs.c)
littlefs_sync_block() in lfs_vfs.c makes an MTD_IOCTL call with cmd = BIOC_FLUSH
For the case of imxrt1064 board, the ioctl calls are supported in function imxrt_flexspi_nor_ioctl()
This function does not seem to have BIOC_FLUSH support, hence it would return -ENOTTY

it's optional to support BIOC_FLUSH in MTD driver, the upper layer will convert ENOTTY to OK:
https://github.com/apache/incubator-nuttx/blob/master/fs/littlefs/lfs_vfs.c#L921-L937

BIOC_FLUSH is supported in ftl.c with the help of rwbuffer.c
However, it's IOCTL base is _BIOC
Request you to kindly clarify the following please: -

With MTD_IOCTL, would the control flow reach ftl.c ?

No, the call chain is: ioctl->ftl_ioctl->MTD_IOCTL, not  ioctl->MTD_IOCTL->ftl_ioctl.

Why is a BIOC command used with and MTD_IOCTL call ?

Just to save one MTD_IOCTL number, but it's may better to add MTD_FLUSH, just like BIOC_XIPBASE and MTDIOC_XIPBASE.

Is the BIOC_FLUSH supported properly or is it intended to return -ENOTTY ?

it's designed for the MTD layer which have a cache internally, and it's optional feature as mentioned before.

Kindly excuse any mistakes in my understanding.

Hello, thankyou for your prompt reply.
I understand that it is not necessary to support the lfs_cfg_s ->sync functionality if we are not buffering the write request data.
For Eg: - if CONFIG_FTL_WRITEBBUFFER is not set,
BIOC_FLUSH still returns -ENOTTY
However, you mentioned

No, the call chain is: ioctl->ftl_ioctl->MTD_IOCTL, not ioctl->MTD_IOCTL->ftl_ioctl.

Could you help me understand this please?
Assuming an MTD driver registry for Littlefs, MTD_IOCTL(drvr->u.i_mtd, BIOC_FLUSH, ....) would call
(drvr->u.i_mtd)->ioctl(BIOC_FLUSH, ...) right?
For say, the imxrt1064 device, this ioctl is populated by vendor specific code in boards/arm/imxrt/imxrt1064-evk/src/imxrt_flexspi_nor.c which does not have case: BIOC_FLUSH supported
Again, pardon me for any mistakes in understanding

@amogh-samsung to avoid the confusion, the new ioctl MTDIOC_FLUSH is added, please take a look: https://github.com/apache/incubator-nuttx/pull/3885

repo: apache/incubator-nuttx


text:
arm/armv[7|8]m: compare of hardware fp registers should skip REG_FP_RESERVED

Summary
arm/armv[7|8]m: compare of hardware fp registers should skip REG_FP_RESERVED
Impact
Fix fpu test break by:
https://github.com/apache/incubator-nuttx/pull/6073
Reported by @masayuki2009
https://github.com/apache/incubator-nuttx/pull/6073#issuecomment-1104640815
Testing
spresense:smp

@anchao
Please add Fix fpu test break to the commit log.

Fix fpu test break

Done

I confirmed that this PR fixes the issue.


text:
Add string type support to MIN/MAX aggregation functions

Since Pinot supports string comparison, it will be nice to add the string type support to MIN/MAX aggregation functions, similar to other SQL engines like mysql.
For example, it can be used to find the earliest/latest date from string format.

In general we need to change min/max function to handle all types instead of just numeric values.

repo: apache/incubator-pinot


text:
Standardize the Dictionary interface, ensure the BYTES support

Type conversion between INT/LONG/FLOAT/DOUBLE/STRING are allowed
Type conversion between STRING/BYTES are allowed
Push down and enhance the MutableDictionary range predicate evaluation
Return dictId/dictIds while indexing value into MutableDictionary
Add documentation for the contract of Dictionary interface

Codecov Report

Merging #4622 into master will decrease coverage by 0.21%.
The diff coverage is 60.97%.

@@             Coverage Diff              @@
##             master    #4622      +/-   ##
============================================
- Coverage     64.25%   64.03%   -0.22%
  Complexity       32       32
============================================
  Files          1072     1071       -1
  Lines         55701    55842     +141
  Branches       8130     8216      +86
============================================
- Hits          35789    35761      -28
- Misses        17271    17408     +137
- Partials       2641     2673      +32

Impacted Files
Coverage Δ
Complexity Δ

...re/segment/index/data/source/ColumnDataSource.java
95.45% <ø> (ø)
0 <0> (ø)
:arrow_down:

...ment/creator/impl/SegmentColumnarIndexCreator.java
77.17% <ø> (-0.07%)
0 <0> (ø)

...e/pinot/core/segment/creator/impl/V1Constants.java
11.11% <ø> (-22.23%)
0 <0> (ø)

...t/core/segment/index/readers/OnHeapDictionary.java
100% <ø> (ø)
0 <0> (ø)
:arrow_down:

...impl/stats/StringColumnPreIndexStatsCollector.java
76.11% <ø> (-0.7%)
0 <0> (ø)

.../impl/stats/AbstractColumnStatisticsCollector.java
94.28% <ø> (+4.08%)
0 <0> (ø)
:arrow_down:

...time/impl/dictionary/MutableDictionaryFactory.java
65% <ø> (ø)
0 <0> (ø)
:arrow_down:

...ent/index/column/PhysicalColumnIndexContainer.java
92.06% <ø> (ø)
0 <0> (ø)
:arrow_down:

...pinot/core/query/pruner/AbstractSegmentPruner.java
72.72% <0%> (ø)
0 <0> (ø)
:arrow_down:

...t/index/loader/bloomfilter/BloomFilterHandler.java
71.66% <100%> (ø)
0 <0> (ø)
:arrow_down:

... and 68 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 44d1ce9...acf6fe9. Read the comment docs.

authors: Jackie-Jiang codecov-io


text:
Set error-message into RestException

Motivation
Right now, RestException(code, message) doesn't set given message into the exception and restException.getMessage() doesn't return correct configured message-string which doesn't log correct information when broker tries to log message string using restException.getMessage().
Modifications
Set correct message-string into RestException.
Result
RestException.getMessage() returns correct message-string.

SUCCESS
--none--

authors: asfgit rdhabalia

repo: apache/incubator-pulsar


text:
RATIS-1212. Remove steams from StreamMap when close stream

What changes were proposed in this pull request?
Remove steams from StreamMap when close stream
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/RATIS-1212
How was this patch tested?
No need to add ut.

+1

authors: amaliujia runzhiwang

repo: apache/incubator-ratis