text:
Documentation build warnings when DPF installed locally

Before submitting the issue

[X] I have searched among the existing issues
[X] I am using a Python virtual environment
[X] I have a fully updated virtual environment (i.e. pip install --upgrade --upgrade-strategy eager ansys-mapdl-core)

Description of the bug
Hi @germa89,
As discussed during the meeting, here you have the logs when building the documentation.
This accounts for the case of a user using MAPDL from the Docker image and DPF installed locally.
Note that even with the warnings, most of the examples are correctly rendered (including the composite_dcb with the animations). Not 100% sure if the only one failing is the basic_dpf_example.py. See logs below.
Steps To Reproduce
Building the documentation as:

doc/make.bat html

The following error log is obtained:
Running Sphinx v5.3.0
[autosummary] generating autosummary for: 404.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.aux_capabilities.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.boundary_condition_information.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.config_values.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.database_status.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.global_status.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.job_information.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.load_step_options.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.mapdl_version.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.mapdl_version_build.rst, ..., user_guide\mapdl.rst, user_guide\mapdl_examples.rst, user_guide\math.rst, user_guide\mesh_geometry.rst, user_guide\parameters.rst, user_guide\plotting.rst, user_guide\pool.rst, user_guide\post.rst, user_guide\upf.rst, user_guide\xpl.rst
loading intersphinx inventory from https://docs.python.org/dev/objects.inv...
loading intersphinx inventory from https://docs.scipy.org/doc/scipy/objects.inv...
loading intersphinx inventory from https://numpy.org/devdocs/objects.inv...
loading intersphinx inventory from https://matplotlib.org/stable/objects.inv...
loading intersphinx inventory from https://pandas.pydata.org/pandas-docs/stable/objects.inv...
loading intersphinx inventory from https://docs.pyvista.org/objects.inv...
loading intersphinx inventory from https://grpc.github.io/grpc/python/objects.inv...
loading intersphinx inventory from https://pypim.docs.pyansys.com/objects.inv...
generating gallery...
[INFO] See http://johnmacfarlane.net/pandoc/installing.html
for installation options

[INFO] ---------------------------------------------------------------

WARNING: 'pypandoc' not available. Using Sphinx-Gallery to convert rst text blocks to markdown for .ipynb files.
generating gallery for examples\gallery_examples\00-mapdl-examples... [ 33%] basic_dpf_example.py
Interrupted!
Terminate batch job (Y/N)? y
(mynewenv) PS C:\Users\gbarroso\repos\pymapdl> .\doc\make.bat html
Running Sphinx v5.3.0
[autosummary] generating autosummary for: 404.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.aux_capabilities.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.boundary_condition_information.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.config_values.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.database_status.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.global_status.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.job_information.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.load_step_options.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.mapdl_version.rst, contribution_and_api\_autosummary\ansys.mapdl.core.Information.mapdl_version_build.rst, ..., user_guide\mapdl.rst, user_guide\mapdl_examples.rst, user_guide\math.rst, user_guide\mesh_geometry.rst, user_guide\parameters.rst, user_guide\plotting.rst, user_guide\pool.rst, user_guide\post.rst, user_guide\upf.rst, user_guide\xpl.rst
loading intersphinx inventory from https://docs.python.org/dev/objects.inv...
loading intersphinx inventory from https://docs.scipy.org/doc/scipy/objects.inv...
loading intersphinx inventory from https://numpy.org/devdocs/objects.inv...
loading intersphinx inventory from https://matplotlib.org/stable/objects.inv...
loading intersphinx inventory from https://pandas.pydata.org/pandas-docs/stable/objects.inv...
loading intersphinx inventory from https://docs.pyvista.org/objects.inv...
loading intersphinx inventory from https://grpc.github.io/grpc/python/objects.inv...
loading intersphinx inventory from https://pypim.docs.pyansys.com/objects.inv...
loading intersphinx inventory from https://dpf.docs.pyansys.com/objects.inv...
generating gallery...
[INFO] See http://johnmacfarlane.net/pandoc/installing.html
for installation options

[INFO] ---------------------------------------------------------------

WARNING: 'pypandoc' not available. Using Sphinx-Gallery to convert rst text blocks to markdown for .ipynb files.
WARNING: C:\Users\gbarroso\repos\pymapdl\examples\00-mapdl-examples\basic_dpf_example.py failed to execute correctly: Traceback (most recent call last):
  File "C:\Users\gbarroso\repos\pymapdl\examples\00-mapdl-examples\basic_dpf_example.py", line 66, in <module>
    dpf.connect_to_server()
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server.py", line 313, in connect_to_server
    return connect()
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server.py", line 301, in connect
    server = server_type(
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 614, in __init__
    self._check_first_call(num_connection_tryouts)
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 625, in _check_first_call
    raise e
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 620, in _check_first_call
    self.version
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 633, in version
    api.data_processing_get_server_version_on_client(self.client, major, minor)
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\gate\generated\data_processing_capi.py", line 343, in data_processing_get_server_version_on_client
    raise errors.DPFServerException(sError.value)
ansys.dpf.gate.errors.DPFServerException: a unimplemented error ocurred:

generating gallery for examples\gallery_examples\00-mapdl-examples... [100%] transient_thermal.py
generating gallery for examples\gallery_examples\01-apdlmath-examples... [100%] use_numpy_arrays.py
generating gallery for examples\gallery_examples\02-geometry... [100%] 04-primitives.py
generating gallery for examples\gallery_examples\03-tips-n-tricks... [100%] 04-rotational-displacement.py
generating gallery for examples\gallery_examples\04-general-fea... [100%] 00-how_finite_element_works.py
generating gallery for examples\gallery_examples\06-verif-manual... [100%] vm-010-bending_of_a_t-shaped_beam.py
computation time summary:
    - ..\..\examples\00-mapdl-examples\composite_dcb.py:                                                29.17 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\basic_dpf_example.py:                                             0.78 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\2d_plate_with_a_hole.py:                                          0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\2d_pressure_vessel.py:                                            0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\3d_notch.py:                                                      0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\3d_plate_thermal.py:                                              0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\acoustic_analysis.py:                                             0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\contact_elements.py:                                              0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\cyclic_analysis.py:                                               0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\exhaust_manifold_thermal_stress.py:                               0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\geometry.py:                                                      0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\lathe_cutter.py:                                                  0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\mapdl_3d_beam.py:                                                 0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\mapdl_beam.py:                                                    0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\path_operations.py:                                               0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\pressure_vessel.py:                                               0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\pyvista_mesh.py:                                                  0.00 sec   0.0 MB
    - ..\..\examples\00-mapdl-examples\transient_thermal.py:                                             0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\basic_operations.py:                                           0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\eigen_solve.py:                                                0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\explore_mapdl_files.py:                                        0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\mapdl_vs_scipy.py:                                             0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\scipy_sparse_matrix.py:                                        0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\solve_dense_matrix.py:                                         0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\solve_sparse_matrix.py:                                        0.00 sec   0.0 MB
    - ..\..\examples\01-apdlmath-examples\use_numpy_arrays.py:                                           0.00 sec   0.0 MB
    - ..\..\examples\02-geometry\00-keypoints.py:                                                        0.00 sec   0.0 MB
    - ..\..\examples\02-geometry\01-lines.py:                                                            0.00 sec   0.0 MB
    - ..\..\examples\02-geometry\02-areas.py:                                                            0.00 sec   0.0 MB
    - ..\..\examples\02-geometry\03-volumes.py:                                                          0.00 sec   0.0 MB
    - ..\..\examples\02-geometry\04-primitives.py:                                                       0.00 sec   0.0 MB
    - ..\..\examples\03-tips-n-tricks\00-example-template.py:                                            0.00 sec   0.0 MB
    - ..\..\examples\03-tips-n-tricks\01-smoothing-element-size-transitions.py:                          0.00 sec   0.0 MB
    - ..\..\examples\03-tips-n-tricks\03-using_inline_functions_and_Query.py:                            0.00 sec   0.0 MB
    - ..\..\examples\03-tips-n-tricks\04-rotational-displacement.py:                                     0.00 sec   0.0 MB
    - ..\..\examples\04-general-fea\00-how_finite_element_works.py:                                      0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-001-statically_indeterminate_reaction_force_analysis.py:         0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-002-beam_stresses_and_deflections.py:                            0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-003-thermally_loaded_support_structure.py:                       0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-004-deflection_of_a_hinged_support.py:                           0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-005-laterally_loaded_tapered_support_structure.py:               0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-006-pinched_cylinder.py:                                         0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-007-plastic_compression_of_a_pipe_assembly.py:                   0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-008-parametric_calculation.py:                                   0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-009-large_lateral_deflection_of_unequal_stiffness_springs.py:    0.00 sec   0.0 MB
    - ..\..\examples\06-verif-manual\vm-010-bending_of_a_t-shaped_beam.py:                               0.00 sec   0.0 MB
building [mo]: targets for 0 po files that are out of date
building [html]: targets for 2058 source files that are out of date
updating environment: [new config] 2058 added, 0 changed, 0 removed
executing ex_0-tecbrakesquealmples/technology_showcase_examples/techdemo-1/ex_0-tecbrakesqueal
executing ex_28-tecfricstirxamples/technology_showcase_examples/techdemo-28/ex_28-tecfricstir
reading sources... [100%] user_guide/xpl
looking for now-outdated files... none found
pickling environment... done
checking consistency... done
preparing documents... done
writing output... [100%] user_guide/xpl
generating indices... genindex done
writing additional pages... search done
copying images... [ 60%] examples/gallery_examples/06-verif-manual/images/thumb/sphx_glr_vm-009-large_lateral_deflection_of_unequal_stiffness_springs_thumbcopying images... [100%] images/rst_structure.png
copying downloadable files... [100%] examples/technology_showcase_examples/techdemo-20/20-example-technology-showcase-dynamic-simulation-PCB.ipynb
copying static files... done
copying extra files... done
dumping search index in English (code: en)... done
dumping object inventory... done

Sphinx-Gallery successfully executed 1 out of 2 files subselected by:

    gallery_conf["filename_pattern"] = '\\.py'
    gallery_conf["ignore_pattern"]   = 'flycheck*'

after excluding 44 files that had previously been run (based on MD5).

Extension error:
Here is a summary of the problems encountered when running the examples

Unexpected failing examples:
C:\Users\gbarroso\repos\pymapdl\examples\00-mapdl-examples\basic_dpf_example.py failed leaving traceback:
Traceback (most recent call last):
  File "C:\Users\gbarroso\repos\pymapdl\examples\00-mapdl-examples\basic_dpf_example.py", line 66, in <module>
    dpf.connect_to_server()
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server.py", line 313, in connect_to_server
    return connect()
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server.py", line 301, in connect
    server = server_type(
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 614, in __init__
    self._check_first_call(num_connection_tryouts)
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 625, in _check_first_call
    raise e
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 620, in _check_first_call
    self.version
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\core\server_types.py", line 633, in version
    api.data_processing_get_server_version_on_client(self.client, major, minor)
  File "C:\ProgramData\Miniconda3\envs\mynewenv\lib\site-packages\ansys\dpf\gate\generated\data_processing_capi.py", line 343, in data_processing_get_server_version_on_client
    raise errors.DPFServerException(sError.value)
ansys.dpf.gate.errors.DPFServerException: a unimplemented error ocurred:

-------------------------------------------------------------------------------

Which Operating System are you using?
Windows
Which Python version are you using?
3.9
PyMAPDL Report

Show the Report!

PyMAPDL Software and Environment Report

Packages Requirements
*********************

Core packages
-------------
ansys.mapdl.core    : 0.64.dev0
numpy               : 1.23.4
appdirs             : 1.4.4
scipy               : 1.9.3
grpc                : Package not found
ansys.api.mapdl.v0  : Package not found
ansys.mapdl.reader  : 0.52.3
google.protobuf     : Package not found

Optional packages
-----------------
matplotlib          : 3.6.2
pyvista             : 0.37.0
pyiges              : 0.2.1
tqdm                : 4.64.1

Ansys Installation
******************
Version   Location
------------------
222       C:\Program Files\ANSYS Inc\v222

Ansys Environment Variables
***************************
ANSYS222_DIR                   C:\Program Files\ANSYS Inc\v222\ANSYS
ANSYSLIC_DIR                   C:\Program Files\ANSYS Inc\Shared Files\Licensing
AWP_ROOT222                    C:\Program Files\ANSYS Inc\v222
CADOE_LIBDIR222                C:\Program Files\ANSYS Inc\v222\CommonFiles\Language\en-us

Installed packages

Show the installed packages!

aiohttp==3.8.3
aiosignal==1.2.0
alabaster==0.7.12
ansys-api-mapdl==0.5.1
ansys-api-platform-instancemanagement==1.0.0b3
ansys-dpf-core==0.6.2
ansys-dpf-gate==0.2.3
ansys-dpf-gatebin==0.2.3
ansys-grpc-dpf==0.6.1
-e git+https://github.com/pyansys/pymapdl.git@b93ea297c947598d55ae22f170e2867ee5843e85#egg=ansys_mapdl_core
ansys-mapdl-reader==0.52.3
ansys-platform-instancemanagement==1.0.2
ansys-sphinx-theme==0.7.0
anyio==3.6.2
appdirs==1.4.4
argon2-cffi==21.3.0
argon2-cffi-bindings==21.2.0
asttokens==2.1.0
async-timeout==4.0.2
attrs==22.1.0
autobahn==22.7.1
Automat==22.10.0
Babel==2.11.0
backcall==0.2.0
beautifulsoup4==4.11.1
bleach==5.0.1
cachetools==5.2.0
certifi @ file:///C:/b/abs_ac29jvt43w/croot/certifi_1665076682579/work/certifi
cffi==1.15.1
charset-normalizer==2.1.1
click==8.1.3
colorama==0.4.6
constantly==15.1.0
contourpy==1.0.6
cryptography==38.0.3
cycler==0.11.0
debugpy==1.6.3
decorator==5.1.1
defusedxml==0.7.1
docutils==0.19
entrypoints==0.4
exceptiongroup==1.0.0
executing==1.2.0
fastjsonschema==2.16.2
fonttools==4.38.0
frozenlist==1.3.1
geomdl==5.3.1
google-api-core==2.10.2
google-api-python-client==2.65.0
google-auth==2.14.0
google-auth-httplib2==0.1.0
googleapis-common-protos==1.56.4
grpcio==1.50.0
httplib2==0.21.0
hyperlink==21.0.0
idna==3.4
imageio==2.22.3
imageio-ffmpeg==0.4.7
imagesize==1.4.1
importlib-metadata==5.0.0
incremental==22.10.0
iniconfig==1.1.1
ipydatawidgets==4.3.2
ipykernel==6.17.0
ipython==8.6.0
ipython-genutils==0.2.0
ipywidgets==8.0.2
jedi==0.18.1
Jinja2==3.1.2
json5==0.9.10
jsonschema==4.17.0
jupyter-server==1.21.0
jupyter-sphinx==0.4.0
jupyter_client==7.4.4
jupyter_core==4.11.2
jupyterlab==3.5.0
jupyterlab-pygments==0.2.2
jupyterlab-widgets==3.0.3
jupyterlab_server==2.16.2
kiwisolver==1.4.4
livereload==2.6.3
MarkupSafe==2.1.1
matplotlib==3.6.2
matplotlib-inline==0.1.6
mistune==2.0.4
multidict==6.0.2
nbclassic==0.4.7
nbclient==0.7.0
nbconvert==7.2.3
nbformat==5.7.0
nest-asyncio==1.5.6
notebook==6.5.2
notebook_shim==0.2.0
numpy==1.23.4
numpydoc==1.5.0
packaging==21.3
pandas==1.5.1
pandocfilters==1.5.0
parso==0.8.3
pickleshare==0.7.5
Pillow==9.3.0
plotly==5.11.0
pluggy==1.0.0
pooch==1.6.0
prometheus-client==0.15.0
prompt-toolkit==3.0.31
protobuf==3.20.3
protoc-gen-swagger==0.1.0
psutil==5.9.3
pure-eval==0.2.2
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydata-sphinx-theme==0.9.0
Pygments==2.13.0
pyiges==0.2.1
pypandoc==1.9
pyparsing==3.0.9
pyrsistent==0.19.1
pytest==7.2.0
pytest-sphinx==0.5.0
python-dateutil==2.8.2
pythreejs==2.4.1
pytz==2022.6
pyvista==0.37.0
pywin32==304
pywinpty==2.0.9
pyzmq==24.0.1
requests==2.28.1
rsa==4.9
scipy==1.9.3
scooby==0.7.0
Send2Trash==1.8.0
six==1.16.0
sniffio==1.3.0
snowballstemmer==2.2.0
soupsieve==2.3.2.post1
Sphinx==5.3.0
sphinx-autobuild==2021.3.14
sphinx-copybutton==0.5.0
sphinx-gallery==0.11.1
sphinx-notfound-page==0.8.3
sphinx_autodoc_typehints==1.19.4
sphinxcontrib-applehelp==1.0.2
sphinxcontrib-devhelp==1.0.2
sphinxcontrib-htmlhelp==2.0.0
sphinxcontrib-jsmath==1.0.1
sphinxcontrib-qthelp==1.0.3
sphinxcontrib-serializinghtml==1.1.5
sphinxcontrib-websupport==1.2.4
sphinxemoji==0.2.0
stack-data==0.6.0
tenacity==8.1.0
terminado==0.17.0
tinycss2==1.2.1
tomli==2.0.1
tornado==6.2
tqdm==4.64.1
traitlets==5.5.0
traittypes==0.2.1
Twisted==22.10.0
twisted-iocpsupport==1.0.2
txaio==22.2.1
typing_extensions==4.4.0
uritemplate==4.1.1
urllib3==1.26.12
vtk==9.2.2
wcwidth==0.2.5
webencodings==0.5.1
websocket-client==1.4.1
widgetsnbextension==4.0.3
wincertstore==0.2
wslink==1.9.1
yarl==1.8.1
zipp==3.10.0
zope.interface==5.5.0

I believe this was fixed in #2338 where the DPF locally build was fixed.

repo: ansys/pymapdl


text:
Path based SSG

In the vitesse-ssr example for vite-ssr, they have a path based i18n.
for example, try
https://vitesse-ssr.vercel.app/vi/
and
https://vitesse-ssr.vercel.app/tr/
How can one achieve the same with vite-ssg. In fact that would be very nice to add to vitesse as well.
Thanks

I think you can use this: https://github.com/antfu/vite-ssg#custom-routes-to-render
with some vue-router meta to switch vue-i18n's language

@hannoeru thanks for suggestion, but I ended up using the similar technique to the one here and 'pagesDir' param of vite-plugin-pages e.g.
pagesDir: ["", ...SECONDARY_LOCALES].map((x) => ({
        dir: "src/pages",
        baseRoute: x,
      })),

source: gharchive/issue

authors: hannoeru husayt

repo: antfu/vite-ssg

license: MIT

license_type: permissive

license_source: github-api


text:
dosc.rs not up-to-date with 0.15.0; still on 0.13.0

On https://docs.rs/crate/tesseract/0.15.0 the docs warn that the last successful version was built for 0.13.0.
Is this intentional? Did nothing change?

Hey
Thanks for pointing this out.
Looking at the logs
[INFO] [stderr] 5 | use self::tesseract_sys::TessBaseAPIInit5;

The issue seems to be around TessBaseAPIInit5.
We can see that TessBaseAPIInit5 is gated by tesseract_5_2 here, I think the docs.rs CI system is using an older version of the tesseract c library. I'll see if we can have the docs.rs CI not use the feature tesseract_5_2.

Because of this change, it has now built
04070d2941a78cbacf4c25ce25240825d41cc1f1
https://docs.rs/tesseract/0.15.1/tesseract/

authors: ccouzens metalglove

license: mit

license_source: bigquery


text:
Multi-threading problem

Hello, this library  is awesome and I use it in my tools. But I have  some problem.
In my tool, I use libuv to do the network jobs and use linenoise to interactive with user. They are run on different thread. But when running linenoise and blocked on one thread and writing some message with '\n' on another thread, the column position of the next line is padding to the position of the preview's.
For example, if I write abc\ndef to stdout, it will be:
~>
# terminal show this and then I call printf("abc\ndef") on another thread.
# then it will be like this
~>abc
     def

It's hard for humen to read especially the line is long and there is many line.Such as I print the DebugString of protobuf to stdout.
Then I fork this repo and comment linenoise.c:233
    raw.c_iflag &= ~(BRKINT | ICRNL | INPCK | ISTRIP | IXON);
    /* output modes - disable post processing */
    // raw.c_oflag &= ~(OPOST);  // HERE MODIFIED
    /* control modes - set 8 bit chars */
    raw.c_cflag |= (CS8);

And then this problem is gone.
But I wonder if is there any problem in other cases?
Hope for your help.
Thanks

please see https://github.com/owent-contrib/linenoise to view the changes

I had the same issue, thank you for this temporary fix! I'll report back if I run into any unintended consequences.

I had the same issue. This proposed fix solves the problem. Please consider merging to the main branch. Thanks! (unless it has unintended side effects, if so, please point it out, thanks!).

repo: antirez/linenoise


text:
Debug and pass CONV2D tests

Debug and finish CONV2D implementation to pass all tests
Current implementation of CONV2D operator is currently failing on memory allocation for VTA and is disabled by default in the delegate implementation. Aim of the issue is to debug the CONV2D operator and get it to pass all tests in the project.
Steps to run the tests

Clone the repository

git clone https://github.com/antmicro/alkali-csd-fw.git
cd alkali-csd-fw/

Install the requirements (for building test models)

pip3 install -r requirements.txt

Create a build directory and build the project with tests enabled and simulation driver enabled:

mkdir build && cd build
cmake -DCMAKE_EXPORT_COMPILE_COMMANDS=1 -DCMAKE_BUILD_TYPE=Debug -DNO_HARDWARE=ON -DBUILD_TESTS=ON ..
make -j`nproc`

Increase logging verbosity:

export SPDLOG_LEVEL=debug

Run tests for CONV2D:

./vta-delegate-test-runner --gtest_filter="VTAConv2DTestGroup/VTAConv2DTest.*"

To run one of the smallest CONV2D examples, run:
./vta-delegate-test-runner --gtest_filter="VTAConv2DTestGroup/VTAConv2DTest.*/96"

(tests are sorted alphabetically, and accessed via test id, hence the number)

It regards implementation from https://github.com/antmicro/alkali-csd-fw/pull/6

repo: antmicro/alkali-csd-fw


text:
REALLY broken

Describe the bug
Refuses to load games, returns HTTP error when getting prices, and much more as I can imagine.
To Reproduce
Steps to reproduce the behavior:

Import
Copy the following code:

from marketwatch import MarketWatch
marketwatch = MarketWatch("username", "password")
out1 = marketwatch.get_price("AAPL")
out2 = marketwatch.get_games()

print(out1)
print(out2)

Expected behavior
Return proper JSON output like it used to
Screenshots
one
two
Desktop (please complete the following information):

OS: Chrome
Browser: Chrome
Version Current

Additional context
THIS USED TO WORK, however now it doesn't.

They changed the api recently i gonna look into it

They added a geo blocker to the api and the web pages. What I can do is make the stock api, watchlist works. I am not sure if i can make the game works like before. I will do more tests

That's all right, I'll try to figure out some other stuff in the meantime.  Also, one last thing -- There was another problem with the output that returned "Working..." every time a request was made.  Not being too familiar with python, stdout was the closest thing I could get to returning the right values to Javascript, but each time I did there was another object sent with that message.  It'd be pretty helpful I'm sure if you could try to wire out that as well, but I'm in no hurry so take your time.


text:
HP Omen dc0051nr Keyboard Support

Is it possible to get the HP Omen DC0051NR Keyboard supported in this program?

Which software do you use to change its lights?

It is normally controlled through the OMEN Command Center

I couldn't find any way of interfacing with the lights on that keyboard as HP doesnt offer an SDK for use to use, so i'm afraid we can't support it.

repo: antonpup/Aurora


text:
Discord overlay profile is black

Expected Behaviour
The Discord profile should continue to use the Desktop profile regardless of focus, however overlaying the Discord profile wrapper upon certain events (mentions, DM's, etc)
Actual Behaviour
The Discord profile sets the keyboard completely black if Discord is in focus
Reproduction steps
Create the Discord profile using discord.exe, create a Wrapper layer in Overlay Layers. Ensure Logitech patch is working. Disable the layer but keep Overlays Enabled checked. Put the Discord app in focus.

Frequency
This issue occurs every time.
Aurora Version:
beta v0.7.0
Previously an Issue?
Don't know

The main reason this doesn't work is because (if I remember correctly) the wrappers do not send transparency to Aurora. The wrappers do not differentiate between keys they are set and those that aren't, so there's no way of Aurora being able to know which is which. We also believe the Discord applet is designed to work with Logitech's software in such a way that the overlay is calculated by that software and then the whole keyboard result is then sent to Aurora (which again, means that there are black keys where you would expect transparency).
For these reasons we don't really advise the use of the Logitech applets at the same time as you are attempting stuff with Aurora.
If you use BetterDiscord, there is plugin support for that. Otherwise, there's not a lot the Aurora team can do as normal Discord does not have an API for fetching this type of data.


text:
Suggesting Support for Total War Warhammer

Hi, I'd just like to suggest Aurora support for Total War Warhammer (I and II). Currently it is the leading epic scale fantasy strategy game. And I think it will remain that way. And there is even TW: Warhammer III to be published. Since you could use almost the same aurora profile for all three games and it would be very nice to also have a game from the grand scale strategy genre for aurora, I'd be very happy if this would become true.

I don't think this will be on the timeline for support in Aurora. I haven't looked into it, but I assume there is mod support that could theoretically allow for giving game info to Aurora. My plan is to make it as easy as possible for other people to add support for new games, as it just isn't viable for me to add them all, right now I barely have enough time to work on Aurora itself.

authors: Shendrach simon-wh


text:
try iron-session for Multitenant auth

https://github.com/vvo/iron-session

this is done now

authors: antosubash antosubash-dev

repo: antosubash/abp-react


text:
Improve readability of code and comment about externalTrafficPolicy

Signed-off-by: Quan Tian qtian@vmware.com

Codecov Report

Merging #3877 (cb9cc02) into main (8e8aafb) will decrease coverage by 16.71%.
The diff coverage is 50.00%.

@@             Coverage Diff             @@
##             main    #3877       +/-   ##
===========================================
- Coverage   64.39%   47.68%   -16.72%
===========================================
  Files         288      256       -32
  Lines       41223    37077     -4146
===========================================
- Hits        26546    17679     -8867
- Misses      12538    17676     +5138
+ Partials     2139     1722      -417

Flag
Coverage Δ

kind-e2e-tests
47.68% <50.00%> (-4.07%)
:arrow_down:

unit-tests
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/agent/openflow/client.go
62.74% <ø> (-6.64%)
:arrow_down:

pkg/agent/proxy/proxier.go
47.64% <0.00%> (-15.29%)
:arrow_down:

pkg/agent/openflow/pipeline.go
70.81% <55.55%> (-4.22%)
:arrow_down:

pkg/controller/networkpolicy/endpoint_querier.go
4.58% <0.00%> (-88.08%)
:arrow_down:

pkg/agent/flowexporter/connections/conntrack.go
0.00% <0.00%> (-85.72%)
:arrow_down:

pkg/agent/util/iptables/lock.go
0.00% <0.00%> (-80.00%)
:arrow_down:

pkg/agent/flowexporter/exporter/exporter.go
0.00% <0.00%> (-77.98%)
:arrow_down:

pkg/cni/client.go
0.00% <0.00%> (-77.78%)
:arrow_down:

...g/agent/apiserver/handlers/featuregates/handler.go
4.54% <0.00%> (-77.28%)
:arrow_down:

.../certificatesigningrequest/approving_controller.go
0.00% <0.00%> (-76.60%)
:arrow_down:

... and 159 more

LGTM, no further comment

/skip-all

source: gharchive/pull-request

authors: codecov-commenter hongliangl tnqn

repo: antrea-io/antrea


text:
Automated cherry pick of #6050: Fix wrong TCP flags validation (#6050)

Cherry pick of #6050 on release-1.14.
#6050: Fix wrong TCP flags validation (#6050)
For details on the cherry pick process, see the cherry pick requests page.

/skip-all

/skip-all

authors: gran-vmv tnqn


text:
F2 增加chart实例级别的theme

目前F2.Global.setTheme 只支持全局的换皮肤。

暂不支持

authors: cycgit simaQ


text:
在小程序中无法使用

尊敬的开源者，您好，我在使用你开源的项目中出现了问题，按照文档提供的步骤一步一步操作还是无法实现，不知是不是我自己的问题，还望看到能及时回复，感谢。下面附上问题和截图~！
我是按照文档提供的引入babel.config方式，但是他的编译好像没有达到。不太清楚是哪里的问题

没办法添加截图

{
"classic": {
"plugins": [
[
"@babel/plugin-transform-react-jsx",
{
"pragma": "jsx",
"pragmaFrag": "Fragment"
}
]
]
},
"automatic": {
"plugins": [
[
"@babel/plugin-transform-react-jsx",
{
"runtime": "automatic",
"importSource": "@antv/f2"
}
]
]
}
}

这是jsx内容
import Chart from './chart';
const data = [
{ genre: 'Sports', sold: 275 },
{ genre: 'Strategy', sold: 115 },
{ genre: 'Action', sold: 120 },
{ genre: 'Shooter', sold: 350 },
{ genre: 'Other', sold: 150 },
];
Page({
data: {
onRenderChart() {
return ;
},
},
});

这是编译后的内容，缺少
// pages/index/index.js
Page({
/**

页面的初始数据
*/
data: {

},
/**

生命周期函数--监听页面加载
*/
onLoad(options) {

},
/**

生命周期函数--监听页面初次渲染完成
*/
onReady() {

},
/**

生命周期函数--监听页面显示
*/
onShow() {

},
/**

生命周期函数--监听页面隐藏
*/
onHide() {

},
/**

生命周期函数--监听页面卸载
*/
onUnload() {

},
/**

页面相关事件处理函数--监听用户下拉动作
*/
onPullDownRefresh() {

},
/**

页面上拉触底事件的处理函数
*/
onReachBottom() {

},
/**

用户点击右上角分享
*/
onShareAppMessage() {

}
})


text:
BUG:Text not visible in Darkmode

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
In the Literary Realms section ,while we are switching dark mode on,the text is not visible
We can change the color to a darker one so that visibility is fine
From this:

To this:

Plz @anuragverma108 Assign this issue to me
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

Assigned!
Make sure to attach before & after screenshots in your PR. Also, star the repo before working on it. While creating your PR, ensure you pull all existing changes beforehand to avoid conflicts.
Happy open-source contributing!

I'd like to contribute to this issue too, can you assign this to me as well sir?


text:
Proper navigation for Privacy notice and Copyright policy in the footer section.

Related Issue
Fixes:  #2788
Description
Provided proper navigation for Privacy notice and Copyright policy links in every page.
Type of PR

[X] Bug fix

Screenshots / videos (if applicable)
https://drive.google.com/file/d/114oMS1f66MRU5xaFdafOaHsiSG1z_X4D/view?usp=drive_link
Checklist:

[X] I have made this change from my own.
[X] My code follows the style guidelines of this project.
[X] I have performed a self-review of my own code.
[X] My changes generate no new warnings.
[X] I have tested the changes thoroughly before submitting this pull request.
[X] I have provided relevant issue numbers and screenshots after making the changes.

@anuragverma108 @huamanraj
Please review this PR and assign labels.
Thank you.

@huamanraj
Please review this PR.
I've resolved the conflicts.
Thank you.


text:
Added Icons to Navbar

Related Issue
Icons absent in Navbar section
Fixes: Added icons to navbar
Description
Added attractive icons to the NavLinks present on the navbar section.
#3019
Type of PR

[ ] Bug fix
[X] Feature enhancement
[ ] Documentation update
[ ] Other (specify): _______________

Screenshots / videos (if applicable)

Checklist:

[X] I have made this change from my own.
[X] I have taken help from some online resources.
[X] My code follows the style guidelines of this project.
[X] I have performed a self-review of my own code.
[X] I have tested the changes thoroughly before submitting this pull request.
[X] I have provided relevant issue numbers and screenshots after making the changes.

Please review the PR and let me know if any additional changes are required

not looking good @Devaki01


text:
Fixed NavBar : Login and Register options not working fixed with Working proof

To address the issue of the NavBar's Login and Register options not working here's a plan for resolving it:
The issue  with the "Login" and "Register" links not reloading the pages is due to the JavaScript logic that prevents default behavior and implements smooth scrolling to sections based on id attributes. Since the login.html and register.html pages don't correspond to sections with IDs, they aren't loading as expected.
I have fixed the issue Please assign me the task .
Before :
https://github.com/user-attachments/assets/aaa76e65-0544-4452-a1a9-0554b07a4f89
please @anuragverma108 assign me with this issue with labels "hactoberfest"

After 👍  : Login and Register Link works successfully
https://github.com/user-attachments/assets/0b16a8d9-f16b-411d-9544-9a2b53cf1490
Closes Issue #946 , #942 , #945
Now the Register and login links work well


text:
toggle mode feature added

toggle for light & dark mode feature added for better user experience during night
Light & Dark mode :

@anuragverma108 @PriyaGhosal @rahulkhandait-sde

Please do merge my PR @anuragverma108

Please note that this is not in line with our code of conduct. To ensure clarity and proper assignment tracking, please attach the issue number to your PR description. This helps us confirm that the issue is assigned to you. Kindly update your PR with the issue number and resubmit.
Example:
Fixes #123 - Brief description of the fix.


text:
Added DJANGO_REST_LOOKUP_FIELD configuration closes #5

Test added, tell me if you want some other change, otherwise i will clean the commits so this can be merged.

@anx-ckreuzberger something about this?

Thanks for the PR! Looks good so far, but I haven't had the time to fully check it.
Please bare with me, I'll try to get it done next week.

I love it!
You are not breaking the API, you did write a test, and the PR is clean! Sorry that it took so long!

authors: anx-ckreuzberger iagocanalejas


text:
Tempfile

Just a question. Why require "tempfile" was needed here?
https://github.com/anykeyh/crystal-coverage/commit/bd4db8260ce664d15c5c912fc3c0fbd95d30e090#diff-8d37261a58ddf04376fa214911114adc

it is no longer useful. I am making a merge request.

Sorry for delay. I'm currently traveling in low-connection location. I've merged the PR! Thank you !

authors: 007lva JadeKharats anykeyh

repo: anykeyh/crystal-coverage


text:
GO-2526: Update diff

[ ] I understand that contributing to this repository will require me to agree with the CLA

Description

What type of PR is this? (check all applicable)

[ ] 🍕 Feature
[ ] 🐛 Bug Fix
[ ] 📝 Documentation Update
[ ] 🎨 Style
[ ] 🧑💻 Code Refactor
[ ] 🔥 Performance Improvements
[ ] ✅ Test
[ ] 🤖 Build
[ ] 🔁 CI

Related Tickets & Documents

Mobile & Desktop Screenshots/Recordings

Added tests?

[ ] 👍 yes
[ ] 🙅 no, because they aren't needed
[ ] 🙋 no, because I need help

Added to documentation?

[ ] 📜 README.md
[ ] 📓 tech-docs
[ ] 🙅 no documentation needed

[optional] Are there any post-deployment tasks we need to perform?

megred in #62

authors: cheggaaa mcrakhman

repo: anyproto/any-sync-node


text:
remove accounts() and all_accounts()

Problem
Trying to get rid of mmaps for storages.
We need to deprecate use of fns that return stored_account_meta.
Summary of Changes
introduce accounts_count() that returns # accounts in a storage. Several tests can make use of this.
Fixes #

Codecov Report
Attention: Patch coverage is 94.02985% with 4 lines in your changes are missing coverage. Please review.

Project coverage is 82.2%. Comparing base (3c0f263) to head (91e8e07).

Additional details and impacted files
@@            Coverage Diff            @@
##           master    #1117     +/-   ##
=========================================
- Coverage    82.2%    82.2%   -0.1%
=========================================
  Files         880      880
  Lines      235623   235609     -14
=========================================
- Hits       193717   193677     -40
- Misses      41906    41932     +26

authors: codecov-commenter jeffwashington

repo: anza-xyz/agave


text:
purge zero lamport accounts in clean

Problem
scenario:
slot 1 contains account a with zero lamports. ref_count=1, slot_list.len()=1
clean comes across account 'a'. Account a should be marked dead and removed from the index.
It currently is not.
Summary of Changes
Recognize this special case and allow clean to remove account a.
Fixes #

Is this bug affecting mainnet? Or just when we disable rewrite?

Is this bug affecting mainnet? Or just when we disable rewrite? I image with rewrites, all storage will eventually be dead and dropped. So these zero accounts will eventually be dropped.

it is affecting mnb in that we are still carrying accounts with zero lamports for an entire epoch or until the entire slot can be marked dead (which is often an entire epoch). when we eliminate rewrites, these zero lamport accounts never get removed.

This has proven tricky to get right. The code as it is causes us to end up with index entries with slot_list=[] and ref_count = 1 (in the case where it works), but ref_count = 0 in the other case, which is wrong. @brooksprumo will be implementing a different solution which relies on shrink to handle these 0 lamport single ref accounts.

authors: HaoranYi jeffwashington


text:
引入 contentView 之后 就会报错  app:contentView="@id/teeee"

org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':module_courseedit:processDebugResources'.
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:100)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:70)
at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:63)
at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:58)
at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:88)
at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:52)
at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:52)
at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54)
at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)
at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:34)
at org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker$1.run(DefaultTaskGraphExecuter.java:248)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:336)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:328)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:197)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:107)
at org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker.execute(DefaultTaskGraphExecuter.java:241)
at org.gradle.execution.taskgraph.DefaultTaskGraphExecuter$EventFiringTaskWorker.execute(DefaultTaskGraphExecuter.java:230)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.processTask(DefaultTaskPlanExecutor.java:124)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.access$200(DefaultTaskPlanExecutor.java:80)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:105)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker$1.execute(DefaultTaskPlanExecutor.java:99)
at org.gradle.execution.taskgraph.DefaultTaskExecutionPlan.execute(DefaultTaskExecutionPlan.java:625)
at org.gradle.execution.taskgraph.DefaultTaskExecutionPlan.executeWithTask(DefaultTaskExecutionPlan.java:580)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$TaskExecutorWorker.run(DefaultTaskPlanExecutor.java:99)
at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor.process(DefaultTaskPlanExecutor.java:60)
at org.gradle.execution.taskgraph.DefaultTaskGraphExecuter.execute(DefaultTaskGraphExecuter.java:128)
at org.gradle.execution.SelectedTaskExecutionAction.execute(SelectedTaskExecutionAction.java:37)
at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:37)
at org.gradle.execution.DefaultBuildExecuter.access$000(DefaultBuildExecuter.java:23)
at org.gradle.execution.DefaultBuildExecuter$1.proceed(DefaultBuildExecuter.java:43)
at org.gradle.execution.DryRunBuildExecutionAction.execute(DryRunBuildExecutionAction.java:46)
at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:37)
at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:30)
at org.gradle.initialization.DefaultGradleLauncher$ExecuteTasks.run(DefaultGradleLauncher.java:311)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:336)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:328)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:197)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:107)
at org.gradle.initialization.DefaultGradleLauncher.runTasks(DefaultGradleLauncher.java:202)
at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:132)
at org.gradle.initialization.DefaultGradleLauncher.executeTasks(DefaultGradleLauncher.java:107)
at org.gradle.internal.invocation.GradleBuildController$1.call(GradleBuildController.java:78)
at org.gradle.internal.invocation.GradleBuildController$1.call(GradleBuildController.java:75)
at org.gradle.internal.work.DefaultWorkerLeaseService.withLocks(DefaultWorkerLeaseService.java:152)
at org.gradle.internal.invocation.GradleBuildController.doBuild(GradleBuildController.java:100)
at org.gradle.internal.invocation.GradleBuildController.run(GradleBuildController.java:75)
at org.gradle.tooling.internal.provider.runner.ClientProvidedBuildActionRunner.run(ClientProvidedBuildActionRunner.java:63)
at org.gradle.launcher.exec.ChainingBuildActionRunner.run(ChainingBuildActionRunner.java:35)
at org.gradle.launcher.exec.ChainingBuildActionRunner.run(ChainingBuildActionRunner.java:35)
at org.gradle.tooling.internal.provider.ValidatingBuildActionRunner.run(ValidatingBuildActionRunner.java:32)
at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner$1.run(RunAsBuildOperationBuildActionRunner.java:43)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:336)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:328)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:197)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:107)
at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner.run(RunAsBuildOperationBuildActionRunner.java:40)
at org.gradle.tooling.internal.provider.SubscribableBuildActionRunner.run(SubscribableBuildActionRunner.java:51)
at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:45)
at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:29)
at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:39)
at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:25)
at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:71)
at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:45)
at org.gradle.tooling.internal.provider.ServicesSetupBuildActionExecuter.execute(ServicesSetupBuildActionExecuter.java:51)
at org.gradle.tooling.internal.provider.ServicesSetupBuildActionExecuter.execute(ServicesSetupBuildActionExecuter.java:32)
at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:36)
at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:25)
at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:43)
at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:29)
at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:64)
at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:29)
at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:55)
at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:42)
at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:58)
at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:33)
at org.gradle.launcher.daemon.server.exec.ExecuteBuild.doBuild(ExecuteBuild.java:67)
at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.WatchForDisconnection.execute(WatchForDisconnection.java:37)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.ResetDeprecationLogger.execute(ResetDeprecationLogger.java:26)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.RequestStopIfSingleUsedDaemon.execute(RequestStopIfSingleUsedDaemon.java:34)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:74)
at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:72)
at org.gradle.util.Swapper.swap(Swapper.java:38)
at org.gradle.launcher.daemon.server.exec.ForwardClientInput.execute(ForwardClientInput.java:72)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.LogAndCheckHealth.execute(LogAndCheckHealth.java:55)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.LogToClient.doBuild(LogToClient.java:62)
at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment.doBuild(EstablishBuildEnvironment.java:82)
at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36)
at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:120)
at org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy$1.run(StartBuildOrRespondWithBusy.java:50)
at org.gradle.launcher.daemon.server.DaemonStateCoordinator$1.run(DaemonStateCoordinator.java:297)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.gradle.tooling.BuildException: Failed to execute aapt
at com.android.build.gradle.tasks.ProcessAndroidResources.invokeAaptForSplit(ProcessAndroidResources.java:573)
at com.android.build.gradle.tasks.ProcessAndroidResources.doFullTaskAction(ProcessAndroidResources.java:285)
at com.android.build.gradle.internal.tasks.IncrementalTask.taskAction(IncrementalTask.java:109)
at sun.reflect.GeneratedMethodAccessor536.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73)
at org.gradle.api.internal.project.taskfactory.DefaultTaskClassInfoStore$IncrementalTaskAction.doExecute(DefaultTaskClassInfoStore.java:173)
at org.gradle.api.internal.project.taskfactory.DefaultTaskClassInfoStore$StandardTaskAction.execute(DefaultTaskClassInfoStore.java:134)
at org.gradle.api.internal.project.taskfactory.DefaultTaskClassInfoStore$StandardTaskAction.execute(DefaultTaskClassInfoStore.java:121)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:122)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:336)
at org.gradle.internal.progress.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:328)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:197)
at org.gradle.internal.progress.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:107)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:111)
at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:92)
... 105 more
Caused by: com.android.ide.common.process.ProcessException: Failed to execute aapt
at com.android.builder.core.AndroidBuilder.processResources(AndroidBuilder.java:796)
at com.android.build.gradle.tasks.ProcessAndroidResources.invokeAaptForSplit(ProcessAndroidResources.java:551)
... 121 more
Caused by: java.util.concurrent.ExecutionException: com.android.ide.common.process.ProcessException: Error while executing process D:\android_sdk\Sdk\build-tools\26.0.2\aapt.exe with arguments {package -f --no-crunch -I D:\android_sdk\Sdk\platforms\android-27\android.jar -M \?\D:\luke1\module_courseedit\build\intermediates\manifests\instant-run\debug\AndroidManifest.xml -S D:\luke1\module_courseedit\build\intermediates\res\merged\debug -m -J \?\D:\luke1\module_courseedit\build\generated\source\r\debug -F D:\luke1\module_courseedit\build\intermediates\res\debug\resources-debug.ap_ --custom-package cn.wdcloud.luke.courseedit -0 apk --preferred-density xxxhdpi --output-text-symbols \?\D:\luke1\module_courseedit\build\intermediates\symbols\debug --no-version-vectors}
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:503)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:482)
at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:79)
at com.android.builder.core.AndroidBuilder.processResources(AndroidBuilder.java:794)
... 122 more
Caused by: com.android.ide.common.process.ProcessException: Error while executing process D:\android_sdk\Sdk\build-tools\26.0.2\aapt.exe with arguments {package -f --no-crunch -I D:\android_sdk\Sdk\platforms\android-27\android.jar -M \?\D:\luke1\module_courseedit\build\intermediates\manifests\instant-run\debug\AndroidManifest.xml -S D:\luke1\module_courseedit\build\intermediates\res\merged\debug -m -J \?\D:\luke1\module_courseedit\build\generated\source\r\debug -F D:\luke1\module_courseedit\build\intermediates\res\debug\resources-debug.ap_ --custom-package cn.wdcloud.luke.courseedit -0 apk --preferred-density xxxhdpi --output-text-symbols \?\D:\luke1\module_courseedit\build\intermediates\symbols\debug --no-version-vectors}
at com.android.build.gradle.internal.process.GradleProcessResult.buildProcessException(GradleProcessResult.java:73)
at com.android.build.gradle.internal.process.GradleProcessResult.assertNormalExitValue(GradleProcessResult.java:48)
at com.android.builder.internal.aapt.AbstractProcessExecutionAapt$1.onSuccess(AbstractProcessExecutionAapt.java:78)
at com.android.builder.internal.aapt.AbstractProcessExecutionAapt$1.onSuccess(AbstractProcessExecutionAapt.java:74)
at com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1237)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:399)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:911)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:822)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:664)
at com.google.common.util.concurrent.SettableFuture.set(SettableFuture.java:48)
at com.android.build.gradle.internal.process.GradleProcessExecutor$1.run(GradleProcessExecutor.java:58)
Caused by: org.gradle.process.internal.ExecException: Process 'command 'D:\android_sdk\Sdk\build-tools\26.0.2\aapt.exe'' finished with non-zero exit value 1
at org.gradle.process.internal.DefaultExecHandle$ExecResultImpl.assertNormalExitValue(DefaultExecHandle.java:380)
at com.android.build.gradle.internal.process.GradleProcessResult.assertNormalExitValue(GradleProcessResult.java:46)
... 9 more

<com.guanaj.easyswipemenulibrary.EasySwipeMenuLayout
    android:layout_width="match_parent"
    android:layout_height="wrap_content"
    app:contentView="@id/teeee">

    <TextView
        android:id="@+id/teeee"
        android:layout_width="match_parent"
        android:layout_height="wrap_content"
        android:text="112233" />

</com.guanaj.easyswipemenulibrary.EasySwipeMenuLayout>

   这是我的布局文件 不知道存在什么问题么

<com.guanaj.easyswipemenulibrary.EasySwipeMenuLayout
    android:layout_width="match_parent"
    android:layout_height="34dp"
    app:contentView="@id/content_ll"
    app:rightMenuView="@id/right"

    >

    <LinearLayout
        android:id="@+id/content_ll"
        android:layout_width="match_parent"
        android:layout_height="match_parent"
        android:orientation="horizontal">

        <TextView
            android:id="@+id/item_dot_time_tv"
            android:layout_width="wrap_content"
            android:layout_height="wrap_content"
            android:layout_gravity="center_vertical"
            android:layout_marginLeft="8dp"
            android:text="00:00.00"
            android:textColor="@color/color_969696"
            android:textSize="12dp" />

        <TextView
            android:id="@+id/item_dot_content_tv"
            android:layout_width="wrap_content"
            android:layout_height="wrap_content"
            android:layout_gravity="center_vertical"
            android:layout_marginLeft="13dp"
            android:text="化学方程式易错点解析"
            android:textColor="@color/color_8c94a7"
            android:textSize="12dp" />
    </LinearLayout>

    <LinearLayout
        android:id="@+id/right"
        android:layout_width="92dp"
        android:layout_height="match_parent"
        android:background="@color/color_3b3b40"
        android:orientation="horizontal">

        <TextView
            android:id="@+id/item_set_tv"
            android:layout_width="wrap_content"
            android:layout_height="wrap_content"
            android:layout_gravity="center_vertical"
            android:layout_weight="1"
            android:gravity="center"
            android:text="编辑"
            android:textColor="@color/color_ffffff" />

        <View
            android:layout_width="1dp"
            android:layout_height="19dp"
            android:layout_gravity="center"
            android:background="@color/color_707070" />

        <TextView
            android:id="@+id/item_delete_tv"
            android:layout_width="wrap_content"
            android:layout_height="wrap_content"
            android:layout_gravity="center_vertical"
            android:layout_weight="1"
            android:gravity="center"
            android:text="删除"
            android:textColor="@color/color_fe5a49" />
    </LinearLayout>
</com.guanaj.easyswipemenulibrary.EasySwipeMenuLayout>

这样写也报同样的错误

app:contentView="@+id/teeee"  改成这样就可以了哦，感谢您的反馈

repo: anzaizai/EasySwipeMenuLayout


text:
Updated $addField (v5)

Added Index field.
Updated usage.
Added example image.

Solve the merge conflicts!

The function has already been updated for v5 by the Dev's. So you can close this pr. Thanks for your efforts.

Conflicts and already updated.

authors: DevMike123 Leref aumansh

repo: aoijs/documentation


text:
Add a Java 9 style Iterate Predicate operator to ReactiveSeq and Spouts

ReactiveSeq for sychronous Streams
Spouts for async Streams
e.g. to Iterate from 0 to 10 (exclusive of 10)
Spouts.iterate(0,i->i<10,i->i+1)

Released in 2.0.0-MI3

repo: aol/cyclops-react


text:
Additional Header Fields

Add additional index fields for protocol header fields:
IP version, IP header length, IP ID, IP flags, TTL, Embedded Protocol
TCP Header Length, TCP Flags, Checksum, Urgent Pointer
UDP: Length, Checksum
ICMP: Message Type, Message Code, Checksum

to throw my hat in the ring, icmp codes would be pretty useful to have (echo vs ttl exceeded vs echo reply)

authors: JeffSoh paulpc

repo: aol/moloch


text:
Rollback

The Backup feature is enhanced such that it can export settings, mappings, templates, and aliases in addition to documents.

A Rollback feature is implemented to restore settings, mappings, templates, and documents of a specific DB version.

Thank you for submitting this pull request, however I do not see a valid CLA on file for you. Before we can merge this request please visit https://yahoocla.herokuapp.com/ and agree to the terms. Thanks! :smile:

authors: codesniffer yahoocla


text:
Remove deprecated api versions "extensions/v1beta1"

"v1beta1" has been deprecated since K8s version 1.16.
https://kubernetes.io/blog/2019/07/18/api-deprecations-in-1-16/
There are still references to this version in hdfs charts. Deploying the hdfs helm chart throws the following error:
Error: validation failed: [unable to recognize "": no matches for kind "DaemonSet" in version "extensions/v1beta1", unable to recognize "": no matches for kind "Deployment" in version "extensions/v1beta1", unable to recognize "": no matches for kind "StatefulSet" in version "apps/v1beta1"]

duplicate of https://github.com/apache-spark-on-k8s/kubernetes-HDFS/issues/81


text:
Python driver unable to build from source

Describe the bug
When building from source (following instructions in Readme) it says
Exception: Could not deserialize ATN with version ♥ (expected 4)
Unable to build when package antlr4-python3-runtime installed is version 4.10 or above
The issue was also referred in apache-age-python PyPi package repository rhizome-ai/apache-age-python#18
How are you accessing AGE (Command line, driver, etc.)?

Command line
Python Driver

What data setup do we need to do?

Install all required packages given in setup.py or Readme (psycopg2 and antlr4-python3-runtime)

What is the necessary configuration info needed?

Install antlr4-python3-runtime version 4.10 or above to test the error

What is the command that caused the error?
python setup.py install

Traceback (most recent call last):
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\setup.py", line 17, in <module>
    from age import VERSION
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\age\__init__.py", line 16, in <module>
    from . import age
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\age\age.py", line 22, in <module>    from .builder import ResultHandler , parseAgeValue, newResultHandler
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\age\builder.py", line 16, in <module>
    from .gen.AgtypeLexer import AgtypeLexer
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\age\gen\AgtypeLexer.py", line 106, in <module>
    class AgtypeLexer(Lexer):
  File "C:\Users\hunai\Desktop\AGE\age\drivers\python\age\gen\AgtypeLexer.py", line 108, in AgtypeLexer
    atn = ATNDeserializer().deserialize(serializedATN())
  File "C:\Users\hunai\AppData\Local\Programs\Python\Python310\lib\site-packages\antlr4\atn\ATNDeserializer.py", line 28, in deserialize
    self.checkVersion()
  File "C:\Users\hunai\AppData\Local\Programs\Python\Python310\lib\site-packages\antlr4\atn\ATNDeserializer.py", line 50, in checkVersion
    raise Exception("Could not deserialize ATN with version " + str(version) + " (expected " + str(SERIALIZED_VERSION) + ").")
Exception: Could not deserialize ATN with version ♥ (expected 4).

Expected behavior
Should be able to successfully build from source.
Environment (please complete the following information):

Version: 1.1.0

Documentation of apache-age-python package should also be updated.

@dehowef Can you take a look as you have been working on the Python driver?

Hello, yeah this is an issue with the Python driver. You need a specific version of ANTLR for it to work-- I think the version is 4.9.2. It's in the documentation, you have to use:
pip install antlr4-python3-runtime==4.9.2
Hope this helps
@jrgemignani @Hunaid2000

Thanks for your reply @dehowef.
How about if we move all dependencies/packages to requirements.txt file? It would make it easier for user to install all packages with one line and give developers more control over required packages (along with their required versions). Any guidance on this would be helpful.
I submitted a PR (mentioned in my earlier comment) that contains following changes:

Resolves this issue (with requirements.txt)
Fixed typo in exceptions.py
Fix ambiguity in README (giving user instruction to run tests and then cloning the repo. Should have been opposite)

@dehowef Kindly have look into it and let me know if I should close this issue and PR now.

Resolved in #389.

authors: Hunaid2000 dehowef jrgemignani

repo: apache/age


text:
Ambari 23087 branch feature ambari 14714 ui

What changes were proposed in this pull request?
Initial framework for the mpack upgrade wizard.
How was this patch tested?
20402 passing (21s)
46 pending

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/948/
Test FAILed.
Test FAILured.

authors: asfgit ishanbha

repo: apache/ambari


text:
[AMORO_3053]Add system metric for ams service

Why are the changes needed?

Close https://github.com/apache/amoro/issues/3053.
Brief change log

collect system metric for jvm  using api from jdk
it's refer from flink jvm system metric https://github.com/apache/flink/blob/af7d2b3ab0e0ecc4157005704bebac9c767f2e1a/flink-runtime/src/main/java/org/apache/flink/runtime/metrics/util/MetricUtils.java#L129
register metric in AmoroServiceContainer  during start ams httpserver by using amoro metric plugin

How was this patch tested?

[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

[ ] Add screenshots for manual tests if appropriate

[ ] Run test locally before making a pull request

I had test HEAP_USED,HEAP_COMMITTED,HEAP_MAX,THREADS_COUNT ,the count collected by jdk api is meet expectations
But I'm not sure  the number of CPU_LOAD and CPU_TIME collected by jdk api is equals to the number collect from machinery system
Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

Another question I have here is whether these metrics should also be improved when we use different GC recyclers, such as G1

Another question I have here is whether these metrics should also be improved when we use different GC recyclers, such as G1

Another question I have here is whether these metrics should also be improved when we use different GC recyclers, such as G1

    for (final GarbageCollectorMXBean garbageCollector : garbageCollectorMXBeans) {
      MetricDefine count = formatGarbageCollectorMetricDefine(garbageCollector.getName(), "count");
      MetricDefine time = formatGarbageCollectorMetricDefine(garbageCollector.getName(), "time");
      registerMetric(
          registry,
          count,
          (org.apache.amoro.api.metrics.Gauge<Long>) () -> garbageCollector.getCollectionCount());
      registerMetric(
          registry,
          time,
          (org.apache.amoro.api.metrics.Gauge<Long>) () -> garbageCollector.getCollectionTime());
    }
  }

Another question I have here is whether these metrics should also be improved when we use different GC recyclers, such as G1

from  List will get  all the GarbageCollector
and garbageCollector.getName() can get the name of GarbageCollector
if use G1 Collect, the garbageCollectorName will be  G1 Young and G1 Old
 List<GarbageCollectorMXBean> garbageCollectorMXBeans =
        ManagementFactory.getGarbageCollectorMXBeans();

    for (final GarbageCollectorMXBean garbageCollector : garbageCollectorMXBeans) {
      MetricDefine count = formatGarbageCollectorMetricDefine(garbageCollector.getName(), "count");
      MetricDefine time = formatGarbageCollectorMetricDefine(garbageCollector.getName(), "time");
      registerMetric(
          registry,
          count,
          (org.apache.amoro.api.metrics.Gauge<Long>) () -> garbageCollector.getCollectionCount());
      registerMetric(
          registry,
          time,
          (org.apache.amoro.api.metrics.Gauge<Long>) () -> garbageCollector.getCollectionTime());
    }
  }

Thanks @baiyangtx @czy006
I had fix the comment, please take a look

Thanks for the contribution! @xieyi888
Thanks for the review! @czy006 @tcodehuber @baiyangtx

repo: apache/amoro


text:
[Docs]: translate the content under the general directory

Current State
Description of the current state/issue:
Translate the contents of the general directory, including:
join
submit-issue
security-guide
committer-guide
For documentation style and content specification, make sure to read 中文文档写作指南 first before submitting content.

Hi, I'd like to work on this and then open a PR.

repo: apache/apisix-website


text:
Add SessionContext::record_batches

Which issue does this PR close?
Closes #9157

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

CI failure seems unrelated -- I retriggered it

Thanks for this :+1:

authors: Jefffrey Lordworms alamb

repo: apache/arrow-datafusion


text:
fix docs deployment

Fixup https://github.com/apache/arrow-rs/pull/4436
Mainly refered to opendal's action https://github.com/apache/incubator-opendal/blob/7ede1bdc0849905a5b140cf984481adca05dc1b3/.github/workflows/docs.yml
Tested on my fork https://github.com/xxchan/arrow-rs/tree/asf-site  (the asf-site branch might need to be manually created first). Not 100% sure the url works correctly though.
Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

@alamb  PTAL

BTW it appears to be working well: https://arrow.apache.org/rust/

However, I think the main docs page should probably still point at the crate.io page for the released version. I will make a PR for that

Proposed follow on : https://github.com/apache/arrow-rs/pull/4461

authors: alamb xxchan

repo: apache/arrow-rs


text:
pyarrow latest parquet map column type isn't supported

Hello
When I trying read parquet file with  column of type map, pyarrow.lib.ArrowNotImplementedError: lists with structs are not supported. exception is throws.
Seems like this was fixed here https://github.com/apache/arrow/pull/1530, and only release is required?

No, this would also require https://github.com/apache/parquet-cpp/pull/462

Assistance with this would be much appreciated. Unfortunately we haven't been able to get this done in time for 0.10, so it will have to be later this year

No It has not yet been implemented

@damache would anyone from IBM like to get involved with Parquet development? We could really use the help.

authors: den-rifiniti wesm xhochy

repo: apache/arrow


text:
[Docs][Format] Move IPC format spec back into a separate page

Describe the enhancement requested
Some time ago the IPC specification was added to the main Arrow Columnar Format page (https://github.com/apache/arrow/pull/5202/files#diff-6569a570a17ffd52bbe0b4f58cc6da2610ede6ac9c9d0771f46a01e80202946e). We could split this content again adding the IPC content back to a separate page, reasoning:

new content is planned to be added to the Arrow Columnar Format page making it harder to navigate through as it is becoming quite heavy with information
new parts of the specification also landed into separate pages, for example: C Data Interface, Flight, etc.

Component(s)
Documentation, Format

cc @jorisvandenbossche


text:
[C++][Parquet] Add version of LocalFileSource that uses memory-mapping for zero-copy reads

Repurposed this JIRA after PARQUET-533. Memory-mapping will save us memory allocations and performance in some applications. We could have it as an optional API.
Reporter: Wes McKinney / @wesm
Assignee: Wes McKinney](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=wesm) / @wesm
Note: This issue was originally created as PARQUET-520. Please see the migration documentation for further details.

Julien Le Dem / @julienledem:
Issue resolved by pull request 66
https://github.com/apache/parquet-cpp/pull/66

Wes McKinney / @wesm:
see patch: https://github.com/apache/parquet-cpp/pull/66


text:
ARROW-17517: [C++] Avoid exposing internal headers from engine/api.h

Also some assorted header inclusion cleanups.
Followup to PR #13965.

This is a crude way to solve the issue and some more elaborate solution could probably be pushed. @westonpace

@westonpace @aucahuasi Some engine maintainer should probably take this task up.

@westonpace I updated this to just contain the test additions and a few cleanups.

The LLVM deprecation errors are unrelated.


text:
ARROW-3012: [Python] Fix setuptools_scm usage

We were using a deprecated / unofficial API together with hand-written version parsing.
We can just pass a custom git tag regex instead.
Also, harden the fallback in setup.py when we're not in a git clone (typically when running pip install, as pip always copies the project directory before acting on it).
Include a clear error message when not able to infer the Arrow version, to let people
know how to workaround the issue.
pip-installing source distributions should now work fine (and get the right version
number).

it turns out that this fails if a more recent JS tag is defined:
$ python setup.py sdist
/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/distutils/dist.py:261: UserWarning: Unknown distribution option: 'long_description_content_type'
  warnings.warn(msg)
/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/version.py:92: UserWarning: tag 'apache-arrow-js-0.9.9' no version found
  warnings.warn("tag %r no version found" % (tag,))
Traceback (most recent call last):
  File "setup.py", line 557, in <module>
    url="https://arrow.apache.org/"
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools/__init__.py", line 129, in setup
    return distutils.core.setup(**attrs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/distutils/core.py", line 108, in setup
    _setup_distribution = dist = klass(attrs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools/dist.py", line 333, in __init__
    _Distribution.__init__(self, attrs)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/distutils/dist.py", line 281, in __init__
    self.finalize_options()
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools/dist.py", line 476, in finalize_options
    ep.load()(self, ep.name, value)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/integration.py", line 23, in version_keyword
    dist.metadata.version = get_version(**value)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/__init__.py", line 135, in get_version
    parsed_version = _do_parse(config)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/__init__.py", line 88, in _do_parse
    config, "setuptools_scm.parse_scm"
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/__init__.py", line 45, in _version_from_entrypoint
    version = _call_entrypoint_fn(config, ep.load())
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/__init__.py", line 33, in _call_entrypoint_fn
    return fn(config.absolute_root, config=config)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/git.py", line 134, in parse
    return meta(tag, config=config, node=node, dirty=dirty, branch=branch)
  File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.6/site-packages/setuptools_scm/version.py", line 196, in meta
    assert parsed_version is not None, "cant parse version %s" % tag
AssertionError: cant parse version apache-arrow-js-0.9.9

Codecov Report

Merging #2413 into master will increase coverage by 2.11%.
The diff coverage is 50%.

@@            Coverage Diff             @@
##           master    #2413      +/-   ##
==========================================
+ Coverage    84.8%   86.92%   +2.11%
==========================================
  Files         296      237      -59
  Lines       45646    42696    -2950
==========================================
- Hits        38711    37113    -1598
+ Misses       6890     5583    -1307
+ Partials       45        0      -45

Impacted Files
Coverage Δ

python/pyarrow/__init__.py
83.87% <50%> (+9.22%)
:arrow_up:

go/arrow/array/bufferbuilder.go

go/arrow/datatype_nested.go

go/arrow/array/data.go

go/arrow/type_string.go

go/arrow/math/int64_avx2_amd64.go

rust/src/datatypes.rs

go/arrow/datatype_binary.go

go/arrow/datatype_fixedwidth.go

go/arrow/array/bufferbuilder_numeric.gen.go

... and 50 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6e5bfe2...2a93f9c. Read the comment docs.

I re-added a minimal parse wrapper to solve the JS tag issue.

authors: codecov-io pitrou


text:
GH-35081: [Python] Remove usage of pandas internals DatetimeTZBlock

Rationale for this change
This usage probably stems from a long time ago that it was required to specify the Block type, but nowadays (and tested with pandas 1.0) it's good enough to just specify the dtype, and thus cutting down on our usage of internal pandas objects.
We only need to ensure the data passed is 2D, because it is always for a Block in a dataframe (not series), and otherwise it complains the placement doesn't match.
Part of #35081

Closes: #35081

@github-actions crossbow submit -g python

So it seems that pandas doesn't preserve the unit in the DatetimeArray constructor:
In [4]: arr = np.array([1, 2, 3], dtype="datetime64[s]")

In [5]: dtype = pd.DatetimeTZDtype("s", tz="Europe/Brussels")

In [6]: pd.arrays.DatetimeArray(arr, dtype)
Out[6]:
<DatetimeArray>
['1970-01-01 01:00:01+01:00', '1970-01-01 01:00:02+01:00',
 '1970-01-01 01:00:03+01:00']
Length: 3, dtype: datetime64[ns, Europe/Brussels]

This seems fixed on the last pandas release 2.1, so will have to keep the older code using internals for the older pandas versions.

@github-actions crossbow submit -g python

@github-actions crossbow submit -g python


text:
ARROW-4708: [C++] add multithreaded json reader

add Converter for conversion of arrays from the parser
add ChunkedArrayBuilder for multithreaded conversion of
arrays produced by BlockParser
extract BlockParser's builder management code into a separate
class
add serial and threaded implementations of TableReader for
parsing from an InputStream

@pitrou the sequel, unless you'd like me to break this one up as well

@bkietz Thank you. I've started looking into this. I may end the review this evening or tomorrow...

Thanks, this is super cool! I rebased https://github.com/apache/arrow/pull/4044 on top of this and tested it on some test data I have lying around and it is working well :)

A note for C++ developers -- if you are benchmarking anything that uses multiple threads you need to use UseRealTime with gbenchmark to get it to use wall clock time when reporting statistics, otherwise it will use CPU time

@wesm Did that fix the issue with weird benchmark numbers? What kind of numbers do we get now?

@pitrou yes it did. On the machine where I ran them the single-threaded benchmark showed ~80 MB/s while the multithreaded benchmark showed 130 MB/s.

authors: bkietz pcmoritz pitrou wesm


text:
Upgrade hadoop-yarn-api

Imported from Jira BEAM-7293. Original Jira may contain additional context.
Reported by: echauchot.
Subtask of issue #19519

hadoop-yarn-api is not a direct dependency of Apache Beam

authors: kennknowles lukecwik

repo: apache/beam


text:
[Bug]: Building website changes fails with proto issues

What happened?
When running ./beam/release/src/main/scripts/build_release_candidate.sh  per https://beam.apache.org/contribute/release-guide/#run-build_release_candidatesh-to-create-a-release-candidate, the script fails on website generation with the following error:
Processing ./target/.tox/.tmp/package/1/apache-beam-2.44.0.tar.gz
  Preparing metadata (setup.py) ... error

  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/usr/local/google/home/klk/website_update_dir/python_doc/beam/sdks/python/target/.tox/py38-docs/tmp/pip-req-build-0ht9l7p_/setup.py", line 180, in <module>
          generate_protos_first()
        File "/usr/local/google/home/klk/website_update_dir/python_doc/beam/sdks/python/target/.tox/py38-docs/tmp/pip-req-build-0ht9l7p_/setup.py", line 150, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/usr/local/google/home/klk/website_update_dir/python_doc/beam/sdks/python/target/.tox/py38-docs/tmp/pip-req-build-0ht9l7p_/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

Upthread, we also see
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
virtualenv 20.17.1 requires distlib<1,>=0.3.6, but you have distlib 0.3.1 which is incompatible.

This can be worked around by running python gen_protos.py as an intermediate step in the script before running tox -e py38-docs, which indicates this probably is a bug with gen_protos in other directories.
Issue Priority
Priority: 3 (minor)
Issue Components

[X] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

What tox version were you using?

I have encountered this issue before when I was trying to update tox to 4.x.x. Tox 4.x.x uses isolated builds by default and this could be the reason our generated pb_2 files and urn files are not getting copied to the sdist created by tox ( I might be totally wrong here) but the same code worked with tox 3.x in which our tox tasks didn't run on isolated builds.

I'd have to check the exact version, but it was definitely tox 4.x.x (which is what now gets installed by default in our local dev setup https://github.com/apache/beam/blob/62e9a1239bb6f9ef2f1469d0c1af192697f8b10c/local-env-setup.sh#L126)

Can we try to fix a tox version and investigate what is happening with tox 4.x and gen protos?

I have encountered this issue before when I was trying to update tox to 4.x.x. Tox 4.x.x uses isolated builds by default and this could be the reason our generated pb_2 files and urn files are not getting copied to the sdist created by tox ( I might be totally wrong here) but the same code worked with tox 3.x in which our tox tasks didn't run on isolated builds.
May be this could be a bug with gen_protos. If it is, we need to figure out what it is since it could be a blocker for #25123

I started to dig into it but this is where I stopped. I can pick it up after Python 3.11 work if its not resolved by then.

authors: AnandInguva damccorm


text:
[Feature Request]: Upgrade pandas to 2.x

What would you like to happen?
Recently Pandas released a new major version https://pypi.org/project/pandas/#files.
Update the Pandas bounds in setup.py
Issue Priority
Priority: 3 (nice-to-have improvement)
Issue Components

[ ] Component: Python SDK
[ ] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[ ] Component: IO connector
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

.take-issue

With pandas 2.0, from apache_beam.runners.interactive.interactive_runner import InteractiveRunner stops working with this error: AttributeError: type object 'Series' has no attribute 'append'. Did you mean: '_append'?

.take-issue

Pandas 2.0 removed the append method for both Series and Dataframe. I think we should do the same(remove append from deferred dataframes) but we need to provide alternatives with concat.
https://github.com/pandas-dev/pandas/issues/35407
cc: @robertwb

Let's track in https://github.com/apache/beam/issues/27221

authors: AnandInguva liferoad tvalentyn


text:
[BEAM-10073] Add pubsub performance tests results to the grafana dashboards

Add influx params to pubsub python performance tests.
Add grafana dashboard for pubsub tests.
R: @kamilwu

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
Post-Commit Tests Status (on master branch)

Lang
SDK
Apex
Dataflow
Flink
Gearpump
Samza
Spark

Go

---
---

---
---

Java

Python

---

---
---

XLang
---
---
---

---
---

Pre-Commit Tests Status (on master branch)

---
Java
Python
Go
Website

Non-portable

Portable
---

---
---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

Run Seed Job

Run PubsubIO Performance Test Python

Run PubsubIO Performance Test Python

Thanks, LGTM. We have to publish new images and add one more commit that updates image tags in deployment resource file. I will do it for you and merge afterwards.

Retest this please

Retest this please

Changes have been deployed to http://metrics.beam.apache.org

Thanks, LGTM. We have to publish new images and add one more commit that updates image tags in deployment resource file. I will do it for you and merge afterwards.

Sounds good to me.

authors: kamilwu piotr-szuberski


text:
[BEAM-646] Use Surgery in the Dataflow Runner

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

[x] Make sure the PR title is formatted like:
[BEAM-<Jira issue #>] Description of pull request
[x] Make sure tests pass via mvn clean verify. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
[x] Replace <Jira issue #> in the title with the actual Jira issue
number, if there is one.
[x] If this contribution is large, please file an Apache
Individual Contributor License Agreement.

Couple of cleanups and underlying PRs still have to be submitted prior to actual review.
I do want to use this PR to run some RunnableOnService Tests, though.

Run Dataflow RunnableOnService

Coverage decreased (-0.3%) to 68.911% when pulling 580243e046f19f0c86c1754869abe84b80c83a02 on tgroh:dataflow_runner_surgery into 9335738f044d3d3b779a5deec3240504bfaf2886 on apache:master.

Coverage decreased (-0.3%) to 68.886% when pulling b9742ca2981f29c600a86b81699e4435332d28ba on tgroh:dataflow_runner_surgery into 918c7fa3666e60343b86087c3450e77291b4d024 on apache:master.

Coverage decreased (-0.3%) to 68.879% when pulling b9742ca2981f29c600a86b81699e4435332d28ba on tgroh:dataflow_runner_surgery into 918c7fa3666e60343b86087c3450e77291b4d024 on apache:master.

Coverage decreased (-0.3%) to 68.877% when pulling 1229c97c550fead3127ea21602afd8811cf4a5cf on tgroh:dataflow_runner_surgery into 918c7fa3666e60343b86087c3450e77291b4d024 on apache:master.

Coverage decreased (-0.2%) to 68.945% when pulling 09e2278c7fcd7eac05727941f79132451906b5d5 on tgroh:dataflow_runner_surgery into eb59a1d23fb5b88a8cc59910af6445241266d3ec on apache:master.

Coverage decreased (-0.2%) to 69.07% when pulling 777ea60bb27a0b41695144fe4fb08d1f75005602 on tgroh:dataflow_runner_surgery into 154c543057b54ca46975cb9e9d360a52784518d7 on apache:master.

Run Dataflow RunnableOnService

Coverage decreased (-0.2%) to 69.061% when pulling 1af755fee465904ecab1d0b22d923fef59b50405 on tgroh:dataflow_runner_surgery into 2982238f7ae2aceb49f4acfa1ef2cf3ab9d21486 on apache:master.

Run Dataflow RunnableOnService

R: @kennknowles
This works now, less a RAT failure unrelated to the change (or at minimum WordCount does in both modes.)

Coverage decreased (-0.2%) to 69.074% when pulling 28caec1b7d935b135f26c444f2ab32ad1e920614 on tgroh:dataflow_runner_surgery into 0d639e63d635903df949a09186d1a6f2c0d9b0ae on apache:master.

Run Dataflow RunnableOnService

Changes Unknown when pulling df83ec3c4041951a7d1e7f478b458ecaa052b2f7 on tgroh:dataflow_runner_surgery into ** on apache:master**.

Coverage decreased (-0.2%) to 69.076% when pulling df83ec3c4041951a7d1e7f478b458ecaa052b2f7 on tgroh:dataflow_runner_surgery into fbaac0fc81d12ca63b35b0e1f9176660c5164275 on apache:master.

Code looks good, but I want to see what happens between now and green ROS. There's a possibility you'll need a new worker image.

Run Dataflow RunnableOnService

Run Dataflow RunnableOnService

Coverage decreased (-0.2%) to 69.084% when pulling 15e3c17cfbdb130d68b78572380b2672f64d08b2 on tgroh:dataflow_runner_surgery into 3a8ae530c443e2ff8cd5c361a6738d80534573e8 on apache:master.

@kennknowles PTAL (Dataflow ROS is green, woop woop)

LGTM pending changes just to @Ignore unit tests, which shouldn't materially change this PR.

Changes Unknown when pulling 3b0c64d04de9439c4898b563ede30e1ef25fbfee on tgroh:dataflow_runner_surgery into ** on apache:master**.

Changes Unknown when pulling 62e02c0af34182b5995dc4487f0c692d326b00ba on tgroh:dataflow_runner_surgery into ** on apache:master**.

Run Dataflow RunnableOnService

authors: coveralls kennknowles tgroh


text:
Cherry-pick of #2926 into Release-2.0.0 branch

R: @davorbonaci
Upgrades Bigtable to 0.9.6.2

Update commit description from "closes" to "cherry-picks".

authors: davorbonaci dhalperi


text:
Fix pr building of wheels

Same change as https://github.com/apache/beam/pull/32348/files - unfortunately I targeted that against the wrong branch 🙈

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

R: @Abacn


text:
Avoid returning empty splits.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Post-Commit Tests Status (on master branch)

Lang
SDK
Apex
Dataflow
Flink
Gearpump
Samza
Spark

Go

---
---

---
---
---

Java

Python

---

---
---

Pre-Commit Tests Status (on master branch)

---
Java
Python
Go
Website

Non-portable

Portable
---

---
---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

R: @boyuanzz

I would also assume that an error means that something went wrong and hence
the bundle processing may have been corrupted and hence cancelled/aborted.
I believe empty splits should be handled by the runner as a failed response.
On Wed, Jun 5, 2019 at 2:58 PM Boyuan Zhang notifications@github.com
wrote:

@boyuanzz commented on this pull request.
In sdks/python/apache_beam/runners/worker/bundle_processor.py
https://github.com/apache/beam/pull/8764#discussion_r290951996:

@@ -638,6 +638,9 @@ def try_split(self, bundle_split_request):
last_primary_element=primary_end,
first_residual_element=residual_start)])

if not split_response.channel_splits:

 raise ValueError('Unable to find an effective split.')

Just curious why we treat empty split as a value error? From my
understanding, the split should be somehow best-effort, not a guaranteed
request.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/apache/beam/pull/8764?email_source=notifications&email_token=ACM4V3GOBMJ3NFHNVY7OBRDPZAZGXA5CNFSM4HTXBZN2YY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOB2W66NA#pullrequestreview-246279988,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACM4V3F36OIUHIA6LTGNJSLPZAZGXANCNFSM4HTXBZNQ
.

Throughout the worker stack, the inability to split is treated as an error. This is probably because there's no other way to represent "no split" as there is in these protos (it's a StatusOr).
The corollary is that the system must handle errors properly, i.e. the entire bundle will still be processed on any failure here (which is what SDKs do now). If an attempt to split puts the SDK in a state where it cannot do that, an error must be returned on the bundle processing channel.
I'm making the dataflow runner accept (and ignore) this for the moment, but the desired semantic should be clarified and documented here.

Thats a good point, it would make sense that the Runner would honor bundle completion/failure based upon the ProcessBundleResponse regardless of whether any of the other dependent bundle processing calls succeed/fail. For example, if accessing a side input fails, should this fail the bundle? (no in my opinion).

What's next on this PR?

We've worked around this in the dataflow worker, but I think this change still makes sense.

authors: lukecwik robertwb tvalentyn


text:
[BEAM-7650] Add docker system prune to inventory job

The Inventory job already runs once daily on each machine, which is
ideal for this task.
Using the inventory job for a maintenance task since I didn't want to
create 16 new Jenkins jobs.

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Post-Commit Tests Status (on master branch)

Lang
SDK
Apex
Dataflow
Flink
Gearpump
Samza
Spark

Go

---
---

---
---

Java

Python

---

---
---

Pre-Commit Tests Status (on master branch)

---
Java
Python
Go
Website

Non-portable

Portable
---

---
---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

run seed job

run inventory beam1

run inventory apache-beam-jenkins-1

R: @yifanzou (still waiting for machine inventory test job to run)

run inventory apache-beam-jenkins-11

run seed job

run inventory apache-beam-jenkins-12

Successful run log: https://builds.apache.org/job/beam_Inventory_apache-beam-jenkins-11/83/consoleFull

LGTM. Thanks, Udi!

authors: udim yifanzou


text:
Add timed activity (or similar) for waiting for buildbox-casd

See original issue on GitLab
In GitLab by [Gitlab user @chiaratolentino] on May 5, 2020, 14:56
Background
As discussed in !1889, with the longer buildbox-casd timeout period, we should have some way of telling users what's going on (e.g. a timed activity or periodic status telling the user that we're still waiting for buildbox-casd to start) without generating too much noise.
See:

https://gitlab.com/BuildStream/buildstream/-/merge_requests/1889#note_333881011
https://gitlab.com/BuildStream/buildstream/-/merge_requests/1889#note_336027502

Acceptance Criteria
Users must get some kind of feedback/message to tell them when we're waiting on buildbox-casd to start

In GitLab by [Gitlab user @tristanvb] on Nov 6, 2020, 08:12
marked this issue as related to #1261

In GitLab by [Gitlab user @tristanvb] on Nov 6, 2020, 08:13
marked this issue as related to #1029

repo: apache/buildstream