text:
How can I get all of a Youtube's Channel's Videos in a file?

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm asking a question and not reporting a bug or requesting a feature
[X] I've looked through the README
[X] I've verified that I'm running yt-dlp version 2023.03.04 (update instructions) or later (specify commit)
[X] I've searched known issues and the bugtracker for similar questions including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Please make sure the question is worded well enough to be understood
I want to download an entire channel's video links to a file to download later using the -a arg
the other explanations I found were for downloading directly or outdated.
PS: I had this answered, but I issued it as a bug and now the answer is gone.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
[debug] Command-line config: ['-vU']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2023.03.04 [392389b7d] (pip)
[debug] Python 3.11.3 (CPython AMD64 64bit) - Windows-10-10.0.19045-SP0 (OpenSSL 1.1.1t  7 Feb 2023)
[debug] exe versions: ffmpeg 6.0-essentials_build-www.gyan.dev (setts), ffprobe 6.0-essentials_build-www.gyan.dev, phantomjs 2.1.1
[debug] Optional libraries: Cryptodome-3.18.0, brotli-1.0.9, certifi-2023.05.07, mutagen-1.46.0, sqlite3-2.6.0, websockets-11.0.3
[debug] Proxy map: {}
[debug] Loaded 1786 extractors
[debug] Fetching release info: https://api.github.com/repos/yt-dlp/yt-dlp/releases/latest
Available version: stable@2023.03.04, Current version: stable@2023.03.04
yt-dlp is up to date (stable@2023.03.04)

yt-dlp --flat-playlist --print-to-file webpage_url "TEXT_FILE.txt" "CHANNEL_URL"

replace CHANNEL_URL with the actual URL, e.g. https://www.youtube.com/@LinusTechTips/videos
replace TEXT_FILE.txt with your desired filename


text:
How to force a conversion to a specific video codec?

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm asking a question and not reporting a bug or requesting a feature
[X] I've looked through the README
[X] I've verified that I'm running yt-dlp version 2023.07.06 (update instructions) or later (specify commit)
[X] I've searched known issues and the bugtracker for similar questions including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Please make sure the question is worded well enough to be understood
yt-dlp supports a conversion to a specific video format using --recode-video mp4.
It would be nice to also specify the codecs since the format alone can produce a bit of arbitrary results and may still produce an incompatible file.
But how do I force a conversion to a specific video codec of the best available video if the codec is not already available but the format is?
Is there any way to force a ffmpeg postprocessor that replaces the video file?
I'm currently facing the problem that I can't fully support h265 (only h264 / libx264) and TikToks best formats are sometimes only available in h265. How do I download the best resolution and convert it to h264?
yt-dlp -S "res:1080,vcodec:h264,fps"  --recode-video mp4 --id -- 'https://www.tiktok.com/@feuerwehr_eschau/video/7254996214456864027'
# result: best video but H.265, no recode happening because already mp4

yt-dlp -S "res:1080,vcodec:h264,fps"  -f "bv[vcodec=h264]" --recode-video mp4 --id -- 'https://www.tiktok.com/@feuerwehr_eschau/video/7254996214456864027'
# ERROR: ... Requested format is not available.

yt-dlp -S "res:1080,vcodec:h264,fps"  -f "all[vcodec=h264]"  --recode-video mp4 --id -- 'https://www.tiktok.com/@feuerwehr_eschau/video/7254996214456864027'
# result: H.264 but not best video, no recode happening because already mp4

yt-dlp -S "res:1080,vcodec:h264,fps"  --postprocessor-args "VideoConvertor:-vcodec libx264 "  --recode-video mp4 --id -- 'https://www.tiktok.com/@feuerwehr_eschau/video/7254996214456864027'
# result: best video but H.265
# this should result in H.264, but VideoConvertor is skipped because already mp4

Provide verbose output that clearly demonstrates the problem

[ ] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[ ] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
No response

--use-postprocessor FFmpegCopyStream --ppa CopyStream:"-c:v libx264 -c:a aac -f mp4" recodes to h264+aac in mp4 etc, but there is currently no straightforward way.

Another hack is --remux mkv --recode mp4, but above method's better

For anyone trying to get the final output video converted to specific format using python script, try this:
ydl_opts = {
        # <existing options>
        "postprocessors": [
            # <other postprocessors>
            {"key": "FFmpegCopyStream"},
        ],
        "postprocessor_args": {
            "copystream": [
                "-c:v", "libx264", "-c:a", "ac3"
            ],
        },
    }

with YoutubeDL(ydl_opts) as ydl:
        ydl.download([url])

This will make yt-dlp use FFmpefCopyStream postprocessor to convert the output video to desired format by passing in the additional args to ffmpeg during conversion.

https://github.com/yt-dlp/yt-dlp/issues/11668#issuecomment-2508631577

The above proposal:

With --recode-video ..., the option value specifies a certain required container type, with whatever required media conversion, and there isn't a way to be more specific.
For cases like this the option syntax might be extended to specify, optionally, a required codec, compatible with the specified container by ext, say a semicolon-separated string of type:codec where type can be one of a, v, s and codec is a name as defined in ffmpeg -encoders for that type. In this case --recode-video mp4;v:h264 would be wanted.
A wild-card ext, meaning "the expected container ext" might also be supported, say @ (character that is generally not significant to a shell and also not used in codec names, or * or any) when specifying a codec: then --recode-video @;v:h264.

Currently AFAIU the --recode-video option only knows that it has to convert video to xvid for AVI targets. It could be taught about some of the newer constraints between known video codecs and known (container) formats, which would reduce the need for conversions to be specified explicitly.
And #126.

source: gharchive/issue

authors: UNCode101 bashonly dirkf niklas-englert pukkandan

repo: yt-dlp/yt-dlp

license: Unlicense

license_type: permissive

license_source: github-api


text:
(ok.ru) HTTP Error 400: Bad Request

[X] I'm reporting a broken site support
[X] I've verified that I'm running youtube-dl version 2021.04.17
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://ok.ru/video/381828403604']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.04.17
[debug] Python version 3.8.6 (CPython) - Linux-5.8.0-50-generic-x86_64-with-glibc2.32
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1, rtmpdump 2.4
[debug] Proxy map: {}
[Odnoklassniki] 381828403604: Downloading webpage
[Odnoklassniki] 381828403604: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 400: Bad Request
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://vd297.mycdn.me/?expires=1618913293719&srcIp=XXX.XXX.XXX.XXX&srcAg=CHROME&ms=185.226.53.6&type=5&sig=2Q7MMATljB8&ct=4&urls=185.226.52.6&clientType=0&id=358157257424'
ERROR: unable to download video data: HTTP Error 400: Bad Request
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1967, in process_info
success = dl(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1906, in dl
return fd.download(name, info)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/common.py", line 366, in download
return self.real_download(filename, info_dict)
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/http.py", line 351, in real_download
establish_connection()
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/http.py", line 116, in establish_connection
raise err
File "/usr/local/bin/youtube-dl/youtube_dl/downloader/http.py", line 110, in establish_connection
ctx.data = self.ydl.urlopen(request)
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2279, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.8/urllib/request.py", line 531, in open
response = meth(req, response)
File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
response = self.parent.error(
File "/usr/lib/python3.8/urllib/request.py", line 569, in error
return self._call_chain(*args)
File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
result = func(*args)
File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request
<

Description
I've got this error when downloading from OK.RU,
Tested it on windows and it works great...
Tried ipv4, ipv6, proxy, geo restrictions, no help, still same problem
BR

You must provide reproducible environment.

repo: ytdl-org/youtube-dl


text:
Error 503 while downloading https://www.france.tv/france-2/meurtres-au-paradis/meurtres-au-paradis-saison-11/3352060-dans-le-noir.html json (to be fixed soon as the video is available only during 7 days)

Just performed curl -L https://yt-dl.org/downloads/latest/youtube-dl -o /usr/bin/youtube-dl today and tried to download the video.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--embed-subs', '--embed-thumbnail', 'https://www.france.tv/france-2/meurtres-au-paradis/meurtres-au-paradis-saison-11/3352060-dans-le-noir.html', '--all-subs', '-v']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.9.12 (PyPy version 7.3.9) - Linux-3.18.115-17011592-aarch64-with-glibc2.35.9000
[debug] exe versions: none
[debug] Proxy map: {}
[FranceTVSite] 3352060-dans-le-noir: Downloading webpage
[FranceTV] 698392b7-ae1d-40b6-876d-d5fb5d40da54: Downloading video JSON
ERROR: Unable to download JSON metadata: HTTP Error 503: Service Unavailable (caused by <HTTPError 503: 'Service Unavailable'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/bin/youtube-dl/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib64/pypy3.9/urllib/request.py", line 523, in open
    response = meth(req, response)
  File "/usr/lib64/pypy3.9/urllib/request.py", line 632, in http_response
    response = self.parent.error(
  File "/usr/lib64/pypy3.9/urllib/request.py", line 561, in error
    return self._call_chain(*args)
  File "/usr/lib64/pypy3.9/urllib/request.py", line 494, in _call_chain
    result = func(*args)
  File "/usr/lib64/pypy3.9/urllib/request.py", line 641, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)

Please note the video is available for download for free when using the official Android app. But the feature requires non rooted devices.

Duplicate of #29956.
Try yt-dlp for your immediate needs. The necessary fix needs to be back-ported but this is not completely trivial.

authors: dirkf ytrezq


text:
ERROR: Unable to extract uploader id;

hello，everyone！
this bug not fix ，  youtube-dl.exe in window， or sudo -H pip install --upgrade youtube-dl ，the error again！
ERROR: Unable to extract uploader id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

#30839


text:
not downloading video from youtube.

todays master(2024-07-24-12:00) branch tarball.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', '-F', 'https://www.youtube.com/watch?v=sRb_-MsdjaM']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python 3.11.9 (CPython x86_64 64bit) - Linux-6.9.10-x86_64-Intel-R-Core-TM-i7-6700K_CPU@4.00GHz-with-glibc2.39 - OpenSSL 3.3.1 4 Jun 2024 - glibc 2.39
[debug] exe versions: ffmpeg 6.1.1, ffprobe 6.1.1
[debug] Proxy map: {}
[youtube] sRb-MsdjaM: Downloading webpage
[youtube] sRb-MsdjaM: Downloading player 3400486c
ERROR: Unable to extract nsig function code (caused by RegexNotFoundError('Unable to extract Initial JS player n function name; please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.')); please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.
Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1637, in _decrypt_nsig
jsi, player_id, func_code = self._extract_n_function_code(video_id, player_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1686, in _extract_n_function_code
func_name = self._extract_n_function_name(jscode)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1660, in _extract_n_function_name
func_name, idx = self._search_regex(
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/common.py", line 1101, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player n function name; please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.
Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1637, in _decrypt_nsig
jsi, player_id, func_code = self._extract_n_function_code(video_id, player_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1686, in _extract_n_function_code
func_name = self._extract_n_function_name(jscode)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1660, in _extract_n_function_name
func_name, idx = self._search_regex(
^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/common.py", line 1101, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract Initial JS player n function name; please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.11/site-packages/youtube_dl/YoutubeDL.py", line 875, in wrapper
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/YoutubeDL.py", line 971, in __extract_info
ie_result = ie.extract(url)
^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/common.py", line 571, in extract
ie_result = self._real_extract(url)
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 2104, in _real_extract
self._unthrottle_format_urls(video_id, player_url, dct)
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1721, in _unthrottle_format_urls
n_response = decrypt_nsig(n_param)(n_param, video_id, player_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1614, in inner
raise ret
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1606, in inner
self._player_cache[cache_id] = func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/site-packages/youtube_dl/extractor/youtube.py", line 1639, in _decrypt_nsig
raise ExtractorError('Unable to extract nsig function code', cause=e)
youtube_dl.utils.ExtractorError: Unable to extract nsig function code (caused by RegexNotFoundError('Unable to extract Initial JS player n function name; please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.')); please report this issue on https://github.com/ytdl-org/youtube-dl/issues , using the appropriate issue template. Make sure you are using the latest version; see  https://github.com/ytdl-org/youtube-dl/#user-content-installation  on how to update. Be sure to call youtube-dl with the --verbose option and include the complete output.

The problem has been solved here but I'll let the commit close this issue.

I have the latest code from the repo, and I'm still getting the error for player 13400486c'

I think what was meant was "once the issue is solved, it will close this issue as well" implying it is not solved yet. (which yes it is still broken for me, which is no wonder since the repo hasnt been updated yet)

If you're desperate, apply the linked patch.

Sorry, I misunderstood.  You linked to a closed issue, so I assumed that meant the patch had been applied.  The patch you linked to does work fine, after manually applying it.

A nightly build with the fix should appear in the next few hours.

authors: GregoriusT dirkf ferdna stephen-czetty


text:
[extractor/mtv] Fix mgid extraction

Please follow the guide below

Before submitting a pull request make sure you have:

[x] Searched the bugtracker for similar pull requests
[x] Read adding new extractor tutorial
[x] Read youtube-dl coding conventions and adjusted the code to meet them
[x] Covered the code with tests (note that PRs without tests will be REJECTED)
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x]  Except for the commits by @kikuyan, @Sipherdrakon who separately agreed to either this or the below, I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[x] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
This PR supersedes #30149 which was orphaned when @kikuyan's account was deleted.
It improves extraction of the mgid value needed to access the MTV APIs.
It also fixes/improves utility functions to pass tests:

get the timestamp metadata field from the <airDate> element of the XML returned by the MTV feed API if the <pubDate> element was empty or missing;
make timeconvert() return int or None (not float).

Resolves #30139
Resolves #30678
Resolves #29814
Closes #30149 (superseded).

The feed_url may now be a JSON URL that needs to be found in the page and extracted separately: https://github.com/yt-dlp/yt-dlp/issues/4928#issuecomment-1264540725.

source: gharchive/pull-request


text:
Could not resolve file: index.html

I have come here impressed by the example page. It would be nice to add a troubleshooting section with solutions for common issues. For example, I found that the Unexpected token { error can be fixed by using a newer version of NodeJS. So now I'm on 16.11.1. But, more importantly...
I've been unable to get past this Could not resolve file: index.html error. I've tried:

Building a webpage from the files as found in SPMW 0.0.24.
Building a webpage from my own "hello world" equivalent.
Using various names for the Markdown, such as README.md and index.md.
Creating build/index.html and index.html in hopes it'll write to one of them.
Giving the directory 777 Unix permissions.
Removing the --open flag from the command found in the quick start guide.
Building stuff in packages/single-page-markdown-website.

It gets as far as copying the images into the build directory, but no HTML file ever appears.
I guess it's trying but failing to read what is ~/.npm/_npx/d2cf9fed93aa31b4/node_modules/@single-page-markdown-website/frontend/lib/index.html on my computer?

lol came here for the same reason. recommend adding it to instructions.

Running via npx should be fixed as of 0.0.25

authors: Frosty-J invictus2010 yuanqing

repo: yuanqing/single-page-markdown-website

license: MIT


text:
Add C++ implementation

C++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
上記の+の文字数って200文字あんねん

authors: Sgch yude

repo: yude/ahnmika-white


text:
hello

hello yuehniu
i have a question
i download your code,and build a project in SDx 2017.4
but i dont know which function should add in "Hardware Function"
if i put all functions which in ../src/fpga ,i will get lots of errors such as"SYNCHK 200-61: unsupported memory access on variable 'Out' which is (or contains) an array with unknown size at compile time."
which  function should add in "Hardware Function",and how to use your code?
looking forward to your reply,Thx~!^_^

hello yuehniu
i have a question
i download your code,and build a project in SDx 2017.4
but i dont know which function should add in "Hardware Function"
if i put all functions which in ../src/fpga ,i will get lots of errors such as"SYNCHK 200-61: unsupported memory access on variable 'Out' which is (or contains) an array with unknown size at compile time."
which function should add in "Hardware Function",and how to use your code?
looking forward to your reply,Thx~!^_^

I have encountered the same problem with you. Have you solved it?

Only fc_fpga() and conv_fpga() are needed to be added into "Hardware Function". Sorry for reply so late.

And what  are the meanings of these variables in fc_fpga.cpp/function fc_fpga? The variables are itils, otils, i_num, o_num and wtils.
Looking forward to your reply!

i_num is the number of inputs in fc layers; o_num is the number of outputs in fc_layers.
For itiles, otiles, and wtils, due to limited resources, the computing unit cannot do all the multiplication in one shot, meanwhile, the on-chip memory cannot hold all the input data (for example, there are 25088 inputs in the first fc layer in VGG16). Hence I divide input, output, and weight into small tiles, and compute tiles iteratively. If you go to "common.h", you can see there are two buffers in fc layer, one is for input, the other one is for output, they can reverse their role when computing next layer. The buffer depth is set to be 4096 and 1024, therefore, for 1st layer with 25088 inputs, I have to divide input into 25088/4096 ~= 7 itiles, for some layer with 4096 outputs, I have to divide output into 4096/1024 otiles. For "wtils", the computing units consist 64 parallel units calculating 64 multiplications with input. For a input tile with 4096 inputs, wtils = 4096 / 64 = 64.
Hope I've cleared my explanation. Do tell me if u still have confusions.

hello,I have a question.I would like to know if all the weights are on the buffer for a layer. I think the weight buffer cannot contain all the weights for the latter layers.
Looking forward to your reply!

authors: Sirius4105 SpinClown Wanghaoshu yuehniu

repo: yuehniu/embeddedCNN


text:
产品线建议增加接口test功能

在初始化产品时，salt-api和gitlab这一块希望单独出一份文档。在新建产品线时，增加saltpai和gitlab的正确性探测，这样对纠错的使用体验比较好

@vekergu 已经添加测试功能https://github.com/yueyongyue/saltshaker_api/pull/13

authors: vekergu yueyongyue


text:
Changes required to shade the yb-client dependencies

The build for CDCSDK server is failing due to dependency mismatch between the dependencies of yb-client and cdcsdk-server.

Closing this since the relevant commit has been merged in PR #105

authors: Sumukh-Phalgaonkar vaibhav-yb

repo: yugabyte/debezium-connector-yugabytedb


text:
Width/height adjustment

It'd be pretty nice to be able to customize the dimensions of the widget/graph!

With the way the plugin is currently set up I don't think its possible to add the width/height settings back.
Currently you can change the dimensions by holding alt and dragging the edges of the plugin, right click will set it back to default.

Wow, I had absolutely no idea this was a feature to begin with! This will definitely work as an alternative, thanks!


text:
outputs

The outputs of the scripts are not apparent from the readme of the repo. What is the set of things that may be returned from running the code?

Hi,
The CatE algorithm trains word and topic embeddings which will be saved in files specified by command line arguments -word-emb and -topic-emb, respectively. Also, the topic mining results (lists of terms retrieved for each topic) will be saved in the file specified by -res. You can refer to run.sh for examples.
Best,
Yu


text:
Fix two bugs

For details see commit logs.

Fix bug when remove empty local directoris

s/remove/removing/,  s/directoris/directories/,

Should delete deeper directories firstly. Old way delete higher directories firstly, which leads to cleaning up not completely

Should delete the deeper directories firstly. The old way to delete higher directories firstly leads to imcomplete clean-up.

ACK with the fixes.

Squashed commit of the following:
commit 1155e015108119f331c8f3b1826d863f6d159c7b
Author: ksellesk zhengdachuan200305@gmail.com
Date:   Sun Sep 11 21:43:39 2016 +0800
commands:mv: Fix bug when removing empty local directories

Should delete the deeper directories firstly. The old way to delete higher directories firstly leads to imcomplete clean-up.

commit 68b34a6d62f082a11300d74b7b4ce4263c962224
Author: ksellesk zhengdachuan200305@gmail.com
Date:   Sun Sep 11 21:00:47 2016 +0800
Fix bug when printing help pages

Squashed commit of the following:
commit 1155e015108119f331c8f3b1826d863f6d159c7b
Author: ksellesk zhengdachuan200305@gmail.com
Date:   Sun Sep 11 21:43:39 2016 +0800
commands:mv: Fix bug when removing empty local directories

Should delete the deeper directories firstly. The old way to delete higher directories firstly leads to imcomplete clean-up.

commit 68b34a6d62f082a11300d74b7b4ce4263c962224
Author: ksellesk zhengdachuan200305@gmail.com
Date:   Sun Sep 11 21:00:47 2016 +0800
Fix bug when printing help pages

authors: ksellesk osier prettyxw

repo: yunify/qsctl

license_source: bigquery


text:
[求助/Help] 物理机安装系统，新建裸金属 No resource are avaliable

物理机--安装系统-新建裸金属时报错如下 物理机直接有系统
web界面报错：
[
"No matching resources",
"{"error":{"code":400,"details":"Error #01: genericScheduler.Schedule: No resource are avaliable that match all of the following predicates: filter by baremetal_storage(-1), session_id=\"1704945871575\"\n","request":{"body":"{\"backup\":false,\"baremetal_disk_configs\":[{\"adapter\":0,\"conf\":\"none\",\"count\":1,\"driver\":\"MegaRaid\",\"...t\":96,\"vmem_size\":524288}","headers":{"Content-Length":"2325","Content-Type":"application/json","User-Agent":"yunioncloud-go/201708","X-Auth-Token":"*","X-Request-Id":"4d62d7-3efb21","X-Yunion-Lang":"zh-CN","X-Yunion-Parent-Id":"0.0","X-Yunion-Peer-Service-Name":"compute_v2","X-Yunion-Remote-Addr":"default-scheduler:30887","X-Yunion-Span-Id":"0.0.0","X-Yunion-Span-Name":"","X-Yunion-Strace-Debug":"true","X-Yunion-Strace-Id":"02fc7233"},"method":"POST","url":"https://default-scheduler:30887/scheduler\"}}}"
]
命令行工具调度历史报错如下：
climc  scheduler-history-show --log --raw 1704945871575
consuming: 0s
error: 'genericScheduler.Schedule: No resource are avaliable that match all of the
following predicates: filter by baremetal_storage(-1), session_id="1704945871575"'
input: '{"backup":false,"baremetal_disk_configs":[{"adapter":0,"conf":"none","count":1,"driver":"MegaRaid","range":[0],"type":"rotate"}],"best_effort":false,"change_config":false,"count":1,"details":false,"disks":[{"backend":"local","driver":"scsi","image_id":"6ea5b15d-e009-4984-860b-1d4c38ef3bab","image_properties":{"arch":"x86_64","disk_format":"qcow2","distro":"Ubuntu","installed_cloud_init":"true","is_lvm_partition":"false","is_readonly":"false","os_arch":"x86_64","os_distribution":"Ubuntu","os_language":"","os_type":"Linux","os_version":"20.04","partition_type":"gpt","uefi_support":"true","version":"20.04"},"index":0,"os_arch":"x86_64","size":15697920},{"backend":"local","driver":"scsi","index":0,"mountpoint":"/","size":-1}],"domain_id":"default","has_isolated_device":false,"host_mem_page_size":0,"hypervisor":"baremetal","live_migrate":false,"name":"test-131","nets":[{"bw_limit":1000,"domain_id":"default","driver":"virtio","exit":false,"index":0,"network":"ad5f3f8b-9675-4c37-8da9-95215648d1e7","num_queues":0,"private":false,"project_id":"bb7dc551694e467b8c1d5a4959cc7f8e","require_designated_ip":false,"require_teaming":false,"reserved":false,"rx_traffic_limit":0,"standby_addr_count":0,"standby_port_count":0,"try_teaming":false,"tx_traffic_limit":0,"vip":false}],"pending_usages":[{"brand":"OneCloud","cloud_env":"onpremise","count":1,"cpu":96,"deleted":false,"domain_id":"default","group":0,"hypervisor":"baremetal","isolated_device":0,"memory":524288,"provider":"OneCloud","region_id":"default","storage":15697919,"tenant_id":"bb7dc551694e467b8c1d5a4959cc7f8e","update_version":0,"zone_id":"2d80c45f-2110-48be-8fb7-54660d2edd5e"},{"brand":"OneCloud","bucket":0,"cache":0,"cloud_env":"onpremise","deleted":false,"domain_id":"default","eip":0,"eport":0,"instance_snapshot":0,"loadbalancer":0,"mongodb":0,"object_cnt":0,"object_gb":0,"port":1,"provider":"OneCloud","rds":0,"region_id":"default","snapshot":0,"tenant_id":"bb7dc551694e467b8c1d5a4959cc7f8e","update_version":0}],"prefer_host_id":"c5bf75a4-3abe-4f39-880c-2632a0508187","prefer_region_id":"default","prefer_zone_id":"2d80c45f-2110-48be-8fb7-54660d2edd5e","project_id":"bb7dc551694e467b8c1d5a4959cc7f8e","record_to_history":false,"resource_type":"shared","reuse_network":false,"suggestion":false,"suggestion_all":false,"suggestion_limit":100,"vcpu_count":96,"vmem_size":524288}'
output: ""
session_id: "1704945871575"
tasks:

capacity_map:
c5bf75a4-3abe-4f39-880c-2632a0508187:
MinValue: -1
Values:
baremetal_cpu:
Value: 1
baremetal_memory:
Value: 1
baremetal_status:
Value: 1
baremetal_storage:
Value: 0
consuming: 3.207487ms
data:
meta: null
ChangeConfig: false
HasIsolatedDevice: false
InstanceGroupsDetail: null
PendingUsages:

{}
{}
Raw: '{"backup":false,"baremetal_disk_configs":[{"adapter":0,"conf":"none","count":1,"driver":"MegaRaid","range":[0],"type":"rotate"}],"best_effort":false,"change_config":false,"count":1,"details":false,"disks":[{"backend":"local","driver":"scsi","image_id":"6ea5b15d-e009-4984-860b-1d4c38ef3bab","image_properties":{"arch":"x86_64","disk_format":"qcow2","distro":"Ubuntu","installed_cloud_init":"true","is_lvm_partition":"false","is_readonly":"false","os_arch":"x86_64","os_distribution":"Ubuntu","os_language":"","os_type":"Linux","os_version":"20.04","partition_type":"gpt","uefi_support":"true","version":"20.04"},"index":0,"os_arch":"x86_64","size":15697920},{"backend":"local","driver":"scsi","index":0,"mountpoint":"/","size":-1}],"domain_id":"default","has_isolated_device":false,"host_mem_page_size":0,"hypervisor":"baremetal","live_migrate":false,"name":"test-131","nets":[{"bw_limit":1000,"domain_id":"default","driver":"virtio","exit":false,"index":0,"network":"ad5f3f8b-9675-4c37-8da9-95215648d1e7","num_queues":0,"private":false,"project_id":"bb7dc551694e467b8c1d5a4959cc7f8e","require_designated_ip":false,"require_teaming":false,"reserved":false,"rx_traffic_limit":0,"standby_addr_count":0,"standby_port_count":0,"try_teaming":false,"tx_traffic_limit":0,"vip":false}],"pending_usages":[{"brand":"OneCloud","cloud_env":"onpremise","count":1,"cpu":96,"deleted":false,"domain_id":"default","group":0,"hypervisor":"baremetal","isolated_device":0,"memory":524288,"provider":"OneCloud","region_id":"default","storage":15697919,"tenant_id":"bb7dc551694e467b8c1d5a4959cc7f8e","update_version":0,"zone_id":"2d80c45f-2110-48be-8fb7-54660d2edd5e"},{"brand":"OneCloud","bucket":0,"cache":0,"cloud_env":"onpremise","deleted":false,"domain_id":"default","eip":0,"eport":0,"instance_snapshot":0,"loadbalancer":0,"mongodb":0,"object_cnt":0,"object_gb":0,"port":1,"provider":"OneCloud","rds":0,"region_id":"default","snapshot":0,"tenant_id":"bb7dc551694e467b8c1d5a4959cc7f8e","update_version":0}],"prefer_host_id":"c5bf75a4-3abe-4f39-880c-2632a0508187","prefer_region_id":"default","prefer_zone_id":"2d80c45f-2110-48be-8fb7-54660d2edd5e","project_id":"bb7dc551694e467b8c1d5a4959cc7f8e","record_to_history":false,"resource_type":"shared","reuse_network":false,"suggestion":false,"suggestion_all":false,"suggestion_limit":100,"vcpu_count":96,"vmem_size":524288}'
UserCred:
TokenCredential:
Context:
ip: 172.31.1.114
source: web
Domain: Default
DomainId: default
Expires: "2024-01-12T04:02:44Z"
ProjectDomain: Default
ProjectDomainId: default
RoleIds: a8b061b7e06b4c52851ea35cc02fb5ba
Roles: admin
Token: 5e995853a91f8db6c29f6c2a0645e19b095441f0b3cddcf84c1e620544a7b930
User: admin
UserId: a9dc45667b3844018b4f40933a23a3b3
tenant: system
tenant_id: bb7dc551694e467b8c1d5a4959cc7f8e
backup: false
baremetal_disk_configs:
adapter: 0
conf: none
count: 1
driver: MegaRaid
range:

0
size: null
splits: ""
type: rotate
best_effort: false
candidates:

c5bf75a4-3abe-4f39-880c-2632a0508187
cdrom: ""
count: 1
cpu_desc: ""
cpu_microcode: ""
cpu_mode: ""
details: false
disks:
backend: local
backup_id: ""
boot_index: null
cache: ""
disk_id: ""
disk_type: ""
driver: scsi
existing_path: ""
format: ""
fs: ""
image_encrypt_key_id: ""
image_id: 6ea5b15d-e009-4984-860b-1d4c38ef3bab
image_properties:
arch: x86_64
disk_format: qcow2
distro: Ubuntu
installed_cloud_init: "true"
is_lvm_partition: "false"
is_readonly: "false"
os_arch: x86_64
os_distribution: Ubuntu
os_language: ""
os_type: Linux
os_version: "20.04"
partition_type: gpt
uefi_support: "true"
version: "20.04"
index: 0
medium: ""
mountpoint: ""
nvme_device: null
os_arch: x86_64
schedtags: []
size: 15697920
snapshot_id: ""
storage_id: ""
backend: local
backup_id: ""
boot_index: null
cache: ""
disk_id: ""
disk_type: ""
driver: scsi
existing_path: ""
format: ""
fs: ""
image_encrypt_key_id: ""
image_id: ""
image_properties: null
index: 0
medium: ""
mountpoint: /
nvme_device: null
os_arch: ""
schedtags: []
size: -1
snapshot_id: ""
storage_id: ""
domain_id: default
for_guests: null
group_releations: null
groups: null
guest_status: ""
host_id: ""
host_mem_page_size: 0
hypervisor: baremetal
id: ""
ignore_filters: {}
instance_backup_id: ""
instance_snapshot_id: ""
instance_type: ""
is_container: false
is_daemon: null
isolated_devices: null
live_migrate: false
name: test-131
nets:
address: ""
address6: ""
bw_limit: 1000
domain_id: default
driver: virtio
exit: false
ifname: ""
index: 0
mac: ""
net_type: ""
network: ad5f3f8b-9675-4c37-8da9-95215648d1e7
num_queues: 0
private: false
project_id: bb7dc551694e467b8c1d5a4959cc7f8e
require_designated_ip: false
require_teaming: false
reserved: false
rx_traffic_limit: 0
schedtags: []
sriov_device: null
standby_addr_count: 0
standby_port_count: 0
try_teaming: false
tx_traffic_limit: 0
vip: false
wire: ""
os_arch: ""
prefer_backup_host: ""
prefer_host_id: c5bf75a4-3abe-4f39-880c-2632a0508187
prefer_manager_id: ""
prefer_region_id: default
prefer_wire_id: ""
prefer_zone_id: 2d80c45f-2110-48be-8fb7-54660d2edd5e
project_id: bb7dc551694e467b8c1d5a4959cc7f8e
record_to_history: false
required_candidates: 1
resource_type: shared
reuse_network: false
schedtags: []
session_id: "1704945871575"
skip_cpu_check: null
skip_kernel_check: null
sku: ""
suggestion: false
suggestion_all: false
suggestion_details: false
suggestion_limit: 100
tag: ""
target_host_kernel: ""
type: ""
vcpu_count: 96
vmem_size: 524288
error: 'genericScheduler.Schedule: No resource are avaliable that match all of the
following predicates: filter by baremetal_storage(-1), session_id="1704945871575"'
logs:
'Success: CPU-131:c5bf75a4-3abe-4f39-880c-2632a0508187 [baremetal_cpu,baremetal_memory,baremetal_status,host_schedtag] '
'Failed: CPU-131:c5bf75a4-3abe-4f39-880c-2632a0508187 [baremetal_storage] baremetal_storage:
no enough storage err: '
result: null
status: failed
time: "2024-01-11 04:04:31"
type: baremetal
time: "2024-01-11 04:04:31"

@ChaoHsin-fang 我看传递的磁盘参数是2块，第1块肯定是到  / mountpoint 的，把第二块去掉试试。
[
  {
    "backend": "local",
    "driver": "scsi",
    "image_id": "6ea5b15d-e009-4984-860b-1d4c38ef3bab",
    "image_properties": {
      "arch": "x86_64",
      "disk_format": "qcow2",
      "distro": "Ubuntu",
      "installed_cloud_init": "true",
      "is_lvm_partition": "false",
      "is_readonly": "false",
      "os_arch": "x86_64",
      "os_distribution": "Ubuntu",
      "os_language": "",
      "os_type": "Linux",
      "os_version": "20.04",
      "partition_type": "gpt",
      "uefi_support": "true",
      "version": "20.04"
    },
    "index": 0,
    "os_arch": "x86_64",
    "size": 15697920
  },
  {
    "backend": "local",
    "driver": "scsi",
    "index": 0,
    "mountpoint": "/",
    "size": -1
  }
]

目前只选了一块 3.5T的SSD 不做raid 创建裸金属报错如下
/opt/MegaRAID/MegaCli/MegaCli64 -CfgLdAdd -r0 [134:0] WT NORA Direct NoCachedBadBBU -a0
我理解这个命令里面 -r0 是raid0 吧 服务器只有一块SSD ，做raid0 至少需要两块磁盘吧
{
"reason": "Do deploy: Build MegaRaid raid failed: Driver MegaRaid, adapter 0 build raid: Build raw disks: ["/opt/MegaRAID/MegaCli/MegaCli64 -CfgLdAdd -r0
[134:0] WT NORA Direct NoCachedBadBBU -a0" error: Process exited with status 38, cmd error:  \r                                     \nThe specified physical disk does not have the appropriate attributes to complete \nthe requested command.\n\nExit Code: 0x26\n, "/opt/MegaRAID/storcli/storcli64 /c0 add vd each type=raid0 drives=134:0,134:1,134:2,134:3,134:4,134:5,134:6,134:7 wt nora direct" error: Process exited with status 255, cmd error:  CLI Version = 007.2612.0000.0000 June 13, 2023\nOperating system = Linux 6.0.0-6-amd64\nController = 0\nStatus = Failure\nDescription = Configuration not allowed\n\n\n]",
"stage": "OnDeployGuestComplete",
"status": "error"
}

@ChaoHsin-fang 根据这个代码来看：https://github.com/yunionio/cloudpods/blob/master/pkg/baremetal/utils/raid/megactl/megactl.go#L833-L847 ，应该是先会做 jbod ，如果 jbod 失败，才会用 raid0 再试一遍，megactl 做 raid0 应该可以只用一块盘。
试试用 climc host-ssh 物理机名称 登录到物理机里面，然后手动执行这些 MegaCli64 命令试试，如果还是报错，试试执行 "/opt/MegaRAID/MegaCli/MegaCli64 -CfgForeign -Scan -Clear

请教一下目前物理机进小系统了，yunionos的默认密码是多少

请教一下目前物理机进小系统了，yunionos的默认密码是多少

@ChaoHsin-fang 这个密码是随机生成的，可以用 climc host-logininfo 物理机名称 获取到

climc> host-logininfo CPU-131物理机名称
{"error":{"class":"ActionNotFoundError","code":404,"details":"Action login_info not found, please check service version, current version: release/3.10(7d8b4cd9b523101015)","request":{"body":{},"headers":{"Content-Length":"2","Content-Type":"application/json","User-Agent":"yunioncloud-go/201708","X-Auth-Token":"*"},"method":"POST","url":"https://IP:30888/hosts/CPU-131/login_info"}}}

climc> host-logininfo CPU-131物理机名称 {"error":{"class":"ActionNotFoundError","code":404,"details":"Action login_info not found, please check service version, current version: release/3.10(7d8b4cd9b523101015)","request":{"body":{},"headers":{"Content-Length":"2","Content-Type":"application/json","User-Agent":"yunioncloud-go/201708","X-Auth-Token":"*"},"method":"POST","url":"https://IP:30888/hosts/CPU-131/login_info"}}}

@ChaoHsin-fang 从前端访问物理机列面，应该有获取物理机登录密码的按钮

进入小系统手动执行如下 ：
/opt/MegaRAID/MegaCli/MegaCli64 -CfgLdAdd -r0 [134:0] WT NORA Direct NoCachedBadBBU -a0
The specified physical disk does not have the appropriate attributes to complete
the requested command.
Exit Code: 0x26

进入小系统手动执行如下 ： /opt/MegaRAID/MegaCli/MegaCli64 -CfgLdAdd -r0 [134:0] WT NORA Direct NoCachedBadBBU -a0
The specified physical disk does not have the appropriate attributes to complete the requested command.
Exit Code: 0x26

@ChaoHsin-fang 按照这个步骤排查下：https://serverfault.com/questions/331807/megacli-is-killing-me-any-help-appreciated

/opt/MegaRAID/MegaCli/MegaCli64 -CfgForeign -Clear -aALL
There is no foreign configuration on controller 0.
Exit Code: 0x00
没有外部配置

@ChaoHsin-fang 后来解决了吗？

authors: ChaoHsin-fang zexi

repo: yunionio/cloudpods


text:
[WIP] fix(baremetal): avoid redfish resp nil cause panic

What this PR does / why we need it:

Does this PR need to be backport to the previous release branch?:

/cc @swordqiu
/area baremetal

3.6

/hold cancel


text:
fix max session login issue

这个 PR 实现什么功能/修复什么问题:
支持accesskey认证，避免max session错误
是否需要 backport 到之前的 release 分支:

release/2.11.0
release/2.10.0

/area region
/cc @swordqiu @yousong

Codecov Report

Merging #1599 into master will increase coverage by 0.02%.
The diff coverage is n/a.

@@            Coverage Diff            @@
##           master   #1599      +/-   ##
=========================================
+ Coverage    7.65%   7.68%   +0.02%
=========================================
  Files         411     411
  Lines       63032   63032
=========================================
+ Hits         4826    4842      +16
+ Misses      57795   57782      -13
+ Partials      411     408       -3

Flag
Coverage Δ

#aFlag
7.68% <ø> (+0.02%)
:arrow_up:

Impacted Files
Coverage Δ

pkg/appsrv/response.go
69.23% <0%> (+3.07%)
:arrow_up:

pkg/util/rbacutils/rbac.go
74.76% <0%> (+4.36%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 698bb1c...e7c2816. Read the comment docs.

/lgtm
/approve

authors: codecov-io ioito swordqiu

repo: yunionio/onecloud


text:
Automated cherry pick of #2060: support get model distinct field

Cherry pick of #2060 on release/2.10.0.
#2060: support get model distinct field

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.10.0@d4a74e3). Click here to learn what that means.
The diff coverage is 0%.

@@               Coverage Diff                @@
##             release/2.10.0   #2071   +/-   ##
================================================
  Coverage                  ?   7.59%
================================================
  Files                     ?     410
  Lines                     ?   63341
  Branches                  ?       0
================================================
  Hits                      ?    4812
  Misses                    ?   58118
  Partials                  ?     411

Flag
Coverage Δ

#aFlag
7.59% <0%> (?)

Impacted Files
Coverage Δ

pkg/cloudcommon/db/modelbase.go
1.76% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d4a74e3...4aa9428. Read the comment docs.

authors: codecov-io wanyaoqi


text:
Automated cherry pick of #9339: fix(region,yunionapi,glance): using global proxy

Cherry pick of #9339 on release/3.5.
#9339: fix(region,yunionapi,glance): using global proxy

Codecov Report

Merging #9344 (587dec7) into release/3.5 (6a15e02) will increase coverage by 11.92%.
The diff coverage is 9.52%.

@@               Coverage Diff                @@
##           release/3.5    #9344       +/-   ##
================================================
+ Coverage         5.98%   17.91%   +11.92%
================================================
  Files              796       85      -711
  Lines           125693     8921   -116772
================================================
- Hits              7522     1598     -5924
+ Misses          117504     7151   -110353
+ Partials           667      172      -495

Flag
Coverage Δ

aFlag
17.91% <9.52%> (+11.92%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/apigateway/handler/auth.go
0.00% <0.00%> (ø)

.../monitor/alerting/conditions/suggestrulereducer.go
0.00% <0.00%> (ø)

pkg/monitor/alerting/conditions/suggestquery.go
2.00% <2.00%> (ø)

pkg/util/seclib2/seclib.go
80.39% <55.55%> (-5.66%)
:arrow_down:

pkg/compute/models/capabilities.go

pkg/util/ansible/module.go

pkg/mcclient/options/k8s/fed_rolebinding.go

pkg/hostman/guestfs/fsdriver/linux.go

pkg/hostman/system_service/systemd.go

pkg/cloudcommon/db/enabledbase.go

... and 640 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e34e65f...587dec7. Read the comment docs.

authors: codecov-io ioito


text:
Automated cherry pick of #11166: feat(region): add server migration predication API

Cherry pick of #11166 on release/3.7.
#11166: feat(region): add server migration predication API

Codecov Report

Merging #11211 (7c7687a) into release/3.7 (0ff3997) will decrease coverage by 0.42%.
The diff coverage is 1.11%.

@@               Coverage Diff               @@
##           release/3.7   #11211      +/-   ##
===============================================
- Coverage         5.98%    5.56%   -0.43%
===============================================
  Files              848      520     -328
  Lines           131795    90709   -41086
===============================================
- Hits              7887     5044    -2843
+ Misses          123206    85265   -37941
+ Partials           702      400     -302

Flag
Coverage Δ

aFlag
5.56% <1.11%> (-0.43%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

pkg/apis/const.go
0.00% <0.00%> (ø)

pkg/apis/input.go
0.00% <0.00%> (ø)

pkg/apis/list.go
0.00% <ø> (ø)

pkg/appsrv/appsrv.go
44.32% <0.00%> (-4.35%)
:arrow_down:

pkg/baremetal/tasks/baseprepare.go
0.00% <0.00%> (ø)

pkg/baremetal/tasks/bm_register.go
0.00% <0.00%> (ø)

pkg/baremetal/tasks/ipmiprobe.go
0.00% <0.00%> (ø)

pkg/baremetal/tasks/stop.go
0.00% <0.00%> (ø)

pkg/cloudcommon/cronman/cronman.go
49.44% <0.00%> (ø)

pkg/cloudcommon/notifyclient/events.go
0.00% <ø> (ø)

... and 479 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d445b55...7c7687a. Read the comment docs.

authors: codecov-commenter zexi

repo: yunionio/yunioncloud


text:
🛑 Excalidraw is down

In be5d254, Excalidraw (https://excalidraw.yunuscloud.eu.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Excalidraw is back up in 111dd3f after 31 minutes.


text:
UVC G3 micro - motion sensor

Hey,
I plan to buy some G3 micro cams for home-automation. unifi-video-api is best lib for unifi i was able to find, but it still lack of basic feature for IOT/automation scenarios.
Is there a way to get information if camera detected motion?
Probably can help with implementation, but before i will buy G3 - want to know if this is even possible? NVR is exposing in any way this information?

If you wanted to use the API you would have to check the recordings and see if there are any new motion recordings and whether or not they are in-progress. You can do this with unifi-video-api but you would have to do it by polling the API (which will be a tiny bit less horrible once I'm done with #14).
As far as I know, the API does not provide you with any other way to achieve what you're after. If you'll find it does then please let me know as I'd likely be interested in supporting it in unifi-video-api.
Assuming you want to react to motion events, and you want to avoid having to ask the API for new recordings each second or so, then my suggestion would be to take advantage of UniFi Video's email notifications. This is exactly what I'm doing myself to get object detection and to filter out false positives etc.

Thanks. Yeah polling is not best idea (still better than nothig). But as you suggested i can use some mail to smth proxy. Ex. node-red-contrib-mailin-smtp
Probably will go with one G3 micro just to verify what is possible. If i find anything useful, for sure will create MR.

Forgot to mention https://github.com/yuppity/ufv-alerts. I've since worked on it a bit more for my own purposes and none of that work has made it to Github but the core idea hasn't really changed. Should get you started at least.

Oh, looks good :) For sure will check that 👍

authors: bkupidura yuppity

repo: yuppity/unifi-video-api


text:
Library onl contains headers file.

I want to integrate a library that only contains headers into a plugin in flutter, is it possible?

@NghiNguyen0604 Yes, as long as your headers contain implementation.


text:
php-cs-ficerの導入

以下で導入
composer require -dev friendsofphp/php-cs-fixer
設定ファイルを作成する必要がある

done

repo: yutanakano/yoshinani


text:
改善提案: 進捗状況のアイコン

Hと色合いだけだと分かりづらいので、「作業予約中」「編集完了」のように文字表示のほうが良いのではないでしょうか。
もし色合いで示す場合は、どこかに凡例があると嬉しいです。

サイトの使い方 に、状態遷移図にステート色を表示しました。

authors: nyampire yuuhayashi

repo: yuuhayashi/task-bldg


text:
undefined symbol: _ZN2df12KinectFusionC1ESs on trained model test script

Dear Dr. Xiang @yuxng ,
Thanks for the work. I am working on reproducing your code on my docker image.
Everything is compiled. I can run the test script without kfusion set to True. However, once set it to True, I got the error as follows:
+ set -e
+ export PYTHONUNBUFFERED=True
+ PYTHONUNBUFFERED=True
+ export CUDA_VISIBLE_DEVICES=0
+ CUDA_VISIBLE_DEVICES=0
++ date +%Y-%m-%d_%H-%M-%S
+ LOG=experiments/logs/rgbd_scene_multi_rgbd_test.txt.2018-06-14_23-27-31
+ exec
++ tee -a experiments/logs/rgbd_scene_multi_rgbd_test.txt.2018-06-14_23-27-31
+ echo Logging output to experiments/logs/rgbd_scene_multi_rgbd_test.txt.2018-06-14_23-27-31
Logging output to experiments/logs/rgbd_scene_multi_rgbd_test.txt.2018-06-14_23-27-31
+ '[' -f /home/weizhang/DA-RNN/output/rgbd_scene/rgbd_scene_val/vgg16_fcn_rgbd_multi_frame_rgbd_scene_iter_40000/segmentations.pkl ']'
+ ./tools/test_net.py --gpu 0 --network vgg16 --model data/fcn_models/rgbd_scene/vgg16_fcn_rgbd_multi_frame_rgbd_scene_iter_40000.ckpt --imdb rgbd_scene_val --cfg experiments/cfgs/rgbd_scene_multi_rgbd.yml --rig data/RGBDScene/camera.json --kfusion 1
Traceback (most recent call last):
  File "./tools/test_net.py", line 13, in <module>
    from fcn.test import test_net
  File "/home/weizhang/DA-RNN/tools/../lib/fcn/test.py", line 25, in <module>
    from kinect_fusion import kfusion
ImportError: /home/weizhang/DA-RNN/tools/../lib/kinect_fusion/kfusion.so: undefined symbol: _ZN2df12KinectFusionC1ESs

I am not sure if this is caused by compiling kinect fusion improperly. And comments are very appreciated.
And also @kevinkit , did you successfully run the script with kfusion to 1 in a docker?
Thanks for the help!.

I get the same error, any solution? @Wei2624 @yuxng

@rockkingjy I work it around by adding add_definitions(-D_GLIBCXX_USE_CXX11_ABI=0) to CMakeList.txt in KniectFusion. You can try it.

repo: yuxng/DA-RNN

license: mit


text:
调用SVGADynamicEntity.setDynamicText方法文字居中问题

您好，请教一个问题，我调用SVGADynamicEntity类的setDynamicText方法动态设置文字，但是文字在画布上居中了，其实我想要靠左对齐的效果，这个能有办法解决吗？  谢谢
运行效果图:http://chuantu.xyz/t6/702/1560329732x2073530527.png
svga动画被我用红色的框圈起来了，麻烦您帮忙看看，谢谢。

https://github.com/yyued/SVGAPlayer-Android/wiki/Dynamic-Drawer
用 Canvas API 自己画

repo: yyued/SVGAPlayer-Android


text:
Is it possible to install pyod without numba?

Hello,
I am facing using regarding numpy,we are only allowed to use the versions of numpy>1.22,however the latest version and most of the versions of  numba only supports the numpy versions < 1.22,hence is it possible to use pyod without numba?,please suggest me a workaround if possible.Thanks.

Models are all here: https://github.com/yzhao062/pyod/tree/master/pyod/models

if one depends on numba, you will see that in the import on the top.

I got it,Thank you so much!!!


text:
模型树的一个重大问题

Laravel Version: 6.18.3
PHP Version: 7.3.4
Laravel-admin: 1.7.14

Description:
模型树的修改按钮导向了一个无效的url，经过我查看发现可能是因为我的模型中使用了path字段，导致显示不正常

Steps To Reproduce:

另外模型树这块的文档不够完整

repo: z-song/laravel-admin


text:
No module named 'pyvirtualdisplay'

Traceback (most recent call last):
  File "/data/data/com.termux/files/home/Uscrapper/Uscrapper-vanta.py", line 23, in <module>
    from pyvirtualdisplay import Display
ModuleNotFoundError: No module named 'pyvirtualdisplay'

The issue is now resolved. Thank you!!


text:
Feature Request: Snowflake: Send queries in batches for significant performance gain

Related to #38
It seems like running yaml refactor sends the DESCRIBE TABLE ... statements to Snowflake sequentially one-by-one as it goes. It'd be great if this went a lot faster.
Seems like it also executes show terse objects in [db_name].[schema_name] every single time it runs describe table, when it seems like this could maybe just be executed one time upfront?
Describe the solution you'd like
Would it be reasonable to queue up all those database statements up front and run through them as the results return, so that it completes much more quickly.
Describe alternatives you've considered
Can't really think of any apart from just using it as it is and waiting much longer.
Additional context
python 3.9.16
macOS 13.2 (22D49)
Snowflake 7.3.1
dbt-core==1.3.2
dbt-extractor==0.4.1
dbt-osmosis==0.9.8
dbt-snowflake==1.3.0

One helpful example of this is working with the Fivetran Connector for Salesforce.
The resulting schema has 15,879 columns across 759 tables. Running yaml refactor for just that one schema takes around two hours (using an X-Large Snowflake warehouse with nothing else running on it, executing from an M1 MacBook Pro with little else running on it).
I'd personally want to be able to run this on a regular basis to ensure our repo and documentation stays up to date, but would like to have it run much more quickly so that the resources of the machine it's running on (an EC2 instance, for example) aren't consumed for so long doing this.

@jaredx435k2d0 I have now taken a first stab at parallelizing the yaml stuff. I would expect a massive speed increase.
This show terse objects in [db_name].[schema_name] is super interesting because that must be an implementation detail of the underlying snowflake adapter -- or perhaps just how we are using it.
I am closing this issue because queries should be sent in parallel but we can re-open a more specific issue for the show terse objects which will require a peek at where it is called in dbt-snowflake and where I am calling that caller.

@z3z1ma
So much faster! Love it. THANK you.
I looked in my query history and still see 1 DESCRIBE TABLE statement per table.
I also see several repeated show terse objects in [db_name].[schema_name] statements for the same schema (when I'm only running it for one schema).
I'd anticipate that, while these queries are fast, they're probably still slowing things down considerably (and incurring extra Snowflake costs) due to having to do one round trip to Snowflake per table.

@jaredx435k2d0
This is where the DESCRIBE TABLE is being called.
https://github.com/dbt-labs/dbt-snowflake/blob/main/dbt/include/snowflake/macros/adapters.sql#L112
Its outside my realm of control and inside the actual dbt adapter internals. One thing that is unique about dbt-osmosis for what its worth is that it is compatible with all existing (and future) dbt-adapters since it uses the adapter protocol exclusively which is a required implementation for all adapters. This means there are database specific optimizations I could make but it significantly steps up the complexity even if it sounds simple and I am not sure that is the right path just to eek out some more performance. After a full run, which could be done in CI, you can scope your runs to specific folder paths to make it faster if have a ton of models.
Another potential optimization I could foresee is storing a cache of filechecksums so we dont re-run for an unmodified dependency chain. We would need those checksums either on disk or in the dwh.


text:
Certain tables not loading data

I don't have many details on how to reproduce this, so this is more for logging purposes than anything else.
I'm having issues loading a specific table, regardless of the method.
Notes on the table:

Some fields (at different levels) have the same names
It is highly nested
It contains very few records (412 entries)
Running on full refresh did not fix this issue
Will update with details as they come in

Data from same source but different stream is functionnal

Update: Here is an error message using these configs:
      credentials_path: .secrets/gbq-client_secrets-staging.json
      project: target_bigquery_project_id
      dataset: hibob_z3z1ma
      denormalized: false
      method: streaming_insert
      # method: batch
      timeout: 300
      batch_size: 250000
      append_columns: true
      generate_view: true

2022-12-01T20:09:43.893979Z [info     ]   File "/project/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/utils.py", line 109, in <listcomp> cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894101Z [info     ]     self._field_to_sql(f, f"{path}.{field.name}", array_depth) cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894224Z [info     ]   File "/project/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/utils.py", line 108, in _field_to_sql cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894347Z [info     ]     [                          cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894468Z [info     ]   File "/project/.meltano/loaders/target-bigquery/venv/lib/python3.8/site-packages/target_bigquery/utils.py", line 111, in <listcomp> cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894590Z [info     ]     else self._wrap_repeat_json_extract(f, array_depth + 1) cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.894712Z [info     ] TypeError: _wrap_repeat_json_extract() takes 2 positional arguments but 3 were given cmd_type=elb consumer=True name=target-bigquery producer=False stdio=stderr string_id=target-bigquery
2022-12-01T20:09:43.999884Z [error    ]

It seems we are having an array depth error in utils


text:
求助！节点动态加载后，如何选中指定的子节点？

//选中父节点
var pNode = treeObj.getNodeByParam("nid", "node_x“, null);
//对父节点进行展开（展开时会动态动态获取子节点）
treeObj.expandNode(pNode,true,true,true,true)
如何在父节点展开动态加载完成后，通过子节点的属性选中子节点呢？
由于动态加载是异步的，直接去取子节点的时候不一定能取的到。

看 expandNode倒是可以通过callbackFlag 参数指定是否执行onExpand ，但不清楚怎么把参数传过去

通过reAsyncChildNodes 的callback实现了


text:
popover height issues

hi Zach, I noticed that if you open a popover in the header, it's header will be cut out.  please fix this when you have the chance...thanks :)

Hi Zach, I just figured it out ...
I put in the popover class this:
top: 90px
and it worked... I would like to be a contributor if its possible...
thanks again :)

repo: zachsoft/Ionic-Material


text:
Website Edits

Add "Formal or Cocktail Attire" under the When & Where section
Add "4:00 PM" to the When & Where section

reorder website: W&W, RSVP, Registry, Guest Book, FAQs, Gallery

Move RSVP to be after W&W in the Nav bar to see if you like it.

repo: zachspiel/wedding-rsvp


text:
修复更新后的直播间前端问题

解决方法比较简单粗暴，但是可以用，顺便改了一点css的小问题。
代码不是特别理解，不排除有bug的可能性，不过我自己验证下来基本的操作都是可以用的，求 @zacyu 大佬review以下。
解决 #458 。

直播间的部分给肉看吧 :)

@jjj201200

@std4453 看了下，去掉console和那个意义不明的condition就可以了，改一下吧~

@jjj201200 ok。

那个灰色的块是滚动条，现在修好了。

repo: zacyu/bilibili-helper


text:
Script failed to scan birthdays.

Script failed to scan birthdays.
Error message: eyJlcnJvciI6IlJlbW92ZWQgaW5maW5pdGUgc2NhbiBsb2NrIiwidHlwZSI6IlNDQU5fRVJST1JfR0VORVJBTCJ9

The issue is solved in https://github.com/zagushka/birthday-calendar-extractor/pull/94

repo: zagushka/birthday-calendar-extractor


text:
sqs: handle empty response

fixes #104

:+1:

👍

authors: Jan-M harti2006 mohabusama

repo: zalando-zmon/zmon-aws-agent


text:
docs(description): change the description

Change the description without mentioning Brand Solutions (I also suggest to change Framework to Library and to mention BEM and atomic design).
updates:

github repo settings
README.md
demo index
package.json (in this file it make sense also to update the keywords... BEM, atomic design, css library, etc., remove zalando also here)
bower.json

Fixed in https://github.com/zalando/dress-code/pull/213

authors: rbarilani sambhav-gore

repo: zalando/dress-code


text:
Award fast delivery (and punish the slow)

It would possibly make sense to differentiate on points based on how fast you deliver - bonus on instant delivery, then decreasing the score with increasing customer frustration?  Alternatively/additionally, the speed of the messenger could increase with every fully dressed customer (or points earned), to be able to fulfil more complicated orders.
Additionally (and independently), the game name (especially '404') cannot be seen because of the inventory.

@avaczi thanks! Having bonus system is definitely a good idea, e.g. in the Tetris game you get bonus points when you clear multiple lines. In our case "Time to delivery" is a nice metric to calculate the bonus points from.

Hey @w0rm @kolja @aryszka @vigneshshanmugam, can we close this issue? It dates back to Dec 2015.
Or, we could add a "Help Wanted" label.

authors: LappleApple avaczi w0rm


text:
SecurityStrategy collects response even if path is filtered

Description
We have a few paths that are in the exclude list because they return large binary files and we do not want them logged in any way. The app runs with restricted heap  and we avoid OOM errors by returning the binary in chunks, and never try to cache the entire file in server memory.  This all appears to work properly, at least when the binary files are small enough to fit into heap memory. The excludes work and no logs are produced by logbook.
Using the spring boot starter, the installed security filter (via the SecurityStrategy) wraps the request and the response unconditionally, and then initiates a logging action after the response is generated if the request was unauthorized.  For responses that generate a large body we run into OOM problems as the wrapped response is cached in memory, even though the request is authorized and no log output will be produced.
Expected Behavior
The SecurityStrategy should pay attention to active excludes, and not attempt to wrap requests/responses if the path is in the exclude list.
Actual Behavior
The response is wrapped unconditionally in a LocalResponse, and we hit OOM errors as LocalResponse tries to cache the entire body in memory.
Possible Fix
Steps to Reproduce

start test app with a very small heap
exclude a REST endpoint that will download a binary file larger than the configured heap
hit the REST endpoint to download the huge file
observe OOM stack traces in the console output

Context
Get OOM errors when running an application with logbook enabled
Your Environment

Version used: 1.13.0

Now that I think on it, this problem is also a very good attack vector for a Denial Of Service attack.  An attacker could do an unauthorized request and issue a GET with a huge request body.  The SecurityStrategy would dutifully attempt to cache the request since there is no body size limit, and potentially force the process into an OOM situation even though the request would eventually be blocked.

Now that I think on it, this problem is also a very good attack vector for a Denial Of Service attack. An attacker could do an unauthorized request and issue a GET with a huge request body. The SecurityStrategy would dutifully attempt to cache the request since there is no body size limit, and potentially force the process into an OOM situation even though the request would eventually be blocked.

That's actually the single purpose of the security strategy to prevent that attack vector, because it discards requests bodies. See https://github.com/zalando/logbook/blob/1.13.0/logbook-servlet/src/main/java/org/zalando/logbook/servlet/Strategy.java#L20
You issue is a duplicate but I can't find the other one right now. Can you try to run it with the latest master (install locally) and see whether it's already fixed? I'm planning on releasing a RC soon.

Yes it does discard the request, I was mistaken there, sorry about that. But my original problem remains in that responses are cached regardless of whether the URLs have been excluded.
I will try out master and see if my problem goes away.  I hate asking developers 'when is the release' because I hate being asked that myself :) but I am looking forward to an RC, the stuff on master looks very nice!

But my original problem remains in that responses are cached regardless of whether the URLs have been excluded.

That's right.

I will try out master and see if my problem goes away. I hate asking developers 'when is the release' because I hate being asked that myself :) but I am looking forward to an RC, the stuff on master looks very nice!

I just need to fix #484. I'd create the first RC then.

Ok I have tried out master on my project.  Glad to hear an RC is on its way :)
First, the upgrade to 2.0.0 was a little rocky, I think you should have some kind of 'how to migrate to 2.0' document, especially for SpringBoot users.  There are a number of changes in the spring boot starter auto config (which I think are good changes, you have made a lot of excellent improvements) and these changes break my build.
The main one was that you changed logbook-spring-boot-starter from a JAR to a POM.  Since the 1.X is a JAR it is a valid dependency, but I had to change my POM to stop including it as a JAR.  I am not as up on SB  starter architecture as I should be, but I couldn't get the starter POM to work at all, even when I added it to my  section.  Don't you have to have at least a JAR with META-INF defined in it for a starter jar to work?  Anyway, switching to using logbook-spring-boot-autoconfigure instead seemed to work ok.
The original problem of being forced to cache the response of URLs that are in the excluded list remains.  Is that your designed architecture?  I hope not, because the cached responses of the excluded URLs are blowing up my docker containers.  Is there some kind of work around I can try to stop this from happening?

First, the upgrade to 2.0.0 was a little rocky, I think you should have some kind of 'how to migrate to 2.0' document, especially for SpringBoot users. There are a number of changes in the spring boot starter auto config (which I think are good changes, you have made a lot of excellent improvements) and these changes break my build.

Absolutely. I did that for zalando/tracer and you can expect something close to that once 2.0.0-RC.0 drops.

The main one was that you changed logbook-spring-boot-starter from a JAR to a POM. Since the 1.X is a JAR it is a valid dependency, but I had to change my POM to stop including it as a JAR. I am not as up on SB starter architecture as I should be, but I couldn't get the starter POM to work at all, even when I added it to my  section. Don't you have to have at least a JAR with META-INF defined in it for a starter jar to work?

Yeah, not exactly sure how that slipped in there. It has to be a jar to work, afaik.

The original problem of being forced to cache the response of URLs that are in the excluded list remains. Is that your designed architecture? I hope not, because the cached responses of the excluded URLs are blowing up my docker containers. Is there some kind of work around I can try to stop this from happening?

That's odd. The SecureLogbookFilter is implemented as a special Strategy now.
https://github.com/zalando/logbook/blob/eb15e9adb829ec840dcc93358236b1d2c98dee3d/logbook-servlet/src/main/java/org/zalando/logbook/servlet/SecureLogbookFilter.java#L25
https://github.com/zalando/logbook/blob/eb15e9adb829ec840dcc93358236b1d2c98dee3d/logbook-servlet/src/main/java/org/zalando/logbook/servlet/LogbookFilter.java#L73-L77
In the end the predicate should decide whether to even call the strategy at all (first line):
https://github.com/zalando/logbook/blob/eb15e9adb829ec840dcc93358236b1d2c98dee3d/logbook-core/src/main/java/org/zalando/logbook/DefaultLogbook.java#L29-L40
I added a test for this right now. See #486. Can you share your configuration with the exclusion?

I think I tested it correctly, although your test looks valid, maybe I boo-booed.  But just to be sure, here is an example URL I want ignored:
GET http://127.0.0.1:7072/c2s/v1/download/f1f5a217-66ee-455d-8a01-6802d7b60cfd/installer.sh
And here are my exclusions:
logbook:
  filter.enabled: true
  write.level: INFO
  exclude:
    - "/actuator/public/info"
    - "/c2s/*/clop/next/**"
    - "/c2s/*/clop/complete/**"
    - "/c2s/*/zones/**"
    - "/c2s/*/download/**"
    - "/server/v1/files/*/*"

Does that look reasonable?

Does that look reasonable?

Absolutely! /c2s/*/download/** matches you URL. The double quotes are not necessary, but they shouldn't hurt either, I believe. Can you put a breakpoint in DefaultLogbook and see whether the predicate evaluates incorrectly or might even be constructed incorrectly?

Hi Willi,
Ok I pulled your branch that had the springboot starter fix and ran a full test suite of my app.  I can confirm that the code works exactly as you say above, and my problem with meaty ignored responses blowing up my docker container is gone.
Looking forward to 2.0, keep up the good work.
Jay

authors: jayguidos whiskeysierra

repo: zalando/logbook


text:
Add support for kernel module backend

Official app has this functionality and it allows for better performance with lower battery drain. I believe the documentation is available in the android wire guard docs.

I'll look into this!

Official app has this functionality and it allows for better performance with lower battery drain. I believe the documentation is available in the android wire guard docs.

Hello again! I am trying to work on this feature. I have a rooted Pixel 4a running Android 13 and the official app does not see kernel support for wireguard. Any pointers on how to get this working so I can have a test device to work on this feature?

Do you have "Enable Kernel module backend" in wireguard settings? (3 dot menu, then expand "Advanced")

I don't have that option. But I can confirm with the Root Checker app that my device is rooted.

Hmm, what are you using for root? In magisk and kernelSU you need to allow superuser access on per app basis. Just checked and option won't show unless wireguard is given root access.

Hmm, what are you using for root? In magisk and kernelSU you need to allow superuser access on per app basis. Just checked and option won't show unless wireguard is given root access.

I'm using Magisk and I can't see a way to add Wireguard to the Superuser list of apps because WireGuard did not request it on install/open.

Maybe it's a bug in wireguard itself, but it works for me.
https://github.com/zaneschepke/wgtunnel/assets/56438628/31cfa1e1-aec8-446f-ad33-99df2ea6c70f

Thank you for the video! Unfortunately, I don't get that option. I think I'll try a rooted emulator next. What version of Android are you using to do this?

It is worth mentioning that your kernel has to be compiled with the wireguard kernel module, you can verify that by the presence of /sys/module/wireguard directory.

That's wierd.

What version of Android are you using to do this?

crDroid 9.11 (A13)
November security patch.
I tested crDroid 10 (A14) last week and don't remember having issues.
One thing is that I'm using Neo Backup to restore whole APK along with it's data. On A13 I tried uninstalling and reinstalling, so here it works fine, but I can't confirm anything on A14.

@pacjo @2b I was able to get the kernel module working with the official app on a rooted emulator. I can now begin the dev work. I'll keep you posted on the progress.  I will probably not support multi-tunnel feature to start. I hope that is not the main feature you are looking for.. :rofl:

Tested and seems to be working. Thanks.

Tested and seems to be working. Thanks.

You're welcome :smile:  In the future, I will add the other kernel features that are available to the wireguard official app.

authors: 2b pacjo zaneschepke

repo: zaneschepke/wgtunnel


text:
Fix Bitbucket Cloud api endpoints

This PR fixes #37.
Latest documentation lists the correct URI format as: https://api.bitbucket.org/2.0/...
https://developer.atlassian.com/bitbucket/api/2/reference/

thanks!


text:
refactor:  extending pre-miR overhangs

Closes #24 .

The output was update due to two reasons:

The miRNA annotations went back to Derives_from therefore, the intersection file contains Derives_from instead of Parent.
While testing, I found an annotation out of the genome range, it was removed. This makes the tables to have one less entry but the same counting thus, they were updated.

repo: zavolanlab/mirflowz


text:
Use genkernel root prefix by default on Gentoo

genkernel is often used to generate the initramfs on Gentoo.
An initramfs generated by genkernel accepts a ZFS root option
in the form of root=ZFS=<dataset>,
but does not accept root=zfs:<dataset>,
which is the default format for passing the root dataset
to the BE initramfs in zfsbootmenu.
For Gentoo BEs, make the default root prefix root=ZFS=,
which is accepted by both genkernel- and dracut-generated initramfs.
Users can still set the org.zfsbootmenu:rootprefix property
on <pool>/ROOT or the BE datasets to override the default.
Fixes: #136.

I have tested this manually on my Gentoo system by booting BEs with both genkernel and dracut initramfs. The root prefix property is not set, but the kernel/initramfs gets the root dataset in the expected format:
# zfs list -r -d 1 -o org.zfsbootmenu:rootprefix,org.zfsbootmenu:commandline xa/ROOT | uniq
ORG.ZFSBOOTMENU:ROOTPREFIX  ORG.ZFSBOOTMENU:COMMANDLINE
-                           dozfs=cache mem_sleep_default=deep
# cat /proc/cmdline
root=ZFS=xa/ROOT/gentoo-zfsbootmenu-test2 dozfs=cache mem_sleep_default=deep
# mount | grep ' / '
xa/ROOT/gentoo-zfsbootmenu-test2 on / type zfs (rw,relatime,xattr,noacl)

I have tested this manually on my Gentoo system by booting BEs with both genkernel and dracut initramfs. The root prefix property is not set, but the kernel/initramfs gets the root dataset in the expected format:
# zfs list -r -d 1 -o org.zfsbootmenu:rootprefix,org.zfsbootmenu:commandline xa/ROOT | uniq
ORG.ZFSBOOTMENU:ROOTPREFIX  ORG.ZFSBOOTMENU:COMMANDLINE
-                           dozfs=cache mem_sleep_default=deep
# cat /proc/cmdline
root=ZFS=xa/ROOT/gentoo-zfsbootmenu-test2 dozfs=cache mem_sleep_default=deep
# mount | grep ' / '
xa/ROOT/gentoo-zfsbootmenu-test2 on / type zfs (rw,relatime,xattr,noacl)

Your help getting this up-to-snuff for Gentoo is greatly appreciated!

Your help getting this up-to-snuff for Gentoo is greatly appreciated!

Thank you too for the prompt replies and suggestions on solving problems!

Thank you too for the prompt replies and suggestions on solving problems!

authors: vozhyk- zdykstra

repo: zbm-dev/zfsbootmenu


text:
Issue ingesting blocks with block_height as -1

After following installation instructions when starting zcashd with -reindex I get the following error:
INFO[2019-04-23T19:11:05-07:00] Listening to 0mq on 127.0.0.1:28332           app=zmqclient
INFO[2019-04-23T19:11:38-07:00] new block                                     app=zmqclient block_hash=382c4a332661c7ed0671f32a34d724619f086c61873bce7c99859dd9920aa605block_height=0 block_version=4 error="<nil>" sapling=false seqnum=0 tx_count=1
INFO[2019-04-23T19:11:38-07:00] new block                                     app=zmqclient block_hash=238d665a062b9007836a7d8f968ba2f3847af5f542733389a952cf9b86795502block_height=-1 block_version=4 error="<nil>" sapling=false seqnum=1 tx_count=1
ERROR[2019-04-23T19:11:38-07:00] new block                                     app=zmqclient block_hash=181ac2d6dc0ae73a82d7db472ac2879a7c24d8b12e5f73efc33a55549ea4f100 block_height=-1 block_version=4 error="storing compact block -1: UNIQUE constraint failed: blocks.block_height" sapling=false seqnum=2 tx_count=1
ERROR[2019-04-23T19:11:46-07:00] error on msg recv                             app=zmqclient error="interrupted system call"

In addition, viewing the sqlite database for the blocks table I see the following for block_height 0 and the compact encoding field:
 8,J3&aq*4$ala;|ْ

Running go 1.12.2 and zcashd v2.0.4 on Ubuntu 19.0.4.

This was a missing dependency. Ensured everything from https://github.com/zcash-hackworks/lightwalletd-z-cash/blob/master/Dockerfiles/lightwalletd/Dockerfile was installed and this cured it.

Actually, the above fix was coincidental and the underlying issue remains.
I have found that for blocks 1-16 this line always returns -1 https://github.com/zcash-hackworks/lightwalletd/blob/master/parser/block.go#L71 so if you ingest a couple of blocks 1-16 then you'll get the UNIQUE constraint failed error.
If you don't ingest any blocks 1-16 then everything works as it should.

The bug is caused by the fact that the parser doesn't account for how integers 1 through 16 are encoded in a CScript using their opcodes instead of a byte representation:
https://github.com/zcash/zcash/blob/8a95ba235d146d58c9a6883673fc5da4b9139d03/src/script/script.h#L365-L368

Thanks for the explanation!
Before this is fixed if anyone is having the same issue simply starting zcashd with -rescan before starting lightwalletd is a really simple workaround as then you'll simply miss those problematic first blocks.

@garethtdavies I'm not sold on my PR being fully robust or even a valid fix, but FWIW #37 appears to resolve this issue too on my local environment

repo: zcash-hackworks/lightwalletd


text:
自动下载配置文件

第一次运行时，尝试下载配置文件并解压到指定位置

87efe0f982ba486830f9e33f3da1a27b6dd242db  完成

增加 配置下载管理器

repo: zedeeee/UCLC


text:
add scrollback buffer config option

As stated. The config option added is called scollback and takes a number.
Without the option in config the xterm.js default is used (1000?) I believe.
Discussed in #280

I think this is more or less a duplicate of #3038

Cool thanks @jaridmargolin I didn't see it referenced to the issue. I'll close this.

authors: chhschou jaridmargolin

repo: zeit/hyper


text:
Application > About does nothing

Ubuntu 16.04

This menu item needs removed for both Windows and Linux. It's only supported for OSX.
See https://github.com/electron/electron/issues/4653

authors: Tyriar flybayer

repo: zeit/hyperterm


text:
Eslint in dev mode

Hi, I'm setting up my first project with next. Is there a way to add eslint to automatically lint files as I edit them?

Did you check out eslint-loader?
⚠ This is how it should work (Untested) .

Install eslint-loader

$ npm install eslint-loader --save-dev

Create a next.config.js file in the root of your project.
Insert:

module.exports = {
  webpack: (config, { dev }) => {
    if (dev) {
      config.module.rules.push({
        test: /\.js$/,
        exclude: /node_modules/,
        loader: 'eslint-loader',
        options: {
          // eslint options (if necessary)
        }
      })
    }
    return config
  }
}

Thanks @HaNdTriX
Yeah! Something like this would work.

module.exports = {
  webpack: (config, { dev }) => {
    const eslintRule = {
      test: /\.js$/,
      enforce: 'pre',
      exclude: /node_modules/,
      loader: 'eslint-loader',
      options: {
        // Emit errors as warnings for dev to not break webpack build.
        // Eslint errors are shown in console for dev, yay :-)
        emitWarning: dev,
      },
    };

    const rules = [].concat(eslintRule, config.module.rules);
    return assocPath(['module', 'rules'], rules, config);
  },
};

@steida .. this might be a dumb question.. where is "assocPath" is imported from.. I am getting following error..

yarn run dev
yarn run v0.27.5
$ node server.js
Using "webpack" config function defined in next.config.js.
(node:6156) UnhandledPromiseRejectionWarning: Unhandled promise rejection (rejection id: 2): ReferenceError: assocPath is not def
ined
(node:6156) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are
not handled will terminate the Node.js process with a non-zero exit code.

@vinodronold https://github.com/este/este/blob/master/next.config.js

authors: HaNdTriX arunoda jedlikowski steida vinodronold


text:
(s)css in its own file?

I really like the fact that we can use regular css, but I was just wondering if this could be separated in another file?
<style jsx>{`
      p {
        color: blue;
      }
      div {
        background: red;
      }
      @media (max-width: 600px) {
        div {
          background: blue;
        }
      }
`}</style>

So if we can have a styles folder, and then each file can include css and/or scss, and then we can access those by their filename in the jsx files.
So we could instead have a file called 'name.scss', with the css code:
p {
    color: blue;
 }
div {
    background: red;
}
@media (max-width: 600px) {
    div {
        background: blue;
    }
}

And then use it in the jsx file like so:
<style jsx={name}></style>

So just like the routing, which uses the file system, we could do the same with the css. Would be neat to have the style and javascript separated in different files.
It would also be a great feature to have scss automatically included in next.

This is discussed here https://github.com/zeit/styled-jsx/issues/83

authors: arashsa nkzawa


text:
Move csp examples

Fixes #12042

Stats from current PR

Default Server Mode (Decrease detected ✓)

General

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

buildDuration
12s
12.1s
⚠ +136ms

nodeModulesSize
61.8 MB
61.8 MB
✓

Page Load Tests Overall decrease ⚠

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

/ failed reqs
0
0
✓

/ total time (seconds)
2.005
2.052
⚠ +0.05

/ avg req/sec
1247.09
1218.44
-28.65

/error-in-render failed reqs
0
0
✓

/error-in-render total time (seconds)
1.144
1.219
⚠ +0.08

/error-in-render avg req/sec
2184.91
2051.54
-133.37

Client Bundles (main, webpack, commons)

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

main-HASH.js gzip
6.49 kB
6.49 kB
✓

webpack-HASH.js gzip
746 B
746 B
✓

de003c3a9d30..fef6.js gzip
10.5 kB
10.5 kB
✓

framework.HASH.js gzip
39.1 kB
39.1 kB
✓

Overall change
56.9 kB
56.9 kB
✓

Client Bundles (main, webpack, commons) Modern

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

main-HASH.module.js gzip
5.58 kB
5.58 kB
✓

webpack-HASH..dule.js gzip
746 B
746 B
✓

de003c3a9d30..dule.js gzip
6.92 kB
6.92 kB
✓

framework.HA..dule.js gzip
39.1 kB
39.1 kB
✓

Overall change
52.4 kB
52.4 kB
✓

Legacy Client Bundles (polyfills)

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

polyfills-HASH.js gzip
26.3 kB
26.3 kB
✓

Overall change
26.3 kB
26.3 kB
✓

Client Pages

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_app.js gzip
1.26 kB
1.26 kB
✓

_error.js gzip
3.25 kB
3.25 kB
✓

hooks.js gzip
881 B
881 B
✓

index.js gzip
222 B
222 B
✓

link.js gzip
2.06 kB
2.06 kB
✓

routerDirect.js gzip
279 B
279 B
✓

withRouter.js gzip
278 B
278 B
✓

Overall change
8.22 kB
8.22 kB
✓

Client Pages Modern

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_app.module.js gzip
604 B
604 B
✓

_error.module.js gzip
2.04 kB
2.04 kB
✓

hooks.module.js gzip
383 B
383 B
✓

index.module.js gzip
223 B
223 B
✓

link.module.js gzip
1.52 kB
1.52 kB
✓

routerDirect..dule.js gzip
281 B
281 B
✓

withRouter.m..dule.js gzip
278 B
278 B
✓

Overall change
5.33 kB
5.33 kB
✓

Client Build Manifests

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_buildManifest.js gzip
61 B
61 B
✓

_buildManife..dule.js gzip
61 B
61 B
✓

Overall change
122 B
122 B
✓

Rendered Page Sizes

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

index.html gzip
928 B
928 B
✓

link.html gzip
937 B
937 B
✓

withRouter.html gzip
924 B
924 B
✓

Overall change
2.79 kB
2.79 kB
✓

Serverless Mode

General

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

buildDuration
13.1s
12.9s
-159ms

nodeModulesSize
61.8 MB
61.8 MB
✓

Client Bundles (main, webpack, commons)

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

main-HASH.js gzip
6.49 kB
6.49 kB
✓

webpack-HASH.js gzip
746 B
746 B
✓

de003c3a9d30..fef6.js gzip
10.5 kB
10.5 kB
✓

framework.HASH.js gzip
39.1 kB
39.1 kB
✓

Overall change
56.9 kB
56.9 kB
✓

Client Bundles (main, webpack, commons) Modern

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

main-HASH.module.js gzip
5.58 kB
5.58 kB
✓

webpack-HASH..dule.js gzip
746 B
746 B
✓

de003c3a9d30..dule.js gzip
6.92 kB
6.92 kB
✓

framework.HA..dule.js gzip
39.1 kB
39.1 kB
✓

Overall change
52.4 kB
52.4 kB
✓

Legacy Client Bundles (polyfills)

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

polyfills-HASH.js gzip
26.3 kB
26.3 kB
✓

Overall change
26.3 kB
26.3 kB
✓

Client Pages

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_app.js gzip
1.26 kB
1.26 kB
✓

_error.js gzip
3.25 kB
3.25 kB
✓

hooks.js gzip
881 B
881 B
✓

index.js gzip
222 B
222 B
✓

link.js gzip
2.06 kB
2.06 kB
✓

routerDirect.js gzip
279 B
279 B
✓

withRouter.js gzip
278 B
278 B
✓

Overall change
8.22 kB
8.22 kB
✓

Client Pages Modern

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_app.module.js gzip
604 B
604 B
✓

_error.module.js gzip
2.04 kB
2.04 kB
✓

hooks.module.js gzip
383 B
383 B
✓

index.module.js gzip
223 B
223 B
✓

link.module.js gzip
1.52 kB
1.52 kB
✓

routerDirect..dule.js gzip
281 B
281 B
✓

withRouter.m..dule.js gzip
278 B
278 B
✓

Overall change
5.33 kB
5.33 kB
✓

Client Build Manifests

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_buildManifest.js gzip
61 B
61 B
✓

_buildManife..dule.js gzip
61 B
61 B
✓

Overall change
122 B
122 B
✓

Serverless bundles

zeit/next.js canary
timneutkens/next.js fix/csp-example
Change

_error.js
844 kB
844 kB
✓

404.html
4.18 kB
4.18 kB
✓

hooks.html
3.81 kB
3.81 kB
✓

index.js
844 kB
844 kB
✓

link.js
882 kB
882 kB
✓

routerDirect.js
874 kB
874 kB
✓

withRouter.js
874 kB
874 kB
✓

Overall change
4.33 MB
4.33 MB
✓

authors: ijjk timneutkens