text:
Youtube: Only downloading last 2 hours of 3 hour video. (with hack as a workaround)

Checklist

[x] I'm reporting a broken site support
[x] I've verified that I'm running youtube-dl version 2020.07.28
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar issues including closed ones

Verbose log
$ youtube-dl --verbose https://www.youtube.com/watch?v=7q2E_dMf-PA -f 160+139 -o test.mp4
[debug] System config: ['--prefer-free-formats']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=7q2E_dMf-PA', '-f', '160+139', '-o', 'test.mp4']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.05.29
[debug] Python version 3.8.5 (CPython) - Linux-5.7.12-200.fc32.x86_64-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[youtube] 7q2E_dMf-PA: Downloading webpage
[youtube] 7q2E_dMf-PA: Downloading m3u8 information
[youtube] 7q2E_dMf-PA: Downloading MPD manifest
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597463882/ei/6Qg3X-PLPOTpiwTDgZGYCw/ip/[REDACTED]/id/7q2E_dMf-PA.0/source/yt_live_broadcast/requiressl/yes/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/beids/23886217/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIhAIYKJYy_vhL6FN2sN8JmwtZUzthfIEC1uyLBsWLFRF1-AiBSi_MHyF2FME9Q96eTwBDWUYjupTJnp_MoVJcxOVW74Q%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: test.f160.mp4
[download] 100% of 104.01MiB in 29:48
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597463882/ei/6Qg3X-PLPOTpiwTDgZGYCw/ip/[REDACTED]/id/7q2E_dMf-PA.0/source/yt_live_broadcast/requiressl/yes/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/beids/23886217/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIhAIYKJYy_vhL6FN2sN8JmwtZUzthfIEC1uyLBsWLFRF1-AiBSi_MHyF2FME9Q96eTwBDWUYjupTJnp_MoVJcxOVW74Q%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: test.mp4.f139
[download] 100% of 64.95MiB in 30:09
[ffmpeg] Merging formats into "test.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i file:test.f160.mp4 -i file:test.mp4.f139 -c copy -map 0:v:0 -map 1:a:0 file:test.temp.mp4
Deleting original file test.f160.mp4 (pass -k to keep)
Deleting original file test.mp4.f139 (pass -k to keep)

Description
On that page,the youtube player in firefox shows the video is 3:01:49 in length, and plays fully at that length. While youtube-dl downloads and exits cleanly, it only downloads the last 2:00:00 of it. This happens with both the dash and hls manifests I've tried.
$ ffmpeg -i test.mp4 -f null -
...
frame=216000 fps=8600 q=-0.0 Lsize=N/A time=02:00:00.00 bitrate=N/A speed= 287x
...

Is there a workaround or proper method to grab the full video which is available to play on the site?
This is likely related to issue #26290.
Edit: the output is from an older youtube-dl, but the results are the same on my boox with v. 2020.07.28
Edit 2: streamlink also gets only 2 hours from hls. How does youtube player do it?!
Edit 3: Well, I'm not sure what the youtube player is doing, but I was able to hack the missing fragments into place...
First, I wrote out the info.json for the url.
Then I edited the json and found the first fragment in the stream:
      "fragments": [
        {
          "path": "sq/1855/lmt/1597197498473364",
          "duration": 2
        },

Then I generated all the fragments from 0 to 1854:
$ for F in {0..1854} ; do echo -e "\t{\n\t  \"path\": \"sq/${F}\",\n\t  \"duration\": 2\n\t}," ; done > missing.txt
$ head -n 10 missing.txt
	{
	  "path": "sq/0",
	  "duration": 2
	},
	{
	  "path": "sq/1",
	  "duration": 2
	},
	{
	  "path": "sq/2",

I then inserted these missing fragments before fragment 1855 in the json and saved it.
Then I was able to run youtube-dl against this .json with:
youtube-dl  -f 139 --load-info-json test.info.json -o test.m4a

And got the full length stream saved, as the fragments are on the server, just not enumerated in the manifest.
It would seriously suprise me if this is what the web player is doing to get the full stream.
Maybe the youtube plugin can check to see if fragments start at 0, if not check if 0 is on the server, and compensate for the incomplete manifest as a work around?

Youtube is definitely up to something new as this phenomenon is something I haven't seen before and it started about 5-6 days ago? As most of you know livestreams used to only display the last 2 hours even on the webpage for X amount of time until they got processed into a VOD.
Now it seems like the videos are instantly viewable on the webpage from start to finish with some missing features(Chat replay). However Youtube-dl only seems to grab the last 2 hours regardless.
I might be repeating what has already been said but since the "Processing into a VOD" could be different from person to person depending on your region, I wanted to throw out that I'm experiencing the exact same thing, which likely everybody is.

Same issue here.
$ command youtube-dl --version
2020.07.28

$ command youtube-dl --verbose 'https://www.youtube.com/watch?v=Mm0KCzYpMhQ'
[debug] System config: []
[debug] User config: ['--ignore-errors', '--no-mtime', '--console-title']
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=Mm0KCzYpMhQ']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.07.28
[debug] Python version 3.8.3 (CPython) - Linux-5.7.9-arch1-1-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.3.1, ffprobe 4.3.1, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] Mm0KCzYpMhQ: Downloading webpage
[youtube] Mm0KCzYpMhQ: Downloading m3u8 information
[youtube] Mm0KCzYpMhQ: Downloading MPD manifest
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597700011/ei/S6M6X_zOHpOcs8IPi7SF-Ak/ip/50.999.999.85/id/Mm0KCzYpMhQ.1/source/yt_live_broadcast/requiressl/yes/tx/23908007/txs/23908006%2C23908007/hfr/all/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Ctx%2Ctxs%2Chfr%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIgaBMCXhRtrGe2SeAHys3agvoV10DHyPqygiCOG-_PfjcCIQCBWI3JoZSHDc-Eu5xkAU2Xi_Jpll4aYzVP1m4HEE0g3A%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: 【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f299.mp4
[download] 100% of 3.01GiB in 10:12
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597700011/ei/S6M6X_zOHpOcs8IPi7SF-Ak/ip/50.999.999.85/id/Mm0KCzYpMhQ.1/source/yt_live_broadcast/requiressl/yes/tx/23908007/txs/23908006%2C23908007/hfr/all/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Ctx%2Ctxs%2Chfr%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIgaBMCXhRtrGe2SeAHys3agvoV10DHyPqygiCOG-_PfjcCIQCBWI3JoZSHDc-Eu5xkAU2Xi_Jpll4aYzVP1m4HEE0g3A%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: 【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f140.m4a
[download] 100% of 151.43MiB in 06:39
[ffmpeg] Merging formats into "【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i 'file:【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f299.mp4' -i 'file:【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f140.m4a' -c copy -map 0:v:0 -map 1:a:0 'file:【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.temp.mp4'
Deleting original file 【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f299.mp4 (pass -k to keep)
Deleting original file 【APEX耐久】ダイアモンドになるまで終わらないラストバトル！！【湊あくあ】-Mm0KCzYpMhQ.f140.m4a (pass -k to keep)

The result was the exactly last 2 hours of the 6:54:07 video. Using Firefox for Linux or YouTube app for Android, the video can be played without any problems though Chat Replay hasn't been made available yet.

Same problem, actually I spent whole evening on downloading the video repeatedly and found that it's the audio that is limited to 2-hour duration caused the problem. No matter bitrate, both 139 and 140 have a duration of 2:00:00 while the video is exactly 3:17:51 of length.

Same problem, but it seems like the problem disappears after up to 2 days since the live stream has been finished (please mind it when trying to reproduce the issue).

OP of the linked issue here (on a new account, don't worry about it I'm just dumb...). Yes, they are basically the same issue. Or rather, your issue is more current because YouTube has literally changed how they handle livestream recordings in the past week. When I posted my issue, livestream recordings were clipped on the YouTube site just like what youtube-dl is giving until the processing finishes. Now the full video is available to browser users but youtube-dl is still somehow finding the clipped one. So I agree this now looks like a genuine bug.
(As an aside, this is not the first time the full recording has been available to regular desktop browser users. There was a period of about a week a month or two ago where I could consistently get the full video, but only in chrome, not firefox. That was possibly a trial run for what we're seeing now. After that period it went back to the 2 hour clipped recording that has been standard for years.)
The work-around you posted by editing the json to include the missing fragments is very neat but without trying a bunch of cases I'm not sure how robust it is. If you would rather just filter these videos and wait for processing to occur (for people with relatively automated workflows), I've had success with using filesize after duration broke. Specifically, the filesize shows as null or NA for fragmented videos but will give the real size after processing. This might break some random old video somewhere though so use it with caution.
As a word of warning for anyone else this comes up for, I've run into some very weird cases experimenting with youtube-dl on unprocessed livestreams over 2 hours in the past week. In one case, the video and audio were both downloaded normally (well, slowly, since downloading fragmented files is slow, but no errors or anything), but when they were combined I was left with just a 15 second long video from somewhere in the middle and the audio was gibberish. I also saw a case where when I called youtube-dl, there were literally 0 formats available, like it saw there was a video but it couldn't get any data at all, but subsequent calls couldn't reproduce that result.

I went to grab this livestream 5 hours after it was finished, https://www.youtube.com/watch?v=VMfaFRPGvvM. It downloaded complete with the dash_manifest using youtube-dl.
Interested to see if any changes occurred in the manifest, I wrote out the info.json and inspected it.
The manifest was still in fragments form, but instead of 2 second fragments, it listed 5 second fragments.
This is a change on youtube's end. and might be youtube's way of fixing this problem for us? The previous manifests were showed 2 second fragments with a limit of 3600 fragments (2 hours) before it lost the starting ones.
With 5 second fragments, 3600 fragments would be 5 hours, making the bug only show up on livestreams over 5 hours in length.

@bittaurus

making the bug only show up on livestreams over 5 hours in length?

No. Here is a live archive which has just finished being streamed minutes ago: https://www.youtube.com/watch?v=Esl7kGD5FdE. Although the web player has no problem with it, youtube-dl gives the last 2 hours of 3:26:08, using dash manifest. It occurs even when I use hls manifest:
url=$(curl --silent 'https://www.youtube.com/watch?v=Esl7kGD5FdE' | grep -o 'https:\\/\\/[^"]\+googlevideo.com\\/[^"]\+' | grep 'hls_variant' | sed 's/\\//g')
ffmpeg -i "${url}" out.mkv #=> The same result. The problem is not specific to youtube-dl.

@bittaurus
This behavior existed before; in fact the 2 hour duration is new and was added when YouTube made several improvements to their livestream platform like increasing supported max resolution and adding low latency options. Depending on the settings for the livestream, the fragments can be 1s, 2s, 5s, and maybe other amounts. I have seen the clipped version of the video be a maximum of 2 hours, 4 hours, 5 hours, or maybe more (and it can be less than these if the livestream goes offline and back online again; only the final X hours of the stream, as it was shown in realtime, will be available. So you may see 1:58:30 clipped recordings if there were connection issues, for example). The settings that matter in determining this are (most importantly) the latency setting, the (source) resolution, framerate, and possibly bitrate. Higher settings lead to shorter durations but I do not know exactly what formula YouTube is using. It is not just a fixed number of fragments; you will find 2 hour videos with 3600 fragments or 7200 (2s vs 1s), and a 4 hour clip with 5s fragments is 2880 which I'm pretty sure I've seen.
I have no way of knowing for sure, but it is likely the stream you were looking at was not using low latency settings, and while it is 1080p, it is only 30fps. So being able to get 4 or 5 hours of the video rather than 2 (which was enough for the full video in this case) is not a surprise. That is what you would have seen in a browser as well up until about a week ago.

Here's a quick bash script to insert the fragments into a .info.json file.  It assumes the same number of fragments are missing from every fragmented stream (which is true for every case I've seen so far.)  It relies on gnu seq and gnu sed.
#!/bin/bash
#
# fixfragx [file.info.json]

[ ! -s "${1}" ] && echo -e "Usage: fixfragx [filename.info.json]\n\nInserts missing begining youtube fragments into youtube-dl --write-info-json file." && exit

FRAGS=$(sed -e 's/^.*"fragments": \[{"path": "sq\///' -e 's/\/.*$//' "${1}")
[ "${FRAGS}" == "" ] || [ "${FRAGS}" == "0" ] && echo "no missing fragments foun
d." && exit

((--FRAGS))
echo "missing fragments {0..${FRAGS}} found."

INSERT=$(for F in $(seq 0 ${FRAGS}) ; do echo -n "{\"path\": \"sq/${F}/\"}, " ; done)
sed -i 's_"fragments": \[_"fragments": \['"${INSERT}"'_g' "${1}"

[ "$?" == "0" ] && echo "missing fragments have been inserted." && exit
echo "error with insertion of missing fragments."
exit

Good luck.

Here is a batch script to generate the missing fragments (you first have to replace the first fragment number, the last fragment number and the duration):
@echo off
for /L %%g in (0,1,6222) do (
echo:        {>>fragments.txt
echo:          "path": "sq/%%g",>>fragments.txt
echo:          "duration": ^2>>fragments.txt
echo:        },>>fragments.txt
)

First, I wrote out the info.json for the url.
Then I edited the json and found the first fragment in the stream:
      "fragments": [
        {
          "path": "sq/1855/lmt/1597197498473364",
          "duration": 2
        },

Then I generated all the fragments from 0 to 1854:
$ for F in {0..1854} ; do echo -e "\t{\n\t  \"path\": \"sq/${F}\",\n\t  \"duration\": 2\n\t}," ; done > missing.txt
$ head -n 10 missing.txt
	{
	  "path": "sq/0",
	  "duration": 2
	},
	{
	  "path": "sq/1",
	  "duration": 2
	},
	{
	  "path": "sq/2",

I then inserted these missing fragments before fragment 1855 in the json and saved it.
Then I was able to run youtube-dl against this .json with:

Where you get this data?
Where you get info.json?
Where you found the first fragment?

Checklist

[x]  I'm reporting a broken site support
[x]  I've verified that I'm running youtube-dl version 2020.07.28
[x]  I've checked that all provided URLs are alive and playable in a browser
[x]  I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x]  I've searched the bugtracker for similar issues including closed ones

Verbose log
$ youtube-dl --verbose https://www.youtube.com/watch?v=7q2E_dMf-PA -f 160+139 -o test.mp4
[debug] System config: ['--prefer-free-formats']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--verbose', 'https://www.youtube.com/watch?v=7q2E_dMf-PA', '-f', '160+139', '-o', 'test.mp4']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2020.05.29
[debug] Python version 3.8.5 (CPython) - Linux-5.7.12-200.fc32.x86_64-x86_64-with-glibc2.2.5
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[youtube] 7q2E_dMf-PA: Downloading webpage
[youtube] 7q2E_dMf-PA: Downloading m3u8 information
[youtube] 7q2E_dMf-PA: Downloading MPD manifest
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597463882/ei/6Qg3X-PLPOTpiwTDgZGYCw/ip/[REDACTED]/id/7q2E_dMf-PA.0/source/yt_live_broadcast/requiressl/yes/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/beids/23886217/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIhAIYKJYy_vhL6FN2sN8JmwtZUzthfIEC1uyLBsWLFRF1-AiBSi_MHyF2FME9Q96eTwBDWUYjupTJnp_MoVJcxOVW74Q%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: test.f160.mp4
[download] 100% of 104.01MiB in 29:48
[debug] Invoking downloader on 'https://manifest.googlevideo.com/api/manifest/dash/expire/1597463882/ei/6Qg3X-PLPOTpiwTDgZGYCw/ip/[REDACTED]/id/7q2E_dMf-PA.0/source/yt_live_broadcast/requiressl/yes/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cwebm2_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm2_sd_hd_clear/force_finished/1/vprv/1/keepalive/yes/fexp/23883098/beids/23886217/itag/0/playlist_type/DVR/sparams/expire%2Cei%2Cip%2Cid%2Csource%2Crequiressl%2Cas%2Cforce_finished%2Cvprv%2Citag%2Cplaylist_type/sig/AOq0QJ8wRQIhAIYKJYy_vhL6FN2sN8JmwtZUzthfIEC1uyLBsWLFRF1-AiBSi_MHyF2FME9Q96eTwBDWUYjupTJnp_MoVJcxOVW74Q%3D%3D'
[dashsegments] Total fragments: 3600
[download] Destination: test.mp4.f139
[download] 100% of 64.95MiB in 30:09
[ffmpeg] Merging formats into "test.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel repeat+info -i file:test.f160.mp4 -i file:test.mp4.f139 -c copy -map 0:v:0 -map 1:a:0 file:test.temp.mp4
Deleting original file test.f160.mp4 (pass -k to keep)
Deleting original file test.mp4.f139 (pass -k to keep)

Description
On that page,the youtube player in firefox shows the video is 3:01:49 in length, and plays fully at that length. While youtube-dl downloads and exits cleanly, it only downloads the last 2:00:00 of it. This happens with both the dash and hls manifests I've tried.
$ ffmpeg -i test.mp4 -f null -
...
frame=216000 fps=8600 q=-0.0 Lsize=N/A time=02:00:00.00 bitrate=N/A speed= 287x
...

Is there a workaround or proper method to grab the full video which is available to play on the site?
This is likely related to issue #26290.
Edit: the output is from an older youtube-dl, but the results are the same on my boox with v. 2020.07.28
Edit 2: streamlink also gets only 2 hours from hls. How does youtube player do it?!
Edit 3: Well, I'm not sure what the youtube player is doing, but I was able to hack the missing fragments into place...
First, I wrote out the info.json for the url.
Then I edited the json and found the first fragment in the stream:
      "fragments": [
        {
          "path": "sq/1855/lmt/1597197498473364",
          "duration": 2
        },

Then I generated all the fragments from 0 to 1854:
$ for F in {0..1854} ; do echo -e "\t{\n\t  \"path\": \"sq/${F}\",\n\t  \"duration\": 2\n\t}," ; done > missing.txt
$ head -n 10 missing.txt
	{
	  "path": "sq/0",
	  "duration": 2
	},
	{
	  "path": "sq/1",
	  "duration": 2
	},
	{
	  "path": "sq/2",

I then inserted these missing fragments before fragment 1855 in the json and saved it.
Then I was able to run youtube-dl against this .json with:
youtube-dl  -f 139 --load-info-json test.info.json -o test.m4a

And got the full length stream saved, as the fragments are on the server, just not enumerated in the manifest.
It would seriously suprise me if this is what the web player is doing to get the full stream.
Maybe the youtube plugin can check to see if fragments start at 0, if not check if 0 is on the server, and compensate for the incomplete manifest as a work around?

i did the same but have onli audio.
How can i get full stream with video?

It seems YouTube on browser access the video meta from completely different endpoint currently (most likely directly embedded in the page).
The desktop YouTube web itself did not use the dash manifest nor the hls manifest at all.
The page only contains a the base url and duration of the segment.
And it use JavaScript to compute the segment index against current video time.
And sign it with the same method it used to sign the download url in manifest.
That is probably the reason youtube is able to play the whole vod on browser normally even the dash manifest it returned is incomplete

It seems YouTube on browser access the video meta from completely different endpoint currently (most likely directly embedded in the page).
The desktop YouTube web itself did not use the dash manifest nor the hls manifest at all.
The page only contains a the base url and duration of the segment.
And it use JavaScript to compute the segment index against current video time.
And sign it with the same method it used to sign the download url in manifest.
That is probably the reason youtube is able to play the whole vod on browser normally even the dash manifest it returned is incomplete

Issue is still present =(

Based on the workaround above, I wrote a little Node script to add the missing fragments for each format:
addMissingFragments.zip
To use:

Install a recent version of Node.js
Extract addMissingFragments.js somewhere and open a command window in that location
Run the following commands, substituting the youtube video URL for [youtube-url]:

youtube-dl --output video --skip-download --write-info-json [youtube-url]
node addMissingFragments video.info.json
youtube-dl --load-info-json video.info.json

If you want to download a specific format or add other arguments that affect the output file, add them to the 3rd line (the one that loads the modified json).
Note: This script is very simple and wouldn't be able to handle changes to the fragment path structure.

@ehoogeveen-medweb Thanks, I was able to download a complete 7+ hour MPD livestream by adding the missing fragments using your script.

Many thanks to @ehoogeveen-medweb for the script to add missing segments.
Wrote a simple .bat file to automate the upload process, you need to put the addMissingFragments.js file next to the batch file, run MissingFragments-dl and insert the link
MissingFragments-dl.zip

Thanks for this report. I faced the same issue recently with this live stream.
I would not have noticed the problem if I had not checked the resulting file generated by youtube-dl.
The logs show a very low number of total segments: e.g. [dashsegments] Total fragments: 7159 (which should be around 29000).
It would be nice if Youtube-dl could warn the user, and perhaps allow to force downloading from segment number 0 by implementing the hacks mentioned above.
That video is probably still being processed by YT at the time of writing, so I'll wait for YT to fix itself on this one but that is not ideal for "emergency archivists" (ie. streams that suddenly get deleted by their author without warning).

I guess compute the segment number and insert id yourself isn't technically a "workaround"?
Because youtube actually never generate a full manifest for it.
Even the youtube web page itself compute that by itself.
If you watch it on youtube before fully processed.
The debug information actually says it is operated under a "manifest-less" mode.

youtube-dl --load-info-json video.info.json --format "bestvideo[protocol=http_dash_segments]+bestaudio"

Thank you, this worked!

sss_dg_****

2: Sometimes fragments use ranges instead of indices. Not much can be done about those, so skip those formats. Also try to select the most common duration if there are multi

I tried this command a few times and it doesn't seem to download audio. There's no metadata for audio bitrate or anything, it just isn't there. Is there a way I can specify an audio format with this command? Downloading them separately isn't even working for me right now.

Same problem, but it seems like the problem disappears after up to 2 days since the live stream has been finished (please mind it when trying to reproduce the issue).

That seems very straightforward. But otherwise we need to back-port https://github.com/yt-dlp/yt-dlp/pull/5091.

authors: Bagunda Cyame DeffoDan Fruktlimpa InternationalYamAgain ThePirate42 Tribalwarrior XaNaNtX bittaurus ddscentral dirkf ehoogeveen-medweb fuomag9 glubsy jmolinski mmis1000 razor91111 your-diary

repo: ytdl-org/youtube-dl


text:
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden

Checklist

[x ] I'm reporting a broken site support issue
[x] I've verified that I'm running youtube-dl version 2020.07.28
[x] I've checked that all provided URLs are alive and playable in a browser
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x] I've searched the bugtracker for similar bug reports including closed ones
[x] I've read bugs section in FAQ

Verbose log

PASTE VERBOSE LOG HERE

john@JohnPC:~$ youtube-dl https://www.bbc.co.uk/iplayer/episode/b01kvmmz/line-of-duty-series-1-episode-3 -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.bbc.co.uk/iplayer/episode/b01kvmmz/line-of-duty-series-1-episode-3', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.07.28
[debug] Python version 2.7.17 (CPython) - Linux-4.15.0-112-generic-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg N-98569-g37f5fec, ffprobe N-98569-g37f5fec
[debug] Proxy map: {}
[bbc.co.uk] b01kvmmz: Downloading video page
[bbc.co.uk] b01kvmmz: Downloading playlist JSON
[bbc.co.uk] b01kvmmq: Downloading media selection XML
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[debug] Default format spec: bestvideo+bestaudio/best
^C
ERROR: Interrupted by user
john@JohnPC:~$ youtube-dl https://www.bbc.co.uk/iplayer/episode/b01kvmmz/line-of-duty-series-1-episode-3 -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://www.bbc.co.uk/iplayer/episode/b01kvmmz/line-of-duty-series-1-episode-3', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2020.07.28
[debug] Python version 2.7.17 (CPython) - Linux-4.15.0-112-generic-x86_64-with-Ubuntu-18.04-bionic
[debug] exe versions: ffmpeg N-98569-g37f5fec, ffprobe N-98569-g37f5fec
[debug] Proxy map: {}
[bbc.co.uk] b01kvmmz: Downloading video page
[bbc.co.uk] b01kvmmz: Downloading playlist JSON
[bbc.co.uk] b01kvmmq: Downloading media selection XML
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading MPD manifest
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
[bbc.co.uk] b01kvmmq: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on u'https://vod-dash-uk-live.bbcfmt.hs.llnwd.net/usp/auth/vod/piff_abr_full_hd/6d3343-b01kvmmq/vf_b01kvmmq_60068a9c-c5c0-4840-94a7-d46faccf3b93.ism.hlsv2.ism/iptv_hd_abr_v1_dash_master.mpd?s=1597647815&e=1597691015&h=107b7bd401a79a6f4a17a7a806d552c5'
[dashsegments] Total fragments: 918
[download] Destination: Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4
[download] 100% of 2.04GiB in 01:22:50
[debug] Invoking downloader on u'https://vod-dash-uk-live.bbcfmt.hs.llnwd.net/usp/auth/vod/piff_abr_full_hd/6d3343-b01kvmmq/vf_b01kvmmq_60068a9c-c5c0-4840-94a7-d46faccf3b93.ism.hlsv2.ism/iptv_hd_abr_v1_dash_master.mpd?s=1597647815&e=1597691015&h=107b7bd401a79a6f4a17a7a806d552c5'
[dashsegments] Total fragments: 918
[download] Destination: Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-audio_eng_1=128000.m4a
[download] 100% of 54.42MiB in 01:18:08
[ffmpeg] Merging formats into "Line of Duty, Series 1, Episode 3-b01kvmmq.mp4"
[debug] ffmpeg command line: ffmpeg -y -loglevel 'repeat+info' -i 'file:Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4' -i 'file:Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-audio_eng_1=128000.m4a' -c copy -map '0:v:0' -map '1:a:0' 'file:Line of Duty, Series 1, Episode 3-b01kvmmq.temp.mp4'
Deleting original file Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4 (pass -k to keep)
Deleting original file Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-audio_eng_1=128000.m4a (pass -k to keep)
john@JohnPC:~$
Description

Get a number of "WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden".
youtube-dl runs very slowly: takes a few minutes before download starts.
Theoretically my broadband is 70+ mbps. Speedtest shows 30+ mbps download.
It took hours to download 100% of the programme & then create the .mp4 file. The mp4 file played OK.

I accidentally copied & pasted an invalid try's log. But I am not able to delete it.
There are also a number of files created which I am not able to delete e.g. Line of Duty, Series 1, Episode 3-b01kvmmq.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4.part-Frag225

source: gharchive/issue

license: Unlicense

license_type: permissive

license_source: github-api


text:
[core] add autonumber_reset (closes #29158)

Before submitting a pull request make sure you have:

[x] Searched the bugtracker for similar pull requests
[x] Read adding new extractor tutorial
[x] Read youtube-dl coding conventions and adjusted the code to meet them
[ ] Covered the code with tests (note that PRs without tests will be REJECTED)
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[ ] Improvement
[ ] New extractor
[x] New feature

Autonumber Reset
I encountered an issue while attempting to use autonumber recently. I was attempting to download some playlists from the YouTube channel Crash Course. For each series, they have a preview video that functions as an "Episode 00". With one playlist, this is simple enough to fix. You simply add --autonumber-start 0 and use %(autonumber)02d for episode indexing.
However, issues arise when passing in multiple playlists. Youtube-DL supports a variable number of URL's to be processed. When multiple playlists are passed in, the autonumber does not reset between operands. This makes sense if you're passing in individual video URL's and want them to be indexed, but for me it is important that each series have it's own indexing starting from 00.
For additional context, I am downloading these videos to be used with a media server that references TVDB. Having the "first" episode (i.e. the second video in the playlist) indexed as 01 is important to ensure that the metadata is mapped properly. So, %(playlist_index)02d doesn't satisfy my use case, and %(autonumber)02d in its current state requires me to pass in each playlist as a separate youtube-dl command.
I could have solved this problem by creating a PowerShell wrapper that batched a series of playlists and sent separate youtube-dl commands for each, but it seemed like others might benefit from having the ability to reset this counter in the future. I tested the reset functionality via local execution, but did not see an applicable space for autonumber tests in the current suite.
This is my first open-source PR submission, so feedback and advice would be appreciated. Thank you!

@dstftw Hi there! Is there something else I should be doing before this PR is further reviewed? Should it be closed and another be opened? I'm not sure what the feedback process is for this repo

source: gharchive/pull-request


text:
css file can't be parsed by css-loader because of invalid @import: url() statement

Hey, I get the following error when using the Dropdown component:
ERROR in ./node_modules/@create-figma-plugin/ui/lib/css/base.css 1:0
Module parse failed: Unexpected character '@' (1:0)
You may need an appropriate loader to handle this file type, currently no loaders are configured to process this file. See https://webpack.js.org/concepts#loaders
> @import url('https://fonts.googleapis.com/css?family=Inter:400,600&display=swap');
|
| :root {
 @ ./node_modules/@create-figma-plugin/ui/lib/utilities/render.js 1:0-26
 @ ./node_modules/@create-figma-plugin/ui/lib/index.js
 @ ./src/app/components/studio/Toolbar/DropdownPlain/DropdownPlain.tsx
 @ ./src/app/components/App.tsx
 @ ./src/app/index.tsx

My webpack configuration is perfectly fine to parse this base.css file, but unfortunately, the @import: url() can't be handled properly.
webpack config
...
      {
        test: /\.css$/,
        loaders: ['style-loader', 'css-loader']
      }
...

Why to remove the @import and use a  tag instead:
https://stackoverflow.com/a/12380004/6854385

Unfortunately use of the @create-figms-plugin/ui package with Webpack is not officially supported at the moment. All components will work out-of-the-box if you use the build-figma-plugin CLI (see the docs)

Thanks for you quick answer, appreciate it very much!! :)
Is there any possibility to move the @import statement out of the base.css?
Although it's not best practice, it can't be parsed by webpack in this way.
Everything except of this tiny line is working perfectly.
Thank you!!

Looking at the Webpack CSS loader docs, it should be able to handle @import statements in CSS…?
https://webpack.js.org/loaders/css-loader/#import

With the suggested configuration, I get the following:
ERROR in ./node_modules/@create-figma-plugin/ui/lib/css/base.css 1:0
Module parse failed: Unexpected character '@' (1:0)
You may need an appropriate loader to handle this file type, currently no loaders are configured to process this file. See https://webpack.js.org/concepts#loaders
> @import url('https://fonts.googleapis.com/css?family=Inter:400,600&display=swap');
|
| :root {
 @ ./node_modules/@create-figma-plugin/ui/lib/utilities/render.js 1:0-26
 @ ./node_modules/@create-figma-plugin/ui/lib/index.js 222:0-47 222:0-47
 @ ./src/app/components/studio/Toolbar/DropdownPlain/DropdownPlain.tsx 2:0-51 18:31-39
 @ ./src/app/components/App.tsx 8:0-73 60:56-69
 @ ./src/app/index.tsx 3:0-35 5:36-39

authors: felixhaeberle yuanqing

repo: yuanqing/create-figma-plugin

license: MIT


text:
如何在设置了cacheTimeInSeconds缓存这种情况下更新缓存。

请问当我在Api中设置了cacheTimeInSeconds值大于0，但我又想在有些时间强制从网络去取数据，那该怎么做呢？
看到有个    startWithoutCache方法，但是不支持Block，请问如何操作？是不是我需要在每次请求的时候动态设置   cacheTimeInSeconds 大于0或等于0来区分从网络取数据还是从缓存取数据？

可以在start之前设置ignoreCache，也可以使用startWithoutCache，通过delegate回调

通过设置ignoreCache可以了。
-(id)initWithParamDict:(NSDictionary *)paramDict andUseCache:(BOOL)useCache{
    self= [super init];
    if (self) {
        _paramDict=paramDict;
    }
    self.ignoreCache=!useCache;
    [self addAccessory:[YTKAnimatingRequestAccessory accessoryWithAnimatingText:nil]];
    return self;
}

authors: jbasttdi lancy

repo: yuantiku/YTKNetwork

license: mit

license_source: bigquery


text:
Webpack and others

I am not sure it's ok to distribute jsx files, webpack can't recongize it by default and I suppose we should not have to BabelScriptize node.js code. It would quickly escalate into super long and brittle builds.

Anyway, very nice work.

@steida Thxs

@steida Thxs

@steida Thxs

+1, it doesn't work with browserify & babelify
import {PulseLoader} from 'halogen';
Error : Cannot find module 'reactify' from '/Users/.../node_modules/halogen'
Obviously, I don't have reactify module in my project (just babelify), but I am not quite sure, why browserify&babelify can't handle the build.
Anyway, it's a good idea to commit the all-in one browserified file without JSX and use it as the main file.

@tajo Added reactify as dependencies, is it ok in halogen@0.1.4?

@yuanyan It is. Thanks! I really like this lib.

I got the same error from the latest version (0.1.8) and had to downgrade to 0.1.4 make it work with browserify.

authors: aybarshazar steida tajo yuanyan

repo: yuanyan/halogen


text:
Some small fixes

I'm using the amazing tool in a personal project and I implement some fixes I needed.
The fixes are

Add static keyword on member functions
Fix static keyword string
Fix inheritance string.
Close file where c++ code is written in the destruct of the cpp code generator (pease, check if this is ok)

I would like to add also the possibility of adding custom types to classes, like using/ typedef. What would be the best methodology?

Thank you for your contribution!
Is it okay if I ask you to add a small unit test?
The project suffers from a lack of meaningful test cases.
You can add class CppUsing, e.g.
using = CppArray(name='vec', value='std::vector<int, alloc<int>>') which can be rendered as  using vec = std::vector<int, Alloc>;`
In the class declaration it can be rendered between enums and nested classes.

@rafaelrojasmiliani If you don't have time for tests now it's fine of course
Just tell me, I will accept your PR anyway

I Added a small test on the file creation. But I don't have an idea of how to test for a code generation.

@rafaelrojasmiliani
You can take a look at existing tests
Creating C++ file:
https://github.com/yuchdev/code_generator/blob/master/tests/test_cpp_file.py
Creating in-memory-writer
https://github.com/yuchdev/code_generator/blob/master/tests/test_cpp_function_writer.py

I think it's fine, I approve the PR

authors: rafaelrojasmiliani yuchdev


text:
representation

A neural net typically accepts a vector(n-D array of numbers) as input. Therefore, a process needs to convert a graph into vectors before the neural net does learn and predict: every node, every edge, every property needs to be a vector(fixed dimension).
Adjacency matrix (2-D array) can represent the topology and weights, but the matrix is not invariant for different node ordering and might confuse the neural net.

Distributed Representations of Sentences and Documents:
problem: defined in its reference papers...
approach: convert every word, sentence, paragraph into a vector using neural net, then predict something with some classifier

The representation seems to be the key to every door - as soon as we get a good representation method for all things we care about, we can train the neural net to predict many things. The representation should be the same concept as the "feature vector" (which is usually engineered out of the object's raw intrinsic attributes).
For a long time, I thought the most powerful capability of neural net is that it can use the raw intrinsic attributes(e.g., pixels in image recognition #6 , spectrograms in speech recognition #5 ) so that no feature engineering is needed, but now I think its capability of representing things is way more powerful: it can represent concepts: abstract things without intrinsic attributes (like good and evil). These concepts have no intrinsic attributes but have relations with each other (like Jedi are good; Sith are evil; good and evil are opposite; so are Jedi and Sith). In a sense, these concepts are defined by their relations.
Among all the deep learning applications I've seen so far, the most inspiring one is natural language processing, because it uses a very simple and effective approach to represent concepts: every concept is a vector of numbers, a point in the concept space. Most of representations of the same concept are meaningless, providing no information about the concept (like 狗, الكلب, dog, [0, 0, 1, 0, 0...0], etc... these are different representations for a same concept in Chinese, Arabic, English and a one-hot representation). However, a neural net can represent concepts in its concept space so that their representations become meaningful: its relations with other concepts are their geometric relations (like vector(king) - vector(man) + vector(woman) = vector(queen)).
The most interesting part is that the neural net does not get these vector representations from anywhere - it can learn them in a unsupervised way. The only thing we need to show them the relations of these concepts through a large corpus of text (e.g., given: cheetahs move fast; cheetahs have high speed; cheetahs are predators..., the neural net can represent cheetahs, speed, fast, predators with some meaningful vectors).
This capability of concept representation provides a new approach to graph mining for abstract networks where entities cannot be very well represented by its intrinsic attributes. For example, symptoms, diseases and patients can be viewed as concepts in a diagnoses network: they are not defined by their intrinsic attributes, but by their relations. Can a neural net learn good representations for them given sufficient training data? After that, can it do something like given patient, sequence of symptoms, predict the disease? For another example, users, activities, hobbies, advertisements can be viewed as concepts in social network. Can a neural net represent them and predict the advertisement a user will like given his activities?

Good observations. As we discussed in our meeting, with graphs as the input, there is still a challenge for how to represent graphs at a low level (e.g., vector, or sequence of vectors) for input to a neural net. But as long as the representation does not lose too much information from the original graph, the network should be able to learn the complex interaction among features, and features of features, etc., that capture the salient relationships necessary for the classification/prediction task.

I guess the current deep learning techniques are ready for that challenge - if it works for natural langues, it should work for all abstract things more or less the same:
9. we decompose the graph into abstract things: users, activities, advertisements, movies, etc
9. a neural net learns to map things(high dimension one-hot vectors) to concept points(low dimension feature vectors) in concept space, unsupervised learning
9. another neural net learns to do the prediction, supervised learning

I should keep a list of typical entities and their representations:

entity
attributes (intrinsic, physical)
relations (external, abstract)

image
512 x 512 pixel array
NA

speech
spectrogram sequence
NA

words/phrases
NA
other words and phrases

music
spectrogram sequence
artist, genre, fans, ratings

person
age, weight, height...
hobbies, other persons, movies, ads...

protein
primary sequence, spacial structure...
function, symptoms, diseases

Ah, I see now what you mean by "relation". You can disregard the comment on issue #8. I generally use relation to describe a relationship between the main entities in the domain. E.g., one song is "similar" to another, or one user is the "sibling" of another user.  So, for example with your customer entity in the list above, I would also include hobbies as an attribute of a customer. But sometimes it's not a clear answer as to whether something is a relation or an attribute, especially when there are multiple entity types in the domain (e.g., users, songs, artists).

BTW, good idea to keep this list. Hopefully we'll eventually discern some best practices for how to represent different domains.

Thanks! I like the table too. Regarding the terminology system, I also like to use a domain agnostic system - there're too many domain specific dialects in these papers.

Dynamic graphs seem to make distinctions between attributes and relations clear.
Observation
For example, user U rated music m1, m2, m3... r1, r2, r3... has 2 views:

relation view (abstract user): U has relations with m1, m2, m3..., but no attributes;
attribute view (physical user) U has attributes [r1, r2, r3 ...];

However, the 1st one works in dynamic graphs: e.g. when a few songs show up, the 2nd one requires updating the neural net's architecture, while the first one preserve the user representation.
Conclusion
Don't represent entities directly with their relations to other entities with dynamic total size.

@Xiaomi2008 , here is our earlier study on the representation of nodes and edges in a graph. The idea is mostly inspired by NLP with DNN, e.g. word2vec and Distributed Representations of Sentences and Documents.

Found this paper on arxiv relevant to this discussion. "Deep Convolutional Networks on Graph-Structured Data" by Mikael Henaff, Joan Bruna, Yann LeCun.
http://arxiv.org/abs/1506.05163.

authors: lbholder yuchenhou

repo: yuchenhou/elephant


text:
Several pages giving Unauthorized access error

Did I miss a step when setting up saltshaker?
I am getting errors regard
Traceback:
File "/usr/local/lib/python2.7/dist-packages/django/core/handlers/base.py" in get_response
132.                     response = wrapped_callback(request, *callback_args, **callback_kwargs)
File "/usr/local/lib/python2.7/dist-packages/django/contrib/auth/decorators.py" in _wrapped_view
22.                 return view_func(request, *args, **kwargs)
File "/home/ubuntu/cloudconfig/saltshaker/states_config/views.py" in highstate_result
149.     sapi = SaltAPI()
File "/home/ubuntu/cloudconfig/saltshaker/shaker/shaker_core.py" in init
20.         content = self.postRequest(obj, prefix='/login')
File "/home/ubuntu/cloudconfig/saltshaker/shaker/shaker_core.py" in postRequest
29.         opener = urllib2.urlopen(req)
File "/usr/lib/python2.7/urllib2.py" in urlopen
154.     return opener.open(url, data, timeout)
File "/usr/lib/python2.7/urllib2.py" in open
435.             response = meth(req, response)
File "/usr/lib/python2.7/urllib2.py" in http_response
548.                 'http', request, response, code, msg, hdrs)
File "/usr/lib/python2.7/urllib2.py" in error
473.             return self._call_chain(*args)
File "/usr/lib/python2.7/urllib2.py" in _call_chain
407.             result = func(*args)
File "/usr/lib/python2.7/urllib2.py" in http_error_default
556.         raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
Exception Type: HTTPError at /states_config/highstate_result/
Exception Value: HTTP Error 401: Unauthorized

Exception Value: HTTP Error 401: Unauthorized
check your user and passowrd of saltapi

repo: yueyongyue/saltshaker


text:
🛑 API Server is down

In caf465f, API Server ($API_SITE) was down:

HTTP code: 404
Response time: 2149 ms

Resolved: API Server is back up in b0333c9.

repo: yukbid/upptime


text:
mk_exercise を利用して，exercise を本文から生成する

mk_exercise を実行し，Tutorial ディレクトリの内容から Exercise ディレクトリに演習問題を出します．
GitHub Action により，mk_exercise の出力結果を自動的にコミットします．

TutorialディレクトリをSolutionディレクトリに改名したほうがよいように思います

Lecture0.mdはExerciseディレクトリに置きたいです

誤ってクローズしてしまい，reopen できなくなりました

authors: Seasawher yuma-mizuno

repo: yuma-mizuno/lean-math-workshop


text:
fix(region): vm_sync_isolated_device i18n

What this PR does / why we need it:

Does this PR need to be backport to the previous release branch?:

/area region
/cc @swordqiu

repo: yunionio/cloudpods


text:
避免OpenStack未设置默认值,导致认证失败

这个 PR 实现什么功能/修复什么问题:
避免OpenStack未设置默认值,导致认证失败
是否需要 backport 到之前的 release 分支:

release/2.10.0

Codecov Report

Merging #1076 into master will not change coverage.
The diff coverage is n/a.

@@          Coverage Diff           @@
##           master   #1076   +/-   ##
======================================
  Coverage     7.9%    7.9%
======================================
  Files         356     356
  Lines       56477   56477
======================================
  Hits         4464    4464
  Misses      51618   51618
  Partials      395     395

Flag
Coverage Δ

#aFlag
7.9% <ø> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9e1e8f5...2596b70. Read the comment docs.

/lgtm
/approve

authors: codecov-io ioito swordqiu

repo: yunionio/onecloud


text:
Automated cherry pick of #2128: kvm elb fix

Cherry pick of #2128 on release/2.11.
#2128: kvm elb fix

Codecov Report

:exclamation: No coverage uploaded for pull request base (release/2.11@4b00d34). Click here to learn what that means.
The diff coverage is 0%.

@@              Coverage Diff               @@
##             release/2.11   #2129   +/-   ##
==============================================
  Coverage                ?   7.15%
==============================================
  Files                   ?     451
  Lines                   ?   70284
  Branches                ?       0
==============================================
  Hits                    ?    5030
  Misses                  ?   64842
  Partials                ?     412

Flag
Coverage Δ

#aFlag
7.15% <0%> (?)

Impacted Files
Coverage Δ

pkg/compute/models/loadbalancers.go
1.82% <0%> (ø)

pkg/compute/models/loadbalancerclusters.go
6.2% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4b00d34...0320e01. Read the comment docs.

/approve
/lgtm

authors: codecov-io tb365 yousong


text:
fix: 支持同步经典网络ip地址

这个 PR 实现什么功能/修复什么问题:

支持同步经典网络ip地址
支持腾讯云特殊的cloud_pro存储

是否需要 backport 到之前的 release 分支:

release/2.12

/area region
/cc @swordqiu @yousong

Codecov Report

Merging #4347 into master will decrease coverage by <.01%.
The diff coverage is 0%.

@@            Coverage Diff            @@
##           master   #4347      +/-   ##
=========================================
- Coverage    6.87%   6.87%   -0.01%
=========================================
  Files         521     521
  Lines       88094   88191      +97
=========================================
+ Hits         6055    6059       +4
- Misses      81533   81627      +94
+ Partials      506     505       -1

Flag
Coverage Δ

#aFlag
6.87% <0%> (-0.01%)
:arrow_down:

Impacted Files
Coverage Δ

pkg/compute/models/guests.go
0.55% <ø> (ø)
:arrow_up:

pkg/multicloud/esxi/vnic.go
0% <0%> (ø)
:arrow_up:

pkg/compute/models/vpcs.go
1.48% <0%> (-0.07%)
:arrow_down:

pkg/multicloud/ucloud/instancenic.go
0% <0%> (ø)
:arrow_up:

pkg/compute/models/networks.go
0.54% <0%> (-0.01%)
:arrow_down:

pkg/compute/models/wires.go
1.86% <0%> (-0.12%)
:arrow_down:

pkg/multicloud/aws/instancenic.go
0% <0%> (ø)
:arrow_up:

pkg/compute/guestdrivers/qcloud.go
3.7% <0%> (-0.12%)
:arrow_down:

pkg/keystone/models/users.go
1.72% <0%> (ø)
:arrow_up:

pkg/cloudcommon/db/lockman/inmemory.go
67.07% <0%> (+2.43%)
:arrow_up:

... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d4ed948...0da5ddb. Read the comment docs.

/lgtm

/lgtm

/lgtm

/lgtm

/approve

authors: codecov-io ioito swordqiu yousong


text:
Bugfix: backport fix

这个 PR 实现什么功能/修复什么问题:
backport bugfix import from libvirt
是否需要 backport 到之前的 release 分支:

/cc @swordqiu

/lgtm
/approve

authors: swordqiu wanyaoqi


text:
Automated cherry pick of #8493: fix(region): roll back the optimization of cachedimage list

Cherry pick of #8493 on release/3.4.
#8493: tmp

/lgtm
/approve

authors: rainzm zexi


text:
Skip tasks that fail setup (rather than crashing)

When harness/run_setup.py fails for a task we get a crash rather than a helpful message.
Also I think it would be better if tasks that fail setup are skipped rather than causing the whole run to fail.
Here is the failure that occurs because Miniconda on arm64 doesn't support Python 3.6:
(auto-code-rover) root@2ae90efb13f1:/opt/auto-code-rover# cd /opt/SWE-bench
echo django__django-11133 > tasks.txt
(auto-code-rover) root@2ae90efb13f1:/opt/SWE-bench# cd /opt/SWE-bench
conda activate swe-bench
python harness/run_setup.py --log_dir logs --testbed testbed --result_dir setup_result --subset_file tasks.txt
2024-04-15 03:05:28,024 - INFO - env_name for all setup entries: ['setup_django__django__3.0']
2024-04-15 03:05:28,024 - INFO - Starting parallel setup.
2024-04-15 03:05:28,024 - INFO - 	Number of setup tasks: 1
2024-04-15 03:05:28,024 - INFO - 	Number of processes: 1
2024-04-15 03:05:28,024 - INFO - [setup_django__django__3.0] ======= Start setting up for django/django 3.0 =======
2024-04-15 03:07:48,933 - INFO - [setup_django__django__3.0] Cloned django/django to /opt/SWE-bench/testbed/django__django/setup_django__django__3.0
2024-04-15 03:07:49,092 - INFO - [setup_django__django__3.0] Creating environment setup_django__django__3.0; Command: /opt/conda/bin/conda create -n setup_django__django__3.0 python=3.6 -y
2024-04-15 03:07:50,584 - ERROR - Error: Command '['/opt/conda/bin/conda', 'create', '-n', 'setup_django__django__3.0', 'python=3.6', '-y']' returned non-zero exit status 1.
2024-04-15 03:07:50,585 - ERROR - Error stdout: Channels:
 - defaults
Platform: linux-aarch64
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... failed

2024-04-15 03:07:50,585 - ERROR - Error stderr:
PackagesNotFoundError: The following packages are not available from current channels:

  - python=3.6*

Current channels:

  - defaults

To search for alternate channels that may provide the conda package you're
looking for, navigate to

    https://anaconda.org

and use the search bar at the top of the page.

2024-04-15 03:07:50,587 - ERROR - Error traceback: Traceback (most recent call last):
  File "/opt/SWE-bench/harness/context_manager.py", line 49, in __call__
    output = subprocess.run(cmd, **combined_args)
  File "/opt/conda/envs/swe-bench/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/opt/conda/bin/conda', 'create', '-n', 'setup_django__django__3.0', 'python=3.6', '-y']' returned non-zero exit status 1.

Done with setup.
setup_map is saved to setup_result/setup_map.json
tasks_map is saved to setup_result/tasks_map.json
Traceback (most recent call last):
  File "/opt/SWE-bench/harness/run_setup.py", line 440, in <module>
    main(**vars(args))
  File "/opt/SWE-bench/harness/run_setup.py", line 382, in main
    setup_one_repo_version(*entry)
  File "/opt/SWE-bench/harness/run_setup.py", line 233, in setup_one_repo_version
    create_conda_env(repo_full, version, repo_path, env_name, task)
  File "/opt/SWE-bench/harness/run_setup.py", line 132, in create_conda_env
    exec_wrapper(cmd.split(" "))
  File "/opt/SWE-bench/harness/context_manager.py", line 57, in __call__
    raise e
  File "/opt/SWE-bench/harness/context_manager.py", line 49, in __call__
    output = subprocess.run(cmd, **combined_args)
  File "/opt/conda/envs/swe-bench/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/opt/conda/bin/conda', 'create', '-n', 'setup_django__django__3.0', 'python=3.6', '-y']' returned non-zero exit status 1.

I plan to submit a suitable PR shortly.

same error with you. Have you fixed it? really need some help and thank u so much.

repo: yuntongzhang/SWE-bench


text:
Question with LogViewer and .csv files

I accidentally opened the .csv files with microsoft excel. And now the LogViewer stop to record any of those logs now. I tried to download a KCV but it didn't work. What should I do to fix that?

You mean while they're opened in Excel or even after you closed them?
If they're not locked by Excel, then Logger will add new entries (you can check KanColleViewer*/Logs/*.csv with any text editor) and LogViewer will display things properly (unless Excel somehow messed up the format, check the files, or move them out of Logs directory).

I'd believe that Excel somehow messed up the whole setting for .csv files. I tried to move them out of the Logs folder, and it won't even create new .csv files any more. And I'm not quite sure how to check if they are locked by Excel.

Should't be locked if you can move/delete them.
So, no BuildItemLog.csv or BuildShipLog.csv when you build item or ship? Even if you delete/backup the whole thing and download and extract KCV into some other folder?

Nope, it didn't work. But the strange thing is that it still won't fix even after I uninstalled Excel from my computer.

Well, maybe it's not Excel then, the Logger and LogViewer both are quite simple, they just write and read files, I don't know what can possibly go wrong here.
Maybe see https://github.com/KCV-Localisation/KanColleViewer/blob/master/FAQ.md, if permissions are right, you can also try to delete %APPDATA%\grabacr.net\ folder, start KCV from its directory and check the settings, including Logging checkbox in Settings -> Other (it's disabled by default).

Yeah, deleting that folder is right! No wonder why it always remembers my proxy server. Thank you! :)

repo: yuyuvn/KanColleViewer


text:
How to download pretrained model?  bucket_namespace

Hello author, could you provide the download link of ResNet50 and ResNet101? I don't know the bucket_namespace and bucket_name in the download script. I downloaded two pretrained models from other place but the size dosen't match. Thanks.

Besides, I am new to semantic segmentation task and don't know how to preprocess cityscape data. Could you please give me some instructions?

Thanks for your interest.
The download link for the pre-trained model is same as the CPS, and you can find them in here. Please don't worry about those bucket_namespaces, they are for k8s & dgx-clustering launch. You can train our approach in the normal way.
The processed cityscapes can be found in this repository, and please note that the directory for the cityscapes follow this structure:
city_scape/
├── annotation
│   └── city_gt_fine
│       ├── train
│       └── val
└── images
    └── city_gt_fine
        ├── train
        └── val

Best,
Yuyuan

Thank you!
发自我的iPhone

在 2022年8月4日，下午1:28，Yuyuan Liu @.***> 写道：

Thanks for your interest.
The download link for the pre-trained model is same as the CPS, and you can find them in here. Please don't worry about those bucket_namespaces, they are for k8s & dgx-clustering launch. You can train our approach in the normal way.
The processed cityscapes can be found in this repository, and please note that the directory for the cityscapes follow this structure:
city_scape/
├── annotation
│   └── city_gt_fine
│       ├── train
│       └── val
└── images
└── city_gt_fine
├── train
└── val
Best,
Yuyuan
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.

Sorry. I didn't find the processed cityscapes in this repository. There are only original files not processed files.

Hi Yuyuan,
How can I get the SegmentationClassAug? I found SegmentationClass and SegmentationClassAug in vocsplit/*.txt. While, there is no SegmentationClassAug in pascalVOC.

@LPXTT The related download address can be found in this repository (here)[https://github.com/yassouali/CCT] for the SegmentationClassAug. For a brief explaination, the Pascal VOC 12 contains around ~1400 official (high-quality) labels and ~9000 unofficial low-quality labels. The SegmentationClassAug should contain those low-quality labels.

Thank you!


text:
checkboxes with array model

How do I get something like this to work?:

  <input
    type='checkbox'
    value='{{ language }}'
    v-model='myLanguages'>

What exactly are you wanting to happen?
If it's a list of checkboxes and their checked state, you could hold the languages as an object rather than a string.

  <input
    type='checkbox'
    value='{{ language.name }}'
    v-model='language.checked'>

You can then use a filter/map to retrieve the names of the selected languages.
Here's a jsfiddle demonstrating it. http://jsfiddle.net/rmp135/v9vx9qyd/

I guess the use case is to use the check boxes in a similar manner that
your use a select with the ability to select multiple selections.  Sort of
a "check all that apply" scenario, where the checkables come from an array
of possibilities.
On Jul 12, 2015 9:43 AM, "rmp135" notifications@github.com wrote:

What exactly are you wanting to happen?
If it's a list of checkboxes and their checked state, you could hold the
languages as an object rather than a string.

You can then use a filter/map to retrieve the names of the selected
languages.
Here's a jsfiddle demonstrating it. http://jsfiddle.net/rmp135/v9vx9qyd/
—
Reply to this email directly or view it on GitHub
https://github.com/yyx990803/vue/issues/1037#issuecomment-120721497.

Old example here: http://jsfiddle.net/yyx990803/1onz2ho7/1/
Please open questions like this at vuejs/Discussion instead of the core repo.


text:
I think there is a bug in the implementation of bpc

According to the material I have find from here and here, bpc=log2(NLL).
But in the implementation in your code, I found that bpc = NLL / log2.
Is there something wrong for the calculation of bpc, or I have missed anything?

My implementation follows the definition of BPC in https://arxiv.org/pdf/1308.0850.pdf (page 8) and aligns with the implementation with Transformer-XL, and adaptive-span transformer and the StackOverflow thread you posted.
For the paper you mentioned, I think that's a typo in the paper. NLL has already applied a log to the input: https://pytorch.org/docs/stable/generated/torch.nn.NLLLoss.html#torch.nn.NLLLoss.

OK， I got it , thanks


text:
Development V0.7.8.2

All Submissions Basics:

[ ] Have you followed the guidelines in our Contributing document?
[ ] Have you checked to ensure there aren't other open Pull Requests for the same update/change?
[ ] Have you checked all Issues to tie the PR to a specific one?

All Submissions Cores:

[ ] Have you added an explanation of what your changes do and why you'd like us to include them?
[ ] Have you written new tests for your core changes, as applicable?
[ ] Have you successfully ran tests with your changes locally?
[ ] Does your submission pass tests, including CircleCI, Travis CI, and AppVeyor?
[ ] Does your submission have appropriate code coverage? The cutoff threshold is 95% by Coversall.

New Model Submissions:

[ ] Have you created a .py in ~/pyod/models/?
[ ] Have you created a _example.py in ~/examples/?
[ ] Have you created a test_.py in ~/pyod/test/?
[ ] Have you lint your code locally prior to submission?

Pull Request Test Coverage Report for Build 1434

6 of 6 (100.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.001%) to 95.532%

Totals

Change from base Build 1421:
-0.001%

Covered Lines:
4405

Relevant Lines:
4611

💛  - Coveralls


text:
Show Page Flex

Laravel Version: 5.8
PHP Version: 7.3
Laravel-admin: 1.8

Description:
非常感谢@z-song 提供的laravel-admin 管理系统， 目前我们团队有很多项目在使用它!
但是我们最近遇到一个问题，在某些项目里面， 单个模型可能字段比较多， 导出 详情页面展示太长,  观看很不方便
目前试过像form 一样的column 尝试去多列布局, 但是并没有效果 ， 想问 这样的需要怎样处理 ?
感谢！
Steps To Reproduce:

参考文档 https://laravel-admin.org/docs/zh/content-layout#自定义页面内容

repo: z-song/laravel-admin


text:
Registration behaviour doesn't respect replacing

It throws exception even when we are just replacing an existing registration.

released in v3.1.1


text:
Domains matching

I want to add domains matching for SaaS products to use middleware/chains depending on domains.

+1 Yes please

Closing for now - I've this in Linear as task and will come back when it's ready


text:
Build fails on Ubuntu 24.04 Server

When following the instructions on Ubuntu 24.04 Server, I stubmled at the following:

Missing dependencies for lxml:Collecting lxml==4.5.2 (from -r requirements.txt (line 22))
  Downloading lxml-4.5.2.tar.gz (4.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 19.1 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [4 lines of output]
      <string>:64: DeprecationWarning: pkg_resources is deprecated as an API. See
https://setuptools.pypa.io/en/latest/pkg_resources.html
      Building lxml version 4.5.2.
      Building without Cython.
      Error: Please make sure the libxml2 and libxslt development packages are installed.
      [end of output]

That can be solved by apt install libxml2-dev libxslt-dev
Missing header:  creating build/temp.linux-x86_64-cpython-312/src/lxml
  x86_64-linux-gnu-gcc -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -fPIC -DCYTHON_CLINE_IN_TRACEBACK=0 -I/usr/include/libxml2 -Isrc -Isrc/lxml/includes -I/opt/PTZController/include -I/usr/include/python3.12 -c src/lxml/etree.c -o build/temp.linux-x86_64-cpython-312/src/lxml/etree.o -w
  src/lxml/etree.c:289:12: fatal error: longintrepr.h: No such file or directory
    289 |   #include "longintrepr.h"
        |            ^~~~~~~~~~~~~~~
  compilation terminated.
  Compile failed: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1
  creating tmp
  cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInitky6mao9b.c -o tmp/xmlXPathInitky6mao9b.o
  cc tmp/xmlXPathInitky6mao9b.o -lxml2 -o a.out
  error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1

That can be solved by:cd /usr/include
ln -s python3.12/cpython/longintrepr.h

A very long list of build errors during lxml.etree compilation, starting with:  building 'lxml.etree' extension
  creating build/temp.linux-x86_64-cpython-312/src/lxml
  x86_64-linux-gnu-gcc -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -fPIC -DCYTHON_CLINE_IN_TRACEBACK=0 -I/usr/include/libxml2 -Isrc -Isrc/lxml/includes -I/opt/PTZController/include -I/usr/include/python3.12 -c src/lxml/etree.c -o build/temp.linux-x86_64-cpython-312/src/lxml/etree.o -w
  src/lxml/etree.c: In function ‘__pyx_gb_4lxml_5etree_16C14NWriterTarget_4generator1’:
  src/lxml/etree.c:5535:45: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘curexc_type’
   5535 | #define __Pyx_PyErr_Occurred()  __pyx_tstate->curexc_type
        |                                             ^~

Doesn't look like there is a fast fix for that.

I will take a look at this issue. It probably has to do with the newer release of python. When I last built this is was on an earlier release. Don't recall the release. Until I update it, you might try an earlier release of python.
Thanks for reporting this issue. Sorry for the issue.

I updated the requirements so that it should now work with any release of python.

repo: zSeriesGuy/PTZController


text:
fix: type validation error for profile_picture property (getClip)

Minor fix for getClip error caused by channels and users without a profile picture
{
  errors: [
    ValidationErrorItem {
      path: 'clip.channel.profile_picture',
      code: 'type',
      message: 'Not a string',
      value: undefined
    }
  ]
}

Thanks, merged and release published

authors: ahmedrangel zSoulweaver

repo: zSoulweaver/kient


text:
Allow multiple documents opening

hello
Could be nice to allow multiple opening feature, when we want open more than one document, we get only one markdown document.
Others documents are opened with default editor or preview feature.
Thanks

I'm using this for note-taking, and being able to use the WYSIWYG editor with more than one file or pane at a time would make my setup perfect.

authors: Blayr camlafit

repo: zaaack/vscode-markdown-editor


text:
Cannot download the firmware found by Bifrost on Ubuntu Linux

Hi @zacharee
Trying Bifrost on Ubuntu Linux, installed from package bifrost_1.18.13_amd64.deb.
Bifrost is able to find the latest firmware for my SM-A546B device but on download attempt I have following error message:

Any suggestions?
BR,
Ladislav

I think this has something to do with your network configuration, possibly from some MITM certificate VMware installs. I can't reproduce this in Parallels.

authors: laheller zacharee

repo: zacharee/SamloaderKotlin


text:
Add traced/1 decorator

Our documentation is currently incorrect, as it claims that a traced/1 decorator exists that would allow for adding context to the parent span.

This topic creates actually another question, why do we even need to distinguish between trace & span at the moment? Why just not have always a span, and create a parent/trace when we are missing it? I think this was actually the original implementation.
At the moment from what I saw we only log error, instead of creating span instead.

You might be right about that.
Not necessarily disagreeing, but some more food for thought: The top level span is special as far as  dd is concerned. For instance, it is the only one that needs to have the http metadata, and whether or not it is an error is what dictates whether or not the whole trace is an error. Other implementations (I think this is how Google/Stackdriver tracing is set up) have the trace as a discreet entity that contains spans, so having an explicit entry point for starting a trace would be better for extending to other adapters. Also, imagine that someone forgot to start a span around the primary call that they want to trace, and that thing calls 100 functions sequentially, all of which are spanned. If we do it for them, then they will get 100 traces, one for each thing they intended to be a span, which isn't really what they wanted.

I'll take care of this issue tomorrow or the day after. We can upgrade the decorator library that we use to also really clean these up, as they now support default arguments in decorators.

repo: zachdaniel/spandex


text:
App crashes on Apple monteray - crash report points to electron

The crash report specifically mentions Electron:
Process:               Scourhead [1823]
Path:                  /Applications/Scourhead.app/Contents/MacOS/Scourhead
Identifier:            com.zachrattner.scourhead
Version:               1.0.1 (1.0.1)
Code Type:             X86-64 (Native)
Parent Process:        launchd [1]
User ID:               503
Date/Time:             2024-12-31 10:06:09.6099 +0200
OS Version:            macOS 12.7.6 (21H1320)
Report Version:        12
Bridge OS Version:     3.0 (14Y910)
Anonymous UUID:        CB8C375F-842D-B812-15E4-4F38B015E15A
Time Awake Since Boot: 340 seconds
System Integrity Protection: enabled
Crashed Thread:        0  Dispatch queue: com.apple.main-thread
Exception Type:        EXC_BREAKPOINT (SIGTRAP)
Exception Codes:       0x0000000000000002, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY
Termination Reason:    Namespace SIGNAL, Code 5 Trace/BPT trap: 5
Terminating Process:   exc handler [1823]
Thread 0 Crashed::  Dispatch queue: com.apple.main-thread
0   Electron Framework            	       0x11e372adf ares_dns_rr_get_name + 28682239
1   Electron Framework            	       0x11e36a11c ares_dns_rr_get_name + 28646972
2   Electron Framework            	       0x11a5d2780 node::GetEnvironmentIsolateData(node::Environment*) + 7845696
3   Electron Framework            	       0x11a5d26dd node::GetEnvironmentIsolateData(node::Environment*) + 7845533
4   Electron Framework            	       0x11a92e971 node::AsyncResource::get_trigger_async_id() const + 311457
5   Electron Framework            	       0x11e36ea38 ares_dns_rr_get_name + 28665688
6   Electron Framework            	       0x11a92e861 node::AsyncResource::get_trigger_async_id() const + 311185
7   Electron Framework            	       0x11a7e1fa9 v8::CppHeap::CollectGarbageInYoungGenerationForTesting(cppgc::EmbedderStackState) + 301833
8   Electron Framework            	       0x11a73ac31 v8::Unwinder::PCIsInV8(unsigned long, v8::MemoryRange const*, void*) + 136865
9   Electron Framework            	       0x11a73bcb9 v8::Unwinder::PCIsInV8(unsigned long, v8::MemoryRange const*, void*) + 141097
10  Electron Framework            	       0x11ad01204 v8::internal::TickSample::print() const + 713972
11  Electron Framework            	       0x11a5fb653 v8::Isolate::Initialize(v8::Isolate*, v8::Isolate::CreateParams const&) + 259
12  Electron Framework            	       0x11e5634ec ares_dns_rr_get_name + 30716428
13  Electron Framework            	       0x11915e07f v8::BackingStore::MaxByteLength() const + 190463
14  Electron Framework            	       0x119141327 v8::BackingStore::MaxByteLength() const + 72359
15  Electron Framework            	       0x11b926dc4 v8::internal::compiler::CompilationDependencies::FieldTypeDependencyOffTheRecord(v8::internal::compiler::MapRef, v8::internal::compiler::MapRef, v8::internal::InternalIndex, v8::internal::compiler::ObjectRef) const + 7544628
16  Electron Framework            	       0x11b92a63a v8::internal::compiler::CompilationDependencies::FieldTypeDependencyOffTheRecord(v8::internal::compiler::MapRef, v8::internal::compiler::MapRef, v8::internal::InternalIndex, v8::internal::compiler::ObjectRef) const + 7559082
17  Electron Framework            	       0x11b9264d8 v8::internal::compiler::CompilationDependencies::FieldTypeDependencyOffTheRecord(v8::internal::compiler::MapRef, v8::internal::compiler::MapRef, v8::internal::InternalIndex, v8::internal::compiler::ObjectRef) const + 7542344
18  Electron Framework            	       0x1193e8a3e v8::CodeEvent::GetScriptLine() + 546062
19  Electron Framework            	       0x1193e9a4d v8::CodeEvent::GetScriptLine() + 550173
20  Electron Framework            	       0x1193e98a8 v8::CodeEvent::GetScriptLine() + 549752
21  Electron Framework            	       0x1193e82ca v8::CodeEvent::GetScriptLine() + 544154
22  Electron Framework            	       0x1193e83b2 v8::CodeEvent::GetScriptLine() + 544386
23  Electron Framework            	       0x119048765 ElectronMain + 245
24  dyld                          	       0x10e4c552e start + 462

Thanks @reuvenneumann let me test this out and I can bring this into main after testing.  Appreciate the help!

authors: reuvenneumann zachrattner

repo: zachrattner/scourhead


text:
vue-router 3.x support

If I switch the vue-router version to the "^3.1.3" I got the following error:
Error: Redirected from "/page1?vnk=f733d010" to "/page2" via a navigation guard.

As I understand the vue-router complains about the repeating the same redirect twise:
Redirect 1: "/page2"
Redirect 2: "/page2?vnk=123"
Is there any 3.x support planned guys? If not can somebody recommend any similar package availabe on npmjs with vue-router 3.x support?
Error reference: https://router.vuejs.org/guide/advanced/navigation-guards.html#global-before-guards
Stackoverflow: https://stackoverflow.com/questions/62223195/vue-router-uncaught-in-promise-error-redirected-from-login-to-via-a

@fairking https://github.com/hezhongfeng/vue-page-stack

@fairking I will support vue-router 3.x when vue 3.x and vue-router3.x is realese,now U can closed this issue.

authors: fairking hezhongfeng


text:
Update chapter 7 save API

The previous way of exporting an hybridized model as advertised in Chapter7 does not work anymore in 1.2.0 impacting users who relied on this technique to save their models @piiswrong is working on a fix to keep supporting the old behavior.
In the meanwhile there is a new cleaner API for exporting a hybridized model using .export(), which replace the old advertised way and I have updated the notebook accordingly.
In the works is also SymbolBlock.imports() that will let you import directly the exported model back to Gluon, ETA end of this week.
Please refer to: https://github.com/apache/incubator-mxnet/pull/11127
@piiswrong @zackchase @srochel @szha
New wording:

Thanks @ThomasDelteil!! -- we should discuss generally how to make the info on saving better documented in the book, adding to earlier sections on serialization (not just hybridize where that's not the main purpose). Would you be keen to identify best spots for that info an contribute a section/notebook?

no worries @zackchase! Sure as soon as we have the imports() function, I think it would be nice indeed to add a 3rd section on serialization of hybridized models, building on what is available here: https://mxnet.incubator.apache.org/tutorials/gluon/save_load_params.html#saving-model-parameters-and-architecture-to-file

authors: ThomasDelteil zackchase

repo: zackchase/mxnet-the-straight-dope


text:
How do I change file?

When I first configured the extension I specified the files to use. If I want to use another set of files, how do I change that? I can't find it under settings. Do I have to delete the old files to re-initialize the configuration?

The setting for that is in the popup menu. The file icon.

Figured it out. Great extension! Finally I can organize myself :)


text:
Add an offset to the text link underline

It looks a bit nicer for a text link to have its underline slightly offset (Shadcn etc. do)

Looks great! Thanks for the PR!

authors: gregmsanderson zaichaopan


text:
First event is lost

First event is lost if earliest known offset is 0 because cursor in X-Nakadi-Consumer header is set to 0 (should be -1, i.e., 1 before the required offset).

Assumes the offset on each cursor is not inclusive (i.e., first delivered Event is the
first one after the one pointed to in the cursor).

(see https://github.com/zalando/nakadi/blob/master/api/nakadi-event-bus-api.yaml)
Config used:

partitionCoordinatorProvider: simple

SimplePartitionCoordinator uses either newest_available_offset or oldest_available_offset depending on
startNewestAvailableOffset configuration parameter.
http://localhost:8080/event-types/order.ORDER_RECEIVED/partitions provides following result after

0 events
[{"oldest_available_offset":"0","newest_available_offset":"BEGIN","partition":"0"}]
1 event
[{"oldest_available_offset":"0","newest_available_offset":"0","partition":"0"}]
2 events
[{"oldest_available_offset":"0","newest_available_offset":"1","partition":"0"}]

were published.
In case of startNewestAvailableOffset is true, offset is set to consume next event which will be published (and not last one which has been published).
Using oldest_available_offset should give you possibility to replay events.
In such a case decrementing the value would be really necessary.

authors: CasianOlga everesio


text:
Fix for issue #1340

Fixes # .
Fix for extra formdata parameter error in parameter validator
Changes proposed in this pull request:
removed validate_parameter_list function from parameter validator

Hi @vijaya2497. Thanks for the PR, but commenting out functionality is not a good solution. Closing this one in favor of #1374.

repo: zalando/connexion


text:
Add for support relative paths in schema refs -- updated.

Refs #461
Refs #254
Updates #543
From #543:
"Fix to allow the json schema validation to handle relative refs by passing in the spec file path. This will only work when passing a file path to add_api and not a dict.
Note: This will only work with response validation disabled. There are more changes required to support local refs elsewhere in the code."

Thanks for the contribution!
What's needed for this to not break response validation?
Somewhat of an aside, when I was writing this I remember something about an "id" field that allows you to set the base_url from inside the spec. The code is here if you want to look into it.

Sorry, that "Note: This will only work with response validation disabled. There are more changes required to support
local refs elsewhere in the code." was from the description from the original PR #543.
I'm new to the code base, so I'll have to lean on others to help answer that for me.  I'm thinking that note is no longer relevant, but I'm not sure what testing I need to do. Any help?

The main breakage I can think of is that the spec that is served to the UI/client is the raw unresolved json spec.
We'll need to figure out how to serve up all of the files so that the client can use them as well.
What I'm wondering is if the use case is (a) to help the developer break up a spec file, or (b) to serve multiple files to the client. I can't yet understand why serving multiple files to the client would be ideal.
Looking back through older tickets, I'll second that jinja templating is probably the best way of splitting up yaml specs if it's for developer convenience only.

Yes. I'd really like to improve working with swaggerui. I'm currently referencing https://zalando.github.io/problem/schema.yaml in my openapi specs, but swagger ui does not like that.

@cognifloyd is swagger-ui unable to resolve remote yaml?

authors: cognifloyd crunk1 dtkav


text:
authorization

did anyone already look into this? can we easily set this up for this appliance?
https://github.com/Netflix/exhibitor/wiki/Authentication-Setup

One of the 'solutions' of this problem would be to build a tunnel with piu. Maybe documentingin the README of how to build a tunnel, would be enough.
But solving a problem of Jetty configuration to use STUPS OAuth infrastructure is an interesting task by itself.

we've been using for half a year now the https://github.com/zalando-stups/ssh-tunnels solution. will add a link to the Readme for this. this can be closed ...

authors: drummerwolli valgog

repo: zalando/exhibitor-appliance


text:
Ensuring accessibility and compatibility

Go to repository Settings and set up GitHub Pages (from the main branch), update repository description with the proper website link. Follow the link to check if everything is fine — you should see your index.html content.

For this activity you will need to update the style.css file that
considers the following tasks:
Compatible and Consistent: Use basic CSS that works in all modern browsers.
Secure: Form fields with basic validation.

Changes ok

repo: zamorajg/homepage


text:
Cloudwatch events errors out when APP_MODULE is not available in zappa_settings.yml

Zappa errors when APP_MODULE is not in zappa_settings.yml and CloudWatch events triggered to Lambda.
Context
When CloudWatch is configured to trigger a Lambda function deployed by Zappa (without  APP_MODULE in zappa_settings.yml) and the event data is {'awslogs': {'data': 'some_random_data'}}, the below error occurs,
{
  "errorMessage": "module 'zappa_settings' has no attribute 'APP_MODULE'",
  "errorType": "AttributeError",
  "stackTrace": [
    [
      "/var/task/handler.py",
      657,
      "lambda_handler",
      "return LambdaHandler.lambda_handler(event, context)"
    ],
    [
      "/var/task/handler.py",
      254,
      "lambda_handler",
      "return handler.handler(event, context)"
    ],
    [
      "/var/task/handler.py",
      495,
      "handler",
      "whole_function = \"{}.{}\".format(settings.APP_MODULE, settings.APP_FUNCTION)"
    ]
  ]
}

Expected Behavior
Lambda should not return an error
Actual Behavior
Lambda trigger is failing
Possible Fix
Check for APP_MODULE and APP_FUNCTION attributes in settings and log an error if it doesn't exist
https://github.com/rmithun/Zappa/pull/1/files
Steps to Reproduce
Create and deploy a lambda function with Zappa without APP_MODULE in zappa_settings.yml.
Go to the "Test" tab in the deployed lambda
Enter {"awslogs": {"data": "some_data"}}  and click test
You should see execution result as failed
Environment

Zappa version: 0.52.0
Operating System and Python version: Python 3.6
The output of pip freeze:

appdirs==1.4.4
argcomplete==1.12.3
asgiref==3.4.1
asn1crypto==1.2.0
atomicwrites==1.4.0
attrs==21.2.0
aws-xray-sdk==2.4.2
awscli==1.19.111
backcall==0.2.0
boto3==1.17.111
botocore==1.20.111
cached-property==1.5.2
cachetools==4.2.2
certifi==2021.5.30
cffi==1.14.6
cfn-flip==1.2.3
chardet==4.0.0
click==8.0.1
colorama==0.4.3
contextlib2==0.6.0.post1
coreapi==2.3.3
coreschema==0.0.4
coverage==4.5.3
coveralls==1.7.0
cryptography==3.3.1
datadog==0.28.0
decorator==5.0.9
defusedxml==0.7.1
Django==3.0.4
django-admin-actions==0.1.1
django-annoying==0.10.4
django-colorfield==0.1.15
django-cors-headers==3.2.1
django-enumfields==2.0.0
django-excel==0.0.10
django-extensions==3.1.3
django-filter==2.2.0
django-ical==1.4
django-money==1.0
django-multiselectfield==0.1.12
django-ordered-model==3.3.0
django-recurrence==1.10.2
django-requestlogging-redux==1.2.1
django-rest-multiple-models==1.8.2
django-ses==2.1.1
django-simple-history==2.8.0
django-storages==1.9.1
django-timezone-field==4.0
django-yearlessdate==1.3.1
djangorestframework==3.11.0
djangorestframework-csv==2.1.0
djangorestframework-jwt==1.11.0
docopt==0.6.2
docutils==0.14
drf-yasg==1.17.0
durationpy==0.5
pytest-flake8==1.0.4
python-dateutil==2.7.0
websocket-client==0.54.0
Werkzeug==0.16.1
whitenoise==4.1.3
wrapt==1.12.1
wsgi-request-logger==0.4.6
xlrd==2.0.1
xlwt==1.3.0
zappa==0.52.0
zeep==3.4.0
zipp==3.5.0

Your zappa_settings.yml:

common:
  django_settings:       *
  profile_name:           *
  project_name:          *
  runtime:               python3.6
  log_level:             INFO
  num_retained_versions: 10
  timeout_seconds:       300
  memory_size:           1512

development:
  extends:               common
  aws_region:            *
  s3_bucket:             *
  keep_warm:             false
  environment_variables:
    DEV_ENV:             "*"
    DB_PORT:             "*"
    DB_USER:             *
    DB_NAME:             *
    DB_HOST:             *

APP_MODULE is derived from app_function in your zappa_settings file.
Make sure that your app_function is configured correctly.

authors: monkut rmithun

repo: zappa/Zappa


text:
Websocket is not connected

By running
APKSIGNER_PATH=/home/learntheropes/Android/Sdk/build-tools/34.0.0/apksigner zapstore publish peach --overwrite-release

I get
ERROR WebSocket is not connected.

#0      _WebSocketImpl.connect (dart:_http/websocket_impl.dart:1011)
#1      WebSocket.connect (dart:_http/websocket.dart:320)
#2      WebSocketClient$VM.connect (package:ws/src/client/ws_client_vm.dart:102)
#3      WebSocketClient.connect.<anonymous closure>.<anonymous closure> (package:ws/src/client/ws_client.dart:116)
#4      new Future.sync (dart:async/future.dart:313)
#5      WebSocketClient.connect.<anonymous closure> (package:ws/src/client/ws_client.dart:116)
#6      WebSocketTask.call (package:ws/src/util/event_queue.dart:88)
#7      WebSocketEventQueue._exec.<anonymous closure> (package:ws/src/util/event_queue.dart:56)
#8      Future.doWhile.<anonymous closure> (dart:async/future.dart:720)
#9      _RootZone.runUnaryGuarded (dart:async/zone.dart:1594)
#10     _RootZone.bindUnaryCallbackGuarded.<anonymous closure> (dart:async/zone.dart:1633)
#11     Future.doWhile (dart:async/future.dart:735)
#12     WebSocketEventQueue._exec (package:ws/src/util/event_queue.dart:50)
#13     WebSocketEventQueue.push (package:ws/src/util/event_queue.dart:20)
#14     WebSocketClient.connect (package:ws/src/client/ws_client.dart:110)
#15     WebSocketPool.initialize (package:purplebase/src/pool.dart:29)
#16     RelayMessageNotifier.initialize (package:purplebase/src/relay.dart:115)
#17     publish (package:zapstore_cli/commands/publish.dart:47)
<asynchronous suspension>
#18     PublishCommand.run (package:zapstore_cli/main.dart:175)
<asynchronous suspension>
#19     CommandRunner.runCommand (package:args/command_runner.dart:212)
<asynchronous suspension>
#20     main (package:zapstore_cli/main.dart:37)
<asynchronous suspension>

What could be the issue?

I get ERROR WebSocket is not connected. just by running zapstore install myapp.apk

Which version are you running? zapstore -v

zap.store 0.1.0

Makes sense! 0.1.0 points to relay.zap.store which obviously is down. Please upgrade to 0.1.2 . https://zapstore.dev/download
In general, please try to make sure you are running the latest.

I switch with
git checkout 0.1.2
but I'm still on zap.store 0.1.0
How to fix?

I'm confused - you pull the code but what are you running?
I suggest the following IF you want to run from source:
git pull origin
git checkout 0.1.2
dart pub get
dart compile exe lib/main.dart -o zapstore-0.1.2
chmod +x zapstore-0.1.2
./zapstore-0.1.2

Once you run a new version of the program for the first time, it will auto-install itself. So at this point you can start using zapstore from your PATH. zapstore -v should return 0.1.2
If you run into version problems for whatever reason, try rm -f ~/.zapstore/zapstore and again

So, I'm running it from scratch:
git clone https://github.com/zapstore/zapstore-cli.git
cd zapstore-cli
git checkout 0.1.2
dart pub get
dart compile exe lib/main.dart -o zapstore-0.1.2
chmod +x zapstore-0.1.2
./zapstore-0.1.2

But when I run zapstore -v I get:
bash: /home/learntheropes/.zapstore/zapstore: No such file or directory

Sorry, my mistake I think: try ./zapstore-0.1.2 list - that should install. If it doesn't work please paste the output of the command here

authors: franzaps ildella learntheropes

repo: zapstore/zapstore-cli


text:
Makefile: add noop default action

this is similar to many other projects that are install-only, like xtools

alternatively, we could move zbm-release up so it's the default target, as that's what the void template does: https://github.com/void-linux/void-packages/blob/master/srcpkgs/zfsbootmenu/template#L6

I like making the zbm-release target up to the default slot. If you want to keep a no-op target, I'd prefer a name like dummy or no-op over all, which implies it will run other functional targets.

authors: ahesford classabbyamp

repo: zbm-dev/zfsbootmenu


text:
Deeper explanation in website or docs

The current explanation on the website is shallow and does not go deep into the internal workings of the library. For instance "Multiple storages, including memory, OS file system, RDBMS, key-value object store"  does not explain how to interact with other storage systems like memory or RDBMS.
Another example, "State-of-the-art cryptography: AES-256-GCM (hardware), XChaCha20-Poly1305, Argon2 and etc." does not explain which is cryptography is used by default or how it's all interconnected.
It would be great if you explained more, or gave a document detailing the internal
architecture of zbox.
Also the chat on gitter seems abandoned

Thanks for you suggestions. Yes, the current document is very minimal and not deep in details. This is definitely the next thing I will focus to improve. As for now, I can give some simple explanations for your questions.

The underlying storage implementation is decoupled with zbox fs, the interface between them is through the Storable trait object: https://github.com/zboxfs/zbox/blob/068d1abd3c4374fb6358675087bb982d23ba9873/src/volume/storage/mod.rs#L44 Storage must implement this trait with some guarantees, which is mentioned in the code. Data passed down to the storage is already encrypted and file content is also chunked to 8KB blocks, so the underlying storage have no knowledge about the file system. There are some storage implementations already in the storage folder (https://github.com/zboxfs/zbox/tree/master/src/volume/storage)

The crypto primitives is provided by libsodium. You can choose AES or XChacha when creating a repo. By default, it will choose AES if AES-NI instrunction set is available in CPU, otherwise fallback to XChacha. Argon2 is used for hashing, which is also provided by libsodium. So basically zbox fs fully depends on libsodium and doesn't do any cryptography itself because this part is hard and critical.

Hope this is helpful and the future document will give more details on the this.

If I use zbox on arm processors, does it default to XChaCha or AES?

I would say it depends on how libsodium deal with it, seems like AArch64 can use hardeware AES instruction set. Check this: https://github.com/jedisct1/libsodium/issues/363

If I encrypt a repo with AES on Desktop, would I be able to decrypt it using XChaCha on Arm?

No, you cannot. The crypto, including cipher and cost, must be exactly same to encrypt and decrypt.

That makes sense. Where in the docs can I make XChaCha the default. I am only finding the enum XChaCha

Hope this new page https://zbox.io/fs can provide more architectural view about the internal of ZboxFS. I will write up more details of each module in blogs later on. Close this for now.

authors: burmecia iamcharleschege

repo: zboxfs/zbox


text:
Change zsh standard compatibility

Function dir should be /functions, see: https://github.com/zdharma-continuum/Zsh-100-Commits-Club/blob/master/Zsh-Plugin-Standard.adoc#funcs-dir

Ironically, this plug-in and the standard you linked were written by the same person :)

Let's also drop all Unicode chars in file names here.

[ ] Remove Unicode characters in file names

@vladdoster Done!

Renaming all the internal funcs is out of scope for this pr imo.

While that's true, I'm ok with a "modernize this repo" PR

@pschmitt Is right, now that I think about it. Let's split this into two PRs.

On second thought, this PR is now impossible to review efficiently.

Let's cherrypick Remove Unicode symbol → to a new PR and I'll approve this one.

If we were to change the function prefix, would we also want to change
https://github.com/zdharma-continuum/Zsh-100-Commits-Club/blob/master/Zsh-Plugin-Standard.adoc#namespacing
as well? Currently it recommends → for hook functions. See also #4.

Hey @alichtman Done!

I suggest not to remove the unicode prefix.
A unicode prefix is less likely to be a prefix of a normal function/file so that it is less likely to appear in the completion list.
The repo is deleted and I cannot find the old discussion, but the commit which change ascii prefix to unicode preifx is still here: https://github.com/zdharma-continuum/fast-syntax-highlighting/commit/a3242a93399535faccda4896ab5c61a7a6dca1fe

On second thought, I just saw @alichtman comment regarding splitting up changes.
@grigorii-horos, Could you please split changes into two PRs to make the changes more atomic?

authors: Aloxaf FranklinYu alichtman grigorii-horos pschmitt vladdoster


text:
Test jobs failed with error "[ERROR] Could not initialize class com.zebrunner.agent.core.config.ConfigurationHolder"

Steps:
1.Set up community edition (developer branch)
Note:Used Carina-demo (master)
2.Start Api and Web test jobs
Actual result: test job failed with error [ERROR] Could not initialize class com.zebrunner.agent.core.config.ConfigurationHolder
Expected: Api and Web test jobs passed

opened  the same in jenkins-master

repo: zebrunner/community-edition