text:
Support non-UTF8 encodings

Status

[x] Implement support for reading non-UTF-8 files
[x] Add tests for Chinese SGFs
[x] Add support for saving files back to their non-UTF-8 forms (if this is even desirable).
[x] More tests with more languages/encodings, and some unsupported encodings as well.

Screenshots

(The exciting part of this screenshot is not that Chinese characters are being displayed correctly, since Sabaki can already do that; the exciting part is that the file being opened is not UTF-8 encoded, as can be seen from the terminal).
Known Issues

[x] Currently, if the CA[] property comes after a text node in the root gametree, the text node preceding it won't be properly decoded if it's non-ISO.

Addresses yishn/sabaki#121.
(Note: this is my first time writing any Node/Electron at all, so this may not be very idiomatic 😄)

On further reflection, I think the only safe way to set the encoding is to make two passes: one where we we just parse every field as ISO-8859-1 in order to read the CA attribute (if present), and then if it is set, another parsing round where text fields are read properly.
I think this is the cleanest way to get around the problem that the parser doesn't know how to interpret text attributes that occur earlier than the CA tag. What do you think, @yishn?

Thank you so much for your work @apetresc! I'll look over it once I'm back.

Yes, it's probably the best way. If the CA tag only appears in the root node, we only need to parse just a few tokens to get to the CA property.

Another idea is as follows, since the CA property can only appear in the root node: With the current implementation, the only properties not handled are the properties in the parent node of the CA property. A quick (and maybe dirty) way is to just fix said properties when we encounter a CA tag. This would also work if there are several games with different CA properties inside one sgf file.

I'm back from vacation! @apetresc do you want to finish this PR, or should I take over?

I can finish it! I'll implement your suggestion on Monday.
How do you feel about the saving aspect? Do you want to preserve the CA[] tag and encode with it when saving, or convert everything to UTF-8?

I don't really know, but personally, I'm fine with saving everything in UTF-8.

@yishn, I think I'm done! I've completed all the objectives set out initially, and it works well from my personal manual testing, including saving back to UTF-8.
Let me know if there's anything else that needs doing :)

Thanks for your hard work! I left some comments in the code. I have one question, though:
In case we have an encoding and try to parse values we first decode the encoded data, then apply unescapeString, i.e. unescapeString(decode(encoded_data)), however when we encounter CA and reparse values, we actually do decode(unescapeString(encoded_data)). I'm wondering if this yields the same thing?
I have no experience with text encodings and I'm not sure what the "correct" order is, but they seem to give the same results.

Excellent point about the different order of escaping. In theory, it could make a difference if the encoding we're switching between had a different byte for " or \ characters. In practice, though, virtually all 8-bit encodings in common use today (and probably all the ones that iconv-lite actually supports) are ASCII-compatible and don't differ on those common characters.

Thank you for clarifying! I'm merging this now.

authors: apetresc yishn

repo: yishn/Sabaki


text:
dx: add the ability to debug Next.js backend code with Chrome Dev Tools

more info: https://nextjs.org/docs/advanced-features/debugging

Let's add cross-env as a devDep to make sure this works on Windows too. See: https://nextjs.org/docs/advanced-features/debugging#debugging-on-windows

@ykdojo we can merge this if you can add the above-requested changes.

@iShibi I'll come back to this if/when I start working on #108

@iShibi should be fixed now

source: gharchive/pull-request

authors: iShibi ykdojo

repo: ykdojo/defaang

license: MIT

license_type: permissive

license_source: github-api


text:
🛑 AleWorld is down

In 4fa6854, AleWorld (https://www.ale.world) was down:

HTTP code: 502
Response time: 406 ms

Resolved: AleWorld is back up in cae6962.

source: gharchive/issue


text:
🛑 AleWorld is down

In 013cef7, AleWorld (https://www.ale.world) was down:

HTTP code: 502
Response time: 446 ms

Resolved: AleWorld is back up in 3c28682.


text:
How do I fit my own features without using pcap files?

I'm using network packets from my elasticsearch and I wanna know how do I fit my own features to this.
Is it possible to use different data than a pcap file or is it necessary to use pcap ?

If you don't need the feature extractor (just the anomaly detector) then
check out my other repository (KitNET)
Dr. Yisroel Mirsky
Head of the Offensive AI Research Lab
Department of Software and Information Systems Engineering
Ben-Gurion University
On Mon, 28 Feb 2022 at 10:48, SandeepaDevin @.***>
wrote:

I'm using network packets from my elasticsearch and I wanna know how do I
fit my own features to this.
Is it possible to use different data than a pcap file or is it necessary
to use pcap ?
—
Reply to this email directly, view it on GitHub
https://github.com/ymirsky/Kitsune-py/issues/21, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACYEV26TLRN4XUZCY6HZHH3U5MZE5ANCNFSM5PQOJLTA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

I'd check it out. Thanks!

authors: SandeepaDevin ymirsky

repo: ymirsky/Kitsune-py


text:
相対座標の基準点が移動した際の相殺処理

相対座標の基準点が移動した場合、関連するコントロールポイントも移動してしまうので、相殺処理をする。

653c03036dd631cf4b3509b3029e6af59c35d57a で対応。

repo: ynakajima/SVGPathEditor

license: mit

license_source: bigquery


text:
Chinese translation

Hello I am the Chinese translator rabbitism. I didn't have enough time to play your game during translation. I you leave me your email so i can send you a polished translation? Thx. Mine is rabbitism.bot@qq.com

I have sent you an email regarding the matter.


text:
Fix: Not removing absolute path in Maya DL submission

Changelog Description
This occured only in Maya (or DCC with AOV), caused pasting whole absolute path to metadata.json which could cause Given file names contain full paths (if ValidateExpectedFiles was disabled). 'files' is expecting only file names, not full paths.
Testing notes:

disable ValidateExpectedFiles
publish from Maya
check metadata.json, shouldn't contain absolute paths, but only file names in files

This also influences other DCCs and should also need confirmation that it works from other hosts, like Houdini and potentially others that submit to the farm?
Technically it's by all of these. So we may want to confirm at least a few:

[ ] Blender
[ ] Celaction
[ ] Fusion
[ ] Harmony
[ ] Houdini
[ ] Max
[ ] Maya
[ ] Nuke
[ ] Unreal

This also influences other DCCs and should also need confirmation that it works from other hosts, like Houdini and potentially others that submit to the farm?

We should test it, but on the other hand it is returning back the code that was there before and was removed by mistake (mine ☝🏻 )

This also influences other DCCs and should also need confirmation that it works from other hosts, like Houdini and potentially others that submit to the farm?
Technically it's by all of these. So we may want to confirm at least a few:

[ ]  Blender
[ ]  Celaction
[ ]  Fusion
[ ]  Harmony
[ ]  Houdini
[ ]  Max
[ ]  Maya
[x]  Nuke
[ ]  Unreal

We should also confirm the publish jobs work.

It would be affecting only DCCs which have AOVs, which are not these on the list, imho.

Also works in blender host . Again full testing with rendering and publish job done. LGTM

so now also 3dsmax been tested and all good too

authors: BigRoy LiborBatek antirotor kalisp

repo: ynput/ayon-core


text:
carelink_carepartner_api_login.py produces syntax errors

Followed the instructions for Windows environment and getting this error:
PS C:\Users\night> python carelink_carepartner_api_login.py
  File "C:\Users\night\carelink_carepartner_api_login.py", line 112
    <title>Home-Assistant-Carelink/utils/carelink_carepartner_api_login.py at develop · yo-han/Home-Assistant-Carelink</title>
                                                                                ^
SyntaxError: invalid character '·' (U+00B7)

If I remove this character from the script, it comes to another syntax error:
PS C:\Users\night> python carelink_carepartner_api_login.py
  File "C:\Users\night\carelink_carepartner_api_login.py", line 7
    <!DOCTYPE html>
    ^
SyntaxError: invalid syntax

Any help?

Found the error: the script that has been linked in the setup description (https://github.com/yo-han/Home-Assistant-Carelink/blob/develop/utils/carelink_carepartner_api_login.py) is garbage.

repo: yo-han/Home-Assistant-Carelink


text:
component: delegates flora/mqtt message

Is your feature request related to a problem? Please describe.
Flora/MQTT messages are mostly handled by other components rather than flora/mqtt component themself.
Describe the solution you'd like
Defines configuration files like keyboard.json to dispatch messages.

How about delegates the MQTT as a flora message, so that we could only own the flora message for component and application.

How about delegates the MQTT as a flora message, so that we could only own the flora message for component and application.

IMO merging MQTT to flora might not be a good idea, since both two has its uniqueness on its usage. The proposed idea of configuring delegating the flora/mqtt message to injected components could be ideal and simple on current stage.
Still, it might not be the perfect one.

Ok, just dismiss my suggestion :)

We have move MQTT on user-land, so this could be discussed outside of the framework place.

authors: legendecas yorkie

repo: yodaos-project/yodart


text:
Console warning: Unbalanced calls to begin/end appearance transitions for <UINavigationController: 0x126030000>.

SO articles:
first
second
third
fourth

Reference: http://stackoverflow.com/a/35732558/2229062
Solution: https://github.com/yoha/Notes/commit/819fed2fddd615163feef256d42aee6d8ad463bc

repo: yoha/Notes


text:
CreateEdge does not return _from and _to

Hello,
while prototyping ArangoDB-NET I noticed that the CreateEdge method of ADocument does not return the content of the "_from" and "_to" fields in its result structure just "_id", "_key" and "_rev".
So to get this information right after creation I would have to explicitly query for that edge document by id.
Not a major issue but if I want to consistently return the populated document after creation it is a bit annoying and a little less performant.
Best regards
Patrick

Hi Patrick,
this is standard behaviour which mirrors ArangoDB 3.x HTTP API when creating a new edge (same pattern when creating new document - only _id, _key and _rev fields are returned), however if you call ReturnNew method before CreateEdge then resulting document would contain new field where you can find entire document data, e.g.
var createResult = db
    .Document
    .ReturnNew()
    .CreateEdge("MyEdgeCol", "MyDocCol/123", "MyDocCol/456");

// createResult.Value.ID() == createResult.Value.String("new._id")
// createResult.Value.Key() == createResult.Value.String("new._key")
// createResult.Value.Rev() == createResult.Value.String("new._rev")
// "MyDocCol/123" == createResult.Value.String("new._from")
// "MyDocCol/456" == createResult.Value.String("new._to")

Hope it helps.

Thanks works pretty well!


text:
OES_texture_float is missing on Android.

OES_texture_float is missing on Android. Is it possilbe to make GPUComputation android compatible?

Hello,
This repository was merged with the Three.js official one.
Please see this issue, I think it is already solved there by using HalfFloat
Thanks

hi @yomboprime
Thanks for your response.It fails to work on android browser, fine on ios device.

hi @yomboprime
Thanks for your response.It fails to work on android browser, fine on ios device.

Then, please consider opening a new issue in the Three.js repo, about the bug on Android.

authors: imokya yomboprime

repo: yomboprime/GPGPU-threejs-demos


text:
요나 첫 페이지의 그림을 바꾸고 싶어요.

평소에 로그인해서 쓸때는 별로 못느끼지만..
처음 켜지는 요나 메인페이지의 뒤 배경그림을 다른 걸로 교체할 수 있을까요?
한 서버에 요나를 여러개 설치해두고 쓰니. ^^:;; (H2버전 나머지 2개는 일반 BBS처럼 쓰고 있습니다.)
하나는 DB연동, 나머지 두개는 H2버전을 구동했어요. 작동포트를 서로 다르게 설정하고..
아파치에서 리버스 프록시로 서브도메인 부여해서 이용중입니다.
셋 다 똑같은 그림이 나오다보니.. 주소를 보고 찾는 것이 헷갈려서.. 서로 다른 그림이 나오면 좋을 것 같아서요..
에셋을 뒤져보니.. 여러 배경 그림이 들어있던데요... 혹시 내부 설정에서 바꿀 수 있는 방법이 있을까요?
매번 잘 이용하고 있어서 감사드립니다.

명시적으로 바꾸는 기능은 현재는 없습니다만
배포판 lib 폴더를 살펴보면 yona.yona-1.15.0-assets.jar 파일이 있습니다.
jar xf yona.yona-1.15.0-assets.jar

압축을 해제해보면 project_default.jpg 파일이 기본 헤더 배경 이미지 입니다.
해당 이름으로 다른 이미지를 넣으시고 다시 압축을 하시면
기본 배경이미지가 변경됩니다.
관련코드 https://github.com/yona-projects/yona/blob/next/app/utils/TemplateHelper.scala#L188

감사합니다~~ 이 방법으로 바꾸어보겠습니다.

authors: doortts minishanell

repo: yona-projects/yona


text:
Fixed several bugs (including #4)

I have fixed several bugs in this Pull Request.
Firstly, I addressed issue #4. I fixed it by doing something similar to what @alex-laycalvert suggested there.
I changed if(focusedItem) to if(focusedItem != -1) in generateStateWithNewFolder and generateStateWithNewFolder (located in FileSystemHelpers.ts). In my opinion, this change is more accurate because item.index will either be -1 or a string. Using if(focusedItem >= 0) would work but is less clear.
Secondly, I addressed some bugs related to PR #22 regarding focusing a file. Since in that PR I changed the structure of the file system item (making the index and the object key the path of the file) it broke some stuff:

It broke dragging and dropping files. I fixed it by adapting the new changes in the helper functions (inside FileSystemHelpers.ts)
In addFile and addFolder functions (located in FileSystem.tsx), the check for the existence of an item was broken because the key is no longer the name but the path. I implemented a new function in FileSystemHelpers.tsx to make this check, now that the name is a property (data) and not the object key.

Important note: I have not yet adapted the handleRenameItem function (located in FileSystem.tsx) to the changes in PR #22. Therefore, renaming will likely be broken when it is implemented. I will make sure to fix it as soon as possible.
I believe these changes have resolved all known issues. However, if any further bugs are discovered, I will be sure to fix them as soon as possible.

I’ll Look into it.

I have fixed the two bugs that you mentioned. The first one was caused by a typo I made in the generateStateWithNewFolder function, where I mistakenly replaced newFolderName with newFileName.
The second bug was caused by the checkIfItemNameIsFolder function, which checked for the existence of files with a certain name throughout the system. I have now modified it to check for items by the provided name under a passed node (path) - in our use case, the focused item. Although I believe that this solution works well for now, we should consider passing the parent node when a folder is opened, not just when it is focused. If this indicator has already been implemented, please let me know.

@yonatanmgr I fixed the last bugs, and made some changes. The main change I did is that generateStateWithNewFile, generateStateWithNewFolder and itemExistsInParent (which is the new version of checkIfItemNameIsFolder, more about that below) now relate to the selectedFolder and not focusedItem. Other changes I made:

Recreated checkIfItemNameIsFolder as itemExistsInParent. It is pretty much doing the same, but now correct and more concise. Reference the comments in the function for more information.
Shortened generateStateWithNewFile and generateStateWithNewFolder. The first if check in those functions was redundant, since it was looking for the parent's path, which we don't need to look for now, as it is the key (or index).

repo: yonatanmgr/mathberet


text:
SLIAR 강화학습 DQN 알고리즘 결과물 분석

https://github.com/yoon-gu/epirl/blob/master/rl/dqn/Visualization.ipynb 참고
자유롭게 진행하시면 됩니다.

위를 참고하여 SLIAR 모델에 적용중입니다.

중간에 vf, af를 지정할때 크기를 (S,I)가 아닌 (I,S)로 한 이유가 궁금합니다.
현재 총 인구가 S=1000000, I=1 이므로, 1000001의 약수는 9901, 101뿐인데 101을 이용하여 linspace를 102로 우선 설정해보았습니다. 인구에 비해 간격이 너무 넓은 것 같은데, 중간의 수가 없어서 이런 경우에는 그냥 간격이 좁은 것을 선택하여 9902개의 수를 얻는게 맞는지 궁금합니다.

우선 위의 코드로 진행하여

의 초기 그래프를 얻었습니다. 이후 학습을 통해 이 그래프의 모양이 어떻게 변하는지 관찰할 예정입니다.

우선 위의 결과로 1000번 학습시킨 결과입니다.

결과가 다음과 같이 바뀌어서 나타났습니다.
학습이 덜 된 것 같아서 횟수를 늘려서 다시 결과를 얻어보겠습니다.

약간의 수정을 거쳐 1000번 학습 시켰을 때의 결과를 다시 얻었습니다.

어제와 비슷한 결과가 나왔고, 2000/4000/8000/16000에 대한 결과를 얻는 중입니다.
그런데, 위와 다르게 초기 그래프의 모양이 다르게 나옵니다.
제가 이해한 바로는 vf 값이 value function에서 얻은 값, af값이 맥시멈을 만드는 액션인데, 학습을 전혀 시키지 않은 상태에서는 vf 값이 음수로 나옵니다.(거의)
이게 학습을 시키지 않아서 랜덤 확률로 음수, 양수를 왔다갔다 할 수 있는 건가요? 아니면 뭔가를 잘못이해하거나 코드에 오류가 있는 것일까요..?

학습을 전혀하지 않았으므로 이상한 값들이 많이 나오는게 당연합니다.
신경망 모델이 생성 되면 랜덤한 Coefficient들이 할당되므로, 값이 이상하게 되죠.
학습이 될 수록 덜(?) 이상해질겁니다.

16000번 학습한 결과입니다.
확실히 안정되어 있고, 첫번째 그래프에서 백신의 초기 투여가 좋다는 결과는 지난번과 같이 나왔습니다.
dqn을 통해 얻은 두번째 value function에 해당하는 그래프는 S가 크고 I 가 작을수록 안정된다고 보이므로, 학습이 잘 된것으로 판단됩니다.
그런데 문제는 세번째 그래프는 제가 이해하고 있는 것과는 뭔가 다른 것 같습니다.
제가 이해한 바로는, 세번째 그래프는 왼쪽, 즉 S가 매우 작을때만 1이라는 액션을 취해서 백신을 준다라고 이해되는데, 그렇다면 위에서 얻은 첫번째 결과에서 초기에 S가 매우 큰 상황에서 백신을 투여한 것과 상반되지 않나요...?
세번째 그래프를 어떻게 해석해야 좋을지 모르겠습니다...

visualization이 다른 epsilon 조건 하에서 이상하게 나와서 살펴보는 도중, 이 부분에서 문제가 있지 않나 생각됩니다.
기존의 SIR은 S와 I compartment만 사용하여 모든 경우의 수를 따질 수 있는 반면, SLIAR의 경우는 S,L,I,A의 모든 경우를 따져야 앞과 같이 DQN을 visualization 할 수 있는게 아닐까 라는 생각이 들었습니다.
그렇다면 2차원 그래프를 나타내기가 어려운데 다른 방법을 찾아서 다차원을 표현해야는 것이 맞을까요?

애초에 다차원은 시각화하기 거의 불가능합니다. 오늘 세미나 진행하면서 S와 I 외에 필요한 정보가 있는지 교수님께 문의해서 진행하시죠

넵 알겠습니다!

repo: yoon-gu/epirl


text:
changelog: 3.0.0

Final piece, hey! :sparkles:

@bendrucker thanks heaps for spotting the errs :sparkles:

Updated with feedback from https://github.com/yoshuawuyts/choo/issues/124, merging!

repo: yoshuawuyts/choo


text:
HomeBridge dimmables wrong values

In #12 @RonaldR and @martienvd pointed this out. In my case the following happens:

Dim a dimmable to 100% only goes to 39% as 100/255  = 39%
On max brightness, HomeKit shows a brightness of 255% instead of 100%

I'll wait and see if HomeBridge team fixes this. Please open an issue at their repo.

@youridijk is maxBrightness: 15 in https://github.com/youridijk/ICS-2000-NodeJS/blob/main/src/kaku/DeviceConfigs.ts not the issue?

Same issue here, I think that the issue indeed started when updated to iOS 17. I ordered ah older iPad today i hope it has iOS 16.x installed. I can try it out if its in iOS.
In Home it shows the correct value in the small overview after comparing it to the default KAKU app but when you open the dimmables to set the value it is shows very low values.
example: overview 40% open 6%
overview 47% open 7%
overview 13% open 2%
you can change it a bit but it falls back down but it will change. When I try to up the 13% / 2% it falls back stays on 11% and the overview shows 73%.

Yes, same problems here as you describe. Definitely an issues with homebridge, but can’t seem to find an issue about it on their GitHub or somewhere else. Feels weird, can’t be that it’s just us. Anyone experiencing same issues with other plugins?

I fixed the issue by manually convert the 0-100 brightness range from Homebridge to a 0-255 range KAKU uses. Don't really like the solution but works fine. Should be backwards compatible with previous iOS versions. I just released a new version of this plugin with the fix. If after the update the issue isn't gone, please empty your cache.

Works, great! Only thing now is that the value is wrong other way around. When open it is correct for example 30% closed 200% so that looks a bit weird but it works again and no flyback down.

thanks, works perfectly!

@rickklh  Hmm I'm not experiencing it after clearing the cache. Maybe it will help you too.

@rickklh Hmm I'm not experiencing it after clearing the cache. Maybe it will help you too.

I did that after the first post because after the update to 1.3.2 I didn’t work and cleared the cache of homebridge like you said. No issues again on iOS 16.4 only 17.
Tried rebooting the whole system, no succes but simply after rebooting my phone the issue was gone!
so for anyone else having this problem, reboot your stuff might be the solution.
Thanks for your response and great homebridge plug-in. Much appreciated.

authors: RonaldR martienvd rickklh youridijk


text:
throttler: Add new configuration option "ignore_n_slowest_rdonlys".

The new setting is similar, but independent to the existing option "ignore_n_slowest_rdonlys".
For example, if both are set to 1, you can have one 1 slow REPLICA and 1 slow RDONLY tablet.

LGTM

authors: alainjobart michael-berlin

repo: youtube/vitess


text:
Is my usage wrong?

Sorry, I'm a rookie. I want to know what's wrong with me

Getting the same error.

did you figure it out ?

Getting the same error.

authors: CrossV4 ValiaP andrewdesi lcfkbs

repo: yretenai/HFSExtract


text:
Add support for Dactyl Manuform 4x6

I added support for my version of the Dactyl Manuform, which is a 4x6 configuration of Carbonfet's fork.
I haven't created a PR to QMK with my keyboard and a default keymap, should this PR wait until there's a default keymap available in QMK?

@genkobar
Sorry for the late reply.

should this PR wait until there's a default keymap available in QMK?

keymapviz only supports QMK keyboard. So, I will merge this PR when your keyboard is available in QMK.
If your keyboard will not be available for QMK, we may need to consider a feature to make it easier to set up your own keyboard in keymapviz without the PR.

keymapviz only supports QMK keyboard. So, I will merge this PR when your keyboard is available in QMK.

All right, that sounds good :)
I'm finalizing my PR to QMK, so I believe it will be available in QMK eventually.

authors: genkobar yskoht

repo: yskoht/keymapviz


text:
"This application has requested the Runtime to terminate it in an unusual way." nightly@2024.07.10.232707. New curl_cffi broken on Windows 7.

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting a bug unrelated to a specific site
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue

Provide a description that is worded well enough to be understood
Steps to reproduce.

Use Windows 7 x64 and get yt-dlp version nightly@2024.07.10.232707

yt-dlp --impersonate="" -F BaW_jenozKc

"This application has requested the Runtime to terminate it in an unusual way."

I thought this was only gonna happen in/after October ? #10086
EDIT: The problem appeaars to be with the new curl_cffi . Not using --impersonate="" does show the formats_table. But now I can't use yt-dlp on websites that necessitate impersonation.
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[ ] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
$ youtube-dl -v --impersonate "" --youtube-skip-hls-manifest --compat-options list-formats,format-sort,manifest-filesize-approx -F -- BaW_jenozKc
[debug] Command-line config: ['-v', '--impersonate=', '--youtube-skip-hls-manifest', '--compat-options', 'list-formats,format-sort,manifest-filesize-approx', '-F', '--', 'BaW_jenozKc']
[debug] yt-dlp version nightly@2024.07.10.232707 from yt-dlp/yt-dlp-nightly-builds [705f5b84d] (win_exe)
[debug] Compatibility options: format-sort, list-formats, manifest-filesize-approx
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-7-6.1.7601-SP1 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.7.0, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Extractor Plugins: AGB (YoutubeIE), Youtube_AgeGateBypassIE
[debug] Loaded 1835 extractors
[youtube+AGB] Extracting URL: BaW_jenozKc
[youtube+AGB] BaW_jenozKc: Downloading webpage

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

Can you confirm that the problem does not exist in https://github.com/yt-dlp/yt-dlp-nightly-builds/releases/tag/2024.07.09.232843 ?
yt-dlp --update-to nightly@2024.07.09.232843

Can you confirm that the problem does not exist in https://github.com/yt-dlp/yt-dlp-nightly-builds/releases/tag/2024.07.09.232843 ?
yt-dlp --update-to nightly@2024.07.09.232843

Sorry I should have mentioned. I was using in fact using nightly@2024.07.09.232843 before the update.
WORKS - nightly@2024.07.09.232843 with curl_cffi-0.5.10
$ yt-dlp.exe -v --no-config --proxy socks5h://127.0.0.1:9050 --impersonate="Chrome-110:Windows-10" -F BaW_jenozKc
[debug] Command-line config: ['-v', '--no-config', '--proxy', 'socks5h://127.0.0.1:9050', '--impersonate=Chrome-110:Windows-10', '-F', 'BaW_jenozKc']
[debug] yt-dlp version nightly@2024.07.09.232843 from yt-dlp/yt-dlp-nightly-builds [d2189d3d3] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-7-6.1.7601-SP1 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.5.10, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {'all': 'socks5h://127.0.0.1:9050'}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Loaded 1834 extractors
[youtube] Extracting URL: BaW_jenozKc
[youtube] BaW_jenozKc: Downloading webpage
[youtube] BaW_jenozKc: Downloading ios player API JSON
[debug] Loading youtube-nsig.9ed4a7e1 from cache
[debug] [youtube] Decrypted nsig CxdNN_Y8acviGKn0 => 5ehLo-AIKNuZrg
[youtube] BaW_jenozKc: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, hasaud, id
[info] Available formats for BaW_jenozKc:
ID      EXT   RESOLUTION FPS CH |   FILESIZE  TBR PROTO | VCODEC         VBR ACODEC      ABR ASR MORE INFO
--------------------------------------------------------------------------------------------------------------------------------
sb0     mhtml 48x27       10    |                 mhtml | images                                 storyboard
233     mp4   audio only        |                 m3u8  | audio only         unknown             [en] Default, IOS
234     mp4   audio only        |                 m3u8  | audio only         unknown             [en] Default, IOS
139-drc m4a   audio only      2 |   60.21KiB  49k https | audio only         mp4a.40.5   49k 22k [en] low, DRC, IOS, m4a_dash
139     m4a   audio only      2 |   60.20KiB  49k https | audio only         mp4a.40.5   49k 22k [en] low, IOS, m4a_dash
140-drc m4a   audio only      2 |  157.14KiB 130k https | audio only         mp4a.40.2  130k 44k [en] medium, DRC, IOS, m4a_dash
140     m4a   audio only      2 |  157.16KiB 130k https | audio only         mp4a.40.2  130k 44k [en] medium, IOS, m4a_dash
269     mp4   256x144     30    | ~ 83.18KiB  68k m3u8  | avc1.4D400C    68k video only          IOS
160     mp4   256x144     30    |   14.93KiB  12k https | avc1.4D400C    12k video only          144p, IOS, mp4_dash
230     mp4   640x360     30    | ~205.33KiB 168k m3u8  | avc1.4D401E   168k video only          IOS
134     mp4   640x360     30    |   29.39KiB  24k https | avc1.4D401E    24k video only          360p, IOS, mp4_dash
18      mp4   640x360     30  2 |  199.11KiB 165k https | avc1.42001E        mp4a.40.2       44k [en] 360p, WEB
605     mp4   640x360     30    | ~255.88KiB 210k m3u8  | vp09.00.21.08 210k video only          IOS
232     mp4   1280x720    30    | ~247.03KiB 202k m3u8  | avc1.4D401F   202k video only          IOS
136     mp4   1280x720    30    |   59.04KiB  49k https | avc1.4D401F    49k video only          720p, IOS, mp4_dash
270     mp4   1920x1080   30    | ~484.67KiB 397k m3u8  | avc1.640028   397k video only          IOS
137     mp4   1920x1080   30    |  286.74KiB 239k https | avc1.640028   239k video only          1080p, IOS, mp4_dash

FAILS - nightly@2024.07.10.232707 with curl_cffi-0.7.0
$ yt-dlp.exe -v --no-config --proxy socks5h://127.0.0.1:9050 --impersonate="Chrome-110:Windows-10" -F BaW_jenozKc
[debug] Command-line config: ['-v', '--no-config', '--proxy', 'socks5h://127.0.0.1:9050', '--impersonate=Chrome-110:Windows-10', '-F', 'BaW_jenozKc']
[debug] yt-dlp version nightly@2024.07.10.232707 from yt-dlp/yt-dlp-nightly-builds [705f5b84d] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-7-6.1.7601-SP1 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, curl_cffi-0.7.0, mutagen-1.47.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {'all': 'socks5h://127.0.0.1:9050'}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Extractor Plugins: AGB (YoutubeIE), Youtube_AgeGateBypassIE
[debug] Loaded 1835 extractors
[youtube+AGB] Extracting URL: BaW_jenozKc
[youtube+AGB] BaW_jenozKc: Downloading webpage

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

I can also reproduce this with the pypi version.
WORKS - nightly@2024.07.10.232707(pip) with curl_cffi version 0.5.10
$ pip --proxy socks5h://127.0.0.1:9050 install -U --pre yt-dlp[default]
$ yt-dlp.exe --rm-cache-dir -v --no-config --proxy socks5h://127.0.0.1:9050 --impersonate="Chrome-110:Windows-10" -F BaW_jenozKc
[debug] Command-line config: ['--rm-cache-dir', '-v', '--no-config', '--proxy','socks5h://127.0.0.1:9050', '--impersonate=Chrome-110:Windows-10', '-F', 'BaW_jenozKc']
[debug] yt-dlp version nightly@2024.07.10.232707 from yt-dlp/yt-dlp-nightly-builds [705f5b84d] (pip)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-7-6.1.7601-SP1 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] Optional libraries: Cryptodome-3.17, brotli-1.0.9, certifi-2022.12.07, curl_cffi-0.5.10, mutagen-1.46.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.1, websockets-12.0
[debug] Proxy map: {'all': 'socks5h://127.0.0.1:9050'}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Extractor Plugins: AGB (YoutubeIE)
[debug] Plugin directories: ['C:\\Users\\USERNAME\\AppData\\Local\\Programs\\Python\\Python38\\lib\\site-packages\\yt_dlp_plugins']
[debug] Loaded 1834 extractors
Removing cache dir V:\MOBAXT~1\home/.cache\yt-dlp ...
[youtube+AGB] Extracting URL: BaW_jenozKc
[youtube+AGB] BaW_jenozKc: Downloading webpage
[youtube+AGB] BaW_jenozKc: Downloading ios player API JSON
[youtube+AGB] BaW_jenozKc: Downloading player 9ed4a7e1
[debug] Saving youtube-nsig.9ed4a7e1 to cache
[debug] [youtube+AGB] Decrypted nsig Smjhobqj4JUH99Fn => gskrwKTpHn9axw
[youtube+AGB] BaW_jenozKc: Downloading m3u8 information
[debug] Sort order given by extractor: quality, res, fps, hdr:12, source, vcodec:vp9.2, channels, acodec, lang, proto
[debug] Formats sorted by: hasvid, ie_pref, quality, res, fps, hdr:12(7), source, vcodec:vp9.2(10), channels, acodec, lang, proto, size, br, asr, vext, aext, hasaud, id
[info] Available formats for BaW_jenozKc:
ID      EXT   RESOLUTION FPS CH |   FILESIZE  TBR PROTO | VCODEC         VBR ACODEC      ABR ASR MORE INFO
--------------------------------------------------------------------------------------------------------------------------------
sb0     mhtml 48x27       10    |                 mhtml | images                 storyboard
233     mp4   audio only        |                 m3u8  | audio only         unknown             [en] Default, IOS
234     mp4   audio only        |                 m3u8  | audio only         unknown             [en] Default, IOS
139-drc m4a   audio only      2 |   60.21KiB  49k https | audio only         mp4a.40.5   49k 22k [en] low, DRC, IOS, m4a_dash
139     m4a   audio only      2 |   60.20KiB  49k https | audio only         mp4a.40.5   49k 22k [en] low, IOS, m4a_dash
140-drc m4a   audio only      2 |  157.14KiB 130k https | audio only         mp4a.40.2  130k 44k [en] medium, DRC, IOS, m4a_dash
140     m4a   audio only      2 |  157.16KiB 130k https | audio only         mp4a.40.2  130k 44k [en] medium, IOS, m4a_dash
269     mp4   256x144     30    | ~ 83.18KiB  68k m3u8  | avc1.4D400C    68k video only          IOS
160     mp4   256x144     30    |   14.93KiB  12k https | avc1.4D400C    12k video only          144p, IOS, mp4_dash
230     mp4   640x360     30    | ~205.33KiB 168k m3u8  | avc1.4D401E   168k video only          IOS
134     mp4   640x360     30    |   29.39KiB  24k https | avc1.4D401E    24k video only          360p, IOS, mp4_dash
18      mp4   640x360     30  2 |  199.11KiB 165k https | avc1.42001E        mp4a.40.2       44k [en] 360p, WEB
605     mp4   640x360     30    | ~255.88KiB 210k m3u8  | vp09.00.21.08 210k video only          IOS
232     mp4   1280x720    30    | ~247.03KiB 202k m3u8  | avc1.4D401F   202k video only          IOS
136     mp4   1280x720    30    |   59.04KiB  49k https | avc1.4D401F    49k video only          720p, IOS, mp4_dash
270     mp4   1920x1080   30    | ~484.67KiB 397k m3u8  | avc1.640028   397k video only          IOS
137     mp4   1920x1080   30    |  286.74KiB 239k https | avc1.640028   239k video only          1080p, IOS, mp4_dash

FAILS - nightly@2024.07.10.232707(pip) with curl_cffi version 0.7.0
$ pip --proxy socks5h://127.0.0.1:9050 install -U curl_cffi==0.7.0
$ yt-dlp.exe -v --no-config --proxy socks5h://127.0.0.1:9050 --impersonate="Chrome-110:Windows-10" -F BaW_jenozKc
[debug] Command-line config: ['-v', '--no-config', '--proxy', 'socks5h://127.0.0.1:9050', '--impersonate=Chrome-110:Windows-10', '-F', 'BaW_jenozKc']
[debug] yt-dlp version nightly@2024.07.10.232707 from yt-dlp/yt-dlp-nightly-builds [705f5b84d] (pip)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-7-6.1.7601-SP1 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] Optional libraries: Cryptodome-3.17, brotli-1.0.9, certifi-2024.07.04, curl_cffi-0.7.0, mutagen-1.46.0, requests-2.32.3, sqlite3-3.35.5, urllib3-2.2.1,websockets-12.0
[debug] Proxy map: {'all': 'socks5h://127.0.0.1:9050'}
[debug] Request Handlers: urllib, requests, websockets, curl_cffi
[debug] Extractor Plugins: AGB (YoutubeIE)
[debug] Plugin directories: ['C:\\Users\\USERNAME\\AppData\\Local\\Programs\\Python\\Python38\\lib\\site-packages\\yt_dlp_plugins']
[debug] Loaded 1834 extractors
[youtube+AGB] Extracting URL: BaW_jenozKc
[youtube+AGB] BaW_jenozKc: Downloading webpage

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

That's how I knew the problem had something to do with curl_cffi version 0.7.0

pip installation is affected too, hmm. Seems like it could be a problem with curl_cffi and older versions of Windows (e.g. 7)

Could you try running this script on your Windows 7 system with curl_cffi 0.7.0 installed and share the output:
import curl_cffi

print(curl_cffi.__version__)
session = curl_cffi.requests.Session()
response = session.get('https://www.youtube.com/watch?v=BaW_jenozKc', impersonate='chrome110')
print(response.status_code)

(you can copy/paste the above code, save it to curlcffitest.py, and run with python curlcffitest.py)

Could you try running this script on your Windows 7 system with curl_cffi 0.7.0 installed and share the output:

0.7.0
Traceback (most recent call last):
  File "curlcffitest.py", line 4, in <module>
    session = curl_cffi.requests.Session()
AttributeError: module 'curl_cffi' has no attribute 'requests'

argh my bad
try this one
import curl_cffi
import curl_cffi.requests

print(curl_cffi.__version__)
session = curl_cffi.requests.Session()
response = session.get('https://www.youtube.com/watch?v=BaW_jenozKc', impersonate='chrome110')
print(response.status_code)

0.7.0

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

The next nightly release (publishing in about 3.5 hours) should resolve this issue

authors: barkoder bashonly

repo: yt-dlp/yt-dlp

license: Unlicense


text:
[Question] Add brackets and similar characters to folder name.

Checklist

[X] I'm asking a question
[X] I've looked through the README and FAQ for similar questions
[X] I've searched the bugtracker for similar questions including closed ones

Question

How can i make yt-dlp create a folder with brackets and similar characters?
Let's take this example:
# Download all playlists of YouTube channel/user keeping each playlist in separate directory:

yt-dlp -o '%(uploader)s/%(playlist)s/%(playlist_index)s - %(title)s.%(ext)s' https://www.youtube.com/user/TheLinuxFoundation/playlists

I want the playlist folder to look like something like this: (name of playlist) or [name of playlist] etc..
How can i achieve this?

If you want brackets, just use brackets!
[%(playlist)s]

I see, i was doing it wrong %[(playlist)]s
Thanks!

authors: fosam pukkandan


text:
[ie/patreon:campaign] Support /c/ URLs

Closes #11755
Template
Before submitting a pull request make sure you have:

[x] At least skimmed through contributing guidelines including yt-dlp coding conventions
[x] Searched the bugtracker for similar pull requests

In order to be accepted and merged into yt-dlp each piece of code must be in public domain or released under Unlicense. Check all of the following options that apply:

[x] I am the original author of this code and I am willing to release it under Unlicense

What is the purpose of your pull request?

[x] Fix or improvement to an extractor (Make sure to add/update tests)

Thank you! Looking forward to this 😄

authors: Levi--G bashonly


text:
Fix playlist_index's inconsistent behavior

There are some inconsistencies in how youtube-dl and yt-dlp handles playlist_index when used with --playlist-reverse and similar options. Sometimes playlist_index is the index of the item in the actual playlist, and sometimes, it is the position of the item in the download queue, sometimes neither...

        1. Normal use, we get expected results (1-10)

$ youtube-dl https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(title)s" --get-filename --playlist-end 10
01 How (and why) to raise e to the power of a matrix _ DE6
02 Why Bayes rule is nicer with odds
03 Hamming codes part 2, the elegance of it all
04 Hamming codes and error correction
05 Group theory, abstraction, and the 196,883-dimensional monster
06 The impossible chessboard puzzle
07 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
08 Intuition for i to the power i _ Lockdown math ep. 9
09 The DP-3T algorithm for contact tracing (via Nicky Case)
10 The power tower puzzle _ Lockdown math ep. 8

        2. When using --playlist-start 5, we get 5-10 which is the actual index in the playlist

$ youtube-dl https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(title)s" --get-filename --playlist-start 5 --playlist-end 10
5 Group theory, abstraction, and the 196,883-dimensional monster
6 The impossible chessboard puzzle
7 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
8 Intuition for i to the power i _ Lockdown math ep. 9
9 The DP-3T algorithm for contact tracing (via Nicky Case)
10 The power tower puzzle _ Lockdown math ep. 8

        3. When using --playlist-reverse, we get 1-10 which is the queue position. The index in actual playlist would have given 10-1

$ youtube-dl https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(title)s" --get-filename --playlist-end 10 --playlist-reverse
01 The power tower puzzle _ Lockdown math ep. 8
02 The DP-3T algorithm for contact tracing (via Nicky Case)
03 Intuition for i to the power i _ Lockdown math ep. 9
04 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
05 The impossible chessboard puzzle
06 Group theory, abstraction, and the 196,883-dimensional monster
07 Hamming codes and error correction
08 Hamming codes part 2, the elegance of it all
09 Why Bayes rule is nicer with odds
10 How (and why) to raise e to the power of a matrix _ DE6

        4. --playlist-items 10,9,8,7,6,5,4,3,2,1. While the download queue for this is the same as (3), we get the index in actual playlist 10-1 since we didn't use --playlist-reverse

$ youtube-dl https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(title)s" --get-filename --playlist-items 10,9,8,7,6,5,4,3,2,1
10 The power tower puzzle _ Lockdown math ep. 8
09 The DP-3T algorithm for contact tracing (via Nicky Case)
08 Intuition for i to the power i _ Lockdown math ep. 9
07 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
06 The impossible chessboard puzzle
05 Group theory, abstraction, and the 196,883-dimensional monster
04 Hamming codes and error correction
03 Hamming codes part 2, the elegance of it all
02 Why Bayes rule is nicer with odds
01 How (and why) to raise e to the power of a matrix _ DE6

        5. When using both --playlist-start 5 and --playlist-reverse together, he index in the playlist are 10-5 and position in queue is 1-5. But we get 5-10 which is neither...

$ youtube-dl https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(title)s" --get-filename --playlist-start 5 --playlist-end 10 --playlist-reverse
5 The power tower puzzle _ Lockdown math ep. 8
6 The DP-3T algorithm for contact tracing (via Nicky Case)
7 Intuition for i to the power i _ Lockdown math ep. 9
8 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
9 The impossible chessboard puzzle
10 Group theory, abstraction, and the 196,883-dimensional monster

To fix this inconsistency, I am making playlist_index always the position of the video in the actual playlist and adding a new field playlist_autonumber which is the position of the item in the playlist queue.

        Outputs with this PR

$ yt-dlp https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(playlist_autonumber)02d %(title)s" --get-filename --playlist-end 10
01 01 How (and why) to raise e to the power of a matrix _ DE6
02 02 Why Bayes rule is nicer with odds
03 03 Hamming codes part 2, the elegance of it all
04 04 Hamming codes and error correction
05 05 Group theory, abstraction, and the 196,883-dimensional monster
06 06 The impossible chessboard puzzle
07 07 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
08 08 Intuition for i to the power i _ Lockdown math ep. 9
09 09 The DP-3T algorithm for contact tracing (via Nicky Case)
10 10 The power tower puzzle _ Lockdown math ep. 8

$ yt-dlp https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(playlist_autonumber)02d %(title)s" --get-filename --playlist-start 5 --playlist-end 10
05 01 Group theory, abstraction, and the 196,883-dimensional monster
06 02 The impossible chessboard puzzle
07 03 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
08 04 Intuition for i to the power i _ Lockdown math ep. 9
09 05 The DP-3T algorithm for contact tracing (via Nicky Case)
10 06 The power tower puzzle _ Lockdown math ep. 8

$ yt-dlp https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(playlist_autonumber)02d %(title)s" --get-filename --playlist-end 10 --playlist-reverse
10 01 The power tower puzzle _ Lockdown math ep. 8
09 02 The DP-3T algorithm for contact tracing (via Nicky Case)
08 03 Intuition for i to the power i _ Lockdown math ep. 9
07 04 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
06 05 The impossible chessboard puzzle
05 06 Group theory, abstraction, and the 196,883-dimensional monster
04 07 Hamming codes and error correction
03 08 Hamming codes part 2, the elegance of it all
02 09 Why Bayes rule is nicer with odds
01 10 How (and why) to raise e to the power of a matrix _ DE6

$ yt-dlp https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(playlist_autonumber)02d %(title)s" --get-filename --playlist-items 10,9,8,7,6,5,4,3,2,1
10 01 The power tower puzzle _ Lockdown math ep. 8
09 02 The DP-3T algorithm for contact tracing (via Nicky Case)
08 03 Intuition for i to the power i _ Lockdown math ep. 9
07 04 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
06 05 The impossible chessboard puzzle
05 06 Group theory, abstraction, and the 196,883-dimensional monster
04 07 Hamming codes and error correction
03 08 Hamming codes part 2, the elegance of it all
02 09 Why Bayes rule is nicer with odds
01 10 How (and why) to raise e to the power of a matrix _ DE6

$ yt-dlp https://www.youtube.com/channel/UCYO_jab_esuFRV4b17AJtAw/videos -o "%(playlist_index)s %(playlist_autonumber)02d %(title)s" --get-filename --playlist-start 5 --playlist-end 10 --playlist-reverse
10 01 The power tower puzzle _ Lockdown math ep. 8
09 02 The DP-3T algorithm for contact tracing (via Nicky Case)
08 03 Intuition for i to the power i _ Lockdown math ep. 9
07 04 Tips to be a better problem solver [Last lecture] _ Lockdown math ep. 10
06 05 The impossible chessboard puzzle
05 06 Group theory, abstraction, and the 196,883-dimensional monster

(How) is it possible to achieve a (really and consistent)
time-related new numbering in playlists
(start numbering from the oldest video)?
That means, independent of the original numbering
related to the (often arbitrary) position in the playlist.
A new field   'timestamp_related_number'
only and directly derived from the timestamp
could be very helpful.
For playlists, but also for whole channels and whatever else...
(Backstory: After a lot of trial and error fiddling around
with --playlist-reverse, playlist_autonumber, --playlist-items, ...  ,
finally achieving the desired result for one or several playlists,
but then the opposite again,
I noticed there must be a systematical error in my approach.
My fault was, expecting playlists numbered in a chronological order in youtube.
This is not the case, some are in ascending order, others descending,
and in some playlists single items fall totally out of the general time-related order,
which is causing even more confusion.
So the original numbering is arbitrary and seems not to be a valid base for chronological sorting.)
Any help appreciated,
and thank you very much for yt-dlp, it is a great tool.

authors: altadr pukkandan


text:
Classic FM support?

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.10.05. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.10.05

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[ ] Bug report (encountered problems with youtube-dl)
[x] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
youtube-dl -v -x --audio-format mp3 https://www.classicfm.com/radio/aod/?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-x', '--audio-format', 'mp3', 'https://www.classicfm.com/radio/aod/?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043']
[debug] Encodings: locale cp1252, fs mbcs, out cp850, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134
[debug] exe versions: ffmpeg N-87257-g8e17cd2, ffprobe N-87257-g8e17cd2
[debug] Proxy map: {}
[generic] ?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043: Requesting header
WARNING: Falling back on generic information extractor.
[generic] ?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043: Downloading webpage
[generic] ?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043: Extracting information
ERROR: Unsupported URL: https://www.classicfm.com/radio/aod/?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043
Traceback (most recent call last):
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\YoutubeDL.py", line 792, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\extractor\common.py", line 507, in extract
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmp5xdqinp2\build\youtube_dl\extractor\generic.py", line 3298, in _real_extract
youtube_dl.utils.UnsupportedError: Unsupported URL: https://www.classicfm.com/radio/aod/?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single stream: https://www.classicfm.com/radio/aod/?episodeId=17fe8e48-2389-49ba-b4e2-bf835af59043
Single stream (other example): https://www.classicfm.com/radio/aod/?episodeId=34bee1be-06d2-4ed1-a3e4-0ea32e3bca90

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
Simply put, could support be added for Classic FM streams? The website allows you to listen to the live radio shows again for up to seven days (i.e. there's no copyright infringement involved on their part)
Note, the link won't work unless you're in the UK (or give a UK Postcode).
I've given only links for single streams because I don't believe they do playlists or any other kind of link.

A bump, and also giving more example links because they expire after a week:
https://www.classicfm.com/radio/player/
Any link under the 'listen again' tab on that page should work as an example.

Classicfm shows are trivial to download. You don't need youtube-dl.
Once on the page featuring the on demand show you want to listen to, right click on the page and inspect. Search - ctrl+f - for "m4a" or "dax", this yields an address, mixed in with other info. The address looks like this: http://catchup.hosting.thisisdax.com/f7df68b4-4cde-48f6-a0d0-639516754012/1583cec9-d92b-43f3-8f87-142d19b6f00d.m4a
Just paste it into the address bar and it'll give you the audio.

repo: ytdl-org/youtube-dl


text:
Frequent "ERROR: Did not get any data blocks" downloading as MP4 from YT

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2019.03.09. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2019.03.09

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-i', '-f', 'mp4/(bestvideo+bestaudio)', '--verbose', 'https://www.youtube.com/watch?v=NxvQPzrg2Wg']
[debug] Encodings: locale cp1252, fs mbcs, out cp437, pref cp1252
[debug] youtube-dl version 2019.03.09
[debug] Python version 3.4.4 (CPython) - Windows-10-10.0.17134
[debug] exe versions: ffmpeg N-76041-g0418541, ffprobe N-76041-g0418541, rtmpdump 2.4
[debug] Proxy map: {}
[youtube] NxvQPzrg2Wg: Downloading webpage
[youtube] NxvQPzrg2Wg: Downloading video info webpage
[debug] Invoking downloader on 'https://r4---sn-nx5s7n7z.googlevideo.com/videoplayback?source=youtube&lmt=1547544508396832&expire=1552204233&c=WEB&ratebypass=yes&ei=aW2EXNa_BJKTkwa135fQCw&fvip=4&dur=528.346&ipbits=0&initcwndbps=2005000&key=yt6&mv=m&sparams=dur%2Cei%2Cid%2Cinitcwndbps%2Cip%2Cipbits%2Citag%2Clmt%2Cmime%2Cmm%2Cmn%2Cms%2Cmv%2Cpl%2Cratebypass%2Crequiressl%2Csource%2Cexpire&mt=1552182586&ms=au%2Conr&mime=video%2Fmp4&requiressl=yes&ip=2601%3A600%3A817f%3Ae19a%3Aa97d%3A841b%3Abe92%3A146&txp=5532432&signature=100AF9048FFFDC584F5655F3AB9B5EBD027D6620.0DB44A52999858E8E633E9D05BA3D43505D4E6A0&mn=sn-nx5s7n7z%2Csn-n4v7knll&itag=22&mm=31%2C26&pl=33&id=o-ACDxX3BZPf9BM-lm0S-23urg4HqrNzkuCTmCAWLpE4dp'
[download] Destination: Why Meat is the Best Worst Thing in the World 🍔-NxvQPzrg2Wg.mp4
[download]   0.5% of 41.16MiB at  2.01MiB/s ETA 00:20         [download] Got server HTTP error: Downloaded 233524 bytes, expected 43159327 bytes. Retrying (attempt 1 of 10)...

ERROR: Did not get any data blocks
  File "__main__.py", line 19, in <module>
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\__init__.py", line 472, in main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\__init__.py", line 462, in _real_main
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 2006, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 805, in extract_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 859, in process_ie_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 1640, in process_video_result
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 1913, in process_info
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 1852, in dl
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\downloader\common.py", line 364, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\downloader\http.py", line 342, in real_download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\downloader\http.py", line 312, in download
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\downloader\common.py", line 165, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 622, in report_error
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpy110f8qy\build\youtube_dl\YoutubeDL.py", line 584, in trouble

Description of your issue, suggested solution and other information
Recently I've been getting errors like this more and more frequently when attempting to download certain mp4 format videos from YouTube. The particular videos that cause it are fairly random. It works if I don't specify mp4 in the format parameter, but the format (22) is listed as available for this video, so it should work (and does for the majority of videos).

I tried "-f mp4+140 -k"
This should download video "MP4" and audio "140" and then merge them, keeping the originals.
It tried to download format "22" and failed as shown above.
Format 22 is listed but fails if you specify it
22           mp4        1280x720   hd720  653k , avc1.64001F, mp4a.40.2@192k (44100Hz) (best)
Trying "-f (bestvideo+bestaudio) -k" downloaded video format "299" and audio format "251", merging them to "MKV".
Trying to merge the kept files manually using "ffmpeg" says that audio format "251" contains "OPUS" which cannot be contained in "MP4".
Video foirmat "299" is
299          mp4        1920x1080  1080p60 5274k , avc1.64002a, 60fps, video only, 86.47MiB
Audio format "251" is
251          webm       audio only DASH audio  152k , opus @160k, 8.81MiB
Trying "-f (bestvideo+140) -k" downloaded video format "299" and audio format "140", merging them to "MP4".
Audio format "140" is
140          m4a        audio only DASH audio  128k , m4a_dash container, mp4a.40.2@128k, 8.00MiB
Trying to merge the kept files manually using "ffmpeg" created an identical "MP4" file,  [same MD5]
Conclusion, the problem must be at YOUTUBE's end.
Use format numbers instead of "best" defaults.
...

Server side youtube issue for format 22.

-f 18 or bestvideo[ext=mp4]
Not occur "ERROR: Did not get any data blocks" error.

Requesting the webm format works. Turns out the problem is in fetching the mp4 format.
-f "webm[height=720]"          instead of        -f "best[height<=720]"
Explanation : #17148

Having this issue, although this same command has worked for me on many other videos.
youtube-dl -v -f 22/18/best https://www.youtube.com/watch?v=SWdM5MdSCbc
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-f', '22/18/best', 'https://www.youtube.com/watch?v=SWdM5MdSCbc']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.04.07
[debug] Python version 3.8.5 (CPython) - Linux-4.4.0-19041-Microsoft-x86_64-with-glibc2.29
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[youtube] SWdM5MdSCbc: Downloading webpage
[debug] Invoking downloader on 'https://r11---sn-bvvbax-2iae.googlevideo.com/videoplayback?expire=1618438502&ei=BhV3YOasJtm4hwbU0rXgAQ&ip=2601%3A43%3A80%3A32f0%3A6c13%3A5d95%3Aa2d4%3A9d12&id=o-ADpRqb0pMvcHzfHJfZCqjg3QxZA-PnXwgSbq0sRHo7ES&itag=22&source=youtube&requiressl=yes&mh=e3&mm=31%2C29&mn=sn-bvvbax-2iae%2Csn-ab5szn76&ms=au%2Crdu&mv=m&mvi=11&pl=34&pcm2=yes&initcwndbps=2463750&vprv=1&mime=video%2Fmp4&ns=ln9-8R6o38m9KZQLFUwmfb0F&cnr=14&ratebypass=yes&dur=8675.021&lmt=1551628500695417&mt=1618416555&fvip=3&fexp=24001373%2C24007246&c=WEB&txp=5535432&n=A-bma3hY_UFN60G&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cpcm2%2Cvprv%2Cmime%2Cns%2Ccnr%2Cratebypass%2Cdur%2Clmt&sig=AOq0QJ8wRQIgJzYGsj0xDNFhYm3e_xbDDDD7sic0z4kuQmZ6u1Q5pZICIQDvl6y3_PprQLHde7lTjA7m0hRcOljn6loZGIEaEEgYAg%3D%3D&lsparams=mh%2Cmm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AG3C_xAwRAIgIQeNLCkxqt_DVLzTLkX738djigO6a9l6hmkOoss1WcQCIGpHrbQRnf-WVIhQL80EWMrbnlz8WkgOaPhgQfyZhIwc'
[download] Resuming download at byte 4332580
ERROR: Did not get any data blocks
File "/usr/local/bin/youtube-dl", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/init.py", line 475, in main
_real_main(argv)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/init.py", line 465, in _real_main
retcode = ydl.download(all_urls)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 2059, in download
res = self.extract_info(
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 799, in extract_info
return self.__extract_info(url, ie, download, extra_info, process)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 806, in wrapper
return func(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 838, in __extract_info
return self.process_ie_result(ie_result, download, extra_info)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 872, in process_ie_result
return self.process_video_result(ie_result, download=download)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 1683, in process_video_result
self.process_info(new_info)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 1967, in process_info
success = dl(filename, info_dict)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 1906, in dl
return fd.download(name, info)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/downloader/common.py", line 366, in download
return self.real_download(filename, info_dict)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/downloader/http.py", line 352, in real_download
return download()
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/downloader/http.py", line 322, in download
self.report_error('Did not get any data blocks')
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/downloader/common.py", line 165, in report_error
self.ydl.report_error(*args, **kargs)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 628, in report_error
self.trouble(error_message, tb)
File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 590, in trouble
tb_data = traceback.format_list(traceback.extract_stack())

authors: aaronsgiles appleton-tom cjm399 dstftw ilyoungkim medbenchohra


text:
[YouTube] Age-gated videos still have "WARNING: Unable to extract video title" in 2019.07.30

Checklist

[X] I'm reporting a broken site support
[X] I've verified that I'm running youtube-dl version 2019.07.30
[X] I've checked that all provided URLs are alive and playable in a browser
[X] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[X] I've searched the bugtracker for similar issues including closed ones

Verbose log

$ youtube-dl -v RO90omga8D4
[debug] System config: ['--prefer-free-formats']
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', 'RO90omga8D4']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.07.30
[debug] Python version 3.7.4 (CPython) - Linux-5.1.20-300.fc30.x86_64-x86_64-with-fedora-30-Thirty
[debug] exe versions: ffmpeg 4.1.4, ffprobe 4.1.4
[debug] Proxy map: {}
[youtube] RO90omga8D4: Downloading webpage
[youtube] RO90omga8D4: Downloading embed webpage
[youtube] RO90omga8D4: Refetching age-gated info webpage
WARNING: Unable to extract video title
WARNING: unable to extract uploader name
[debug] Default format spec: bestvideo+bestaudio/best
WARNING: Requested formats are incompatible for merge and will be merged into mkv.
[debug] Invoking downloader on 'https://r5---sn-bvvbax-8pxs.googlevideo.com/videoplayback?expire=1564519534&ei=DlhAXaysI8eD8gPCg7KACw&ip=31.147.108.28&id=o-ALHAhZnktLhl59FfucRQhOCE_Zf3DPHPE6O-Q4-gU0nl&itag=299&aitags=133%2C134%2C13
5%2C136%2C137%2C160%2C242%2C243%2C244%2C247%2C248%2C278%2C298%2C299%2C302%2C303%2C394%2C395%2C396%2C397%2C398&source=youtube&requiressl=yes&mm=31%2C29&mn=sn-bvvbax-8pxs%2Csn-4g5e6nls&ms=au%2Crdu&mv=m&mvi=4&pl=18&initcwndbps=792500&
mime=video%2Fmp4&gir=yes&clen=36894980&dur=62.345&lmt=1507526424654884&mt=1564497842&fvip=3&keepalive=yes&c=WEB&sparams=expire%2Cei%2Cip%2Cid%2Caitags%2Csource%2Crequiressl%2Cmime%2Cgir%2Cclen%2Cdur%2Clmt&sig=ALgxI2wwRQIgPBfLuMPiIS
bOd1iXq-IAMWkjjJAkmFCp26uRZbEHhboCIQCb4AYxeJzxIc26-Nm_tY2MWpuKWGzKLs9mXOMkDEcVgA%3D%3D&lsparams=mm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AHylml4wRgIhAPj73Hu2yBGHqa1OSUXBg2saobCUAPoSV8BxbPPSfxyXAiEAu5DPDWamSZajbSw-8hVdAMTexh0
sJKj16cgDAVvJIhg%3D&ratebypass=yes'
[download] Destination: _-RO90omga8D4.f299.mp4

Description

Age-gated videos still have an issue with title and uploader extraction similar to #21934.

Thanks. Any chance another release will be made anytime soon?


text:
"Unable to extract encoded url" error

Checklist

[ x ] I'm reporting a broken site support
[ x ] I've verified that I'm running youtube-dl version 2019.09.28
[ x ] I've checked that all provided URLs are alive and playable in a browser
[ x ] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[ x ] I've searched the bugtracker for similar issues including closed ones

Verbose log

root@jdownloader:/media/jdownloader/indigo # youtube-dl --recode-video mp4 -w -o "%(upload_date)s-%(title)s.%(ext)s" "https://www.pornhub.com/pornstar/indigo-white/videos" --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['--recode-video', 'mp4', '-w', '-o', '%(upload_date)s-%(title)s.%(ext)s', 'https://www.pornhub.com/pornstar/indigo-white/videos', '--verbose']
WARNING: Assuming --restrict-filenames since file system encoding cannot encode all characters. Set the LC_ALL environment variable to fix this.
[debug] Encodings: locale US-ASCII, fs ascii, out US-ASCII, pref US-ASCII
[debug] youtube-dl version 2019.09.28
[debug] Python version 3.6.8 (CPython) - FreeBSD-11.2-STABLE-amd64-64bit-ELF
[debug] exe versions: ffmpeg 4.1.3, ffprobe 4.1.3
[debug] Proxy map: {}
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 1
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 2
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 3
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 4
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 5
[PornHubPagedVideoList] pornstar/indigo-white/videos: Downloading page 6
[download] Downloading playlist: pornstar/indigo-white/videos
[PornHubPagedVideoList] playlist pornstar/indigo-white/videos: Collected 229 video ids (downloading 229 of them)
[download] Downloading video 1 of 229
[PornHub] ph5d94d59ba8322: Downloading pc webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://cv.phncdn.com/videos/201910/02/252310512/1080P_4000K_252310512.mp4?9XghjLJORHI5Al8YtzrwGjgmBzINpZDpiZKQZSAdkXk7E5seKZ6bU2bEuheViMjgs2nICCGm4axi54x7oeslL_260ds0JG0PhaHAAuzGuUh5evHMrRSRFOcumFYS-9_jWKie0LXjgSvmuFyXNl2pc80Fz-R50IR0n32YgJm8sL8f05cz83HI1cqkhkbBSWkMxAIGsg7f--93HUMoLA'
[download] 20191002-420_NURSE_HELPS_YOU_CHILL_TF_OUT_-_INDIGO_WHITE.mp4 has already been downloaded
[download] 100% of 574.51MiB
[ffmpeg] Not converting video file 20191002-420_NURSE_HELPS_YOU_CHILL_TF_OUT_-_INDIGO_WHITE.mp4 - already is in target format mp4
[download] Downloading video 2 of 229
[PornHub] ph5d8c15819ffad: Downloading pc webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201909/26/250862062/1080P_4000K_250862062.mp4?ttl=1570103062&ri=51200000&rs=400000&hash=3cae368b86667d0c5fafb089058b899c'
[download] 20190926-WHAT_TEDDY-CHAN_DOES_WHILE_YOU_RE_AT_WORK_-_INDIGO_WHITE.mp4 has already been downloaded
[download] 100% of 786.00MiB
[ffmpeg] Not converting video file 20190926-WHAT_TEDDY-CHAN_DOES_WHILE_YOU_RE_AT_WORK_-_INDIGO_WHITE.mp4 - already is in target format mp4
[download] Downloading video 3 of 229
[PornHub] ph5d88fc0bbd8e0: Downloading pc webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://dv.phncdn.com/videos/201909/23/250333811/1080P_4000K_250333811.mp4?ttl=1570103063&ri=51200000&rs=400000&hash=962cddd7b03efb087245dc03006567d6'
[download] 20190923-SHIELD_BRO_HAS_TO_CHOOSE_-_INDIGO_WHITE.mp4 has already been downloaded
[download] 100% of 1.41GiB
[ffmpeg] Not converting video file 20190923-SHIELD_BRO_HAS_TO_CHOOSE_-_INDIGO_WHITE.mp4 - already is in target format mp4
[download] Downloading video 4 of 229
[PornHub] ph5d841783785cb: Downloading pc webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://cv.phncdn.com/videos/201909/20/249533381/1080P_4000K_249533381.mp4?supKf81M8vTwWpSW1TaijMJc_bRiGSk2mcga2YzlZjAnMV0mrTEjNRLRYJ0nllDxG0TPf_nUqqnhQlctI4YKL729Aqo6bYIRGGNWTcyX0ev6U_Lt5Z_O7Ge5_ZZabh3lxcp-fdvCZK95Df9c4PALJJROLnLzGPFFc60RtJaE9QeMyKp-BndSCa2xXDpAECBwlyad5jxray-tUEI02w'
[download] 20190920-RAIDING_AREA_51_-_INDIGO_WHITE.mp4 has already been downloaded
[download] 100% of 875.56MiB
[ffmpeg] Not converting video file 20190920-RAIDING_AREA_51_-_INDIGO_WHITE.mp4 - already is in target format mp4
[download] Downloading video 5 of 229
[PornHub] ph5d83af35f3673: Downloading pc webpage
[debug] Default format spec: bestvideo+bestaudio/best
[debug] Invoking downloader on 'https://ev.phncdn.com/videos/201909/19/249464471/1080P_4000K_249464471.mp4?validfrom=1570095865&validto=1570103065&rate=50000k&burst=50000k&hash=w5OLjnYSb0eOzxzUnCmOnulinCw%3D'
[download] 20190919-COW_WAIFU_TAKES_A_MILK_BATH_Slow_Motion_-_INDIGO_WHITE.mp4 has already been downloaded
[download] 100% of 1.09GiB
[ffmpeg] Not converting video file 20190919-COW_WAIFU_TAKES_A_MILK_BATH_Slow_Motion_-_INDIGO_WHITE.mp4 - already is in target format mp4
[download] Downloading video 6 of 229
[PornHub] ph5ca26a850d6b8: Downloading pc webpage
[PornHub] ph5ca26a850d6b8: Downloading tv webpage
ERROR: Unable to extract encoded url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/pornhub.py", line 235, in _real_extract
    'encoded url').split(';')
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1005, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract encoded url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

I think the issue is pretty well described by the command output above--trying to download a channel from PornHub succeeds in downloading a few videos, then ends with an error of "unable to extract encoded url".

It seems that it cannot extract the URL for the Premium videos, you can pass -i flag to ignore the erros.

youtube-dl --help
...
-i, --ignore-errors              Continue on download errors, for example to skip unavailable videos in a playlist

That does seem to have fixed it (and seems like an obvious thing for me to have tried in the first place)--thanks.

Well, then it's changed again recently to everything. Including simple playlists, I was actually using that d/ler, but the command line alone looked simpler, so i just grabs a playlist,s the behavior change  is across bistros, -i lets it fail, but after a -U and such, it got worse behavior wise complain for regex. The behavior of it with playlists is certainly recently chained, it used to go throughout pages and now it is stuck to 36 or less before it vomits.  I just assumed because ph is changing stuff regularly  one was sol on the youtube-dl client flowing them.  this was a new ubuntu 16 container
I tried updating with -U , pip and then apt-get to becertain and a container as well as fixed die, around two weeks ago it quite reading page1,2,,3,4,,5,6, if it was apart of a playlist.
Unable to extract encoded url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/youtube_dl/YoutubeDL.py", line 796, in extract_info
ie_result = ie.extract(url)
File "/usr/local/lib/python3.7/site-packages/youtube_dl/extractor/common.py", line 530, in extract
ie_result = self._real_extract(url)
File "/usr/local/lib/python3.7/site-packages/youtube_dl/extractor/pornhub.py",line 235, in _real_extract
'encoded url').split(';')
File "/usr/local/lib/python3.7/site-packages/youtube_dl/extractor/common.py", line 1005, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
youtube_dl.utils.RegexNotFoundError: Unable to extract encoded url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

authors: cewatkins danb35 molnarjani


text:
[YouTube] Some CPPCon 2019 Videos Fail to Download

Checklist

[x] I'm reporting broken site support.
[x] I've verified that I'm running youtube-dl version 2019.09.28.
[x] I've checked that all provided URLs are alive and playable in a browser.
[x] I've checked that all URLs and arguments with special characters are properly quoted or escaped.
[x] I've searched the bugtracker for similar issues including closed ones.

Verbose log

…$ ~/bin/tmp/youtube-dl -v "https://www.youtube.com/watch?v=IAdLwUXRUvg" -o "%(title)s.%(ext)s" # I currently have some…nasty outstanding package-management issues, so this a a temporary `youtube-dl` installation fetched straight from GitHub, hence its path.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=IAdLwUXRUvg', u'-o', u'%(title)s.%(ext)s']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.09.28
[debug] Python version 2.7.15 (CPython) - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: rtmpdump 2.4
[debug] Proxy map: {}
[youtube] IAdLwUXRUvg: Downloading webpage
[youtube] IAdLwUXRUvg: Downloading video info webpage
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on u'https://r4---sn-vgqsenek.googlevideo.com/videoplayback?expire=1571101015&ei=98SkXb6RNJPxwQH8kabYBw&ip=2601%3A803%3A4300%3A6%3Af97d%3A477e%3Ae370%3Ae8e&id=o-ALCPaP5DS9x5PtQ9LVQWrq9IFoMReEVdaTRHCNDvex-x&itag=22&source=youtube&requiressl=yes&mm=31%2C26&mn=sn-vgqsenek%2Csn-p5qs7n7l&ms=au%2Conr&mv=m&mvi=3&pl=26&initcwndbps=1817500&mime=video%2Fmp4&ratebypass=yes&dur=3142.147&lmt=1569528067583926&mt=1571079346&fvip=6&fexp=23842630&beids=9466586&c=WEB&txp=3416222&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cmime%2Cratebypass%2Cdur%2Clmt&sig=ALgxI2wwRAIgVHkSAtlBBLsPyzyukybAkKFu-oS26BCDCK6keO4towgCIDi2WvyEroIApvq7wfl_9osP9FVanf2jNSMu9Bgxp2bN&lsparams=mm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AHylml4wRAIgXZPwcCKq5w2fRwOCBH-TAQLFB2T3S_DmiLIuMaZEmmQCIGgA_heqpx8gTtarvnzvYxe6kYUQNtMhtJVwgG9mKTe5'
[download] Destination: CppCon 2019 - Miro Knejp “Non-conforming C++ - the Secrets the Committee Is Hiding From You”.mp4
[download]   0.6% of 200.34MiB at  1.49MiB/s ETA 02:13[download] Got server HTTP error: Downloaded 1200091 bytes, expected 210076867 bytes. Retrying (attempt 1 of 10)...

ERROR: Did not get any data blocks
Traceback (most recent call last):
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 342, in real_download
    return download()
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 320, in download
    retry(err)
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 225, in retry
    raise RetryDownload(e)
RetryDownload

…$ ~/bin/tmp/youtube-dl -v "https://www.youtube.com/watch?v=Lb3hlLlHTrs" -o "%(title)s.%(ext)s" # Again, the reason for this non-standard `youtube-dl` invocation path is the same as I stated above.
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.youtube.com/watch?v=Lb3hlLlHTrs', u'-o', u'%(title)s.%(ext)s']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.09.28
[debug] Python version 2.7.15 (CPython) - Darwin-15.6.0-x86_64-i386-64bit
[debug] exe versions: rtmpdump 2.4
[debug] Proxy map: {}
[youtube] Lb3hlLlHTrs: Downloading webpage
[youtube] Lb3hlLlHTrs: Downloading video info webpage
[debug] Default format spec: best/bestvideo+bestaudio
[debug] Invoking downloader on u'https://r5---sn-vgqsdn7s.googlevideo.com/videoplayback?expire=1571101059&ei=I8WkXbXwHISWDr3HhvgE&ip=2601%3A803%3A4300%3A6%3Af97d%3A477e%3Ae370%3Ae8e&id=o-ACE_yRPuj3AxCeEJULcu1ySH6XN0ef4VAkTWKeucyuBs&itag=22&source=youtube&requiressl=yes&mm=31%2C26&mn=sn-vgqsdn7s%2Csn-p5qlsndd&ms=au%2Conr&mv=m&mvi=4&pl=26&initcwndbps=1772500&mime=video%2Fmp4&ratebypass=yes&dur=1883.440&lmt=1569518454784847&mt=1571079346&fvip=5&fexp=23842630&c=WEB&txp=3416222&sparams=expire%2Cei%2Cip%2Cid%2Citag%2Csource%2Crequiressl%2Cmime%2Cratebypass%2Cdur%2Clmt&sig=ALgxI2wwRAIgLTRj6DrJYUHr2FvssF4DBWreLHQNaZdbWtZ3_84B8L4CIHkc48NsHMwCuorOVF_jF8SVZvcnjgH4yjbtVe_XUZ-R&lsparams=mm%2Cmn%2Cms%2Cmv%2Cmvi%2Cpl%2Cinitcwndbps&lsig=AHylml4wRQIhAJb43sNiTk56eQ4gAqy1LMhzWHLwaclH2qXWXu9_UsgFAiBkRjjnt_KrONY_AFhXT6jMEiAJAEjp1dquk18VRVfu8A%3D%3D'
[download] Destination: CppCon 2019 - Robert Schumacher “How to Herd 1,000 Libraries”.mp4
[download]   0.5% of 125.74MiB at  1.66MiB/s ETA 01:15[download] Got server HTTP error: Downloaded 690851 bytes, expected 131850173 bytes. Retrying (attempt 1 of 10)...

ERROR: Did not get any data blocks
Traceback (most recent call last):
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 342, in real_download
    return download()
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 320, in download
    retry(err)
  File "/Users/zadmin/bin/tmp/youtube-dl/youtube_dl/downloader/http.py", line 225, in retry
    raise RetryDownload(e)
RetryDownload

Description

     Some videos from CPPCon 2019 fail to download properly.  Those I've tried and had trouble with so far include:

CppCon 2019:  Miro Knejp “Non-conforming C++:  the Secrets the Committee Is Hiding From You”
CppCon 2019:  Robert Schumacher “How to Herd 1,000 Libraries”

Server side Youtube error for format 22.

@dstftw:  Hmm, is my issue a duplicate of #20296…?

authors: RandomDSdevel dstftw


text:
dr.dk not working after update

svtplay-dl versions:
# youtube-dl --version
2019.11.05

Operating system and Python version:
# cat /etc/os-release
PRETTY_NAME="Raspbian GNU/Linux 9 (stretch)"
NAME="Raspbian GNU/Linux"
VERSION_ID="9"
VERSION="9 (stretch)"
VERSION_CODENAME=stretch
ID=raspbian
ID_LIKE=debian
HOME_URL="http://www.raspbian.org/"
SUPPORT_URL="http://www.raspbian.org/RaspbianForums"
BUG_REPORT_URL="http://www.raspbian.org/RaspbianBugs"
# python3 -V
Python 3.5.3
# python -V
Python 2.7.13

What is the issue:
Can not download from dr.dk after they have updated the interface:
If i use a link from the old interface i get the following:
# youtube-dl --verbose https://www.dr.dk/tv/se/boern/ramasjang/gurli-gris-tv/gurli-gris-7/gurli-gris-2019-08-20
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.dr.dk/tv/se/boern/ramasjang/gurli-gris-tv/gurli-gris-7/gurli-gris-2019-08-20']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.11.05
[debug] Python version 2.7.13 (CPython) - Linux-4.19.66-v7+-armv7l-with-debian-9.11
[debug] exe versions: avconv 3.2.14-1, avprobe 3.2.14-1, ffmpeg 3.2.14-1, ffprobe 3.2.14-1
[debug] Proxy map: {}
[drtv] gurli-gris-2019-08-20: Downloading webpage
ERROR: Unable to extract urn; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/drtv.py", line 105, in _real_extract
    webpage, 'urn'))
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 1005, in _search_regex
    raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract urn; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

If i use a link from the new interface i get the following (same content):
# youtube-dl --verbose https://www.dr.dk/drtv/episode/gurli-gris_-graeskargildet_146041
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'--verbose', u'https://www.dr.dk/drtv/episode/gurli-gris_-graeskargildet_146041']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2019.11.05
[debug] Python version 2.7.13 (CPython) - Linux-4.19.66-v7+-armv7l-with-debian-9.11
[debug] exe versions: avconv 3.2.14-1, avprobe 3.2.14-1, ffmpeg 3.2.14-1, ffprobe 3.2.14-1
[debug] Proxy map: {}
[generic] gurli-gris_-graeskargildet_146041: Requesting header
WARNING: Falling back on generic information extractor.
[generic] gurli-gris_-graeskargildet_146041: Downloading webpage
[generic] gurli-gris_-graeskargildet_146041: Extracting information
ERROR: Unsupported URL: https://www.dr.dk/drtv/episode/gurli-gris_-graeskargildet_146041
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 2373, in _real_extract
    doc = compat_etree_fromstring(webpage.encode('utf-8'))
  File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2551, in compat_etree_fromstring
    doc = _XML(text, parser=etree.XMLParser(target=_TreeBuilder(element_factory=_element_factory)))
  File "/usr/local/bin/youtube-dl/youtube_dl/compat.py", line 2540, in _XML
    parser.feed(text)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1653, in feed
    self._raiseerror(v)
  File "/usr/lib/python2.7/xml/etree/ElementTree.py", line 1517, in _raiseerror
    raise err
ParseError: mismatched tag: line 5, column 14
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 796, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 530, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/generic.py", line 3354, in _real_extract
    raise UnsupportedError(url)
UnsupportedError: Unsupported URL: https://www.dr.dk/drtv/episode/gurli-gris_-graeskargildet_146041

Confirming that the site dr.dk has an updated layout and that the issue with youtube-dl can be confirmed with other URLs as well and other OS.

I am seeing the same issue on newest .exe .
from reading @Marge-Innovera 's comment, I assume this is fixed in the next version that will be released?
If you need more debug info, don't hesitate to ask.
ERROR: Unsupported URL: https://www.dr.dk/drtv/se/paw-patrol_-vovserne-redder-luke-stars_149929 Traceback (most recent call last):   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp7hc5a09v\build\youtube_dl\YoutubeDL.py", line 796, in extract_info   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp7hc5a09v\build\youtube_dl\extractor\common.py", line 530, in extract   File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\ytdl-org\tmp7hc5a09v\build\youtube_dl\extractor\generic.py", line 3354, in _real_extract youtube_dl.utils.UnsupportedError: Unsupported URL: https://www.dr.dk/drtv/se/paw-patrol_-vovserne-redder-luke-stars_149929


text:
Using the output template to save to TXT

Checklist

[x] I'm asking a question
[x] I've looked through the README and FAQ for similar questions
[x] I've searched the bugtracker for similar questions including closed ones

Question

Hi. I simply wish to know how to use the Output template to pull video data such as the upload date and view count and save to a text document. Is this possible to do, and can you provide an example command?
youtube-dl --get-id --get-duration --get-title https://www.youtube.com/watch?v=NEmdbcW7D3Q >> example.txt pulls the ID, duration, and title and saves as a text document, as an example. But I am confused as to how to use the output template.

--write-info-json                Write video metadata to a .info.json file


text:
Intermittent Error: "Failed to parse JSON Unterminated string starting at: line 1 column" ; "The following content has been identified by the YouTube community as inappropriate..."

[x ] I'm reporting a broken site support issue
[x ] I've verified that I'm running youtube-dl version 2021.12.17
[x ] I've checked that all provided URLs are alive and playable in a browser
[x ] I've checked that all URLs and arguments with special characters are properly quoted or escaped
[x ] I've searched the bugtracker for similar bug reports including closed ones
[x ] I've read bugs section in FAQ

youtube-dl -s -v https://www.youtube.com/watch?v=L4nyWlYga_w

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-s', '-v', 'https://www.youtube.com/watch?v=L4nyWlYga_w']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.8.10 (CPython) - Linux-5.4.0-113-generic-x86_64-with-glibc2.29
[debug] exe versions: ffmpeg 4.2.4, ffprobe 4.2.4
[debug] Proxy map: {}
[youtube] L4nyWlYga_w: Downloading webpage
WARNING: [youtube] L4nyWlYga_w: Failed to parse JSON Unterminated string starting at: line 1 column 52939 (char 52938)
[youtube] L4nyWlYga_w: Downloading API JSON
ERROR: The following content has been identified by the YouTube community as inappropriate or offensive to some audiences.
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 815, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/youtube_dl/YoutubeDL.py", line 836, in __extract_info
    ie_result = ie.extract(url)
  File "/usr/local/lib/python3.8/dist-packages/youtube_dl/extractor/common.py", line 534, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/lib/python3.8/dist-packages/youtube_dl/extractor/youtube.py", line 1731, in _real_extract
    raise ExtractorError(reason, expected=True)
youtube_dl.utils.ExtractorError: The following content has been identified by the YouTube community as inappropriate or offensive to some audiences.

this error occurs intermittently on videos placed in "Limited State", like above.
other examples:
youtube-dl -s -v https://www.youtube.com/watch?v=QVw4oV8ECaY
youtube-dl -s -v https://www.youtube.com/watch?v=k2zf5dpTZws

Issue should be closed:

What is a holocaust? "It's a mental illness."

In all cases I get (UK):
ERROR: Video unavailable
This content is not available on this country domain.

https://github.com/ytdl-org/youtube-dl/issues/30987#issuecomment-1140642230

I'll assume that the fix for #30987 will sort this. The issue will be closed when that fix is merged. If it then reappears, please open a new issue referencing this.

authors: 89z coletdjnz dirkf jiveandwail


text:
ERROR: Join this channel to get access to members-only content like this video, and other exclusive perks.

Checklist

[x] I'm reporting a feature request
[x] I've verified that I'm running youtube-dl version 2021.12.17
[ ] I've searched the bugtracker for similar feature requests including closed ones

Description

WRITE DESCRIPTION HERE

Thanks for the report, we will resolve this right away
👍

I am not able to download members only videos..

Do you have access to those videos? If yes, try logging into youtube-dl using youtube-dl URL --username USERNAME --password PASSWORD
If your account is protected by two-factor authentication, use youtube-dl URL --username USERNAME --password PASSWORD --twofactor CODE

Also, show details of the failure(s) encountered including full verbose log.

Do you have access to those videos? If yes, try logging into youtube-dl using youtube-dl URL --username USERNAME --password PASSWORD
If your account is protected by two-factor authentication, use youtube-dl URL --username USERNAME --password PASSWORD --twofactor CODE

From the title, I think they are asking about youtube. In which case, only --cookies will work, not username+password

@vishwajeet4real ?

Due to Google, username/pass combo doesn't work. Use --cookies option instead with youtube-dl. Look into README for more.


text:
[streamzz] Add new extractor

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] Searched the bugtracker for similar pull requests
[x] Read adding new extractor tutorial
[x] Read youtube-dl coding conventions and adjusted the code to meet them
[x] Covered the code with tests (note that PRs without tests will be REJECTED)
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[ ] Improvement
[x] New extractor
[ ] New feature

Description of your pull request and other information
Adding a new extractor for the https://streamzz.to website.

Read coding conventions.

Read coding conventions.

Read coding conventions.

Hi @dstftw, sorry to be dense here but can you give me a hint for what I missed? I tried my best to follow the coding conventions by providing fallbacks, making sure I used "fatal=False" everywhere appropriate, and running flake8.  Can you give me a nudge in the right direction? I'm happy to change anything necessary.

Read coding conventions.

Hi @dstftw, sorry to be dense here but can you give me a hint for what I missed? I tried my best to follow the coding conventions by providing fallbacks, making sure I used "fatal=False" everywhere appropriate, and running flake8.  Can you give me a nudge in the right direction? I'm happy to change anything necessary.

Coding conventions explains everything in details. If you don't want to read it see any recent new extractor PR review. All the issues are the same.

Coding conventions explains everything in details. If you don't want to read it see any recent new extractor PR review. All the issues are the same.

@dstftw Does this commit address the coding convention issues? https://github.com/ytdl-org/youtube-dl/pull/27984/commits/a476ada900f94a7300828d26ce19e4e395ba0a1c

@dstftw Does this commit address the coding convention issues? https://github.com/ytdl-org/youtube-dl/pull/27984/commits/a476ada900f94a7300828d26ce19e4e395ba0a1c

@ProgrammingByPermutation Check out #27691 - dstftw is just to lazy to check the actual code and spams that "read coding conventions" everywhere, don't get discouraged!


text:
[indavideo] Fix broken API URL, update examples

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[x] Searched the bugtracker for similar pull requests
[x] Read adding new extractor tutorial
[x] Read youtube-dl coding conventions and adjusted the code to meet them
[x] Covered the code with tests (note that PRs without tests will be REJECTED)
[x] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[x] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[x] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Status quo: IndaVideo extractor is broken, the API URL seems to have changed since the last commit. I don't know how long it has been broken, I first noticed it ~2 weeks ago, the first time I ever tried the extractor.
My pull request contains the correct URL which I acquired from inspecting the in-browser behavior of the IndaVideo platform. The fix works for every video I tried. It's unclear why the platform added this seemingly arbitrary suffix.
I also updated the list of IndaVideo example videos as some of them have been deleted.

Thanks. This seems to work for the test here according to the CI tests.
However, download test Generic_137 (Indavideo embed) is failing on the URL https://streetkitchen.hu/receptek/igy_kell_otthon_hamburgert_sutni/ which is giving "Unsupported URL". Would you be able to investigate this? It seems that this URL no longer has the expected embedded video. If it can't be fixed, please replace the test video with one of those mentioned in the newly added comments.

authors: dirkf thlor


text:
Suggesting some code changes based on recommendations

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

[ ] Searched the bugtracker for similar pull requests
[ ] Read adding new extractor tutorial
[ ] Read youtube-dl coding conventions and adjusted the code to meet them
[ ] Covered the code with tests (note that PRs without tests will be REJECTED)
[ ] Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

[ ] I am the original author of this code and I am willing to release it under Unlicense
[ ] I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

[ ] Bug fix
[ ] Improvement
[ ] New extractor
[ ] New feature

Description of your pull request and other information
Explanation of your pull request in arbitrary form goes here. Please make sure the description explains the purpose and effect of your pull request and is worded well enough to be understood. Provide as much context and examples as possible.

Looks like you accidentally created this PR. But if there is a real PR behind it, start off by completing the template even if you don't have all the code ready.

authors: dirkf splunkdevabhi