text:
Another Primary Key issue

Hello!
I'm working with latest version of both Realm, RealmCrust and Crust libraries. I'm getting new issues. In the following model with custom transformations:
public class User: Object {

    public dynamic var identifier: String = ""
    public dynamic var name: String? = nil
    public dynamic var surname: String? = nil
    public dynamic var height: Int = 170
    public dynamic var weight: Int = 70
    public dynamic var birthDate: NSDate? = nil
    public dynamic var sex: Int = 2
    public dynamic var photoPath: String? = nil

    override public static func primaryKey() -> String? {
        return "identifier"
    }

}

public class UserMapping: RealmMapping {

    public var adaptor: RealmAdaptor
    public var primaryKeys: Dictionary<String, CRMappingKey>? {
        return ["identifier": "id_hash"]
    }

    public required init(adaptor: RealmAdaptor) {
        self.adaptor = adaptor
    }

    public func mapping(inout tomap: User, context: MappingContext) {
        let birthdateMapping = DateMapping(dateFormatter: NSDateFormatter.birthdateFormatter())
        let primaryKeyMapping = PrimaryKeyMapping()

        tomap.birthDate     <- (KeyExtensions.Mapping("birthdate", birthdateMapping), context)
        tomap.identifier    <- (KeyExtensions.Mapping("id_hash", primaryKeyMapping), context)
        tomap.name          <- ("user_name", context)
        tomap.surname       <- ("user_surname", context)
        tomap.height        <- ("height", context)
        tomap.weight        <- ("weight", context)
        tomap.sex           <- ("sex", context)
        tomap.photoPath     <- ("photo_path", context)
    }
}

extension NSDate: AnyMappable { }

public class DateMapping: Transform {

    public typealias MappedObject = NSDate

    let dateFormatter: NSDateFormatter

    init(dateFormatter: NSDateFormatter){
        self.dateFormatter = dateFormatter
    }

    public func fromJSON(json: JSONValue) throws -> MappedObject {

        switch json {
        case .JSONString(let date):
            return self.dateFormatter.dateFromString(date) ?? NSDate()
        default:
            throw NSError(domain: "", code: 0, userInfo: nil)
        }
    }

    public func toJSON(obj: MappedObject) -> JSONValue {
        return .JSONString(self.dateFormatter.stringFromDate(obj))
    }
}

extension String: AnyMappable { }

public class PrimaryKeyMapping: Transform {

    public typealias MappedObject = String

    public func fromJSON(json: JSONValue) throws -> MappedObject {
        switch json{
        case .JSONNumber(let number):
            return "\(NSNumber(double: number).integerValue)"
        default:
            throw NSError(domain: "", code: -1, userInfo: nil)
        }
    }

    public func toJSON(obj: MappedObject) -> JSONValue {
        return JSONValue.JSONNumber(Double(obj)!)
    }
}

I apply the following tests:
it("Should decode JSON User objects"){

                let json: Dictionary<String, AnyObject> = ["data": ["id_hash": 170, "user_name": "Jorge", "user_surname": "Revuelta", "birthdate": "1991-03-31", "height": 175, "weight": 60, "sex": 2, "photo_path": "http://somwhere-over-the-internet.com/"]]

                let mapping = CRMapper<User, UserMapping>()
                let jsonValue = try! JSONValue(object: json)
                let realmUser = try! mapping.mapFromJSONToExistingObject(jsonValue["data"]!, mapping: UserMapping(adaptor: adaptor))

                expect(realm.objects(User).count) == 1
            }

            it("Should encode JSON User objects"){

                let user = realm.objects(User).first!
                let mapping = CRMapper<User, UserMapping>()
                let json = try! mapping.mapFromObjectToJSON(user, mapping: UserMapping(adaptor: adaptor))

                let id_hash = json["id_hash"]!
                expect(json).notTo(beNil())
                expect(id_hash.values() as? Int) == 170
            }

The second one crashes with Primary key cannot be modified after object is inserted, but I'm not modifying anything from that object, just encoding it to JSON... Just for let you know it.
Also, is there any way to use the side of Crust of PrimaryKeys without using the Realm side? An example: I generate a model that has not primary key until it's synchronized with a server which returns me the primary key for that object, but that synchronization could happen when the model is already saved on the Realm so primaryKey() isn't what I'm looking for. But using Crust primaryKeys should fit using that supposed primary key to update an already saved Model or even update it with information taking in mind that although the model has no primary key itself from Realm, Crust is trying to find the object in the database before creating a new one. I don't know if I'm explaining well.

Thanks for providing that code, I'll try running that in a test myself and figure out what's going on.
With your second question, are you stating that you:

Optimistically create a model object on the client without a primary key. Insert it into Realm.
PUT (or equivalent) the model object on the server, the returned response includes a primary key.
Attempt to update the object on the Realm
?

I'm not sure what the issue is here exactly, but I will mention that since you cannot update a primaryKey to a Realm Object after it's been inserted, you shouldn't actually have a primaryKey on your model object at all in this case.
However, if you set primaryKeys on a Crust Mapping it should search for an object with the provided keys before it does a mapping. You wouldn't have to make an explicitly primaryKey on your Realm Object to do this, it comes for free with the Mapping for that object. (And if that's broken for some reason let me know :)).
An additional thought, instead of creating an object on the client and getting the primary key from the server, have you thought of generating a UUID on the client for that object and then sending that UUID to the server? UUID's were made to avoid collisions in cases like this. You could use NSUUID to do this.

That's exactly I ment. I got what you explained in mind but the tests didn't pass I couldn't get it to work any further, erasing the primaryKey from the Model failed the tests, so when we get this working I'll dig deeper.
Tomorrow I'll bring you more news on this!!

Awesome! Looking forward to hearing more info!

Update:
/Users/buddybuild/workspace/EbikemotionTests/UserSpec.swift:38
failed: caught "Invalid value", "Expected object of type string for property 'identifier' on object of type 'User', but received: 170"

When running tests without the Realm primaryKey method overriden.

Thanks for the info, looking into that now.
Btw, in the case with a primaryKey it looks like since the <- operator uses an inout parameter on the field, realm immediately assumes the field will be mutated, and errors with Primary key cannot be modified after object is inserted. I think we'll have to come up with an entirely different method of mapping primary keys to JSON to circumvent this...
In the meantime, I'll try to figure out why this still throws an exception when not even using a primaryKey. That's definitely no good. And you can still map from JSON to Realm even if you can't map in the other direction for now.

Oh this is why
public dynamic var identifier: String = ""

identifier is a String, yet we're forming a predicate with an Int. Realm doesn't perform automatic type coercion.
Changing 170 to "170" like so: ["data": ["id_hash": "170", fixes the problem.
You'll have to change your transform to the following too
public func fromJSON(json: JSONValue) throws -> MappedObject {
        switch json{
        case .JSONString(let string):
            return string
        default:
            throw NSError(domain: "", code: -1, userInfo: nil)
        }
    }

But... I'm using a custom transform to cast the Integer returned from the JSON to the String of the Model, Am I wrong?
public class PrimaryKeyMapping: Transform {

    public typealias MappedObject = String

    public func fromJSON(json: JSONValue) throws -> MappedObject {
        switch json{
        case .JSONNumber(let number):
            return "\(NSNumber(double: number).integerValue)"
        default:
            throw NSError(domain: "", code: -1, userInfo: nil)
        }
    }

    public func toJSON(obj: MappedObject) -> JSONValue {
        return JSONValue.JSONNumber(Double(obj)!)
    }
}

Huh, you bring up a good point. I hadn't written the Transform to map the data before a search query. Sounds reasonable though and a feature we should add. I'll see what kind of solution I can come up with.

Ooooooh is that why! I didn't even realized It was a conflict with the way the data checked the existance of an object! You might think of me as a nighmare from now on... :dizzy_face:

Lol! No, it's totally a good thing you're bringing up points like this I hadn't considered. Just makes the library more robust.
We could probably add a transform to the primaryKeys var
public var primaryKeys: Dictionary<String, CRMappingKey>? {
    return [ "identifier": .Mapping("id_hash", PrimaryKeyMapping()) ]
}

We may even want to enhance primaryKeys further to avoid Primary key cannot be modified after object is inserted. I came up with this design over the last hour:
public var primaryKeys: Dictionary<String, CRMappingKey>? {
   return [ "identifier": .Primary("id_hash", PrimaryKeyMapping(),
   { tomap: MappedObject, map: PrimaryMapping in
        tomap.identifier <- map
    }) ]
}

PrimaryMapping would be a new type constructed at runtime with the "identifier" and PrimaryKeyMapping you supplied. The mapping is wrapped in a closure and would only be executed in the case of generating a new object to map the primary key to. We'd avoid having to use inout for tomap in this case because only a reference type would ever need to follow these semantics.
It's a little complex, but should cover every edge case. This work for you?

It seems fine to me, I actually like closures... haha. I think that with this we solve the issue where the inout with the primary key throws the exception. And I think that this kind of usage is acceptable in the library, with documentation doesn't add up anything too hard to understand.

authors: minuscorp rexmas

repo: rexmas/RealmCrust


text:
Arbimon uploader - upload audio files with the large issue (1-min files every 3 minutes)

Original post: https://rfcx.slack.com/archives/C01BW5M71JS/p1711477643671119
From: Carly

New user support request, you’re cc’d on the email. I’ve asked her to send us one of the large files so that we can test it to trouble-shoot. thanks!
https://arbimon.org/p/tai-gunshots

I found a problem, the arbimon-ingest-consumer log shows us the core sent to arbimon each first file in each 3 minutes, but the core segments have all 60 files for this 1 hour recording from the user example. So we can restore missed 40 files to the arbimon db. I can help with this. Another work, to find an original problem and we have to create a ticket on the core side with this description.
arbimon-ingest-consumer log

core saves all 60 files to the core db

I created core task https://github.com/rfcx/rfcx-api/issues/580

Recovered recording from the user's request
site: 51613 Tai C11F
date: 29 November 2023

I checked the files are correct. I can see every 1-min recordings.

I tested uploading 1 hour file to my project. I don't see the issue. All 60 files showed up in my project.
Project: https://arbimon.org/project/the-green-place-phitsanulok/audiodata/recordings
Site: 29 Mar 2024

source: gharchive/issue

authors: RatreeOchn koonchaya rassokhina-e

repo: rfcx/arbimon-uploader

license_type: permissive

license_source: github-api


text:
No values shown

I have a setup with node_exporter 0.15.2, Prometheus 2.1 and Grafana 4.6.3
I am not able to display any values.
When I open Prometheus, it is able to show values from node_exporter. Other dashboards work too.

Shame on me ... I used the Query Inspector and found out that no data was passed between Grafana and Prometheus. The reason for this was a firewall rule.

@mar1ged can you tell me what firewall rule was meddling? I have a similar issue

license_source: bigquery


text:
[Fabric] Incompatible Minimap Error GUI

I get frequent reports, mostly from people using the vanilla MC launcher as its error/crash GUI is absolutely useless and people don't check logs.
Replace the forced crash here: https://github.com/rfresh2/XaeroPlus/blob/58a8f333073c9395d554f730105bd638ae4738fc/src/main/java/xaeroplus/XaeroPlus.java#L42-L66 with a GUI similar to https://github.com/Luligabi1/NoIndium
Need to hook in before mixins are applied and crashes caused.
Not an issue on Forge as mods can be declared non-required and it will enforce version ranges only if the mod is present like we need

resolved in https://github.com/rfresh2/XaeroPlus/commit/b6097571b176aa71ba9a8e5560093691240aaca3

license: MIT


text:
ntvde python error

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.11.22. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[ ] I've verified and I assure that I'm running youtube-dl 2016.11.22

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

youtube-dl --verbose http://www.n-tv.de/mediathek/videos/panorama/Es-lebe-die-Fressefreiheit-was-duerfen-wir-noch-sagen-article19188311.html
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'--verbose', u'http://www.n-tv.de/mediathek/videos/panorama/Es-lebe-die-Fressefreiheit-was-duerfen-wir-noch-sagen-article19188311.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.06.25
[debug] Python version 2.7.12+ - Linux-4.4.0-kali1-686-pae-i686-with-Kali-kali-rolling-kali-rolling
[debug] exe versions: ffmpeg 3.1.2-1, ffprobe 3.1.2-1, rtmpdump 2.4
[debug] Proxy map: {}
[n-tv.de] 19188311: Downloading webpage
ERROR: 19188311: Failed to parse JSON  (caused by ValueError("Expecting ',' delimiter: line 11 column 30 (char 255)",)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 545, in _parse_json
return json.loads(json_string)
File "/usr/lib/python2.7/json/init.py", line 339, in loads
return _default_decoder.decode(s)
File "/usr/lib/python2.7/json/decoder.py", line 364, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python2.7/json/decoder.py", line 380, in raw_decode
obj, end = self.scan_once(s, idx)
ValueError: Expecting ',' delimiter: line 11 column 30 (char 255)
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/youtube_dl/YoutubeDL.py", line 676, in extract_info
ie_result = ie.extract(url)
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 343, in extract
return self._real_extract(url)
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/ntvde.py", line 44, in _real_extract
video_id, transform_source=js_to_json)
File "/usr/lib/python2.7/dist-packages/youtube_dl/extractor/common.py", line 549, in _parse_json
raise ExtractorError(errmsg, cause=ve)
ExtractorError: 19188311: Failed to parse JSON  (caused by ValueError("Expecting ',' delimiter: line 11 column 30 (char 255)",)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

You are using an outdated version of youtube-dl. Read this FAQ entry if you have troubles updating.

thx, my linux distro was uptodate - but outdatet. building it from git source myself helped

authors: dstftw viisauksena

license: Unlicense


text:
C-SPAN audio-only programs fail

[x] I've verified and I assure that I'm running youtube-dl 2017.12.14

I don't know why there are audio-only hearings recorded on C-SPAN (there seems to be video of this hearing available elsewhere, at least in snippet form...), but youtube-dl doesn't seem to work:
pb3:Downloads jhawk$ youtube-dl -v https://www.c-span.org/video/?438311-1/judiciary
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'https://www.c-span.org/video/?438311-1/judiciary']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.12.14
[debug] Python version 2.7.10 - Darwin-14.5.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg git-2017-02-28-7f62368, ffprobe git-2017-02-28-7f62368, rtmpdump 2.4
[debug] Proxy map: {}
[CSpan] 438311: Downloading webpage
ERROR: unable to find video id and type; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 784, in extract_info
    ie_result = ie.extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 437, in extract
    ie_result = self._real_extract(url)
  File "/usr/local/bin/youtube-dl/youtube_dl/extractor/cspan.py", line 115, in _real_extract
    raise ExtractorError('unable to find video id and type')
ExtractorError: unable to find video id and type; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

There is a
                                var jwsetup = {
                                        file: 'https://media.c-spanvideo.org/trimmed/program/049/492999/program.492999.AAC-STD.aac?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9tZWRpYS5jLXNwYW52aWRlby5vcmcvdHJpbW1lZC9wcm9ncmFtLzA0OS80OTI5OTkvcHJvZ3JhbS40OTI5OTkuQUFDLVNURC5hYWMiLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE1MTMzMjUwNDV9LCJJUEFkZHJlc3MiOnsiQVdTOlNvdXJjZUlwIjoiNzEuMjMyLjE5Ljc0In19fV19&Signature=S1TVHl2jeTxiir05RZRpnGDLaKq9yN6ih-oqr2FbxWzpFop9~oNJvJnhD9SUIZTObjYkXugKAdpr8-kldWIy-vE9kq5FKHAr~2ZcMO-T2~Nn3qN6-mW4PZ5tq0vhrD3LHdUEX4c9qk84mIpwhPaDF4AUgdV1QyULazTRHrDDxNQ_&Key-Pair-Id=APKAIHKVWBEAXX562G7Q',

and that URL downloads just fine.

Bah humbug. By the time I got to looking at this, the web page has changed and now has no audio link either... And the https://media.c-spanvideo.org/trimmed/program/ link fails now.
I think I don't understand how c-span manages their content at a fundamental level...

because the url has exprired.
from the Amazon CloudFront Policy in the audio url:
{
    "Statement": [{
        "Resource": "https://media.c-spanvideo.org/trimmed/program/049/492999/program.492999.AAC-STD.aac",
        "Condition": {
            "DateLessThan": {
                "AWS:EpochTime": 1513325045
            },
            "IPAddress": {
                "AWS:SourceIp": "CLIENT_IP"
            }
        }
    }]
}

I need to find another example, but looking at my dump file (from --write-pages) from last week, the C-SPAN web page had:

And that fails to be matched by _find_jwplayer_data():
https://github.com/rg3/youtube-dl/blob/549bb416f5a9d15c03749a98abd582d0e40418ac/youtube_dl/extractor/common.py#L2299-L2302
because that is expecting to see something like:

and script-video-ck, which is minified, eventually calls:
    var d = jwplayer("video-embed");
    d.setup(jwsetup);

So I imagine this too complicated for the common.py JWPlayer support to handle, so cspan.py needs to search out the var jwsetup and call _find_jwplayer_data() on its own?

@remitamine:

because the url has exprired.
from the Amazon CloudFront Policy in the audio url:

Yeah, I get that. What I'm puzzled by is why the audio link is gone from the c-span page, not why the audio URL itself is invalid.

I need to find another example, but looking at my dump file (from --write-pages) from last week, the C-SPAN web page had:

Here is another example of an audio-only C-SPAN recording which has not disappeared: https://www.c-span.org/video/?438495-1/judiciary
Same jwsetup js pattern and script-video-ck usage.

this will work in the url that you have posted, however it would be better to test on more urls.
diff --git a/youtube_dl/extractor/cspan.py b/youtube_dl/extractor/cspan.py
index 171820e27..1a6426c4f 100644
--- a/youtube_dl/extractor/cspan.py
+++ b/youtube_dl/extractor/cspan.py
@@ -111,6 +111,11 @@ class CSpanIE(InfoExtractor):
                     title = self._og_search_title(webpage)
                     surl = smuggle_url(senate_isvp_url, {'force_title': title})
                     return self.url_result(surl, 'SenateISVP', video_id, title)
+                video_id = self._search_regex(
+                    r'jwsetup\.clipprog\s*=\s*(\d+);',
+                    webpage, 'jwsetup program id', default=None)
+                if video_id:
+                    video_type = 'program'
         if video_type is None or video_id is None:
             raise ExtractorError('unable to find video id and type')

@@ -138,7 +143,7 @@ class CSpanIE(InfoExtractor):
         entries = []
         for partnum, f in enumerate(files):
             formats = []
-            for quality in f['qualities']:
+            for quality in f.get('qualities', []):
                 formats.append({
                     'format_id': '%s-%sp' % (get_text_attr(quality, 'bitrate'), get_text_attr(quality, 'height')),
                     'url': unescapeHTML(get_text_attr(quality, 'file')),

Thanks. I wouldn't have done it that way, but your way gets the C-SPAN metadata so I can see why you chose it.
It also ought to have worked, based on inspection of my saved data, on the original URL.

however it would be better to test on more urls.

Here's are some more test cases:
https://www.c-span.org/video/?437336-1/judiciary-antitrust-competition-policy-consumer-rights
https://www.c-span.org/video/?438047-1/judiciary
I got them from
https://www.c-span.org/search/?sdate=&edate=&audio=1&searchtype=Videos&sort=Most+Recent+Airing&text=0&sponsorid[]=61188
and picking out the ones marked "AUDIO STREAM ONLY" (except for 438311, the original, which is still listed there but broken).
So looks good, except for a youtube-dl test?

So looks good, except for a youtube-dl test?

added a test with only_matching as most of the pages show this error(most likely that a normal test will expire soon):
Video not available at this time

Huh. The older pages do all seem to show that.

I think I don't understand how c-span manages their content at a fundamental level...

Yeah that.
p.s.: seems like a test with skip would make more sense than only_matching but whatever.

authors: johnhawkinson remitamine


text:
How do you query DASH Manifest

I'm trying to manually read the DASH manifest of videos. It works for some, while for others I get "Access forbidden". How do you work around this?
Here's a video where it fails
https://www.youtube.com/watch?v=6ex1YkDXelo
Here's the DASH Manifest File
https://manifest.googlevideo.com/api/manifest/dash/ms/au/mt/1435354572/mv/m/id/o-AMUPnDgLvQXtsltgAI6SEP5-Bj2RqjxcLFQNP12iYzuz/pl/21/fexp/9407141%2C9407943%2C9408142%2C9408420%2C9408710%2C9408764%2C9409229%2C9413449%2C9413503%2C9414764%2C9415397%2C9415809%2C9416126%2C9416456%2C9416729%2C952640/ipbits/0/hfr/1/source/youtube/mm/31/ip/189.221.249.135/sver/3/mn/sn-j5caxh5nj5o-j0oe/pcm2cms/yes/gcr/mx/as/fmp4_audio_clear%2Cwebm_audio_clear%2Cfmp4_sd_hd_clear%2Cwebm_sd_hd_clear%2Cwebm2_sd_hd_clear/sparams/as%2Cgcr%2Chfr%2Cid%2Cip%2Cipbits%2Citag%2Cmm%2Cmn%2Cms%2Cmv%2Cpcm2cms%2Cpl%2Cplayback_host%2Crequiressl%2Csource%2Cexpire/requiressl/yes/s/0C2A2AAB7247D8BB426ABF972F45D633AAA48B41.659C2195AD715493183CA55688FE9A5F0A33F8588/upn/gojQPqsy9Ws/expire/1435376226/itag/0/playback_host/r2---sn-j5caxh5nj5o-j0oe.googlevideo.com/key/yt5

By decrypting signature.


text:
FFmpeg error while embedding subtitles in lynda.com videos

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.04.01.

[x] I've verified and I assure that I'm running youtube-dl 2016.04.01

Before submitting an issue make sure you have:

[x] At least skimmed through README and most notably FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
$ youtube-dl -v -o '%(playlist_index)s - %(title)s.%(ext)s' --write-sub --embed-subs --cookies cookies.txt 'https://www.lynda.com/JavaScript-tutorials/JavaScript-Essential-Training/81266-2.html'
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'-o', u'%(playlist_index)s - %(title)s.%(ext)s', u'--write-sub', u'--embed-subs', u'--cookies', u'cookies.txt', u'https://www.lynda.com/JavaScript-tutorials/JavaScript-Essential-Training/81266-2.html']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.04.01
[debug] Python version 2.7.9 - Linux-3.19.0-42-generic-x86_64-with-Ubuntu-15.04-vivid
[debug] exe versions: ffmpeg 2.5.10-0ubuntu0.15.04.1, ffprobe 2.5.10-0ubuntu0.15.04.1, rtmpdump 2.4
[debug] Proxy map: {}
[lynda:course] 81266: Downloading course JSON
[download] Downloading playlist: JavaScript Essential Training
[lynda:course] playlist JavaScript Essential Training: Collected 56 video ids (downloading 56 of them)
[download] Downloading video 1 of 56
[lynda] 87513: Downloading video JSON
[lynda] 87513: Checking 1-540 video format URL
[lynda] 87513: Checking 1-360 video format URL
[lynda] 87513: Checking 0-540 video format URL
[lynda] 87513: Checking 0-360 video format URL
[lynda] 87513: Checking 2-540 video format URL
[lynda] 87513: Checking 2-360 video format URL
[info] Writing video subtitles to: 01 - Welcome.en.srt
[debug] Invoking downloader on u'http://files2.lynda.com/secure/courses/81266/VBR_MP4h264_main_SD/81266_00_01_SC03_Welcome.mp4?c3.ri=3774139467965391321&hashval=1459631490_5c50bed6d920146788086cfc83296f5b'
[download] Destination: 01 - Welcome.mp4
[download] 100% of 5.13MiB in 00:02
[ffmpeg] Embedding subtitles in '01 - Welcome.mp4'
[debug] ffmpeg command line: ffmpeg -y -i 'file:01 - Welcome.mp4' -i 'file:01 - Welcome.en.srt' -map 0 -c copy -map -0:s -c:s mov_text -map 1:0 -metadata:s:s:0 language=eng 'file:01 - Welcome.temp.mp4'
ERROR: Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
Traceback (most recent call last):
  File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1771, in post_process
    files_to_delete, info = pp.run(info)
  File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 381, in run
    self.run_ffmpeg_multiple_files(input_files, temp_filename, opts)
  File "/usr/local/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 168, in run_ffmpeg_multiple_files
    raise FFmpegPostProcessorError(msg)
FFmpegPostProcessorError

Description of your issue, suggested solution and other information
As suggested in the title, the problem occurs when FFmpeg attempts to merge the downloaded .srt file into the .mp4 file. Consequently, the program halted, the merge failed and the downloads of all other videos in the sequence did not proceed. It is noteworthy that the only video and subtitles files that did get downloaded are complete, uncorrupted and play together nicely.
This problem was previously identified by @horusra in #8434 after it was closed:

It seems the error only occurs if I enable to embed subtitles.

Considering the aforementioned thread was closed and left unattended, and it would be ill-advised to dump various issues into one ticket, I am filing a separate issue here to make the problem resurface.
Please note that the problem is also reproducible without the use of  the --username, --password (for individual login) or --cookies (for organizational login) options, as the first couple of videos in each lynda.com course are accessible even when the viewer is not logged in. That being said, I am more than willing to provide my credentials should they be required for further testing.

There seems to be some problem in the downloaded file, ffprobe <filename> report this:
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'foo.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 1
    compatible_brands: isommp41avc1
    creation_time   : 2011-07-20 02:18:20
  Duration: 00:01:01.70, start: 0.000000, bitrate: 697 kb/s
    Stream #0:0(eng): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv), 960x540 [SAR 1:1 DAR 16:9], 567 kb/s, 30 fps, 30 tbr, 600 tbn, 60 tbc (default)
    Metadata:
      creation_time   : 2011-07-20 02:18:20
      handler_name    : ?Apple Video Media Handler
    Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 126 kb/s (default)
    Metadata:
      creation_time   : 2011-07-20 02:18:20
      handler_name    : ?Apple Sound Media Handler
    Stream #0:2(eng): Data: none (mp4s / 0x7334706D), 0 kb/s (default)
    Metadata:
      creation_time   : 2011-07-20 02:18:20
      handler_name    : ?
    Stream #0:3(eng): Data: none (mp4s / 0x7334706D), 0 kb/s (default)
    Metadata:
      creation_time   : 2011-07-20 02:18:20
Unsupported codec with id 0 for input stream 2
Unsupported codec with id 0 for input stream 3

For developers: changing in the commandline -map 0 -c copy to -map 0:v -map 0:a seems to pick only the working streams, but I'm not sure that its is the correct solution and don't know if there's any downside when using them.

This problem could potentially be related to #8855.
@jaimeMF I just tested with several other Lynda.com courses. All of them are giving the same error; examining the downloaded .mp4 files using ffprobe <filename> produces similar results – all of them contain stream #0:2 and stream #0:3 with no data. Effectively, we cannot embed subtitles in any Lynda.com videos using youtube-dl commands as of now (at least the many that I have tried).

Yes, it seems to be the same problem.

Should be fixed as #9288 got merged.
Note to developers:

In #9288 data and attachments are not copied. In the provided sample file mentioned above, copying data brings problems.
ffmpeg's -ignore_unknown seems a better option than #9288, but it's not implemented in avconv.

The latest change in subtitle embedding breaks in some cases (#10081). The example above no longer serves problematic files. Do you have other examples? @xiatianyu @reyyed

Hi, I'm sorry that I did not consider the cases where subtitles are embedded into video or audio only files.
The example which I relied on previously was Jekyll for Web Designers.
I've tried downloading it with the latest build of youtube-dl and did not encounter any ffmpeg error.
It's possible that there have been efforts by lynda to fix the files since both @xiatianyu and my examples no longer give problematic files.

OK I'm closing this now until someone else finds another example.

authors: jaimeMF reyyed xiatianyu yan12125


text:
HTTP Error 403: Forbidden (with correct password)

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2016.04.19. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[ x ] I've verified and I assure that I'm running youtube-dl 2016.04.19

Before submitting an issue make sure you have:

[ x ] At least skimmed through README and most notably FAQ and BUGS sections
[ x ] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[ x ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add -v flag to your command line you run youtube-dl with, copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
$ youtube-dl -g -f 22 'https://player.vimeo.com/video/157167711' --video-password SEEWEBSITE --verbose
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-g', u'-f', u'22', u'https://player.vimeo.com/video/157167711', u'--video-password', u'PRIVATE', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.04.19
[debug] Python version 2.7.10 - Linux-4.1.18-v7+-armv7l-with-Ubuntu-15.10-wily
[debug] exe versions: ffmpeg 2.7.6-0ubuntu0.15.10.1, ffprobe 2.7.6-0ubuntu0.15.10.1, rtmpdump 2.4
[debug] Proxy map: {}
ERROR: Wrong password: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/bin/youtube-dl/youtube_dl/extractor/common.py", line 388, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1940, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://player.vimeo.com/video/157167711

The video file came from here
http://buildtoabillion.com/
You can enter the password (listed on the website) to verify it does work via web.

Description of your issue, suggested solution and other information
Entering a valid password yields this error.  If I intentionally enter a BAD password I get a different message.

http://buildtoabillion.com/ does not work for me.

Agh I was afraid of that.  I thought it might be a public site... but guess not.  Sadly I don't have permission to give out the password.
However, I did accidentally run this on an older version of youtube-dl (from 2015) and found that it worked.  So I did some itterative testing/digging and this is the commit has that breaks my login 0f56a4b44366234dafbd4b56559c610d6a0d5b4c [vimeo] Don't pollute std_headers
git checkout 1b5284b13f1b579b2cbac5ce6ab9faa5b95800fb;make; ./youtube-dl -g 'https://player.vimeo.com/video/157167711' --video-password DELETED --verbose
M	README.md
Previous HEAD position was 0f56a4b... [vimeo] Don't pollute std_headers
HEAD is now at 1b5284b... [downloader/fragment] Make speed more smooth
zip --quiet youtube-dl youtube_dl/*.py youtube_dl/*/*.py
zip --quiet --junk-paths youtube-dl youtube_dl/__main__.py
echo '#!/usr/bin/env python' > youtube-dl
cat youtube-dl.zip >> youtube-dl
rm youtube-dl.zip
chmod a+x youtube-dl
COLUMNS=80 /usr/bin/env python youtube_dl/__main__.py --help | /usr/bin/env python devscripts/make_readme.py
/usr/bin/env python devscripts/make_contributing.py README.md CONTRIBUTING.md
pandoc -f markdown -t plain README.md -o README.txt
make: pandoc: No such file or directory
make: *** [README.txt] Error 1
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-g', u'https://player.vimeo.com/video/157167711', u'--video-password', u'PRIVATE', u'--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.03.01
[debug] Python version 2.7.10 - Darwin-15.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
https://fpdl.vimeocdn.com/vimeo-prod-skyfire-std-us/01/1433/6/157167711/489311568.mp4?token=DELETED

vs
git checkout 0f56a4b44366234dafbd4b56559c610d6a0d5b4c;make; ./youtube-dl -g 'https://player.vimeo.com/video/157167711' --video-password DELETED --verbose
M	README.md
Previous HEAD position was 1b5284b... [downloader/fragment] Make speed more smooth
HEAD is now at 0f56a4b... [vimeo] Don't pollute std_headers
zip --quiet youtube-dl youtube_dl/*.py youtube_dl/*/*.py
zip --quiet --junk-paths youtube-dl youtube_dl/__main__.py
echo '#!/usr/bin/env python' > youtube-dl
cat youtube-dl.zip >> youtube-dl
rm youtube-dl.zip
chmod a+x youtube-dl
COLUMNS=80 /usr/bin/env python youtube_dl/__main__.py --help | /usr/bin/env python devscripts/make_readme.py
/usr/bin/env python devscripts/make_contributing.py README.md CONTRIBUTING.md
pandoc -f markdown -t plain README.md -o README.txt
make: pandoc: No such file or directory
make: *** [README.txt] Error 1
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-g', u'https://player.vimeo.com/video/157167711', u'--video-password', u'PRIVATE', u'--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.03.01
[debug] Python version 2.7.10 - Darwin-15.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
ERROR: Wrong password: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "./youtube-dl/youtube_dl/extractor/common.py", line 358, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "./youtube-dl/youtube_dl/YoutubeDL.py", line 1931, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

The password-protected test case uploaded by @jaimeMF works fine.
$ youtube-dl -v http://player.vimeo.com/video/68375962 --video-password youtube-dl
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://player.vimeo.com/video/68375962', '--video-password', 'PRIVATE']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.04.13
[debug] Git HEAD: 7bab22a
[debug] Python version 3.5.1 - Linux-4.5.0-1-ARCH-x86_64-with-arch-Arch-Linux
[debug] exe versions: avconv v12_dev0-2591-gd12b5b2, avprobe v12_dev0-2591-gd12b5b2, ffmpeg 3.0.1, ffprobe 3.0.1, rtmpdump 2.4
[debug] Proxy map: {}
[vimeo] 68375962: Downloading webpage
[vimeo] 68375962: Extracting information
[vimeo] 68375962: Verifying the password
[vimeo] 68375962: Downloading JSON metadata
[vimeo] 68375962: Downloading m3u8 information
[debug] Invoking downloader on 'https://11-lvl3-pdl.vimeocdn.com/01/3675/2/68375962/171158304.mp4?expires=1461217740&token=018b0edf50d9b1459f63d'
[download] Destination: youtube-dl password protected test video-68375962.mp4
[download] 100% of 320.60KiB in 00:00

We can't debug unless you can provide an example with its password.

Still trying to get a way to allow you guys to test this with an actual password, or at least track down what the issue is.  But this should nail it down so that someone with a "Vimeo Plus" account can create a video that reproduces the issue.
Today I tried with print-traffic enabled (didn't even know that was an option, you guys rock)
./youtube-dl -g 'http://buildtoabillion.com/' --video-password DELETED --verbose --print-traffic

The header dumps were nearly identical up to this single point.
send: u'POST /video/157167711/check-password HTTP/1.1\r\nContent-Length: 28\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nHost: player.vimeo.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nConnection: close\r\nReferer: http://buildtoabillion.com/\r\nContent-Type: application/x-www-form-urlencoded\r\n\r\npassword=DELETED'
reply: 'HTTP/1.1 200 OK\r\n'

and
send: u'POST /video/157167711/check-password HTTP/1.1\r\nContent-Length: 28\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nHost: player.vimeo.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nConnection: close\r\nContent-Type: application/x-www-form-urlencoded\r\n\r\npassword=DELETED'
reply: 'HTTP/1.1 403 Forbidden\r\n'

The difference between the two is the "Referrer" value is missing from the 403 forbidden request.
Referer: http://buildtoabillion.com/\r\n

Vimeo Plus members have the ability to restrict downloads to a single website.
Sadly I don't have access to a "Vimeo Plus" account, but this should be easy to verify by anyone that does.

So, it does work for you when using http://buildtoabillion.com/ directly and downloading as vimeo embed video but does not work when trying to download as https://player.vimeo.com/video/157167711?
Does the latter case work if you specify referer explicitly with --referer?

Yes, adding --referrer does work
youtube-dl version 2016.03.01 does not require the --referrer, but the newest version does.
./youtube-dl -g 'http://buildtoabillion.com/' --video-password X --verbose
pandoc -f markdown -t plain README.md -o README.txt
make: pandoc: No such file or directory
make: *** [README.txt] Error 1
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-g', u'http://buildtoabillion.com/', u'--video-password', u'PRIVATE', u'--verbose']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.04.19
[debug] Python version 2.7.10 - Darwin-15.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
WARNING: Falling back on generic information extractor.
ERROR: Wrong password: HTTP Error 403: Forbidden (caused by HTTPError()); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

And now
./youtube-dl -g 'http://buildtoabillion.com/' --video-password X --verbose --referer https://buildtoabillion.com
pandoc -f markdown -t plain README.md -o README.txt
make: pandoc: No such file or directory
make: *** [README.txt] Error 1
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-g', u'http://buildtoabillion.com/', u'--video-password', u'PRIVATE', u'--verbose', u'--referer', u'https://buildtoabillion.com']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.04.19
[debug] Python version 2.7.10 - Darwin-15.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
WARNING: Falling back on generic information extractor.
https://fpdl.vimeocdn.com/vimeo-prod-skyfire-std-us/01/1433/6/157167711/489311568.mp4?token=DELETED

Post the output of ./youtube-dl -v --print-traffic https://player.vimeo.com/video/157167711 running 2016.03.01.

Man trimming that for tokens and passwords can make your eyes bleed =P
git checkout 1b5284b13f1b579b2cbac5ce6ab9faa5b95800fb
make
./youtube-dl -v --print-traffic 'https://player.vimeo.com/video/157167711' --video-password X
HEAD is now at 1b5284b... [downloader/fragment] Make speed more smooth
pandoc -f markdown -t plain README.md -o README.txt
make: pandoc: No such file or directory
make: *** [README.txt] Error 1
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'--print-traffic', u'https://player.vimeo.com/video/157167711', u'--video-password', u'PRIVATE']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2016.03.01
[debug] Python version 2.7.10 - Darwin-15.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 2.8.3, ffprobe 2.8.3
[debug] Proxy map: {}
[vimeo] 157167711: Downloading webpage
send: u'GET /video/157167711 HTTP/1.1\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nConnection: close\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nHost: player.vimeo.com\r\nReferer: https://player.vimeo.com/video/157167711\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Server: nginx
header: Content-Type: text/html; charset=UTF-8
header: X-Xss-Protection: 1; mode=block
header: Content-Security-Policy: script-src 'self' 'unsafe-inline' https://f.vimeocdn.com https://ssl.google-analytics.com https://js-agent.newrelic.com https://bam.nr-data.net; style-src 'self' 'unsafe-inline' https://f.vimeocdn.com; connect-src 'self' https://vimeo.com https://fresnel.vimeocdn.com https://skyfiregce-a.akamaihd.net https://*.vimeocdn.com https://ssl.google-analytics.com; media-src 'self' blob: https://*.vimeocdn.com https://*.akamaihd.net; object-src 'self' https://*.vimeocdn.com https://skyfiregcs-a.akamaihd.net https://skyfiregce-a.akamaihd.net https://sb.scorecardresearch.com; default-src 'none'; img-src https://i.vimeocdn.com https://secure-b.vimeocdn.com https://f.vimeocdn.com https://vimeo.com https://sb.scorecardresearch.com https://ssl.google-analytics.com https://secure.gravatar.com https://i0.wp.com https://i1.wp.com https://i2.wp.com; frame-src 'self' https://f.vimeocdn.com
header: X-Content-Type-Options: nosniff
header: Content-Encoding: gzip
header: Strict-Transport-Security: max-age=15120000; includeSubDomains; preload
header: P3p: CP="This is not a P3P policy! See https://vimeo.com/privacy"
header: Expires: Fri, 15 Dec 1985 19:30:00 GMT
header: Via: 1.1 varnish
header: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
header: X-Varnish-Cache: 0
header: X-VServer: dfvimeoplayproxy7
header: Via: 1.1 varnish
header: Fastly-Debug-Digest: 3098....fe460
header: Content-Length: 2795
header: Accept-Ranges: bytes
header: Date: Thu, 21 Apr 2016 17:43:32 GMT
header: Via: 1.1 varnish
header: Age: 0
header: Connection: close
header: X-Served-By: cache-iad2123-IAD, cache-den6022-DEN
header: X-Cache: MISS, MISS
header: X-Cache-Hits: 0, 0
header: Vary: Accept-Encoding
[vimeo] 157167711: Extracting information
[vimeo] 157167711: Verifying the password
send: u'POST /video/157167711/check-password HTTP/1.1\r\nContent-Length: 28\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nHost: player.vimeo.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nConnection: close\r\nReferer: https://player.vimeo.com/video/157167711\r\nContent-Type: application/x-www-form-urlencoded\r\n\r\npassword=X'
reply: 'HTTP/1.1 200 OK\r\n'
header: Server: nginx
header: Content-Type: text/html; charset=UTF-8
header: X-Xss-Protection: 1; mode=block
header: Content-Security-Policy: default-src 'self'; script-src 'self' https://f.vimeocdn.com; style-src 'self' https://f.vimeocdn.com; img-src 'self' https://i.vimeocdn.com https://f.vimeocdn.com
header: X-Content-Type-Options: nosniff
header: Strict-Transport-Security: max-age=15120000; includeSubDomains; preload
header: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
header: P3p: CP="This is not a P3P policy! See https://vimeo.com/privacy"
header: Expires: Fri, 15 Dec 1985 19:30:00 GMT
header: X-Host: dfvimeoplayer4
header: Set-Cookie: 157167711_password=e89....dd74469.1461260612; Domain=.vimeo.com; expires=Thu, 21 Apr 2016 18:43:32 GMT; Path=/
header: Accept-Ranges: bytes
header: Via: 1.1 varnish
header: Fastly-Debug-Digest: c38d....62fdf
header: Content-Length: 4230
header: Accept-Ranges: bytes
header: Date: Thu, 21 Apr 2016 17:43:32 GMT
header: Via: 1.1 varnish
header: Connection: close
header: X-Served-By: cache-iad2145-IAD, cache-den6023-DEN
header: X-Cache: MISS, MISS
header: X-Cache-Hits: 0, 0
header: Vary: Accept-Encoding
[vimeo] 157167711: Downloading JSON metadata
send: u'GET /157167711?action=load_download_config HTTP/1.1\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nX-Requested-With: XMLHttpRequest\r\nHost: vimeo.com\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nConnection: close\r\nCookie: 157167711_password=e892....d74469.1461260612\r\nReferer: https://player.vimeo.com/video/157167711\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Server: nginx
header: Content-Type: application/json; charset=UTF-8
header: Expires: Thu, 21 Apr 2016 05:43:33 GMT
header: X-UA-Compatible: IE=edge
header: X-XSS-Protection: 1; mode=block
header: X-Content-Type-Options: nosniff
header: X-Frame-Options: sameorigin
header: Strict-Transport-Security: max-age=15120000; includeSubDomains; preload
header: Content-Security-Policy-Report-Only: default-src https: data: blob: 'unsafe-inline' 'unsafe-eval'; report-uri /_csp
header: Content-Encoding: gzip
header: Via: 1.1 varnish
header: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
header: X-Varnish-Cache: 0
header: X-VServer: dfvimeowebproxy5
header: Via: 1.1 varnish
header: Fastly-Debug-Digest: 33c0....443d5
header: Content-Length: 24
header: Accept-Ranges: bytes
header: Date: Thu, 21 Apr 2016 17:43:33 GMT
header: Via: 1.1 varnish
header: Age: 0
header: Connection: close
header: X-Served-By: cache-iad2120-IAD, cache-den6023-DEN
header: X-Cache: MISS, MISS
header: X-Cache-Hits: 0, 0
header: X-Timer: S1461260613.575230,VS0,VE75
header: Vary: User-Agent,Accept-Encoding
[vimeo] 157167711: Downloading m3u8 information
send: u'GET /exp=1461282560~acl=%2F%2A%2F157167711%2F%2A~hmac=9184....b2998/2tierchgci/157167711/video/489311569,489311568/master.m3u8 HTTP/1.1\r\nAccept-Language: en-us,en;q=0.5\r\nAccept-Encoding: gzip, deflate\r\nConnection: close\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nHost: skyfiregce-a.akamaihd.net\r\nReferer: https://player.vimeo.com/video/157167711\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Access-Control-Allow-Origin: *
header: Content-Type: application/vnd.apple.mpegurl
header: Skyfire-Build: 2016-04-20-173158
header: Content-Encoding: gzip
header: Vary: Accept-Encoding
header: Timing-Allow-Origin: *
header: Content-Length: 198
header: Date: Thu, 21 Apr 2016 17:43:34 GMT
header: Connection: close
header: Aka-c-hit: cache-hit
[debug] Invoking downloader on u'https://fpdl.vimeocdn.com/vimeo-prod-skyfire-std-us/01/1433/6/157167711/489311568.mp4?token=X'
send: u'GET /vimeo-prod-skyfire-std-us/01/1433/6/157167711/489311568.mp4?token=X HTTP/1.1\r\nAccept-Encoding: identity\r\nAccept-Language: en-us,en;q=0.5\r\nConnection: close\r\nAccept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8\r\nUser-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:10.0) Gecko/20150101 Firefox/44.0 (Chrome)\r\nAccept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7\r\nHost: fpdl.vimeocdn.com\r\nReferer: https://player.vimeo.com/video/157167711\r\n\r\n'
reply: 'HTTP/1.1 200 OK\r\n'
header: Expires: Thu, 21 Apr 2016 17:38:46 GMT
header: Last-Modified: Mon, 29 Feb 2016 17:55:14 GMT
header: ETag: "72a49...b52a"
header: Content-Type: video/mp4
header: Server: UploadServer
header: Via: 1.1 varnish
header: Fastly-Debug-Digest: f3a1....83bde
header: Content-Length: 231805657
header: Accept-Ranges: bytes
header: Date: Thu, 21 Apr 2016 17:43:34 GMT
header: Via: 1.1 varnish
header: Connection: close
header: Timing-Allow-Origin: *
header: X-Served-By: cache-iad2128-IAD, cache-den6026-DEN
header: X-Cache: MISS, HIT
header: X-Cache-Hits: 0, 0
header: X-Timer: S1461260614.826347,VS0,VE0
[download] Destination: renamed-the-file-157167711.mp4
[download] 100% of 221.07MiB in 00:08

Should probably work with bdbb8530c7103a47be19b2dd2dfad8bfe9f8fd67.

Tested, and confirmed, thank you.

Thanks for testing.

authors: dstftw oaxlin yan12125


text:
Initial_placement.py Hardcoded variable domain and chain

Right now the chain and range of variable domain are still hard coded. To fix this ask user for input of variable domain

this is now fixed the TCR is now renumbered to IMGT which causes this info to always be the same

repo: rhinowarrior/swifttcr


text:
html closing tag

Shouldn't this be like this?
Doesn't seem to make a difference anyway, still loads fine.

Ah, you are right...

source: gharchive/pull-request

authors: rhysd romgrk

repo: rhysd/neovim-component

license: mit


text:
Pub/Sub Question

i want to send an message in a topic with the pub/sub api. but the second client on the same pc does not recieve any messages

I have a similar issue ... I can get the pub sub to work from 2 nodes running on the same machine but not when running on different machines.
What's the best way to go about debugging this/I am missing something fundamental?

could anyone provide a solution?

authors: furesoft markjerz

repo: richardschneider/net-ipfs-engine


text:
Sitecore 9.2 assembly version list don't work with excludes : an extra header was introduced

with Sitecore 9.2 (and maybe 9.1, didn't check), the lists couldn't be used anymore. With 4 fields of information (Filename,Version,FileVersion,InfoVersion) instead of 3 (Filename,Version,FileVersion,InfoVersion) the list couldn't be parsed anymore. This happened due to an explicit check on the amount of fields.

Thanks for the heads up. I'll try to fix it in the next few days but feel free to PR if you need it in a hurry - just add a specific unit test for it in the tasks project.

Ah PR is being prepared. My previous one contained 100+ Commits for some reason

PR #71 solves this issue. Succesfully tested

Released as 1.5.6

Looks to be an issue in 10.1 - manually changing the header to this fixes it:
Filename,FileVersion,Version,InfoVersion

authors: BasLijten markgibbons25 richardszalay

repo: richardszalay/helix-publishing-pipeline


text:
pipe入力時に-t csvを指定するとwidthエラーが出る

↓を試す

tput cols
stty -F /dev/tty

stty size -F /dev/ttyで解決しそう

tput cols でも行けそうですね。
❯ echo | tput cols
188

https://github.com/richcat-dev/richcat/issues/83#issuecomment-1024833241 の2つを試してみたところ、pipe入力は治りました。ただ、#29 の問題は依然として残ったままです。
terminal_width = os.popen('tput cols', 'r').read()

terminal_width = os.popen('stty size -F /dev/tty').read().split()[1]

authors: ShotaroKataoka yamamoto-yuta

repo: richcat-dev/richcat


text:
mysql2 transactions don't work

With mysql driver, I can send "start transaction" and "rollback" and things seem to work.
with mysql2 I get "This command is not supported in the prepared statement protocol yet" (with same MariaDB server)
despite #703

Looks like .execute method in use automatically uses prepared statements, while .query doesn't? will add a quick test and see if that is the case

authors: eladeyal-intel rickbergfalk

repo: rickbergfalk/sqlpad


text:
I don't think containsduplicate is working

Hey
I have implemented similar code from the csv import in my repo (https://github.com/scottrobertson/mondo-to-ynab) to check for duplicates. It does not seem to be working. It's allowing me to import them as many times as i want.

Is the unit test test_duplicate passing in the source you have checked out ? I just verified HEAD in the master branch and it's passing the csv import duplicate tests, i.e. not importing twice.Maybe the version in pip is out of date

I am using the repo directly in git.
Does the usage look correct? https://github.com/scottrobertson/mondo-to-ynab/blob/master/python/main.py#L72-L76

Usage looks fine. Considering Mondo gives you a unique id (the tx_ part), you should probably use it to ensure no duplicates, I did something similar in my OFX import script, using the FITID tag. You can probably save the mondo id in the memo of the transaction to importing into nYNAB, and not import transaction with matching data id.
If it's a webhook, mondo should be sending you only a single request per unique transaction anyway , shouldn't it ?

Furthermore containsduplicate is being phased out, in favor of letting consumers (import scripts, and your code) of the library decide what is a duplicate and what's not, I think it makes more sense (how to discriminate a duplicate transaction shouldn't be tied to what's a duplicate account or whatever). I'll commit a major update soon once all the tests pass.

authors: rienafairefr scottrobertson

repo: rienafairefr/nYNABapi


text:
🛑 Mumbai Server is down

In 1c061f6, Mumbai Server (103.168.119.181) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Mumbai Server is back up in d3bcb26.

repo: rifzkiadiyaksa/upptime


text:
Match new RIK workload definition

Context
Previously, we decided to do some changes into the workload definition (api_version into apiVersion). The change hasn't been made into our CLI tool, making it unusable
What needs to be done ?

Migrate api_version field to apiVersion: #68
Migrate Workload definition to crates/definitions crate
Improve testing coverage of the CLI with simple fixtures (either json file or json string in test's code)

Reopen as not fully completed by PRs

repo: rik-org/rik


text:
Updates to ChartInteractions, time series chart layout and MeasureBigNumber

This PR makes a series of related changes to the primary components used in the Dashboard to solve some UI bugs, inconsistencies with Figma and to prepare for #4216 and Custom Dashboards.

Changes the MeasureBigNumber component to have a fixed width of 118 and height of 85, to match Figma
Conditionally renders MeasureBigNumber as a div or button element depending on context
Removes the use of CSS Grid in the TimeSeriesChartContainer to allow for better layout placement and scroll behavior
Removes the use of Portal for ChartInteractions, solving a UI issue where its position would not update when resizing the sidebar
Shifts the Y-axis labeling for the TimeSeries measures to the left to match their alignment on Figma
Removes unnecessary wrapper elements in the dashboard

@djbarnwal
Alright, addressed those two, though there are some issues with MeasuresContainer (#4258) that should be addressed eventually (present on main as well). That component features a lot of duplicate code from MetricsTimeSeriesContainer and they should probably be combined.

repo: rilldata/rill


text:
Fix libzip compilation error using gcc 14

Fix libzip compilation error using gcc 14
./buildgcc.sh
In file included from zip.c:39,
                 from ring_libzip.c:14:
miniz.h:4988:9: note: '#pragma message: Using fopen, ftello, fseeko, stat() etc. path for file I/O - this path may not support large files.'
 4988 | #pragma message(                                                               \
      |         ^~~~~~~
ring_libzip.c: In function 'ring_zip_extract_file':
ring_libzip.c:298:40: error: passing argument 2 of 'zip_entry_extract' from incompatible pointer type [-Wincompatible-pointer-types]
  298 |                 zip_entry_extract(zip, on_extract, &buf);
      |                                        ^~~~~~~~~~
      |                                        |
      |                                        size_t (*)(void *, long long unsigned int,  const void *, size_t) {aka long unsigned int (*)(void *, long long unsigned int,  const void *, long unsigned int)}
zip.c:1526:32: note: expected 'size_t (*)(void *, uint64_t,  const void *, size_t)' {aka 'long unsigned int (*)(void *, long unsigned int,  const void *, long unsigned int)'} but argument is of type 'size_t (*)(void *, long long unsigned int,  const void *, size_t)' {aka 'long unsigned int (*)(void *, long long unsigned int,  const void *, long unsigned int)'}
 1526 |                       size_t (*on_extract)(void *arg, uint64_t offset,
      |                       ~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 1527 |                                            const void *buf, size_t bufsize),
      |                                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Thanks for the update

authors: MahmoudFayed ysdragon

repo: ring-lang/ring


text:
limit the maxWidth in MessageItem details to 170px to avoid being blo…

…cked

Coverage increased (+0.2%) to 0.939% when pulling 70fab704b7a5d47cebbfc2cf0eea3c477a14bad6 on u9520107:rcint-4429 into 3575e0cc2bad2e114ec835a157a1f31f34db8e0b on ringcentral:dynamics-regression.

repo: ringcentral/ringcentral-js-widget


text:
doc: WebAPIの実用例

章タイトルが内容にそぐわない気もしますが、今は適切なタイトルが思い浮かびません。

ここにさ、それぞれのプレイグラウンドを入れたらどうかな。
それぞれのフィールドを入力不可にして。


text:
Configurator destruction causing errors

Description
When switching between ripe-configurator story and others several times, errors of this.element is null start to appear in the console. This might be due to the fact that unresolved promises and timeouts are still hanging in the configurator-prc of ripe-sdk.
Expected vs. Observed

-
-

Expected
The configurator destroys without causing any errors.

Observed
Errors appear if the there are very fast switches between configurator and other elements.

Repro Steps

Go to the storybook of ripe-sdk-components-vue https://ripe-sdk-components-vue.platforme.com/storybook
Switch fast between ripe-configurator and others components several times
The error will appear

Environment

Key
Value

Device
Desktop

Operating System
Manjaro Linux

Browser
Firefox 83.0

Instance (URL)
https://ripe-sdk-components-vue.platforme.com/storybook

Screens
Uncaught (in promise) TypeError: this.element is null
    mark configurator-prc.js:1305
    render configurator-prc.js:1351
    promise callback*render configurator-prc.js:1351
    render configurator-prc.js:1353
    render configurator-prc.js:1353
    result configurator-prc.js:1369
    setTimeout handler*./node_modules/ripe-sdk/src/js/visual/configurator-prc.js/ripe.ConfiguratorPrc.prototype._preload/result< configurator-prc.js:1367
    _preload configurator-prc.js:1276
    update configurator-prc.js:247
    _update ripe.js:1256
    update ripe.js:1315
    setPart ripe.js:716
    _callee2$ ripe-pickers.vue:185
    Babel 8
    VueJS 3
configurator-prc.js:1305

@BeeMargarida try and investigate this one, checking if we're calling the unbindConfigurator at the right time (destroyed etc), etc.

authors: BeeMargarida gcandal

repo: ripe-tech/ripe-sdk-components-vue


text:
Quick interval period filters and option to set graph dimensions and interval with url or dasboard config file

I have added options to set the graph dimensions or interval period with url (inspirited by nathan-opscode  https://github.com/ripienaar/gdash/pull/14 commits).
Eg:
http://gdash.example.com/dashboard/email/?from=-8d&until=-7d
http://gdash.example.com/dashboard/email/full/2/600/300?from=-8d&until=-7d
http://gdash.example.com/dashboard/email/full/4?width=600&height=300&from=-8d&until=-7d

There is also a optional configurable interval quick filter for dashboards.
Also dashboard based default dimension and interval settings are configurable via dashboard dash.yml file.

This doesn't appear to work for the this route:
get '/:category/:dash/?*' do

Looking through the code, I don't see how
options[:width] ||= @width
options[:height] ||= @height
get set at all in that route.
Shouldn't you do something like, if no url  options, do:
options[:width] = @graph_width
options[:height] = @graph_height
?

Ignore me please.  Found my error.

This looks good to me, love to see it merged.

I like this too. +1

authors: blysik joemiller nstielau tanelj

repo: ripienaar/gdash


text:
'tecINSUFFICIENT_RESERVE  141 error

when i creaTE mul-address,i get error.How to solve?
'''
signedSignerListSet---- { resultCode: 'tecINSUFFICIENT_RESERVE',
resultMessage: 'Insufficient reserve to complete requested operation.',
engine_result: 'tecINSUFFICIENT_RESERVE',
engine_result_code: 141,
engine_result_message: 'Insufficient reserve to complete requested operation.',
tx_blob: '12000C2200000000240000001320230000000368400000000000010073210283D7ED66CA7B83579EF2B7E24242BE82BC8BC6E28B78734B9A7952D4D261C36374463044022008F51236E063B59DA34005EEF1C0CBDBA6B173A55E18AF899EC8314D85008BB20220142DB8D57F3847E6FB7144CE63A6214C26D3E600ED6AA1AFD9344B92B7E1CCD28114F01F8FED33003D4348CD884B0E859698D1612A5DF4EB13000281149CA5CB06855792E03DCA44BFF83D5B5DD6A2D0C1E1EB1300028114F7C00B1701DFDDA6EBC0A0205B1EB5AB3154DC97E1EB130002811438BA5187670CA23683519152B96D44755F40B190E1F1',
tx_json:
{ Account: 'r4tezpBLWezPQC5PJ6DiUx6K4JZtzuUPdP',
Fee: '256',
Flags: 0,
Sequence: 19,
SignerEntries: [ [Object], [Object], [Object] ],
SignerQuorum: 3,
SigningPubKey: '0283D7ED66CA7B83579EF2B7E24242BE82BC8BC6E28B78734B9A7952D4D261C363',
TransactionType: 'SignerListSet',
TxnSignature: '3044022008F51236E063B59DA34005EEF1C0CBDBA6B173A55E18AF899EC8314D85008BB20220142DB8D57F3847E6FB7144CE63A6214C26D3E600ED6AA1AFD9344B92B7E1CCD2',
hash: '26ABE074EEED6AB36D5804F521BE0D3FB446DA37023B852E4A1E61FF567CD1B9' } }

i have enough balance
account_data": {
            "Account": "r4tezpBLWezPQC5PJ6DiUx6K4JZtzuUPdP",
            "Balance": "36685972",
            "Flags": 0,
            "LedgerEntryType": "AccountRoot",
            "OwnerCount": 0,
            "PreviousTxnID": "50853BF13979D3C5D0A2AFEE1CB777F263B06574697DEE7E6F6D4318D574B994",
            "PreviousTxnLgrSeq": 45172123,
            "Sequence": 21,
            "index": "2C2D999482DA731DC0BEEF1174D0189E4D9C4910EBCC8A0173CD0486D10316EA",
            "signer_lists": []
        },

Thanks four opening this issue!
Under the current rules simply having a {{SignerList}} locks up 2 incremental reserve units, and each signer in the list locks up 1 more incremental reserve unit (reference).
The reserve is currently 20 XRP and the incremental reserve is 5. You are attempting to create a signer list with three entries, so the new reserve for your account is (20 XRP + (5 entries * 5 XRP per entry) = 45 XRP. The account you show has ~36 XRP, which is less than the required 45 XRP.
So this is working correctly. For now, anyways: when the MultiSignReserve amendment activates, the rules for calculating the additional reserve associated with a signer list will change, reducing the amount of XRP that must be locked up; a list, regardless of the number of entries, will cost only one incremental reserve.
I'm going to close this issue. If you believe this is in error, please feel free to reopen.

repo: ripple/rippled

license: ISC


text:
Change more uint256 into SHAMapHash

@mtrippled @miguelportilla

Current coverage is 49.38%

Merging #1414 into develop will not affect coverage as of 9218fd0

@@            develop   #1414   diff @@
=======================================
  Files           964     964
  Stmts         67065   67067     +2
  Branches          0       0
  Methods           0       0
=======================================
  Hit           33122   33122
  Partial           0       0
- Missed        33943   33945     +2

Review entire Coverage Diff as of 9218fd0

Powered by Codecov. Updated on successful CI builds.

I left a comment but not holding this back.
:+1:

Rebased to b9.

:+1:

Rebase to b10.

authors: HowardHinnant codecov-io miguelportilla mtrippled


text:
Fix offheap configurations in index_summary_upgrade_test

Local testing works as expected now - notes on https://datastax.jira.com/browse/CSTAR-276

+1 after the minor fix

authors: mshuler ptnapoleon

repo: riptano/cassandra-dtest


text:
Does IOMMU need to check the EN_ATS for ATS Invalidation Completion？

Is it possible that software send a ATS INVAL command whose EN_ATS is 0？ And if it is possible，I think IOMMU needs to check the EN_ATS about the ATS Invalidation Completion.

The IOMMU processes invalidation completions only if there is an outstanding invalidation being tracked by the IOMMU i.e. software has submitted a invalidation request. Each invalidation request has a invalidation tag (ITAG) and a device may generate as many invalidation completions as the number of Traffic Classes (TCs) it may have used. The IOMMU tracks the pending invalidations using a tracker indexed by ITAG and DID . If a completion is received for which there is no outstanding invalidation then they are discarded as unsupported requests. There is no need to check EN_ATS for this action.

I see. Thanks for your answer.

repo: riscv-non-isa/riscv-iommu


text:
unable to assemble "jal x0,0x1f

hi
i am using gas:
jal x0,0x00 -> give me 6f 00 00 00
jal x0,0x1234 -> give me 6f 10 40 23
jal x0,0x1f give me this error:
temp.o: in function _start': (.text+0x0): relocation truncated to fit: R_RISCV_JAL against UND'
why?
thanks
Peter

You can not jump or branch to an odd address.

thanks

authors: johnwinans quantrpeter

repo: riscv/riscv-asm-manual


text:
Minor fixes for rvintrin.h.

Just some minor fixes. NFCI.
Viele Grüße aus Linz, Markus

If you don't have an assignment, then it is better to file bug reports and let someone with an assignment write the code.

Closing.

authors: jim-wilson markus-oberhumer

repo: riscv/riscv-bitmanip


text:
executor: LimitExecutor will panic if all chunks only have 1 element

After https://github.com/singularity-data/risinglight/pull/263 is applied, and next_batch is called with:
it.next_batch(Some(1)).await

Limit executor panics with
thread 'test_disk::_limit_slt_' panicked at 'attempt to subtract with overflow', src/executor/limit.rs:13:9

Is this fixed? I'm a little bit confused about how to reproduce this issue. Where to call it.next_batch(Some(1)).await?

My fault. There are two ways to reproduce this:

Change TableScanExecutor to return one row at a time.

https://github.com/risinglightdb/risinglight/blob/caa809667b5ccf41cceef17a6ac54fb35369680c/src/executor/table_scan.rs#L110
where we can replace next_batch(None) with next_batch(Some(1)).
---- disk::_limit_slt_ stdout ----
thread 'disk::_limit_slt_' panicked at 'attempt to subtract with overflow', src/executor/limit.rs:28:23

and meanwhile, I found that a lot of other tests failed if we return one row at a time 🤣

I guess if we simply insert multiple one-row chunk to in-memory storage, and select * from table limit 10, will also reproduce this issue.

When batch size == 1, all tests other than limit has been fixed in https://github.com/risinglightdb/risinglight/pull/504/

authors: skyzh xxchan

repo: risinglightdb/risinglight


text:
Separate source and streaming rate limit

source_rate_limit will limit the upstream side of the downstream executors.
streaming_rate_limit will limit the backfill rate.

[ ] Update the session variable setting
[ ] Update the parser to handle the with options.

To be more precise, source_rate_limit will control the source rate limit with connections for this source/table in relation to the external system's source rate limit.
Meanwhile, streaming_rate_limit will control the rate limit between the MV/sink being created and its upstream, which also includes the situation when an MV is created on a source. In this case, I believe that a minimum value should be taken between streaming_rate_limit and the source_rate_limit. This is because when the Kafka source's read.offset=oldest, the scenario is the same as with backfill.

Either LGTM

Separate into backfill_rate_limit and streaming_rate_limit.

authors: fuyufjh kwannoel st1page

repo: risingwavelabs/risingwave