text:
Added Rumble Support for generic devices

This adds support for generic HID controllers to have rumble Support (#611)
Every device which reports usages from 0F 95 to 0F 9C will be marked as a rumble-capable device (hid_parser.c#L196) along with 0F 50, 0F 70, 0F 7C and 0F A7 (hid_parser.c#L197).
Please note that there is no effect support, so usages from 0F 99 to 0F 9C have no use.
The way it works is by getting the Maximum and the Minimum value for the report. In case the Rumble State is off, then the BlueRetro will send the minimum value to every usage. Otherwise, it'll send the maximum value multiplied by a multiplier constant (its value is from 0.0 to 1.0. I leave it there just in case) or the value from fb_data.
This should work with generic controllers like the Stadia one, Chinese clones/alternatives, and projects like my BluControl (TBA) an BluN64, without needing to integrate them separately.
Main Changes:

Added RUMBLE report id
Added USAGE_GEN_PHYS_INPUT Usage Page
Moved HID_MI_OUTPUT to the block of HID_MI_INPUT (hid_parser.c#L392)
Implemented the feedback functions for generic HID controllers

Tested with:

Config: HW1 GameCube
Console: Nintendo Wii
Game: Super Smash Bros Brawl
HomeBrew: GameCube Controller Tester
Controller: Generic one based on BluControl

There shouldn't be any breaking change as I didn't touch anything related to the current functionalities. Also, I didn't note any type of input lag, and I tried to simplify as much as I could.
If you have any question or feedback, please let me know

Note: The reason about pytest failling is because (I think) it originally didn't count about BlueRetro printing an Output usage.
Below is the test Descriptor parsed by USB Descriptor and Request Parser, and I marked both Output which were ignored on previous version of BlueRetro:

Test Descriptor
0x05, 0x01,        // Usage Page (Generic Desktop Ctrls)
0x09, 0x06,        // Usage (Keyboard)
0xA1, 0x01,        // Collection (Application)
0x85, 0x01,        //   Report ID (1)
0x75, 0x01,        //   Report Size (1)
0x95, 0x08,        //   Report Count (8)
0x05, 0x07,        //   Usage Page (Kbrd/Keypad)
0x19, 0xE0,        //   Usage Minimum (0xE0)
0x29, 0xE7,        //   Usage Maximum (0xE7)
0x15, 0x00,        //   Logical Minimum (0)
0x25, 0x01,        //   Logical Maximum (1)
0x81, 0x02,        //   Input (Data,Var,Abs,No Wrap,Linear,Preferred State,No Null Position)
0x95, 0x01,        //   Report Count (1)
0x75, 0x08,        //   Report Size (8)
0x81, 0x03,        //   Input (Const,Var,Abs,No Wrap,Linear,Preferred State,No Null Position)
0x95, 0x05,        //   Report Count (5)
0x75, 0x01,        //   Report Size (1)
0x05, 0x08,        //   Usage Page (LEDs)
0x19, 0x01,        //   Usage Minimum (Num Lock)
0x29, 0x05,        //   Usage Maximum (Kana)
0x91, 0x02, /////////   Output (Data,Var,Abs,No Wrap,Linear,Preferred State,No Null Position,Non-volatile)
0x95, 0x01,        //   Report Count (1)
0x75, 0x03,        //   Report Size (3)
0x91, 0x03, /////////   Output (Const,Var,Abs,No Wrap,Linear,Preferred State,No Null Position,Non-volatile)
0x95, 0x06,        //   Report Count (6)
0x75, 0x08,        //   Report Size (8)
0x15, 0x00,        //   Logical Minimum (0)
0x26, 0xFF, 0x00,  //   Logical Maximum (255)
0x05, 0x07,        //   Usage Page (Kbrd/Keypad)
0x19, 0x00,        //   Usage Minimum (0x00)
0x29, 0xFF,        //   Usage Maximum (0xFF)
0x81, 0x00,        //   Input (Data,Array,Abs,No Wrap,Linear,Preferred State,No Null Position)
0xC0,              // End Collection
0x05, 0x0C,        // Usage Page (Consumer)
0x09, 0x01,        // Usage (Consumer Control)
0xA1, 0x01,        // Collection (Application)
0x85, 0x02,        //   Report ID (2)
0x15, 0x00,        //   Logical Minimum (0)
0x25, 0x01,        //   Logical Maximum (1)
0x75, 0x01,        //   Report Size (1)
0x95, 0x16,        //   Report Count (22)
0x0A, 0xB1, 0x01,  //   Usage (AL Screen Saver)
0x0A, 0x23, 0x02,  //   Usage (AC Home)
0x0A, 0xAE, 0x01,  //   Usage (AL Keyboard Layout)
0x0A, 0x8A, 0x01,  //   Usage (AL Email Reader)
0x09, 0x40,        //   Usage (Menu)
0x09, 0x6F,        //   Usage (0x6F)
0x0A, 0x21, 0x02,  //   Usage (AC Search)
0x09, 0xB6,        //   Usage (Scan Previous Track)
0x09, 0xCD,        //   Usage (Play/Pause)
0x09, 0xB5,        //   Usage (Scan Next Track)
0x09, 0xE2,        //   Usage (Mute)
0x09, 0xEA,        //   Usage (Volume Decrement)
0x09, 0xE9,        //   Usage (Volume Increment)
0x09, 0x30,        //   Usage (Power)
0x0A, 0x83, 0x01,  //   Usage (AL Consumer Control Configuration)
0x0A, 0x24, 0x02,  //   Usage (AC Back)
0x0A, 0x06, 0x03,  //   Usage (0x0306)
0x0A, 0x08, 0x03,  //   Usage (0x0308)
0x0A, 0x01, 0x03,  //   Usage (0x0301)
0x0A, 0x83, 0x01,  //   Usage (AL Consumer Control Configuration)
0x0A, 0x0A, 0x03,  //   Usage (0x030A)
0x09, 0x70,        //   Usage (0x70)
0x81, 0x02,        //   Input (Data,Var,Abs,No Wrap,Linear,Preferred State,No Null Position)
0x95, 0x01,        //   Report Count (1)
0x75, 0x02,        //   Report Size (2)
0x81, 0x03,        //   Input (Const,Var,Abs,No Wrap,Linear,Preferred State,No Null Position)
0xC0,              // End Collection

// 147 bytes

I didn't change the pytest files because I think that should be done by the maintainers after they accept the Pull, but it's just about updating the expecting string to 1 07E0 0 8 0801 16 5 0700 24 8, 0700 32 8, 0700 40 8, 0700 48 8, 0700 56 8, 0700 64 8, rtype: 0 dtype: 0 sub: 0 (the only thing that changes is the addition of 0801 16 5 and the consecutive offsets)

It's minor but in my view a PR should make sure if they affect the test result expectation to modify them to the new expectation.
This look really good. Does that make both left & right motor work in a sensible way?
I wonder if that would work better than whatever I make for xbox?
With an extra commit to fix the test, I would merge this.

It's minor but in my view a PR should make sure if they affect the test result expectation to modify them to the new expectation.

Yeah, I think the same. My guess is that the test didn't expect to read an output usage so that's why it's failing now, as BlueRetro printed an output that were ignored before. (As you can see, before every output usage would be completely ignored, while now it'll be threated as the same way as an input)

This look really good. Does that make both left & right motor work in a sensible way?

It should, but I need more devices to test it. My code assumes that every report field is a motor, so if there are five rumble motors, they all will be turned on/off in the same way.
Right now BlueRetro doesn't pass much information to handle them separately. But I tried to use them all, like the delay, the cycle count, and the duration. Some of them I get from BlueRetro itself while the others are from Max/Min values.

I wonder if that would work better than whatever I make for xbox?

I actually based my code from the Xbox one, and I thought the exactly the same, but, again, I don't have any Xbox One controller so I cannot test it neither.

With an extra commit to fix the test, I would merge this.

As I said before, the only thing to "fix" the test should be to update the expected output adding the new Output usage

Yes I know, I would expect you to be the one to modify that. You are the owner of the PR and it's failing the test ;)

Ok, I modified the expected output according to what I get with a BlueRetro running on a ESP32 and with a BT Device with the exactly the same descriptor as the test. Right now it should doing the test and I hope it should end successfully

Ok I will look at more closely later, It doesn't make sense for the report # 1 usage offset to change IMHO.
The rumble stuff should be like in another report.

I think the output is on report # 1 because they're declared before changing the ID.

As you can see, all of the inputs (Red) and both Outputs (Blue) are on the same Report (Yellow/1) as the Report 2 was declared after (Orange).
About getting rumble from another report, that's completely from the device's side, as the manufacture defines the structure. For example, in Stadia, Google didn't use Collections while Microsoft did. The same thing for Output reports. In a perfect world, yes indeed, those reports should be in a different report, but you know where we live right now ¯_(ツ)_/¯

Sorry for my confusion,  in my mind the LEDs output case was handled properly all along. So I was surprised when I saw it popping in and shifting all other key usage bit range by one bytes.
That means keyboard where kind of broken since day one but it was kind of ok since having the Leds byte as the first key didn't make anything, and missing the last key just reduced the amount of simultaneous key press by one.
Anyway your PR fix this!

Thanks again for the PR!

No problem! I'm very happy to support this amazing project!!!

Wow. Nice! Thank you @JPZV! I'll give it a try with my Stadia Controller.

@JPZV Seems vibration still not working with Stadia Controller. See #578.

authors: DJm00n JPZV darthcloud

repo: darthcloud/BlueRetro


text:
NG Version

@darul75 could you add the ability for ng-slider to work in the 1.3.x versions of angular instead of a straight peg to 1.3.7? Tested in 1.3.8 at least and seemed to behave correctly.

Ok yes I check it tommorow

source: gharchive/issue

license: MIT

license_type: permissive

license_source: github-api


text:
Scene Picker

How would one go about implementing this?
var pickedFeature = viewer.scene.pick(movement.position);
Can't seem to see anywhere in the source (inside of Scene.js), that uses the pick function.
Has this been implemented? I'm presuming this is to be done? (EntityCollection maybe?)
I'd be happy to contribute to this.

You can access Viewer object with cesiumComponent property in the components. It is available by using ref prop on Viewer component.
class App extends React.PureComponent {

  render() {
    return (
      <Viewer ref={ref => { this.viewerComponent = ref; }}>
        <ScreenSpaceEventHandler useDefault>
          <ScreenSpaceEvent action={this.mouseEvent} type={ScreenSpaceEventType.MOUSE_MOVE} />
        </ScreenSpaceEventHandler>
       </Viewer>
    );
  }

  mouseEvent = e => {
    const picked = this.viewerComponent.cesiumComponent.scene.pick(e.endPosition);
    const id = picked ? picked.id || picked.primitive.id : null;
    if (picked && id instanceof Entity) {
       // picked is the picked entity
    }
  };

}

cesiumComponent is undocumented now. I plan to prepare the documentation.

I think this may still be an issue, and if the viewer is wrapped by another component then this method doesn't seem to work

Hmm but I think that is limitation of React's design. React's components don't have methods. If we want to use them, we have to use ref. For example: "focus" method of <input> component.
Anyone wraps a Resium component needs to use forwardRef to allow access to Cesium's elements.
related: https://ja.reactjs.org/docs/forwarding-refs.html

You're right, this is a react thing. The ref needs to be in the top level component that is returned by the exported class. Considering this your example works fine. Thanks!

authors: peteratkinson rot1024 shortwavedave

repo: darwin-education/resium


text:
220103 - Capturing Account Information Functionality

Capture account information from MT4 platform: Name, Number, Balance, Equity et cetera.
Not sure if I've covered for error capturing extensively, would appreciate guidance on that respect.
Works as intended on my side. 👍

Sorry for the late response and thanks for the pull request!

source: gharchive/pull-request

authors: elvinex teddywaweru

repo: darwinex/dwx-zeromq-connector


text:
feat(gravsearch): Allow comparing variables representing resource IRIs

https://dasch.myjetbrains.com/youtrack/issue/DSP-656

[x] In InferringGravsearchTypeInspector:

[x] Index variables that are compared with other variables or IRIs in FILTER expressions, and add a rule (InferTypeOfEntityFromComparisonWithOtherEntityInFilter) that infers the types of those entities from those comparisons.

[x] Refactor visitFilterExpression because it was getting too long and hard to read.
[x] Rename all the inference rules and refactor them a bit for clarity.

[x] In the rule InferTypeOfObjectFromPredicate: If we have a statement like ?letter ?prop ?person1, where the property is a variable, and we have already inferred its type, and then we use that to infer the type of ?person1, don't use that as a reason to optimise away ?person1 rdf:type ... later, because in the triplestore, a pattern like ?letter ?prop ?person1 could match any statement.

[x] In AbstractPrequeryGenerator.handleQueryVar(), allow a FILTER expression comparing two entities representing resources.
[x] Add tests.

[x] Remove some tests from SearchRouteV2R2RSpec using OPTIONAL, because they make it difficult to add new test data, and seem redundant anyway (the OPTIONAL doesn't affect the results).

[x] Add docs.

Closes #1441.

Can you please add a test to the GravsearchTypeInspection to see what types are inferred for the following query?

It infers that ?document is a knora-api:Resource:
GravsearchTypeInspectionResult(
    entities = Map(
        TypeableVariable(variableName = "person") -> NonPropertyTypeInfo(
            typeIri = "http://0.0.0.0:3333/ontology/0801/beol/simple/v2#person".toSmartIri,
            isResourceType = true,
            isValueType = false
        ),
        TypeableVariable(variableName = "document") -> NonPropertyTypeInfo(
            typeIri = "http://api.knora.org/ontology/knora-api/simple/v2#Resource".toSmartIri,
            isResourceType = true,
            isValueType = false
        ),
        TypeableIri(iri = "http://0.0.0.0:3333/ontology/0801/beol/simple/v2#hasAuthor".toSmartIri) -> PropertyTypeInfo(
            objectTypeIri = "http://0.0.0.0:3333/ontology/0801/beol/simple/v2#person".toSmartIri,
            objectIsResourceType = true,
            objectIsValueType = false
        ),
        TypeableIri(iri = "http://rdfh.ch/0801/XNn6wanrTHWShGTjoULm5g".toSmartIri) -> NonPropertyTypeInfo(
            typeIri = "http://api.knora.org/ontology/knora-api/simple/v2#Resource".toSmartIri,
            isResourceType = true,
            isValueType = false
        )
    ),
    entitiesInferredFromProperties = Map(
        TypeableVariable(variableName = "document") -> Set(NonPropertyTypeInfo(
            typeIri = "http://api.knora.org/ontology/knora-api/simple/v2#Resource".toSmartIri,
            isResourceType = true,
            isValueType = false
        )),
        TypeableVariable(variableName = "person") -> Set(NonPropertyTypeInfo(
            typeIri = "http://0.0.0.0:3333/ontology/0801/beol/simple/v2#person".toSmartIri,
            isResourceType = true,
            isValueType = false
        ))
    )
)

This is because beol:hasAuthor is a subproperty of knora-basei:hasLinkTo, whose knora-base:subjectClassConstraint is knora-base:Resource. There's nothing in the query that allows the type beol:letter to be inferred. The inferring type inspector doesn't know that your letter IRI refers to a beol:letter; it just knows that it's a resource IRI.

Test added: db9b92cf

Thanks for the review!

Thanks for the review!

Thanks for the quick fix!

authors: SepidehAlassi benjamingeer

repo: dasch-swiss/knora-api


text:
chore: Enable tag based deploy pipeline

This does several things:

Install dependencies via npm ci
Add check-package scripts to ensure same values for both name and version in package.json and package-lock.json
Update deploy script to check tags. The first check $PACKAGE_TAG" != "$TRAVIS_TAG" makes sure the tag version number pushed via git is equal to the version number in package.json. It should be "v1.2.3" for example, for the tag, and "1.2.3" in the package.json version.

It also checks if the string "dev" exists in the tag in order to not use "latest" for a dev tag. Then it publishes the module to npm with a tag of either latest or dev.

Please don't merge this as yet, I want to rebase this once #17 is merged. This should not go into that PR.

Rebased onto latest master after #17 was merged.

repo: dashevo/DashJS


text:
Don't call core_set_thread_initializer if not defined

Description
core_set_thread_initializer is only defined if macro MULTI != RELIC_NONE evaluates true.
It evaluates as false on some systems and since we cannot inherit relic's macros when compiling BLS,
we add an additional check to see if the function is defined (inheriting the macro's evaluation) and decide
accordingly if we make a call to it or not.
Tested on Darwin Kernel Version 20.3.0: Thu Jan 21 00:07:06 PST 2021; root:xnu-7195.81.3~1/RELEASE_X86_64

Why not? They are defined in relic_conf.h which is (indirectly) included here

I didn't know that, now I do. I'm completely unfamiliar with the codebase and I just did whatever I thought would get it to compile!

#ifdef core_set_thread_initializer doesn't work at all because core_set_thread_initializer is a function, not a define so this evaluates to false no matter if core_set_thread_initializer function exists or not

Might've well just done an #if 0 :P

Can you please also open this PR to https://github.com/Chia-Network/bls-signatures?

Sure! I'll link them back to this PR!

I'll cherry pick your commit to the branch and try again. Thanks for reviewing (this admittedly ill-done PR but it's the thought that counts, right?)

Closing because its included in #19

authors: kittywhiskers xdustinface

repo: dashpay/bls-signatures


text:
Pin dask/distributed versions for release

Restricts the max version of dask/distributed to the latest stable release, in preparation for a new dask-sql release

Codecov Report

Merging #380 (c2054b1) into main (8a6302c) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #380   +/-   ##
=======================================
  Coverage   95.60%   95.60%
=======================================
  Files          67       67
  Lines        2933     2933
  Branches      547      547
=======================================
  Hits         2804     2804
  Misses         79       79
  Partials       50       50

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8a6302c...c2054b1. Read the comment docs.

authors: charlesbluca codecov-commenter

repo: dask-contrib/dask-sql


text:
nan vs mask

I have a use case where I want to perform some statistical processing over a large data set. So, naturally I want to leverage all the awesome goodness that's baked into dask ... however, my data has an MDI.
I'm glad to see that there is nan support already in dask.array, and as a strategy that helps me move forward somewhat - although things are a wee bit clunky in the case of integral data types.
Normally, I'd turn to masked arrays, but that's clearly not an option currently within dask. I've seen peppered requests over time from the community for masked support in dask, but it seems to be a big ask, otherwise I guess it would've been already implemented.
Would it be possible to have some guidance/clarity from the dask devs as to whether such a feature is realistically and technically viable? and just as importantly, is it really desireable from your point of view?
It would be most helpful to understand if there is a genuine appetite to have masked array support within dask, or whether the effort/issues involved simply outweigh the benefit, rendering such a feature request not feasible/worthwhile.
Many thanks in advance

Hi @bjlittle,
Generally I think that masked arrays are in scope for dask.array.  Generally we just copy numpy's scope.  If the numpy community was likely to move to a different model for missing data we might consider adopting that instead, but that doesn't appear likely any time soon.
Yes, I think that such a feature is technically viable.  I suspect that with sufficient cleverness it would be doable without too much pain, though I may be thinking naively on the subject (I am not as intimately familiar with numpy's masked arrays as I should be).  My recent experience has been that if you can get a few of the core dask.array operations to work well, notably dask/array/core.py::atop, then you can build new features like this surprisingly cheaply for a broad subset of the project.
I personally have no immediate burning desire to build masked arrays, however I would be happy to support others if they want to take this on.  I certainly wouldn't oppose such an effort if it doesn't significantly increase the maintenance burden of core dask.array.
cc @shoyer @pelson

There are basically two ways to write masked arrays for dask:

Write an implementation wrapping Dask Array instead of NumPy. The implementation looks a lot like numpy.ma, omitting some numpy specific details.
Write an implementation wrapping NumPy masked arrays in Dask. The implementation looks a lot like dask.array (e.g., reimplementing atop).

I think both paths are viable, with clear templates to start from, but would still be a lot of work, given that both numpy.ma and dask.array are thousands of lines of code. Personally, I would be reluctant to start down this path.
In an ideal world, NumPy's masked array could simply do duck-typing well enough that it works on generic duck array types, but glancing at the code that is clearly not the case now.

@shoyer, going along with your second option (wrapping numpy masked arrays) what would have to change in atop if the constituent elements were numpy masked arrays?
Even though numpy.ma is thousands of lines of code, we still get to benefit from those thousands of lines when wrapping.  I don't think that it we would necessary have to write thousands of lines to compose the two.

going along with your second option (wrapping numpy masked arrays) what would have to change in atop if the constituent elements were numpy masked arrays?

Which version of atop do you have in the mind? The version where func acts on masked arrays or numpy arrays?
For the former, I think no modification would be necessary, but atop wouldn't give you much -- you would still need to rewrite all dask masked array operations in terms of dask.array.atop and masked array primitives.
For the later, you would need to write an operation to propagate masks, and then combine the result of atop(func, out_ind, arg_0, indices_0, ...) with atop_mask(out_ind, arg_0, indices_0, ...). This would be more scalable (you only need to write atop_mask), but I'm not entirely sure the scheduler would handle this well.
Anyways, I agree that it would be easier to wrap masked arrays and duplicate some of the dask.array logic (which is generally much more cleanly abstracted than masked array).

I'd love to see this happen. @bjlittle - are you able to pull some strings to get this onto the SciTools agenda?
For completeness (since @bjlittle already knows), there is some out-of-code masked array support in biggus that could be re-implemented in the cleaner dask.array abstraction style. For example, the streaming/out-of-core standard dev algorithm can be found in biggus._init._StdMaskedStreamsHandler.

I've added initial support for masked arrays in #2301. This adds support for chunks to be instances of masked arrays, and makes most operations with them work. We also support many of the masked array specific functions in the dask.array.ma namespace (e.g. da.ma.masked_greater, etc...)
Note that because we keep the same outer Array class, static access to the fill_value doesn't work (e.g. you can't inspect the fill_value by x.fill_value) because we don't track that with the metadata (as we do for dtype). You can however set it with da.ma.set_fill_value.
Demo:
In [1]: import dask.array as da

In [2]: x = da.random.random((10, 10), chunks=5)

In [3]: mx = da.ma.masked_greater(x, 0.2)  # mask values > 0.2

In [4]: mx[:4, :4].compute()
Out[4]:
masked_array(data =
 [[-- -- -- --]
 [0.13436558733596338 -- -- --]
 [-- 0.09774187207397944 -- --]
 [-- -- 0.15060314411709008 --]],
             mask =
 [[ True  True  True  True]
 [False  True  True  True]
 [ True False  True  True]
 [ True  True False  True]],
       fill_value = 1e+20)

In [5]: mx.dot(mx.T).sum().compute()  # dot and reductions work
Out[5]: 0.98678638692978504

In [6]: da.ma.filled(mx, 0).compute()  # Fill missing with 0
Out[6]:
array([[ 0.        ,  0.        ,  0.        ,  0.        ,  0.        ,
         0.        ,  0.01256106,  0.16551167,  0.        ,  0.        ],
       [ 0.13436559,  0.        ,  0.        ,  0.        ,  0.17200201,
         0.        ,  0.        ,  0.        ,  0.        ,  0.18279078],
       [ 0.        ,  0.09774187,  0.        ,  0.        ,  0.        ,
         0.        ,  0.        ,  0.04618743,  0.09385341,  0.        ],
       [ 0.        ,  0.        ,  0.15060314,  0.        ,  0.        ,
         0.        ,  0.        ,  0.        ,  0.        ,  0.        ],
       [ 0.19307299,  0.        ,  0.        ,  0.        ,  0.        ,
         0.        ,  0.1757851 ,  0.        ,  0.        ,  0.        ],
       [ 0.        ,  0.        ,  0.        ,  0.        ,  0.03385781,
         0.        ,  0.        ,  0.        ,  0.        ,  0.        ],
       [ 0.        ,  0.16630388,  0.        ,  0.15377459,  0.08695276,
         0.        ,  0.        ,  0.        ,  0.        ,  0.08303051],
       [ 0.        ,  0.19929265,  0.        ,  0.        ,  0.        ,
         0.19556017,  0.        ,  0.        ,  0.        ,  0.        ],
       [ 0.        ,  0.        ,  0.        ,  0.        ,  0.        ,
         0.        ,  0.        ,  0.        ,  0.        ,  0.        ],
       [ 0.        ,  0.17384505,  0.04375032,  0.        ,  0.02915479,
         0.        ,  0.        ,  0.18237864,  0.        ,  0.        ]])

In [8]: da.ma.set_fill_value(mx, 0)  # set fill_value inplace

In [9]: da.ma.filled(mx)[:4, :4].compute()
Out[9]:
array([[ 0.        ,  0.        ,  0.        ,  0.        ],
       [ 0.13436559,  0.        ,  0.        ,  0.        ],
       [ 0.        ,  0.09774187,  0.        ,  0.        ],
       [ 0.        ,  0.        ,  0.15060314,  0.        ]])

@jcrist this is most interesting
a more detailed comment is on the pr
https://github.com/dask/dask/pull/2301#issuecomment-308992198

authors: bjlittle jcrist marqh mrocklin pelson shoyer

repo: dask/dask


text:
DataFrame.groupby.mean fails with multiple categoricals

Seems closely related to issue #2510, but it looks like there's still a problem with groupby.mean.  Here's a quick example:
import dask.dataframe as dd

dt = {"col1": "category",
      "col2": "category",
      "col3": int}
df = dd.read_csv("data.csv", dtype=dt)

df.compute()
#   col1 col2  col3
# 0    a    y     0
# 1    a    z     1
# 2    b    y     0
# 3    b    z     1

# Gives an error
df.groupby(by=["col1", "col2"])["col3"].mean().compute()
# ValueError: Level values must be unique: [nan, nan] on level 0

# Taking a sum works
df.groupby(by=["col1", "col2"])["col3"].sum().compute()
# col1  col2
# a     y       0
#       z       1
# b     y       0
#       z       1
# Name: col3, dtype: int64

# Grouping by only one column also works
df.groupby(by="col1")["col3"].mean().compute()
# col1
# a    0.5
# b    0.5
# Name: col3, dtype: float64

# Use object dtype instead
df = dd.read_csv("data.csv")
df.dtypes
# col1    object
# col2    object
# col3     int64
# dtype: object

# Works now
df.groupby(by=["col1", "col2"]).mean().compute()
#            col3
# col1 col2
# a    y      0.0
#      z      1.0
# b    y      0.0
#      z      1.0

This is dask 0.17.5 and pandas 0.24.0.

Thanks for the bug report @dsaxton .  If possible I recommend two steps:

Verify that this error also occurs with the latest release of dask
Try to produce a minimal example.  See http://matthewrocklin.com/blog/work/2018/02/28/minimal-bug-reports for more information

Here's an example using version 1.1.1 with the full stack trace:
import pandas as pd
import dask.dataframe as dd

data = {"col1": ["a", "a", "b", "b"],
        "col2": ["y", "z", "y", "z"],
        "col3": [0, 1, 0, 1]}

df = dd.from_pandas(pd.DataFrame(data), chunksize=2)
df[["col1", "col2"]] = df[["col1", "col2"]].astype("category")

df.groupby(by=["col1", "col2"])["col3"].mean().compute()

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-1-53ba1bf325bc> in <module>
      9 df[["col1", "col2"]] = df[["col1", "col2"]].astype("category")
     10
---> 11 df.groupby(by=["col1", "col2"])["col3"].mean().compute()

/anaconda3/lib/python3.6/site-packages/dask/dataframe/groupby.py in mean(self, split_every, split_out)
    925     def mean(self, split_every=None, split_out=1):
    926         return (self.sum(split_every=split_every, split_out=split_out) /
--> 927                 self.count(split_every=split_every, split_out=split_out))
    928
    929     @derived_from(pd.core.groupby.GroupBy)

/anaconda3/lib/python3.6/site-packages/dask/dataframe/core.py in <lambda>(self, other)
   1198             return lambda self, other: elemwise(op, other, self)
   1199         else:
-> 1200             return lambda self, other: elemwise(op, self, other)
   1201
   1202     def rolling(self, window, min_periods=None, freq=None, center=False,

/anaconda3/lib/python3.6/site-packages/dask/dataframe/core.py in elemwise(op, *args, **kwargs)
   3409         # For broadcastable series, use no rows.
   3410         parts = [d._meta if _is_broadcastable(d) or isinstance(d, Array)
-> 3411                  else d._meta_nonempty for d in dasks]
   3412         with raise_on_meta_error(funcname(op)):
   3413             meta = partial_by_order(*parts, function=op, other=other)

/anaconda3/lib/python3.6/site-packages/dask/dataframe/core.py in <listcomp>(.0)
   3409         # For broadcastable series, use no rows.
   3410         parts = [d._meta if _is_broadcastable(d) or isinstance(d, Array)
-> 3411                  else d._meta_nonempty for d in dasks]
   3412         with raise_on_meta_error(funcname(op)):
   3413             meta = partial_by_order(*parts, function=op, other=other)

/anaconda3/lib/python3.6/site-packages/dask/dataframe/core.py in _meta_nonempty(self)
    305     def _meta_nonempty(self):
    306         """ A non-empty version of `_meta` with fake data."""
--> 307         return meta_nonempty(self._meta)
    308
    309     @property

/anaconda3/lib/python3.6/site-packages/dask/utils.py in __call__(self, arg, *args, **kwargs)
    411         """
    412         meth = self.dispatch(type(arg))
--> 413         return meth(arg, *args, **kwargs)
    414
    415     @property

/anaconda3/lib/python3.6/site-packages/dask/dataframe/utils.py in _nonempty_series(s, idx)
    453     # TODO: Use register dtypes with make_array_nonempty
    454     if idx is None:
--> 455         idx = _nonempty_index(s.index)
    456     dtype = s.dtype
    457     if is_datetime64tz_dtype(dtype):

/anaconda3/lib/python3.6/site-packages/dask/dataframe/utils.py in _nonempty_index(idx)
    409         levels = [_nonempty_index(l) for l in idx.levels]
    410         labels = [[0, 0] for i in idx.levels]
--> 411         return pd.MultiIndex(levels=levels, labels=labels, names=idx.names)
    412     raise TypeError("Don't know how to handle index of "
    413                     "type {0}".format(type(idx).__name__))

/anaconda3/lib/python3.6/site-packages/pandas/core/indexes/multi.py in __new__(cls, levels, labels, sortorder, names, dtype, copy, name, verify_integrity, _set_identity)
    240
    241         if verify_integrity:
--> 242             result._verify_integrity()
    243         if _set_identity:
    244             result._reset_identity()

/anaconda3/lib/python3.6/site-packages/pandas/core/indexes/multi.py in _verify_integrity(self, labels, levels)
    283                                  "level {level}".format(
    284                                      values=[value for value in level],
--> 285                                      level=i))
    286
    287     @property

ValueError: Level values must be unique: [nan, nan] on level 0

Thanks for the excellent reproducible example @dsaxton !
cc @TomAugspurger in case he's able to interpret the error message

Thanks for the excellent issue report. This should be fixed by #4505.
In [1]: %load test2.py

In [2]: # %load test2.py
   ...: import pandas as pd
   ...: import dask.dataframe as dd
   ...:
   ...: df = pd.DataFrame({"col1": ["a", "a", "b", "b"],
   ...:                    "col2": ["y", "z", "y", "z"],
   ...:                    "col3": [0, 1, 0, 1]})
   ...: df[["col1", "col2"]] = df[["col1", "col2"]].astype("category")
   ...:
   ...: ddf = dd.from_pandas(df, chunksize=2)
   ...:
   ...: res = ddf.groupby(["col1", "col2"])["col3"].mean()
   ...:

In [3]: res.compute()
Out[3]:
col1  col2
a     y       0.0
      z       1.0
b     y       0.0
      z       1.0
Name: col3, dtype: float64

authors: dsaxton jcrist mrocklin


text:
Should bbconf be renamed to bbagent ?

Me and @donaldcampbelljr thought, what if bbconf will be renamed bbagent to have similar standard naming (like pepdbagent)?
Additionally, it will be easier to distinguish bbclient and bbconf

Probably not. bbconf is parallel to refgenconf. I guess to standardize we could rename pepdbagent to pepdbconf, since the 'conf' name has precedence.

authors: khoroshevskyi nsheff

repo: databio/bbconf


text:
Update bedset

There was a lot of changes in bedboss, and bedset broken. Make sure everything works correctly.

[x] bedset is created in bedbase database
[x] bedset is created in pephub

This issue is solved

repo: databio/bedboss


text:
Request the update the part 1 of the workshop

Added the foundation notebooks, first merge request, will need one more test after.

approve commit


text:
[BUG] Place page age across places charts seem off

Describe the bug
Age across places seems off in several ways.
Expected behavior
I expected the MTV chart to always show, since this is the MTV place page. I think if places don't have data, then the chart wouldn't show either.

I also expected if data exists for one of the age across places chart, it would exist for the other

These issues have been solved after using merged landing page cache on server side https://github.com/datacommonsorg/website/pull/476

authors: shifucun tjann

repo: datacommonsorg/website


text:
Correction for raw affiliation CNRS (UMR 5574), Centre de Recherche Astrophysique de Lyon, École Normale Supérieure de Lyon, 69007 Lyon, France; Université Lyon 1, Observatoire de Lyon, 9 avenue Charles André, 69230 Saint-Genis-Laval, France

Correction needed for raw affiliation CNRS (UMR 5574), Centre de Recherche Astrophysique de Lyon, École Normale Supérieure de Lyon, 69007 Lyon, France; Université Lyon 1, Observatoire de Lyon, 9 avenue Charles André, 69230 Saint-Genis-Laval, France
raw_affiliation_name: CNRS (UMR 5574), Centre de Recherche Astrophysique de Lyon, École Normale Supérieure de Lyon, 69007 Lyon, France; Université Lyon 1, Observatoire de Lyon, 9 avenue Charles André, 69230 Saint-Genis-Laval, France
new_rors: 04zmssz18;029brtt94;02feahw73;0084x3h80
previous_rors: 04zmssz18;029brtt94;02feahw73
works_examples: W1983541764;W3099371934
contact: ae1f8efc2fa9b549da0f3da504ab94a4:f80521f6ace8208f21fda81181da @ ens-lyon.fr

This issue was accepted and ingested by the OpenAlex team on 2024-11-01. The new affiliations should be visible within the next 7 days.

repo: dataesr/openalex-affiliations


text:
Correction for raw affiliation INRA, UMR AMAP, F-3400 Montpellier, France; INRA, UMR1092, Laboratoire d’Étude des Ressources Forêt-Bois (LERFoB), Centre INRA de Nancy, F-54280 Champenoux, France

Correction needed for raw affiliation INRA, UMR AMAP, F-3400 Montpellier, France; INRA, UMR1092, Laboratoire d’Étude des Ressources Forêt-Bois (LERFoB), Centre INRA de Nancy, F-54280 Champenoux, France
raw_affiliation_name: INRA, UMR AMAP, F-3400 Montpellier, France; INRA, UMR1092, Laboratoire d’Étude des Ressources Forêt-Bois (LERFoB), Centre INRA de Nancy, F-54280 Champenoux, France
new_rors: ;020nks034
previous_rors:
works_examples: W2068342111
contact: 4ec6bd9ffec9a5207cd3b67bd7b33665:3fecdb68f2870bd27542d3254e0afd55df0e @ inrae.fr

This issue was accepted and ingested by the OpenAlex team on 2024-11-18. The new affiliations should be visible within the next 7 days.


text:
Correction for raw affiliation Laboratoire de Biologie Moléculaire de la Cellule-UMR 5239 CNRS/ENS Lyon/ Université Lyon, Ecole Normale Supérieure de Lyon, Lyon, France

Correction needed for raw affiliation Laboratoire de Biologie Moléculaire de la Cellule-UMR 5239 CNRS/ENS Lyon/ Université Lyon, Ecole Normale Supérieure de Lyon, Lyon, France
raw_affiliation_name: Laboratoire de Biologie Moléculaire de la Cellule-UMR 5239 CNRS/ENS Lyon/ Université Lyon, Ecole Normale Supérieure de Lyon, Lyon, France
new_rors: 04zmssz18;029brtt94;02feahw73;01bj4fd12
previous_rors: 04zmssz18;029brtt94;02feahw73
works_examples: W1974732946
contact: d6e246493cd8c51f899fdcc0dd4b792b:8714a2d3649e8cebb436af9cc8d0 @ ens-lyon.fr

This issue was accepted and ingested by the OpenAlex team on 2024-12-19. The new affiliations should be visible within the next 7 days.


text:
About Codex efficiency

Hello,
I noticed that one of the modules is implemented based on OpenAI's Codex. I have a question about the efficiency of Codex. According to the description on the website of Codex, it writes that they only accept 20 requests per minute, and it seems that there is no way to improve the rate limit. I am wondering whether it limits the datafaker, too. Otherwise, How do you overcome this problem?
Thanks

It's an experimental module, more for a proof of concept than anything else. Ideally, it should support batch generation, but it's not implemented yet. The core / production version of Datafaker isn't using OpenAI, but uses yml files instead, and is incredibly fast (that's a performance module for actual results, and there's a benchmark here: https://www.datafaker.net/documentation/performance)
Hope that helps!

Thank you for your information!

authors: Alex-HaochenLi bodiam

repo: datafaker-net/datafaker


text:
Possibilité d'installer l'app comme une appli

Voir comment ça a été fait pour https://github.com/datagir/mesfruitsetlegumesdesaison

Je ferme au profit de #597

authors: Clemog laem

repo: datagir/nosgestesclimat-site


text:
Localisation 2

Mise à jour de #482
Démo : https://localisation-2--nosgestesclimat.netlify.app
Intégration de la localisation dans nosgestesclimat

[ ] auto-détection du pays de simulation
[ ] page localisation pour le voir et le changer (basique)
[ ] chargement des règles de la bonne PR
[ ] message aux pays non couverts.
[ ] message de contribution à ces pays

Voilà, c'est basique, mais ça fonctionne un minimum.
Tutoriel
https://demo.hedgedoc.org/Tna9VKnnTGqdqW7wOhBu0A?both @Clemog
Pour la facilitation du travail côté modèle, voir https://github.com/datagir/nosgestesclimat/pull/1349

[Maël]
Faut-il localiser automatiquement les gens ?
Le problème, c'est que l'alternative est de poser la question à tout le monde alors que dans la première année, 100% des gens seront en France métropolitaine.
Par contre, on peut également faire un choix relativement discret (par exemple le drapeau dans le menu) MAIS aussi publier des pages d'accueil pour les pays. Par exemple, The Shift project belgique diffusera l'outil via la page d'accueil dédiée nosgestesclimat.fr/belgique.
Quid des Belges qui trouveront NGC via google ? Eh bien la page /belgique sera référencée comme la version belge du site, ce qui est à ma connaissance faisable facilement.

Pour utiliser la localisation de Netlify Edge, on peut soit faire une route qui permet d'obtenir les informations de geoloc, soit les injecter directement lors de la requête. Je ne vois pas comment faire le 2) proprement, je vais partir sur une nouvelle requête de géoloc dans un premier temps.

@EmileRolley @Clemog j'ai fait le changement vers l'utilisation de l'API netlify, ça semble marcher parfaitement.
Pour tester en local, il faut utiliser netlify dev pour qu'il lance la fonction edge.

J'ai cette erreur en local : The string did not match the expected pattern. ?

N'hésitez pas à revert ce commit si ce n'est pas utile d'ouvrir une nouvelle fenêtre pour le tuto :)

[ ] Affichage du drapeau Français
[ ] Afficher une notification pour indiquer le modèle sur lequel on est (ex : en Guadeloupe, modèle DOM TOM) sous la simulation ou dans la barre de résultat

Next steps :

[ ] Réflexions sur l'affichage des drapeaux : régions vs Pays ? Questions reliées à la traduction

Bon, j'ai une boucle infinie sur le useEffect de useBranchData :/

[ ] enlever le Belgique et les autres tests (enfin les garder mais les cacher via un attribute)

bug drapeau ..

On a plusieurs problèmes : les bonnes règles ne sont pas chargées quand on choisit la France après avoir choisi la Guadeloupe; le choix de la Guadeloupe semble charger les règles mais le modèle n'est pas recalculé... Probablement un conflit entre setRules et WithEngine.

authors: Clem-mrtn Clemog laem


text:
Update MinimalLib to CoordGen 3.0.0

This PR only updates MinimalLib to use the latest CoordGen 3.0.0 libs from Schroedinger.

@StLeonidas Hi Leonid, did you miss this one?

@ptosco thanks a lot

authors: StLeonidas ptosco

repo: datagrok-ai/public


text:
Issue loading DeltaTable due to

Describe the bug
I stored a DeltaTable using the deltalake pypi library (https://pypi.org/project/deltalake/); tested version 0.9.0 and 0.10.0; and while attempting to ingest the DeltaTable from my storage with S3 interface (lakeFS), I end up with the following error message:
    delta_table = read_delta_table(path, self.storage_options, self.source_config)
  File "/tmp/datahub/ingest/venv-delta-lake-0.10.4/lib/python3.10/site-packages/datahub/ingestion/source/delta_lake/delta_lake_utils.py", line 44, in read_delta_table
    raise e
  File "/tmp/datahub/ingest/venv-delta-lake-0.10.4/lib/python3.10/site-packages/datahub/ingestion/source/delta_lake/delta_lake_utils.py", line 31, in read_delta_table
    return DeltaTable(
  File "/tmp/datahub/ingest/venv-delta-lake-0.10.4/lib/python3.10/site-packages/deltalake/table.py", line 238, in __init__
    self._table = RawDeltaTable(
_internal.DeltaError: Delta protocol violation: Failed to serialize operation: expected value at line 1 column 1

The error seems to come from here:
https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/delta_lake/delta_lake_utils.py#L19-L42
but I am able to load the table locally on my machine with:
from deltalake import DeltaTable
s3_aws_config = {
    "AWS_ACCESS_KEY_ID": lakefs_user,
    "AWS_SECRET_ACCESS_KEY": lakefs_pass,
    "AWS_ENDPOINT_URL": lakefs_endpoint,
    "AWS_REGION": "<redacted>",
    "AWS_S3_ALLOW_UNSAFE_RENAME": "True"
}
dt = DeltaTable('s3://<redacted>/delta/test', storage_options=s3_aws_config)
print(dt.protocol())  # ProtocolVersions(min_reader_version=1, min_writer_version=1)

To Reproduce
Steps to reproduce the behavior:

Go to the ingestion UI
Add the following config

source:
    type: delta-lake
    config:
        env: PROD
        platform_instance: lakeFS-delta-test
        base_path: 's3://<redacted>/delta/test'
        version_history_lookback: -1
        require_files: false
        s3:
            aws_config:
                aws_access_key_id: <redacted>
                aws_secret_access_key: <redacted>
                aws_region: <redacted>
                aws_endpoint_url: 'https://lakefs.<redacted>/'
sink:
    type: datahub-rest
    config:
        server: 'http://<redacted>:8085'

Run with this config
See error

Expected behavior
I expect datahub to successfully ingest the delta lake source.
Desktop (please complete the following information):

OS: macOS Ventura
Browser Firefox
Version 115.0.2

Additional context
datahub is deployed using the docker-compose template on an Ubuntu machine. Ingestion of S3 parquet tables and files (with lakeFS) works.

Addition: I just connected to the datahub-actions container with an exec shell and ran the python command. From the prompt I tested
from deltalake import DeltaTable
s3_aws_config = {
    "AWS_ACCESS_KEY_ID": lakefs_user,
    "AWS_SECRET_ACCESS_KEY": lakefs_pass,
    "AWS_ENDPOINT_URL": lakefs_endpoint,
    "AWS_REGION": "<redacted>",
    "AWS_S3_ALLOW_UNSAFE_RENAME": "True"
}
dt = DeltaTable('s3://<redacted>/delta/test', storage_options=s3_aws_config)

which worked fine on my machine. I ended up with the same error here outlined above.

repo: datahub-project/datahub


text:
Remove usage of COMPOSE_FAILURE string to end compose chains (main branch)

Use ComposeException instead
Removed from AdminService, RegistrationService and PolicyService

Fixes #177

repo: datakaveri/iudx-aaa-server


text:
🛑 pdfRest is down

In 3497069, pdfRest (https://status.pdfrest.com/up) was down:

HTTP code: 504
Response time: 10276 ms

Resolved: pdfRest is back up in c89c4dc after 57 days, 50 minutes.

repo: datalogics/pdfRest-Status-Page


text:
molfeat references np.float128, which doesn't exist on some platforms

Is there an existing issue for this?

[X] I have searched the existing issues and found nothing

Bug description
The molfeat package references np.float128, which is not implemented on some platforms (e.g. M1 Mac)
File ~/miniconda3/envs/rdkit_2022_12/lib/python3.8/site-packages/molfeat/utils/state.py:30
12 from molfeat.calc.bond import DGLCanonicalBondCalculator
13 from molfeat.calc.bond import DGLWeaveEdgeCalculator
16 DTYPES_MAPPING = {
17     None: None,
18     torch.float16: "torch.float16",
19     torch.float32: "torch.float32",
20     torch.float64: "torch.float64",
21     torch.int8: "torch.int8",
22     torch.int16: "torch.int16",
23     torch.int32: "torch.int32",
24     torch.int64: "torch.int64",
25     torch.uint8: "torch.uint8",
26     torch.bool: "torch.bool",
27     np.float16: "np.float16",
28     np.float32: "np.float32",
29     np.float64: "np.float64",
---> 30     np.float128: "np.float128",
31     np.int8: "np.int8",
32     np.int16: "np.int16",
33     np.int32: "np.int32",
34     np.int64: "np.int64",
35     np.uint8: "np.uint8",
36     np.uint16: "np.uint16",
37     np.uint32: "np.uint32",
38     np.uint64: "np.uint64",
39     bool: "bool",
40     int: "int",
41     float: "float",
42 }
How to reproduce the bug
On an M1 Mac
from molfeat.trans import MoleculeTransformer

Error messages and logs
# Error messages and logs here please

Environment

Current environment
#- Molfeat version (e.g., 0.1.0):
#- PyTorch Version (e.g., 1.10.0):
#- RDKit version (e.g., 2022.09.5):
#- scikit-learn version (e.g.,  1.2.1):
#- OS (e.g., Linux):
#- How you installed Molfeat (`conda`, `pip`, source):

Additional context
No response

Thank you @PatWalters, good catch! I propose we check if the numpy module has the float128 attribute and only add it to the DTYPES_MAPPING if so. Additionally, I think it would be nice to address this case specifically on loading a state dict, as it seems to be the only dtype that is not consistently supported across systems. Let me propose some changes and open a pull-request!

Thanks for your quick response.  I just started playing around with molfeat and datamol.  Very cool!  It will be great if I can use molfeat on my M1 mac.

We ended up removing support for the dtype altogether. It should work now. A new version should soon be released to make these recent changes available through pip and conda. We are also spending some time to see if we can automatically run our CICD on more machines (like the M1) as well to automatically catch these issues in the future.
In the meantime, we would be happy to hear about any other issues or feedback you might have! Thank you again for pointing this out.

It's available on PyPi now!
pip install "molfeat>=0.8.5"

And on conda!

Wow, that's great, it works on M1 Mac!  Thanks for fixing that so quickly

authors: PatWalters cwognum

repo: datamol-io/molfeat


text:
Test

System Information

OS:
Python version:
Python environment: pip / conda
Using jupyter: true / false
Datapane version:

Bug / Issue

test2

repo: datapane/datapane


text:
develop gtfs cleaner for Unrecognised column warnings

Description of the Feature to be Added

Unrecognised column warnings are commonly raised by the is_valid() method, but are not resolved by cleaning.
E.g. Unrecognized column agency_noc and Unrecognized column vehicle_journey_code are regularly raised when working with GTFS data extracted from DfT's BODS. These columns have nothing to do with the GTFS spec and can be safely removed from the feed (NOC is National Operator Code and journey_code is used by DfT to describe the bus type).
(OPTIONAL) Suggested Implementations

Add an extra optional argument to clean_feed() which accepts a lists of columns to drop. For each column provided, these can then be removed from and feed dataframe if the column is present. Giving the user the ability to define which ones can be removed safely is important here, since gtfs_kit doesn't handle the extended GTFS definitions and so dropping all unrecognised columns could lead to issues.

Migrated to https://github.com/datasciencecampus/assess_gtfs/issues/4

authors: ethan-moss r-leyshon


text:
Add DATA_API_INCLUDED_KEYSPACES to settings

By default we should include all of them but this will be a helpful complimentary setting for users that only want to expose a subset of user keyspaces

We have the option for a single keyspace,DATA_API_KEYSPACE that, when set, exposes the schema at /graphql (no subpath with the ks name).

Maybe this should supersede single keyspace mode?

authors: csplinter jorgebay mpenick

repo: datastax/cassandra-data-apis


text:
Minor nit: Nagle's algorithm (not "Nagel's") is named after John Nagl…

…e; see:
https://en.wikipedia.org/wiki/Nagle's_algorithm

This addresses CPP-359.

repo: datastax/cpp-driver

license_source: bigquery


text:
push to AWS fails

$ dvc push
Failed to push data to the cloud: 'Region'

AWS settings are correct:
[Core]
# Supported clouds: AWS, GCP
Cloud = AWS

# Log levels: Debug, Info, Warning and Error
LogLevel = Info

[AWS]
CredentialPath = ~/.aws/credentials
CredentialSection = default

StoragePath = dvc-share/cnn_tutorial_cache

[GCP]
StoragePath =
ProjectName =

A small addition - config file has a new line in the first line which is not good and no newline at the end of the file.

repo: dataversioncontrol/dvc


text:
Mobile bugs

Hi!
I am having thoses bugs when i switch the platform to mobile.
UNetWeaver error: Exception :System.MissingMethodException: Method not found: 'Mono.Cecil.ModuleDefinition.ImportReference'.
at Unity.UNetWeaver.Weaver.Weave (System.String assName, IEnumerable1 dependencies, IAssemblyResolver assemblyResolver, System.String unityEngineDLLPath, System.String unityUNetDLLPath, System.String outputDir) [0x00050] in /Users/builduser/buildslave/unity/build/Extensions/Networking/Weaver/UNetWeaver.cs:1714    at Unity.UNetWeaver.Weaver.WeaveAssemblies (IEnumerable1 assemblies, IEnumerable1 dependencies, IAssemblyResolver assemblyResolver, System.String outputDir, System.String unityEngineDLLPath, System.String unityUNetDLLPath) [0x0006e] in /Users/builduser/buildslave/unity/build/Extensions/Networking/Weaver/UNetWeaver.cs:1837  UnityEngine.Debug:LogError(Object) Unity.UNetWeaver.Log:Error(String) (at /Users/builduser/buildslave/unity/build/Extensions/Networking/Weaver/Program.cs:20) Unity.UNetWeaver.Weaver:WeaveAssemblies(IEnumerable1, IEnumerable1, IAssemblyResolver, String, String, String) (at /Users/builduser/buildslave/unity/build/Extensions/Networking/Weaver/UNetWeaver.cs:1844) Unity.UNetWeaver.Program:Process(String, String, String, String[], String[], IAssemblyResolver, Action1, Action`1) (at /Users/builduser/buildslave/unity/build/Extensions/Networking/Weaver/Program.cs:34)
UnityEditor.Scripting.Serialization.Weaver:WeaveUnetFromEditor(String, String, String, String, Boolean)
Failure generating network code.
UnityEditor.Scripting.Serialization.Weaver:WeaveUnetFromEditor(String, String, String, String, Boolean)
Please Help

Hi, sorry it took me time to reply. How did you solve this?

+1
@clebel I might have the same problem to build for a HoloLens

authors: clebel daterre schallerala

repo: daterre/Cradle

license: mit


text:
feat: tojsonl add --quiet option

resolves #2335

Yay. Thanks for this @jqnatividad

authors: jqnatividad tmtmtmtm

repo: dathere/qsv

license: Unlicense


text:
Support Hyperdrive-Key header when cloning from URL [WIP]

For now this is just a proof of concept. Just messing around with some things 😉
Related to: https://github.com/mafintosh/hyperdrive-http/pull/1

@mafintosh Am I on the right track?

Got this integrated into v13 via dat-link-resolve, thanks! Going to use the header on datproject.org.

authors: joehand watson

repo: datproject/dat


text:
display timings at the end of the export

Since script was running almost 1 hours to export all (9929  Rows) …. I would like also see timings “Elapsed: 01:02:00.000” to know how much time I can expect on next run 😊

repo: daust/opal-tools


text:
Add support for mixed type bots

Bots that are based on TorchCraft require both a dll and an exe to run. While it's possible to hack TorchCraft to launch a single executable, or to use client mode, it's probably safer to allow the use of dlls.
This pull request adds this feature by defining a new bot type, "mixed", which combines proxy and dll bots. This new type allows users to load a dll in StarCraft, while also enabling them to provide a run_proxy.bat script if deemed necessary.
To avoid too much confusion this close to the tournament, I have not renamed the required script to something like script.bat, however we might consider doing some refactoring around this new type after AIIDE.
Note: I've provided compiled binaries of the server and client using javac 1.8.0_144 x86, however you might want to check them after merging. All I can say is that I tested them for a couple of hours, and everything looked functional :)

@richard-kelly When you get back can you review this pull request?

@edran, this is just a clarification of the settings, right? Currently for proxy bots a dll can still be included and BotName.dll is placed in the bwapi settings file.

Oh, I see what you are saying. Proxy bots are forced to provide a fake dll. What's the use case for that?

It was when I didn't realize you couldn't specify no dll :)

I tried not specifying the dll for proxy bots and found that it the dll path is required for earlier versions of BWAPI (but not 4.2.0), so Dave there was a good reason for doing it that way :)

This is no longer required so I'll close the issue

authors: davechurchill edran richard-kelly


text:
Dialog

is this imageview zooming works in full screen dialogs?

I've never tried that. Have you tried it?

Yes it is working perfect. Thanx @davemorrissey for such a beautiful lib.  One thing I am missing is, I want image to be full screen irrespective of aspect ratio is it possible?

Have a look at the configuration page in the wiki, you'll find what you need under the minimum scale type option.

authors: davemorrissey prashanthd


text:
Chore #158140031 Set Up Postgres

What does this PR do?

Set up PostgreSQL database

Description of Tasks to be completed

Create a Database class that will make it easier to make queries
Add a method to create all tables
Add a method to drop all tables
Add a method to prepare tables for development mode. This is to ease the re-structuring of tables if the need arises during development.

Relevant Pivotal Tracker Stories
#158140031

Pull Request Test Coverage Report for Build 94

8 of 31 (25.81%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-3.6%) to 89.024%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

MaintenanceTrackerAPI/api/v1/database.py
8
31
25.81%

Totals

Change from base Build 87:
-3.6%

Covered Lines:
511

Relevant Lines:
574

💛  - Coveralls

👍

authors: coveralls davenmathews valeria-chemtai

repo: davenmathews/Maintenance-Tracker


text:
Use site_url to compare with content URLs

Hello, We got a report that this plugin is not working with WPML on translated pages. Ticket link
Since Server Push matching domain of resource URL with home URL and WPML translate the home URL thus it doesn't match. e.g. http://example.com/fr/ replacing it with site URL fix the issue.
Also, content URL constructed using site URL itself so it will be good even when not using WPML.

Thanks for the patch! I just released v1.4 with this fix. You rock!


text:
Add JTI_CLAIM to SIMPLE_JWT config

Add ability to change jti key name for integration with Auth0 (Auth0 do not add jti to jwt by default and you can't add jti via hooks there).
So access_token['jti'] = require('uuid').v4(); will not work, but access_token['https://domain.com/jti'] = require('uuid').v4(); will add https://domain.com/jti
It can look like:
SIMPLE_JWT = {
    ...
    'JTI_CLAIM': 'https://domain.com/jti',
}

default value: 'jti'
Related question on Auth0 support forum: https://community.auth0.com/t/set-token-exp-jti-in-client-credentials-exchange-hook/6732

Just released version 4.3 which includes this feature.

authors: davesque lorddaedra


text:
Add flag and environment variable for OAUTH2 server

This is just to make it easier to test while also doing work that will eventually need to be done anyway.

Rebased onto latest bss-auth commit.

@davidallendj Could you review?

repo: davidallendj/bss


text:
Additional event listener

Added additional event listeners:

onAfterExport
onAfterPlot
onAnimated
onAnimatingFrame
onAnimationInterrupted
onAutoSize
onBeforeExport
onClickAnnotation
onDeselect
onDoubleClick
onFramework
onLegendClick
onLegendDoubleClick
onRelayout
onRestyle
onRedraw
onSelecting
onSliderChange
onSliderEnd
onSliderStart
onTransitioning
onTransitionInterrupted
onEvent
onBeforePlot

thank you @matthiaseigner !

authors: davidctj matthiaseigner

repo: davidctj/react-plotlyjs-ts


text:
Added support of object initializers

This PR adds support of object initializers, so that it's possible to write new MyClass { MyProp = 5 }.

I fixed the formatting issues, and added the tests you suggested.
I like your plan to release the smaller changes before the lambda syntax PR, that way there's a fallback version in case something goes terribly wrong :)

repo: davideicardi/DynamicExpresso


text:
Fix comments regarding Atari disks.

Fix out of date comment. Used to be three boot tracks, but since the loader was introduced, it's only one.
Regards,
Ivo

Thanks --- merged.

Hi,
Didn't see it merged into master yet. Here's another fix when building the 90kB SD image.
Regards,
Ivo

Huh --- maybe I forgot to press the button. Done now.

authors: davidgiven ivop


text:
Plural Models with Single Form

I am confused by model reducer/ form reducer pattern when dealing with plural models. If i have a ChildForm, and I wish the form to be used to dynamically add to a children model, how would you suggest I approach this?
At the moment,  I have childForm, child, and children models in my store. I am dispatching actions on submit to clear the child and the childForm model, while pushing the data from the child model into the children model. Is there a nice way for me to eliminate this child model? It doesn't seem to be doing a lot for me.
Thanks,
Sam

Yes, there is. Consider a store that looks like this:
// combineForms comes form RRF v1
const store = createStore(combineForms({
  children: [],
});

And a very simple function that returns a new child:
const createChild = (name) => ({ name, age: null });

Then you can add a child by using actions.push():
<button
  onClick={() => dispatch(actions.push('children', createChild('bob')))}
>
  Add bob
</button>

And you can reference that exact child by name (or other unique ID) by using track():
// edit only bob's age
<Field model={track('children[].age', {name: 'bob'})}>
  <input type="number" />
</Field>

Hope that helps!

authors: davidkpiano sdlovecraft

repo: davidkpiano/react-redux-form


text:
Incompatible with ReactNative >=0.43.4

The Problem
react-redux-form (^1.12.1) is incompatible with the latest version of ReactNative (0.43.4), which has a dependency on React 16.0.0-alpha.6. react-redux-form's dependencies are "react@^0.14.0 || ^15.0.0".
Please update react-redux-form to be compatible with ReactNative >=0.43.4.

Want to make a PR? I'll merge it in ASAP.

I gave it a go. Looks like it's not currently possible given the state of some of your third party dependencies.
I updated react and react-dom to v16.0.0-alpha.13, and these dependencies complain:
warning "shallow-compare@1.2.1" has incorrect peer dependency "react@15.x".
warning "react-addons-test-utils@15.6.0-rc.0" has incorrect peer dependency "react-dom@^15.4.2".

Those are the latest versions of each library. I suppose I'll have to forgo using react-redux-form in this project until everything catches up to React 16.

I may be having an unrelated issue with my local environment. I switched to yarn and the application is building despite the unmet dependencies. So the library appears to be usable with RN 0.43.4. Apologies. It would still be good to get the versions up, but that doesn't seem possible (or necessary) at this time. Closing this.

I guess the problem still persists especially because now React 16 is out! It's a warning but I assume it won't be a deal-breaker in any way

@rahulbasu710 @andrewhl If it's a simple fix, mind making a quick PR? I'll merge it in ASAP.

authors: andrewhl davidkpiano rahulbasu710


text:
@xstate/react README displaying wrong options for second useMachine arg

Bug or feature request?
Bug
Description:
The following git commit introduced documentation that isn't valid on the current versions: @xstate/react 0.6.1 and xstate 4.6.3 ):
Commit
(Bug) Expected result:
The README page on @xstate/react should describe useMachine's second argument to be interpretter options (e.g. devTools key)
(Bug) Actual result:
The README describes machine config options (e.g. actions).
(Bug) Potential fix:
Changing the description in the README to one that shows that these are machine config options.
I could send this as PR if you like :heart_decoration:
Link to reproduction or proof-of-concept:
CodeSandbox proof of concept, only one of the two keys supplied is being used

Fixed in the newly released @xstate/react@0.7.0.
There's also now a CHANGELOG.md file for the @xstate/react package documenting the changes.

authors: amitnovick davidkpiano

repo: davidkpiano/xstate


text:
test: increase coverage after reviewing some reports

Issue or need
After reviewing some coverage reports both locally and on app.codecov.io, seems there are some quick coverage wins (on branches coverage)

Proposed changes
Apply them hehe

Quick reminders

🤝 I will follow Code of Conduct
✅ No existing pull request already does almost same changes
👁 Contributing docs are something I've taken a look at
📝 Commit messages convention has been followed
💬 TSDoc comments have been added or updated indicating API visibility if API surface has changed.
🧪 Tests have been added if needed. For instance, if adding new features or fixing a bug. Or removed if removing features.
⚙ API Report has been updated if API surface is altered.

#720  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @davidlj95 and the rest of your teammates on  Graphite


text:
refactor: remove id from attribute and its usages

This way we're a step closer to remove the slug generation service

#410  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @davidlj95 and the rest of your teammates on  Graphite


text:
Update from v24.11.02 - 4mppt missing

Description
Hello,
Got the update info today and installed it.
From 24.11.02 to 24.12.08_09
My inverter config was:
deye_4mppt.yaml
This file was deleted after the update.
Manually recreating it did not help.
I no longer get any inverter data.
Need help please....
Reproduction Steps
Update from 24.11.02 - to 24.12.08_09
Log
Logger: homeassistant.config_entries
Quelle: config_entries.py:640
Erstmals aufgetreten: 13:09:58 (2 Vorkommnisse)
Zuletzt protokolliert: 13:09:58
Error setting up entry West-PV for solarman
Error setting up entry Garage-PV for solarman
Traceback (most recent call last):
File "/usr/src/homeassistant/homeassistant/config_entries.py", line 640, in __async_setup_with_context
result = await component.async_setup_entry(hass, self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/solarman/init.py", line 56, in async_setup_entry
await async_migrate_entries(hass, config_entry.entry_id, partial(migrate_unique_ids, config.name, config.serial))
File "/usr/src/homeassistant/homeassistant/helpers/entity_registry.py", line 1636, in async_migrate_entries
ent_reg.async_update_entity(entry.entity_id, **updates)
~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/homeassistant/homeassistant/helpers/entity_registry.py", line 1179, in async_update_entity
return self._async_update_entity(
~~~~~~~~~~~~~~~~~~~~~~~~~^
entity_id,
^^^^^^^^^^
...<21 lines>...
unit_of_measurement=unit_of_measurement,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/usr/src/homeassistant/homeassistant/helpers/entity_registry.py", line 1118, in _async_update_entity
raise ValueError(
...<2 lines>...
)
ValueError: Unique id 'west_pv_4064093016_over_frequency_load_reduction_switch' is already in use by 'switch.west_pv_over_frequency_load_reduction'
Version
24.12.08_09
Home Assistant Version
2024.12.1

You have change to deye_micro.yaml?
And Set all setting by gui?

One should not have to change anything in theory. But that duplicate id is weird.

Hi,
Ok, I deleted everything and reconfigured them.
Values arrive again, but everything has to be rebuilt as entities are called differently.
That takes time again....
Thanks so far....

There is migration in place which should take care of everything but can't figure out where that second west_pv_4064093016_over_frequency_load_reduction_switch came from... 🤯

Mh, @Wubarius, It would be very helpful if you could do partial buckup restore to before you did the update and repeat the process but then (before restart of HA) enabled debug logging, restarted HA and share the debug log w/ migrations. But only really if you have the time, no pressure. 😉

authors: CrazyUs3r Wubarius davidrapan

repo: davidrapan/ha-solarman


text:
Don't (re)focus and select if focus is already in the target element during trap activation

I have a focus trap for an input that is automatically activated when the user types something in that input.
During the activation the library is not checking if the node to focus is the same already focused, resulting in a misleading behavior: while user is inputing characters, the text become selected and continuing typing overwrites previously inserted chars.
This PR just do this check in tryFocus() before focusing:
    if (node === document.activeElement)  return;

I've added missing file, are you planning to merge this?

Makes sense, thanks!

authors: andrea-spotsoftware davidtheclark

repo: davidtheclark/focus-trap


text:
Types\SellerProfilesType -- ProfileID Int larger than 32bit php_int_max

Change integer to string in the respective profile types

nope, you have to switch to 64bit

Just changed int to string works fine. Here for anyone else that runs into it.

that´s a bad hack. next time this SDK gets an update, you may not forget to redo all your hacks. use 64bit, we no longer live in the stone age.

what does bad hack mean?

it´s the opposite of something good. i guess you can close this issue because there is nothing in here that helps somebody.

If someone is running this on a 32 bit system and ran into this problem, would this not help them?

no. this person should switch to 64bit - that´s the only solution that makes sense when working with this SDK and ebay at all.
btw. this issue is already adressed here and more detailed here.

Whats the point of the integer data type requirement? Since xml doesn't send data types, ebay would kick back an error anyway, if the input was wrong. Im no php api expert, so your knowledge on the subject would be appreciative.

Pardon, my intention is to help, not to discuss why it makes sense to use a 32bit system these days, nothing more this is about. I'm out.

I guess you misunderstood the question?

Duplicate of #101 - just to keep track of things. :)

authors: Rykono medigeek michabbb

repo: davidtsadler/ebay-sdk-php


text:
Get relist item ID after product expired in the Shopping Service

Hi everyone
I build service to review anything products. The writer creates an article and fills products to it.
We use DTS\eBaySDK\Shopping\Services\ShoppingService with method getMultipleItems() by getting information about the product, but we have a problem with products which expired and has been relisted
For example:
If writer added a link to the product on the eBay: https://www.ebay.de/itm/Lego-Darth-Vader-TIE-Fighter-8017-Anleitung-OVP-/123190324900
And after its expired time of the product and if you go to this link you will have a redirect to https://www.ebay.de/itm/Display-stand-angled-no-3-for-75105-7965-Millennium-Falcon-Star-Wars-Lego-/172850356481?oid=123190324900 , this a product with new ItemID, which can contain different cost, name, and other information.
Could you explain how we can get a new ItemID on which redirect on basic request from the browser?
I try to use method getItem in the DTS\eBaySDK\Trading\Services\TradingService for get Item.ListingDetails.RelistedItemID, but I have got error:
$service = service = new TradingService([
    'credentials' => $this->availableAccs[$this->currentAccKey],
    'siteId'      => $this->siteId // DTS\eBaySDK\Constants\SiteIds::DE
]);
$request = new GetItemRequestType();
$request->DetailLevel[] = DetailLevelCodeType::C_RETURN_ALL;
$request->ItemID = $itemsIdString;
$response = $service->getItem($request);

Response:
`GetItemResponseType {#507 ▼
  -values: array:5 [▼
    "Timestamp" => DateTime @1529747514 {#506 ▶}
    "Ack" => "Failure"
    "Errors" => RepeatableType {#526 ▼
      -data: array:1 [▼
        0 => ErrorType {#518 ▼
          -values: array:5 [▼
            "ShortMessage" => "No Password and no token."
            "LongMessage" => "No XML <RequestPassword> or <RequestToken> was found in XML Request."
            "ErrorCode" => "930"
            "SeverityCode" => "Error"
            "ErrorClassification" => "RequestError"
          ]
          -attachment: array:2 [▼
            "data" => null
            "mimeType" => null
          ]
        }
      ]
      -position: 0
      -class: "DTS\eBaySDK\Trading\Types\GetItemResponseType"
      -property: "Errors"
      -expectedType: "DTS\eBaySDK\Trading\Types\ErrorType"
    }
    "Version" => "1063"
    "Build" => "E1063_CORE_API_18716213_R1"
  ]
  -attachment: array:2 [▼
    "data" => null
    "mimeType" => null
  ]
}

please read the wiki or inspect the samples.

Hi guys. I'd like to have the same feature(to extract a new Item ID if I have an ended one )
But I'm not an owner of relisted item.
So it seems I can't use TradingService to get this kind of info.
I've searched in official docs, articles, questions on stakoverflow and others to find another way.
The only thing I see is usage curl with redirect to extract a new ID, but captcha can brake it.
@michabbb Could you suggest something please?

@Dmitri10 as far as i know: the getitem call gives you the "old itemid" of your own listings. i never had the need before to get this info from foreign listings so i don´t know the perfect solution here. but why don´t u ask the professional ebay support ? if there is another way, the will know - and tell you.

@michabbb I'll get their response in 24-48 h so I wondered here if you or Topic author had the same problem.

@Dmitri10 many thanks for letting us know

btw.. why don´t people never close their issues... i will never understand this... 🤔

authors: Dmitri10 almonax michabbb


text:
Solcast time after day ahead optimization not correct

Describe the bug
I'm using Solcast for the solar forcast and filled in the paramters in te config en secret file and it worked before.
Since I'v updated to version 0.8.4 the predicted solar data is not on the right time stamp
Its like the solar data is shifted 10h further than expected (see screenshot)
I'm using solcast also in the energy dashboard on HA and there it works fine
Expected behavior
That the solar data is shown on the right timeslot
Screenshots
log file

data after day ahaed optimization
when you look at p_pv it start showing values from 18u but then the sun is almost gone

Home Assistant installation type

Home Assistant Supervised

Your hardware

OS:  Linux
Architecture: amd64

EMHASS installation type

Docker Standalone

Are you on TZ +1h?

yes correct, I live in Belgium
In the docker container the time is running correct and in the secret file the timezone is also set

Very strange.
When starting the app with the docker run command try adding the env variable -e TIME_ZONE="Europe/Paris" to directly specify the TZ and see if it makes any difference.

Your timezone parameter may be correct. However, It may be that the timezone on the standalone Docker file itself is incorrect. Presenting incorrect timezone values on the web sever.
After trying @davidusb-geek 's recommendation. Try: -e TZ="Europe/Paris":
So something line docker run ... -e TIME_ZONE="Europe/Paris" -e TZ="Europe/Paris ... `

I've removed the container en build it with docker run ... -e TIME_ZONE="Europe/Paris" -e TZ="Europe/Paris ...
the time is correct in the container see image, but still same issue

In the log file I found this error
2024-03-31 18:47:25,420 - web_server - INFO - Status: Optimal
2024-03-31 18:47:25,420 - web_server - INFO - Total value of the Cost function = -1.58
2024-03-31 18:47:25,423 - web_server - INFO - Solving for day: 30-3-2024
2024-03-31 18:47:25,424 - web_server - ERROR - Exception on /action/perfect-optim [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/pandas/core/arrays/datetimes.py", line 2423, in _infer_tz_from_endpoints
inferred_tz = timezones.infer_tzinfo(start, end)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "pandas/_libs/tslibs/timezones.pyx", line 368, in pandas._libs.tslibs.timezones.infer_tzinfo
AssertionError: Inputs must both have the same timezone, UTC+01:00 != UTC+02:00
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 1463, in wsgi_app
response = self.full_dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 872, in full_dispatch_request
rv = self.handle_user_exception(e)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 870, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/flask/app.py", line 855, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)  # type: ignore[no-any-return]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/emhass/web_server.py", line 119, in action_call
opt_res = perfect_forecast_optim(input_data_dict, app.logger)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/emhass/command_line.py", line 207, in perfect_forecast_optim
opt_res = input_data_dict['opt'].perform_perfect_forecast_optim(df_input_data, input_data_dict['days_list'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/emhass/optimization.py", line 538, in perform_perfect_forecast_optim
data_tp = df_input_data.copy().loc[pd.date_range(start=day_start, end=day_end, freq=self.freq)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pandas/core/indexes/datetimes.py", line 945, in date_range
dtarr = DatetimeArray._generate_range(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pandas/core/arrays/datetimes.py", line 422, in _generate_range
tz = _infer_tz_from_endpoints(start, end, tz)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/pandas/core/arrays/datetimes.py", line 2426, in _infer_tz_from_endpoints
raise TypeError(
TypeError: Start and end cannot both be tz-aware with different timezones

I tried but I'm currently not able to reproduce this.

When I change in config_emhass.yaml retrieve_hass_conf:   freq: 60 # The time step to resample retrieved data from hass in minutes back to retrieve_hass_conf:   freq: 30 # The time step to resample retrieved data from hass in minutes
The solcast data is shown correct again, the reason why i changed the resample time from 30 to 60 is the following,
I use in homeassistant an sensor to load the price per hour because its not always the same, this data is given per hour.
my question is how can I change the code below to output 30 minute data instead of 60 minute data?
  - platform: template     sensors:       load_cost_forecast_list:         value_template: >-           {% if now().weekday() == 5 or now().weekday() == 6 %}             {%- set load_cost = [0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.115] %}           {%- else -%}             {%- set load_cost = [0.115, 0.115, 0.115, 0.115, 0.115, 0.115, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.155, 0.115, 0.115] %}           {%- endif %}           {%- set values_all = namespace(all=[]) %}           {% for i in range(load_cost | length) %}             {%- set v = (load_cost[i] | float ) %}             {%- set values_all.all = values_all.all + [ v ] %}           {%- endfor %} {{ (values_all.all)[now().hour:24] + (values_all.all)[0:now().hour] }}
so that I can send 48 data points instead of 24 data points to the load cost forcast...

Ok I will try to reproduce this by changing the retrieve_hass_conf. It might be a bug, so I will do some tests.
For your question regarding the code I don't know if I understand well, but you just need to expand your lists to have 48 elements.
For example this list with 3 elements:
list=[1,2,3]

Can be expanded to 6 elements like this:
list=[1,1,2,2,3,3]

Are you still having this issue?

Yes, even after updating to version 0.8.6
when using retrieve_hass_conf: freq: 30 # in the config file it works perfect
when using retrieve_hass_conf: freq: 60 # the solcast data starts @ 14h

This is an part of the solcast data (yellow) with retrieve_hass_conf: freq: 30 #
The solcast data start @ 6h30

This is an part of the solcast data (yellow) with retrieve_hass_conf: freq: 60 #
The solcast data start @ 14h
If you look to the steps off the solcast data, @ 14h the solcast value is "2W", @ 15h I expected "79W" but see "32W" because there is an time difference of 1h and not 30 minutes.
Its like the data array from solcast is stil 30 minute data but the emhass data is 60 minute data.
because

Ok there is probably a bug with Solcast not adapting to the new freq values. However in your original issue the dat was shifted 10h, so that's some improvement! ;-)
As for your second question I already answered before like this:
Just update your lists in your template sensor.
For example this list with 3 elements:
list=[1,2,3]

Can be expanded to 6 elements like this:
list=[1,1,2,2,3,3]

authors: BDVGitHub GeoDerp davidusb-geek

repo: davidusb-geek/emhass


text:
Android tv + nvidia

Black screen after installation

Did you try https://github.com/daviiid99/LineageOS-Switch-T210/releases/tag/20201228.?
Only this version of androidTV works for now

Did you try https://github.com/daviiid99/LineageOS-Switch-T210/releases/tag/20201228.?
Only this version of androidTV works for now


text:
image scaling in face recognition

Hi --
I'm wondering how images are getting preprocessed before going into face_recognition_model_v1.  There's a comment in the code that suggests the face chips are upsampled to 150x150, but I could find exactly where that's happening, or what kind of upsampling is being done.
Roughly, I'm trying to measure how performance of the model degrades with the quality of the image.  I have a dataset where a number of the extracted faces are smaller than 50x50, so trying to build intuition about how the model might behave at those resolutions.
Thanks
Ben

Look at the C++ example program http://dlib.net/dnn_face_recognition_ex.cpp.html.  It shows all the processing steps from loading the image to computing the face descriptor.

authors: bkj davisking

repo: davisking/dlib


text:
Umbraco 9

Do you have any plans to upgrade this package for Umbraco 9?

Hi @creativesuspects
I have plans to upgrade this to V9. But at the moment I can't give a time frame.
I have started my more popular packages first.
Dave

Hi @dawoe,
I totally understand. Would love to see this package ported to v9 in the (near) future. I will keep an eye on it and maybe chime in if I can find some spare time. :-/
Arjan

Thanks! I will check it out as soon as I get the chance.

@dawoe Any idea when you'll be pushing PR #33 to NuGet, maybe as an RC? I'd love to test it.

authors: creativesuspects dawoe

repo: dawoe/umbraco-redirectsviewer


text:
Allow builder images to be configurable

Is your feature request related to a problem? Please describe.
Currently, we hardcode the builder image to daytonaio/workspace-project.
Describe the solution you'd like
This should be configurable as part of daytona server configure.
Describe alternatives you've considered
As part of this issue, we should discuss if the user should be able to configure a custom image for each builder (DevContainer, Docker, etc.) or one image that is used by all builders.

As part of this issue, we should discuss if the user should be able to configure a custom image for each builder (DevContainer, Docker, etc.) or one image that is used by all builders.

Regarding this, I propose we have one image for all builders. The builder image should ideally only be used for the purpose of serving as a Daytona Builder, thus having dependencies for all builders shouldn't be much of a concern.
E.g. We would require that the builder image has the devcontainer cli, nix, docker, etc.
Alternatively, we would list requirements for each builder image separately and the user would have one image with thedevcontainer CLI, one with nix, etc.

One configurable image for all builds sounds good for now

authors: Tpuljak idagelic

repo: daytonaio/daytona


text:
Preparing metadata (setup.py)  error

Hi,
I was doing python -m pip install dbt-mysql on window powershell and ran into this error
Collecting cffi<1.15,>=1.9
Using cached cffi-1.14.6.tar.gz (475 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [24 lines of output]
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\John\AppData\Local\Temp\pip-install-xb14e42c\cffi_21c026e457b24a1fa2c27f696e5b1d7c\setup.py", line 127, in
if sys.platform == 'win32' and uses_msvc():
^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Temp\pip-install-xb14e42c\cffi_21c026e457b24a1fa2c27f696e5b1d7c\setup.py", line 105, in uses_msvc
return config.try_compile('#ifndef _MSC_VER\n#error "not MSVC"\n#endif')
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools_distutils\command\config.py", line 223, in try_compile
self._compile(body, headers, include_dirs, lang)
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools_distutils\command\config.py", line 128, in _compile
self.compiler.compile([src], include_dirs=include_dirs)
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools_distutils_msvccompiler.py", line 343, in compile
self.initialize()
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools_distutils_msvccompiler.py", line 253, in initialize
vc_env = _get_vc_env(plat_spec)
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools\msvc.py", line 210, in msvc14_get_vc_env
return _msvc14_get_vc_env(plat_spec)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\setuptools\msvc.py", line 164, in _msvc14_get_vc_env
raise distutils.errors.DistutilsPlatformError(
distutils.errors.DistutilsPlatformError: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
I was wondering if there's a fix for this?

Thanks for reaching out @bibimimi103 !
I don't have a Windows machine to test this on, so my ability to troubleshoot is limited.
The error message mentioned that

Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/

So maybe try downloading the build tools at https://visualstudio.microsoft.com/visual-cpp-build-tools/ ? 🙏

Thanks for reaching out @bibimimi103 !
I don't have a Windows machine to test this on, so my ability to troubleshoot is limited.
The error message mentioned that

Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/

So maybe try downloading the build tools at https://visualstudio.microsoft.com/visual-cpp-build-tools/ ? 🙏

seems like downloading the build tools solved my problem. Apologies for not looking at it closely. However, after it installed and I'm trying to initialize my first project by running command "dbt init first_project" within my clone repository  so I could test, I received this error after.
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Scripts\dbt.exe_main.py", line 4, in
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\dbt\main.py", line 2, in
from dbt.logger import GLOBAL_LOGGER as logger, log_cache_events, log_manager
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\dbt\logger.py", line 16, in
from dbt.dataclass_schema import dbtClassMixin
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\dbt\dataclass_schema.py", line 13, in
from mashumaro import DataClassDictMixin
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro_init.py", line 4, in
from mashumaro.serializer.json import DataClassJSONMixin
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\serializer\json.py", line 28, in
class DataClassJSONMixin(DataClassDictMixin):
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\serializer\base\dict.py", line 21, in init_subclass
raise exc
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\serializer\base\dict.py", line 17, in init_subclass
builder.add_to_dict()
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\serializer\base\metaprogramming.py", line 365, in add_to_dict
pre_serialize = self.get_declared_hook(PRE_SERIALIZE)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\serializer\base\metaprogramming.py", line 203, in get_declared_hook
if type_name(cls) != DataClassDictMixinPath:
^^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\meta\helpers.py", line 28, in type_name
if is_generic(t):
^^^^^^^^^^^^^
File "C:\Users\John\AppData\Local\Programs\Python\Python311\Lib\site-packages\mashumaro\meta\helpers.py", line 54, in is_generic
raise NotImplementedError
NotImplementedError
after doing a bit of googling, information that I got is it isn't support by python 3.1.1, I was wondering if this is the case for dbt-mysql?

No worries @bibimimi103
dbt-mysql doesn't yet support Python 3.10 or 3.11. Issues for each of the are in https://github.com/dbeatty10/dbt-mysql/issues/117 and https://github.com/dbeatty10/dbt-mysql/issues/142
So in the meantime, you'd need to use <= Python 3.9

thank you for your help! much appreciated.


text:
Filters don't work for enum types

PostgreSQL 12, DBeaver EE 21.0.0, macOS 11.2.3.
Suppose we have a enum type and a table:
CREATE TYPE "mood" AS ENUM (
    'sad',
    'ok',
    'happy'
);

CREATE TABLE mood_data (
    id int4 NOT NULL GENERATED ALWAYS AS IDENTITY,
    "time" timestamp NULL,
    "mood" "mood" NULL,
    CONSTRAINT mood_data_pkey PRIMARY KEY (id)
);

Fill the table with data. Open the data editor and try to apply a filter on the mood column. Possible values for filtering will be duplicated, the data editor will be closed with an error when applying the filter.

The bug is specific to PostgreSQL.

It also seems that the only way to reproduce the bug is when this enum type is created in some non-public schema and this exact schema is set as default schema in the bootstrap settings. Everything points to a bug in PostgreExecutionContext.

Verified

repo: dbeaver/dbeaver


text:
When to develop the version for M1 Apple.

There is no problem to run DBeaver on Apple M1, but its really very slowly. Because its a intel version, not actual to Apple M1,
is M1 version on developing or there is not this plan?

duplicates #12441


text:
How to hide tables?

I created an empty database.
And it was created with tables.
How to hide tables?

It is not very clear what do you need to do.
If you need to hide something then you can filters (context menu->Filter).
Things in red square are schemas (not tables).

@serge-rider
I'm starting to learn ms sql server.
When I open a database in another program, I see only my tables and nothing superfluous

Can you tell me what is "db_sessionammin" and other list items highlighted in red?

How are the elements of the highlighted in red color hidden?

These elements are schemas (users). SQL Server has specific users model - maybe a bit too verbose.
Usually your tables reside in schema dbo - so you can just expand it and work only with them.

Thank you.
Could you help with this question:
"How do I edit the table name and column name? "


text:
Run selected script - without opening editor

Some scripts are very big and editor will take long time to load into UI -  for such scripts we save in drive and run them from workbench or some other tool - just by selecting the file and running it without loading it to editor.
Can we get that feature -  probably in tools or some relevant location when we right click on the database name -  to run the sql file on selected connection/DB instead of opening the file in editor.

Mysql:

Any possible milestone?

This is relatively big feature.
There are too many different questions and possibly too many UI additions. I can't say when we'll have resources for that. Maybe we more people would vote for this feature.

Sorry, I was not trying to prioritize the ticket, but just commenting to make sure it was not forgotten.
Thank you for the wonderful application and thank you for keeping it free.

This is relatively big feature.

I found it by way of the good first issue label. Would you please clarify whether you think it is a good first issue?

A suggestion: I suppose it might be quite easy to implement this as a command line parameter. Just like now you allow to execute tasks (which are very similar in nature to a sql script).
Of course running tasks from the command line is a EE feature, so if a similar implementation is chosen, there goes the "thank you for keeping it free" :smiley:.

I am only asking to provide a right click file within dbeaver ide and run script, without opening the sql script editing window. I don't think it will clash with EE version.
Clarifying: I am not asking for commandline args, I am only asking a right click within the Dbeaver IDE.

This is especially useful when working with database dumps, which are usually large in size. If I want to import a db dump in dbeaver I would usually have to wait around 4 to 5 minutes for the editor to load after opening the sql file, only to then wait 4 to 5 minutes more after switching the database on which I would want to import this dump.

Hello, I Just tried to make this feature by myself. But I got caught in a cyclic dependency problem.
Following is a sequence of my approach:
(1) Make 'Run Script' menu and command in 'org.jkiss.dbeaver.ui.navigator'
(2) Write handler setting in plugin.xml to connect the command with 'SQLEditorHandlerExecute' class in 'org.jkiss.dbeaver.ui.editor.sql'
(3) Add 'org.jkiss.dbeaver.ui.editor.sql' in Required-Bundle of MANIFEST
(4) Because 'org.jkiss.dbeaver.ui.editor.sql' already has dependency on 'org.jkiss.dbeaver.ui.navigator', (3) raises cyclic dependency and compile fails
I tried to find a way to execute SQL without 'SQLEditorHandlerExecute' class, but I couldn't make it. Could anyone have better approach to make this feature? Any advice would be appreciated!

is this issue still open

Hello, I just tried to make this feature by myself. But I got caught in a cyclic dependency problem.
Following is a sequence of my approach: (1) Make 'Run Script' menu and command in 'org.jkiss.dbeaver.ui.navigator' (2) Write handler setting in plugin.xml to connect the command with 'SQLEditorHandlerExecute' class in 'org.jkiss.dbeaver.ui.editor.sql' (3) Add 'org.jkiss.dbeaver.ui.editor.sql' in Required-Bundle of MANIFEST (4) Because 'org.jkiss.dbeaver.ui.editor.sql' already has dependency on 'org.jkiss.dbeaver.ui.navigator', (3) raises cyclic dependency and compile fails
I tried to find a way to execute SQL without 'SQLEditorHandlerExecute' class, but I couldn't make it. Could anyone have better approach to make this feature? Any advice would be appreciated!

Hi. As i am new to Open Source in general i dont know if this will be Helpful and i do not know if you are still interest in solving this Issue. But i have used Lazy Dependencies in the Past for handling necessary cyclic dependencies. So you only Get the dependency once required.
The way i know this in C# is we inject the ServiceProvider[Or equivalent Factory - whatever is used for getting the depency into our class in a clean way, without directly injecting it]
We then make a private member for the dependency, which is nullable and null on intiation of the class
Then we write a getter that intiates the dependency member if null and then returns it either way. This Getter is what we use then to access our dependency.
This way we are not injecting cyclicly on object creation. We are just left with a bidirectional dependancy.
I would apreciate it if one of the big boys of this repository would tell me if this kind of action is ok and how good of an idea it seems.
As, if @CodyBuilder-dev is not interested in pursuing this issue further i would like to tackle it as my first issue.

authors: CodyBuilder-dev Erarshad MrHPotter chaptergy dckc p91paul serge-rider surpavan


text:
[Oracle] Metadata search doesn't work for tables if CONSTRAINT and/or FOREIGN KEY is also checked in Object type settings

System information:

Operating system (distribution) and version Win10
DBeaver version 7.0.5 EA

Connection specification:

Database name and version Oracle

Describe the problem you're observing:
Metadata search doesn't work for tables if CONSTRAINT and/or FOREIGN KEY is also checked in Object type settings.
Steps to reproduce, if exist:

Open Metadata search
select Oracle.HR
enter test in Object name field (or another table name)
Check TABLE, CONSTRAINT, FOREIGN KEY in Object types
Press Search

Actual result: the object is not found.

verified


text:
Postgres track function changed#18412

See original issue's screenshot

sorry, incorrect branch ((