text:
Feastire idea: Deployment examples

The architecture is fast thanks for the smart layering of caches.
I was thinking that deployment examples might be useful for devs .
Fly.io can scale out Postresql and Redis automatically for example. Its requires slight changes to the Docker as fly only allow a Docker and not a Docker compose. This might sound like a problem but it is not and just requires a Dockerfile that can boot Redis and Postresql.
Anyway, there is no Dockerfile in the repo for the main golang code anyway, so we could make one that is designed for fly and scaling out Redis and Postresql if we want.
It can also be used for non fly too btw, but shaping the docker appropriately.
https://fly.io/docs/reference/redis/ for edit but you can also just boot your own.
https://fly.io/docs/postgres/ but you can also boot your own and scale out your own.
Fly makes all databases sync into all regions automatically.
The golang code scales to zero so is server less.  So costs you close to nothing if you users hitting your system.
fly cli is golang and is insanely easy.
Fly anycast / bop automatically does nearest server LB, so its seamless scale out at that level too.  Its pretty no brainer stuff
Most people use Cloudflare but any DNS works. SSL is done for you.

Yep deploy folder is perfect .
GitHub actions can use it and deploy.

The other hosting providers can be done too of course. I tend to use fly because it’s anycast. So I standup an instance and via the cli or GitHub actions can scale the instance to any of the 30 data centers and it Al remains in sync.
also postresql works and scales in a master sake pattern . I normally pick Amsterdam as it’s the best for global origin. Than all slaves in the other 29 auto sync .
Clients get automatically send and load balanced to nearest DC and LB in each DC to how many instances you have in that DC.
this is why I guess I don’t use GCP or AWS.
S3 proxying also works and postresql is automatically Snapshot so if you blow away your Origin your can get your postresql data and s3 blobs.

https://github.com/superfly/flyctl For cli.
https://fly.io/docs/app-guides/continuous-deployment-with-github-actions/ for git ops.
https://github.com/superfly/flyctl-actions
https://github.com/superfly/fly-pr-review-apps  for GitHub or ops
https://github.com/superfly/fly-log-shipper For log shipping. I use nats as they suggest so I can log async which is much faster and takes load off main servers.

For back control plane is also nats but hosted :
https://www.synadia.com/ngs
it’s identical to nats golang server used for logging but I can control fky, s3, dns, etc etc via ngs Nats. GitHub actions just call a makefile that modifies all the operational things.
Ngs is just the command and control system for talking to all this things

Just realised that the docker compose has Redis and postresql.
2 options:

run each standalone

https://github.com/fly-apps/redis/
https://github.com/fly-apps/postgres-ha

inject the binaries into the one docker

So what would be required to add to this repo in order to make deploying via fly easier? Does this app require anything highly specific? I'm curious if including it will actually be of much help to people. As always, my concern with adding things is that it's another thing to maintain and stay on top of, so it has to be worth it. I thought about adding something for cloud run but I'm not really sure how helpful that is. The other problem is that the list of cloud providers is very long.

A fly.toml
A dockerfile that runs the golang main.
The fly cli is used to run the deployment
The fly GitHub action to auto deploy it.
postresql is supported on fly. You can even scale it out using the fly cli

I'm going to close this. There's an endless amount of places and way to host this and there's really nothing specific about this app that requires anything custom. I'm also considering removing both Postgres and Redis as a default in favor of SQLite and something in-memory to really make this template as rapid/easy/fast as possible. If that is done, then there's really nothing regarding deployment required.

Yeah I changed to SQLite and marmot . It’s been great having clustering and real time updates

repo: mikestefanello/pagoda


text:
Add image

Done

source: gharchive/issue

license: MIT

license_type: permissive

license_source: github-api


text:
Making PoissonPointProposal guaranteed symmetric

Assertion statement has been added in the __init__() function of the PoissonPointProposal class to force p_create = p_destroy

@SaiAakash Thanks for putting this in. Sorry, I think assert is actually not the right way to do this, since assertions are only enforced in debug mode. The correct design pattern would be:
if not self.move_distribution["create"] == self.move_distribution["destroy"]:
    raise ValueError("Something descriptive")

This change has been made.

@SaiAakash Awesome. LGTM. Thank you very much.

source: gharchive/pull-request

authors: SaiAakash mikkelbue

repo: mikkelbue/tinyDA


text:
Setting One-To-One relation from inverse side has no effect

Describe the bug
When setting undefined from the inverse side of a One-To-One relation, the value is not persisted. The operation does not generate a SQL line and therefore does not persist the change.
Example:
@OneToOne(() => Book, book => book.favoritedByAuthor, { owner: true, wrappedReference: true, nullable: true })
  favouriteBook?: IdentifiedReference<Book>;

@OneToOne(() => Author, author => author.favouriteBook, { wrappedReference: true, nullable: true })
  favoritedByAuthor?: IdentifiedReference<Author>;

    /** Preparation */
    const insertAuthor = new Author('Author 1', 'test@example.org');
    await this.orm.em.persistAndFlush(insertAuthor);

    const insertAuthor2 = new Author('Author 2', 'test@example.org');
    await this.orm.em.persistAndFlush(insertAuthor2);

    const insertBook = new Book('Book 1', insertAuthor);
    await this.orm.em.persistAndFlush(insertBook);

    const insertBook2 = new Book('Book 2', insertAuthor);
    await this.orm.em.persistAndFlush(insertBook2);

    /** Here it all starts */
    const author1 = await this.orm.em.findOneOrFail(Author, { name: 'Author 1' });
    const author2 = await this.orm.em.findOneOrFail(Author, { name: 'Author 2' });

    author1.favouriteBook = wrap(insertBook).toReference();
    await this.orm.em.flush();

    insertBook.favoritedByAuthor = undefined; // THIS IS THE RELEVANT LINE
    await this.orm.em.flush();

In this case Author 1 will still keep favourite_book_id set to the ID of insertBook even though we set it to undefined.
To Reproduce
Example above or here is also a reproduction repo (you will need to start the docker-compose.yml and run the Migrations):
https://github.com/visurel/nestjs-example-app/commit/4d47ca2600d161e81b50e90ff7871ec80bf387c3
Expected behavior
The value should be set and the favourite_book_id should be set to null.
Additional context
I have also tried setting it to null instead of undefined with the same result.
Setting propagateToOneOwner to true also had no difference.
Versions

Dependency
Version

node
14.16.0

typescript
^3.9.7 and ~4.0.5

mikro-orm
4.5.5

postgresql
12.4

4.5.6-dev.6

repo: mikro-orm/mikro-orm


text:
configPaths order does not work as expected at least with NestJS

Describe the bug
I have NestJS app and try to manage migrations using cli (create, up, down) and I defined two paths to orm configs in configPaths like this
  "mikro-orm": {
    "useTsNode": true,
    "configPaths": [
      "./src/mikro-orm.config.ts",
      "./dist/mikro-orm.config.js"
    ]
  }
If I don't have `dist` folder with build yet it works correctly and take configuration from `./src/mikro-orm.config.ts` but once I have `dist` folder cli never see at `./src/mikro-orm.config.ts` and take always `.js` config.

Stack trace
...

To Reproduce
Steps to reproduce the behavior:

Create NestJS app using cli and command nest new project-name
Install

    "@mikro-orm/cli": "^4.5.9",
    "@mikro-orm/core": "^4.5.9",
    "@mikro-orm/migrations": "^4.5.9",
    "@mikro-orm/nestjs": "^4.3.1",
    "@mikro-orm/postgresql": "^4.5.9",

Define ./src/mikro-orm.config.ts with

import { User } from "./src/entities/user";
import { UnderscoreNamingStrategy } from "@mikro-orm/core";
import pluralize from "pluralize";

module.exports = {
  entities: [
    User
  ],
  dbName: "nest_mikro_orm_db",
  type: "postgresql",
  password: "root",
  user: "root",
  namingStrategy: class extends UnderscoreNamingStrategy {
    classToTableName(entityName: string): string {
      return pluralize(super.classToTableName(entityName));
    }
  },
  migrations: {
    tableName: 'migrations', // name of database table with log of executed transactions
    path: './migrations', // path to the folder with migrations
    pattern: /^[\w-]+\d+\.ts$/, // regex pattern for the migration files
    transactional: true, // wrap each migration in a transaction
    disableForeignKeys: true, // wrap statements with `set foreign_key_checks = 0` or equivalent
    allOrNothing: true, // wrap all migrations in master transaction
    dropTables: true, // allow to disable table dropping
    safe: false, // allow to disable table and column dropping
    emit: 'ts', // migration generation mode
  }
}

Create User model with properties

import { Entity, PrimaryKey, Property } from "@mikro-orm/core";

@Entity()
export class User {
  @PrimaryKey()
  id: number;

  @Property()
  username: string;

  @Property()
  email: string;

  @Property()
  firstName: string;

  @Property()
  lastName?: string;

  @Property({ persist: false })
  get fullName() {
    return `${this.firstName} ${this.lastName}`;
  }

  @Property()
  updatedAt: Date;

  readonly mood: string;

  constructor(mood: string) {
    this.mood = mood;
  }

  sayHi() {
    return `${this.fullName} says hi! I am ${this.mood}`;
  }
}

Run npx mikro-orm migration:create and it generates correct migration.
Run npx mikro-orm migration:up to apply it.
Then let's build project using npm run build.
Add new property to User model

  @Property()
  createdAt: Date;

Run npx mikro-orm migration:create and get the message

No changes required, schema is up-to-date

Build project again and run npx mikro-orm migration:create and it generates correct migration.

Expected behavior
Migration tool should consider order configPaths as is.
Additional context
Add any other context about the problem here.
Versions

Dependency
Version

node
14.18.2

typescript
4.3.5

mikro-orm
4.5.9

your-driver
postgresql

Ah, that's my fault. I defined wrong path to .ts config.


text:
Fix duplicates in random seek

Fix iteration over btree returning multiple times the same node

Codecov Report

Merging #41 (089e702) into master (93cee4f) will increase coverage by 0.02%.
The diff coverage is 83.16%.

@@            Coverage Diff             @@
##           master      #41      +/-   ##
==========================================
+ Coverage   78.76%   78.79%   +0.02%
==========================================
  Files           6        6
  Lines        1262     1325      +63
  Branches      147      152       +5
==========================================
+ Hits          994     1044      +50
- Misses        192      203      +11
- Partials       76       78       +2

Impacted Files
Coverage Δ

bcachefs/bcachefs.c
70.72% <ø> (ø)

bcachefs/bcachefs_iterator.c
77.80% <77.41%> (-0.33%)
:arrow_down:

bcachefs/bcachefs.py
90.05% <90.90%> (-0.06%)
:arrow_down:

bcachefs/bcachefsmodule.c
58.49% <100.00%> (+0.79%)
:arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

authors: codecov-commenter satyaog

repo: mila-iqia/bcachefs


text:
Adds script to cross build shapeless from multiple branches.

This script allows for Shapeless cross-build model, which is based on branches. Since the build definition itself can change between branches, e.g. for changing dependencies and Scala version, it is an easy task, if possible, to do using the SBT release plugins.
Note that it is still missing the actual commands that sign and release, but should be simple to add on release  function.

This will be a huge time saver ... many, many thanks :-)
Merging ...

authors: khronnuz milessabin

repo: milessabin/shapeless

license_source: bigquery


text:
微信支付回调问题

微信支付的回调接口文档 关键字 trade_state 在你的代码里没有任何体现，你是怎么判断支付成功的？

交易状态
trade_state
string[1,32]
是
交易状态，枚举值：SUCCESS：支付成功REFUND：转入退款NOTPAY：未支付CLOSED：已关闭REVOKED：已撤销（付款码支付）USERPAYING：用户支付中（付款码支付）PAYERROR：支付失败(其他原因，如银行返回失败)示例值：SUCCESS

在WeChatWebCallback方法的TradeState字段

需要自己调 WachatQueryOrder ?

不需要，返回字段已包含TradeState字段

返回的结构体没有TradeState字段，请double check一下。

抱歉，这是新字段，本人最近很忙，没时间兼容，可以的话请提pull requests。

reopen issue，等有愿意改的人来改吧

repo: milkbobo/gopay


text:
Different board revision

Hello, I looks like I have a different board revision than what is in the tutorial (although they are both v1). Below are some images of the board and info.
I was able to trace the RX and TX to a empty through hole (labeled MCU_TP) which I soldered screw terminals to. Unfortunately, I was unable to figure out how to pull the RST pin for the wifi down. The rst pin now heads into an unlabeled chip. Luckily the code works on this board revision and I had no trouble with anything else.
Board:

Revision: 1.0
Name: C545 PBA DISPLAY_WFM50
Production date: 2021

MCU:

Manufactuer: ABOV
Model: A31G123RLN
Product Page

WiFi:

Manufactuer I&C Technonolgy
Model: WFM50-SFC201
Product Page

Front Images

Back Images

RST pin to WiFi module is Q12. One of my machines is the same model as this.

Looks like the RST might even be broken out on that MCU_TP header. Lucky you!
Thanks for this information. I might create a project wiki to contain some of this information.

Added a wiki page with this information. Thanks for the contribution.


text:
Error reference: amazon is not defined

Hey miltador, I got this bug from the chrome console

Bassically said that "amazon" is not defined
<amazon-login     [clientId]="myClientId"     (amazonAuthResponse)="onAmazonAuthResponse($event)"> </amazon-login>
But it works fine
I'm using angular 6

I notice that this bug only happens when the method amazon.Login.logout() is called

repo: miltador/angular-amazon-login


text:
Use a empty json string as json default value in python api

issue: #927

DiskANN deserialization uses a JSON config, and other index types need a default value.

repo: milvus-io/knowhere


text:
Server: Get data from PCA - Purpose

Epost fra PCA (Arild)
Hei,
Endepunktet befinner seg her:
https://staging-imf.posccaesar.org/
The SPARQL endpoint address is
https://staging-imf.posccaesar.org/dataset/sparql
Det mangler noe data der, men det kommer på mandag regner jeg med.
Mvh
Arild

Jobber i banch: feature/purpose

repo: mimir-org/typelibrary


text:
There is no posibility to switch off wordwrap

It is no way how to use "wordWrap: false" and place new lines by the '\n' charecter.
If we use  -wordWrap: false, then we get "infinity" width of textContainer. It leads to disappearing texts at all.

Hi. Can you send me an example of this? I don't see the issue when I'm testing it.
From demo/index.html
            // Wrapping and Alignment
            const wrappingText = `Global word wrap and alignment properties are controlled by the "default" style, and can\'t be overridden by other styles.`;
            const wrappingStyle = {
              default: {
                fontFamily: "Arial",
                fontSize: "24px",
                fill: "#CC6600",
                wordWrap: true,
                wordWrapWidth: 150,
                align: "right",
              },
            };
            let wrapping = new TaggedText(wrappingText, wrappingStyle, {});

            const nonWrappingText = `This one doesn't have \`wordWrap\` so it just keeps going and going and going off the edge! \nHowever, you can use line breaks to manually wrap it.`;
            const nonWrappingStyle = {
              default: {
                fontFamily: "Arial",
                fontSize: "17px",
                fill: "#669900",
                wordWrap: false, // <<<<<<<<<<<<
                wordWrapWidth: 150,
                align: "left",
              },
            };
            let nonWrapping = new TaggedText(nonWrappingText, nonWrappingStyle);
            nonWrapping.x = 30;
            nonWrapping.y = 330;

            nonWrapping.textContainer.width; // 693

Result:

Thank you for an example. If we will use align: "center" for the nonWrappingText we get an infinite textbox. And I can`t choose a width of the textContainer.

authors: mimshwright zadolbaloi

repo: mimshwright/pixi-tagged-text


text:
error occured when running "python setup.py bdist_wheel"

fail to run "python setup.py bdist_wheel"; error information is as folloews:
.....
running install_scripts
error: [WinError 5] 拒绝访问。: 'build\bdist.win-amd64\wheel\mindnlp-0.0.1.dist-info\dependency_links.txt'

This is an issue of python wheel lib.  See Building wheel from read-only source on Windows gives "Access Denied" on cleanup #327
.
The contributor claims the bug has been fixed but seems not.

authors: TTYee lvyufeng

repo: mindlab-ai/mindnlp


text:
Connect to Sense Server

I've tried to connect to Sense server but reached a point where I'm getting "Unauthorized (403)" error. Is it possible to pass credentials somehow?
Thanks!
Stefan

What's the authentication method on your server? Is the url correctly formatted, I.e make sure the slashes are correct.
When qsocks initializes it will do a GET request to the hub and if you have a active directory sso setup it will automatically sign you in (setting the correct cookie).
If you are using any other auth modules then windows there is no support for that right now.

AD is the authentication method.
What do you mean by "slashes are correct"?
Is it possible to post an example?

Ops, I forgot the most important thing facepalm
Qlik Sense has a whitelist to authorize which origins are allowed to talk websockets.
So you need to whitelist the extension origin in your proxy, origin should be
haifjhcobciacleiahcdnndlgankbdoa
But verify that by going to your extensions page in Chrome and look for the ID of the extension, that will be your origin to enter into the whitelist list in QMC. In QS 1.1 you will find it in QMC > Virtual Proxies > [Your Proxy] > Advanced

Btw, have you whitelisted your server in the proxy whitelist?
qsocks tries to connect over websockets so make sure your origin is in the list of approved hosts.

Well. So to make a long confusion short I initially thought you were raising the issue on the chrome extension SenseIt and not qsocks itself. Very stupid off me. So anyways, disregard any previous communication.
This gist contains a sample on how to authenticate a user, grab a ticket and establish the connection to the QIX engine.
https://gist.github.com/mindspank/c623e3f0bcf448093feb

That works perfect!
Thanks!

I know it's still plenty of documentation missing. I will start making some updates, I did however push a new update which now does not force you to specify /app/3%transient in the host so just fyi.
If you do build something cool feel free to share as we are in desperate need of cool stuff to show off :)

A little late but finally managed to spend some time to start building something using qsocks.bundle.js - https://github.com/countnazgul/qlik-sense-chrome-devtools-extension

authors: countnazgul mindspank

repo: mindspank/qsocks

license: mit


text:
Add Keyword Field and Refactor FieldMapper with ParameterizedFieldMapper

Description
This is an WIP towards approach 1. Adding this PR to further discuss about the format of parsing dot path notation approach for  key value pairs in keyword field.
In this PR,
-Added keyword field,
-refactor FieldMapper with ParameterizedFieldMapper
-refactor FieldMapperTest with ParameterizedFieldMapper
Next step,
To be determined to write a new parser to read context and tokenized into key-value pairs
* option 1：catalog.title=Lucene in Action
* option 2: catalog.title=Lucene, catalog.title=in, catalog.title=Action
Issues Resolved
#1018
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@lukas-vlcek Thanks for the doc!
I am able to run the plugin now. This Pr now can create the flat-object field type index, uploaded the document and search on string on the path and also search on the value.
example:
—————————Able to create "flat-object" index
curl -XPUT localhost:9200/test-index --data '{
"mappings": {
"dynamic": "strict",
"properties": {
"catalog": {
"type": "flat-object"
}
}
}
} ' -H "Content-Type:Application/json"
———————Able to search and fetch
curl 'localhost:9200/test-index0/_search?pretty' --data '{
"query": {
"match": {
"catalog": "Lucene In Action"
}
}
}
' -H "Content-Type:Application/json"
————— Able to search and fetch
curl 'localhost:9200/test-index0/_search?pretty' --data '{
"query": {
"match": {
"catalog": "title"
}
}
}
' -H "Content-Type:Application/json"
—————  Fetch result
{
"took" : 1,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : {
"value" : 1,
"relation" : "eq"
},
"max_score" : 0.2876821,
"hits" : [
{
"_index" : "test-index0",
"_id" : "1",
"_score" : 0.2876821,
"_source" : {
"catalog" : "title: Lucene in Action"
}
}
]
}
}
The next step would work on to  parse the json object into a string into "key value" pair format.

@mingshl That is nice progress!

I am currently still trying to figure out why is CI failing. There are couple of reasons but one I am focusing on now is why the FlatObjectQueryBuilder tests fail on missing geo support... (geo shouldn't be relevant at all in this case, so I expect that we need to "instruct" the abstract test cases that we inherit from) let's see if I can figure this out by tomorrow. I will give you an update.

If you feel like jumping on the JSON processing, go for it 👍

Please, just a reminder, do not forget about DCO on your commits.

Finally, I found the reason why FlatObjectQueryBuilderTests are failing due to "missing" geo_shape type.
The reason is explained here:
https://github.com/opensearch-project/OpenSearch/blob/ac322595eb1838b68e4d9a46cf97cbe56b811aed/test/framework/src/main/java/org/opensearch/test/TestGeoShapeFieldMapperPlugin.java#L44-L47
Simply put, the test will need to depend on TestGeoShapeFieldMapperPlugin plugin for now. It is known testing framework issue, hopefully it will be fixed in the future.
@mingshl I will be pushing fix for this tomorrow.

lukas-vlcek I made the KeyValueJsonXContentParser in the commit
Enable Search for each subfields so currently now can use the flat-object mapper to search for values for every subfield name and also the subfield value.
            /**
             * KeyValueJsonXContentParser does :
             * this is "value" only format for each subfield
             * parsedFields will contain {"key_path": "key", "key_value": "value"}
             */

This is the test case that I am using and it's working properly for create index, query filed name, query field value, and update docs, and query again, it's working properly.
Requesting review from @froh
Next step is to enable search for dot path.
Here is the logging that I have for testings:
----create index ---
`curl -XPUT localhost:9200/demo-flattened1 --data '{
  "mappings": {
    "properties": {
      "host": {
        "type": "flat-object"
      }
    }
  }
} ' -H "Content-Type:Application/json"`

{"acknowledged":true,"shards_acknowledged":true,"index":"demo-flattened1"}
---upload doc---
curl -XPUT localhost:9200/demo-flattened1/_doc/1 -d '{
  "message": "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
  "fileset": {
    "name": "syslog"
  },
  "process": {
    "name": "org.gnome.Shell.desktop",
    "pid": 3383
  },
  "@timestamp": "2020-03-09T18:00:54.000+05:30",
  "host": {
    "hostname": "bionic",
    "name": "bionic"
  }
}'  -H "Content-Type:Application/json"

{"_index":"demo-flattened1","_id":"1","_version":1,"result":"created","_shards":{"total":2,"successful":1,"failed":0},"_seq_no":0,"_primary_term":1}%
---check mapping --
"localhost:9200/demo-flattened1/_mapping?pretty=true"
{
  "demo-flattened1" : {
    "mappings" : {
      "properties" : {
        "@timestamp" : {
          "type" : "date"
        },
        "fileset" : {
          "properties" : {
            "name" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            }
          }
        },
        "host" : {
          "type" : "flat-object"
        },
        "message" : {
          "type" : "text",
          "fields" : {
            "keyword" : {
              "type" : "keyword",
              "ignore_above" : 256
            }
          }
        },
        "process" : {
          "properties" : {
            "name" : {
              "type" : "text",
              "fields" : {
                "keyword" : {
                  "type" : "keyword",
                  "ignore_above" : 256
                }
              }
            },
            "pid" : {
              "type" : "long"
            }
          }
        }
      }
    }
  }
}

---query on field name and field value ---
mingshl@bcd0741e226d flat-object % curl 'localhost:9200/demo-flattened1/_search?pretty' --data '{
  "query": {
    "match": {
      "host": "name"
    }
  }
}
' -H "Content-Type:Application/json"
{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 0.39556286,
    "hits" : [
      {
        "_index" : "demo-flattened1",
        "_id" : "1",
        "_score" : 0.39556286,
        "_source" : {
          "message" : "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
          "fileset" : {
            "name" : "syslog"
          },
          "process" : {
            "name" : "org.gnome.Shell.desktop",
            "pid" : 3383
          },
          "@timestamp" : "2020-03-09T18:00:54.000+05:30",
          "host" : {
            "hostname" : "bionic",
            "name" : "bionic"
          }
        }
      }
    ]
  }
}
mingshl@bcd0741e226d flat-object % curl 'localhost:9200/demo-flattened1/_search?pretty' --data '{
  "query": {
    "match": {
      "host": "bionic"
    }
  }
}
' -H "Content-Type:Application/json"
{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 0.39556286,
    "hits" : [
      {
        "_index" : "demo-flattened1",
        "_id" : "1",
        "_score" : 0.39556286,
        "_source" : {
          "message" : "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
          "fileset" : {
            "name" : "syslog"
          },
          "process" : {
            "name" : "org.gnome.Shell.desktop",
            "pid" : 3383
          },
          "@timestamp" : "2020-03-09T18:00:54.000+05:30",
          "host" : {
            "hostname" : "bionic",
            "name" : "bionic"
          }
        }
      }
    ]
  }
}

-- update doc ---
 curl -XPOST "localhost:9200/demo-flattened1/_update/1" -d'{
    "doc" : {
        "host" : {
          "osVersion": "Bionic Beaver",
          "osArchitecture":"x86_64"
        }
    }
}' -H "Content-Type:Application/json"

--- query on added sub field name --
curl 'localhost:9200/demo-flattened1/_search?pretty' --data '{
  "query": {
    "match": {
      "host": "osArchitecture"
    }
  }
}
' -H "Content-Type:Application/json"

{
  "took" : 2,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0303539,
    "hits" : [
      {
        "_index" : "demo-flattened1",
        "_id" : "1",
        "_score" : 1.0303539,
        "_source" : {
          "message" : "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
          "fileset" : {
            "name" : "syslog"
          },
          "process" : {
            "name" : "org.gnome.Shell.desktop",
            "pid" : 3383
          },
          "@timestamp" : "2020-03-09T18:00:54.000+05:30",
          "host" : {
            "hostname" : "bionic",
            "name" : "bionic",
            "osVersion" : "Bionic Beaver",
            "osArchitecture" : "x86_64"
          }
        }
      }
    ]
  }
}

@mingshl Great! I will have a look tmrw.
BTW, do you think we will need FlatObjectQueryBuilder at all? In other words, do you think the plugin will need to implement SearchPlugin interface? Wouldn't be MapperPlugin interface sufficient?

@lukas-vlcek Made another commit I made for flat multiple nested fields which should flat multiple layers, so in regarding to how many inner layer of nested JSON, it should be handed in the KeyValueJsonXContentParser.
I tested with the following nested Json documents, this is a three levels nested documents:
curl -XPOST "localhost:9200/demo-flattened1/_update/1" -d'{
    "doc" : {
        "host" : {
          "osVersion": {"versionNumber": "one",
                       "versionName": "Bionic Beaver",
                       "versionContact":{
                          "email": "bionic@opensearch.com",
                          "first name": "me"
                       }
                       },
          "osArchitecture":"x86_64"
        }
    }
}' -H "Content-Type:Application/json"

{"_index":"demo-flattened1","_id":"1","_version":2,"result":"updated","_shards":{"total":2,"successful":1,"failed":0},"_seq_no":1,"_primary_term":1}%
``
`mingshl@bcd0741e226d OpenSearch-Mingshl-2 % curl -XGET "localhost:9200/demo-flattened1/_search?pretty=true" -d'{
  "query": {
    "term": {
      "host": "bionic@opensearch.com"
    }
  }
}' -H "Content-Type:Application/json"
{
  "took" : 44,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 1.0933416,
    "hits" : [
      {
        "_index" : "demo-flattened1",
        "_id" : "1",
        "_score" : 1.0933416,
        "_source" : {
          "message" : "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
          "fileset" : {
            "name" : "syslog"
          },
          "process" : {
            "name" : "org.gnome.Shell.desktop",
            "pid" : 3383
          },
          "@timestamp" : "2020-03-09T18:00:54.000+05:30",
          "host" : {
            "hostname" : "bionic",
            "name" : "bionic",
            "osVersion" : {
              "versionContact" : {
                "first name" : "me",
                "email" : "bionic@opensearch.com"
              },
              "versionName" : "Bionic Beaver",
              "versionNumber" : "one"
            },
            "osArchitecture" : "x86_64"
          }
        }
      }
    ]
  }
}
`

In the past commits, I can achieve the following functionalities:

create an flat-object index with mapping to flatobject type
upload Json documents and mapped as string
update fields with new subfields, including nested Json subfields.
query subfield's field name under field name. for example "field name = subfield's fieldname"
query subfield's value with under field name. for example "field name = subfield's value"

But there are a couple things in my list that I didn't go through yet

[ ] 1. query through dot path. example "field name.subfield = subfield's fieldname"
[ ] 2. query with filters
[ ] 3. add normalizers

....
I am still working on the dot.path notation query, so might keep the querybuilder file until that.

Requesting review from @froh

@msfroh that is?

@mingshl wrote:

Requesting review from @froh

I think you meant @msfroh?

yes, thank you!

@lukas-vlcek I made some updates to the KeyValueJsonXContentParser so it also recognize the full path as keyword in search.
 % curl -XGET "localhost:9200/demo-flattened1/_search?pretty=true" -d'{
  "query": {
    "match": {
      "host": "host.hostname=bionic"
    }
  }
}' -H "Content-Type:Application/json"

{
  "took" : 55,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 1,
      "relation" : "eq"
    },
    "max_score" : 0.21696386,
    "hits" : [
      {
        "_index" : "demo-flattened1",
        "_id" : "1",
        "_score" : 0.21696386,
        "_source" : {
          "message" : "[5592:1:0309/123054.737712:ERROR:child_process_sandbox_support_impl_linux.cc(79)] FontService unique font name matching request did not receive a response.",
          "fileset" : {
            "name" : "syslog"
          },
          "process" : {
            "name" : "org.gnome.Shell.desktop",
            "pid" : 3383
          },
          "@timestamp" : "2020-03-09T18:00:54.000+05:30",
          "host" : {
            "hostname" : "bionic",
            "name" : "mr bionic",
            "osVersion" : {
              "versionName" : "Bionic Beaver",
              "versionNumber" : "one",
              "versionContact" : {
                "first name" : "me",
                "email" : "bionic@opensearch.com"
              }
            },
            "osArchitecture" : "x86_64"
          }
        }
      }
    ]
  }
}

But it currently creates only one stingField.
For better query performance, next step, I should make FlatObjectFieldMappers that create two fields, one field for value only and one subfield for pathAndContent.

@mingshl
I fixed a naming bug with yaml resource folder that was preventing the testcluster to find the yaml tests.
We should be able to create and run real yaml tests now!
You can use ../../gradlew clean :plugins:flat-object:yamlRestTest or you can run/debug them directly from Idea! (right-click on the yamlRestText folder and select Run and then the gradle option).
The first test that we have there (10_basic.yml) is currently failing due to interesting issue, I am 👀  at it:
[2023-02-17T02:25:30,307][INFO ][o.o.f.FlatObjectClientYamlTestSuiteIT] [test] initializing client, minimum OpenSearch version [3.0.0], cluster-manager version, [3.0.0], hosts [http://[::1]:60795, http://127.0.0.1:60796]
[2023-02-17T02:25:30,478][INFO ][o.o.f.FlatObjectClientYamlTestSuiteIT] [test] Stash dump on test failure [{
  "stash" : {
    "body" : {
      "error" : {
        "root_cause" : [
          {
            "type" : "mapper_parsing_exception",
            "reason" : "Expected map for property [fields] on field [catalog] but got a class java.lang.String",
            "stack_trace" : "MapperParsingException[Expected map for property [fields] on field [catalog] but got a class java.lang.String]

@peterzhuamazon I am trying to understand more about gradle-check.yml. It seems to be the last check that is failing on our PR. Is this check expected to work in this situation (upstream repo-clone/branch PR)? Shall we just remove this file in our case and only put it back when we move to feature branch in the upstream repo?

@mingshl
FYI, according to https://docs.github.com/en/actions/managing-workflow-runs/disabling-and-enabling-a-workflow it is possible to disable individual workflows. I am going to disable https://github.com/mingshl/OpenSearch-Mingshl/actions/workflows/gradle-check.yml
cc @peterzhuamazon

Thanks @peterzhuamazon for the suggestions.  Hi @lukas-vlcek since we are not pushing over the upstream, that's fine to remove the gradle check yml file. We will include the gradle check when we are ready to push to main.

Hi @lukas-vlcek To test the performance of flatObject, I spent some time added a new class FlatObjectMappingBenchmark,
I tested with a document with 100 nested level , each with 10 subfields, in using Dynamic Mapping, it gets exception of fields over 1000. BUT it works pretty nicely with Flat-Object Mapping.
here are some benchmark outcomes:
Benchmark                                                                   Mode  Cnt     Score    Error  Units
FlatObjectMappingBenchmark.CreateDynamicIndex                               avgt  100   255.615 ±  9.534  ms/op
FlatObjectMappingBenchmark.CreateFlatObjectIndex                            avgt  100   279.247 ±  9.157  ms/op
FlatObjectMappingBenchmark.indexDynamicMapping                              avgt  100   365.284 ± 16.736  ms/op
FlatObjectMappingBenchmark.indexFlatObjectMapping                           avgt  100   361.555 ± 14.835  ms/op
FlatObjectMappingBenchmark.searchDynamicMapping                             avgt  100   404.177 ± 17.067  ms/op
FlatObjectMappingBenchmark.searchFlatObjectMapping                          avgt  100   407.120 ± 25.673  ms/op
FlatObjectMappingBenchmark.searchFlatObjectMappingWithOneHundredNestedJSON  avgt  100  1145.303 ± 29.177  ms/op
I shall also test some edge case like 999 subfields in the future commits in using DynamicMapping and FlatObjectMapping, please expect them in the coming week.
Thanks  @dai-chen for introducing micro-benchmark tool (https://github.com/dai-chen). Requesting review from @dai-chen about this Add FlatObjectMappingBenchmark class.

Hi,
I was not aware I was tagged here as well.
But just like @mingshl mentioned I talked with here, that this PR is not send to upstream.
Therefore, the gradle check will not trigger correctly as it is missing key secrets.
Just run gradle check locally for this, and when you send the PR to upstream, it will trigger correct with no issues.
Thanks.

@lukas-vlcek  I successfully created two subfields as keyword in the new commit!!!!
The lesson learn I have is that each field would need a fieldmapper, a field type and a field. So I created the ValueFieldMapper and ValueAndPathFieldMapper, and also their field type and fields. It works nicely in the benchmarking class. Please see the new commit in detail
I think we have enough to put up a draft PR to the core. I am about to create a new PR again core as API just as we discuss in the issue.

After talking to the maintainers, because we are going to release in 2.7, we don't need a feature branch. I got the suggestions that we should start raising a pull request to the main branch. Please see the draft PR  6507 @lukas-vlcek I don't have permission at assign you, maybe you can try assign yourself in the draft PR?

Sure. We don’t need a new querybuilder, I will remove it in today’s commit.
From: Lukáš Vlček @.>
Reply-To: mingshl/OpenSearch-Mingshl @.>
Date: Tuesday, March 21, 2023 at 7:02 AM
To: mingshl/OpenSearch-Mingshl @.>
Cc: "Liu, Mingshi" @.>, Mention @.***>
Subject: Re: [mingshl/OpenSearch-Mingshl] Add Keyword Field and Refactor FieldMapper with ParameterizedFieldMapper (PR #3)
@mingshlhttps://github.com/mingshl Looking at new commits now. A real quick note - do you think you can remove binary QueryFlatObjectTests.class file? I am not sure if QueryFlatObjectTests.java file would pass style check (formatting).
—
Reply to this email directly, view it on GitHubhttps://github.com/mingshl/OpenSearch-Mingshl/pull/3#issuecomment-1477892281, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A3BBKSRTP5UTMCPU4AP7ZSDW5GYFRANCNFSM6AAAAAAUWHIDTI.
You are receiving this because you were mentioned.Message ID: @.***>

authors: froh lukas-vlcek mingshl peterzhuamazon

repo: mingshl/OpenSearch-Mingshl


text:
🛑 MineVN Maven & Resource Pack is down

In 9898fce, MineVN Maven & Resource Pack (http://app.minevn.net/pack) was down:

HTTP code: 0
Response time: 0 ms

Resolved: MineVN Maven & Resource Pack is back up in a33c921.


text:
🛑 [MineVN] Grafana is down

In f0b8b80, [MineVN] Grafana (https://grafana.minevn.net) was down:

HTTP code: 502
Response time: 3847 ms

Resolved: [MineVN] Grafana is back up in 2c4fcab after 6 minutes.


text:
🛑 MineVN Website is down

In 3e6d895, MineVN Website (http://minevn.net) was down:

HTTP code: 0
Response time: 0 ms

Resolved: MineVN Website is back up in 7d2bd1d.


text:
🛑 MineVN Website is down

In 79120b8, MineVN Website (http://minevn.net) was down:

HTTP code: 0
Response time: 0 ms

Resolved: MineVN Website is back up in 75559b8.


text:
Updates readme

Adds screenshots
Breaks down steps a little more effectively to lower barrier to entry

Snippet from Before

Snippet from After

Note: would love to add contact information to the heroku section so contributors have someone to be in touch with if need be.

I added some troubleshooting for the .env file process.

Thank you!

authors: asheren cczona hilarysk

repo: minifast/conference-opportunities


text:
TBF link type lacks proper parameter

Mininet uses GitHub issues for bug reports and feature requests only.
These issues can be viewed at bugs.mininet.org
If you have a question that is not a bug report or a feature request,
please use the documentation at docs.mininet.org, the FAQ
at faq.mininet.org, and the mininet-discuss mailing list.
For bug reports, please fill in the following information in detail,
and also feel free to include additional information such as debug
output from mn -v debug, etc.
--- Cut Here ---
Expected/Desired Behavior:
Using TBF link to limit rate and impose latency.
Actual Behavior:
Error: tbf: either "limit" or "latency" is required.
Detailed Steps to Reproduce the Behavior:
When adding the link, I use these parameters:
net.addLink('xx', 'xx', bw=500, delay='5ms', use_tbf=True)
Above error is reported.
Additional Information:
In Link.py, it seems that a default latency_ms is already specified.

In the Link.py, We will calculate the default latency via following way.
latency_ms = 15 * 8 / bw

Since the result will convert to the integer, it will be zero if bw is bigger than 200. and the "TC" command doesn't support the latency as 0.00000 ms.
@lantz
What do you think if I fix this problem just change the result of latency_ms from int to float ?
latency_ms = 15.0 * 8 / bw

If you seems that's ok, I will send a PR to fix it.

Good catch! Yeah, integer arithmetic is annoying - I think the future is in untyped numerics, but Python 2.x is what it is.

authors: Linerd hwchiu lantz

repo: mininet/mininet


text:
Switch to a non-root user

The tools image runs everything as root. This means we can't launch a container based on it in our kubernetes cluster.
Alter the image to use a non-root user. This will also require changes to the cluster build script (which assumes /root is the user's home directory), and also changes to the Dockerfile, which puts a lot of stuff into /root.

aged out as this is no longer needed.

authors: digitalronin jasonBirchall


text:
Allow user sign-in

Added exclusion for accept invitation (edit)

This looks like it fixes an issue, but are there any tests for it ? :)

Nice :balloon: merge it

authors: colinbruce dotemacs

repo: ministryofjustice/fr-staffapp


text:
BugFix Local Dev environment logger issue when using silence method

BugFix logger issue when using silence method
The silence method is used on the activesupport logger not the default rails logger.
This caused an issue locally around truelayer bank import data worker
Checklist
Before you ask people to review this PR:

[x] Tests and rubocop should be passing: bundle exec rake
[x] Github should not be reporting conflicts; you should have recently run git rebase master.
[x] There should be no unnecessary whitespace changes. These make diffs harder to read and conflicts more likely.
[x] The PR description should say what you changed and why, with a link to the JIRA story.
[x] You should have looked at the diff against master and ensured that nothing unexpected is included in your changes.
[x] You should have checked that the commit messages say why the change was made.

Codecov Report

Merging #2437 (3cbe88d) into master (bb07bf5) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##            master     #2437   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files          496       496
  Lines         9753      9753
=========================================
  Hits          9753      9753

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bb07bf5...3cbe88d. Read the comment docs.

authors: Obsiye codecov-io


text:
Rubocop: address Rails/SaveBang exclusions

What
This addresses most of the save_bang infractions
Unless we are checking the result of the call, we should use .save! rather than .save
This will raise an error and is preferred
This PR leaves two of the uses that affect a lot of other classes.
They can be addresses in separate PRs as it's likely changing draftable.rb could break tests in all the request specs
Checklist
Before you ask people to review this PR:

Tests and rubocop should be passing: bundle exec rake
Github should not be reporting conflicts; you should have recently run git rebase main.
There should be no unnecessary whitespace changes. These make diffs harder to read and conflicts more likely.
The PR description should say what you changed and why, with a link to the JIRA story.
You should have looked at the diff against main and ensured that nothing unexpected is included in your changes.
You should have checked that the commit messages say why the change was made.

Sorry, just realised this is still draft so you might not have been done. Whoops

Sorry, just realised this is still draft so you might not have been done. Whoops

No worries, the tests were still running when I logged off.  If it was successful I would have opened it for review this morning! 😄
I'm also going to run some UAT regression tests as it is not just changing spec files :+1: so it will be hanging around a bit longer than some of my rubocop PRs

Successfully run through some applications and seen no issues
I'll merge and monitor


text:
EL-1308 - fixup dualality between models and form

https://dsdmoj.atlassian.net/browse/EL-1308
What changed and why
This is a first attempt at fixing the model/form duality in CCQ - it works, but could be quite a bit neater. It's all to do with instantiating a blank form as the 'first' (which is always present in the form, but not in the model)
Checklist
Before you ask people to review this PR:

Tests and rubocop should be passing
Branch is generally up to date with main Github - definitely no conflicts
No unnecessary whitespace changes. These make diffs harder to read and conflicts more likely.
PR description says what changed and why, with a link to the JIRA story.
Diff has been checked for unexpected changes being included.
Commit messages say why the change was made.

can we make sure this is thoroughly UAT'd focussing on add another and question flow. we dont have an obvious ticket for this work.

authors: starswan willc-work


text:
Test Local Terraform Apply After OIDC Change

User Story
Before we can roll out the OIDC changes to all accounts, we need to make sure we haven't broken the way that local plans are run.
User Type(s)

Value

Questions / Assumptions / Hypothesis

Definition of done

[ ] readme has been updated
[ ] user docs have been updated
[ ] another team member has reviewed
[ ] tests are green
[ ] UR test OR added to continual research plan

Reference
How to write good user stories

https://github.com/ministryofjustice/modernisation-platform/issues/1975

authors: davidkelliott zuriguardiola


text:
Run Oracle licencing scripts for CCMS EBS (all environments)

User Story
As P&A Delivery Director, I need to understand our Oracle licencing exposure - specifically how it has changed since the migration of CCMS EBS to Modernisation platform. There is potential to be a significant increase in those costs since migration.
Tina Toor is managing the Oracle Licencing response. A call has been set up for Friday 16th June at 10 to confirm scripts and how they need the output

User Type(s)

Value
Helps us understand costs in advance or Oracle's audit towards end of year - and potentially reduce the exposure

Assumptions / Hypothesis / Questions / Unknowns
We can run the scripts that Oracle provide on EBS environments only

Definition of done

[ ] confirm scripts with Tina Toor
[ ] run scripts
[ ] provide feedback

Reference
How to write good user stories

EBS licencing is based on number of users, so we cannot do this

@


text:
Remove start option for 6dg VPN tunnel startup

Based on the advice of AWS Support, I've removed the optional field that causes AWS to initiate tunnel establishment. From their investigation of the logs, the 6DG CGW is initiating connections.
From discussion with AWS Support they stated the following:

Start: AWS initiates the IKE negotiation to bring the tunnel up. Only supported if your customer gateway is configured with an IP address. Supported if using IKEv2.

However, I'm pretty sure that we're using IKEv1 in other VPNs (eg, Nomis) so I don't know how trustworthy that statement is.

closing this as no longer appropriate


text:
Show "Worked, Pending" status

When a case is pending—but worked—then the status should be shown as "Worked, Pending" instead of Pending.
This is done through a new template called status-tag which, when passed a case, will show the status with the appropriate colour.
Fixes VEGA-866

Codecov Report

Merging #45 (dc8208b) into main (0f3061b) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #45   +/-   ##
=======================================
  Coverage   89.77%   89.77%
=======================================
  Files          22       22
  Lines         567      567
=======================================
  Hits          509      509
  Misses         31       31
  Partials       27       27

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0f3061b...dc8208b. Read the comment docs.

authors: codecov-commenter gregtyler


text:
Uml 995 twig extension

Purpose
This change implements the first part of the twig extension we need to translate pages. It adds translations for the start pages of both services
Fixes UML-995
Approach
I realised we already have access to a factory to create the translation component so that was removed.
This mostly pulls code from the twig extension that is a part of the symfony/twig-bridge package with some minor alterations to get it working with our translation packages.
Learning
The code to read twig tags is simple but quite verbose.
Checklist

[ ] I have performed a self-review of my own code
[ ] I have added relevant logging with appropriate levels to my code
[ ] I have updated documentation (Confluence/GitHub wiki/tech debt doc) where relevant
[ ] I have added tests to prove my work
[ ] The product team have tested these changes

Builds still not happening (Sorry Billy)

repo: ministryofjustice/opg-use-an-lpa


text:
:wrench: Upgrade Ruby / Alpine / KEA

This PR updates the following:

ruby:3.0.3-alpine3.13 -> ruby:3.1.2-alpine3.14
Ruby 3.0.3 -> 3.1.2
Alpine 3.13 -> 3.14
KEA 2.0 -> KEA 2.2

Such a substantial number of upgrades are required since we do not build from source i.e. we are reliant on the images available online, and associated repositories which are available for each version of Alpine. More detail below.
Why are you upgrading KEA?
The upgrade to KEA is required as when building with ruby:3.1.2-alpine3.14 and KEA 2.0 the following errors occur during build:
...
#5 18.31     required by: world[isc-kea-admin]
#5 18.31   isc-kea-ctrl-agent (no such package):
#5 18.31     required by: world[isc-kea-ctrl-agent]
#5 18.31   isc-kea-dhcp4 (no such package):
#5 18.31     required by: world[isc-kea-dhcp4]
#5 18.31   isc-kea-hook-ha (no such package):
#5 18.31     required by: world[isc-kea-hook-ha]
#5 18.31   isc-kea-hook-lease-cmds (no such package):
#5 18.31     required by: world[isc-kea-hook-lease-cmds]
#5 18.31   isc-kea-hook-stat-cmds (no such package):
#5 18.31     required by: world[isc-kea-hook-stat-cmds]
#5 18.31   isc-kea-perfdhcp (no such package):
#5 18.31     required by: world[isc-kea-perfdhcp]
...

This is because KEA 2.0 is not available in the Alpine 3.14 image.
KEA 2.2 is however available in the Alpine 3.14 image.
The changes above encapsulate the minimum number of changes we can make to upgrade the Alpine image.
Prior to merging we need to:

~further understand occasional (~80%) failures in testing leases~
understand any changes which may be needed as a result of upgrading Ruby - read the release notes between 3.0.3 and 3.1.2
understand any changes which may be needed as a result of upgrading KEA - release notes and previous commits around June/July

Tested in Dev and Pre-Prod, containers load fine and there are no errors of note in the startup. We have also tested loading new config by editing a site in Pre-Prod and watching the container reload it.


text:
Convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable

What changes were proposed in this pull request?

convert RDD[Vector]/RDD[LabeledPoint] to HomogenTable
add unit test

Does this PR also require the following changes?

CI
Documentation
Example

Thanks, could you rebase #7 and I will review it. thanks!

repo: minmingzhu/oap-mllib


text:
Trouble with running npm install command

Hello, I have been trying to install MINOS for a while, and I have been following the installation steps in the README.md. However, running npm install command inside the server directory (located at /home/mwlee/minos/minos/server in this case) under sudo -s gives the following error message.
root@doota:~/mwlee/minos/minos/server# npm install
npm ERR! code 1
npm ERR! Command failed: /usr/bin/git clone -q git://github.com/smartscenes/sstk.git /home/.npm/_cacache/tmp/git-clone-33dd48c3
npm ERR! /home/.npm/_cacache/tmp/git-clone-33dd48c3/.git: Permission denied
npm ERR!

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/.npm/_logs/2018-04-24T04_47_15_520Z-debug.log

Running the command with another sudo in front of the command gives a very long error message (more than 4000 lines), and I am not quite sure which part is relevant. The first ~170 lines of this error message is the following.
root@doota:~/mwlee/minos/minos/server# sudo npm install
npm ERR! code 1
npm ERR! Command failed: /usr/bin/git clone -q git://github.com/smartscenes/sstk.git /home/.npm/_cacache/tmp/git-clone-33dd48c3
npm ERR! /home/.npm/_cacache/tmp/git-clone-33dd48c3/.git: Permission denied
npm ERR!

npm ERR! A complete log of this run can be found in:
npm ERR!     /home/.npm/_logs/2018-04-24T04_47_15_520Z-debug.log
root@doota:~/mwlee/minos/minos/server# sudo npm install
loadDep:sstk -> resolveWi | |####################################-----------------------------------------------------------------------------------------------------------------------------------------|
npm WARN deprecated coffee-script@1.12.7: CoffeeScript on NPM has moved to "coffeescript" (no hyphen)
loadDep:node-expat -> 304 - |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDep:hoek -> resolveWi | |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDep:topo -> 304       - |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDep:punycode -> 304   - |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDep:hoek -> resolveWi / |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDep:source-map -> 304 \ |########################################-------------------------------------------------------------------------------------------------------------------------------------|
loadDevDep:pixel-diff ->  | |########################################################---------------------------------------------------------------------------------------------------------------------|
npm WARN deprecated to-iso-string@0.0.2: to-iso-string has been deprecated, use @segment/to-iso-string instead.
npm WARN deprecated jade@0.26.3: Jade has been renamed to pug, please install the latest version of pug instead of jade
npm WARN deprecated minimatch@0.3.0: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
loadDep:uuid -> cache add \ |#######################################################################------------------------------------------------------------------------------------------------------|

> node-expat@2.3.16 install /home/mwlee/minos/minos/server/node_modules/node-expat
> node-gyp rebuild

make: Entering directory '/home/mwlee/minos/minos/server/node_modules/node-expat/build'
  CC(target) Release/obj.target/expat/deps/libexpat/lib/xmlparse.o
../deps/libexpat/lib/xmlparse.c: In function ‘gather_time_entropy’:
../deps/libexpat/lib/xmlparse.c:780:7: warning: variable ‘gettimeofday_res’ set but not used [-Wunused-but-set-variable]
   int gettimeofday_res;
       ^
  CC(target) Release/obj.target/expat/deps/libexpat/lib/xmltok.o
  CC(target) Release/obj.target/expat/deps/libexpat/lib/xmlrole.o
  AR(target) Release/obj.target/deps/libexpat/libexpat.a
  COPY Release/libexpat.a
  CXX(target) Release/obj.target/node_expat/node-expat.o
  SOLINK_MODULE(target) Release/obj.target/node_expat.node
  COPY Release/node_expat.node
make: Leaving directory '/home/mwlee/minos/minos/server/node_modules/node-expat/build'

> sstk@0.5.2 postinstall /home/mwlee/minos/minos/server/node_modules/sstk
> npm run bootstrap

> sstk@0.5.2 bootstrap /home/mwlee/minos/minos/server/node_modules/sstk
> lerna bootstrap --hoist

lerna info version 2.10.2
lerna info Bootstrapping 3 packages
lerna info lifecycle preinstall
lerna info Installing external dependencies
lerna info hoist Installing hoisted dependencies into root
lerna info hoist Pruning hoisted dependencies
lerna info hoist Finished pruning hoisted dependencies
lerna ERR! execute callback with error
lerna ERR! Error: Command failed: npm install
lerna ERR! npm WARN deprecated jade@1.11.0: Jade has been renamed to pug, please install the latest version of pug instead of jade
lerna ERR! WARN engine pixel-diff@1.0.1: wanted: {"npm":">=3.0.0","node":">=4.6.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine express-csv@0.6.0: wanted: {"node":"0.6 || 0.8 || 0.10"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! npm WARN deprecated filesaverjs@0.2.2: use 'file-saver' instead
lerna ERR! WARN engine sharp@0.18.4: wanted: {"node":">=4.5.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine najax@1.0.3: wanted: {"node":">= 4.4.3"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! npm WARN deprecated coffee-script@1.12.7: CoffeeScript on NPM has moved to "coffeescript" (no hyphen)
lerna ERR! WARN engine joi@13.2.0: wanted: {"node":">=8.9.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hoek@5.0.3: wanted: {"node":">=8.9.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine topo@3.0.0: wanted: {"node":">=8.0.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine punycode@2.1.0: wanted: {"node":">=6"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hoek@5.0.3: wanted: {"node":">=8.9.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine source-map@0.7.2: wanted: {"node":">= 8"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hawk@0.10.2: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! npm WARN deprecated node-uuid@1.4.8: Use uuid module instead
lerna ERR! WARN engine hoek@0.7.6: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine boom@0.3.8: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine cryptiles@0.1.3: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine sntp@0.1.4: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hoek@0.7.6: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hoek@0.7.6: wanted: {"node":"0.8.x"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! WARN engine hawk@6.0.2: wanted: {"node":">=4.5.0"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! npm WARN deprecated constantinople@3.0.2: Please update to at least constantinople 3.1.1
lerna ERR! npm WARN deprecated transformers@2.1.0: Deprecated, use jstransformer
lerna ERR! npm WARN deprecated jscs-preset-wikimedia@1.0.1: Deprecated in favour of eslint-config-wikimedia. -- https://phabricator.wikimedia.org/T118941
lerna ERR! npm WARN deprecated minimatch@2.0.10: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
lerna ERR! npm WARN deprecated nomnom@1.8.1: Package no longer supported. Contact support@npmjs.com for more info.
lerna ERR! npm WARN deprecated jade@0.26.3: Jade has been renamed to pug, please install the latest version of pug instead of jade
lerna ERR! npm WARN deprecated to-iso-string@0.0.2: to-iso-string has been deprecated, use @segment/to-iso-string instead.
lerna ERR! npm WARN deprecated minimatch@0.3.0: Please update to minimatch 3.0.2 or higher to avoid a RegExp DoS issue
lerna ERR! WARN engine tar@3.2.1: wanted: {"node":">=4.5"} (current: {"node":"4.2.6","npm":"3.5.2"})
lerna ERR! npm WARN prefer global npm@5.8.0 should be installed with -g
lerna ERR! npm WARN prefer global jsonlint@1.6.3 should be installed with -g
lerna ERR! npm WARN prefer global node-gyp@3.6.2 should be installed with -g
lerna ERR! ../deps/libexpat/lib/xmlparse.c: In function ‘gather_time_entropy’:
lerna ERR! ../deps/libexpat/lib/xmlparse.c:780:7: warning: variable ‘gettimeofday_res’ set but not used [-Wunused-but-set-variable]
lerna ERR!    int gettimeofday_res;
lerna ERR!        ^
lerna ERR! prebuild-install WARN install No prebuilt binaries found (target=9.8.0 runtime=node arch=x64 platform=linux)
lerna ERR! In file included from ../angle/src/compiler/preprocessor/DirectiveParser.cpp:17:0:
lerna ERR! ../angle/src/compiler/preprocessor/MacroExpander.h:86:10: warning: ‘template<class> class std::auto_ptr’ is deprecated [-Wdeprecated-declarations]
lerna ERR!      std::auto_ptr<Token> mReserveToken;
lerna ERR!           ^
lerna ERR! In file included from /usr/include/c++/5/memory:81:0,
lerna ERR!                  from ../angle/src/compiler/preprocessor/MacroExpander.h:11,
lerna ERR!                  from ../angle/src/compiler/preprocessor/DirectiveParser.cpp:17:
lerna ERR! /usr/include/c++/5/bits/unique_ptr.h:49:28: note: declared here
lerna ERR!    template<typename> class auto_ptr;
lerna ERR!                             ^
lerna ERR! In file included from ../angle/src/compiler/preprocessor/MacroExpander.cpp:7:0:
lerna ERR! ../angle/src/compiler/preprocessor/MacroExpander.h:86:10: warning: ‘template<class> class std::auto_ptr’ is deprecated [-Wdeprecated-declarations]
lerna ERR!      std::auto_ptr<Token> mReserveToken;
lerna ERR!           ^
lerna ERR! In file included from /usr/include/c++/5/memory:81:0,
lerna ERR!                  from ../angle/src/compiler/preprocessor/MacroExpander.h:11,
lerna ERR!                  from ../angle/src/compiler/preprocessor/MacroExpander.cpp:7:
lerna ERR! /usr/include/c++/5/bits/unique_ptr.h:49:28: note: declared here
lerna ERR!    template<typename> class auto_ptr;
lerna ERR!                             ^
lerna ERR! In file included from ../angle/src/compiler/preprocessor/Preprocessor.cpp:14:0:
lerna ERR! ../angle/src/compiler/preprocessor/MacroExpander.h:86:10: warning: ‘template<class> class std::auto_ptr’ is deprecated [-Wdeprecated-declarations]
lerna ERR!      std::auto_ptr<Token> mReserveToken;
lerna ERR!           ^
lerna ERR! In file included from /usr/include/c++/5/memory:81:0,
lerna ERR!                  from ../angle/src/compiler/preprocessor/MacroExpander.h:11,
lerna ERR!                  from ../angle/src/compiler/preprocessor/Preprocessor.cpp:14:
lerna ERR! /usr/include/c++/5/bits/unique_ptr.h:49:28: note: declared here
lerna ERR!    template<typename> class auto_ptr;
lerna ERR!                             ^
lerna ERR! Error: Running Homebrew as root is extremely dangerous and no longer supported.
lerna ERR! As Homebrew does not drop privileges on installation you would be giving all
lerna ERR! build scripts full access to your system.
lerna ERR! /bin/sh: 1: eval: W:: not found
lerna ERR! gyp: Call to 'which brew >/dev/null 2>&1 && eval $(brew --env) && echo $PKG_CONFIG_LIBDIR || true' returned exit status 0 while in binding.gyp. while trying to load binding.gyp
lerna ERR! gyp ERR! configure error
lerna ERR! gyp ERR! stack Error: `gyp` failed with exit code: 1
lerna ERR! gyp ERR! stack     at ChildProcess.onCpExit (/home/mwlee/minos/minos/server/node_modules/sstk/node_modules/node-gyp/lib/configure.js:336:16)
lerna ERR! gyp ERR! stack     at ChildProcess.emit (events.js:180:13)
lerna ERR! gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:209:12)
lerna ERR! gyp ERR! System Linux 4.4.0-119-generic
lerna ERR! gyp ERR! command "/usr/local/bin/node" "/home/mwlee/minos/minos/server/node_modules/sstk/node_modules/.bin/node-gyp" "rebuild"
lerna ERR! gyp ERR! cwd /home/mwlee/minos/minos/server/node_modules/sstk/node_modules/sharp
lerna ERR! gyp ERR! node -v v9.8.0
lerna ERR! gyp ERR! node-gyp -v v3.6.2
lerna ERR! gyp ERR! not ok
lerna ERR! npm WARN optional Skipping failed optional dependency /chokidar/fsevents:
lerna ERR! npm WARN notsup Not compatible with your operating system or architecture: fsevents@1.2.2
lerna ERR! npm WARN sstk No repository field.
lerna ERR! npm WARN sstk No license field.
lerna ERR! npm ERR! Linux 4.4.0-119-generic
lerna ERR! npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "install"
lerna ERR! npm ERR! node v4.2.6
lerna ERR! npm ERR! npm  v3.5.2
lerna ERR! npm ERR! code ELIFECYCLE
lerna ERR!
lerna ERR! npm ERR! sharp@0.18.4 install: `node-gyp rebuild`
lerna ERR! npm ERR! Exit status 1
lerna ERR! npm ERR!
lerna ERR! npm ERR! Failed at the sharp@0.18.4 install script 'node-gyp rebuild'.
lerna ERR! npm ERR! Make sure you have the latest version of node.js and npm installed.
lerna ERR! npm ERR! If you do, this is most likely a problem with the sharp package,
lerna ERR! npm ERR! not with npm itself.
lerna ERR! npm ERR! Tell the author that this fails on your system:
lerna ERR! npm ERR!     node-gyp rebuild
lerna ERR! npm ERR! You can get information on how to open an issue for this project with:
lerna ERR! npm ERR!     npm bugs sharp
lerna ERR! npm ERR! Or if that isn't available, you can get their info via:
lerna ERR! npm ERR!     npm owner ls sharp
lerna ERR! npm ERR! There is likely additional logging output above.
lerna ERR!
lerna ERR! npm ERR! Please include the following file with any support request:
lerna ERR! npm ERR!     /home/mwlee/minos/minos/server/node_modules/sstk/npm-debug.log

I have Node v9.11.1, and npm version gives the following result.
root@doota:~/mwlee/minos/minos/server# npm version
{ 'sstk-sim': '0.5.2',
  npm: '5.6.0',
  ares: '1.13.0',
  cldr: '33.0',
  http_parser: '2.8.0',
  icu: '61.1',
  modules: '59',
  napi: '3',
  nghttp2: '1.29.0',
  node: '9.11.1',
  openssl: '1.0.2o',
  tz: '2018c',
  unicode: '10.0',
  uv: '1.19.2',
  v8: '6.2.414.46-node.23',
  zlib: '1.2.11' }

If there are other information I would need to provide, or if I would have to raise this issue in npm repository instead, please let me know.

@lionminhu Thank you for trying out MINOS.
The log indicates the issue is with permissions during git cloning of the dependencies.  There should be no need to run any of the installation steps using sudo.  Can you confirm whether you installed nvm and run npm install under a regular user account, not using sudo?  If you perform all the installation steps from beginning to end without elevating to a sudo user there should be no issue like the one you see.

@lionminhu Besides the permissions issues, at the end of the log it looks like you might also be missing a package for building one of the dependencies. In Ubuntu you can install necessary packages for building all dependencies using sudo apt-get install build-essential libxi-dev libglu1-mesa-dev libglew-dev libvips.

Uninstalling and reinstalling nvm and rerunning npm install without sudo seems to have worked successfully. I installed libvips package, which was the only one missing, according to your advice.
I have yet to check that everything works after installing the SUNCG/Matterport3D data set, but since npm install part is settled, I will close this issue now.
Thank you for your help.

authors: lionminhu msavva

repo: minosworld/minos


text:
Use clippy to find the leftover todo!()s

As per discussion in #809.
Had to change some existing code to make it pass, the idea is to establish the following convention:

Use todo! for short-term todos that are supposed to be fixed in the current PR.
Use unimplemented! for stuff that is not implemented and will stay unimplemented beyond the current PR.

This is what you get if there are still todo!s in the code:
https://github.com/mintlayer/mintlayer-core/actions/runs/4616271887

repo: mintlayer/mintlayer-core


text:
3.0.0 setting button language is invalid

I used the new version of 3.0.0 to set the button language according to the following code, but in order to take effect, the demo you provided is valid. Is there anything to be configured in the project?
code
Future scan() async {
try {
var options = ScanOptions(
strings: {
"cancel": "取消",
"flash_on": "开启",
"flash_off": "关闭",
},
restrictFormat: selectedFormats,
useCamera: _selectedCamera,
autoEnableFlash: _autoEnableFlash,
android: AndroidOptions(
aspectTolerance: _aspectTolerance,
useAutoFocus: _useAutoFocus,
),
);
  var result = await BarcodeScanner.scan(options: options);

  // setState(() => scanResult = result);
} on PlatformException catch (e) {
  var result = ScanResult(
    type: ResultType.Error,
    format: BarcodeFormat.unknown,
  );

  if (e.code == BarcodeScanner.cameraAccessDenied) {
    setState(() {
      result.rawContent = 'The user did not grant the camera permission!';
    });
  } else {
    result.rawContent = 'Unknown error: $e';
  }
  // setState(() {
    // scanResult = result;
  // });
}

}

I'm sorry, but I don't understand your problem. Please provide more details about the actual and the expected behavior.


text:
[免测]fix constructor problem #523

提交pr时需要关联issue，请大家遵守
#523
1、升级点 （清晰准确的描述升级的功能点）

将获取元素属性等操作移到 connectedCallback

2、影响范围 （描述该需求上线会影响什么功能）
3、自测 checklist
4、需要覆盖的场景和case

[ ] 是否覆盖了sf打开mip页
[ ] 是否验证了极速服务mip页面效果

5、自测机型和浏览器

[ ] 是否覆盖了ios系统手机
[ ] 是否覆盖了安卓系统手机
[ ] 是否覆盖了iphone版式浏览器（比如qq、uc、chrome、safari、安卓自带浏览器）
[ ] 是否覆盖了手百

确认免测


text:
Prepare v0.10

Fixes #81 .

thanks, merged as #86

authors: hannesm yomimono

repo: mirage/charrua-core

license: ISC


text:
Irmin as a PouchDB/CouchDB replacement?

Hey guys!
Hope it's ok to put questions like these in an issue, I've found no other means of communication.
I work in a team using OCaml/ReScript, and we're considering Irmin as a solution for collaborative editing. We want (maybe to different degrees): collaborative editing, version history, and two-way replication between browsers and the server.
So my question is: how feasible it is to use Irmin in the browser today. Is it production-ready? And more specifically:

Do you know if you can compile Irmin with ReScrit(formerly BuckleScript)? I've only seen mentions of JSOO.
Is there a ready-made backend for LocalStorage/IndexedDB, or do we have to write it ourselves? Nevermind, found talex5/irmin-indexeddb
What about two-way replication between the browser and the server? Will we have to write the replication layer too?

@hoichi thanks for the interest. I'd suggest short-circuiting a back and forth on this issue to have a quick video chat to discuss what you'd like to do, and then circle back and summarise the findings in this issue.  Browser support has long been on our roadmap, and we've had prototypes, but it's been awaiting a serious user before committing to it. And here you are :-)
If you could drop me a mail on anil@recoil.org, I'll connect to the right Irmin/Mirage developers.

authors: avsm hoichi

repo: mirage/irmin

license: isc


text:
Import files from previous layers iteration; add FIXMEs

FIXMEs mark where we need to integrate with the new IO
This is a draft pull request just to mark the branch where I try to merge the new IO with the old layers.
NO NEED FOR REVIEW AT THE MOMENT!

Codecov Report

Merging #1924 (2779406) into main (9137b76) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1924   +/-   ##
=======================================
  Coverage   64.53%   64.53%
=======================================
  Files         125      125
  Lines       14710    14710
=======================================
  Hits         9493     9493
  Misses       5217     5217

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

Is this PR still relevant? If not we should close it :-)

Closed as no longer relevant.

authors: codecov-commenter samoht tomjridge


text:
Rewrite auth to hooks without changing its functionality

I want to merge this change because...

PR intended to be tested with API branch:
Screenshots

Pull Request Checklist

[ ] All visible strings are translated with proper context.
[ ] All data-formatting is locale-aware (dates, numbers, and so on).
[ ] Translated strings are extracted.
[ ] Number of API calls is optimized.
[ ] The changes are tested.
[ ] Type definitions are up to date.
[ ] Changes are mentioned in the changelog.

Test environment config

API_URI=https://master.staging.saleor.rocks/graphql/

Task linked: CU-6a5vxr Dashboard: use refresh token to re-generate expired JWT token

authors: orzechdev patrys

repo: mirumee/saleor-dashboard


text:
Where do I throw in the configuration for Stripe, Paypal, etc?

The readme (https://saleor.readthedocs.io/en/latest/payments.html) is very lacking, I don't know what files I am suppose to edit. Can I be shown the right direction? Also the readme I linked could use a bit of an improving.

I have figured it out with intensive grepping that it goes into the settings.py file (shocker)
With that said, docs should still be updated.

repo: mirumee/saleor


text:
Initial work on adding data loaders

⚠ Work in progress!
This is an initial implementation with some basic data loaders. You can test them by fetching the pricing information of products and their variants.
Pull Request Checklist

[ ] Privileged views and APIs are guarded by proper permission checks.
[ ] All visible strings are translated with proper context.
[ ] All data-formatting is locale-aware (dates, numbers, and so on).
[ ] Database queries are optimized and the number of queries is constant.
[ ] Database migration files are up to date.
[ ] The changes are tested.
[ ] GraphQL schema and type definitions are up to date.
[ ] Changes are mentioned in the changelog.

Here is the report for e68e5e642c72d80cc334959bed5bdf9918a849f7 (patrys/saleor @ introduce-data-loaders)
Base comparison is 89ca7b6182761e6e41887d794a40c582390f87a7.
**Found 6 differences!** (click me)

# api.benchmark category
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
- category view                              	         23	         57	             24

# api.benchmark checkout
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
- add billing address to checkout            	         34	         35	             20
  add shipping to checkout                   	          7	          7	              0
  checkout payment charge                    	         10	         10	              0
  complete checkout                          	          8	          8	              0
  create checkout                            	          5	          5	              1

# api.benchmark collection
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
- collection view                            	         21	         55	             22

# api.benchmark homepage
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
  featured products list                     	         20	         20	              0
  retrieve main menu                         	          8	          8	              0
  retrieve product list                      	          6	          6	              0
  retrieve secondary menu                    	          8	          8	              0
  retrieve shop                              	          2	          2	              0
- user checkout details                      	         53	         54	             28

# api.benchmark product
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
- product details                            	         17	         18	              3
- retrieve product attributes                	          9	         11	              3

# api.benchmark variant
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
  product variant bulk create                	         51	         51	              3
  retrieve variant list                      	         23	         23	              9

# api product sorting attributes
  test name                                  	left count 	right count	duplicate count
  -------------------------------------------	-----------	-----------	---------------
  sort product not having attribute data     	         21	         21	              0

authors: django-queries patrys


text:
Introduce CSP policies for GraphQL Playground

img-src:

allow usage of data: due to playground using inline SVG files
allow loading of favicon and playground logo

script-src and style-src: allow loading of the external resources but require SHA256 checksum to match, otherwise they are to be rejected
connect-src:

(breaking change) only allow full URL for /graphql/ endpoint based on the current server location (HTTP host) - note: relative paths are not allowed in CSP

External sources: always use HTTPS, HTTP should never be used due to security risks

I want to merge this change because...

Impact

[ ] New migrations
[ ] New/Updated API fields or mutations
[ ] Deprecated API fields or mutations
[ ] Removed API types, fields, or mutations
[ ] Documentation needs to be updated

Pull Request Checklist

[ ] Privileged queries and mutations are guarded by proper permission checks
[ ] Database queries are optimized and the number of queries is constant
[ ] Database migration files are up to date
[x] The changes are tested
[ ] GraphQL schema and type definitions are up to date
[ ] Changes are mentioned in the changelog

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

authors: CLAassistant NyanKiyoshi


text:
🛑 Catalogue is down

In f470e88, Catalogue (https://catalogue.apprentissage.beta.gouv.fr/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Catalogue is back up in e5783b0.

repo: mission-apprentissage/upptime


text:
build on 5.16.1+ fails

Heya,
this widget doesn't seem to be building on 5.16.1+, due to jquery not being loaded correctly.
I'd suggest you remove the duplicate jquery versionsin your lib (you seem to have jquery.js and jquery-1.11.2.min.js) and replace them with the jquery from this pull request:
https://github.com/mendix/AppStoreWidgetBoilerplate/pull/13
That version omits the string in the define on line 10307.
If you change all dependencies to that jquery version you should be ok. AFAICT that's only jquery.jplayer.js
Let me know if there's anything else I can do to help :)
--
Achiel

I have include your suggestion but i am running into this error
404 - file not found for file: mxclientsystem/jquery.js

I have used your suggestion but i am running into this error.
404 - file not found for file: mxclientsystem/jquery.js

You also need to update jquery.jplayer.js to point to that jquery. You'll need to use a full path.

v3.0.1 fixes has your suggests and fixes deployment issues.Click Link for details

Thanks!

authors: Achiel mistaguy

repo: mistaguy/AudioVideoPlayBack


text:
Sheet breaking attributes line in Tidy5e

Currently, i found that adding a new skill is breaking the attributes line, as its adding space between them and not adding to the width that the character sheet opens in. Its something minor, but it can be a bother sometimes.
With the added skill:

Without the added skill:

If help you, I've solved it like this for the moment:
Tidy version: 0.8.41
custom version: 1.2.0
D&D5e version: 2.1.5
waiting for updates


text:
ClassNotFoundException when compile some apps with extensions

Some users have reported on the forum that they cannot compile apps containing the BLE extension. When an error is given, it is a ClassNotFoundException involving the BLE extension, so somehow we are either not placing the extension's classes.jar file on the path or Kawa is failing to find it.

Indeed, by my report on Forums, most of my extensions get this issue!

Is this only worth extensions that use BLE?

No this happens to any kind of extensions at random occasions.

By saying random occasions that doesnt mean sometimes you can compile app and sometimes not. By random occasions, I mean, some extensions don't get this, while others do

I have noticed this as well when testing. At least when running against the buildserver on my local machine, it looks like it is failing roughly every other build. It ought to be deterministic in the file contents, so there's some issue to uncover in the compiler code.

What I know, when I downloaded AppyBuilder sources and tried to make an extension, didnt ran into any issues. Also, what did find out (from ant extensions log) is that, there is issue either in extension packaging process or compiler (path analyzation process). I will check that this weekend again

And I will give you more details about that. We should check @Hossein's distro's extension packaging part and also compiler process part.

is there any progress on the topic? Having the same issue still.

repo: mit-cml/appinventor-sources


text:
Box score tuning

Hi!
How should one interpret (and tune) the box-score parameter used in the visualization?
I understand it does not directly map to confidence, but it's used similarly I guess.

This is used to suppress duplicate predictions. I guess NMS with threshold 0 will also work. Generally we adjust this value such that the visual quality of our demo looks best.

Closed due to inactivity.

authors: carlinds kentang-mit

repo: mit-han-lab/bevfusion


text:
Exception on certain convolution configurations

Related to https://github.com/mit-han-lab/torchsparse/issues/16
I think this is a bug. If not, a clearer error message might be helpful.
Both of these test cases raise the same exception:
import torchsparse
import torchsparse.nn
import torch

def test(coords, stride):
    feat_depth_in = 3
    feat_depth_out = 1
    kernel_size = 2
    feats = torch.randn(len(coords), feat_depth_in).to(torch.float32)
    inputs = torchsparse.SparseTensor(feats, coords)
    conv = torchsparse.nn.Conv3d(
        feat_depth_in, feat_depth_out, kernel_size=kernel_size, stride=stride
    )
    conv(inputs)

coords = torch.Tensor(
    [
        [76, 74, 4, 0],
        [77, 74, 4, 0],
        [76, 75, 4, 0],
        [76, 74, 5, 0],
        [77, 75, 4, 0],
        [76, 75, 5, 0],
        [77, 74, 5, 0],
        [77, 75, 5, 0],
    ]
).to(torch.int32)

test(coords, 2)
test(coords[:1], 1)

backtrace:
ValueError                                Traceback (most recent call last)
<ipython-input-2-ebdce6b86d44> in <module>
     31     ]
     32 ).to(torch.int32)
---> 33 test(coords, 2)

<ipython-input-2-ebdce6b86d44> in test(coords, stride)
     16         feat_depth_in, feat_depth_out, kernel_size=kernel_size, stride=stride
     17     )
---> 18     conv(inputs)
     19
     20

~/miniconda3/lib/python3.8/site-packages/torch/nn/modules/module.py in _call_impl(self, *input, **kwargs)
    887             result = self._slow_forward(*input, **kwargs)
    888         else:
--> 889             result = self.forward(*input, **kwargs)
    890         for hook in itertools.chain(
    891                 _global_forward_hooks.values(),

~/miniconda3/lib/python3.8/site-packages/torchsparse/nn/modules/conv.py in forward(self, inputs)
     70
     71     def forward(self, inputs):
---> 72         return conv3d(inputs,
     73                       self.kernel,
     74                       kernel_size=self.kernel_size,

~/miniconda3/lib/python3.8/site-packages/torchsparse/nn/functional/conv.py in conv3d(inputs, kernel, kernel_size, bias, stride, dilation, transpose)
    116             hash_target = sphash(coords)
    117             idx_query = sphashquery(hash_query, hash_target)
--> 118             idx_query = list(convert_neighbor_map_gpu(idx_query))
    119             idx_query[1] = idx_query[1].to('cpu')
    120             sizes = (features.shape[0], new_coords.shape[0])

~/miniconda3/lib/python3.8/site-packages/torchsparse/nn/functional/convert_neighbor_map.py in forward(ctx, neighbor_map)
      7     @staticmethod
      8     def forward(ctx, neighbor_map):
----> 9         idx_batch, idx_point = torch.where(neighbor_map != -1)
     10         if 'cuda' in str(neighbor_map.device):
     11             map_converted = torchsparse_backend.convert_map_forward(

ValueError: not enough values to unpack (expected 2, got 1)

Hi, I encountered the same error as @noahstier, and I solved the problem by reshaping neighbor_map. I add neighbor_map = neighbor_map.reshape(neighbor_map.shape[0], -1) in convert_neighbor_map.py and it seems to work.

Could you try the latest version to see whether the error is still there? Thanks!

I don't get this error any more with 1.4.0

@-

Hi, I encountered the same error as @noahstier, and I solved the problem by reshaping neighbor_map. I add neighbor_map = neighbor_map.reshape(neighbor_map.shape[0], -1) in convert_neighbor_map.py and it seems to work.

It works. Thanks :)

authors: chendaozai jokester-zzz noahstier zhijian-liu

repo: mit-han-lab/torchsparse


text:
Unexported identifiers are not factored into hashing

func TestUnexportedFields(t *testing.T) {
	type str struct {
		v string
	}

	k1 := str{"123"}
	k2 := str{"456"}

	v1, _ := hashstructure.Hash(k1, nil)
	v2, _ := hashstructure.Hash(k2, nil)

	if v1 == v2 {
		t.Errorf("cache collision: %d vs %d", v1, v2)
	}
}

Expected: nothing
Actual: cache collision: 15609384054371896546 vs 15609384054371896546
This was surprising and unexpected. If this is intended behavior I suggest updating the documentation and considering making this an option.

Indeed, this is documented here as the first note: https://godoc.org/github.com/mitchellh/hashstructure#Hash
Go reflection can't see unexported fields unless you're in the same package (makes sense!) so hashstructure can't even see that they exist to make hashing decisions on them. To hashstructure it just looks like type str struct {}!

Ah, sorry for missing that. Maybe worth calling out in the readme too? I was expecting it to behave like reflect.DeepEqual.

authors: dpup mitchellh

repo: mitchellh/hashstructure


text:
Disable debug in policy.toml for hardware mode

Description
Disable debug in policy.toml for hardware mode
policy.toml generation (build time)
The makefile will generate a policy with allow_debug=false when SGX_MODE = HW, and allow_debug=true when SGX_MODE = SW.
You can override this using the POLICY_ALLOW_DEBUG flag. (true/false)
Enclave startup (runtime)
The enclave will start on debug mode if it was compiled with SGX_MODE = SW, and will start in non-debug mode if it was compiled with SGX_MODE = HW.
You can override this behavior using the ENCLAVE_DEBUG_MODE runtime environment variable. (true/false)
Docs
This should be documented somewhere. POLICY_ALLOW_DEBUG / ENCLAVE_DEBUG_MODE are not exactly user-facing (I don't expect any normal user to use them) but they are useful for contributors.
We may want to create a contributor section in the gitbook, what do you think?
Related Issue
Closes #25
Type of change

[x] This change requires a documentation update
[ ] This change affects the client
[x] This change affects the server
[ ] This change affects the API
[ ] This change only concerns the documentation

How Has This Been Tested?
Using the SGX vps, and locally. I don't really know if we should write a test for this (what would it look like?)
Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings
[ ] I have updated the documentation according to my changes

Writing a test would be useless for this. I'll review ASAP but I like your changes so far

I have rebased the branch

authors: JoFrost cchudant

repo: mithril-security/blindai


text:
Documentation for using mitmproxy as a library

Hi, I really need to use mitmproxy as a library other that write scriptlet for mitmproxy, but I can't find any documentation on that, and the examples in the examples folder seems to be buggy and lack of update.
Thanks for your attention!

Hi @yifeikong!
Thanks for raising this issue - the mitmproxy is a always a work-in-progress and there are still undocumented corners. Could you maybe briefly explain what you want to do, and why you really need to mitmproxy as library? Maybe a regular script using mitmproxy hooks is enough for your use case?

My use case is that I need to build a long-running-proxy to intercept some responses and store the responses in a database. First, I tried to write a scriptlet for mitmdump, but it seems that mitmdump stops working and hangs for no reason after a day or two. So I figured I could use mitmproxy as a library and write my own daemon process so that I could add my own logic of when to restart the proxy. I searched the web for using mitmproxy as a library, and saw some outdated articles talking about libmproxy or libmitmproxy, but nothing works.

First, I tried to write a scriptlet for mitmdump,

Assuming that you are talking about mitmproxy addons/scripts, this is the recommended approach. If you have problems with long-running processes, that'd be a bug. If you need to work around that, I'd recommend some external montoring/restarting on top of mitmproxy.

authors: Kriechi mhils yifeikong

repo: mitmproxy/mitmproxy


text:
Port canvas_integration django app from mitodl/edx-platform

Subtask of #3
Depends on #7, #6
What needs to be done?
This task will include the effort to port all the Canvas Integration-related code that should/can be moved into a plugin.
The plugin should be created in a way to be supported by edX platform itself. For creating edX extension plugins a good read could be this guide and this utility repo. Following the edX standards, we can make sure that our plugins work with edX without any issues.
Acceptance Criteria:

[x] Migrate all the canvas_integration Django app code into the open-edx-plugins inside /src directory (Parallelly this part will be removed from edx-platform as part of #6)
[x] Setup all the configurations in the app to be pip installable within edX-platform
[x] Setup the BUILD files to generate proper app releases for migrated canvas_integration Django app

Closed via #8

repo: mitodl/open-edx-plugins


text:
Accepted techniques remain in the list

I have found some solutions for the error already mentioned in some other issues and TRAM is finally starting now and rendering the text in the analyze procedure.
Unfortunately suggested techniques remain in the list even after I accepted them. When I reject a technique it's being removed from the list, but when I accept it, it will be added to the Positives again and again so there are multiple entries and the original suggestion remains in the list. So I am not able to complete the review and all the reports remain in the "needs review" list.

This is because the database will always add a new entry - no matter what - when you press these buttons. Statuses beyond 'Needs Review' are never used anyway (at time of writing). I've raised #86 and the tagged PR (in that issue's description) fixes both of these (duplicate confirmed entries and using statuses).
If the duplicate entries are really bugging you, one thing I can suggest is adding this small snippet in rest_svc.py, at the beginning of the true_positive() method (at time of writing, around line 67)
async def true_positive(self, criteria=None):
    existing = await self.dao.get('report_sentence_hits', dict(uid=criteria['sentence_id'], attack_uid=criteria['attack_uid']))
    if existing:
        return
    <rest of method>

authors: jecarr timoliciouz

repo: mitre-attack/tram


text:
Provider orders' basic functionality - Copy to a new order

[ ] Adapt frontend to create a new Order (POST) with same description, provider company and order lines of currently active order.

Issue metrics:

Real time: 20 mins (0,33 hours).
Code lines (for each technology):

Angular: +8, -8.
Spring: +0, -0.

repo: miw-upm/betca-tpv


text:
Can't build with latest version 3.0.0

Integration Method: Cocoapods
Xcode Version: 7.3.1
Library Version: 3.0.0
Platform: iOS
Device: Simulator
Description: When build with version 3.0.0, the compiler gives error "definition of 'Mixpanel' must be imported from module 'Mixpanel.Mixpanel' before it is required My project is Objective-C
Expected Behavior: When i revert back to 2.9.9, everything is fine.

Hi @namanhams Can you please post the contents of your bridging header?

Can you confirm that you have #import <Mixpanel/Mixpanel.h> in that same file that you're receiving the error? Although the error looks like it might be from the module system. Are you instead using @import Mixpanel;?
Otherwise I think it must be an issue with your project configuration. I created a new clean project in Objective-C and integrated v3.0.0 of the CocoaPod. I'm able to build and send events. I attached the sample project in hopes that it might help you figure out what setting is wrong in your project.
MixpanelCocoaPod300.zip

I follow the instruction and do "#import "Mixpanel.h" instead. But this works fine for 2.9.9. It just doesn't work for 3.0.0. I'll clean and try again and let you know

Did this resolve your issue?

I'm facing the same issue, i just updated my pod and now it's not working with 3.0.0

@hamdullahshah Can you please open a new issue and fill out the template so we can keep each issue focused?

@samgreen I was having the same issue, because I was importing #import "Mixpanel.h. Changing to @import Mixpanel; fixed it.

Marking issue as resolved.

authors: hamdullahshah namanhams natanrolnik samgreen

repo: mixpanel/mixpanel-iphone


text:
track_links is broken on  tags without href

If you have a placeholder link that does not have a href (Example), then the behaviour of track_links is broken.
Without track_links, clicking that link in most browsers does nothing.
If you call track_links on a placeholder link, then clicking the link refreshes the page.

Thanks for the report @pfhayes. Looks like event_handler and after_track_handler need to handle this case (https://github.com/mixpanel/mixpanel-js/blob/7078b29da8baccdbfe6a3707fb36a920bd1cf9a8/src/mixpanel-core.js#L1597-L1617). The typical use case for track_links is to ensure that tracking calls go out before the browser unloads the current page, so the case of using it on anchor tags without href hasn't come up before. We'll get a patch out soon, but Pull Requests are welcome if you can't wait!

We have the same issue. Any update?

An  without an href is inherently un-clickable and only represents a placeholder of a link.
From w3:
If the a element has no href attribute, then the element represents a placeholder for where a link might otherwise have been placed, if it had been relevant.

Close?

FYI, this is happening with anchor links to. e.g. seomthing

authors: dblN emmanueljohn1 eric-blue pfhayes tdumitrescu

repo: mixpanel/mixpanel-js


text:
Add info about Expo development client in README

To run this app with Expo, you apparently need to have development builds set up (if you do not want to eject). I had to read https://github.com/mixpanel/mixpanel-react-native/issues/82 to figure that out
I suggest this should be added to the README to make it clear for people who use Expo

thanks @elmaxe  for bringing it up, added here

authors: elmaxe zihejia

repo: mixpanel/mixpanel-react-native


text:
provide a directive to bundle ocaml modules

the motivation is to help distribute software in some cases, so that I only need throw one file, no need build system for some simple cases
#bundle(file1,file2,file3)
---->
module rec File1 : sig #include "file1.mli" end = struct #include "file1.ml" end
....

I don't see how to implement this with a macro, even if cppo supported variadic macros, so okay, it makes sense to have this as a built-in.
I don't have much time at the moment. If you want to contribute it's great. Check out https://github.com/mjambon/documents/blob/master/how-to-contribute.md

authors: bobzhang mjambon

repo: mjambon/cppo