text:
Use Case Example with 2x 3090ti - Great job on this devs!

I wanted to share a quick demonstration of a home use case for this that I made: https://youtu.be/tiQpw50lKjU
Great job and thanks very much for releasing this for local use! I did a quick bit of testing with this on a more consumer spec machine and figured I would share for those of us who are interested in running this but only have one or two 24gb cards available to use. I am very excited about the future of this technology and am glad to have a way to generate videos, even if they are short, without having to sign up for a paid subscription service online.

Hello, I am also using 2x3090. Do you use torchrun or gradio for forward inferencing, or by "scripts/inference.py"? I'm always running failedly with out of memory, or I can only call 1 GPU. Can you give me some advice? I'm looking forward to hearing from you soon!

Hello, I am also using 2x3090. Do you use torchrun or gradio for forward inferencing, or by "scripts/inference.py"? I'm always running failedly with out of memory. Can you give me some advice? I'm looking forward to hearing from you soon!

Hello, I am also using 2x3090. Do you use torchrun or gradio for forward inferencing, or by "scripts/inference.py"? I'm always running failedly with out of memory, or I can only call 1 GPU. Can you give me some advice? I'm looking forward to hearing from you soon!

I am using torchrun without apex and flash-attn. I tried the single command for inference:
python scripts/inference.py configs/opensora-v1-2/inference/sample.py \
  --num-frames 4s --resolution 720p \
  --layernorm-kernel False --flash-attn False \
  --prompt "a beautiful waterfall"

And could not get it to work. I also could not get gradio to work as it said out of memory when trying to start the gradio app. Since "sequence parallelism is not supported for gradio deployment" I did not really try any troubleshooting with the gradio app since I wanted to use both cards.
The command I ended up successfully using is:
CUDA_VISIBLE_DEVICES=0,1 torchrun --nproc_per_node 2 scripts/inference.py configs/opensora-v1-2/inference/sample.py   --num-frames 4s --resolution 240p --aspect-ratio 1:1   --layernorm-kernel False --flash-attn False   --prompt "create a video of a car driving down a road."
Keep in mind I did not have apex or flash-attn so I disabled them with:  --layernorm-kernel False --flash-attn False \
I tried going above 240p and would run out of memory. I also kept the aspect ratio at 1:1 because it worked for my case and I didn't want to risk messing anything up. I am not an expert by far, but if you still have issues and want to paste the error message I will take a look at it to see if it is anything I struggled with.

I think 3090 has limited GPU RAM and thus only low resolution videos can be generated. I will close this issue for now since it looks inactive. Feel free to re-open it if you have any further questions.

CUDA_VISIBLE_DEVICES=0,1 torchrun --nproc_per_node 2 scripts/inference.py configs/opensora-v1-2/inference/sample.py   --num-frames 2s --resolution 360p --aspect-ratio 9:16   --prompt "a beautiful waterfall"
OOM

repo: hpcaitech/Open-Sora


text:
Bug: Monitoring

scope of testing:
https://trello.com/c/yOMuCoYa

Is this ready for review? @rajuAhmed1705

@johannesvedder, except for the task with the intervention mismatch problem. everything is solved. I actually cannot create a study without an intervention task. So, I'm trying to figure out the other way around.

@johannesvedder, except for the task with the intervention mismatch problem. everything is solved. I actually cannot create a study without an intervention task. So, I'm trying to figure out the other way around.

This used to be possible in the past and we might need to re-enable this again in order to allow washout phases, as long as we have the adaptive schedule alternative. So you can revert this commit if you would like.

@johannesvedder, except for the task with the intervention mismatch problem. everything is solved. I actually cannot create a study without an intervention task. So, I'm trying to figure out the other way around.

This used to be possible in the past and we might need to re-enable this again in order to allow washout phases, as long as we have the adaptive schedule alternative. So you can revert this commit if you would like.

#671

source: gharchive/pull-request

repo: hpi-studyu/studyu

license: MIT

license_type: permissive

license_source: github-api


text:
456 basic exhibitiontool

Closes #456

Don't forget to scroll up, I have reopened some comments by @olschulz

authors: MariusDoe rheaSPK


text:
Presentation: Demo

Vorstellung soll 10 Minuten einnehmen. Der Fokus soll auf neuen Features liegen, die zu Zwischenpräsentation noch nicht gezeigt wurden (Gruppen, Permissions, Bilder, Warteliste).
Mit einer Art Rollenspiel könnten die Features anschaulich und realistisch demonstriert werden.
Der Kunde hat den expliziten Wunsch geäußert, dass mit realistischen Items demonstriert wird. Also nicht 'Beispielbuch 1', sondern echte Bücher, Filme und Spiele, mit korrekt gepflegten Eigenschaften.

Preparation
We need two separate users, one using the laptop U1, one using the phone U2, both connected using chrome devtools.
Prepare localhost instead of production version in case HPI internet fails.
Create 2 to 3 realistic items with real data.
Groups

Create Group G (U1)
Edit item I permissions so that new group G can manage(U1)
Add User U2 to Group (U1)
Show updated permissions for item I (U2)
Edit item permissions so that new group G can only lend(U1)
Show updated permissions for item I (U2)

New lending process features

Reserve Item (U2)
Join Waitlist (U1)
Lend and return item (U2)
Show Autoreservation caused by waiting list (U1)
Freeze Item (U1)
Show notifications in between

Other features ?

Search Filters
New pages
CSV export
Analytics

Rollen:
MobileUser WiMi
MobileUser oder PCUser Studi
PCUser ProfessorDr
Narrator?!
Konzeption (nicht Ablauf!):
Man richtet die Lehrstuhlgruppe (ChairGroup) ein, dazu gehört der ProfessorDr und der WiMi, diese hat borrowing Rechte auf den Spielen
Man richtet die Lehrstuhlverwaltungsgruppe (ChairMgmtGroup) ein, dazu gehört der ProfessorDr, diese hat managing Rechte auf den Spielen & Büchern
Item, welches von der Lehrstuhlgruppe geliehen werden kann: Werwolf
Item, welches von allen geliehen werden kann (everyone): Design Patterns
Ablauf: ProfessorDr erstellt die beiden Items & druckt deren QR Codes aus (Geschieht alles im Voraus, die Items werden am Anfang gezeigt). Everyone hat view Rechte auf Werwolf. Everyone hat Borrowing Rechte auf Design Patterns.
On Screen: ChairGroup erstellen & WiMi hinzufügen; ChairGroup erhält Borrowing Rechte auf Werwolf (sonst keiner)
Zeigen: Studi kann Werwolf nicht ausleihen.
WiMi leiht sich Werwolf aus.
Item Freeze & Reservierung & Management Rechte
ProfessorDr richtet die ChairMgmt Gruppe ein und transferiert Management Rechte an den beiden Items an die Gruppe.
WiMi möchte in die ChairMgmt wird in die ChairMgmt Gruppe aufgenommen werden.
WiMi freezed nun das Design Patterns Buch.
Der Studi kann es sich nicht mehr ausleihen und landet auf der Warteliste.
WiMi unfreezed Design Patterns.
Studi hat automatisch die Reservierung für Design Patterns.
WiMi versucht Design Patterns auszuleihen und landet auf Warteliste.
Studi scannt QRCode und leiht Design Patterns aus.
Studi gibt Design Patterns zurück, WiMi hat Reservierung auf Design patterns.
WiMi returniert Werwolf.
Setup:
Gruppen:
Items:
	Buch1:
		name: Design Patterns. Elements of Reusable Object-Oriented Software.
		ISBN: 978-0201633610
		Autor: Erich Gamma, Richard Helm, Ralph E. Johnson, John Vlissides
		Erscheiningsdatum: 01.07.197
		Genre: IT, Sachbuch
		Sprache: Englisch
		Seitenzahl: 395
		Verlag: Prentice Hall
		Edition: 1
	Spiel1:
		name: Werwölfe von Düsterwald
		beschreibung:  Die Werwölfe von Düsterwald Der kommunikative Gesellschaftsspiel-Klassiker  Auf einer zerklüfteten Hochebene des Hunsrücks liegt das kleine Dorf Düsterwald. Seit einiger Zeit wird das Dorf jede Nacht von Werwölfen heimgesucht; jede Nacht geschieht ein Verbrechen und ein Dorfbewohner fällt den Werwölfen zum Opfer.  Die Dorfbewohner versuchen herauszufinden, wer unter ihnen zu den Werwölfen gehört, bevor sie alle verschwinden!  Die Werwölfe von Düsterwald ist ein sehr kommunikatives und interaktives Kartenspiel für größere Runden oder Partys.
		Autor: des Pallières, Philippe
		Verleger: Asmodee
		Jugendfreigabe: 10
		Spielerzahl: 8-18
		Spieldauer: 20-40
		Sprache: Deutsch

nur eine Chair Gruppe erstellen
zusätzlich ein neues Item: das ist bereits von Student ausgeliehen, am Ende zeigt Studi dass er Overdue-Notification bekommen hat → gibt sein noch ausgeliehenes Item per Owner Return an WiMi zurück
ganz am Ende schaut sich Prof. die History des Design Pattern Buchs an

Prep:

Prof erstellt Spiel mit Everyone-View Permission und Buch mit Everyone-Borrow Permission
Ausleihen für Buch erstellen, welche später in History auftauchen

Ablauf:

N: befinden uns am HPI, am Lehrstuhl Intelligente Systeme von Prof. Johanna Schlimme — der Lehrstuhl kämpft seit Jahren damit dass ausgeliehene Objekte nicht organisiert und zurückgegeben werden können; damit ist nun Schluss! denn Prof hat das neue Tool "Bookkeeper Portal Red" aufgesetzt - schauen wir doch mal rein
Prof: Cool, das Einstellen vom Design Pattern Buch und Werwolf Spiel war echt einfach. Sieht so aus als kann das noch keiner ausleihen, dazu muss ich jetzt wohl eine Gruppe erstellen.
[Prof erstellt Gruppe "Intelligente Systeme" und fügt Wimi hinzu]
Tony: Hey Johanna, ich habe gesehen dass unser Design Patterns Buch ausgeliehen werden kann. Ich hab ein cooles Bild, könntest du mich als Manager hinzufügen damit ich das ändern kann? Außerdem würde ich gern Werwolf ausleihen.
Prof: Ja klar, dann gebe ich einfach dem Lehrstuhl die Management Rechte für das Buch und allen aus dem Lehrstuhl die Rechte um Werwolf auszuleihen.
[Prof editiert Buch und fügt Chair Gruppe mit Management Permission hinzu]
[Prof editiert Spiel und fügt Chair Gruppe mit Borrow Permissions hinzu]
Tony: Cool, dann leih ich mir das Spiel direkt aus.
[Tony scannt Spiel Code und leiht Spiel aus]
Tony: Dann füge ich hier das Bild hinzu
[Tony fügt Bild hinzu]
Tony: Oh, nur noch eine Woche bis zur Klausur, dann freeze ich doch mal das Buch – die Studis sind ja sicher schon bestens vorbereitet 😈
[Tony freezed Buch]
N: Es begibt sich nun, dass der bestens vorbereitete Studi Tim nun feststellt, dass die Klausur in einer Woche ist. Er hat nun erhöhtes Interesse an Lehrmaterial und möchte das Buch ausleihen.
Tim:

Im Kundengespräch kam nochmal der Wunsch, dass bei der Demo die ganze App ein wenig mit Leben gefüllt ist. Das heißt es wäre cool, wenn ihr zusätzlich zu den 2 Items, die wir für die Demo benutzen, 3-4 weitere Items (mit echten Daten und Bildern) in der App rumliegen habt und vielleicht auch noch 1 oder 2 Gruppen dazu passende Gruppen.

Falls ihr den Localhost benutzt, gibt es gerade noch einen Bug beim scannen vom item, der gerade gefixt wird: #399

source: gharchive/issue

authors: DefineDan MaxSpeer konrad-gerlach richartkeil


text:
Calling convention run-time check failure

The following program encounters a run-time failure:
#include <SFML\Window.hpp>
#include <glbinding\gl\gl.h>
#include <glbinding\Binding.h>

using namespace gl;

int main(int argc, const char* argv[])
{
    sf::Window window(sf::VideoMode(640, 480), "GLBinding Test");

    glbinding::Binding::initialize();
    glClearColor(0.0f, 0.5f, 0.8f, 1.0f);
   // truncated
}

With the error message:

Run-Time Check Failure #0 - The value of ESP was not properly saved across a function call.  This is usually a result of calling a function declared with one calling convention with a function pointer declared with a different calling convention.

Which occurs on line 71 of Function.hpp and the call stack for the error originates from the glClearColor call:
template <typename... Arguments>
struct FunctionHelper<void, Arguments...>
{
    void call(const glbinding::Function<void, Arguments...> * function, Arguments&&... arguments) const
    {
        // truncated
        if (function->isEnabled(glbinding::CallbackMask::After))      // line 71
            function->after(functionCall);
    }
};

The toolchain used to build the library:

VS 2013 Version 12.0.30723.00 Update 3
CMake 3.0.2

The same tools were used to build SFML and GLEW which have no issues with the same program.

I can confirm this is still broken on x86. x86-64 build is fine.

We currently tried to reproduce this error on our windows machines and it didn't pop up.
This issue is over one year old; can anyone confirm the issue is still there in the current master?

I re-validated my claims on VS2015.1 x86:
The commit before the ac049cc2d8ec9de837f496ff569a8bbc180c499b fix (7f063b2fe6baaaf03ba505132d8969bddaf09a5) has the mismatched stack diagnostic as reported.
A build of ac049cc2d8ec9de837f496ff569a8bbc180c499b does not exhibit the reported problem.
Current master (b838090719a72207c020025b24a26fa9cf34fbbe) does not exhibit the reported problem.

Currently we don't plan to fix this issue in glbinding 1.1 (c031b7f0830146519dad9451a60a764c41cacfb8) branch and since it cannot be reproduced for 2.0 the issue will be closed for now (@julkw tested x86 builds with Qt, GLFW, and GLEW on Windows). However, should the issue emerge again, especially for SFML, please re-open.

authors: abadd cgcostume imallett scheibel zao

repo: hpicgs/glbinding

license: mit

license_source: bigquery


text:
.net根据hprose服务方法名查询相关信息

在已知服务方法名的基础上，根据方法名获取服务方法所在的类对象，类型，该方法对应的Attribute的对象信息

好的，记下来，2.0 的时候加上这个功能。

3.0 中可以通过 Service.Get 方法来获取，参数是方法名和参数个数（参数个数计数不包含Context参数在内）

authors: WildShooter andot

repo: hprose/hprose-dotnet


text:
性能问题，cpu过高30+%

代码在public class TcpHandler : IHandler --> private async Task Send(Stream netStream, ConcurrentQueue<(int index, Stream stream)> responses)  ---> while (!responses.TryDequeue(out response))
这句话从队列取值，会一致循环，实际上客户端并不是在请求，没有数据加入队列，是否应该改进检测到请求再循环，
比如使用SemaphoreSlim 这个信号量判断？

看到了maser分支和3.0分支的代码是有区别的了，我再测试一下

master分支测试正常


text:
distribute binaries

start with 64bit linux / python 3.7/8/9

https://github.com/pypa/manylinux#readme

https://discuss.python.org/t/manylinux2010-docker-image-now-available/1471

https://opensource.com/article/19/2/manylinux-python-wheels

https://uwekorn.com/2019/09/15/how-we-build-apache-arrows-manylinux-wheels.html

docker run -it quay.io/pypa/manylinux2010_x86_64:latest bash


text:
can not download pretrained model

i can not download the pretrained model,is it my problem or the author have not  published yet

i can not open the url provided by author ,is there a baiduyunpan link

Hi, the link has been added. The models can also be downloaded from here, extraction code: f5dz.

authors: xiaodingkun-git zeduchen

repo: hqucv/siamban


text:
#159 filter selfnode from nodeslist

Re:
https://github.com/hseeberger/constructr/issues/159
This will filter the selfnode from the list of nodes received and warn if it's encountered.
I'm not sure if this is the prettiest approach but I tested and it does work. This is a fairly easy scenario to produce. Using a fixed ip address, If we shutdown the old nodes and then try to start up again nodes can see the selfnode while other nodes are acquiring the lock and trying to start up
[WARN][17:43:10.907][d.h.c.ConstructrMachine][C:] - Selfnode received in list of nodes Set(akka.tcp://testcartCluster@10.102.3.6:2756). Will filter to prevent forming an island.
[WARN][17:43:10.908][d.h.c.ConstructrMachine][C:] - Couldn't acquire lock, going to GettingNodes
[WARN][17:43:10.909][d.h.c.ConstructrMachine][C:] - Selfnode received in list of nodes Set(akka.tcp://testcartCluster@10.102.3.6:2756). Will filter to prevent forming an island.
[WARN][17:43:10.910][d.h.c.ConstructrMachine][C:] - Couldn't acquire lock, going to GettingNodes

The filtering is done in the retrieve section which is significant - the node will be filtered before determining if there are nodes or not. The implication is that if only the self node exists, it will attempt to lock if the only node is selfNode as it would be filtered.

This is another great example for a nasty corner case when we allow the cluster to be formed more than once.

authors: hseeberger jasongoodwin

repo: hseeberger/constructr


text:
Docs: Add link to deployed Jupyter Book in README and in the project sidebar

It would be great if from the README there was a link to the deployed build of the Jupyter Book. Additionally if that URL could get added as the "website" metadata in the "repository details" section on the sidebar of the landing page that would be great.

I need to get back to finish writing this. (It's not even remotely done.)

Yeah, this wasn't intended as a "why isn't this done" ping. More that people like me would be interested to see this in the "getting developed" stages as you build it.

Done: I've now verified that the GitHub Pages are being built correctly and I've included a link from the README to the first page.
So far, the converted part includes lesson-1-introduction from the CoDaS-HEP lectures. lesson-2-issues will be a large part of what remains, and lesson-3-project is just a project description. I don't know what/how much of lesson-4-architectures to do, but I'll make a decision about that when I get to it.

authors: jpivarski matthewfeickert


text:
Планирование — залог успеха

Александр, привет!
Комментарии написала в телегу.

:mortar_board: Планирование — залог успеха

Просто замечу на будущее, что хранение дампов БД на сервере это небезопасно, т.к. роботы в сети постоянно сканируют все возможные адреса: db.sql, dump.sql, schema и т.п. с тем чтобы скачать и получить доступ к данным.
Такое допустимо, сам такое иногда делаю, но надо быть аккуратным =)

authors: lula-may webmayak


text:
Add Eq instance for Uri

Now targeting master.

Successor to https://github.com/http4s/http4s/pull/1672


text:
3.06版本执行用例后无法生成测试报告？

问题描述
安装了3.06版本，startproject 创建了一个文件模板。
模板的文件夹少了一个testsuits。 执行testcases里面的例子成功后，无法在reports文件夹生成测试报告。
版本信息
请提供如下版本信息：

操作系统类型: [Windows10]
Python 版本 [e.g. 3.7.1]
HttpRunner 版本 [e.g. 3.06]

@canhingbo 默认不生成 html 报告，你可以结合 pytest-html 或 allure 插件来生成报告。使用方法参考 pytest

authors: canhingbo debugtalk

repo: httprunner/httprunner


text:
Resolves #14: add splitter

no split
storages:
  local:
    type: local
    keep: 2
    path: /tmp/demo

2022/12/04 22:23:03 [Model: demo] WorkDir: /tmp/gobackup513879139/1670221383827497238/demo
2022/12/04 22:23:03 [Database] => database | postgresql: postgresql
2022/12/04 22:23:03 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/04 22:23:03 [PostgreSQL] dump path: /tmp/gobackup513879139/1670221383827497238/demo/postgresql/postgresql/demo.sql
2022/12/04 22:23:03 [Database] Dump succeeded
2022/12/04 22:23:03 [Compressor] => Compress | xz
2022/12/04 22:23:03 [Compressor] -> /tmp/gobackup513879139/1670221383827497238/2022.12.04.22.23.03.tar.xz
2022/12/04 22:23:03 [Storage] => Storage | local
2022/12/04 22:23:03 [Local] Store succeeded /tmp/demo/2022.12.04.22.23.03.tar.xz
2022/12/04 22:23:03 [Model] Cleanup temp: /tmp/gobackup513879139/

encrypt + split
encrypt_with:
  type: openssl
  password: 123456
  salt: false
split_with:
  chunk_size: 1k
storages:
  local:
    type: local
    keep: 2
    path: /tmp/demo

2022/12/04 22:23:19 [Model: demo] WorkDir: /tmp/gobackup619301606/1670221399175830369/demo
2022/12/04 22:23:19 [Database] => database | postgresql: postgresql
2022/12/04 22:23:19 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/04 22:23:19 [PostgreSQL] dump path: /tmp/gobackup619301606/1670221399175830369/demo/postgresql/postgresql/demo.sql
2022/12/04 22:23:19 [Database] Dump succeeded
2022/12/04 22:23:19 [Compressor] => Compress | xz
2022/12/04 22:23:19 [Compressor] -> /tmp/gobackup619301606/1670221399175830369/2022.12.04.22.23.19.tar.xz
2022/12/04 22:23:19 [Encryptor] => Encrypt | openssl
2022/12/04 22:23:19 [Encryptor] -> /tmp/gobackup619301606/1670221399175830369/2022.12.04.22.23.19.tar.xz.enc
2022/12/04 22:23:19 [Splitter] Split to chunks
2022/12/04 22:23:19 [Splitter] Split done
2022/12/04 22:23:19 [Storage] => Storage | local
2022/12/04 22:23:19 [Local] Store succeeded /tmp/demo/2022.12.04.22.23.19
2022/12/04 22:23:19 [Model] Cleanup temp: /tmp/gobackup619301606/

$ tree /tmp/demo/2022.12.04.22.23.19
/tmp/demo/2022.12.04.22.23.19
├── 2022.12.04.22.23.19.tar.xz.enc-000
└── 2022.12.04.22.23.19.tar.xz.enc-001

0 directories, 2 files

split
split_with:
  chunk_size: 1k
storages:
  local:
    type: local
    keep: 2
    path: /tmp/demo

2022/12/04 22:23:42 [Model: demo] WorkDir: /tmp/gobackup1587917345/1670221422525536828/demo
2022/12/04 22:23:42 [Database] => database | postgresql: postgresql
2022/12/04 22:23:42 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/04 22:23:42 [PostgreSQL] dump path: /tmp/gobackup1587917345/1670221422525536828/demo/postgresql/postgresql/demo.sql
2022/12/04 22:23:42 [Database] Dump succeeded
2022/12/04 22:23:42 [Compressor] => Compress | xz
2022/12/04 22:23:42 [Compressor] -> /tmp/gobackup1587917345/1670221422525536828/2022.12.04.22.23.42.tar.xz
2022/12/04 22:23:42 [Splitter] Split to chunks
2022/12/04 22:23:42 [Splitter] Split done
2022/12/04 22:23:42 [Storage] => Storage | local
2022/12/04 22:23:42 [Local] Store succeeded /tmp/demo/2022.12.04.22.23.42
2022/12/04 22:23:42 [Cycler] Removed 2022.12.04.22.23.03.tar.xz
2022/12/04 22:23:42 [Model] Cleanup temp: /tmp/gobackup1587917345/

cycler removes directory
2022/12/04 22:23:50 [Model: demo] WorkDir: /tmp/gobackup3877017112/1670221430758204064/demo
2022/12/04 22:23:50 [Database] => database | postgresql: postgresql
2022/12/04 22:23:50 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/04 22:23:50 [PostgreSQL] dump path: /tmp/gobackup3877017112/1670221430758204064/demo/postgresql/postgresql/demo.sql
2022/12/04 22:23:50 [Database] Dump succeeded
2022/12/04 22:23:50 [Compressor] => Compress | xz
2022/12/04 22:23:50 [Compressor] -> /tmp/gobackup3877017112/1670221430758204064/2022.12.04.22.23.50.tar.xz
2022/12/04 22:23:50 [Splitter] Split to chunks
2022/12/04 22:23:50 [Splitter] Split done
2022/12/04 22:23:50 [Storage] => Storage | local
2022/12/04 22:23:50 [Local] Store succeeded /tmp/demo/2022.12.04.22.23.50
2022/12/04 22:23:50 [Cycler] Removed 2022.12.04.22.23.19/2022.12.04.22.23.19.tar.xz.enc-000
2022/12/04 22:23:50 [Cycler] Removed 2022.12.04.22.23.19/2022.12.04.22.23.19.tar.xz.enc-001
2022/12/04 22:23:50 [Cycler] Removed 2022.12.04.22.23.19/
2022/12/04 22:23:50 [Model] Cleanup temp: /tmp/gobackup3877017112/

encrypt + split
2022/12/06 01:16:00 [Model: demo] WorkDir: /tmp/gobackup3216602163/1670318160386036422/demo
2022/12/06 01:16:00 [Database] => database | postgresql: postgresql
2022/12/06 01:16:00 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/06 01:16:00 [PostgreSQL] dump path: /tmp/gobackup3216602163/1670318160386036422/demo/postgresql/postgresql/demo.sql
2022/12/06 01:16:00 [Database] Dump succeeded
2022/12/06 01:16:00 [Compressor] => Compress | xz
2022/12/06 01:16:00 [Compressor] -> /tmp/gobackup3216602163/1670318160386036422/2022.12.06.01.16.00.tar.xz
2022/12/06 01:16:00 [Encryptor] => Encrypt | openssl
2022/12/06 01:16:00 [Encryptor] -> /tmp/gobackup3216602163/1670318160386036422/2022.12.06.01.16.00.tar.xz.enc
2022/12/06 01:16:00 [Splitter] Split to chunks
2022/12/06 01:16:00 [Splitter] Split done
2022/12/06 01:16:00 [Storage] => Storage | gcs
2022/12/06 01:16:00 [GCS] timeout: 5m0s
2022/12/06 01:16:00 [GCS] -> Uploading backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000 (0 MiB)...
2022/12/06 01:16:01 [GCS] Duration 1 second 323 milliseconds, rate 1.0 MiB/s
2022/12/06 01:16:01 [GCS] -> Uploading backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001 (0 MiB)...
2022/12/06 01:16:02 [GCS] Duration 371 milliseconds 284 microseconds, rate 1.0 MiB/s
2022/12/06 01:16:02 [Storage] => Storage | scp
2022/12/06 01:16:02 [SCP] -> scp to /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:16:02 [SCP] Store /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000 succeeded
2022/12/06 01:16:02 [SCP] -> scp to /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:16:02 [SCP] Store /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001 succeeded
2022/12/06 01:16:02 [SCP] Store succeeded
2022/12/06 01:16:02 [Storage] => Storage | ftp
2022/12/06 01:16:04 [FTP] -> Uploading...
2022/12/06 01:16:04 [FTP] Store /ftp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000 succeeded
2022/12/06 01:16:04 [FTP] Store /ftp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001 succeeded
2022/12/06 01:16:04 [FTP] Store succeeded
2022/12/06 01:16:04 [Storage] => Storage | oss
2022/12/06 01:16:04 [OSS] endpoint: oss-cn-hangzhou.aliyuncs.com
2022/12/06 01:16:04 [OSS] bucket: backups
2022/12/06 01:16:04 [OSS] -> Uploading backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000...
2022/12/06 01:16:04 [OSS] Duration 262 milliseconds 374 microseconds
2022/12/06 01:16:04 [OSS] -> Uploading backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001...
2022/12/06 01:16:05 [OSS] Duration 203 milliseconds 196 microseconds
2022/12/06 01:16:05 [Storage] => Storage | local
2022/12/06 01:16:05 [Local] Store succeeded /tmp/demo/2022.12.06.01.16.00
2022/12/06 01:16:05 [Storage] => Storage | s3
2022/12/06 01:16:05 [AWS S3] -> Uploading (0 MiB)...
2022/12/06 01:16:06 [AWS S3] => https://s3.ap-northeast-1.wasabisys.com/wasabi2022/backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:16:06 [AWS S3] => s3://wasabi2022/backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:16:06 [AWS S3] Duration 1 second 173 milliseconds, rate 1.0 MiB/s
2022/12/06 01:16:06 [AWS S3] -> Uploading (0 MiB)...
2022/12/06 01:16:07 [AWS S3] => https://s3.ap-northeast-1.wasabisys.com/wasabi2022/backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:16:07 [AWS S3] => s3://wasabi2022/backups/demo/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:16:07 [AWS S3] Duration 872 milliseconds 280 microseconds, rate 1.0 MiB/s
2022/12/06 01:16:07 [Model] Cleanup temp: /tmp/gobackup3216602163/

no encrypt + no split
2022/12/06 01:17:12 [Model: demo] WorkDir: /tmp/gobackup3821008951/1670318232866336281/demo
2022/12/06 01:17:12 [Database] => database | postgresql: postgresql
2022/12/06 01:17:12 [PostgreSQL] -> Dumping PostgreSQL...
2022/12/06 01:17:13 [PostgreSQL] dump path: /tmp/gobackup3821008951/1670318232866336281/demo/postgresql/postgresql/demo.sql
2022/12/06 01:17:13 [Database] Dump succeeded
2022/12/06 01:17:13 [Compressor] => Compress | xz
2022/12/06 01:17:13 [Compressor] -> /tmp/gobackup3821008951/1670318232866336281/2022.12.06.01.17.13.tar.xz
2022/12/06 01:17:13 [Storage] => Storage | ftp
2022/12/06 01:17:15 [FTP] -> Uploading...
2022/12/06 01:17:15 [FTP] Store /ftp/2022.12.06.01.17.13.tar.xz succeeded
2022/12/06 01:17:15 [FTP] Store succeeded
2022/12/06 01:17:15 [Storage] => Storage | oss
2022/12/06 01:17:15 [OSS] endpoint: oss-cn-hangzhou.aliyuncs.com
2022/12/06 01:17:15 [OSS] bucket: backups
2022/12/06 01:17:15 [OSS] -> Uploading backups/demo/2022.12.06.01.17.13.tar.xz...
2022/12/06 01:17:15 [OSS] Duration 400 milliseconds 65 microseconds
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/
2022/12/06 01:17:15 [Storage] => Storage | local
2022/12/06 01:17:15 [Local] Store succeeded /tmp/demo/2022.12.06.01.17.13.tar.xz
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:15 [Cycler] Removed 2022.12.06.01.16.00/
2022/12/06 01:17:15 [Storage] => Storage | s3
2022/12/06 01:17:15 [AWS S3] -> Uploading (0 MiB)...
2022/12/06 01:17:17 [AWS S3] => https://s3.ap-northeast-1.wasabisys.com/wasabi2022/backups/demo/2022.12.06.01.17.13.tar.xz
2022/12/06 01:17:17 [AWS S3] => s3://wasabi2022/backups/demo/2022.12.06.01.17.13.tar.xz
2022/12/06 01:17:17 [AWS S3] Duration 1 second 351 milliseconds, rate 1.0 MiB/s
2022/12/06 01:17:17 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:17 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:18 [Cycler] Removed 2022.12.06.01.16.00/
2022/12/06 01:17:18 [Storage] => Storage | gcs
2022/12/06 01:17:18 [GCS] timeout: 5m0s
2022/12/06 01:17:18 [GCS] -> Uploading backups/demo/2022.12.06.01.17.13.tar.xz (0 MiB)...
2022/12/06 01:17:20 [GCS] Duration 1 second 896 milliseconds, rate 1.0 MiB/s
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/
2022/12/06 01:17:21 [Storage] => Storage | scp
2022/12/06 01:17:21 [SCP] -> scp to /tmp/scp/2022.12.06.01.17.13.tar.xz
2022/12/06 01:17:21 [SCP] Store /tmp/scp/2022.12.06.01.17.13.tar.xz succeeded
2022/12/06 01:17:21 [SCP] Store succeeded
2022/12/06 01:17:21 [SCP] -> remove /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-000
2022/12/06 01:17:21 [SCP] -> remove /tmp/scp/2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/2022.12.06.01.16.00.tar.xz.enc-001
2022/12/06 01:17:21 [SCP] -> remove /tmp/scp/2022.12.06.01.16.00
2022/12/06 01:17:21 [Cycler] Removed 2022.12.06.01.16.00/
2022/12/06 01:17:21 [Model] Cleanup temp: /tmp/gobackup3821008951/

@huacnlee not WIP anymore.

repo: huacnlee/gobackup


text:
可以去掉框架集成的node-scss

Windows环境下开发，安装node-scss较为繁琐，部分项目不使用scss，建议从框架中去掉，或者做成可插拔的形式。

通过this.setStyleLoaderOption({sass: false}) 禁用

authors: hubcarl z-ak

repo: hubcarl/egg-vue-webpack-boilerplate


text:
🛑 Akkoma is down

In cc1b467, Akkoma (https://akkoma.chez.chat) was down:

HTTP code: 404
Response time: 523 ms

Resolved: Akkoma is back up in 29c207a after 9 minutes.

repo: hufman/upptime


text:
🛑 Akkoma is down

In 92635d7, Akkoma (https://akkoma.chez.chat) was down:

HTTP code: 404
Response time: 481 ms

Resolved: Akkoma is back up in 24c0583.


text:
Documentation Enhancements

[x] - Document missing APIs
[x] - Enhance Example Section in Document
[x] - Categorize Extensions based on groups (Suggestions on the group order is welcome)
[x] - Fix minor formatting issues
[x] - Release manager script with Calendar Verison and Micro release support.

Note: There are still a few more sanic classes that need API documentation. I will go ahead and create a different PR for them.

@ahopkins @vltr @yunstanford I just added a basic Release management script that can automatically manage calendar version with micro-release support. I am working on adding change log support for it. I would really appreciate it if you guys could take a look and provide a feedback on that script.

Will do. I also want to make some edits to the README, and the intro page. I was thinking I'd do a separate PR, but maybe I will commit to this one.

@ahopkins Great. Let me know if there is something I can add to the README from my side to simplify your work.

awesome, thanks!

I have some docs to add myself to Sanic (so I can close #1329), but I think I'll just wait yours to be merged first because, well, it's almost like a complete overhaul :muscle:

Since you're in the vibe ... Have you seen that there's different installation instructions in the project's README and in the docs?

Nice!! This is awesome! Thanks, @harshanarayana !

cool, good improvement.

@harshanarayana Can you update this branch due to conflicts? will approve and merge in if no one objects.

authors: ahopkins harshanarayana pypycoder vltr yunstanford

repo: huge-success/sanic


text:
support: invalid cache through rpc

Change-Id: I3fe18cd8c893a84a56fb66df651b78c5e0fe5f4b

Cassandra/Scylla ci error:

HBase ci error:

repo: hugegraph/hugegraph


text:
rustdoc of hub.md fails on windows

Hi! I'm going deeper into simple documentation tests and I seem actually liked investigating it
The initial problem was when I tried to run mdbook test on the candle-book crate.
So the problem boiled down to running
cd candle-book
cargo build
rustdoc .\src\inference\hub.md --test -L ..\target\debug\deps\

Then we got the linker error
Couldn't compile the test.
---- .\src\inference\hub.md - Using_the_hub::Using_in_a_real_model_ (line 50) stdout ----

error: linking with `link.exe` failed: exit code: 1181
//very long chain of linking
 = note: LINK : fatal error LNK1181: cannot open input file 'windows.0.48.5.lib'

---- .\src\inference\hub.md - Using_the_hub (line 12) stdout ----

error: linking with `link.exe` failed: exit code: 1181
//very long chain of linking
 = note: LINK : fatal error LNK1181: cannot open input file 'windows.0.48.5.lib'

The strange thing is that the code in the test is actually compiles and runs outside of doc tests.
The toolcahain is

stable-x86_64-pc-windows-msvc (default)
rustc 1.72.0 (5680fa18f 2023-08-23)

Just to mention that these commands worked well on my linux box (though with cd cargo-book -> cd candle-book) so pretty tricky to reproduce the issue here I'm afraid as I don't have access to a windows box.

It took took me couple days to figure out how the linking works, so basically some of the native libraries are located in different directories, so you have to pass them as an argument for linker as well.
This command should now correctly run tests for the docs on windows with msvc toolchain:
mdbook test -L ..\target\debug\deps\ -L native= %USERPROFILE%\.cargo\registry\src\index.crates.io-
\n6f17d22bba15001f\windows_x86_64_msvc-0.42.2\lib -L native= %USERPROFILE%\.cargo\registry\src
\index.crates.io-6f17d22bba15001f\windows_x86_64_msvc-0.48.5\lib

Wow that must have been a pain to dig out. Maybe you could add an entry to the Common Errors section of the readme in case anyone else also runs into this?

Sounds good, sure

authors: LaurentMazare Ssslakter

repo: huggingface/candle


text:
Opus DGT added

Dataset : http://opus.nlpl.eu/DGT.php

merging since the CI is fixed on master

repo: huggingface/datasets


text:
Perform minor refactoring

Perform minor refactoring related to config.

@lhoestq is there a problem in the master branch? I got a segmentation fault...
tests/test_table.py::test_concatenation_table_cast[in_memory] Fatal Python error: Segmentation fault

Oh wow. Let me re-run the CI just to make sure

Hmm interesting, the segfault is still there. I'm investigating this issue on my windows machine

Feel free to merge master into this branch to fix the CI :)

authors: albertvillanova lhoestq


text:
Check if dataset features match before push in DatasetDict.push_to_hub

Fix #4211

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

authors: HuggingFaceDocBuilderDev mariosasko


text:
Update godotrl.mdx with the model export and application

Added my experience regarding the model export and applying the model back to the game.

Thanks for this new section, that can be quite useful for the students I merge it 🤗

authors: JiaqiHe simoninithomas

repo: huggingface/deep-rl-class


text:
feat: add styles for RTL

Allow styling Docs for Arabic(ie RTL)

Gently Pinging @mishig25

repo: huggingface/doc-builder


text:
Provide user manual download for "hf_hub_download " when "hf_hub_download" does not work

Is your feature request related to a problem? Please describe.
I'm always frustrated when "hf_hub_download" does not work. As you know, in many countries or regions, network connection are so strange that the python download tool can never see hugging face hub files, while user can always have other ways (wget, git clone, scp) to download the file properly. This makes users like me very confused, and we cannot enjoy the powerful open pretrained models/datasets and other resources elegantly, stepping away from hf toolchains.
Describe the solution you'd like
In Microsoft/vcpkg, which is a tool to download and install cmake dependencies, when something to be download does not work, the vcpkg will tell the user which url and which target disk location it is trying to download, then the user can utilize their own way to download that file. Running the tool again, the code would see the file is integral and continue to the next steps. I think this design is very execellent.
Now I am changing the codes of hugging face or other libraries that call  "hf_hub_download " to manually load the pytorch file that I've downloaded, because I have to use debug to see the parameters of hf_hub_download, and the cache of hf_hub_download  is not transparent, it changes over versions, I cannot fill the cache properly to make a successful download.
Describe alternatives you've considered
solve the problem from the root:  why the requesting method that hf is using does not work, but git clone and wget work? for example, I can git clone from "https://huggingface.co/timm/swin_base_patch4_window7_224.ms_in22k_ft_in1k/tree/main", but I cannot call cached_safe_file = hf_hub_download(repo_id='timm/swin_base_patch4_window7_224.ms_in22k_ft_in1k', filename='model.safetensors', revision=None) .
Additional context
Add any other context or screenshots about the feature request here.

the cache of hf_hub_download is not transparent, it changes over versions, I cannot fill the cache properly to make a successful download.

@2catycm I am sorry you are running into such issues. Changing the cache system would be difficult on our side as it is already widely used and is based on a particular structure and symlinks to efficient save disk space (see cache explanation). I can assure that the cache system is not evolving over versions (it did once 18 months ago but has not changed ever since). That being said, it is true that for a given URL we know before-hand exactly where the file will be stored in the cache. Would it be helpful to you if a debug message is logged like "Will download file from https://... and save it to 'path/to/disk'" ? And if download fails you can always checks the logs to retrieve this exact message.

for example, I can git clone from "https://huggingface.co/timm/swin_base_patch4_window7_224.ms_in22k_ft_in1k/tree/main", but I cannot call cached_safe_file = hf_hub_download(repo_id='timm/swin_base_patch4_window7_224.ms_in22k_ft_in1k', filename='model.safetensors', revision=None)

I'd be curious to know what error you are encountering here. What is the exact error? Could you copy-paste the stacktrace?
Just in case it might help, it is possible to pass resume_download=True to hf_hub_download (and many more HF-tools) which will check if you already tried to download the file and resume where it stopped. This might help you if you are struggling to download files.

Closing this issue as we've got no news for 6 weeks. Feel free to reopen if needed.


text:
Switch text loading to multi-threaded PyArrow loading

Test if we can get better performances for large-scale text datasets by using multi-threaded text file loading based on Apache Arrow multi-threaded CSV loader.
If it works ok, it would fix #546.

Awesome !
Also I was wondering if we should try to make the hashing of the data_files faster (it is used to build the cache directory of datasets like text or json). Right now it reads each file and hashes all of its data. We could simply hash the path and some metadata including the last updated tag no ? Apparently we can get this tag with os.path.getmtime(path)

I just rebased from master to include the hashing changes from #573

I think this is ready to merge, no?

Indeed it's ready to merge :)

Ok added the breaking change info and we can merge indeed.

authors: lhoestq thomwolf

repo: huggingface/nlp


text:
Fix onnx export preprocessors save

Bug introduced in https://github.com/huggingface/optimum/pull/897 as well

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

authors: HuggingFaceDocBuilderDev fxmarty

repo: huggingface/optimum


text:
FIX: Small numerical discrepancy for p-tuning after loading the model

There is a small numerical discrepancy between the outputs of a p-tuning model before and after loading. Even though it is small, it can still affect generations, so this PR eliminates it.
As an example, without the fix, this is the difference in logits for opt-125m:
>       torch.testing.assert_close(output_loaded, output_peft)
E       AssertionError: Tensor-likes are not close!
E
E       Mismatched elements: 30 / 10557120 (0.0%)
E       Greatest absolute difference: 1.1086463928222656e-05 at index (0, 9, 9314) (up to 1e-05 allowed)
E       Greatest relative difference: 0.00021288332936819643 at index (0, 9, 9314) (up to 1.3e-06 allowed)

Details about how this comes about are explained here:
https://github.com/huggingface/peft/issues/2043#issuecomment-2321522577
The gist of it is that if we take a single sample, repeat it X times, and then forward it through a model (which is the training path in p-tuning), we would expect the same output as if we forwarded this sample only once and repeated the output X times (the inference path for p-tuning). However, for sufficiently large models, the two approaches can have tiny differences.
With the fixed approach, there is no difference between training and inference code paths when it comes to this. The new code should also be slightly more compute efficient, but in practice will not make a noticeable difference.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

authors: BenjaminBossan HuggingFaceDocBuilderDev

repo: huggingface/peft


text:
Uneven VRAM usage with sharded model serving

System Info
Running 0.9.4 container on ubuntu 20.04.6 LTS with CUDA 11.8 and A100s.
Information

[X] Docker
[ ] The CLI directly

Tasks

[X] An officially supported command
[ ] My own modifications

Reproduction
docker run --gpus=all --rm --shm-size 1g \
    -p $port:$port ghcr.io/huggingface/text-generation-inference:0.9.4 \
    --model-id llama-70b --num-shard 4 \
    --max-input-length 4095 \
    --max-total-tokens 4096\
    --max-batch-prefill-tokens 32768 \
    --cuda-memory-fraction 0.99 \
    --hostname 0.0.0.0 --port $port

Expected behavior
While serving default fp16 LLaMA-2-70B using 4 or 8 shards and logging from each shards information about free memory available I see (below is an example of 4 shards):
2023-08-06T05:42:44.436040Z  INFO text_generation_launcher: Rank [1] Total GPU memory: 79.21 GB,
Total free memory: 5.32 GB,
Effective supported batch size: 22

2023-08-06T05:42:44.453502Z  INFO text_generation_launcher: Rank [0] Total GPU memory: 79.21 GB,
Total free memory: 5.46 GB,
Effective supported batch size: 22

2023-08-06T05:42:44.468010Z  INFO text_generation_launcher: Rank [3] Total GPU memory: 79.21 GB,
Total free memory: 2.71 GB,
Effective supported batch size: 14

2023-08-06T05:42:44.479387Z  INFO text_generation_launcher: Rank [2] Total GPU memory: 79.21 GB,
Total free memory: 5.32 GB,
Effective supported batch size: 22

The above is printed over here as follows:
        max_supported_batch_total_tokens = int(num_blocks * BLOCK_SIZE)
        logger.info(
            f"Rank [{self.rank}] Total GPU memory: {total_gpu_memory / 1024 ** 3:.2f} GB, \n"
            f"Total free memory: {total_free_memory / 1024 ** 3:.2f} GB, \n"
            f"Total free memory allowed: {free_memory / 1024 ** 3:.2f} GB, \n"
            f"Effective supported batch size: {int(max_supported_batch_total_tokens/max_seqlen)}"
        )

In other words each shard sees different VRAM available and thereby returns back to the router different value for max_supported_batch_total_tokens. Hence it is unclear whether (1) it is expected (2) even if not - is router OK to deal with such imbalanced capabilities of the shards?
Thanks!

Is this consistent across runs ? Maybe 1 shard got some fragmentation going on and that's what we're seeing ?

I'm unable to reproduce, is there any way there's already a running process on GPU3 ?
Can you provide the output of nvidia-smi after the load ?

Sure. Here is an example with the same serving h-params:
2023-08-09T16:39:17.557727Z  INFO text_generation_router: router/src/main.rs:210: Warming up model
2023-08-09T16:39:30.032821Z  INFO text_generation_launcher: Rank [0] Total GPU memory: 79.21 GB,
Total free memory: 7.84 GB,
Total free memory allowed: 7.05 GB,
Effective supported batch size: 30

2023-08-09T16:39:30.051492Z  INFO text_generation_launcher: Rank [2] Total GPU memory: 79.21 GB,
Total free memory: 7.70 GB,
Total free memory allowed: 6.91 GB,
Effective supported batch size: 30

2023-08-09T16:39:30.076165Z  INFO text_generation_launcher: Rank [3] Total GPU memory: 79.21 GB,
Total free memory: 5.09 GB,
Total free memory allowed: 4.30 GB,
Effective supported batch size: 21

2023-08-09T16:39:30.078729Z  INFO text_generation_launcher: Rank [1] Total GPU memory: 79.21 GB,
Total free memory: 2.57 GB,
Total free memory allowed: 1.78 GB,
Effective supported batch size: 13

Idling:
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  On   | 00000000:0F:00.0 Off |                    0 |
| N/A   37C    P0    83W / 400W |  45202MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A100-SXM...  On   | 00000000:15:00.0 Off |                    0 |
| N/A   34C    P0    81W / 400W |  39912MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A100-SXM...  On   | 00000000:50:00.0 Off |                    0 |
| N/A   35C    P0    83W / 400W |  45346MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA A100-SXM...  On   | 00000000:53:00.0 Off |                    0 |
| N/A   35C    P0    81W / 400W |  42340MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

Under peak load:
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  On   | 00000000:0F:00.0 Off |                    0 |
| N/A   65C    P0   416W / 400W |  80834MiB / 81920MiB |     81%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A100-SXM...  On   | 00000000:15:00.0 Off |                    0 |
| N/A   57C    P0   426W / 400W |  80814MiB / 81920MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A100-SXM...  On   | 00000000:50:00.0 Off |                    0 |
| N/A   58C    P0   397W / 400W |  80978MiB / 81920MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA A100-SXM...  On   | 00000000:53:00.0 Off |                    0 |
| N/A   62C    P0   377W / 400W |  80758MiB / 81920MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

The other scary thing I found is that regular RAM leaks very slowly... ~1GB/day with ~1QPS sent to such a 4-shards server.

I see, thanks.
Wonder if @Narsil you have had some meaningful time spent on figuring out if it is debuggable at all?
I don't want to think there is nothing one can do but just to live with that :)

If I can't reproduce, it's really hard to debug you know.
I have it in mind, so I'll keep looking for it.

I'm going to close this, since the uneven part of VRAM usage doesn't seem to be that bad.
Please do comment if you see it cropping up again, or have an easier way to reproduce so we can actually fix.
Our cache manager would be the place to look if anyone's interested: https://github.com/huggingface/text-generation-inference/blob/0e8b47811e711b46fe80e6b4f5304186f83744d6/server/text_generation_server/models/flash_causal_lm.py#L31

authors: Narsil ipoletaev

repo: huggingface/text-generation-inference


text:
Caddy as web server

I noticed that there are only guides for Nginx and Apache (https://github.com/huginn/huginn/blob/master/doc/manual/installation.md#6-nginx) in the manual.
Is it possible to use Caddy as the web server for Huginn?

I am sure that it is possible. I did not test it myself, but this Caddyfile should work (I am not sure of the order of the rules, maybe the assets rule needs to be the first):
example.com {
    proxy / unix:/home/huginn/huginn/tmp/sockets/unicorn.socket {
        transparent
    }
    gzip
}
example.com/assets {
    root /home/huginn/huginn/public
    gzip
}

After some testing:
example.com {
    root /home/huginn/huginn/public
    proxy / unix:/home/huginn/huginn/tmp/sockets/unicorn.socket {
        except /assets/
        transparent
    }
    gzip
}

authors: dsander peerau rongmu

repo: huginn/huginn


text:
Older macOS release unsupported

Looks like there was a change on the macOS packaging from 1.2.176.1 onward. It used be archive-esque that could be extracted but in the more recent releases it looks like its an actual installer. This just effects macOS so probably not a huge deal but it would be nice to have support for older versions. You can validate this by running the workflow for version 1.2.170.0 or previous.

Ahh, OK -- I was able to confirm just now that 1.2.170.0 breaks things. Taking a look at autodetecting the archive format so old versions can be supported.

fixed in v1.1.1! (confirmed by running CI builds against all available SDK versions as reported by LunarG webservices)

This is so slick. Awesome awesome work.

authors: humbletim sbrkopac

repo: humbletim/install-vulkan-sdk


text:
Fails to install on macOS

https://gist.github.com/86f05ee763111e6ebf2752fd77004e65
Perhaps because I'm on macOS 10.14?

I have the same issue. Also prevents installation of pyranges.

Coud not reproduce:
pip install --no-cache-dir ncls
Collecting ncls
  Downloading https://files.pythonhosted.org/packages/8b/72/68e5a38c8e5fb4b3c53ee0e9709d496b39aaf3ae17b1059329278ed5fe17/ncls-0.0.36.tar.gz (311kB)
    100% |████████████████████████████████| 317kB 6.6MB/s
Requirement already satisfied: cython in ./anaconda3/lib/python3.6/site-packages (from ncls) (0.28.2)
Requirement already satisfied: numpy in ./anaconda3/lib/python3.6/site-packages (from ncls) (1.15.4)
Installing collected packages: ncls
  Running setup.py install for ncls ... done
Successfully installed ncls-0.0.36
You are using pip version 18.1, however version 19.0.3 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

Sorry, no ideas. Will look closer at this in a few weeks when I am submitting the pyranges paper :)

Thanks for the feedback btw :)

Thanks for looking. At first glance you seem to be using a different version of Python. Both @alexreg and I are using python 3.7 and you seem to be running 3.6. Maybe it's nothing, but a clear difference.

Just checked, and I was able to install on python2.7 on the same machine. So perhaps this is a python 3.7 issue.

What is your error message? :)

I am using python 3.6 myself.
I have tried updating MANIFEST.in and set language_level=2 in setup.py.
The new version is 0.0.37. Could you please try pip install ncls==0.0.37 in Python 3.7?

Hi, my error is the same as OP, which is why I didn't include it. I tried the new version and it still has the same issue:
 pip3.7 install ncls==0.0.37
Collecting ncls==0.0.37
  Downloading https://files.pythonhosted.org/packages/8f/0d/6e49884f8d4f1dd6e45876297a32721e060e89be030ad984b828f136aac5/ncls-0.0.37.tar.gz (311kB)
    100% |████████████████████████████████| 317kB 3.8MB/s
Requirement already satisfied: cython in /usr/local/lib/python3.7/site-packages (from ncls==0.0.37) (0.29.5)
Requirement already satisfied: numpy in /usr/local/lib/python3.7/site-packages (from ncls==0.0.37) (1.16.0)
Building wheels for collected packages: ncls
  Running setup.py bdist_wheel for ncls ... error
  Complete output from command /usr/local/opt/python/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-m3zgm_k1/ncls/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-wheel-dp2su9ls --python-tag cp37:
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-10.14-x86_64-3.7
  creating build/lib.macosx-10.14-x86_64-3.7/ncls
  copying ncls/version.py -> build/lib.macosx-10.14-x86_64-3.7/ncls
  copying ncls/__init__.py -> build/lib.macosx-10.14-x86_64-3.7/ncls
  creating build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/__init__.py -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/ncls32.pyx -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/ncls.pyx -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/cncls32.pxd -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/cncls.pxd -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/utarray.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/intervaldb.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/cgraph.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/intervaldb32.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/default.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/cgraph.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/intervaldb32.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/ncls32.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/ncls.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  copying ncls/src/intervaldb.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
  running build_ext
  building 'ncls.src.ncls' extension
  creating build/temp.macosx-10.14-x86_64-3.7
  creating build/temp.macosx-10.14-x86_64-3.7/ncls
  creating build/temp.macosx-10.14-x86_64-3.7/ncls/src
  clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -I/usr/local/include -I/usr/local/opt/openssl/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python/3.7.2/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c ncls/src/ncls.c -o build/temp.macosx-10.14-x86_64-3.7/ncls/src/ncls.o
  ncls/src/ncls.c:609:10: fatal error: 'ncls/src/intervaldb.h' file not found
  #include "ncls/src/intervaldb.h"
           ^~~~~~~~~~~~~~~~~~~~~~~
  1 error generated.
  error: command 'clang' failed with exit status 1

  ----------------------------------------
  Failed building wheel for ncls
  Running setup.py clean for ncls
Failed to build ncls
Installing collected packages: ncls
  Running setup.py install for ncls ... error
    Complete output from command /usr/local/opt/python/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-m3zgm_k1/ncls/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-record-ni5i1hqq/install-record.txt --single-version-externally-managed --compile:
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.14-x86_64-3.7
    creating build/lib.macosx-10.14-x86_64-3.7/ncls
    copying ncls/version.py -> build/lib.macosx-10.14-x86_64-3.7/ncls
    copying ncls/__init__.py -> build/lib.macosx-10.14-x86_64-3.7/ncls
    creating build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/__init__.py -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/ncls32.pyx -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/ncls.pyx -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/cncls32.pxd -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/cncls.pxd -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/utarray.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/intervaldb.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/cgraph.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/intervaldb32.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/default.h -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/cgraph.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/intervaldb32.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/ncls32.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/ncls.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    copying ncls/src/intervaldb.c -> build/lib.macosx-10.14-x86_64-3.7/ncls/src
    running build_ext
    building 'ncls.src.ncls' extension
    creating build/temp.macosx-10.14-x86_64-3.7
    creating build/temp.macosx-10.14-x86_64-3.7/ncls
    creating build/temp.macosx-10.14-x86_64-3.7/ncls/src
    clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -I/usr/local/include -I/usr/local/opt/openssl/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python/3.7.2/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c ncls/src/ncls.c -o build/temp.macosx-10.14-x86_64-3.7/ncls/src/ncls.o
    ncls/src/ncls.c:609:10: fatal error: 'ncls/src/intervaldb.h' file not found
    #include "ncls/src/intervaldb.h"
             ^~~~~~~~~~~~~~~~~~~~~~~
    1 error generated.
    error: command 'clang' failed with exit status 1

    ----------------------------------------
Command "/usr/local/opt/python/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-m3zgm_k1/ncls/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-record-ni5i1hqq/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-m3zgm_k1/ncls/

This is weird. I downloaded the zipped archive and intervaldb.h is there in ncls/src. I will ask on stack overflow :)

Now I have added a hint to the compiler where it should look for the headers.
If you want to get the Py3 version working, could you please try: pip install ncls==0.0.38 and then send me the error message if it does not work? If you are happy with using 2.7 feel free to ignore this message :)

Failed with the same error. I don't use python 2.7, I just happened to have it installed, so it would be good to get to the bottom of this.
clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/usr/include -I/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.14.sdk/System/Library/Frameworks/Tk.framework/Versions/8.5/Headers -Incls/src/ -I/usr/local/include -I/usr/local/opt/openssl/include -I/usr/local/opt/sqlite/include -I/usr/local/Cellar/python/3.7.2/Frameworks/Python.framework/Versions/3.7/include/python3.7m -c ncls/src/ncls.c -o build/temp.macosx-10.14-x86_64-3.7/ncls/src/ncls.o
    ncls/src/ncls.c:612:10: fatal error: 'ncls/src/intervaldb.h' file not found
    #include "ncls/src/intervaldb.h"
             ^~~~~~~~~~~~~~~~~~~~~~~
    1 error generated.
    error: command 'clang' failed with exit status 1

    ----------------------------------------
Command "/usr/local/opt/python/bin/python3.7 -u -c "import setuptools, tokenize;__file__='/private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-tvy56v0r/ncls/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-record-0ei6igck/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/qn/ydpc94sn6d70l_ptdnmsn3c80000gp/T/pip-install-tvy56v0r/ncls/

The paths in the include-statement are relative (-Incls/src/). I have tried fixing this in 0.0.40.

Thanks for helping me out :)

@endrebak Success! Thanks a lot for the fix.

Thank you @endrebak, it works for me too now.
On Wed, Feb 27, 2019 at 5:56 PM Alexander Regueiro notifications@github.com
wrote:

@endrebak https://github.com/endrebak Success! Thanks a lot for the fix.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/hunt-genes/ncls/issues/3#issuecomment-467942556, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AFlTB0K7_nh6UJvXk1SrMDi-VEsnh7wsks5vRrjRgaJpZM4XMD9E
.

--
Sergei

Neat. Then I guess clang does not look in the CWD for libraries, while GCC does? My best guess for why it did not work for you guys.

authors: alexreg endrebak llevar

repo: hunt-genes/ncls


text:
Compatibility with appveyor

This gets the doc-upload command working at least on appveyor to allow publishing docs from appveyor.

The environment variables of AppVeyor are checked as well as the travis equivalents
Instead of trying to execute a python script instead run it through the python interpreter

Thanks for the pull request, and welcome! You should hear from @huonw (or someone else) soon.

authors: alexcrichton autohuonw

repo: huonw/travis-cargo


text:
🛑 Portfolio is down

In 0ba7bce, Portfolio (https://portfolio.thekor.eu) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Portfolio is back up in 52f8457 after 19 minutes.

repo: hupratt/upptime


text:
Xcode 10 Errors

As you can see the attached screenshot, I got a bunch of errors when migrating to Xcode 10. I did not see these errors before. I could unlock the pod and fix the deprecated code by myself, but even after I did that, my app crashes. See the second screenshot for what I did and the error on the print line. It seems caused by EKAttributes.

What version of SwiftEntryKit are you using (0.8.2) is Xcode 10 compatible.

What version of SwiftEntryKit are you using (0.8.2) is Xcode 10 compatible.

The deployment target was iOS 11.3

You are right. I am sorry for that. But what caused the crash was still the SwiftEntryKit code as shown in the other screenshot. I tried to create a new project using SwiftEntryKit and it worked. I don't why that piece of code always crashed in my current app. Even if I move the print line to right after the creation of EKAttributes, var attributes = EKAttributes.topFloat, it gives me the same error. Very weird. Anyway, you can close this problem. I will have to find a way around.

One of those typical migration problems IMO.
Have you tried the following?

pod cache clean --all
pod deintegrate
Clean the project, build folder and derived data.
pod install
Run again.

And it might also happen because your project/target is defined with Swift version which is less than 4.2. When you opened the project using Xcode 10, it generated a Swift4.2 project by default. If it is te case - please have a look at: https://github.com/huri000/SwiftEntryKit/issues/122#issuecomment-427670349

Oh, boy. I did use 4.1. I will try your suggestion and let you know. Thanks

Thanks, @MenuHunt! I'm keeping the issue open until then. :-)

It took me a while to update the syntax for using Swift 4.2. Yeah! That was the problem. The issue has been fixed. Thanks so much! You are the man!

Great! 💯


text:
bar plot languages count LLM dataset

Fasttext model trained on,
lang_labels_v2 = {
    0: 'standard-english',
    1: 'local-english',
    2: 'manglish',
    3: 'standard-indonesian',
    4: 'socialmedia-indonesian',
    5: 'standard-malay',
    6: 'local-malay',
    7: 'standard-mandarin',
    8: 'local-mandarin',
    9: 'other',
}

Steps to reproduce the fasttext training at https://github.com/huseinzol05/malaya/blob/5.1/pretrained-model/language-detection-v2/train-fasttext-auto.ipynb

Directory https://github.com/huseinzol05/malay-dataset/blob/master/prepare-llm/count.ipynb


text:
Um7 packet without data

Please provide the following information:

OS: 18.04
ROS Distro: Melodic
Real hardware

Um7 doesn't receive data
Rosrun um7 um7_driver
rosrun um7 um7_driver
[ INFO] [1667367895.042224127]: um7_driver successfully connected to serial port /dev/clearpath/um7.
[ INFO] [1667367895.065160976]: Received packet 02 without data.
[ INFO] [1667367895.068245150]: Setting update rate to 160Hz
[ INFO] [1667367895.092220604]: Received packet 02 without data.
[ INFO] [1667367895.342022190]: Received packet 04 without data.
[ERROR] [1667367895.895289034]: Unable to set CREG_COM_RATES5.
[ INFO] [1667367895.895379002]: Attempting reconnection after error.
[ INFO] [1667367896.896302190]: um7_driver successfully connected to serial port /dev/clearpath/um7.
[ INFO] [1667367896.926591566]: Received packet 02 without data.
[ INFO] [1667367896.935063056]: Setting update rate to 160Hz
[ INFO] [1667367896.938572218]: Received packet 02 without data.
[ INFO] [1667367896.941582882]: Received packet 04 without data.
[ INFO] [1667367896.944535374]: Received packet 05 without data.
[ INFO] [1667367896.947561436]: Received packet 06 without data.
[ WARN] [1667367896.955753342]: Excluding magnetometer updates from EKF.
[ INFO] [1667367896.975545165]: Received packet 08 without data.
[ INFO] [1667367896.979696600]: Sending command: zero gyroscopes
[ INFO] [1667367896.987522327]: Received packet ad without data.
Tried also changing the update rate with no difference.
Any suggestions?

Did you change the update rate for this device?

Yes tried changing multiple times

Does the issue happen when you are operating at 20Hz?

Closing due to inactivity.  Please feel free to re-open if issue persists.

authors: Rowaid-x tonybaltovski

repo: husky/husky


text:
proxies...

please help me :(
I don't get how I'm supposed to use proxies I have tried it like this var device = new Client.Device('dkwkapskpdkpws'); var storage = new Client.CookieFileStorage(__dirname + '/cookies/user1.json'); var proxy = "182.16.187.***:23500" Client.Session.create(device, storage, '****', '****', 'https://'+proxy+'/') but then I get an error
I don't know if I just use bad proxies or if I'm just dumb but please help
error: "Unhandled rejection RequestError: Error: tunneling socket could not be established, cause=write EPROTO 19656:error:1408F10B:SSL routines:ssl3_get_record:wrong version number:openssl\ssl\record\ssl3_record.c:252:" or "Unhandled rejection RequestError: Error: tunneling socket could not be established, cause=Client network socket disconnected before secure TLS connection was established"

i got it working...

how can you solve it?? :(...

I really want to know how you solve this problem... i'm having same issue... plz  :(...

First try to change “https://“ to “http://“ and if that doesnt work then i Think the problem is a bad proxy. Have you tried different proxies?

i tried two proxies... but same issue.. change proxie?

Error: tunneling socket could not be established, statusCode=403

when i try "http://", above error trigger...

hmmm then i Think your proxy is dead but i’m NOT sure

now, "http://" work ??

repo: huttarichard/instagram-private-api


text:
Add mechanism to create both content and b64content versions

Writing binary files into vault is easier when base64-encoding the file before it goes in. We have no way of knowing if the user wants that content base64-encoded or not though - smaller, text files need not be.
So this patch creates two attributes for a key - one base64 encoded (b64content), one not (content).

(Note that if you rebase this PR to the main tip of common, you'd drop these spurious commits from the PR)
I am wondering if we should just always inject everything as base64 and tweak all external secrets to assume that everything is base64-encoded (we have the b64dec filter in external secrets). It's a bit of a bigger patch and crosses some repos, but maybe it would keep things a little simpler+clearer?

I'm leery of doing that silently at least because people might want to see what they stored in Vault; and because there are other potential uses for Vault outside of Kubernetes secrets. I think it's a "least surprise" violation how things seem to be handled on retrieval from Vault, but I think it would be a bigger least-surprise validation for us to force b64-encoding on every "file"; though maybe we're just leaving a bit of a landmine for people to trip over if they discover the same thing we did.
Still, I think providing both attributes allows both behaviors - we don't really have control of how users/patterns will consume the secrets from vault, though I could also see a point to "fromKey" being a bit of a surprise with both attributes.

I've thought about it a bit more, and my thinking is still to publish both attributes. I understand we have b64dec, but in my mind, I think users would want at least the option to see what they stored directly. What do you think?

Agreed, let's go for this approach for the time being. I cannot think of any other ways (if we added a "format: {binary,text}" attribute, we probably could not beat external secrets into grasping that. I.e. reading the attribute and using b64dec when format is binary)

authors: mbaldessari mhjacks

repo: hybrid-cloud-patterns/common


text:
playStream 'end' reason is "Stream is not generating quickly enough."

Everything seems like working fine, videos are played correctly until the end, but when music ends the reason printed from the activeStream.on('end') reason is not stream (as per docs) but Stream is not generating quickly enough..
Do I have to manually close the stream, or something?
I'm using node-opus.
Code snippet:
const stream = ytdl(musicUrl, { filter: 'audioonly' });
stream.on('info', (info) => {
   const streamInfo = 'Reproducing ... ' + info.title + ' (' + info.length_seconds + 's)';
   message.channel.sendMessage(streamInfo);
});
activeStream = connection.playStream(stream, { volume: config.getVolume() });
activeStream.on('end', (reason) => { console.log(reason); });

The discussion for it is here: #1225
Also this isn't the correct place for support questions. Please join the official d.js support server: https://discord.gg/bRCvFy9

authors: Vargash iCrawl


text:
Add Explore page

@dtarb @horsburgh @martinseul @aphelionz @aramatev
The project is to create a "you might also like..." page for HydroShare. This page uses machine learning to infer resources (and other users and groups) that are likely of interest to each user, based upon usage patterns that HydroShare records.
This is an MS project at Tufts University in partial fulfillment of the Master of Science in Computer Science.
This issue serves to notify everyone that this project is ongoing.

@Castronova @martinseul
Are you retrieving any usage data from
hydroshare.org/tracking/* as implemented in hydroshare/hs_tracking?
Currently, history times out (probably due to response length) and profiles forces a login and doesn't respond.

@horsburgh @dtarb @martinseul I just changed this issue name to "Explore" and am creating a prototype "explore" tab. This would seem to overlap with Jeff's social discovery line item. The concept of the "explore" tab is that it shows you things that might interest you based upon your usage patterns.
This is fundamentally a different activity than discovery. In discovery, you show the system what you want. In Explore, the system shows you things you might be interested in based upon your prior activities.
For now, the "explore" tab will recommend resources based upon users' usage patterns. However, it has much more potential, including highlighting new holdings, showing top-rated or recently updated holdings, etc. So, @horsburgh should think about panes other than "recommendations" that might go into this page.

Where do you envisage this new page/tab going in the overall website page set.  The current page map design is at https://docs.google.com/drawings/d/1WBGON5o7zDxSWaNytCMkIV1ewfSCQ0ccqXIz0w3ZOs0/edit.  If you are considering revisions, some discussion (and perhaps mocking up) of the big picture may be good, so we know what the purpose and goal is before too much coding.

I think this could potentially be two separate pages, but I think we should consider consolidating them in the main navigation of the site. For example, we use one "Explore" link at the top of the page that perhaps has a fly down menu that enables a user to select:

Search for Resources - What we have now
Explore Resources - New functionality Alva is proposing
And perhaps even "Explore Users" - Browse and search users

Also - I had originally envisioned that suggestions of content a user might want to look at would happen on a user's "Dashboard" page that would have other social functionality like showing a feed of recent activity, etc. We haven't designed this page, and it isn't in our overall webpage set that @dtarb provided the link to, but it is in our early mockups and designs. Explore could be done via a separate page as @alvacouch suggests, but we could also decide that we want to do it via a Dashboard page. It's worth a discussion.

Does Recommendations work handle this? Also note RENCI and CUAHSI work on clustering and "proximity search" did not yield very usable results, due to low quantity of data.

Close, part of recommendations

Close, part of recommendations

authors: alvacouch aramatev cuahsimarko dtarb horsburgh martinseul

repo: hydroshare/hydroshare


text:
make irods user creation more robust

Pull Request Checklist:

[ ] Positive Test Case Written by Dev

[ ] Automated Testing

[ ] Sufficient User and Developer Documentation

[ ] Passing Jenkins Build

[ ] Peer Code review and approval

Positive Test Case
This PR makes iRODS user creation functionality a bit more robust to accommodate errors being raised from iRODS. It also fixed user notification for deleting iRODS user account to improve user experience.

I don't see how this makes user creation more robust.  The messaging has been modified a bit, which is likely a slight improvement.  I'm trying to recall exactly what prompted this work.  I believe it was because a user was trying to create an irods account and hydroshare said it created a user without actually creating it right?  Could you put together a test that ensures we'll catch that problem again?  The solution was just a small typo fix in config.  I don't see anything in here that would catch that specific issue.

@sblack-usu Here are two main changes that make iRODS user creation more robust:

Make run_ssh_command to return the list of output with each list item representing one command output if any rather than a concatenated string. This will enable the calling routine to check error in each command output to catch the subsequent command error if the first command output is the error indicating CATALOG_ALREADY_HAS_ITEM_BY_THAT_NAME which indicates the iRODS user already exists and is not treated as error. This is a bit confusing, but hope it makes sense.

Make ````create_irods_account()``` to capture the error coming from bash so that if the ssh command line string is wrongly configured in local_settings.py as we encountered recently, this problem will be captured and treated as an error, to prevent us from the out-of-sync issue between Django flag and iRODS user existence.

I think we need to have a REST service running on iRODS user zone server to handle user creation and deletion rather than using this remote ssh invocation method, so just try to make the current implementation more robust to minimize out-of-sync issue between Django flag and iRODS user existence without spending too much effort.

@sblack-usu We do have tests for creating and deleting iRODS users in https://github.com/hydroshare/hydroshare/blob/develop/hs_core/testing.py which depends on the same logic in the core ssh-based methods for creating and deleting iRODS users. So adding the two changes mentioned above would enable the tests to capture the configuration-caused errors in the future.

@sblack-usu I have added debug logging back in, and responded to your comments. See if it looks good now.

authors: hyi sblack-usu


text:
bug: latest version not found when patch for older version exists

Describe the bug
Currently I get for rancher as the latest version the 2.5.13, although the latest version is the 2.6.4.
This is probably because the 2.5.13 was the last to be released.
To Reproduce
Use the following config
service:
  rancher/rancher:
    type: github
    url: rancher/rancher
    url_commands:
      - type: regex_submatch
        regex: v([0-9.]+)$
    web_url: https://github.com/rancher/rancher/releases/v{{ version }}
    icon: https://raw.githubusercontent.com/rancher/docs/master/static/imgs/rancher-logo-cow-blue.svg
    status:
      current_version: 2.6.3
      current_version_timestamp: "2022-04-22T20:29:51Z"
      latest_version: 2.5.13
      latest_version_timestamp: "2022-04-22T20:29:51Z"

Thanks for noticing and reporting. You were right in the cause being because 2.5.13 was released after 2.6.4. I hadn't accounted for patch versions and just took the newer tags as newer versions. I've now made it (if semantic versioning is enabled and it's a git query) get all the possible versions (if the url_commands pass), then go through and sort them by semVer. With this I did default Service.IgnoreMisses to true as not every tag is a release tag, so lots of warnings would print.
Thanks for posting the config with it, that really helped with my testing and 0.0.1 works with that config

authors: JosephKav larsl-net

repo: hymenaios-io/Hymenaios


text:
support for multi dbs

Currently we assume databases are created based off of the current system connection. Whenever you plan on moving a tenant to another server we need to allow the database creation there with full support to manage the database; including deletion and updating.
In order to do so we will be storing a column on the Website table which will relate to a database connection configured in app/database.php.
/cc @julesbloemen

Does this mean it'll also use a new user, or does it uses the user defined in the connection?

authors: Thijmen luceos

repo: hyn/multi-tenant


text:
A property for toggling search field in header

Is it possible to add a property that shows the search field in the header initially?
At this point, you must press the filter button for the search field to appear.

@Yuvaleros So far, no. search filed is stateful, but it might be changed to fully stateless in the future. the other option is to hide default header and to put your component instead of it.

Implemented on v0.18.2

authors: Yuvaleros hyojin

repo: hyojin/material-ui-datatables


text:
Core value front-and-center

Putting women's benefits front-and-center, from the CONTRIBUTING.md
intro, over to the README.md. Slight edits.

Small suggestion: make "cis" and "trans" links to Wikipedia or whatever you feel best describes the terms, especially for "cis", as I've very often had to explain that term whenever it comes up.

authors: ejmr lillian-lemmer

repo: hypatia-engine/hypatia


text:
Partial Paints?

I've created a little learning project with hyperapp and @hyperapp/transitions and have run into a strange issue. When adding some of the larger quotes, the containing blockquote element appears to only partially paint. If I do anything to alter the screen (i.e. show the browsers toolbar, hover elements in the devtools inspector, tab away and back, highlight the text with ctrl + a or whatever) it will snap to the correct render.
The Project Code
Live Demo

Just click the quote on the demo and sometimes the larger quotes will reproduce the issue.
I'm using Firefox Quantum 60.0.2 on Ubuntu MATE. Let me know if you need more info.

I tried it and could not replicate (Firefox 61.0 on Mac OS 10.13.4) 😞
But I don't think any of the quotes that I could get up were as long as the one in your pic. Does it matter how long the quotes are (how large the box needs to be)? Could this be a css/layout issue?

Removing transform-style: preserve-3d fixes it. Closing as it was an issue with my CSS, not your package. Sorry for the confusion.

🍻 No prob! Glad you worked it out!

authors: ryanford-frontend zaceno

repo: hyperapp/transitions


text:
Transitions broken between 1.2.5 and 1.2.6

The latest update to hyperapp introduced a bug in transitions, you can notice in the toasts example when toasts are removed. (Janky behavior)

@zaceno Any idea where the bug is?

@jorgebucaran I opened an issue in Hyperapp with what I've figured out so far. I believe it's a bug in 1.2.6.
https://github.com/hyperapp/hyperapp/issues/710

authors: jorgebucaran zaceno


text:
[FEATURE] 建议把HTTP的 404 等错误统一化成异常处理

现在404、405等错误， 返回的都是空页面，实现自定义404错误的json、页面结构返回需要重新定义中间件拦截特定状态代码响应
比如这样：

这么做恩别扭，而且有个问题，就是不是所有的状态代码是40X的都是需要拦截的，有些restfull api，其路由是存在的，但是对应的资源不存在，我们自主返回的404和路由不存在的404显然错误信息肯定是不同的，这时候不需要任何拦截，那么这时候中间件就很尴尬，又要做很多判断。
既有实现的框架中，很多把这种HTTP异常都统一抛出，然后统一在ERROR EXCEPTION里面处理，这样感觉比较统一而且不会出现上面的情况，建议hyperf也做类似的设计。

如果说在中间件里可以捕获状态码，我是觉得就足够了😂

而你说的资源不存在啥的，可以通过exceptionhandler初级，比如资源不存在抛出一个notfoundException

@limingxinleo 这样感觉要处理两处地方了，一个是中间件拦截 一个是全局异常处理处。但是返回的格式都是类似的，如果统一规划为抛异常，那么业务上的404就可以很灵活的做，返回数据或者用异常都行。

你是说 404 405 的时候抛出异常，而不是直接返回 response ？

好吧，我最开始没理解清楚

@limingxinleo 现在框架hyperf的设计 路由不匹配、请求方法不命中的话是不触发异常的 直接返回一个空只有状态码的空页面。其他有些框架也是归为http异常的，会被app的Exception handler统一处理，返回统一的格式响应，而且，如果有需要，还可以很方便的带上trace信息。
我现在对hyperf做了一些修改，环境变量带上debug的时候，这些错误都会带上额外的trace信息字段在json里面，处理和定位都很方便。

404 405 通过 DI 重写 CoreMiddleware 的 handleNotFound 方法就好了，如果抛出异常给 ExceptionHandler 处理，很容易会因为对 ExceptionHandler 的调整而导致这两个响应状态不对，用户犯错的成本太低了

@huangzhhui Optimized #603  https://github.com/hyperf-cloud/hyperf/pull/630 这个PR什么时候会发布，之前Coremiddle不在DI的管理下。

@huangzhhui Optimized #603 #630 这个PR什么时候会发布，之前CoreMiddleware不在DI的管理下。

明天

Released v1.1

404 405 通过 DI 重写 CoreMiddleware 的 handleNotFound 方法就好了，如果抛出异常给 ExceptionHandler 处理，很容易会因为对 ExceptionHandler 的调整而导致这两个响应状态不对，用户犯错的成本太低了

@huangzhhui @ihipop 请问如何通过 DI 重写 CoreMiddleware 的 handleNotFound 方法

@yangliulnn v1.1通过使用di容器来初始化CoreMiddleware，给予你不用修改vendor下的CoreMiddleware的便利，你可以继承那个原版的CoreMiddleware，然后覆写handleNotFound handleMethodNotAllowed2个方法

@ihipop 这个我知道，那如何将自己写的 CoreMiddleware 注入到容器内？

应该 config/autoload/dependencies.php 改 Hyperf\HttpServer\Contract\CoreMiddlewareInterface 的指向即可

我试过，并没有生效

@yangliulnn 仔细看了一下代码 是
 \Hyperf\HttpServer\CoreMiddleware::class => \App\Middleware\CoreMiddleware::class

可以了，谢谢

@limingxinleo @huangzhhui 这块是否接受补充文档 ，接受我就写下这块，完善下文档

@ihipop 嗯，你完善一下这部分的文档吧，感谢

authors: huangzhhui ihipop limingxinleo yangliulnn

repo: hyperf-cloud/hyperf


text:
di:init-proxy 扫描生成AOP代理类, 被代理类构造函数带参数会报错误

di:init-proxy 默认会扫描 app 目录下的所有类, 假如被扫描的类构造函数带有参数, 那么会报错误.
这里举一个重现例子, 业务中有用到 Flysystem 这个文件驱动, 在对接华为云OBS对象存储的时候报错:
namespace Foo\Bar;
use League\Flysystem\Adapter\AbstractAdapter;
class ObsAdapter extends AbstractAdapter
{
    private $client;

    public function __construct(ObsClient $client)
    {
        $this->client = $client;
    }
}

class ObsClient {
    public function __construct(array $config = []){
        $this->factorys = [];
        $this->ak = strval($config['key']);
        $this->sk = strval($config['secret']);
    }
}

因为 ObsClient 需要一个配置参数, 而 aop 生成代理类的时候默认传递进去的是一个空数组, 那么直接取值就会报错:

是你的$config获取了不存在的键触发的，只要判断一下就好了，$config['key']??''

@MrCJJW 问题我也知道, 但是这个是华为云存储SDK的代码, 他们默认构造函数就需要传入配置信息的

class ObsClient {
    public function __construct(ConfigInterface $config){
        $this->factorys = [];
        $this->ak = strval($config['obs']['key']);
        $this->sk = strval($config['obs']['secret']);
    }
}

把你的配置也放到容器里注入即可。

@Reasno 治标不治本, 何况第三方SDK的代码, 不应该去修改, 服务端的怎么改? 一台台服务器上去vim修改vendor里面的代码吗?

不需要修改第三方啊。 用factory即可。

https://github.com/Reasno/cloudnative-hyperf/blob/master/app/Provider/FileSystemFactory.php

你这个是 Adapter 存在的情况, 假如 Adapter 不存在呢? 那么我就要在 app 目录下写一个自定义的Adapter的驱动(比如ObsAdapter), 这个时候这个 Adapter 就会被 AOP 扫描到, 就会报我上面的问题了. 当然了既然是自定义的Adapter, 我当然可以给他构造函数不传入 ObsClient, 在构造函数里面去new ObsClient, 但是这样代码就耦合了

不存在呢? 那么我就要在 app 目录下写一个自定义的Adapter的驱动(比如ObsAdapter), 这个时候这个 Adapter 就会被 AOP 扫描到,

在config/depenencies.php里加上
<?php
return [
    ObsAdapter::class=>ObsAdapterFactory::class
];

然后写个ObsAdapterFactory的Invokable Class，返回构造好的ObsAdapter示例即可。

这个我也有想过, 这个是在 $obsConfig 固定的情况, 假如 $obsConfig 不固定呢? 我们的业务是要根据用户行为来动态配置选择使用存储驱动的哪一个配置(比如bucket和appkey secret等不确定)

这个我也有想过, 这个是在 $obsConfig 固定的情况, 假如 $obsConfig 不固定呢? 我们的业务是要根据用户行为来动态配置选择使用存储驱动的哪一个配置(比如bucket和appkey secret等不确定)

每个用户用不同的配置？那你不能用单例了。Hyperf的构造函数注入都是长生命周期的单例。使用短生命周期对象，不要在控制器或者其他构造函数注入ObsAdapter， ObsClient，而是使用make(ObsClient:class, ['key' => 'xxxx', 'secret' => 'yyyyy']) 来实例化。
文档：https://doc.hyperf.io/#/zh-cn/di?id=短生命周期对象

提前补充一句，make是$container->make的简化，构造的类是根据容器中的定义构造的，也就是说不会像new一样产生耦合，你在单元测试里是可以把该类替换成替身的。
//单元测试中
$contianer->define(ObsClient::class, ObsClientMock::class);
$client = make(ObsClient::class, []);  //此时实例化的对象是ObsClientMock

authors: MrCJJW Reasno wh469012917

repo: hyperf/hyperf


text:
AOP切入的类  在scan_cacheable配置为true  测试得到未走代理类  而是直接指向原始类

scan_cacheable  为true的时候 为执行代理类

composer dump-autoload -o
然后再试试

测试来看是生效了，但是没太明白composer dump-autoload -o 执行后  classmap并没有代理类的映射关系

看文档，scan_cacheable的场景和原理都有提到

走了代理类，还遇到一个问题，父类和子类都被aop了，子类继承父类的一个public属性 ，属性默认值为null。子类重写父类属性并赋值某个值，走原始类打印属性值正确，走代理类属性值就变成null

文档在那个位置讲这块的原理了呀  没找到

authors: Arvin-Lee limingxinleo


text:
Hyperf phar部署问题

找了很久方案，官方文档有打包phar的教程，甚至有映射文件夹的方法

注意事项
打包后是以 phar 包的形式运行，不同与源代码模式运行，phar 包中的 runtime 目录是不可写的， 所以我们需要重写部分可写的目录位置。

但是没有获取文件的教程
请问直接把 hyperf 项目用 phar 打包后，线上运行，安全和便捷原因不想丢源码跑，如何获取到包里面的.log 文件呢，想要看里面输出的日志进行调试和维护，求支招

找了很久方案，官方文档有打包phar的教程，甚至有映射文件夹的方法

注意事项
打包后是以 phar 包的形式运行，不同与源代码模式运行，phar 包中的 runtime 目录是不可写的， 所以我们需要重写部分可写的目录位置。

但是没有获取文件的教程
请问直接把 hyperf 项目用 phar 打包后，线上运行，安全和便捷原因不想丢源码跑，如何获取到包里面的.log 文件呢，想要看里面输出的日志进行调试和维护，求支招

已解决，所以关闭

已解决，所以关闭


text:
Call onclose after we remove the tabs in the interface

in the same way we do on clicking close

hey @arj03 have you linked this in to prove it works for patchbay?
I don't know what your comment means, are you refering to somewhere else in the code?

Yes, I'm running this branch in patchbay:
https://github.com/ssbc/patchbay/tree/fix-quote-2
And what I'm comparing is:
https://github.com/hyperhype/hypertabs/blob/master/tabs.js#L46
You can see that if I click close onclose gets called after. This change makes it consistent.

@arj03 added you to org + npm owner, feel free to merge

Thanks!

authors: arj03 dominictarr mixmix

repo: hyperhype/hypertabs


text:
chore(codec): Use as_str method to implement display for CompressionEncoding

Reduces duplicate similar implementations for the similar purpose.

Thanks for these PRs! Would have welcomed these suggestions as feedback on my original PR, too.

authors: djc tottoto

repo: hyperium/tonic


text:
Mailgen Emails Breaks in iOS Email App when there is more than 1 recipients

Describe the bug
Seems like the email is not full-width.
To Reproduce
Steps to reproduce the behavior:
Prerequisites:

Install Monika v1.6.3 first by running npm install -g @hyperjumptech/monika or download the binary in the release page
Make sure to setup your email in your iOS Email app

Create a new file called config.yml:

notifications:
  - id: unique-id-smtp
    type: smtp
    data:
      recipients:
        - YOUR_EMAIL_ADDRESS_HERE
      hostname: YOUR_SMTP_HOST
      port: YOUR_SMTP_PORT
      username: YOUR_SMTP_ACCOUNT
      password: YOUR_SMTP_PASSWORD
probes:
  - id: sample_1
    name: Sample Request
    requests:
      - method: GET
        url: https://reqres.in/api/users/23
    alerts:
      - query: response.time > 200
        message: Response time is {{ response.time }} ms, expecting less than 200ms
      - query: response.status != 200
        message: Status code is not 200. I think their service is down.
      - query: isEmpty(response.body)
        message: Response body should not be empty!
    incidentThreshold: 1
    recoveryThreshold: 1

Run Monika by running monika -c config.yml
Check your email in iOS Email App

Expected behavior
It should display the email in full-width
Screenshots

Desktop (please complete the following information):

OS: iOS 15

Additional context
Please check https://www.npmjs.com/package/mailgen for better context. Probably test other themes

Hi @galanggg how is it going? After creating an issue in Mailgen (https://github.com/eladnava/mailgen/issues/55) it seems that the bug is not reproduce-able somehow.
Do you find anything while working on this? If you are not interested anymore in this issue or couldn't reproduce because of hardware limitation, let me know :grinning:

Hi, mas @dennypradipta. First of all, I want to apologize because since this issue was created to this day I haven't had time to debug due to busy work at the office and other things. Maybe you can re-assign this issue to someone else 😄

authors: dennypradipta galanggg

repo: hyperjumptech/monika


text:
Latest version Docker API

최신 패브릭 개발 환경 Docker API가 삭제되었습니다. 그것을 추가해야합니다.
<! - 위 제목의 변경 사항에 대한 일반적인 요약을 제공하십시오. ->
설명
<! - 변경 사항을 자세히 설명하십시오. ->
동기 부여 및 컨텍스트
<! - 왜이 변경이 필요합니까? 어떤 문제가 해결됩니까? ->
<! - 아직 해결되지 않은 문제가 해결되면 여기에있는 문제로 연결하십시오. ->
수정 #
어떻게 테스트 되었습니까?
<! -이 PR에 새로운 테스트 케이스가 포함되어 있지 않은 경우 그 이유를 설명하십시오. ->
<! - 변경 사항을 테스트 한 방법을 자세하게 설명하십시오. ->
검사 목록 :
<! - 상자
를 선택하려면 'x': [x] -> <! - 확인란을 선택 취소하려면 공백을 추가하십시오. [] ->
<! - 당신이 이것들에 대해 확신이 없으면, 주저하지 말고 물어보십시오. 우린 도와 줘! ->

[] Signed-off-by (https://github.com/hyperledger/fabric/blob/master/CONTRIBUTING.md#legal-stuff)를 추가했습니다.
[] 변경 사항을 다루기 위해 문서를 추가했거나이 변경 사항에 새로운 문서가 필요하지 않습니다.
[] 변경 사항을 다루기 위해 단위 테스트를 추가했거나이 변경에 새로운 테스트가 필요하지 않습니다.
[] 나는 [golint] (https://github.com/golang/lint)를 실행했고 수정했다.유효한 ~ 안에있는 경고 암호나는 추가 또는 수정했다. 이 도구는 오 탐지 (false positive)를 생성하므로 일부 경고를 무시하도록 선택할 수 있습니다. 목표는 깨끗하고 일관되며 읽기 쉬운 코드입니다.

<! - 지속적인 통합 빌드 프로세스는 테스트가 통과하고 코드 품질이 최소 기준을 충족시키는 지 확인하기 위해 [수표 발행] (https://github.com/hyperledger/fabric/blob/master/Makefile#L22)을 실행합니다. PR이 통과 할 때까지 받아 들여지지 않기 때문에 선택적으로 로컬로 실행할 수 있습니다. ->
서명 한 사람 :

Thanks for the contribution! this is a read-only mirror. please read the contribution guide.

authors: jihyon ryjones

repo: hyperledger-archives/fabric


text:
Revist FPC validation diagram

What this PR does / why we need it:
This PR completes the entire FPC flow with the last missing step - the validation.

replace MSP validtion with custom vscc plugin

Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing changes and/or breaks backward compatability?:

two small clarification suggestions

Yep, good finds! I've accepted them as an independent approval, so you or i can squash-merge.  I realize now, though, that i should have added a Signed-off-by: ..  as marcus has done ..  and it would have removed the need to overrule the DCO check ...