text:
Code doesn't run - RAM fills up too quickly

The code did not run on my 16GB RAM, 12GB x2 GeForce GTX TITAN X. It would get stuck while training at 0%.
So i tried to replicate the same in google colab but it kept getting killed even when I had 35GB of RAM.
I added a line to logger in dataset.py to show me RAM usage using psutil.
with every 500 examples, about 4GB of RAM is being used up.
Am I missing something?
06/30/2021 11:39:38 - INFO - dataset -   Writing example 0/3053
06/30/2021 11:39:38 - INFO - dataset -   RAM used: 23%
06/30/2021 11:39:39 - INFO - dataset -   *** Example ***
06/30/2021 11:39:39 - INFO - dataset -   guid: train-42
06/30/2021 11:39:39 - INFO - dataset -   doc: BENS’ early work focused extensively on initiatives aimed at U.S .- Soviet threat reduction and inefficiencies within support functions of the Department of Defense , e.g. , the maintenance and construction of military housing . The organization was also active in BRAC , championing the process and helping develop transition plans for locations affected by base closure . Over the last decade , the organization expanded their focus , addressing issues such as cybersecurity , domestic counterterrorism , and talent management . They have also broadened their partnerships to include other government agencies such as the Departments of State , Treasury , and Homeland Security ; the Office of the Director of National Intelligence ; and the unified combatant commands . Work provided by BENS members is pro bono . The organization 's current president and CEO is retired Air Force General Norton A. Schwartz , the 19th Chief of Staff of the U.S. Air Force , and their current chairman is Norman C. Chambers , former Chairman of NCI Building Systems . Prominent members include Jeff Bezos , John P. Morgridge , and Charles E. Phillips .
06/30/2021 11:39:39 - INFO - dataset -   input_ids: 0 163 12743 17 27 419 173 2061 18808 15 5287 3448 23 121 4 104 479 12 8297 1856 4878 8 11 38641 18828 624 323 8047 9 5 641 9 4545 2156 364 4 571 4 2156 5 4861 8 1663 9 831 2004 479 20 1651 21 67 2171 11 6823 2562 2156 2234 154 5 609 8 1903 2179 3868 708 13 3237 2132 30 1542 6803 479 2306 5 94 2202 2156 5 1651 4939 49 1056 2156 6477 743 215 25 13468 2156 1897 29756 2156 8 2959 1052 479 252 33 67 4007 4490 49 8670 7 680 97 168 2244 215 25 5 6748 27101 9 331 2156 4732 2156 8 9777 2010 25606 5 1387 9 5 1678 9 496 6558 25606 8 5 16681 5217 927 16388 479 6011 1286 30 163 12743 453 16 1759 13295 139 479 20 1651 128 29 595 394 8 1324 16 3562 1754 3177 1292 18378 83 4 16070 2156 5 753 212 1231 9 5721 9 5 121 4 104 4 1754 3177 2156 8 49 595 2243 16 11704 230 4 13962 2156 320 3356 9 9537 100 6919 5778 479 10772 19336 453 680 2321 17767 2156 610 221 4 4266 6504 15379 2156 8 3163 381 4 7431 479 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   attention_mask: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   token_type_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_mask for first ent: 0.0 0.25 0.25 0.25 0.25 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
06/30/2021 11:39:39 - INFO - dataset -   label for ent pair 0-1: True False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False
06/30/2021 11:39:39 - INFO - dataset -   label_mask for first ent: False True True True True True True True True True True True True True True True True True False False False False False False False False False False False False False False False False False False False False False False False False
06/30/2021 11:39:39 - INFO - dataset -   ent_ner: 0 1 1 1 1 0 0 0 0 0 0 0 0 2 2 2 0 0 2 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 0 1 0 0 1 1 0 0 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 6 6 6 6 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 0 0 0 0 0 0 6 6 6 6 0 0 0 0 1 1 1 1 0 0 0 0 0 6 6 0 6 6 6 6 6 6 0 0 6 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_pos: 0 1 1 1 1 0 0 0 0 0 0 0 0 2 2 2 0 0 3 0 0 0 0 0 0 0 0 0 0 0 4 4 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 5 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6 6 6 6 0 7 0 0 8 8 0 0 9 9 9 9 9 9 9 0 0 0 0 0 0 0 0 0 0 0 10 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 11 11 0 12 12 12 12 0 0 0 0 0 0 0 0 0 13 13 13 13 13 13 0 0 0 0 0 0 14 14 14 14 0 0 0 0 15 15 15 15 0 0 0 0 0 16 16 0 17 17 17 17 17 17 0 0 18 18 18 18 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_distance for first ent: 10 6 5 5 4 3 3 3 3 2 2 2 2 2 2 2 2 2 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10
06/30/2021 11:39:50 - INFO - dataset -   Writing example 500/3053
06/30/2021 11:39:50 - INFO - dataset -   RAM used: 56%
Killed

The code did not run on my 16GB RAM, 12GB x2 GeForce GTX TITAN X. It would get stuck while training at 0%.
So i tried to replicate the same in google colab but it kept getting killed even when I had 35GB of RAM.
I added a line to logger in dataset.py to show me RAM usage using psutil.
with every 500 examples, about 4GB of RAM is being used up.
Am I missing something?
06/30/2021 11:39:38 - INFO - dataset -   Writing example 0/3053
06/30/2021 11:39:38 - INFO - dataset -   RAM used: 23%
06/30/2021 11:39:39 - INFO - dataset -   *** Example ***
06/30/2021 11:39:39 - INFO - dataset -   guid: train-42
06/30/2021 11:39:39 - INFO - dataset -   doc: BENS’ early work focused extensively on initiatives aimed at U.S .- Soviet threat reduction and inefficiencies within support functions of the Department of Defense , e.g. , the maintenance and construction of military housing . The organization was also active in BRAC , championing the process and helping develop transition plans for locations affected by base closure . Over the last decade , the organization expanded their focus , addressing issues such as cybersecurity , domestic counterterrorism , and talent management . They have also broadened their partnerships to include other government agencies such as the Departments of State , Treasury , and Homeland Security ; the Office of the Director of National Intelligence ; and the unified combatant commands . Work provided by BENS members is pro bono . The organization 's current president and CEO is retired Air Force General Norton A. Schwartz , the 19th Chief of Staff of the U.S. Air Force , and their current chairman is Norman C. Chambers , former Chairman of NCI Building Systems . Prominent members include Jeff Bezos , John P. Morgridge , and Charles E. Phillips .
06/30/2021 11:39:39 - INFO - dataset -   input_ids: 0 163 12743 17 27 419 173 2061 18808 15 5287 3448 23 121 4 104 479 12 8297 1856 4878 8 11 38641 18828 624 323 8047 9 5 641 9 4545 2156 364 4 571 4 2156 5 4861 8 1663 9 831 2004 479 20 1651 21 67 2171 11 6823 2562 2156 2234 154 5 609 8 1903 2179 3868 708 13 3237 2132 30 1542 6803 479 2306 5 94 2202 2156 5 1651 4939 49 1056 2156 6477 743 215 25 13468 2156 1897 29756 2156 8 2959 1052 479 252 33 67 4007 4490 49 8670 7 680 97 168 2244 215 25 5 6748 27101 9 331 2156 4732 2156 8 9777 2010 25606 5 1387 9 5 1678 9 496 6558 25606 8 5 16681 5217 927 16388 479 6011 1286 30 163 12743 453 16 1759 13295 139 479 20 1651 128 29 595 394 8 1324 16 3562 1754 3177 1292 18378 83 4 16070 2156 5 753 212 1231 9 5721 9 5 121 4 104 4 1754 3177 2156 8 49 595 2243 16 11704 230 4 13962 2156 320 3356 9 9537 100 6919 5778 479 10772 19336 453 680 2321 17767 2156 610 221 4 4266 6504 15379 2156 8 3163 381 4 7431 479 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   attention_mask: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   token_type_ids: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_mask for first ent: 0.0 0.25 0.25 0.25 0.25 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
06/30/2021 11:39:39 - INFO - dataset -   label for ent pair 0-1: True False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False False
06/30/2021 11:39:39 - INFO - dataset -   label_mask for first ent: False True True True True True True True True True True True True True True True True True False False False False False False False False False False False False False False False False False False False False False False False False
06/30/2021 11:39:39 - INFO - dataset -   ent_ner: 0 1 1 1 1 0 0 0 0 0 0 0 0 2 2 2 0 0 2 0 0 0 0 0 0 0 0 0 0 0 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 0 1 0 0 1 1 0 0 1 1 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 0 6 6 6 6 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 0 0 0 0 0 0 6 6 6 6 0 0 0 0 1 1 1 1 0 0 0 0 0 6 6 0 6 6 6 6 6 6 0 0 6 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_pos: 0 1 1 1 1 0 0 0 0 0 0 0 0 2 2 2 0 0 3 0 0 0 0 0 0 0 0 0 0 0 4 4 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 5 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 6 6 6 6 0 7 0 0 8 8 0 0 9 9 9 9 9 9 9 0 0 0 0 0 0 0 0 0 0 0 10 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 11 11 0 12 12 12 12 0 0 0 0 0 0 0 0 0 13 13 13 13 13 13 0 0 0 0 0 0 14 14 14 14 0 0 0 0 15 15 15 15 0 0 0 0 0 16 16 0 17 17 17 17 17 17 0 0 18 18 18 18 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
06/30/2021 11:39:39 - INFO - dataset -   ent_distance for first ent: 10 6 5 5 4 3 3 3 3 2 2 2 2 2 2 2 2 2 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10 10
06/30/2021 11:39:50 - INFO - dataset -   Writing example 500/3053
06/30/2021 11:39:50 - INFO - dataset -   RAM used: 56%
Killed

This is expected because the current implementation first preprocess all examples in trainset into various input tensors, include input ids, structure mask, label ids etc, which should take certain time and consume quite large RAM.
The code is tested on 32GB V100 with much larger RAM than 16GB, so I'm afraid 16GB is not enough.
My advice is that, you can implement a sampling based dataset loader instead of preprocessing and caching the examples at one time before training, although this would somewhat slow the training. Here is what you do:

implement sample-based dataset in dataset.py

`class DocRED_Dataset(Dataset):
def init(self, examples, model_type, tokenizer, max_seq_length, max_ent_cnt, label_map):
self.examples = examples
self.model_type = model_type
self.tokenizer = tokenizer
self.max_seq_length = max_seq_length
self.max_ent_cnt = max_ent_cnt
self.label_map = label_map
def getitem(self, index):
example = self.examples[index]
feature = docred_convert_single_example_to_features(example,
self.model_type,
self.tokenizer,
self.max_seq_length,
self.max_ent_cnt,
self.label_map)
 return feature

def len(self):
return len(self.examples)`

where the docred_convert_single_example_to_features func can be modified from https://github.com/BenfengXu/SSAN/blob/main/dataset.py#L38. It takes a single example instead of list of examples, and return tensors instead of list of DocREDInputFeatures object.

`input_ids = torch.tensor(input_ids, dtype=torch.long)
attention_mask = torch.tensor(attention_mask, dtype=torch.long)
token_type_ids = torch.tensor(token_type_ids, dtype=torch.long)
ent_mask = torch.tensor(ent_mask, dtype=torch.float)
ent_ner = torch.tensor(ent_ner, dtype=torch.long)
ent_pos = torch.tensor(ent_pos, dtype=torch.long)
ent_distance = torch.tensor(ent_distance, dtype=torch.long)
structure_mask = torch.tensor(structure_mask, dtype=torch.long)
label = torch.tensor(label_ids, dtype=torch.long)
label_mask = torch.tensor(label_mask, dtype=torch.bool)
return (input_ids, attention_mask, token_type_ids, ent_mask, ent_ner, ent_pos,
ent_distance, structure_mask, label, label_mask)`

and finally, replace the load_and_cache_examples in run_docred.py as the following, call your new dataset class (do not forget to import from datset.py first).

`def load_and_cache_examples(args, tokenizer, evaluate=False, predict=False):
if args.local_rank not in [-1, 0] and not evaluate:
torch.distributed.barrier()  # Make sure only the first process in distributed training process the dataset, and the others will use the cache
processor = DocREDProcessor()
logger.info("Creating features from dataset file at %s", args.data_dir)
label_map = processor.get_label_map(args.data_dir)
if evaluate:
examples = processor.get_dev_examples(args.data_dir)
elif predict:
examples = processor.get_test_examples(args.data_dir)
else:
examples = processor.get_train_examples(args.data_dir)
if args.local_rank == 0 and not evaluate:
torch.distributed.barrier()  # Make sure only the first process in distributed training process the dataset, and the others will use the cache
dataset = DocRED_Dataset(example,
args.model_type,
tokenizer,
args.max_seq_length,
args.max_ent_cnt,
label_map)
return dataset`

If you have any further questions, feel free to ask here or via email, thanks for your attention to our work~

Thank you for such a thorough response! This solved the RAM consumption and code did go through, but I am facing a few CUDA/infra issues during training which might not be related to this issue. I will reach out to you should I need anything. Thanks again!

repo: BenfengXu/SSAN


text:
"You Died" screen upon opening user context menu[Bug]

Describe the Bug
When I click on my user icon from a text channel, it starts opening up my little user profile, but instead crashes. Other user profiles work, my doesn't.
Expected Behavior
Access to personal user popout
Screenshots

Discord Version
Stable, Mac OS 12.1
Additional Context
I set up my custom status to be the url of my portfolio, but i just renamed the "Discord" activity. It crashes even after disabling this.

Plugin issue not BD issue.

S K I L L issue

source: gharchive/issue

authors: SmolAlli afkvido risograph

repo: BetterDiscord/BetterDiscord

license_type: permissive

license_source: github-api


text:
feat: support retrying failed requests

📰 Summary of changes

What is the new functionality added in this PR?

This PR adds support for retrying failed network requests. In short, the following is not possible:

Specifying a RetryBehavior "globally" for any request made by the SturdyHttp instance
Specifying a RetryBehavior "locally" for a single request, which takes precedence over the RetryBehavior of the SturdyHttp instance
Relying on the default retry logic provided by defaultRetryClause
Specifying custom retry logic

Notable: This implementation does not rely on Interceptors to handle the actual retry logic as I personally have found retry logic via Interceptors to be problematic in the past. This could be changed if we find the implementation as written to not be satisfactory.
🧪 Testing done

What testing was added to cover the functionality added in this PR

Unit tests added and passing

Codecov Report
Attention: Patch coverage is 58.82353% with 56 lines in your changes are missing coverage. Please review.

Project coverage is 31.46%. Comparing base (141820e) to head (1301489).

Files
Patch %
Lines

lib/src/network_response.freezed.dart
20.00%
36 Missing :warning:

lib/src/sturdy_http_event_listener.freezed.dart
20.00%
12 Missing :warning:

lib/src/network_request.freezed.dart
33.33%
4 Missing :warning:

lib/src/retry_behavior.dart
83.33%
2 Missing :warning:

lib/src/sturdy_http.dart
96.55%
2 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main       #8      +/-   ##
==========================================
+ Coverage   29.25%   31.46%   +2.21%
==========================================
  Files           9       10       +1
  Lines         670      696      +26
==========================================
+ Hits          196      219      +23
- Misses        474      477       +3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

/no-platform

source: gharchive/pull-request

authors: btrautmann codecov-commenter

license: MIT


text:
Fix Tracking Layer

The cluster layer was not generated for layers of type tracking layer in function generate_cluster_tracks()
This was caused by bugs in 2 functions():

The label ids were wrongly taken from the cluster id column instead of the "labels" column in generate_cluster_tracks()
The generate_cluster_image() function did not map the label ids to the cluster ids in the case of tracking layers

This PR adds a bugfix for this. In order to do so also some recent changes regarding performance optimization had to be reverted (https://github.com/BiAPoL/napari-clusters-plotter/commit/1c2ec0f3669130721fcaab85293ef49eaaf0dc62, https://github.com/BiAPoL/napari-clusters-plotter/commit/dcd83c1ad5842d57506513f8139f28c531a85740, https://github.com/BiAPoL/napari-clusters-plotter/commit/5fee912a3a2dc71fda1c7e2d0b5271174eb2aeea, https://github.com/BiAPoL/napari-clusters-plotter/commit/0800f48b355124f57c4533d68e7440cb002f5250)
@thorstenwagner there is now a unit test for the cluster plotter in combination with tracking layers. Perhaps you could try, if you could make your performance optimizations with this as well?
The PR additionally adds some unit tests to check for bugs that had recently been introduced.

Okay so some testing on the very simple tracking example you implemented in the unit test showed me that actually the problem did not lie with the generate_cluster_immage function but indeed was caused by the wrong extraction of labels in the generate_cluster_tracks function.

The generate_cluster_image() function did not map the label ids to the cluster ids in the case of tracking layers

Regarding this: do you maybe have a simple tracking example dataset you might want to share which I can use for testing? After I have tested this in detail I will adjust the code and merge. Thanks for the unit tests again!

Hm, I'm a bit confused. I just checkout your branch, put my new generate_cluster_image back in and all tests passed.
collecting ... collected 4 items

../../../../../../../../../home/twagner/Projects/napari-clusters-plotter/src/napari-clusters-plotter/napari_clusters_plotter/_tests/test_utilities.py::test_map_array_3d
../../../../../../../../../home/twagner/Projects/napari-clusters-plotter/src/napari-clusters-plotter/napari_clusters_plotter/_tests/test_utilities.py::test_map_array_4d
../../../../../../../../../home/twagner/Projects/napari-clusters-plotter/src/napari-clusters-plotter/napari_clusters_plotter/_tests/test_utilities.py::test_generate_cluster_image
../../../../../../../../../home/twagner/Projects/napari-clusters-plotter/src/napari-clusters-plotter/napari_clusters_plotter/_tests/test_utilities.py::test_generate_cluster_tracks

======================== 4 passed, 3 warnings in 1.48s =========================

@stefanhahmann,
I have changed this PR a bit now, the generate cluster image function will be kept as the updated one from @thorstenwagner but the other bug fix will be included. I added your new tests to the test_utils.py file to have everything in one place and have removed duplicate tests and test cases that do not apply to the plotter (e.g. just testing the generate cluster image function on 4D data). I would love to hear if this now works for your data!

Hm, I'm a bit confused. I just checkout your branch, put my new generate_cluster_image back in and all tests passed.

Sorry for the confusion. I updated the respective unit test so that it actually fails, cf.: https://github.com/BiAPoL/napari-clusters-plotter/pull/286/commits/1d952d75f2fd288b8687a30803596084fc750144
The unit test did pass, since both timeframes included in it had all labels of the complete timelapse. If a single timeframe does not have all timeframes of the complete timelapse, it causes an array index out of bounds error.
@Cryaaa and @thorstenwagner in https://github.com/BiAPoL/napari-clusters-plotter/pull/286/commits/b6e5f60a5c6134f54c08e01b862742dbb2cd937e I have committed a suggestion how to fix this error with the new generate_cluster_image() version, but this breaks other tests: https://github.com/BiAPoL/napari-clusters-plotter/actions/runs/7212283328/job/19649645462 (test_cluster_image_generation_unsorted_non_sequential_labels() and test_generate_cluster_4d_labels())
Only with generate_cluster_image_old() all tests pass at the moment, cf.: https://github.com/BiAPoL/napari-clusters-plotter/pull/286/commits/595797719dcfda91f34a1dc399b16356e644c2fc and https://github.com/BiAPoL/napari-clusters-plotter/actions/runs/7212550935/job/19650463473
Currently, I have no good idea how to make the new version of generate_cluster_image() pass all tests.

With my fix, all tests pass.
The problem is that my method assumes that label_list only contains labels that are actually part of the label_image, which is not the case for your track data. I think it should, and the implementation of generate_cluster_tracks may be buggy as it produces the same label_list for each time point, regardless of the actual labels at that time point. However, I have not had a close look yet.

Regarding my last commit, its indeed almost twice as fast:

Regarding my very last commit of today: With that we reduce the it even to
4.42 µs ± 16 ns per loop (mean ± std. dev. of 7 runs, 100,000 loops each)
However, this is probably not relevant for the complete runtime.

I just want to mention: As soon this is merged, we can probably go back to the 'old' map_array function :-)

With my fix, all tests pass.

Thanks for the fix.

The problem is that my method assumes that label_list only contains labels that are actually part of the label_image, which is not the case for your track data.

Thanks for clarifying the assumptions of the new generate_cluster_image() method.

I think it should, and the implementation of generate_cluster_tracks may be buggy as it produces the same label_list for each time point, regardless of the actual labels at that time point. However, I have not had a close look yet.

With the old implementation it did not matter, which labels were contained at which timepoint. However, I agree, that including only those labels that exist in the considered timepoint should be included. generate_cluster_tracks() can be optimized in this regard. Thanks to you fix, functionality does not currently depend on this optimization.

@thorstenwagner, @stefanhahmann: I think we can merge this now that you have fixed some of the more specific details?

Lgtm, from my side you can merge.

authors: Cryaaa stefanhahmann thorstenwagner

repo: BiAPoL/napari-clusters-plotter


text:
Parallel unit ID handling in Modbus RTU

I'm submitting a ...  (check one with "x")
Problem

( x ) unexpected behavior

Current behavior
Modbus RTU (serial mode) encounters timeout issues when using multiple slaves and when "Unit ids in parallel" is enabled in modbus-client (which is enabled by default). Issue is solved when this option is disabled.
Expected behavior
As far as I know, Modbus RTU slaves should be addressed sequentially, not in parallel. Therefore this feature should not be allowed in serial mode.
Minimal reproduction of the problem with instructions

Configure for RTU operation.
Leave "Unit ids in parallel" checked.
Try to address multiple slaves at the same time.

Your Environment
Please tell us about your environment:

( x ) I am using just the Node-RED package and got modbus-serial package installed with it

Device :

( x ) Raspbian: custom

node-red-contrib-modbus version: v5.13.1

Node: (min. 10.x)
node --version = v12.16.3

it should get switched off on change to serial, but it should be free to configure

could reopen with a PR

I am trying to use multiple solo temperature controllers in series with 1 rs485 - usb. I'm not getting any errors in node red but I'm also not getting outputs. I am trying to extract data using the correct unitids and the correct parameter. Any ideas why?

a) do not use parallel unit-ids option - this just for TCP
b) try to start with one, then two etc.
c) try to play with the delay of the queue to send the messages with some delay like 200 (ms)

authors: biancode boraozgen keshavvasudeva

repo: BiancoRoyal/node-red-contrib-modbus


text:
fix eol from crlf to lf

Fixed the Dockerfile end of line character from crlf to  lf to align with the already existing config in .gitattrbutes file.
Author: @samueljd

Note: recreates Pull Request history from previous repository.


text:
Screenshots/hosted example

Hi, I might want to use this project, but seeing the website in action would be great (or some Screenshots/video of it in the ReadMe) to make a decision.

Thanks for the suggestion - I added a preview of the GUI to the readme.

authors: Bibo-Joshi Poolitzer

repo: Bibo-Joshi/led-strip-controller


text:
LLM node can't find model locations

Hi Big Idea Technology
I already installed  your node and also create LLM checkpoints folder but so far the node cant find the checkpoint. What should I do
Please support me, thank you so much

Hey,
are you created folder ComfyUI/models/LLM_checkpoints ? Also do you click refresh after downloading model?

I create both folder since I use ComfyUI portable version I have 2 ComfyUI folders but your node still does not find the model in both cases. Here are 2 folders location:

Please have a look, thank you.

but you need to download whole folder from huggingface not only model file.

It's working thank you so much


text:
support limit and offset query params

In CRUD GET over a collection the query params offset and limit are usually used to control pagination.
For example, limit is in the example for http://swagger.io/specification/#parametersDefinitionsObject
swagger-express-middleware seems to handle offset=0 as a search for resources if the field offset having the value 0.

a basic implementation would look like query-collection.js#filter()
`
// Build the filter object
var offset = undefined, limit = undefined;
var filterCriteria = {data: {}};
queryParams.forEach(function(param) {
if (req.query[param.name] !== undefined) {
if (param.name === "offset" && param.type === "integer") {
offset = req.query[param.name];
} else if (param.name === "limit" && param.type === "integer") {
limit = req.query[param.name];
} else {
setDeepProperty(filterCriteria.data, param.name, req.query[param.name]);
}
}
});
  if (offset !== undefined || limit !== undefined) {
    util.debug('Filtering pagination offset %d, limit %d', offset || 0, limit || resources.length);
    if (offset === undefined) {
      resources.length = limit;
    } else {
      if (limit !== undefined) {
        resources = resources.slice(offset, offset + limit);
      } else {
        resources = resources.slice(offset);
      }
    }
  }

`

:+1:

authors: fheidrich fragsalat

license: mit

license_source: bigquery


text:
Fall back to example array mock data if spec provides one.

This is just a proof of concept that demonstrates serving up an example array item if the schema provides one.
Note: this will fill in any nested objects in the schema example, but will NOT recursively fill in nested arrays.  If anyone knows where to look to enable that, please let me know.
You could imagine controlling this more explicitly with an 'x-auto-generate' property, for example...
Seeking feedback.

Thanks for submitting this.  I added some unit tests around it and changed it up a bit to be more consistent with the way default and example works elsewhere in the code.  The main change from your code is that the default or example needs to be on the schema itself, rather than on schema.items.  Of course, you can use a $ref to point from schema.example to schema.items.example if you want.

Thank you... Do you know how to address the issue around recursively filling in nested arrays with example items if provided?  Or where to look to fix that?

The example is just used as a literal value, so whatever it points to is exactly what will be returned.  So, you have complete control over what gets returned.  You can populate the returned object as deeply as you want.  For example:
paths:
  /people:
    get:
      responses:
        200:
          schema:
            type: array
            items:
              $ref: "#/definitions/person"
            example:
              - firstName: John
                lastName: Doe
                age: 60
                children:
                  - firstName: Sarah
                    lastName: Smith
                    age: 32
                  - firstName: Andrew
                    lastName: Doe
                    age: 37
                    children:
                      - firstName: Johnny
                        lastName: Doe
                        age: 7
                      - firstName: Susie
                        lastName: Doe
                        age: 6

You can even take advantage of $ref pointers to re-use values across multiple examples:
paths:
paths:
  /people:
    get:
      description: returns all people
      responses:
        200:
          schema:
            type: array
            items:
              $ref: "#/definitions/person"
            example:
              - $ref: "#definitions/johnDoe"

  /people/{name}:
    get:
      description: returns one person
      responses:
        200:
          schema:
            $ref: "#definitions/person"

definitions:
  person:
    type: object
    properties:
      firstName:
        type: string
      lastName:
        type: string
      age:
        type: number
      children:
        type: array
        items:
          $ref: "#/definitions/person"
    example:
      $ref: johnDoe

  johnDoe:
    firstName: John
    lastName: Doe
    age: 60
    children:
      - $ref: sarahSmith
      - $ref: andrewDoe

  sarahSmith:
    firstName: Sarah
    lastName: Smith
    age: 32

  andrewDoe:
    firstName: Andrew
    lastName: Doe
    age: 37
    children:
      - $ref: johnnyDoe
      - $ref: susieDoe

  johnnyDoe:
    firstName: Jonny
    lastName: Doe
    age: 7

  susieDoe:
    firstName: Susie
    lastName: Doe
    age: 6

authors: BigstickCarpet SteveNewhouse


text:
Embedding gitter in the main site

@BillMills Sidecar is a new feature that gitter has launched which allows you to embed the feed in your website (a bit like twitter feeds, I'm assuming). Should we try and embed it in the main resbaz website?
https://sidecar.gitter.im/

I'm super impressed, this is one of the slickest widgets I've ever seen.

@BillMills Do you think we should embed the Gitter feed next to the Twitter feed in the "contact ResBaz" part of the website?

We could do - but I dunno, is that actually better than the pop-over? The pop-over has the advantage of being orthogonal to the rest of the layout - no wondering if things will break on whatever resolution. I also like that the 'join chat' button follows you around, makes it stick out a bit. I dunno, I'm mostly ambivalent on this - if people have a burning desire for an explicit embed, we can do that.

Actually, no, you're right. The pop-over is much better!

authors: BillMills DamienIrving

repo: BillMills/resbaz-site


text:
App keeps reconnecting

Hi,
I have seen that there were some issues raised the last weeks about some connection issues.
Since ~3 weeks I also have troubles.
The App initially connects, stays connected for a few seconds, then disconnects.
Then after a few seconds it tries again. This happens in a loop.
I have attached a video.
@hufman Has anything happend that you know of ?
https://user-images.githubusercontent.com/10863304/217666740-53390805-0752-43ab-80c5-8503c1f3a3c4.mp4

I usually see that when MyBMW is connected over USB.
What does the car's connection status show? I would expect the Apps checkbox to keep checking and unchecking, showing MyBMW is having troubles staying connected.

As most of the time: Update is the best defence.
I updated to yesterdays nightly build of 1.4.1 and everything is working perfectly again..
sorry to have bothered you ._.

authors: Vasmares hufman

repo: BimmerGestalt/AAIdrive


text:
🛑 S-BIAD531 is down

In 51b5a78, S-BIAD531 (https://www.ebi.ac.uk/biostudies/files/S-BIAD531/Zebrafish_ML_Archive/outputs/2020.07.30_FishDev_WT_01_1/obj_probs/FishDev_WT_01_1_MMStack_A10-Site_0.ome_Object Probabilities.tiff_results.txt) was down:

HTTP code: 0
Response time: 0 ms

Resolved: S-BIAD531 is back up in e8a92c9 after 7 minutes.

repo: BioImage-Archive/upptime


text:
🛑 S-BIAD531-TFER-HTTP is down

In 23cb260, S-BIAD531-TFER-HTTP (https://ftp.ebi.ac.uk/biostudies/fire/S-BIAD/531/S-BIAD531/Files/Zebrafish_ML_Archive/outputs/2020.07.30_FishDev_WT_01_1/obj_probs/FishDev_WT_01_1_MMStack_A10-Site_0.ome_Object Probabilities.tiff_results.txt) was down:

HTTP code: 0
Response time: 0 ms

Resolved: S-BIAD531-TFER-HTTP is back up in 9062602 after 7 minutes.


text:
ssGSEA FDR q value > 1

Hi,
I ran ssGSEA with GSEApy unsing the MutSigDB hallmarks gene set and everything looks OK, except that for some of the gene sets I get FDR q values > 1.
Is this a bug?
Thanks,
Alejandro

@alejandro-jimenezsanchez ,which version did you use?
try to install the latest version of GSEApy(v0.8.3), which fixed this issue.

I see, I had version 0.8.1. Thanks!!! And thanks for creating such a nice package :)!

authors: BioNinja alejandro-jimenezsanchez

repo: BioNinja/GSEApy


text:
Fix a wrong configuration in the Page resource

Fix a wrong configuration in the declaration of the Page resource, causing an 500 error when searching a page in admin. The type field does not exists in the entity, it should be removed.

Q
A

Bug fix?
yes

New feature?
no

BC breaks?
no

Deprecations?
no

Related tickets
fixes #140

License
MIT

Thanks a lot!

authors: bitbager johnkrovitch

repo: BitBagCommerce/SyliusCmsPlugin


text:
Error list index out of range makes the bot crash

2018-02-23 17:15:09 Error list index out of range
Traceback (most recent call last):
  File "lendingbot.py", line 94, in <module>
    Lending.lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 254, in lend_all
    lend_all()
  File "/root/poloniexlend/modules/Lending.py", line 252, in lend_all
    usable_currencies += lend_cur(cur, total_lent, lending_balances, ticker)
  File "/root/poloniexlend/modules/Lending.py", line 449, in lend_cur
    orders = construct_orders(active_cur, active_bal, active_cur_total_balance, ticker)  # Build all potential orders
  File "/root/poloniexlend/modules/Lending.py", line 350, in construct_orders
    top_rate, bottom_rate = get_gap_mode_rates(cur, cur_active_bal, cur_total_balance, ticker)
  File "/root/poloniexlend/modules/Lending.py", line 404, in get_gap_mode_rates
    top_rate = get_gap_rate(cur, top_depth, order_book, cur_total_balance, True)
  File "/root/poloniexlend/modules/Lending.py", line 337, in get_gap_rate
    return Decimal(order_book['rates'][i])
IndexError: list index out of range

v318
 Unhandled error, please open a Github issue so we can fix it!

same here. Once this happens then bot stops working.
2018-03-04 12:10:06 Error list index out of range
Traceback (most recent call last):
File "lendingbot.py", line 94, in
Lending.lend_all()
File "/poloniexlendingbot/modules/Lending.py", line 252, in lend_all
usable_currencies += lend_cur(cur, total_lent, lending_balances, ticker)
File "/poloniexlendingbot/modules/Lending.py", line 449, in lend_cur
orders = construct_orders(active_cur, active_bal, active_cur_total_balance, ticker)  # Build all potential orders
File "/poloniexlendingbot/modules/Lending.py", line 350, in construct_orders
top_rate, bottom_rate = get_gap_mode_rates(cur, cur_active_bal, cur_total_balance, ticker)
File "/poloniexlendingbot/modules/Lending.py", line 410, in get_gap_mode_rates
top_rate = get_gap_rate(cur, gap_top, order_book, cur_total_balance)
File "/poloniexlendingbot/modules/Lending.py", line 337, in get_gap_rate
return Decimal(order_book['rates'][i])
IndexError: list index out of range
v318
Unhandled error, please open a Github issue so we can fix it!

Duplicate of #566
Really needs to be handled/fixed

authors: Evanito JCBauza SloRunner

repo: BitBotFactory/poloniexlendingbot


text:
🛑 BitDEVil2K16 Club is down

In bc03fab, BitDEVil2K16 Club (https://bitdevil2k16.club) was down:

HTTP code: 521
Response time: 252 ms

Resolved: BitDEVil2K16 Club is back up in 2994dfd after 15 minutes.


text:
Ct/ci

This PR is going to try and get Travis working without puking on the tests. It'll do this by temporarily commenting out a lot of the tests.

:tada: This PR is included in version 1.0.0 :tada:
Your semantic-release bot :package::rocket:

authors: cgcardona christroutner


text:
Run initial usability tests for Complaint Screener template

What we want to know:

Can non-developers figure it out and use this tool?
What problems or questions do they run into?

Who we should test:

Two designers who maybe have already created GH accounts but are not super familiar with the platform.
One aspiring developer (I have a potential candidate.)

What needs to be done for this issue:

Write up a basic test plan/script.
Schedule people and run tests.
Share out high-level findings (and links to recordings).

FigJam journey maps from first round of usability testings.
Summary of most important issues to address next can be viewed there, as well.

authors: bnaolu pglevy

repo: Bixal/rapid-response-team

license: Unlicense


text:
Hallucination

While the pdf generation is excellent and fast, i realized some minor error, the book was about crop diseases, and somewhere in the middle the books switched to human diseases for a few pages then back to animal diseases,is it a possible issue with the model or maybe my prompt was not clear enough

You can try switching the model to experiment. Based on what you described, it sounds like the outline generated included an irrelevant section about human and animal diseases. Therefore, try swapping the outline generation model under the custom settings on the left sidebar.  Additionally as you mentioned, you can provide more precise content for the models, which will also improve output.

authors: Bklieger gentonje

repo: Bklieger/groqnotes


text:
Moto G 4 broken layout

Hi, when i visit the site from my device it seems to be broken:

Any way to fix it ?

@erikcunha  Can you please let know what you was expecting? When I tested with same device it is working smooth.

I guess it was fixed already but the white bar on the bottom, it shouldn't be there.

authors: erikcunha greatpython


text:
FEAT : Dockerfile과 django.yml을 이용한 nginx 반자동 CICD 기능 추가

추가된 기능은 다음과 같습니다
django.yml을 이용한 깃허브 CI/CD

nginx가 따로 구축된 Naver Cloud Platform Ubuntu Server 내에서 docker를 이용한 우리 레포의 CI/CD 기능 테스트완료.
django.yml이 그 기능을 담당함.

Dockerfile

CICD를 담당하는 django.yml 파일 내에서 docker로 우리 레포를 이미지로 빌드한 후 내보내는 과정을 담당함.

오 ~ CICD 해결 축하드립니다
궁금증이 있는데요! (몰라서 물어봄) manage.py에서
dotenv.read_dotenv()
이 부분 아예 날려도 도텐브 파일 잘 읽히나요? 제 로컬에서는 날리고 돌렸을 때 와리가리한 모습을 보여서 여쭤봅니덩

오 ~ CICD 해결 축하드립니다 궁금증이 있는데요! (몰라서 물어봄) manage.py에서 dotenv.read_dotenv() 이 부분 아예 날려도 도텐브 파일 잘 읽히나요? 제 로컬에서는 날리고 돌렸을 때 와리가리한 모습을 보여서 여쭤봅니덩

window, ubuntu 개발서버 실행에는 문제가 없어보입니다.
다만, 저게 user 로그인 관련 pr에 추가돼있던거라 로그인 회원가입 관련 api에서도 문제가 없을지는 잘 모루게소요

오 ~ CICD 해결 축하드립니다 궁금증이 있는데요! (몰라서 물어봄) manage.py에서 dotenv.read_dotenv() 이 부분 아예 날려도 도텐브 파일 잘 읽히나요? 제 로컬에서는 날리고 돌렸을 때 와리가리한 모습을 보여서 여쭤봅니덩

window, ubuntu 개발서버 실행에는 문제가 없어보입니다. 다만, 저게 user 로그인 관련 pr에 추가돼있던거라 로그인 회원가입 관련 api에서도 문제가 없을지는 잘 모루게소요

오호 그렇다면 구현 이후에 한 번 더 체크하면 좋겠군요 답변 감사링입니다~
머지 하도록 하겠심니더.


text:
Not showing

Hi Guys
I know this is probably a simple thing but if I spin up a complete new solution and go through the quick setup I do not see the diagram. When I inspect the page I see the nodes has been rendered inside the HTML page however they are not visible. What am I missing?

Just to add a bit more context, here is the component...

And Then Code Behind

This was a CSS Issues had to add this to my page
<style>     .diagram-canvas {         width: 100%;         height: 100%;         position: absolute;         outline: none;         overflow: hidden;         cursor: -webkit-grab;         cursor: grab;         touch-action: none;     } </style>


text:
Improved wait icons for plots

Data requests for plots is very slow. #110  A potential usability improvement can be a progress indicator or enhanced waiting visual

This has been, but don't know where and when

repo: BlinkUX/ISB-LSDF


text:
Morphology level radial distance features use the soma as reference point

When a morphology object is used the radial distance features will use the soma as the reference point for calculating the distances, not the root of each neurite.
#982

@adrien-berchet , is this ok to merge?

@adrien-berchet , is this ok to merge?

For me it is ok

Thanks!

authors: adrien-berchet eleftherioszisis

repo: BlueBrain/NeuroM


text:
Self hosted web client

Is there anyway to self host the web client?

You can download the source from https://github.com/BlueBubblesApp/web

Awesome thanks for the direction

repo: BlueBubblesApp/bluebubbles-app


text:
🛑 hosted-PalmettoGBA is down

In 8b47178, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in 56a0654.


text:
🛑 hosted-PalmettoGBA is down

In bc9e786, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in b3f4bf6.


text:
🛑 hosted-PalmettoGBA is down

In 39d0b5a, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in 2305662.


text:
🛑 hosted-PalmettoGBA is down

In fe19697, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in bbe59f1.


text:
🛑 hosted-PalmettoGBA is down

In e7df512, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in 69dc8cb.


text:
🛑 hosted-PalmettoGBA is down

In 012eeba, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in 7b2df6b after 22 minutes.


text:
🛑 hosted-PalmettoGBA is down

In be885e2, hosted-PalmettoGBA (https://palmettogba.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: hosted-PalmettoGBA is back up in d84ecaa after 9 minutes.


text:
SOCKS5 PROXY

Could you please add SOCKS5 proxy option to it ? thanks

Hi, this should already be possible with the right syntax for the proxy url as shown here.
Go to Options -> Settings -> Download and fill in a proxy url with this format socks5://username:password@hostname:port/. Vividl passes this string directly to youtube-dl, so this should work. I haven't tested it yet though.

authors: alxnull oneflowa

repo: Bluegrams/Vividl


text:
vividl crash, not sure why 0.7.0.0

vividl 0.7 crashed, saved a .dmp file vividl.exe.5016.dmp, opened in visual studio 2019 but perhaps you could debug it
Vividl.exe.5016.zip

another crash, this time while a video was converting.  :(  I hear the computer working hard in the background, so hopefully my file will still be fully converted.  But meanwhile, my whole playlist that I was downloading is no longer saved.
[2023-09-06 16:21] An unhandled exception caused the application to terminate unexpectedly.
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.ArgumentNullException: Value cannot be null.
Parameter name: source
at System.Linq.Enumerable.Where[TSource](IEnumerable1 source, Func2 predicate)
at Vividl.Model.YoutubeDLExtensions.GetVideoOnlyFormats(VideoData videoData)
at Vividl.Model.YoutubeDLExtensions.SelectSingleFormat(VideoData videoData, String formatSpecifier)
at Vividl.Model.YoutubeDLExtensions.SelectFormat(VideoData videoData, String formatSpecifier)
at Vividl.ViewModel.FormatSelectionViewModel.applySelectedDownloadOption()
at Vividl.ViewModel.FormatSelectionViewModel..ctor(VideoViewModel videoVm)
at Vividl.ViewModel.VideoViewModel.<.ctor>b__9_0(Action1 callback)    --- End of inner exception stack trace ---    at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)    at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)    at GalaSoft.MvvmLight.Helpers.WeakAction1.Execute(T parameter) in C:\Users\lbugn\Documents\MVVMLight\GalaSoft.MvvmLight\GalaSoft.MvvmLight (PCL)\Helpers\WeakActionGeneric.cs:line 226
at GalaSoft.MvvmLight.CommandWpf.RelayCommand`1.Execute(Object parameter) in C:\Users\lbugn\Documents\MVVMLight\GalaSoft.MvvmLight\GalaSoft.MvvmLight (PCL)\Command\RelayCommandGeneric.cs:line 243
at MS.Internal.Commands.CommandHelpers.CriticalExecuteCommandSource(ICommandSource commandSource, Boolean userInitiated)
at System.Windows.Controls.Primitives.ButtonBase.OnClick()
at System.Windows.Controls.Button.OnClick()
at System.Windows.Controls.Primitives.ButtonBase.OnMouseLeftButtonUp(MouseButtonEventArgs e)
at System.Windows.UIElement.OnMouseLeftButtonUpThunk(Object sender, MouseButtonEventArgs e)
at System.Windows.Input.MouseButtonEventArgs.InvokeEventHandler(Delegate genericHandler, Object genericTarget)
at System.Windows.RoutedEventArgs.InvokeHandler(Delegate handler, Object target)
at System.Windows.RoutedEventHandlerInfo.InvokeHandler(Object target, RoutedEventArgs routedEventArgs)
at System.Windows.EventRoute.InvokeHandlersImpl(Object source, RoutedEventArgs args, Boolean reRaised)
at System.Windows.UIElement.ReRaiseEventAs(DependencyObject sender, RoutedEventArgs args, RoutedEvent newEvent)
at System.Windows.UIElement.OnMouseUpThunk(Object sender, MouseButtonEventArgs e)
at System.Windows.Input.MouseButtonEventArgs.InvokeEventHandler(Delegate genericHandler, Object genericTarget)
at System.Windows.RoutedEventArgs.InvokeHandler(Delegate handler, Object target)
at System.Windows.RoutedEventHandlerInfo.InvokeHandler(Object target, RoutedEventArgs routedEventArgs)
at System.Windows.EventRoute.InvokeHandlersImpl(Object source, RoutedEventArgs args, Boolean reRaised)
at System.Windows.UIElement.RaiseEventImpl(DependencyObject sender, RoutedEventArgs args)
at System.Windows.UIElement.RaiseTrustedEvent(RoutedEventArgs args)
at System.Windows.UIElement.RaiseEvent(RoutedEventArgs args, Boolean trusted)
at System.Windows.Input.InputManager.ProcessStagingArea()
at System.Windows.Input.InputManager.ProcessInput(InputEventArgs input)
at System.Windows.Input.InputProviderSite.ReportInput(InputReport inputReport)
at System.Windows.Interop.HwndMouseInputProvider.ReportInput(IntPtr hwnd, InputMode mode, Int32 timestamp, RawMouseActions actions, Int32 x, Int32 y, Int32 wheel)
at System.Windows.Interop.HwndMouseInputProvider.FilterMessage(IntPtr hwnd, WindowMessage msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at System.Windows.Interop.HwndSource.InputFilterMessage(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndWrapper.WndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndSubclass.DispatcherCallbackOperation(Object o)
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)
at System.Windows.Threading.Dispatcher.LegacyInvokeImpl(DispatcherPriority priority, TimeSpan timeout, Delegate method, Object args, Int32 numArgs)
at MS.Win32.HwndSubclass.SubclassWndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam)
at MS.Win32.UnsafeNativeMethods.DispatchMessage(MSG& msg)
at System.Windows.Threading.Dispatcher.PushFrameImpl(DispatcherFrame frame)
at System.Windows.Threading.Dispatcher.PushFrame(DispatcherFrame frame)
at System.Windows.Application.RunDispatcher(Object ignore)
at System.Windows.Application.RunInternal(Window window)
at System.Windows.Application.Run(Window window)
at Vividl.App.Main()


text:
[IBMQ Backend] The load_qasm_string() function is deprecated and will be removed in a future release. Instead use QuantumCircuit.from_qasm_str().

Qiskit specifications changed.

The load_qasm_string() function is deprecated and will be removed in a future release. Instead use QuantumCircuit.from_qasm_str().

#68

repo: Blueqat/Blueqat


text:
fix: fix license classifier

Hey 👋🏻,
I am currently looking into licensing at Home Assistant, and I found that we could not detect the license of this library properly. According to pyproject.toml documentation about the license field:

If you are using a standard, well-known license, it is not necessary to use this field. Instead, you should use one of the classifiers starting with License ::. (As a general rule, it is a good idea to use a standard, well-known license, both to avoid confusion and because some organizations avoid software whose license is unapproved.)

If you could do a release after this PR, and maybe bump in Home Assistant, that would be awesome :)

Looks good thanks :)

repo: Bluetooth-Devices/xiaomi-ble


text:
Videos Not in Chronological Order

In versions .87 through .89 the videos in the list for a given event do not show up in chronological order.

@tapr00t are you still seeing this issue with the current version?

yeah I still have the problem, videos won't play.  I tried installing the Microsoft HEVC codec, but I don't think chrome uses it (which I'm guessing your app is using to render).  The only way I can view them is if I open the files directly with a video player, or this site - but only with edge browser after installing that Microsoft codec:
https://sentrycam.appspot.com/

Closing due to non-response please feel free to re-open if problem still exists.

repo: BobStrogg/teslacam-browser


text:
Uka starter på søndag

Closes #16

Enig, uka slayer

authors: BobTheShoplifter ludeeus

repo: BobTheShoplifter/HomeAssistant-Posten


text:
Omnikey 3021 support

Hello, tnx for developing this plugin!
I'm trying to use it to encrypt KeePass db using a self-signed digital id stored on a smartcard.
I'm using Omnikey 3021 to read the sc and SafeSign Token Administration Utility to manage it. I used openssl following to https://www.scottbrady91.com/openssl/creating-rsa-keys-using-openssl to create the digital id (pfx) and successifully imported it to the sc.
But when I go on Browse certificate store, the sc is read (it blinks 3 times) but PIN isn't requested and the Windows Security dialog opens saying no certificate is available.
For testing, I also followed https://www.sonicwall.com/support/knowledge-base/how-can-i-import-certificates-into-the-ms-windows-local-machine-certificate-store/170504615105398/ to import the certificate do Windows local store. I imported it to Current User and then it was found.
Might I be doing anything wrong? Maybe Omnikey isn't supported?

Hello I'm happy that you like the plugin  :)
Do you have those Windows Services running / configured as I have on screenshot?

Because Windows OS uses some common communication so it should work.

authors: FrantisekBodnar HikariWS


text:
process is now an EventEmitter

It can now be used to trigger and catch uncaughtException for example

there wasn't any yet

Ok, no worries. Next time, let's ensure to add an issue before creating a PR.

authors: christianklotz mathieudutour

repo: BohemianCoding/SketchAPI


text:
Email confirmation assigns role

Describe the feature you'd like
Would it be possible to change the registration so that you get a role assigned only after you have confirmed your email?
Describe the benefits this feature would bring to BookStack users
This could prevent spam, currently there are few possibilities.
e.g.:
Without confirmed email you would then only have view rights and if you confirm them you get editor.

Hi @Tealk,
Sorry for the late response, just coming across this while reviewing some other issues.
I'm not sure I see the purpose of this? When email confirmation is enabled, an account can't really be used to browse a BookStack instance so a difference in roles pre/post confirmation should not matter.
Recently I've made changes to the auth process so a user won't even appear logged in, in any manner, until they confirm their email.

Sorry for the late response

No problem, thanks for your answer.

Recently I've made changes to the auth process so a user won't even appear logged in, in any manner, until they confirm their email.

If this is the case, then my request is no longer necessary.

authors: Tealk ssddanbrown

repo: BookStackApp/BookStack


text:
Is it possible to hide "Recent Activity" and "Recently Updated Pages" in public view?

Hi,
Is it possible to hide "Recent Activity" and "Recently Updated Pages" in public view?
thanks

Hello,
I'd like to add to that, can you hide the timestamps (like "created before" or "updated") and the users who created/updated content?
Thanks.

There is no way to do these via settings or options provided within BookStack.
The Hacking BookStack page does provide some ways you could customize the UI though: https://www.bookstackapp.com/docs/admin/hacking-bookstack/
The "Custom HTML Head Content" setting allows you to add custom CSS to control the UI where needed otherwise you could use the Theme system to do some more advanced overriding of view content.
If you're attempting to hide these things in just the public view, instead of for all users, then that will be more challenging.

authors: ChrisB101 ssddanbrown wayne-cec


text:
Collapsed Sidebar

Would like to Know ho to create a Collapsed Sidebar for my main content to be enlarged on screen and the sidebar menu to be Shrinked.

@joaocuttrim Could you please explain you requirement in detail?

authors: bootstrapdash-team joaocuttrim


text:
🛑 Supervision BRS is down

In 92dca86, Supervision BRS ($SUPERVISION_BRS_URL) was down:

HTTP code: 525
Response time: 301 ms

Resolved: Supervision BRS is back up in 4200836 after 11 minutes.

repo: BorneRecharge/uptime


text:
🛑 Portail client is down

In eba9e28, Portail client (https://portail.bornerecharge.fr/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Portail client is back up in 677c34e after 1 hour, 25 minutes.


text:
What is delay_ms in bmi160_dev struct for?

I can pass a user defined function pointer to the bmi160_delay_fptr_t member of bmi160_dev.
But I am not able to map it's usage or to what purpose it is used for.
It will help immensely if I can get an explanation.

Hi @sayan000,
Hope this example gist helps.

Thanks..
I also wanted to know why delay_ms is passed around. Like whether the callbacks are called after this much delay or something like that?

Hi @sayan000,
The callback is a way for the API to wait for a period amount of milliseconds. Since the execution time differs across platforms, this callback is required to make sure the API accesses the sensor with the correct delays between calls.


text:
feat(tasks): add parser benchmark

On my 2.6 GHz 6-Core Intel Core i7 laptop.
group                    base
-----                    ----
parser/babylon.max.js    1.00    104.9±3.14ms    98.4 MB/sec
parser/d3.js             1.00     13.1±1.51ms    41.7 MB/sec
parser/lodash.js         1.00      4.5±0.34ms   113.0 MB/sec
parser/pdf.js            1.00      7.4±0.45ms    54.0 MB/sec
parser/typescript.js     1.00    104.3±2.99ms    92.3 MB/sec

Oh wow this is impressive!
It's more than twice as fast as Rome.
Rome
d3.min.js, Total Time: 22.893581ms
typescript.js, Total Time: 218.082348ms

Oxc
parser/typescript.js    time:   [75.942 ms 76.154 ms 76.362 ms]
                        thrpt:  [125.98 MiB/s 126.32 MiB/s 126.67 MiB/s]
parser/d3.js            time:   [9.3791 ms 9.3873 ms 9.3969 ms]
                        thrpt:  [58.134 MiB/s 58.194 MiB/s 58.245 MiB/s]

authors: Boshen MichaReiser

repo: Boshen/oxc


text:
🛑 bestway is down

In e256d2a, bestway (https://bestway.botslovers.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: bestway is back up in 91c0244 after 36 minutes.

repo: Botslovers-SL/uptime


text:
🛑 spell is down

In 0155510, spell (https://spell.botslovers.com/spell/spells) was down:

HTTP code: 502
Response time: 487 ms

Resolved: spell is back up in ffdca9f.


text:
Only one Trash entry allowed?

Hay,
how could I create multiple entries?
I have Bio Waste, Paper, ...
Next ist how can I find the filter Patterns?
Thx

Hi, Yes, you can have multipe entities like this for example:
- platform: abfallplus
  name: Bio Tonne
  key: 5b0384147b5bc055c30fee1fb6db6f76
  municipality: 270
  street: 15720
  trash_ids: "51, 17, 48, 31, 43, 20, 321"
  pattern: Biotonne

- platform: abfallplus
  name: Blaue Tonne
  key: 5b0384147b5bc055c30fee1fb6db6f76
  municipality: 270
  street: 15720
  trash_ids: "51, 17, 48, 31, 43, 20, 321"
  pattern: Blaue Tonne

- platform: abfallplus
  name: Restmüll
  key: 5b0384147b5bc055c30fee1fb6db6f76
  municipality: 270
  street: 15720
  trash_ids: "51, 17, 48, 31, 43, 20, 321"
  pattern: Restmüll

- platform: abfallplus
  name: Gelber Sack
  key: 5b0384147b5bc055c30fee1fb6db6f76
  municipality: 270
  street: 15720
  trash_ids: "51, 17, 48, 31, 43, 20, 321"
  pattern: Gelber Sack

The best way to get your filters is that you go to your municipality's waste management website and download the ICS via the webinterface. There is usually a dropdown which lets you select the fileformat you want to export.
When you open the ICS in a texteditor you get a lot of VEVENTs like this:
BEGIN:VEVENT
DTSTART;VALUE=DATE:20220112
DTEND;VALUE=DATE:20220113
DTSTAMP:20220324T061608Z
UID:da009cc9d7f465bb08be88b8be8bd7a9
CREATED:20220101T090000Z
DESCRIPTION:Gelber Sack nicht vergessen!
LAST-MODIFIED:20220101T090000Z
LOCATION:Gemeinde
SEQUENCE:0
STATUS:CONFIRMED
SUMMARY:Gelber Sack
TRANSP:TRANSPARENT
END:VEVENT

The integration trys to match the SUMMARY key with what you gibe it as a pattern. This can be a regex but the exact words work as well.
So for the above snippet with SUMMARY:Gelber Sack you can set your pattern to Gelber Sack

authors: Bouni stockklauser

repo: Bouni/abfallplus


text:
请问能否支持单个分享链接生成json文件？

还有，好像没看到trojan和ss协议支持

本项目是根据订阅链接来生成 json 文件的，不知你指的分享链接是什么？
另外 ss 协议是支持的，trojan 目前还不支持，待开发

关于 trojan 的支持转到这里跟踪吧 #19

authors: Bpazy pizixi

repo: Bpazy/xraysub


text:
EXC BAD ACCESS when applying filter on a video file(.mp4).

Hello Brad,
i m facing  EXC BAD ACCESS error while i am applying sepia filter on a video file. Here is my code:-
NSString *path = [[NSBundle mainBundle] pathForResource:@"test123" ofType:@"mp4"];
NSURL *url = [NSURL fileURLWithPath:path];
GPUImageMovie *movieFile = [[GPUImageMovie alloc] initWithURL:url];
movieFile.runBenchmark = YES;
movieFile.playAtActualSpeed = YES;
[movieFile prepareForImageCapture];
GPUImageSepiaFilter *filter = [[GPUImageSepiaFilter alloc] init];

[movieFile addTarget:filter];

NSString *pathToMovie = [NSHomeDirectory() stringByAppendingPathComponent:@"Documents/Movie.mp4"];
if ([[NSFileManager defaultManager] fileExistsAtPath:pathToMovie]) {
    [[NSFileManager defaultManager] removeItemAtPath:pathToMovie error:nil];
}

unlink([pathToMovie UTF8String]);
NSURL *movieURL = [NSURL fileURLWithPath:pathToMovie];

GPUImageMovieWriter *movieWriter = [[GPUImageMovieWriter alloc] initWithMovieURL:movieURL size:CGSizeMake(480.0, 320.0)];
[filter addTarget:movieWriter];

movieWriter.shouldPassthroughAudio = YES;
movieFile.audioEncodingTarget = movieWriter;
[movieFile enableSynchronizedEncodingUsingMovieWriter:movieWriter];

[movieWriter setCompletionBlock:^{
    NSLog(@"finished..............................");

    [filter removeTarget:movieWriter];
    [movieWriter finishRecording];
}];

[movieWriter startRecording];
[movieFile startProcessing];

Please help me . Thanx in advance for such a good library... :)

Hi rahulguptahmh89,
Try this
-  Add test123.mp4 file on copy bundle resource(target -> build phase -> Copy bundle resource)

repo: BradLarson/GPUImage


text:
LSTM Not Able To Produce Strings Over 98 Characters Long

What is wrong?

LSTMs can only generate 98 character strings
Where does it happen?

In LSTM Neural Networks
How do we replicate the issue?

By running this code with any training data in data.json, for example: [ "Michael", "Bill", "John" ]
How important is this (1-5)?

3 3/4
Expected behavior (i.e. solution)

I expected the LSTM to be able to generate a string with pretty much the maximum characters a computer can handle (if there even is a real limit with a string itself and not hardware)

I assume this has to do with this option: https://github.com/BrainJS/brain.js#rnn-lstm-or-gru-output-too-short-or-too-long Have you played with this value at all?

This is precisely the answer.  Closing as I believe it was sufficiently answered.  Ty @Derpy-Canadian and @bdistin!

Oh, didn't know that was an option. Thanks!


text:
🛑 Blackangusbelgium is down

In 1ba9bac, Blackangusbelgium (https://blackangusbelgium.be/) was down:

HTTP code: 500
Response time: 4054 ms

Resolved: Blackangusbelgium is back up in adf57d5.


text:
chore(main): release 1.0.3

:robot: I have created a release beep boop
1.0.3 (2023-04-21)
Bug Fixes

create directory if it does not exist yet (48485fc)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/Brend-Smits/github-sbom-generator-action/releases/tag/v1.0.3 :sunflower:


text:
1.13 support?

Caused by: java.util.zip.ZipException: invalid distance too far back
10:12:24 [INFO] Survival >     at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:164) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.io.BufferedInputStream.read(BufferedInputStream.java:345) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.io.DataInputStream.readFully(DataInputStream.java:195) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.io.DataInputStream.readLong(DataInputStream.java:416) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagLongArray.load(SourceFile:66) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.a(SourceFile:437) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.load(SourceFile:81) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagList.load(SourceFile:69) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.a(SourceFile:437) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.load(SourceFile:81) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.a(SourceFile:437) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTTagCompound.load(SourceFile:81) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTCompressedStreamTools.a(NBTCompressedStreamTools.java:84) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTCompressedStreamTools.a(NBTCompressedStreamTools.java:53) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.NBTCompressedStreamTools.a(NBTCompressedStreamTools.java:43) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.RegionFileCache.read(RegionFileCache.java:89) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkRegionLoader.a(ChunkRegionLoader.java:85) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkRegionLoader.a(ChunkRegionLoader.java:53) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkRegionLoader.b(ChunkRegionLoader.java:166) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkTaskScheduler.a(ChunkTaskScheduler.java:68) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkTaskScheduler.lambda$2(ChunkTaskScheduler.java:50) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.Map.computeIfAbsent(Map.java:957) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkTaskScheduler.a(ChunkTaskScheduler.java:49) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkTaskScheduler.a(ChunkTaskScheduler.java:1) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus$1.a(SourceFile:46) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus$1.a(SourceFile:27) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.Map.computeIfAbsent(Map.java:957) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:120) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:105) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:22) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.Map.computeIfAbsent(Map.java:957) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:120) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:105) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:22) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.Map.computeIfAbsent(Map.java:957) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:120) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:105) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkStatus.a(SourceFile:22) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:126) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.Map.computeIfAbsent(Map.java:957) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:120) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler$a.a(SourceFile:98) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler.a(SourceFile:60) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at com.google.common.util.concurrent.MoreExecutors$DirectExecutorService.execute(MoreExecutors.java:260) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at java.util.concurrent.CompletableFuture.asyncSupplyStage(CompletableFuture.java:1604) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at java.util.concurrent.CompletableFuture.supplyAsync(CompletableFuture.java:1830) ~[?:1.8.0_171]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.Scheduler.b(SourceFile:61) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.SchedulerBatch.a(SourceFile:39) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkProviderServer.generateChunk(ChunkProviderServer.java:176) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkProviderServer.generateChunk(ChunkProviderServer.java:166) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     at net.minecraft.server.v1_13_R1.ChunkProviderServer.getChunkAt(ChunkProviderServer.java:127) ~[Spigot.jar:git-Spigot-69774b3-671581e]
10:12:24 [INFO] Survival >     ... 9 more

What were you doing when you received that error? I don't see any code from WorldBorder indicated in that stack trace.

trying to fill my world border it was always slow almoste crashing my 1.13 server/world lower than 10 tps
cloud it be corruption?
i had some techinical problem with my server regarding bad sata cable and ram almost lost everything
specs:
core2 quad Q6600
8GB ddr2
ubuntu 16.04.5
java 8 jdk

authors: Brettflan TheCompieter

repo: Brettflan/WorldBorder


text:
[Question] How to correctly use embed and embed_one method?

You must follow the issue template and provide as much information as possible. otherwise, this issue will be closed.
请按照 issue 模板要求填写信息。如果没有按照 issue 模板填写，将会忽略并关闭这个 issue
Check List
Thanks for considering to open an issue. Before you submit your issue, please confirm these boxes are checked.
You can post pictures, but if specific text or code is required to reproduce the issue, please provide the text in a plain text format for easy copy/paste.

[x] I have searched in existing issues but did not find the same one.
[x] I have read the documents

Environment

OS [e.g. Mac OS, Linux]: Linux, Ubuntu 18
Python Version: 3.6.9
requirements.txt:

absl-py==0.9.0
astor==0.8.1
bert4keras==0.6.5
boto==2.49.0
boto3==1.13.19
botocore==1.16.19
cachetools==4.1.0
certifi==2020.4.5.1
chardet==3.0.4
click==7.1.2
cycler==0.10.0
dataclasses==0.7
docutils==0.15.2
filelock==3.0.12
gast==0.2.2
gensim==3.8.3
google-auth==1.16.0
google-auth-oauthlib==0.4.1
google-pasta==0.2.0
grpcio==1.29.0
h5py==2.10.0
idna==2.9
importlib-metadata==1.6.0
jmespath==0.10.0
joblib==0.15.1
kashgari==1.1.5
kashgari-tf==0.5.5
Keras==2.3.1
Keras-Applications==1.0.8
keras-bert==0.81.0
keras-embed-sim==0.7.0
keras-gpt-2==0.14.0
keras-layer-normalization==0.14.0
keras-multi-head==0.24.0
keras-pos-embd==0.11.0
keras-position-wise-feed-forward==0.6.0
Keras-Preprocessing==1.1.2
keras-self-attention==0.41.0
keras-transformer==0.33.0
kiwisolver==1.2.0
Markdown==3.2.2
matplotlib==3.2.1
numpy==1.16.4
oauthlib==3.1.0
opt-einsum==3.2.1
pandas==0.25.3
protobuf==3.12.2
py-dotenv==0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pybind11==2.4.3
pyparsing==2.4.7
python-dateutil==2.8.1
python-dotenv==0.13.0
pytz==2019.3
PyYAML==5.3.1
regex==2020.5.14
requests==2.23.0
requests-oauthlib==1.3.0
rsa==4.0
s3transfer==0.3.3
sacremoses==0.0.43
scikit-learn==0.23.1
scipy==1.4.1
sentencepiece==0.1.91
seqeval==0.0.10
six==1.14.0
smart-open==2.0.0
tensorboard==1.14.0
tensorflow-estimator==1.14.0
tensorflow-gpu==1.14.0
termcolor==1.1.0
Theano==1.0.4
threadpoolctl==2.1.0
tokenizers==0.7.0
tqdm==4.46.0
urllib3==1.25.9
Werkzeug==1.0.1
wrapt==1.12.1
zipp==3.1.0

Question
Hi, I am confused about the input sequences to embed and embed_one method for GPT-2 model. Do I need to train a sentence piece model to convert my text into sub-string lists/ sub-string-id list or all I need to do is to use the plain text as the input?

Here is my code for embedding, correct my if I am wrong.
import kashgari
from dotenv import load_dotenv
import sentencepiece as spm
import os
from tqdm import tqdm
from load_train_file import texts
load_dotenv()
kashgari.config.use_cudnn_cell = True
gpt2_embedding = kashgari.embeddings.GPT2Embedding(os.getenv('GPT2_PATH'),
                                                   task=kashgari.CLASSIFICATION,
                                                   sequence_length='variable')
sp = spm.SentencePieceProcessor()
sp.Load(os.getenv('SPM_MODEL_PATH'))
inputs = texts
encoded = [sp.encode_as_ids(input) for input in tqdm(inputs)]
result = gpt2_embedding.embed(encoded)

You need to tokenize the plan text, then call the embed function. Like this,
x = ["this", "is", "one", "sentence"]
result = gpt2_embedding.embed([x])

You need to tokenize the plan text, then call the embed function. Like this,
x = ["this", "is", "one", "sentence"]
result = gpt2_embedding.embed([x])

Hi, thanks for your reply. By the way, one thing I am not so sure is about the tokenizer. Do I need to use the plain tokenizer like the one provided by nltk or a sentence piece model trained by myself?

When you are using pre-trained models like GPT-2, you need to use some tokenizer which they used for GPT-2. Otherwise, you will have lots of 'UNK' tokens, and it will lost lots of contexts.

Alright, I got it. Where I can find the tokenizer for GPT-2 in your project, so I can use it to tokenize my text?

Hey, I just found a tokenizer from keras_gpt_2 that is the one of dependencies this repo owns. The keras_gpt_2 has a function called get_bpe_from_files, which I think should be the proper tokenizer for pre-trained GPT-2?

authors: BrikerMan hqsiswiliam

repo: BrikerMan/Kashgari


text:
PHOENIX and Sonora getitem method is returning a spectrum with incomplete metadata

getitem for PHOENIXGrid is indexing in an odd fashion which causes the returned spectrum to miss teff, logg, and metallicity attributes.

https://github.com/BrownDwarf/gollum/blob/2abbf42d07ca9f721313118f7f0a5b67dd9a2c5c/src/gollum/phoenix.py#L220

repo: BrownDwarf/gollum


text:
Enable external UI elements to control panning, zooming

I would like to define a scrollbar, and have a way for it to control the zoom factor or the panning location on a chart.

We are estimating this is about 1 day worth of effort

authors: danrope lkittock

repo: Brunel-Visualization/Brunel


text:
SPG 9 Model is not in game

It appears that the SPG 9 launcher model is not in the game.  It currently appears as an Error model.  I am able to see all other missile launchers models and other players were also unable to see the SPG 9 model.  Thanks!

ummm it looks like your copy was fucked up in some way

repo: Bubbus/ACF-Missiles


text:
Fix moment.js instantiation on timestamp in ms

Timestamp in ms overflows int32.
BS int is int32 by default; BS int64 doesn't map to JS number whereas
BS float does.
See here:
http://bloomberg.github.io/bucklescript/Manual.html#_integers
http://bloomberg.github.io/bucklescript/Manual.html#_simple_ocaml_type
http://momentjs.com/docs/#/parsing/unix-timestamp-milliseconds/

I'm not sure how you intended for the moment.js API to be mapped down the line, there also is a unix function which takes seconds as input:
http://momentjs.com/docs/#/parsing/unix-timestamp/

thanks for the change!

@musha68k I am not using that specific function in critical path thus the API is still in flux. The link in your second comment - i am aware of that, it was just that I didn't have time to write and test. If you find it in your use case, feel free to create a PR. Thanks!

repo: BuckleTypes/bs-moment


text:
Accessibility system

A system to easily manage the accessibility of a bpp project, to help make the web more accessible to everyone

I'm going to do this

https://github.com/BuckshotPlusPlus/cli

repo: BuckshotPlusPlus/BuckshotPlusPlus


text:
[ADD FRONTEND] : New Section Added

Frontend Summary 📝
/market-place
Development Approach 🚀
MARKET pLACE wILL  be Added
Deployment Status
None
Select the open source program you are contributing to
Other
Code of Conduct

[X] I adhere to the CONTRIBUTING GUIDELINES of this project.

Hey @shuvadeepmondal👋! Thanks for raising this issue and demonstrating your interest in contributing to our project!🚀
We value your engagement and eagerly anticipate your contributions. Should you wish to get involved, please use the /assignme command to self-assign the issue.
This issue provides an excellent opportunity for us to enhance our project, and we're excited to have you join us! Please take a moment to review our CONTRIBUTING GUIDELINES before getting started.
If you have any questions or need assistance, feel free to reach out to us on LinkedIn.❤

/assignme

Hello @shuvadeepmondal! We'd like to inform you that the issue has been resolved and is now closed. We appreciate your understanding and look forward to your continued involvement with our repository!🤗
If you encounter any further issues, please don't hesitate to reach out to us on LinkedIn. Thank you for your support!❣
Happy coding!✨ We hope to see you again soon!❣

authors: Puskar-Roy shuvadeepmondal


text:
does not work

 is valid HTML

 does render correctly though
Thanks for your project; thought about doing this years ago!

 is valid HTML

It is true that
 is valid HTML, however this is a JSX-based framework, (like React and many others) so all of the rules of JSX applies (like for example, all "tags" must be closed). Parsing HTML is very difficult in itself, and trying to map its concepts to other JSX-based frameworks is very difficult, while the inverse is actually straightforward.
Why JSX? (from Solid's documentation):

[...] JSX is a great DSL made for compilation. It has clear syntax, supports TypeScript, works with Babel, supports other tooling like Code Syntax Highlighting and Prettier. It was only pragmatic to use a tool that basically gives you that all for free. As a compiled solution it provides great DX. Why struggle with custom Syntax DSLs when you can use one so widely supported?

More from the JSX's Draft Spec:

JSX is an XML-like syntax extension to ECMAScript without any defined semantics. It's NOT intended to be implemented by engines or browsers. It's NOT a proposal to incorporate JSX into the ECMAScript spec itself. It's intended to be used by various preprocessors (transpilers) to transform these tokens into standard ECMAScript.

I hope this gives you an idea on why we use JSX (tooling, developer experience, widely supported, familar, made for transpilation, etc) instead of HTML.

authors: mandx tomByrer

repo: BuilderIO/jsx-lite


text:
Update valid output targets

Description
Please provide the following information:

What changes you made: Updated the targets docs

Why you made them, and: Because they were outdated

Any other useful context:

Make sure to follow the PR preparation steps in CONTRIBUTING.md before submitting your PR:

[ ] Format the codebase
[ ] Update all snapshots

PS: Is there a way to transpile to vue v2 via configuring the vue target generator? Based on the ToVueOptions interface it does not look like it is?

repo: BuilderIO/mitosis


text:
No support for Kinect 2

I have a kinect 2 that I'm trying to use with this version, but only get could not open azure device.  Is kinect 2 support not yet implemented?

Hey! Yes, unfortunately, Kinect2 is not yet supported in this version. If you want to capture videos with the Kinect v2 you'd currently need to use the older version located here: https://github.com/MarekKowalski/LiveScan3D
Release: https://github.com/MarekKowalski/LiveScan3D/releases/tag/v1.0.1