text:
Support for additional_special_tokens

Description
This lets users specify "additional_special_tokens" of key of the add_special_tokens method.
Motivation and Context
Special tokens are treated different by the tokenizer, ensuring that they are never broken down. This is important for some use cases, like ChatML.
Consider Yi-200K, which has <|im_start|> and <|im_end|> in its vocabulary already. They are, however not marked as special in the base variant. This means that:
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained(
    "01-ai/Yi-34B-200K"
)

tokens = tokenizer("<|im_start|>system\nX<|im_end|>")

Results in:
{'input_ids': [59666, 59705, 622, 59593, 5858, 46826, 10707, 144, 59733,

However, adding these tokens as special:
tokenizer.add_special_tokens(
    {"additional_special_tokens": ["<|im_start|>", "<|im_end|>"]}
)

Fixes the issue:
{'input_ids': [6, 10707, 144, 59733, 7], 'attention_mask': [1, 1, 1, 1, 1]}

This change will let users handle these cases correctly.
How has this been tested?
I ran a training for 1 step after adding this to my config:
special_tokens:
  additional_special_tokens: ["<|im_start|>", "<|im_end|>"]

Without this, it's likely that many ChatML models are in-fact semi broken, because it's common practice to add <|im_start|> and <|im_end|> like this:
special_tokens:
  eos_token: "<|im_end|>"
tokens:
  - "<|im_start|>"

This means that the tokenizer might incorrectly tokenize <|im_start|> strings.
Social Handles (Optional)
dreamgen on discord
https://twitter.com/DreamGenAI

Slight clarification:
tokenizer.add_tokens(...)

Also ensures that the tokens are treated special by the tokenizer, even if the token is already in the vocabulary!

Add a list of new tokens to the tokenizer class. If the new tokens are not in the vocabulary, they are added to it with indices starting from length of the current vocabulary and and will be isolated before the tokenization algorithm is applied. Added tokens and tokens from the vocabulary of the tokenization algorithm are therefore not treated in the same way.

However, special_tokens_map.json file will not contain such added tokens as special, which will potentially confuse downstream libraries / inference engines trying to load these models, and lead to mistokenization.

Thank you for the PR. I ran into this issue today and it also seems to me that <|im_start|> should be marked as special.
Running your code on the mistral base model with this config:
special_tokens:
  eos_token: "<|im_end|>"
  unk_token: "<unk>"
  additional_special_tokens: ["<|im_start|>"]

Did yield an error:
Traceback (most recent call last):
  File "/root/miniconda3/envs/py3.10/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/root/miniconda3/envs/py3.10/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/workspace/axolotl/src/axolotl/cli/train.py", line 58, in <module>
    fire.Fire(do_cli)
  File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/fire/core.py", line 141, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/fire/core.py", line 475, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "/workspace/axolotl/src/axolotl/cli/train.py", line 34, in do_cli
    return do_train(parsed_cfg, parsed_cli_args)
  File "/workspace/axolotl/src/axolotl/cli/train.py", line 54, in do_train
    return train(cfg=cfg, cli_args=cli_args, dataset_meta=dataset_meta)
  File "/workspace/axolotl/src/axolotl/train.py", line 156, in train
    trainer.train(resume_from_checkpoint=resume_from_checkpoint)
  File "/root/miniconda3/envs/py3.10/lib/python3.10/site-packages/transformers/trainer.py", line 1539, in train
    return inner_training_loop(

Changing the config to this worked:
special_tokens:
  eos_token: "<|im_end|>"
  unk_token: "<unk>"
  additional_special_tokens: ["<|im_start|>"]
tokens:
  - "<|im_start|>"

I believe it may have to do with the fact that Mistral doesn't have <|im_start|> in its vocabulary, unlike Yi.

Thank you for testing! Do you actually see tokenization differences? I did run over the whole training set with these 2 options:
(A) Only use add_tokens on <|im_start|> and <|im_end|>
(B) Use  add_tokens  + additional_special_tokens
And I did not find a single example where the token ids would differ. If you did, can you share an example so I can test with it?
On the issue you mention, I think additional_special_tokens should work even if the tokens were not in the vocab yet:
# %%
from transformers import AutoTokenizer, AddedToken

tokens = ["<|im_start|>", "<|im_end|>"]

tok1 = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")
tok2 = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-v0.1")

tok1.add_tokens(
    [
        AddedToken(token, rstrip=False, lstrip=False, normalized=False)
        for token in tokens
    ]
)

tok2.add_special_tokens({"additional_special_tokens": tokens})

# %%

inputs = [
    "<|im_start|>user\nhello<|im_end|>",
    "<|im_start|>user\nhello<|im_end|>\n<|im_start|> assistant\nworld<|im_end|>",
]

for input in inputs:
    print(tok1.tokenize(input))
    print(tok2.tokenize(input))
    print()

# %%

And it does not raise an exception and the outputs are the same (in this case the ids are swapped, but that's fine):
['<|im_start|>', '▁user', '<0x0A>', 'hello', '<|im_end|>']
[1, 32000, 2188, 13, 21558, 32001]
['<|im_start|>', '▁user', '<0x0A>', 'hello', '<|im_end|>']
[1, 32001, 2188, 13, 21558, 32000]

['<|im_start|>', '▁user', '<0x0A>', 'hello', '<|im_end|>', '▁', '<0x0A>', '<|im_start|>', '▁', '▁assistant', '<0x0A>', 'world', '<|im_end|>']
[1, 32000, 2188, 13, 21558, 32001, 28705, 13, 32000, 28705, 13892, 13, 9471, 32001]
['<|im_start|>', '▁user', '<0x0A>', 'hello', '<|im_end|>', '▁', '<0x0A>', '<|im_start|>', '▁', '▁assistant', '<0x0A>', 'world', '<|im_end|>']
[1, 32001, 2188, 13, 21558, 32000, 28705, 13, 32001, 28705, 13892, 13, 9471, 32000]

So I am not sure what's the issue. The stack trace does not have much information unfortunately :-/

@DreamGenX , I think the difference in the actual implementation and your test code above is that you are adding both the tokens to the vocabulary, and then setting them as special. setting <|im_start|> as a special token without adding it to the vocabulary is what is happening in @komninoschatzipapas first version of the config.

I also get this error if the additional_special_tokens are not already in the vocabulary or included in tokens:
  File "/home/wing/micromamba/envs/dev/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/wing/micromamba/envs/dev/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 1031, in forward
    attention_mask = attention_mask if (attention_mask is not None and 0 in attention_mask) else None
  File "/home/wing/micromamba/envs/dev/lib/python3.10/site-packages/torch/_tensor.py", line 997, in __contains__
    return (element == self).any().item()  # type: ignore[union-attr]
RuntimeError: CUDA error: device-side assert triggered

alright, found the bug and added a test for it.

Thank you for the fix! Just to clarify, you can see in the example that tok2 uses only add_special_tokens, and not add_tokens, and it works. It seems that normally add_special_tokens also adds the special tokens to the vocab if they aren't there yet.

rebasing from main to pick up fixes for ci failures b/c of torch-2.2.0 release

what if the "additional_special_tokens" is already present in the tokenizer.config for the model that is being fine tuned? Is it still necessary to put them in the axolotl yaml manifest? Or they'll just be picked up as expected from tokenizer.config?

@winglian @DreamGenX Based on all the discussion and changes above, it is now very confusing knowing how to properly set up your config.yml for training a sharegpt dataset with the chatml chat template. Would the following stripped example work as intended? It mirrors those found in other issues but it's hard to know what's current at this point. Note this is for a model with a tokenizer that does not already contain <im_start> and <im_end>.
base_model: /hf_downloads/mistralai/Mistral-7B-v0.1
model_type: MistralForCausalLM
tokenizer_type: LlamaTokenizer

#etc

datasets:
  - path: 64bits/lima_vicuna_format
    type: sharegpt
chat_template: chatml

#etc

tokens: # added for chatml
 - "<|im_start|>"
 - '<|im_end|>'
special_tokens:
  eos_token: "<|im_end|>" # added for chatml

authors: DreamGenX ZQ-Dev8 andysalerno komninoschatzipapas winglian


text:
[Bug]: Vanilla replay strategy fails with below error

Describe the bug
PS C:\Users\abhis\openAdapt\OpenAdapt> poetry shell
Spawning shell within C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10
PowerShell 7.4.3
(openadapt-py3.10) PS C:\Users\abhis\openAdapt\OpenAdapt> python -m openadapt.replay VanillaReplayStrategy --instructions "calculate 9-8"
[2024-07-18 00:09:23.481] [recordLogger] [info] Created d3d11 device from 0
[2024-07-18 00:09:23.482] [recordLogger] [info] found 1 displays
Traceback (most recent call last):
File "C:\Users\abhis\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File "C:\Users\abhis\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\replay.py", line 19, in
from openadapt import capture as capture, utils
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\utils.py", line 50, in
from openadapt.models import ActionEvent
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\models.py", line 16, in
from openadapt import window
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\window_init.py", line 17, in
from . import windows as impl
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\window_windows.py", line 6, in
import pywinauto
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\pywinauto_init.py", line 87, in
from .sysinfo import UIA_support
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\pywinauto\sysinfo.py", line 44, in
import comtypes  # noqa: E402
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\comtypes_init.py", line 191, in
CoInitializeEx()
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\comtypes_init.py", line 181, in CoInitializeEx
_ole32.CoInitializeEx(None, flags)
File "_ctypes/callproc.c", line 993, in GetResult
OSError: [WinError -2147417850] Cannot change thread mode after it is set
To Reproduce
on win PowerShell 7 follow steps as mentioned

Thank you @absha03 ! Can you please clarify whether this also happens with other strategies, e.g. NaiveReplayStrategy?

yes as seen below: (openadapt-py3.10) PS C:\Users\abhis\openAdapt\OpenAdapt> python -m openadapt.replay NaiveReplayStrategy --instructions "calculate 9-8"
[2024-07-18 22:38:32.963] [recordLogger] [info] Created d3d11 device from 0
[2024-07-18 22:38:32.964] [recordLogger] [info] found 1 displays
Traceback (most recent call last):
File "C:\Users\abhis\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 196, in _run_module_as_main
return run_code(code, main_globals, None,
File "C:\Users\abhis\AppData\Local\Programs\Python\Python310\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\replay.py", line 19, in
from openadapt import capture as capture, utils
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\utils.py", line 50, in
from openadapt.models import ActionEvent
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\models.py", line 16, in
from openadapt import window
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\window_init.py", line 17, in
from . import windows as impl
File "C:\Users\abhis\openAdapt\OpenAdapt\openadapt\window_windows.py", line 6, in
import pywinauto
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\pywinauto_init.py", line 87, in
from .sysinfo import UIA_support
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\pywinauto\sysinfo.py", line 44, in
import comtypes  # noqa: E402
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\comtypes_init.py", line 191, in
CoInitializeEx()
File "C:\Users\abhis\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-8xtrqwsq-py3.10\lib\site-packages\comtypes_init.py", line 181, in CoInitializeEx
_ole32.CoInitializeEx(None, flags)
File "_ctypes/callproc.c", line 993, in GetResult
OSError: [WinError -2147417850] Cannot change thread mode after it is set

source: gharchive/issue

repo: OpenAdaptAI/OpenAdapt

license: MIT

license_type: permissive

license_source: github-api


text:
Does it support multi-image interleaved conversations?

the demo looks like only support one image in one prompt. i wonder does it support multi-image interleaved conversation?  e.g. input 2 images at once and compare which is brighter

Not yet，we will add this feature in the future.

repo: OpenBMB/MiniCPM-V


text:
UTF-8 characters in listing names return an error

When UTF-8 characters are present in a listing title, such as "Tajné plány", the contracts api rejects the data, and returns
{ "reason": "", "success": false }
Example characters: ¿ ö š ð ¬ ½
Client issue: https://github.com/OpenBazaar/OpenBazaar-Client/issues/1152#issuecomment-199829021

Is this issue fixed? I am able to create an item listing with the name "Tajné plány".

authors: jjeffryes wxzeng

repo: OpenBazaar/OpenBazaar-Server

license: mit

license_source: bigquery


text:
Storage permission error

The app is unable to access any files on the device even though it has the permissions to do so. I have tried clearing app cache, clearing app data, resetting up the entire setup and reinstalling however none solved the issue. If it matters I do not have this issue with bluebubbles (the phone app) and its a rooted s9 with android 10 (stock rom)
https://github.com/user-attachments/assets/6698613a-b41c-42bd-ac5f-656166649cc4

If I can provide any other information please let me know

Are you still experiencing this on the latest update?

Seems like this can be closed?

Seems like this can be closed?

Yes, i just tested and the issue is no longer present, my apologies for taking so long to test it, I've been busy.

authors: Baggette TaeHagen cameronaaron

repo: OpenBubbles/openbubbles-app


text:
Add tests for CompareFiles for different file lengths

The CompareFiles command was not correctly calculating the number of lines compared or the percent when the files were different length.  It was stopping after the end of one file was reached.

I added the tests.  Close the issue.

repo: OpenCDSS/cdss-app-tstool-test


text:
优化 Vue 组件的目录结构

优化导航栏的 Vue 组件目录结构
优化模型数据集 Vue 组件的目录结构

这是来自外部的贡献，需要等待 qa 完成验证，去掉 qa needed 标签之后，方可 merge

QA 验证结果：

pipeline number: 2034
结果展示
https://github.com/OpenCSGs/CSGHub/assets/3827780/e1d84a56-da38-484f-b0f2-8675eb0108d3

source: gharchive/pull-request

authors: hiveer hiveerli

repo: OpenCSGs/CSGHub


text:
Duplicate document IDs

When certificates with duplicate document IDs are batched together it fails silently, instead of throwing an error

closed with #34

repo: OpenCerts/certificate-cli


text:
(on going) Editable collective

Currently a user is able to edit:

Name
Logo
Background Image
Mission
Description
Long Description
Website

To view the editor, simply go the route opencollective.com/:slug/edit. You must be logged in, in order to save changes.
You can make a change and preview it before saving, as changes will only be saved when clicking the Publish button.

Where is the edit mode triggered from? And what auth is in place to only allow it for people who are MEMBERS of that collective?

@asood123

edit mode is triggered by going to the url: opencollective.com/:slug/edit, there is no link in place as of now, however there will be one on the LoginTopBar menu only when a user is logged in.

Currently there is no auth to only allow it for people who are members of the collective.
Yesterday I worked with the api repo having the group update endpoint include a auth middleware:
aZ.authorizeAccessToGroup({userRoles: [HOST, MEMBER]})
https://github.com/OpenCollective/opencollective-api/blob/86a8a719e2df9f5da3d10d5e170e539b7d73cbd4/server/routes.js#L142`
However, I can only see that after a merge, it is now missing:
https://github.com/OpenCollective/opencollective-api/blob/1eb5362853f6a276e93af2a6ba339880a982a250/server/routes.js#L143

I am assuming that removing the auth was unintentional? If that is the case then we can add the auth middleware back to the endpoint.

@carlosascari i'll take care of the auth

repo: OpenCollective/opencollective-website


text:
Replace un needed polyfills

This project runs php 5.6, so polyfills providing php 5.4 to 5.6 functionality dont add anything. Instead, they only serve to clog up the autoloader as they are autoloaded at the start of any process.
Mb string can be replaced as the extension is installed, see:

https://github.com/OpenConext/OpenConext-deploy/blob/17d1d5c3782f1d8d0f20370f210d47634bf394d8/roles/php56fpm/tasks/main.yml#L33

See also:

https://github.com/symfony/polyfill/pull/153

I think ext-mbstring should stay.. It's a requirement, so it should be listed as such

authors: BackEndTea tvdijen

repo: OpenConext/OpenConext-engineblock


text:
Handle oidcng being down

This issue is imported from pivotal
If the oidcng tokens api is not avaiable, the mijn eduID website if not loading after login

2024-08-15T14:24:45.341424000Z 2024-08-15 14:24:45,340 ERROR [http-nio-8080-exec-9] myconext.api.DefaultErrorController:62 - Error occurred; class org.springframework.web.client.HttpServerErrorException$ServiceUnavailable org.springframework.web.client.HttpServerErrorException$ServiceUnavailable: 503 Service Unavailable: \'
503 Service Unavailable
<EOL>No server is available to handle this request.<EOL><EOL>\'
2024-08-15T14:24:45.341538000Z org.springframework.web.client.HttpServerErrorException$ServiceUnavailable: 503 Service Unavailable: \'
503 Service Unavailable
<EOL>No server is available to handle this request.<EOL><EOL>\'
2024-08-15T14:24:45.341591000Z 	at org.springframework.web.client.HttpServerErrorException.create(HttpServerErrorException.java:112)
2024-08-15T14:24:45.341627000Z 	at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:170)
2024-08-15T14:24:45.341661000Z 	at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:122)
2024-08-15T14:24:45.341694000Z 	at org.springframework.web.client.ResponseErrorHandler.handleError(ResponseErrorHandler.java:63)
2024-08-15T14:24:45.341735000Z 	at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:825)
2024-08-15T14:24:45.341779000Z 	at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:783)
2024-08-15T14:24:45.341818000Z 	at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:717)
2024-08-15T14:24:45.341848000Z 	at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:637)
2024-08-15T14:24:45.341882000Z 	at myconext.oidcng.OpenIDConnectRemote.tokens(OpenIDConnectRemote.java:58)
2024-08-15T14:24:45.341914000Z 	at myconext.api.UserController.tokens(UserController.java:691)
2024-08-15T14:24:45.341948000Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2024-08-15T14:24:45.341986000Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2024-08-15T14:24:45.342016000Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2024-08-15T14:24:45.342046000Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)

Is the token endpoint is not available, log this as an ERROR, but display the UI as if no tokens were present

(Peter Havekes - Aug 15, 2024)

https://github.com/OpenConext/OpenConext-myconext/commit/6da9a924c3fa9eda265e1a60228a10fc4e7727df (inesduits - Aug 27, 2024)

repo: OpenConext/OpenConext-myconext


text:
"Enhancing LLM/GPT Agent Interactions with Optimized Data Architecture Integration"

This pull request proposes an advanced data architecture aimed at enhancing the interactions and efficiency of LLM/GPT agents within our project. It specifically addresses the concerns and opportunities highlighted in Issue #33, focusing on optimizing data handling, storage, and retrieval processes. The proposed integration includes the use of Redis for caching frequent LLM computations, PostgreSQL for managing an extensive knowledge base and context, MongoDB for storing reports and generated documents, and MySQL for tracking process states. This architecture is designed to improve response times, support scalability, and ensure robust data management, thereby significantly contributing to the project's goals as outlined in the mentioned issue.

Is MongoDB needed? Is there something that's missing from Postgres JSON support?

Is MongoDB needed? Is there something that's missing from Postgres JSON support?

Based on our discussion about the system's requirements, including handling unstructured context and continuous learning for LLM extension, both MongoDB and PostgreSQL have their distinct advantages, making them valuable for different aspects of the system.
MongoDB's strength lies in its ability to handle unstructured or semi-structured data efficiently. It is particularly adept at automatically converting unstructured inputs into JSON for storage. This capability is crucial for systems that ingest varied and dynamic data types, allowing for flexibility in data representation and quick adaptation to changes without the need for predefined schemas [❞].
PostgreSQL, with its JSON and JSONB data types, offers the capability to store and query JSON data, providing a structured approach to managing semi-structured data. While PostgreSQL can share information in JSON format, allowing for some degree of flexibility similar to MongoDB, it excels in scenarios requiring complex queries, data integrity, and reliability [❞].
The decision to use MongoDB, PostgreSQL, or both should consider the specific requirements of your system:

If your system frequently deals with unstructured or semi-structured inputs that need to be quickly and automatically converted into JSON for storage, MongoDB's schema-less nature and efficient handling of JSON documents could provide significant advantages.
If your system requires the rigorous data integrity, complex querying capabilities, and transactional support provided by SQL databases, along with the need to handle JSON formatted data, PostgreSQL would be highly beneficial.
For systems that encounter both sets of requirements—managing unstructured data with the need for flexible storage options, as well as conducting complex analyses and maintaining data integrity—a combined approach using both MongoDB and PostgreSQL might be the best solution.

This hybrid approach allows you to leverage the strengths of each database system, using MongoDB to efficiently manage dynamic, unstructured data, and PostgreSQL to handle structured data and complex queries, ensuring robust data management and analytics capabilities.
For more insights on MongoDB and PostgreSQL, including their use cases and performance considerations, further reading and resources from official documentation and third-party analyses can offer deeper understanding and guidance.

Also this IS just my first brainstorming for DB architechture for OpenDevin.
@neubig
what do you think, could i contribute in this field?

IMO this is overkill for an MVP.
I would suggest:

an in-memory vector database for extended knowledge (i.e. RAG). It'd start out empty at the beginning of a session, and be filled out with any web pages, files, etc the LLM decides to access. The community seems to be converging on chroma for a vector db

eventually we will probably want to pre-fill the vector DB, e.g. with the repository contents and relevant documentation

A PostgreSQL database for the application itself (i.e. user management, projects, prompt history)

even this is probably overkill for an MVP--because it's self-hosted OSS, we store state in a file on disk.

Yeah, I tend to agree with @rbren that we should probably stick to something simpler at least at first.

Yep, @rbren  i agree. Also am favouring chromadb for the vector database.

@rbren @neubig @TareefAzizi Yeah guys i agree with what you say, i wast just doing a really fast brainstorm but not for AN MVP of course bur let me expose in this other way what i would do based on what you think and speak my mind.
I really am hungry to implement this i am about to Showcase in a real project.
Take a good look at the concrete example I've provided that showcases the power of vectorized LLM-style searches across various vector database options, and how incorporating advanced statistical techniques and data model customization can further optimize the performance and capabilities of our agent solution even for the MVP:
Imagine we have a use case where OpenDevin agent needs to retrieve relevant information from a large knowledge base to generate a thoughtful response to a user's query. Using a vectorized LLM-style search, we can represent both the user's query and the knowledge base content as high-dimensional vectors, allowing us to efficiently find the most semantically relevant information.
Let's compare the performance of this vectorized search across the different vector database options:

Vector DB
Latency (ms)
Throughput (queries/sec)
Search Quality (Recall@10)

Chroma
10-20
1,000+
0.80

Qdrant
5-10
5,000+
0.82

Pinecone
2-5
10,000+
0.88

Weaviate
3-7
5,000+
0.85

Milvus
1-3
20,000+
0.90

Faiss
0.5-1
50,000+
0.92

As you can see, the more advanced vector database options like Milvus and Faiss offer significantly lower latency, higher throughput, and better search quality (as measured by Recall@10) compared to Chroma and Qdrant.
Now, let's take this a step further by incorporating advanced statistical techniques and data model customization to enhance the performance and capabilities of our agent solution:

Intelligent Embedding Generation:

By leveraging state-of-the-art language models (e.g., BERT, GPT-3) and fine-tuning them on our specific domain knowledge, we can generate highly accurate embeddings for both the user queries and the knowledge base content.
This customized embedding generation process will improve the semantic understanding and retrieval accuracy of our vectorized searches, as reflected in the increased Recall@10 scores.

Dynamic Query Expansion:

Implement techniques such as query expansion and relevance feedback to dynamically enrich the user's original query with additional context and related terms.
This will help surface more relevant information from the knowledge base, further improving the quality of the agent's responses.

Adaptive Ranking and Scoring:

Develop custom ranking and scoring algorithms that consider not only the vector similarity, but also other relevant factors such as content recency, user preferences, and contextual cues.
By fine-tuning these scoring mechanisms, we can optimize the relevance and usefulness of the information retrieved for each user query.

Personalized Knowledge Prioritization:

Analyze user interaction patterns and feedback to identify the most valuable and frequently accessed knowledge assets.
Prioritize the indexing and retrieval of these high-value knowledge items, ensuring the agent can quickly and accurately respond to common user queries.

By incorporating these advanced statistical techniques and data model customizations, we can further enhance the performance and capabilities of our agent solution, as demonstrated in the following updated table:

Vector DB
Latency (ms)
Throughput (queries/sec)
Search Quality (Recall@10)

Chroma
8-15
1,500+
0.85

Qdrant
4-8
7,000+
0.87

Pinecone
1-3
12,000+
0.92

Weaviate
2-5
7,000+
0.90

Milvus
0.5-2
25,000+
0.94

Faiss
0.3-0.8
60,000+
0.96

As you can see, by leveraging these advanced techniques, we've been able to further improve the performance and search quality across all the vector database options, with Faiss and Milvus standing out as the clear leaders in terms of low latency, high throughput, and exceptional search relevance.
This comprehensive approach, combining cutting-edge vector databases, advanced statistical methods, and customized data model optimization, will enable OpenDevin agent solution to deliver lightning-fast, highly relevant, and personalized responses, setting a new standard in the industry. I'm really excited to implement this on a real project and position our MVP as a true trailblazer, ensuring its long-term success and scalability.

@rbren @neubig can we get away with something as simple as pgvector?

Probably. I'm a big postgres fan, so that'd probably be my second choice after chromadb.
I'm currently leaning toward chroma, because it has a really nice in-memory engine, and seems to be the DB of choice in llama-index (which I imagine we'll be using for our RAG, but TBD).

I'm going to close this PR as much of this seems to be out of scope for now. Thanks for the discussion all!

Hi @mslmr369, can you cite the sources of those numbers?
Here are the results of Qdrant's open-source benchmarks.
https://qdrant.tech/benchmarks/
FYI. I am affiliated with Qdrant.

authors: Anush008 TareefAzizi mslmr369 neubig penberg rbren

repo: OpenDevin/OpenDevin


text:
Сервис редактирования изображений

Требуется создать сервис, обеспечивающий возможности обработки изображений

[ ] изменение размера
[ ] изменение разрешения
[ ] изменение формата (jpg, png)
[ ] кодирование svg-формата в растровый (bmp, png, jpg)

Логику сервиса обработки изображений можно построить на основе использования пакета SixLabors.ImageSharp

repo: OpenGeekBrains/Thoughts


text:
Added a new 'mode'

mode 2 enables to generate memes from image URL.

Looks great 😍
Hope you are enjoying your journey 🚆  with OpenGenus

authors: AdiChat moderneinstein

repo: OpenGenus/memes


text:
Generalize return value type in performSelect()

We should make it possible to return either a list-of-lists or a list-of-dicts from a DB connector class's performSelect() method. This will have performance benefits as well as offering the developer flexibility in selecting the best format for the the job.

Added in PR #18.

authors: manthey ronichoudhury


text:
Update INSTALL file with information about Fink package manager

Adds note on how to install oiio on OS X using Fink.

Thanks, I'll merge this.

Merged.

authors: lgritz nieder

repo: OpenImageIO/oiio


text:
Correctly sort dir files alphabetically to match Liberty behavior

Use case-insensitive sort for dir files to match Liberty behavior.
Fix configDropins processing to sort alphabetically
Simplified and refactored some code.

Current 23.0.0.10 release has a bug where it uses case-sensitive sort for <include> dirs.
Can hold off on merging this PR until that is fixed.

Please build/run the tests for LMP and LGP with this branch and confirm none of the tests need updating since it is a change in behavior (even though it was a bug and incorrect behavior before). TIA

LMP/LGP builds passed with these changes included.
Used the same build commands as what runs in Github Actions
mvn -V verify --batch-mode --no-transfer-progress --errors -DtrimStackTrace=false -Ponline-its -D"invoker.streamLogsOnFailures"=true -Druntime=ol -DruntimeVersion=23.0.0.10

gradle clean install check -P"test.exclude"="**/TestSpringBootApplication30*,**/DevContainerTest*" -Druntime=ol -DruntimeVersion=23.0.0.10 --stacktrace --i

authors: cherylking evie-lau


text:
Reduce code duplication between striped object and regular object read write test

This is a great first issue for someone who wants to get involved.

I have noticed that your code includes a group of headers called "xnvme". Could you tell me where do you get them? Thanks. : )

Thanks.

https://github.com/OpenMPDK/xNVMe

repo: OpenMPDK/FlexAlloc


text:
(Refactoring) Renaming function to finish removal of the old code

This PR renames

tune_new->tune
perform_utility_analysis_new ->perform_utility_analysis

Thanks for review!

repo: OpenMined/PipelineDP


text:
Adds Bootstrap 3.3.5

This adds the Bootstrap 3.3.5 dist files, tweaked for XSP use. The theme files are near-identical copies of the 3.2.0 release, just pointing at the different directly - all the renderers are unchanged.

Thanks Jesse, that's a big one! We'll review in due course, as we do want to move up to this version of Bootstrap

Bootstrap has been upgraded to v3.3.6 in release 16 of the ExtLib. Thanks for the help (nudge) Jesse

authors: briangleeson jesse-gallagher

repo: OpenNTF/XPagesExtensionLibrary


text:
Restored disks of VM additional disks does not show the real size of the original disk

Description
When you restore a backup image from a VM that has more than one disk, the new restored disk images are not showing the real size of the original disk. It shows the size of the first disk of the VM (vda). The qemu-img output shows the right size for the disk.
To Reproduce
1-Configure backups for a given VM with more than one disk (vda and vdb).
2-Create a backup.
3-Restore the hole backup image, or individual disks for the 2nd disk of the VM.
4-The size of the new image from the 2nd disk (vdb) will show the size of the first disk and not the size of the 2nd original disk.
Original VM:

Restored VM:

HINT: Possible error on remotes/datastore/rsync/stat.
Expected behavior
The 2nd disk showing its real size.
Details

Affected Component: [Sunstone, Storage]
Hypervisor: [KVM]
Version: [6.10.0]

Additional context
Add any other context about the problem here.

Progress Status

[ ] Code committed
[ ] Testing - QA
[ ] Documentation (Release notes - resolved issues, compatibility, known issues)

Hi @rsmontero
Please, take a look at this when you have a free minutes of your time.
Thanks in advance

repo: OpenNebula/one


text:
Feat parse audio

Added parse audio

@kaldan007, I've made the modifications based on your code review.

repo: OpenPecha/stt-data-with-llm


text:
docker recipe

Hi,
I just made an easy to use docker recipe for this project.
https://github.com/torvitas/docker-openpogobot
Feel free to add a Link to the README.md.
Greetings, Sascha

Nice, however the recipe will need modifying as we are doing a drastic overhaul of bot configuration.

As soon as you move to yml I am going to update the recipe.

Hi, I also use docker to run OpenPoGoBot, if you want to take a look my Dockerfile is here https://github.com/eownis/dockerfiles/tree/master/openpogobot and I have an automated build on Docker Hub https://hub.docker.com/r/eownis/openpogobot/

Just updated the docker recipe. Every possible configuration option should now be available via environment variables (readme.md isn't updated yet). I also added an container to run the openpogobotui.

authors: eownis torvitas wchill

repo: OpenPoGo/OpenPoGoBot


text:
master: test fail in testppd

With current master (52c6150ffd0325c60b04bf5f34d7764899f855cd) I see this test suite failure:
   cups-filters 1.27.5: ./test-suite.log
===========================================

# TOTAL: 7
# PASS:  6
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: testppd
=============

ppdOpenFile(test.ppd): FAIL (Unable to open PPD file on line 0)
ppdFindAttr(wildcard): FAIL (not found)
ppdFindNextAttr(wildcard): FAIL (not found)
ppdFindAttr(Foo): FAIL (not found)
ppdFindNextAttr(Foo): PASS
ppdMarkDefaults: PASS
ppdEmitString (defaults): FAIL (0 bytes instead of 572)
ppdEmitString (custom size and string): FAIL (0 bytes instead of 639)
ppdGetConflicts(InputSlot=Envelope): FAIL (0 options:)
ppdConflicts(): FAIL (0)
ppdResolveConflicts(InputSlot=Envelope): FAIL (Unable to resolve)
ppdResolveConflicts(No option/choice): FAIL (Unable to resolve)
ppdInstallableConflict(): FAIL (Duplex=DuplexNoTumble did not conflict)
ppdPageSizeLimits: FAIL (returned 0)
ppdMarkOptions(media=iso-a4): FAIL (unknown)
ppdMarkOptions(media=na_letter_8.5x11in): FAIL (unknown)
ppdMarkOptions(media=oe_letter-fullbleed_8.5x11in): FAIL (unknown)
ppdMarkOptions(media=A4): FAIL (unknown)
ppdMarkOptions(media=Custom.8x10in): FAIL (unknown - 0x0)
ppdLocalizeIPPReason(text): FAIL ("" instead of "Foo Reason")
ppdLocalizeIPPReason(http): FAIL ("" instead of "http://foo/bar.html")
ppdLocalizeIPPReason(help): FAIL ("" instead of "help:anchor='foo'%20bookID=Vendor%20Help")
ppdLocalizeIPPReason(file): FAIL ("" instead of "/help/foo/bar.html")
ppdLocalizeIPPReason(fr text): FAIL ("" instead of "La Long Foo Reason")
ppdLocalizeIPPReason(zh_TW text): FAIL ("" instead of "Number 1 Foo Reason")
ppdLocalizeMarkerName(bogus): PASS
ppdLocalizeMarkerName(cyan): FAIL ("(null)" instead of "Cyan Toner")
ppdLocalizeMarkerName(fr cyan): FAIL ("(null)" instead of "La Toner Cyan")
ppdLocalizeMarkerName(zh_TW cyan): FAIL ("(null)" instead of "Number 1 Cyan Toner")
ppdOpenFile(test2.ppd): FAIL (Unable to open PPD file on line 0)
ppdMarkDefaults: PASS
ppdEmitString (defaults): FAIL (0 bytes instead of 392)
ppdConflicts(): FAIL (0)
ppdResolveConflicts(Quality=Photo): PASS (Unable to resolve)
ppdResolveConflicts(No option/choice): FAIL (Unable to resolve!)
ppdResolveConflicts(loop test): PASS
ppdInstallableConflict(): FAIL (Duplex=DuplexNoTumble did not conflict)
ppdPageSizeLimits(default): FAIL (returned 0)
ppdPageSizeLimits(InputSlot=Manual): FAIL (returned 0)
ppdPageSizeLimits(Quality=Photo): FAIL (returned 0)
ppdPageSizeLimits(Quality=Photo): FAIL (returned 0)
ppdRasterExecPS("setpagedevice"): PASS
ppdRasterExecPS("roll"): PASS
ppdRasterExecPS("dup index"): PASS
ppdRasterExecPS("%%Begin/EndFeature code"): PASS
FAIL testppd (exit status: 35)```

Any idea or is this expected at this moment?

Could you replace the line
if ((ppd = ppdOpenFileWithLocalization("test.ppd", PPD_LOCALIZATION_ALL)) != NULL)

by
if ((ppd = ppdOpenFileWithLocalization("ppd/test.ppd", PPD_LOCALIZATION_ALL)) != NULL)

Does the test suite work then?

applied this and the test keep failing but the test-suit.log looks better now.
--- cups-filters/ppd/testppd.c	2020-11-16 22:40:25.000000000 +0100
+++ cups-filters/ppd/testppd.c.new	2020-11-16 22:44:11.495836665 +0100
@@ -455,7 +455,7 @@

     fputs("ppdOpenFile(test.ppd): ", stdout);

-    if ((ppd = ppdOpenFileWithLocalization("test.ppd", PPD_LOCALIZATION_ALL)) != NULL)
+    if ((ppd = ppdOpenFileWithLocalization("ppd/test.ppd", PPD_LOCALIZATION_ALL)) != NULL)
       puts("PASS");
     else
     {

===========================================
   cups-filters 1.27.5: ./test-suite.log
===========================================

# TOTAL: 7
# PASS:  6
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: testppd
=============

ppdOpenFile(test.ppd): PASS
ppdFindAttr(wildcard): PASS
ppdFindNextAttr(wildcard): PASS
ppdFindAttr(Foo): PASS
ppdFindNextAttr(Foo): PASS
ppdMarkDefaults: PASS
ppdEmitString (defaults): PASS
ppdEmitString (custom size and string): PASS
ppdGetConflicts(InputSlot=Envelope): PASS
ppdConflicts(): PASS (2)
ppdResolveConflicts(InputSlot=Envelope): PASS (Resolved by changing PageSize)
ppdResolveConflicts(No option/choice): PASS (Resolved by changing InputSlot)
ppdInstallableConflict(): PASS
ppdPageSizeLimits: PASS
ppdMarkOptions(media=iso-a4): PASS
ppdMarkOptions(media=na_letter_8.5x11in): PASS
ppdMarkOptions(media=oe_letter-fullbleed_8.5x11in): PASS
ppdMarkOptions(media=A4): PASS
ppdMarkOptions(media=Custom.8x10in): PASS
ppdLocalizeIPPReason(text): PASS
ppdLocalizeIPPReason(http): PASS
ppdLocalizeIPPReason(help): PASS
ppdLocalizeIPPReason(file): PASS
ppdLocalizeIPPReason(fr text): PASS
ppdLocalizeIPPReason(zh_TW text): PASS
ppdLocalizeMarkerName(bogus): PASS
ppdLocalizeMarkerName(cyan): PASS
ppdLocalizeMarkerName(fr cyan): PASS
ppdLocalizeMarkerName(zh_TW cyan): PASS
ppdOpenFile(test2.ppd): FAIL (Unable to open PPD file on line 0)
ppdMarkDefaults: PASS
ppdEmitString (defaults): FAIL (0 bytes instead of 392)
ppdConflicts(): FAIL (0)
ppdResolveConflicts(Quality=Photo): PASS (Unable to resolve)
ppdResolveConflicts(No option/choice): FAIL (Unable to resolve!)
ppdResolveConflicts(loop test): PASS
ppdInstallableConflict(): FAIL (Duplex=DuplexNoTumble did not conflict)
ppdPageSizeLimits(default): FAIL (returned 0)
ppdPageSizeLimits(InputSlot=Manual): FAIL (returned 0)
ppdPageSizeLimits(Quality=Photo): FAIL (returned 0)
ppdPageSizeLimits(Quality=Photo): FAIL (returned 0)
ppdRasterExecPS("setpagedevice"): PASS
ppdRasterExecPS("roll"): PASS
ppdRasterExecPS("dup index"): PASS
ppdRasterExecPS("%%Begin/EndFeature code"): PASS
FAIL testppd (exit status: 9)

fixed it using this:
--- cups-filters/ppd/testppd.c	2020-11-16 22:45:54.000000000 +0100
+++ cups-filters/ppd/testppd.c.new	2020-11-16 22:54:32.592990707 +0100
@@ -911,9 +911,9 @@
     * Test new constraints...
     */

-    fputs("ppdOpenFile(test2.ppd): ", stdout);
+    fputs("ppdOpenFile(ppd/test2.ppd): ", stdout);

-    if ((ppd = ppdOpenFile("test2.ppd")) != NULL)
+    if ((ppd = ppdOpenFile("ppd/test2.ppd")) != NULL)
       puts("PASS");
     else
     {

PASS: testppd
PASS: testdither
PASS: test_analyze
PASS: test_pdf
PASS: test_ps
PASS: test_pdf1
PASS: test_pdf2
============================================================================
Testsuite summary for cups-filters 1.27.5
============================================================================
# TOTAL: 7
# PASS:  7
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================

:)

Thank you very much. I applied your patches as commit 378a821080ecb now.

authors: andyrtr tillkamppeter

repo: OpenPrinting/cups-filters


text:
Reconciliation over OpenSearch

By supporting OpenSearch endpoints as reconciliation services one would greatly existing the number of reconciliation services available. OpenSearch would also be a low barrier alternative to Reconciliation Service API for service development.
https://en.wikipedia.org/wiki/OpenSearch

Absolutely! That is something we have had on our radar in the reconciliation community group:
https://reconciliation-api.github.io/census/other-protocols/#opensearch
Independently of the spec work happening over there it could make sense to add support for OpenSearch services for reconciliation in OpenRefine.

But there's no scoring, only results with OpenSearch?  How would that work?  Scoring is implemented client side then, if the results provide enough disambiguating properties for each candidate?  How a match is determined, algorithmically or human, is pretty important, and scoring has to be done by one or the other or both.

I usually just interfere scoring from the search result order or set all results to the same score.

authors: Abbe98 thadguidry wetneb

repo: OpenRefine/OpenRefine


text:
add files

This failure is not caused by me.
“Build started
git clone -q https://github.com/OpenRefine/OpenRefine.git C:\projects\openrefine
git fetch -q origin +refs/pull/1139/merge:
git checkout -qf FETCH_HEAD
Specify a project or solution file. The directory does not contain a project or solution file.”
I find that if jython scripts are too long, the status code of the http response is 413 because you put scripts in the url. So I have changed some code again. Please have a check.
fix a bug: the results of runniing jython scripts are wrong when it has Chinses string.

Thanks for the pull request. Is there an issue associated with the bug that this fixes? What's the issue number?

This failure is not caused by me.
“Build started
git clone -q https://github.com/OpenRefine/OpenRefine.git C:\projects\openrefine
git fetch -q origin +refs/pull/1139/merge:
git checkout -qf FETCH_HEAD
Specify a project or solution file. The directory does not contain a project or solution file.”
I find that if jython scripts are too long, the status code of the http response is 413 because you put scripts in the url. So I have changed some code again. Please have a check.

Seems it caused by a bug of appveyor:
https://github.com/ogrisel/python-appveyor-demo/issues/6

Closing stale pull request

authors: iYefeng jackyq2015 tfmorris wetneb


text:
How to export kg results to local pc

I just want to use the KGextractor pipeline, How to export the kg results to local pc?

I just want to use the KGextractor pipeline, How to export the kg results to local pc?

kg result will be to graph engine（neo4j, etc）, you can export csv data through neo4j cypher.
Another way is to serialize the kg extraction result to local filesystem in invoke of KGWriter

I just want to use the KGextractor pipeline, How to export the kg results to local pc?

kg result will be to graph engine（neo4j, etc）, you can export csv data through neo4j cypher. Another way is to serialize the kg extraction result to local filesystem in invoke of KGWriter

I re-implement the invoke with the following code to save sub_graph to json. Is this sub_graph is kg results I needed?
class KGWriterLocal(KGWriter):
    def invoke(self, input: List[Output], alter_operation: str = AlterOperationEnum.Upsert, lead_to_builder: bool = False) -> None:
        logger.info(f"Writing graph to neo4j")
        self.client.write_graph(sub_graph=input.to_dict(), operation=alter_operation, lead_to_builder=lead_to_builder)
        logger.info(f"Writing graph to local file system")
        sub_graph_dict = input.to_dict()
        with open(os.path.join(file_path, "./data/kg.json"), "w", encoding='utf-8') as f:
            json.dump(sub_graph_dict, f, ensure_ascii=False, indent=4)

And in my saved sub_graph, I get the following results. There is no any meaningful spo results.
"resultEdges": [
        {
            "id": 140631256252624,
            "from": "建筑室内",
            "to": "KagDemo3#2000#100#20#LEN",
            "fromType": "Zone",
            "toType": "Chunk",
            "label": "source",
            "properties": {}
        },
        {
            "id": 140631256252576,
            "from": " Buildings",
            "to": "KagDemo3#2000#100#20#LEN",
            "fromType": "Building",
            "toType": "Chunk",
            "label": "source",
            "properties": {}
        },
....
]

authors: caszkgui pecanjk

repo: OpenSPG/KAG


text:
Sign in does not work with any provider

I am using latest version of keystone and keystone-nextjs-auth package and when I click on sign in button the page refreshes and nothing else happens:
Here are more details

Keystone Package versions
"@graphql-tools/schema": "^9.0.17",
"@keystone-6/auth": "^7.0.0",
"@keystone-6/core": "^5.1.0",
"@keystone-6/fields-document": "^7.0.0",
"@keystone-ui/core": "^5.0.2",

This is what I get in terminal
[next-auth][error][CLIENT_FETCH_ERROR]
https://next-auth.js.org/errors#client_fetch_error undefined {
  error: {},
  url: 'http://localhost:3000/admin/api/auth/session',
  message: undefined
}

here is my .env content
NEXTAUTH_URL=http://localhost:3000/admin/api/auth
SESSION_SECRET="H0Rvwx5gy5elNS2VhUuQfo5+5sL9WWJQ8dbIR/YsMs0="
DATABASE_URL=postgres://test:test@localhost:5432/test

Any ideas? any help is appreciated.

Same issue.
I try to resolve it, but it can't work correctly.
Anyone else helps?

This error will generally happen when Next-Auth can't find the NEXTAUTH_URL. Make sure the environment variable is set correctly - if using dotenv you could try setting the environment variable directly on the CLI.
If you have a minimal replication steps or code where you get the error I am happy to have a look.

I already set NEXTAUTH_URL="http://localhost:3000"
but it still does not work
in my case, I just initiated a new project by create-keystone-app CLI and then add keystone-nextjs-auth to try to integrate my application with Okta

I have been doing some troubleshooting this issue, and it looks like a change that happened in the next-auth getSession() API between 4.19.1 and 4.22.1 to resolve for now you can use resolutions in your package.json to pin to next-auth@4.19.1

Thank you, bro!
It's correct, I resolved this issue

repo: OpenSaasAU/keystone-nextjs-auth


text:
A Timely Blog Post

💥

This looks fantastic and the information contained therein is EXCELLENT

authors: bitcoinprecept dergigi

repo: OpenSats/website


text:
Blog Post: Second Wave of Education Grants

Build Preview:

/blog/second-wave-of-education-grants

Social Preview:

On second thought, the whole "wave" of grants stuff might get confusing. We already have waves of nostr grants and waves of bitcoin grants, so I think a different title might work better.
What about "Fruits from the OpenSats Education Initiative" or something along these lines?

On second thought, the whole "wave" of grants stuff might get confusing. We already have waves of nostr grants and waves of bitcoin grants, so I think a different title might work better.
What about "Fruits from the OpenSats Education Initiative" or something along these lines?

It might be confusing, but the "Education Initiative" designation in the title should alleviate confusion. With that said, these are specifically bitcoin related project grants, but there may come a day where there are nostr related education grants, so perhaps it does make sense to come up with a new recurring title we can use for all future education grant waves.
I really like the "fruits" title suggestion for this one, but how would we reuse this title for the next wave of education grants, or should each wave of education grant announcements have a new title?

No strong feelings either way, happy to keep the title as is.

Live now:

https://opensats.org/blog/second-wave-of-education-grants
nostr post


text:
Add grid intersection code

This PR should add the calculation of the weights of the grid intersections between line and grid from pycomlink to close #5.

[ ] closes #5
[ ] Tests added and passed if fixing a bug or adding a new feature
[ ] All code checks from pre-commit passed
[ ] Added an entry in the CHANGELOG.md file

To overcome the issue of descending lon/lat coordinates there should be a check based on this raise that checks if lon or lat are descending and if true, a flip along the respective axes e.g. like here.

We should raise an error in calc_intersect() if lat or lon coords are not ascending (like its correctly raised right know in _calc_grid_corners_for_lower_left_location(). The error should add a code snippet how to flip on or lat OR we add an option to automatically flip the coords to be ascending BUT we happens if we have a grid over the equator and on the southern hemisphere?
--> what do we do with a global grid with lower left definition of the grid??

Additionally, the offset for the bounding box should be calculated in the center of the grid and should be always positive

Summary of recent changes:

mainly updating the style of the grid intersection and test code
updating the projects .toml file
removing pixel_poly_list
adding some additional tests for full coverage

Open to suggestions but ready to be merged from my side-

🎉 Thanks @maxmargraf

authors: cchwala maxmargraf

repo: OpenSenseAction/poligrain


text:
Countdown and Message as model

New discussion with @emanuelschuetze: We create new countdown and message models (with access permissions, viewset, serializers, ...) and use the general projector button to control them. Countdowns are not coupled to the projector any more.
( @FinnStutzenstein It is a little bit like it was before in you pull request, but we also want to change the control buttons decouple it from the projector. Maybe some work has to be done twice. Sorry. You can ask @emanuelschuetze about details you you are interested. )

Note: The projection buttons for countdown and messages should become round corners after using the default button (see #2514).

authors: emanuelschuetze normanjaeckel

repo: OpenSlides/OpenSlides


text:
Improves the view of tiles

Sorts the tiles by the weight of their category.

also present in #4913

authors: GabrielInTheWorld tsiegleauq


text:
User customizable gender field

The current three options for gender are less than ideal for my userbase ("male", "female", "diverse"). "Diverse" doesn't quite translate well with American vernacular, and some users may not feel they are "diverse" and are just a single gender (e.g. someone is non-binary and only that).
This would be better as either a user-customizable text box similar to the pronouns field, or if admins would be able to set other genders as pre-programmed options.

Thanks for your suggestion! We've had similar requests in the past and decided on the current implementation as a compromise which was easy to use and maintain, but also suffices for most users. We will debate whether to change this.

That could certainly be a possible compromise.

authors: colinmahns jsangmeister

repo: OpenSlides/openslides-client


text:
add validator for organization reply address

resolves #1969

I've added a directive that trims the pasted input.

I can't replicate that. When I'm adding a space at the end of the email address a error message is shown below the input and I can't save.


text:
create a singleSelection() function that let user chose single image

this has two problems, first it wont let any other image selected as it requires second user will have to deselect and then only it can select new image and proceeded with it,
either this
new Gligar().requestCode(PICKER_REQUEST_CODE).withFragment(this).limit(1).show()
should allow selection of other images while one is selected or setSingleSelection(true) should be made that could introduce such behavior
Praises to creator

Totally agreed with @muhammadkamranlatifraza it will be a great UX enhancement.
Looking forward to that

@hani-momanii any update on that?

authors: crackTheCode muhammadkamranlatifraza

repo: OpenSooq/Gligar


text:
Issue with music playing, possibly due to Callbacks no-longer being supported.

Hello all,
I would just like to let you know I am aware of an issue with music playing, possibly due to Callbacks no-longer being supported.
I will work on an immediate fix for this and will update as soon as I have fixed this issue.

I believe this issue is fixed, I am still currently monitoring so please let me know if this issue happens again.


text:
How do you manage CP with Development?[Session by Satyaki]

First of all, thanks Satyaki bh for giving your time for this session, I follow you on various sites and know quite a bit about you.
This question is quite common and little personal, with regard with your profile. I know there can be common answer that "You should manage your time", "You should be disciplined", "You should do what you enjoy"(I honestly enjoy both the stuff) and the list can continue. But how? I want to know if there is a (hack)technique you follow or a method you adopt to manage your time and how was your typical day in college and when you joined at Directi. Also I have observed that, in spite of your job, you are constantly in touch with competitive programming, and that's very exceptional. I mean most of the top coders of our college left CP platforms just after they joined their job, because of loads of work. I myself did gsoc last year, and I find it very difficult to manage CP and Dev both at the same time? Also the saying goes "If you want to become good at something, you should fully concentrate on that stuff only", which  is totally against, this. :p
Thanks again :D

@satyaki3794 Looks like there is a question for you. :) Could you help answer this? Thanks!

I have already touched on this in the session. To reiterate, you need to decide your priorities. Yes, managing CP with work is tough but not impossible. You have to make sacrifices to make time for CP (eg. I stopped going out on weekends). I wake up early and practise before going to work. I come back home from work and practise again. I do not have much time for movies, TV series, socializing as a result of this but these are the sacrifices I chose to make. :)

authors: nikhita sarthak-sopho satyaki3794

repo: OpenSourceHelpCommunity/Questions


text:
What happened to TaxBrain parameter _ACTC_ChildNum?

The same TaxBrain testing script that ran fine yesterday on scalar parameter values, now gets this error:
ValueError: no TaxBrain parameter named _ACTC_ChildNum

Has something changed that I don't know about?
@talumbau

Martin said:

The same TaxBrain testing script that ran fine yesterday on scalar parameter values, now gets this error:

ValueError: no TaxBrain parameter named _ACTC_ChildNum

After several more runs of TaxBrain, this error seems to have disappeared.  Closing this issue.

repo: OpenSourcePolicyCenter/webapp-public


text:
Adding Chinese localization for web config

Supplement and improve Chinese localization.

Thanks! I've marked this as Draft for now until we land #1040

I removed 4 labels under AddonsConfig.jsx that seems not in use, and changed the order of "Pin LED" to "LED Pin".

authors: SavageCore rebornsick


text:
Limit the search to only pages on the public site

Hides the fund forms and the round pages
@chris-lawton Should fix the issue we had the other day.

LGTM

authors: todd-dembrey zerolab


text:
🛑 Text-to-Speech - Mimic3 - Ziggyai is down

In 8f2d31e, Text-to-Speech - Mimic3 - Ziggyai (https://mimic3.ziggyai.online/status) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Text-to-Speech - Mimic3 - Ziggyai is back up in e2a0fc2 after 9 minutes.

repo: OpenVoiceOS/status


text:
🛑 Speech-to-Text - Citrinet - Smart'Gic is down

In 781278a, Speech-to-Text - Citrinet - Smart'Gic (https://stt.smartgic.io/citrinet/status) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Speech-to-Text - Citrinet - Smart'Gic is back up in 3f5d9a0 after 49 minutes.


text:
Error when swapping to item with "Aspect of the X" mod

When trying to swap to another item (in my case a shield) with Aspect of the Spider PoB gives me the previous error.
The error goes away when the aspect is removed from the item.

Fixed in the next update.

authors: Henbun Openarl

repo: Openarl/PathOfBuilding


text:
Integrate Slack

We have a community on Slack, but need to integrate and authenticate through app while continuing petition (/action).

There are several apps in slack that allow for this, my team uses them, there's a github app, as well as Circle CI and dploy.io might be worth checking them out.

Agree. Fernando (@nanoxd) has the lead. Can you work with him?

On Apr 19, 2015, at 9:24 AM, Krystyna Ewing notifications@github.com wrote:
There are several apps in slack that allow for this, my team uses them, there's a github app, as well as Circle CI and dploy.io might be worth checking them out.
—
Reply to this email directly or view it on GitHub.

@Wimsy113 What did you have in mind?

Well the github app for slack keeps track of pull requests for the repo that it's connected to, and the circleci actually tests the changes that you have made to a repo and let's you know whether they have passed or failed so you can make changes accordingly, they also track pull requests as you go. They can get really spammy especially if you are working on a fix or whatnot. so it really depends on what you're trying to track @nanoxd

@Wimsy113 I responded back in Slack :smile:. Let's move this discussion there

Thanks @nanoxd for this recommendation for on-boarding: https://github.com/rauchg/slackin.

authors: Wimsy113 davidmolina nanoxd

repo: OperationCode/operationcode


text:
License

Hi,
Thank you for maintaining this repository and contributing to the open-source community. I noticed that the repository currently does not include a license file. Adding a license is crucial as it helps clarify how others can use, modify, and distribute the code.
Would it be possible to add a license to the repository? If you are unsure about which license to choose, this guide provides a good overview of popular open-source licenses.
Thank you for your time and consideration!

Hi L1ghtman2k
updated with Apache 2.0 LICENSE

repo: OpsMx/spinnaker-helm


text:
Add py.typed File, Fix Minor Typing Issue

We need a py.typed file for this library's types to be properly recognized by type-checkers. Make minor typing fix to update.

Thanks @max-muoto !

authors: max-muoto wesleykendall


text:
More declarative style

Hey there!
I developed this over the last week:
https://github.com/ORESoftware/npm-link-up
I just discovered your project now. Cool - I wonder if there are others.
One thing I like about my project, is that the tool will search for the packages by name. All you need is a config file with the list of dependency names, and npmlinkup will search for them on the filesystem. So if you happen to move projects around by chance, it will still work fine.
Also, we probably have slightly different algorithms. I tested mine and it should manage circular dependencies just fine. Still have to write more tests for npmlinkup though.

Hi, you may also be interested in this approach to the problem: https://github.com/whitecolor/yalc

@the1mills you mean yalc? it is really very simple. I think it has another goals then npm-link-up just related. It is not for monorepo, monorepo actually assumes that project has many nested packages and they are managed together that is lerna for.
Primarily yalc's goal to get rid of using symlinks when working with shared packages that are in progress ( because symlinks it is the part of the workflow that brings most of the problems, that is why I would never use such tool as pnpm for example) and there are some other issues with npm link workflow too. So it actually "simulates" installation of the packages as if they were installed normally from the registry.

Thanks a lot

authors: ORESoftware SaltonSea374 whitecolor

repo: OrKoN/npm-link-shared


text:
Design bugs identified in issue #1201

Prerequisites

[X] I have searched for duplicate or closed issues
[X] I have validated any HTML to avoid common problems
[X] I have read the contributing guidelines

Describe the issue
This issue comes from the work done in Issue #1201 List in all the doc the incompatibility with ODS in which all Boosted components (variants included) have been inspected in order to identify the ones that do not respect ODS specifications and therefore need an alert message saying "Do not use in ODS".
Doing this work, some design bugs were noticed. They are summed up here is the list below in order to be corrected in Boosted to respect ODS specifications.
Process

Choose one use case in the list below
Create a branch and a PR for this use case
In the list, add at the end of the corresponding line a link to the PR
When the PR is merged, check the use case in the list

Note: Please try to avoid creating a PR that handles several use cases at the same time; it will be easier to track the use cases and easier for the reviewers with small PRs.
Note: This issue will be considered done (and can be closed) when all the use cases are handled, checked and merged.
List of what needs to be corrected in Boosted:
-- DOING... --
docs/5.1/content/tables/

hoverable-row:

[ ] on table-light: change the background color on hover for "#DDD".  (See PR #859 - contains design specification)

[ ] on table-dark, change the background color on hover for "#333".  (See PR #859 - contains design specification)

row-selection:

[ ] on table-light, change background color on selected by "#DDD" (See PR #859 - contains design specification)
[ ] the space between the checkbox of the first column and the text of the second column is too large. It's the same for all the following table with a similar checkbox. (See issue Docs > Tables > Row selection: space after checkbox incorrect #1236)
[ ] The checkbox icon container shall be 40px x 40px instead of the present (30px x 30px + margin of 5px). See ODS specification "standard table with column header WEB-TBL-STD-003.

docs/5.1/forms/checks-radios/

indeterminate:

[ ] background checkbox color on state indeterminate to be changed

[ ] background checkbox color on state indeterminate disabled to be changed

Reduced test cases
NA
What operating system(s) are you seeing the problem on?
macOS
What browser(s) are you seeing the problem on?
Chrome
What version of Boosted are you using?
v5.2

Could you please create specific separate issues. Otherwise it will be complicated to track.
Note: bugs should not appear in sprints boards (I removed this issue from it)

authors: isabellechanclou julien-deramond


text:
Limited functionality of CalculableHook

Due to bug in OrientDB https://github.com/orientechnologies/orientdb/issues/4158 we have to disable calculation for newly created document. To take actual result: please reload object after creation.
To fix this issue in Orienteer just uncomment CalculablePropertiesHook.onRecordAfterCreate() when related issue in OrientDB will be fixed.

Related issue in OrientDB: https://github.com/orientechnologies/orientdb/issues/4575

No response from OrientDB guys: need to move to 1.2

Not yet implemented in OrientDB. Moving to next release

repo: OrienteerBAP/Orienteer


text:
fixing nbdev workflow

testing

I'm not sure if this is the right fix or not. At least, the original bash test seems to broken for me ￼  Or some command behavior changed recently??? Let's see how Jeremy responds on this, https://github.com/fastai/workflows/pull/63
@borna if you copy the original nbdev-ci with the above changes, it should work with us. Please send a PR until the upstream is fixed.

authors: doyu matiasto


text:
Document review API

Document reviews API.

Creating them
Finding them

Added a couple of links and some clarification 😁

authors: DanielVF micahalcorn

repo: OriginProtocol/docs


text:
Notifications API

Once https://github.com/OriginProtocol/origin-js/pull/222/ is merged, the Notifications API should be documented.

Done via https://github.com/OriginProtocol/origin-docs/pull/44 ✅

repo: OriginProtocol/origin-docs


text:
Listing Withdrawal Confirmation

There seems to be some issue with the transaction confirmation callback and/or the object returned from call for the withdrawListing method, which I haven't been able to quickly debug. The DApp looks for the transactionHash and other missing data.

Closing this since GraphQL 🤷♂

repo: OriginProtocol/origin-js


text:
obsolete route /import removed

Removed /import route from "ot-node.js" file.
Pivotal task ID#158211192.

Class import.js contains functions for supported import types - GS1, old XML, JSON and WOT. That class needs to be kept, except the function related to old python importer.

@alexveljkovic @Niks988
So is this good to go in, or what is the work pending it's unclear to me?

authors: Niks988 alexveljkovic radomir-sebek

repo: OriginTrail/ot-node


text:
git ship: use the title of the associated PR for the commit message

This way we can auto-generate the commit message altogether, and don't have to query the user for it.

Closing as with 4.2.0 we can now ship with the Github API and the link is automatic

authors: charlierudolph kevgo

repo: Originate/git-town


text:
cleanup: sync master before deploying website

@kevgo @allewun
just to be safe

Good idea  :ship:


text:
🛑 Fog is down

In 6fcc2f4, Fog (http://fog.ac) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Fog is back up in e9a0683.

repo: OsintUK/Up-or-Down


text:
Ansible 1

Выполнено ДЗ №

[x] Основное ДЗ
[x] Задание со *

В процессе сделано:

Разобраны типовые Ad-Hoc команды;
Написан базовый плейбук;
Выполнена работа с различными типами Inventory-файлов;

Как запустить проект:

Заменить значения в Inventory-файле на свои.

Как проверить работоспособность:

На основе вывода ansible.

PR checklist

[x] Выставил label с номером домашнего задания
[x] Выставил label с темой домашнего задания

Прошу прочитать! Касательно задания со *:

В рамках текущего задания требовалось создать скрипт, создающий динамический Inventory-файл с
JSON-структурой. Мною был написан очень простенький Python-скрипт, который получает список
всех инстансов через Yandex CLI. На основе имени инстанса определяет группу, к которой он относится.
Например, для reddit-app и reddit-db в логике скрипта группа формируется из окончания имени -
app и db соответственно.
Скрипт создаёт словарь с ключами в виде групп и значениями в виде массивов с элементами хостов,
конвертирует его в JSON и print-ом отдаёт вывод.
Работу скрипта проверил - работает. К сожалению, автотест по этому заданию не прошёл, так как не имеет
сервисного доступа к моему Yandex Cloud. В ansible.cfg вернул путь к статическому Inventory-файлу.
Надеюсь, что задание со * можно считать выполненным. Прошу, пожалуйста, дать обратную связь!

Это нормальная история что скрипт не имеет доступа =)
Так же если вы планируете доработать скрипт, то можете посмотреть в сторону использования лейблов и уже формировать инвентарь по ним =)

authors: mrgreyves noirgt


text:
Release 0.28.0-beta

Updated HISTORY, marked some new features as experimental.
Bumpversion to 0.28.0-beta.
Should we bump to 0.28.0 or leave it at beta ?

Should we bump to 0.28.0 or leave it at beta ?

Either one would be fine for me, my question to you is if we tag a beta version, should we make it available on PyPI and conda-forge?

I suppose there is no point in making a release but not distributing it. I suggest we bump to 0.28.0 and deal with bugfixes in patch releases if needed. We merged a few PRs that I consider still experimental, but they're identified in the release notes.

I suppose there is no point in making a release but not distributing it. I suggest we bump to 0.28.0 and deal with bugfixes in patch releases if needed. We merged a few PRs that I consider still experimental, but they're identified in the release notes.

ok for me too

authors: Zeitsperre huard tlogan2000

repo: Ouranosinc/xclim


text:
Does it work with Tapsellplus too?

Apparently Tapsell has been discontinued and they won't support Tapsell anymore.
Any plan to upgrade or any compatibility between this repo and Tapsellplus sdk?

Tapsellplus and standard banner ad(#2) implementation is almost done and will be merged soon.

repo: OverShifted/GodotTapsell


text:
Cookie parsing error called Result::unwrap()on anErr value: RelativeUrlWithoutBase

Hi,
bandsnatch currently isn't parsing my cookies.txt file correctly:
.bandcamp.com	TRUE	/	TRUE	2028157437	client_id	XXXXXXXXXXXXXXXXXXXXXXXXX

 $ RUST_BACKTRACE=1 ./target/debug/bandsnatch run --format mp3-320 mjsir911 -c cookies.txt
thread 'main' panicked at src/cookies.rs:89:43:
called `Result::unwrap()` on an `Err` value: RelativeUrlWithoutBase
stack backtrace:
   0: rust_begin_unwind
   1: core::panicking::panic_fmt
   2: core::result::unwrap_failed
   3: core::result::Result<T,E>::unwrap
             at /rustc/7cf61ebde7b22796c69757901dd346d0fe70bd97/library/core/src/result.rs:1073:23
   4: bandsnatch::cookies::fill_cookie_jar
             at ./src/cookies.rs:89:20
   5: bandsnatch::api::Api::new
             at ./src/api/mod.rs:37:26
   6: bandsnatch::cmds::run::command
             at ./src/cmds/run.rs:115:24
   7: bandsnatch::main
             at ./src/main.rs:40:36
   8: core::ops::function::FnOnce::call_once
             at /rustc/7cf61ebde7b22796c69757901dd346d0fe70bd97/library/core/src/ops/function.rs:250:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

Hi, so sorry for taking a bit to get to this. It should be fixed in v0.3.2!

repo: Ovyerus/bandsnatch


text:
ES3/ES5 Javascript Usage in README not working

Following the ES3/ES5 Javascript Usage in README, I just had a try with a simple website like below in my Chrome and get errors in my console.
<html>
<head>
    <script src="https://unpkg.com/deeplearn@0.3.0"></script>
</head>
<body>
    <script>
    var dl = deeplearn;    // missing this line by the way
    var math = new dl.NDArrayMathGPU();
    var a = dl.Array1D.new([1, 2, 3]);
    var b = dl.Scalar.new(2);
    var result = math.add(a, b);

    // Option 1: With a Promise.
    result.data().then(data => console.log(data));

    // Option 2: Synchronous download of data. This is simpler, but blocks the UI.
    console.log(result.dataSync());

    </script>
</body>
</html>

my console gives:
Uncaught TypeError: result.data is not a function
    at (index):14

I think both Option 1 and 2 in this Usage instruction are wrong.
Because I list the properties of the object result:
for(var propertyName in result) {console.log(typeof propertyName, propertyName)}

and there is no function named data  or dataSync.  I think for the Option 1, it should probably use getValuesAsync instead:
// Option 1: With a Promise.
result.getValuesAsync().then(data => console.log(data));
// Option 2: Synchronous download of data. This is simpler, but blocks the UI.
console.log(result.getValues());

@hma02 data and dataSync was added in version 0.3.3. Please use this version or higher. You should change 0.3.0 to 0.3.3 or higher and try.

Oh I see.  I just tried it works. Thanks a lot.

Ok It works now with 0.3.3. Thanks

repo: PAIR-code/deeplearnjs


text:
Symfony/console to 4.0

WWW is upgraded to laravel 5.6

Denying PR as discussed here: https://github.com/PCextreme/cloudstack-php/pull/3/commits/677ff8cdf47fc1699c9edd4a73a76260281f963c#r188888208

authors: Lesleydesmet kevindierkx

repo: PCextreme/cloudstack-php


text:
首頁未記住語言偏好前是英文，語言選單不明顯

window.navigator.language 觸發是好方法，
不過不一定所有所有中文用戶的navigator.language都是zh_TW等中文
所以同步把語言選單弄醒目一點，例如壓個底色、字放大and/or往上移一些，還是會更好 :)

that's right. gonna highlight it a little bit.

authors: bestian jokeum

repo: PDIS/web


text:
group add behaves like group set on default players

When used on newly joined players (or after doing pex user delete), /pex user <user> group add replaces the default group as if it were /pex user <user> group set. This only happens the first time, then it works normally if adding further groups. If I /pex user <user> group set default first, the group add works normally and keeps the default group as it's supposed to.

PEX doesn't show the default group in the users list, so it looks like they have no group when they join, and then using group add shows only the added group when the users is actually in both groups.  If you test their permissions, you should find that they're getting permissions from both groups.

authors: Stormbow lasercar

repo: PEXPlugins/PermissionsEx


text:
how to get bitrate from music?

Q
A

Bug?
no

New Feature?
maybe

Version Used
least

FFmpeg Version
3.1.4

OS
centos

I did not find how to get bitrate from music? anyone know?

You need to play a little as soon as I got time.
var_dumping https://github.com/PHP-FFMpeg/PHP-FFMpeg#ffprobe with your opened audio file should give you the key.

closed due to inactivity.

repo: PHP-FFMpeg/PHP-FFMpeg


text:
Add available deliveries and current delivery

Add available deliveries and current delivery

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)

How has this been tested?

[ ] Unit test(s)
[ ] Integration test(s)
[ ] Tested manually

Checklist:

[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my own code
[X] I have commented my code, particularly in hard-to-understand areas
[X] My changes generate no new warnings
[X] I have added tests that prove my fix is effective or that my feature works
[X] New and existing unit tests pass locally with my changes
[X] I have checked my code and corrected any misspellings
[X] I have added frontend code and checked it for mobile & desktop

Task linked: CU-862jq8ddd Available deliveries - frontend

repo: PJATK-SPK/ingoodhands


text:
DNS-name is not omitted when saving to Central Certificate Store

I'm using Server 2012R2 with Russian UI.
As you know, resulting .pfx files for CCStore should be named FQDN.pfx, but v1.9.11.1 actually creates files with prefix "DNS-имя=" (which is russian for 'DNS Name=' in certificate's SAN field):
 [INFO] Saving certificate to C:\ProgramData\letsencrypt-win-simple\httpsacme-v0
1.api.letsencrypt.org
 [INFO] Copying certificate to the Central SSL store
 [INFO] Saving certificate to Central SSL location \\SERVER\centralstore$\
DNS-имя=autodiscover.SITE1.pfx
 [INFO] Saving certificate to Central SSL location \\SERVER\centralstore$\
DNS-имя=autodiscover.SITE2.pfx

BTW, LetsEncrypt renewal task using CCS works perfect with Exchange CAS array!
There's no need in "Enable-ExchangeCertificate -service IIS", cause IIS 8+ always use a fresh one from CCS for a binding.
I had to add a PS-script to rename .pfx files as a workaround:
$StorePath = "E:\LetsEncrypt\CentralStore"
get-childitem $StorePath -Filter '*.pfx' | ForEach-Object {
    $NewName = $_.Name -replace 'DNS-имя=',''
    $Destination = Join-Path -Path $_.Directory.FullName -ChildPath $NewName
    Move-Item -Path $_.FullName -Destination $Destination -Force
}

Please, fix 'DNS***=' in filenames for localized OS versions.

Thanks for the report! Would never in a million years have come across this myself :)

Nice shot! Just one trim!

repo: PKISharp/win-acme


text:
🛑 MUSA is down

In 0bcab22, MUSA (https://storemusa.com/) was down:

HTTP code: 403
Response time: 514 ms

Resolved: MUSA is back up in 9a12b75 after 1 hour, 13 minutes.

repo: POCLANOS/status


text:
🛑 MUSA is down

In 5f78265, MUSA (https://storemusa.com/) was down:

HTTP code: 403
Response time: 322 ms

Resolved: MUSA is back up in 25ae7e6 after 31 minutes.


text:
RuntimeError: merge_sort: failed to synchronize: cudaErrorIllegalAddress: an illegal memory access was encountered

Hi!
Thanks for your excellent work! I followed the README to train MaskPLS. However, I encountered the following error during the first iteration.
I have checked outputs, loss_dict, total_loss, and they all seem to be fine.
My environment is torch==1.10.1+cu111, and the rest are the same as in the requirement.txt file.
Could you please help me understand how this problem arose and how to solve it? Thanks in advance!
Traceback (most recent call last):
  File "scripts/train_model.py", line 81, in <module>
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "scripts/train_model.py", line 40, in main
    "experiments/" + cfg.EXPERIMENT.ID, default_hp_metric=False
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 737, in fit
    self._call_and_handle_interrupt(
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 682, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 772, in _fit_impl
    self._run(model, ckpt_path=ckpt_path)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1194, in _run
    self._dispatch()
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1274, in _dispatch
    self.training_type_plugin.start_training(self)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/plugins/training_type/training_type_plugin.py", line 202, in start_training
    self._results = trainer.run_stage()
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1284, in run_stage
    return self._run_train()
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/trainer/trainer.py", line 1314, in _run_train
    self.fit_loop.run()
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/base.py", line 145, in run
    self.advance(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/fit_loop.py", line 234, in advance
    self.epoch_loop.run(data_fetcher)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/base.py", line 145, in run
    self.advance(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 193, in advance
    batch_output = self.batch_loop.run(batch, batch_idx)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/base.py", line 145, in run
    self.advance(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 88, in advance
    outputs = self.optimizer_loop.run(split_batch, optimizers, batch_idx)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/base.py", line 145, in run
    self.advance(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 215, in advance
    result = self._run_optimization(
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 259, in _run_optimization
    closure()
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 160, in __call__
    self._result = self.closure(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 155, in closure
    self._backward_fn(step_output.closure_loss)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 327, in backward_fn
    self.trainer.accelerator.backward(loss, optimizer, opt_idx)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/accelerators/accelerator.py", line 311, in backward
    self.precision_plugin.backward(self.lightning_module, closure_loss, *args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 91, in backward
    model.backward(closure_loss, optimizer, *args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/pytorch_lightning/core/lightning.py", line 1434, in backward
    loss.backward(*args, **kwargs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/torch/_tensor.py", line 307, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
  File "/home/yangyu/envs/PS/lib/python3.8/site-packages/torch/autograd/__init__.py", line 154, in backward
    Variable._execution_engine.run_backward(
RuntimeError: merge_sort: failed to synchronize: cudaErrorIllegalAddress: an illegal memory access was encountered

I changed the torch version to torch==1.10.1+cu113 and the problem is fixed. Thanks!

repo: PRBonn/MaskPLS


text:
refactor: Consolidate regex ident checks

From https://github.com/PRQL/prql/pull/2669#discussion_r1212792233
The behavior change is on handling *, which I think is correct — at least it seems to compile OK.

I trust you that this is correct.

TBC when I say "I think is correct", I mean that this is the correct PRQL: https://github.com/PRQL/prql/pull/2678/files#diff-5557efedcdc69e2fbea057c573b9fb68fb96c2f5b8a087b0ba8b25531bfd949dR9-R10 — i.e. that we should not be quoting * like we do now.

Oh, no that is not correct.
Well, produced PRQL will still be correct, but the backticks are not required in a.`*`.

Oh, no that is not correct.
Well, produced PRQL will still be correct, but the backticks are not required in a.`*`.

Sorry — to confirm — is the proposed code correct or the existing code?
I think the proposed code is correct, which removes the backticks — right?

I'm embarrassed how many times I've made a mistake here. Yes, removing backticks is correct.

authors: aljazerzen max-sixty

repo: PRQL/prql


text:
Conjugate Gradient

This contains the implementation of the conjugate gradient method for linear systems of the form Hx=b, where H is a self-adjoint LinearOperator.

This contains the implementation of the conjugate gradient method for linear systems of the form Hx=b, where H is a self-adjoint LinearOperator.

A point for discussion would already be the following: Should this method be intened to be used with leading batch-dimension>1? If yes, we have to decide on how to act regarding the stopping criterion... Should the CG only stop if for all considered problems the stopping criterion is met?
I think this could in general be problematic as one could have differently-conditioned problems which require different stopping criterions/number of iterations...
I think I would leave the batch-version of the CG maybe as a future implementation as "layer" to be used within a NN. What do you think?

Also, is this considered to be a "basic" algorithm for which we would like to include a callback? see also #194

Without thinking too long about it:

regarding batch: I would consider the operator as (other...) - > (other...) so the norm will be after flattening all dimensions and we consider a batched problem always as one big problem, not as batches.. I think this is what you are doing, right?

can we optimize the inner loop a bit?

if you want some verbosity on the optimizer, I'd add a callback to cg.

Without thinking too long about it:
* regarding batch: I would consider the operator as (other...) - > (other...) so the norm will be after flattening all dimensions and we consider a batched problem always as one big problem, not as batches.. I think this is what you are doing, right?

exactly, I added a comment in the documentation that explains how this case is handled and also included some tests to check that this works indeed.

* can we optimize the inner loop a bit?

I now closely followed the scipy version, but maybe there is still room for improvments?

* if you want some verbosity on the optimizer, I'd add a callback to cg.

done

For lbfgs we use 'initial parameters', here it is 'starting value', can we use similar names for the optimizers?
-> initial value ?

can we add a test that checks if the callback is called?

repo: PTB-MR/mrpro


text:
[Bug] Error message "the styled(component)(... args) API requires all its args to be defined"

Describe the bug
An error msg is displayed in the console.
To Reproduce
Run the website from branch 21 (or main at this point?). Open console and read.
Expected behavior
No error msg.
Screenshots

Additional context
The tabs work exactly as intended.

Might need to suppress the error. The website works as intended.


text:
"make posix gazebo_iris_opt_flow" not working.

Hello,
Iv been trying to get the simulator working but everytime i run make posix gazebo_iris_opt_flow i end up with the following error,
swapnil@UTARIROS08:~/catkin_ws/src/px4_firmware/Firmware$ make posix gazebo_iris_opt_flow
PX4 CONFIG: posix_sitl_default
[  1%] [  1%] Built target git_gencpp
Built target prebuild_targets
[  1%] [  2%] Built target git_genmsg
Built target git_uavcan
[  2%] Built target git_mavlink
[  3%] [  3%] Built target git_jmavsim
Built target git_matrix
[  5%] Built target df_driver_framework
[  5%] Built target git_driverframework
[  5%] Built target git_ecl
[  5%] [  6%] Built target git_gazebo
Built target xml_gen
[  7%] Built target mixer_gen
[ 31%] Built target msg_gen
[ 31%] [ 31%] Built target generate_topic_listener
Built target platforms__common
[ 32%] Built target drivers__boards__sitl
[ 33%] Built target drivers__gps
[ 35%] Built target drivers__device
[ 35%] Built target drivers__pwm_out_sim
[ 36%] Built target platforms__posix__drivers__adcsim
[ 44%] Built target systemcmds__tests
[ 44%] Built target platforms__posix__drivers__accelsim
[ 44%] Built target platforms__posix__drivers__airspeedsim
[ 44%] Built target platforms__posix__drivers__barosim
[ 44%] Built target platforms__posix__drivers__gyrosim
[ 45%] Built target platforms__posix__drivers__gpssim
[ 45%] Built target platforms__posix__drivers__ledsim
[ 46%] Built target platforms__posix__drivers__tonealrmsim
[ 46%] Built target platforms__posix__drivers__rgbledsim
[ 46%] Built target systemcmds__esc_calib
[ 47%] Built target platforms__posix__px4_layer
[ 47%] [ 50%] [ 52%] Built target systemcmds__param
Built target platforms__posix__work_queue
Built target systemcmds__mixer
[ 53%] [ 53%] Built target systemcmds__reboot
Built target systemcmds__sd_bench
[ 53%] [ 54%] Built target systemcmds__perf
Built target systemcmds__topic_listener
[ 54%] [ 54%] [ 54%] Built target systemcmds__ver
Built target systemcmds__top
Built target systemcmds__motor_ramp
[ 54%] Built target modules__attitude_estimator_q
[ 54%] [ 54%] Built target modules__attitude_estimator_ekf
Built target modules__dataman
[ 54%] Built target modules__ekf2
[ 58%] Built target modules__commander
[ 59%] [ 59%] Built target lib__external_lgpl
Built target modules__ekf_att_pos_estimator
[ 60%] Built target modules__land_detector
[ 61%] Built target modules__mc_att_control_multiplatform
[ 66%] [ 68%] Built target lib__ecl
Built target modules__uORB
[ 68%] Built target modules__mc_pos_control
[ 69%] Built target modules__mc_att_control
[ 69%] Built target modules__param
[ 70%] Built target modules__mc_pos_control_multiplatform
[ 71%] Built target modules__position_estimator_inav
[ 77%] [ 77%] Built target modules__local_position_estimator
Built target modules__mavlink
[ 81%] Built target modules__navigator
[ 82%] Built target modules__sdlog2
[ 82%] Built target modules__replay
[ 82%] Built target modules__sensors
[ 83%] Built target modules__simulator
[ 84%] Built target modules__systemlib__mixer
[ 85%] Built target modules__vtol_att_control
[ 90%] Built target modules__systemlib
[ 90%] Built target lib__conversion
[ 91%] Built target lib__controllib
[ 91%] [ 91%] Built target lib__geo_lookup
Built target lib__DriverFramework__framework
[ 92%] [ 92%] Built target lib__geo
Built target lib__mathlib__math__filter
[ 93%] Built target lib__mathlib
[ 93%] Built target lib__launchdetection
[ 94%] Built target lib__rc
[ 94%] Built target lib__tailsitter_recovery
[ 94%] Built target lib__runway_takeoff
[ 94%] Built target lib__terrain_estimation
[ 94%] Built target examples__px4_simple_app
[ 95%] Built target drivers__sf0x__sf0x_tests
[ 96%] Built target lib__rc__rc_tests
[ 97%] Built target modules__commander__commander_tests
[ 97%] [ 97%] Built target modules__controllib_test
Built target modules__unit_test
[ 98%] Built target modules__uORB__uORB_tests
[100%] [100%] [100%] Built target modules__logger
Built target modules__fw_pos_control_l1
Built target modules__fw_att_control
[100%] Built target px4
SITL ARGS
rc_script: posix-configs/SITL/init/rcS
debugger: none
program: gazebo
model: iris_opt_flow
build_path: /home/swapnil/catkin_ws/src/px4_firmware/Firmware/build_posix_sitl_default
make[5]: warning: jobserver unavailable: using -j1.  Add +' to parent make rule. make[8]: *** No rule to make target /home/swapnil/catkin_ws/src/px4_firmware/Firmware/Tools/sitl_gazebo/PROTOBUF_PROTOC_EXECUTABLE-NOTFOUND', needed by `MotorSpeed.pb.cc'.  Stop.
make[7]: *** [CMakeFiles/mav_msgs.dir/all] Error 2
make[7]: *** Waiting for unfinished jobs....
[  4%] Built target sdf
make[6]: *** [all] Error 2
make[5]: *** [gazebo_build] Error 2
make[4]: *** [src/firmware/posix/CMakeFiles/gazebo_iris_opt_flow] Error 2
make[3]: *** [src/firmware/posix/CMakeFiles/gazebo_iris_opt_flow.dir/all] Error 2
make[2]: *** [src/firmware/posix/CMakeFiles/gazebo_iris_opt_flow.dir/rule] Error 2
make[1]: *** [gazebo_iris_opt_flow] Error 2
make: *** [posix_sitl_default] Error 2
swapnil@UTARIROS08:~/catkin_ws/src/px4_firmware/Firmware$
could someone help me please ? Thanks a lot. Im using ubuntu 14.04 and i have gazebo 7 installed.

You don't have protobuf installed. Please follow the installation instructions in the first section here: http://dev.px4.io/starting-installing-linux.html#installation


text:
before_query 查到缓存 key 存在，可能会在 after_query 前过期

https://github.com/Pacific73/gorm-cache/blob/1d0b034dd8c711a96fbd9e19568b6d5a0b195cda/cache/after_query.go#L101
缓存有过期时间，如果碰巧在 after_query 前过期，那就会查不到

提两个个人建议哈

before_query 直接查缓存，放到上下文里传下去
before_query 做一下防缓存击穿，缓存过期的时候 db 扛不住的

谢谢你的建议，这些建议均已实现，请使用最新版


text:
Does actc take advantage of pbi to avoid reading the entire subreads.bam?

Hi Armin,
I was wondering doesactc take advantage of pbi to avoid reading the entire subreads.bam if my ccs.bam represents only a subset of zmws?
I was looking through the code and I think it does, but I wanted to be sure.
Thanks!
Mitchell

99.9% sure that it uses the index after some testing but going to wait for the official response to be sure.

It does use the index.

Thanks Armin!

authors: armintoepfer mrvollger

repo: PacificBiosciences/actc


text:
fc

Operating system
Which operating system and version are you using?
Package name
Which package / tool is causing the problem? Which version are you using, use tool --version. Have you updated to the latest version conda update package? Have you updated the complete env by running conda update --all? Have you ensured that your channel priorities are set up according to the bioconda recommendations at https://bioconda.github.io/#set-up-channels?
Conda environment
What is the result of conda list? (Try to paste that between triple backticks.)
Describe the bug
A clear and concise description of what the bug is.
Error message
Paste the error message / stack.
To Reproduce
Steps to reproduce the behavior. Providing a minimal test dataset on which we can reproduce the behavior will generally lead to quicker turnaround time!
Expected behavior
A clear and concise description of what you expected to happen.

¯_(ツ)_/¯

repo: PacificBiosciences/pbbioconda


text:
Support for Docker and Docker Compose

Reading configuration from enviroment instead of config file.
Procfile

Hey !
Thanks for the PR , let me check and get back to you

@ceorcham  Thanks for the PR , but adding your changes makes it a bit difficult for beginners to set it up . But I do like the changes you've made . I'd still like to add your changes , so a better solution is to link your forked repo in the README.md .
Cheers!

authors: PadamSethia ceorcham

repo: PadamSethia/shorty