text:
ARM: Old Exception Return is misinterpreted

The old (ARMv4 - ARMv6) exception return is misinterpreted as Jump in Ghidra.
According to ARM Instruction Set Specification SUBS pc, <Rn>, #<const> is always exception return.
The appearance in normal User or System space code is very unlikely, because the behavior is UNPREDICTABLE.
The side effect of all ALU Operation (AND, EOR, SUB, RSB, ADD, ADC, SBC, RSC, ORR, MOV, BIC, MVN)
with destination register PC is updating the Status Register (CPSR) with the content of the Saved
Status Register(SPSR). Therefor all ALU Operation with destination register PC shall be handled as
return not as Jump. This behavior was remove in ARMv8 64 Bit Code(AArch64) and still present in
ARMv8 32 Bit Code(AArch32) for compatible to older ARM Code.

@ryanmkurtz is this fix still needed, or has it already been made obselete by other changes since?

@ryanmkurtz is this fix still needed, or has it already been made obselete by other changes since?

I'll let @GhidorahRex field that one

This appears to likely still be an issue, but the fix here isn't correct. You've replaced the interworking branch behavior with the exception return behavior.
The manual is clear that although deprecated, both behaviors are valid depending on the instruction variants:
For encoding A1: is the general-purpose destination register, encoded in the "Rd" field. If omitted,
this register is the same as <Rn> . Arm deprecates using the PC as the destination register, but if the
PC is used:
    • For the ADC variant, the instruction is a branch to the address calculated by the operation.
This is an interworking branch, see Pseudocode description of operations on the AArch32
general-purpose registers and the PC on page E1-6817.
    • For the ADCS variant, the instruction performs an exception return, that restores PSTATE
from SPSR_<current_mode>.

So what would likely need to happen is to have the constructors split between the S variants and non-S variants.


text:
SingleSkillSummarySpec.load skill summary with badges sporadically fails

Error:    SingleSkillSummarySpec.load skill summary with badges:1213 Condition not satisfied:

summary.badges[0].badgeId == badge1.badgeId
|       |     |   |       |  |      |
|       |     |   badge2  |  |      badge1
|       |     |           |  [projectId:TestProject1, badgeId:badge1, name:Test Badge 1, enabled:true]
|       |     |           false
|       |     |           1 difference (83% similarity)
|       |     |           badge(2)
|       |     |           badge(1)
|       |     [name:Test Badge 2, badgeId:badge2, skillId:skill1, skillType:GlobalBadge]
|       [[name:Test Badge 2, badgeId:badge2, skillId:skill1, skillType:GlobalBadge], [name:Test Badge 1, badgeId:badge1, skillId:skill1, skillType:Badge]]
[projectId:TestProject1, projectName:Test Project#1, skillId:skill1, skill:Test Skill 1, points:0, totalPoints:10, todaysPoints:0, crossProject:false, type:Skill, copiedFromProjectId:null, copiedFromProjectName:null, pointIncrement:10, pointIncrementInterval:480, maxOccurrencesWithinIncrementInterval:1, description:[skillId:skill1, description:This skill [skill1] belongs to project [TestProject1], href:http://veryhelpfulwebsite-1, achievedOn:null, type:null, selfReporting:null], dependencyInfo:null, achievedOn:null, selfReporting:[approvalId:null, enabled:false, justificationRequired:false, type:null, requestedOn:null, rejectedOn:null, rejectionMsg:null], subjectName:null, subjectId:null, nextSkillId:skill2, prevSkillId:null, totalSkills:3, orderInGroup:1, isLastViewed:null, badges:[[name:Test Badge 2, badgeId:badge2, skillId:skill1, skillType:GlobalBadge], [name:Test Badge 1, badgeId:badge1, skillId:skill1, skillType:Badge]]]

PR: https://github.com/NationalSecurityAgency/skills-service/pull/1775

source: gharchive/issue

repo: NationalSecurityAgency/skills-service

license_type: permissive

license_source: github-api


text:
Fix layout of custom icons

After uploading 6 custom icons not all of them are visible and can be viewed/removed:

One idea for a fix is to lay icons out in a grid within a scrollable container.

:+1:


text:
Some tables do not properly resize

Skills Table does not properly resize when optional fields are added:

Admin Activity table doesn't properly resize:

PR: https://github.com/NationalSecurityAgency/skills-service/pull/2864

:+1:

authors: rmmayo sudo-may


text:
Standardise italics

Added a new custom jinja2 tag for parsing and formatting specimen taxonomy - can be added to other templates as necessary
closes #266

The italics look correct to me. If possible removed the italic formatting on the filed as name. May be worthwhile getting some additional testing by one of the botanists.

source: gharchive/pull-request

authors: alycejenni llivermore

repo: NaturalHistoryMuseum/ckanext-nhm

license: mit

license_source: bigquery


text:
proposal: enable automated builds/tests

pylibdmtx does have a test suite, but it is not run automatically whenever a commit is made to this repo.
Automatic testing would allow us to avoid problems like #27, and would alert us to any breaking changes made to the upstream C library.

My bad; this is already done!

repo: NaturalHistoryMuseum/pylibdmtx


text:
Is it possible to update Clusterize but keep the previous elements visible?

Assuming I have N rows and I use the search method (from the example), would it be possible to somehow set the irrelevant rows as visible but to start from the 1st active row? e.g
[
 { value: 1, active: true, visible: true },
 { value: 2, active: true, visible: true },
 { value: 3, active: true, visible: true },
 { value: 4, active: true, visible: true },
 { value: 5, active: true, visible: true },
 { value: 6, active: true, visible: true },
 { value: 7, active: true, visible: true }
]
search(4)
[
 { value: 1, active: false, visible: true },
 { value: 2, active: false, visible: true },
 { value: 3, active: false, visible: true },
 { value: 4, active: true, visible: true },
 { value: 5, active: true, visible: true },
 { value: 6, active: true, visible: true },
 { value: 7, active: true, visible: true }
]

Basically I would like to create a way to scroll back after searching.
Thanks,
Shaked

I struggled with the same issue on a UL list I wanted to bind a click event on a LI and add class 'active' to it, once scrolling and clusterize renewed the list and going back, the selected LI lost is active state. I found a solution for this, maybe this can help you. Here is my codepen test.
https://codepen.io/PlippiePlop/pen/vegozV
The one issue I did not get around was when selecting the item and going to another page and coming back to the page with the list, getting/scroll back to the  selected event in the large list.

Your codepen test is not there anymore, can you provide what you did?

updated the link...

authors: PlippiePlop Shaked shakunvohra

license: MIT


text:
Insecure defaults

By default the permitted columns are all the columns in the database table.
This is a very bad default. The default should follow Rails examples and be no columns at all, requiring the user to specify columns. If the defaults of this library insecure, the library will be used in an insecure way.
Also, I don't see any mention of permissions checking. What's to stop a user from running User.delete(random_id) or otherwise searching, retrieving, and updating resources that don't belong to the current user?

I'll have to agree. We just need to find a way to keep it simple.
Permitted columns
We can make it have no default permitted columns (https://github.com/Nedomas/databound-rails/blob/master/lib/databound/manager.rb#L58), but I'm not sure how to do it in a elegant way so we could just specify the route and have controller on the fly.

One way is to have a custom controller generator from console.
The other is to have it specified in the routes.rb. But I'm not sure its the right place to be specifying models there.

About the delete
On the create or update part you can specify the DSL, like:
Post.create({ user_id: 'current', title: 'Hey' }).then(...

And handle it on the backend securely (it will error if its not current):
dsl(:user_id, :current) { current_user.id }

But there's no way currently to forbid deleting any record. Maybe a allow_destroy_if method? Something like:
allow_destroy_if do |record|
  record.user_id == current_user.id
end

Got any ideas on these or other approaches?
Thanks for raising it! :heart: :heart: :heart:

Permitted Columns
I would recommend hooking into Rails' own Strong Parameters rather than building your own. http://edgeguides.rubyonrails.org/action_controller_overview.html#strong-parameters
Delete and Update
The normal way to protect against these kind of attacks is to query and filter according to what the user is allowed to see. For example, instead of Project.find(10).destroy you call current_user.projects.find(10).destroy. Then if the current_user is not linked to Project 10, the query blows up with a not-found error, preventing any destroy. If anything you wouldn't be dealing with an allow_destroy type call but a default_query_scope configuration, instead of, say, the #model method you define on the controller.
class ProjectsController < ApplicationController
  include Databound

  def query_scope
    current_user.projects
  end
end

Hope that helps!

About the delete and update.
How could we deal with polymorphic scope?
Where a project might belong to the user or to the client via context_id (and hence the user to the client? I was thinking about moving the scope that is currently implemented in javascript to the backend.
Now it is we secured via strict dsl, but we could totally define extra scope in the backend if we found an elegant solution.

Well that's where this type of solution gets really tricky, because you really can't build a solution for every type of application or requirement. The least intrusive way I can think of is to make sure that if the user redefines the normal CRUD actions in their controller that those are called and not the handlers in Databound. Then users can let the default work when it can, and build custom as they need.

True. I believe there is a clean way not become the second ActiveScaffold.
I've implemented the permit_update_destroy? do |record| method  which allows us to handle both polymorphic and simple relations for now. So the security part is fixed now and is production-ready.
It is released in RubyGems with databound 1.1.0
https://github.com/Nedomas/databound-rails/commit/04e28afaf0d37f32241800425c98e809e1fbb9e9
What we need to do now is to find the way to implement secure defaults in such way that accomplishes both:

by default you should specify the columns
you could easily permit all columns without creating a controller.

An idea I've got right now:

no columns are permitted by default
but you can specify in config/routes.rb:

databound :users, permitted_columns: :table_columns
# or
databound :users, permitted_columns: %i(name)

I think this is borderline thing we can do in the routes.

Fixed, implemented and closed by https://github.com/Nedomas/databound-rails/commit/f1819a77b1c2f1d3421c8c89b6f4431bc82cbb7e
Thank you, Jason :shipit:

authors: Nedomas jasonroelofs

repo: Nedomas/databound


text:
🛑 Becpl Angular UI is down

In 8c04dbb, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 50318dc after 5 minutes.

repo: NehalDamania/becpl-uptime


text:
🛑 Becpl Angular UI is down

In ec8659d, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in e17ee3c after 5 minutes.


text:
🛑 Becpl Angular UI is down

In b565730, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 2feed38 after 24 minutes.


text:
🛑 Becpl Angular UI is down

In ca86d2b, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 0ddc4a9 after 10 minutes.


text:
🛑 Becpl Angular UI is down

In ef77731, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in b977429 after 5 minutes.


text:
🛑 Becpl Angular UI is down

In 8099207, Becpl Angular UI ($BECPL_ANGULAR_URL) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Becpl Angular UI is back up in 14b76fb after 10 minutes.


text:
It appears to be in Go

Please dont listen to Lucas

That will never happen.

That will never happen.

authors: bonisthegreat daniielgak

repo: NeironTeam/ncoin


text:
check all test

Please check all your tests

all of us or is this for a certain people?

all of us or is this for a certain people?

just asking everyone to please make sure the test pass. thanks

repo: NemesisGuy/OnTheGoRentals


text:
UDP issue

Hi Nenkai!
I would like to use data from GT7 in SimHub but also with DBox at the same time. For such cases, SimHub may forward the Data to another Port. But the DBox Software cannot listen to another Port nor Forwarding Data.
As far as I know, both SimHub and DBox are using your code. And each Tool separatly works great.
At this point I want to thank you. Incredible work!
However, I asked DBox to make it possible to listen to another Port. But they dont want to.
The only chance I see is to clone the Data even before it goes to Simhub (where I may change the listening port.
Any ideas how to do so?
Thank you!
Christian

Actually, I don't know about SimHub, but DBox isn't at least.
DBox uses GT7Proxy and isn't quite clear about it.

Hello
I once made a tool to duplicate an incoming udp flow to two/three destinations: https://github.com/vthinsel/Python_UDP_Receiver/blob/master/UDP_proxy.py
Hope it helps

In the meantime, I found a "UDP Relay Plugin" in SimHub.
But it doesn't work as expexted.
However, I search for a way to use DBox and SimHub at the same time with GT7 Data.
And since I do have just a roght understanding about UDP, any help would be apriciated.
Thanks!

authors: Nenkai Rak3tenmann vthinsel

repo: Nenkai/PDTools


text:
🛑 NerdBot is down

In 9aeb6bd, NerdBot (https://nerdbot.xyz/health) was down:

HTTP code: 502
Response time: 66 ms

Resolved: NerdBot is back up in 09b00d6 after 7 minutes.

repo: NerdAutoTradeBot/upptime


text:
MMC is broken on master

Latest code raises the following error. Same code on 12.1 works properly.
Original stack trace for 'main_level/agent/main/online/network_0/behavior/behavior':
  File "C:\Anaconda3\lib\site-packages\rl_coach\graph_managers\graph_manager.py", line 148, in create_graph
    self.level_managers, self.environments = self._create_graph(task_parameters)
  File "C:\Anaconda3\lib\site-packages\rl_coach\graph_managers\basic_rl_graph_manager.py", line 72, in _create_graph
    level_manager = LevelManager(agents=agent, environment=env, name="main_level")
  File "C:\Anaconda3\lib\site-packages\rl_coach\level_manager.py", line 91, in __init__
    self.build(spaces_definition)
  File "C:\Anaconda3\lib\site-packages\rl_coach\level_manager.py", line 165, in build
    [agent.set_environment_parameters(spaces) for agent in self.agents.values()]
  File "C:\Anaconda3\lib\site-packages\rl_coach\level_manager.py", line 165, in <listcomp>
    [agent.set_environment_parameters(spaces) for agent in self.agents.values()]
  File "C:\Anaconda3\lib\site-packages\rl_coach\agents\agent.py", line 335, in set_environment_parameters
    self.init_environment_dependent_modules()
  File "C:\Anaconda3\lib\site-packages\rl_coach\agents\value_optimization_agent.py", line 46, in init_environment_dependent_modules
    super().init_environment_dependent_modules()
  File "C:\Anaconda3\lib\site-packages\rl_coach\agents\agent.py", line 380, in init_environment_dependent_modules
    self.networks = self.create_networks()
  File "C:\Anaconda3\lib\site-packages\rl_coach\agents\agent.py", line 353, in create_networks
    worker_device=self.worker_device)
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\network_wrapper.py", line 86, in __init__
    network_is_trainable=True)
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\general_network.py", line 74, in construct
    return construct_on_device()
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\general_network.py", line 59, in construct_on_device
    return GeneralTensorFlowNetwork(*args, **kwargs)
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\general_network.py", line 126, in __init__
    network_is_local, network_is_trainable)
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\architecture.py", line 105, in __init__
    self.weights = self.get_model()
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\general_network.py", line 262, in get_model
    input_placeholder, embedding = input_embedder()
  File "C:\Anaconda3\lib\site-packages\rl_coach\architectures\tensorflow_components\embedders\embedder.py", line 86, in __call__
    self.input = tf.placeholder("float", shape=[None] + self.input_size, name=self.get_name())
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\ops\array_ops.py", line 2143, in placeholder
    return gen_array_ops.placeholder(dtype=dtype, shape=shape, name=name)
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\ops\gen_array_ops.py", line 7400, in placeholder
    "Placeholder", dtype=dtype, shape=shape, name=name)
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\util\deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 3616, in create_op
    op_def=op_def)
  File "C:\Anaconda3\lib\site-packages\tensorflow\python\framework\ops.py", line 2005, in __init__
    self._traceback = tf_stack.extract_stack()

The Doom_Health_MMC preset is running fine on my setup with the latest code on master, so need some more details:

Command line (or code) you're using to launch the training process
Are you getting the failure immediately when starting to train?
Which Tensorflow version are you using?

I am launching using my own code cause I have a very complex data generation setup
On Heatup
Tensorflow 1.14

It also affects Rainbow and a few others it seems.

Code is pretty straightforward.
Sample:
agent_params = MixedMonteCarloAgentParameters()

agent_params.network_wrappers['main'].replace_mse_with_huber_loss = with_default(training_profile.replace_mse_with_huber_loss, True)

# agent_params.exploration.evaluation_epsilon = with_default(mmc_config.evaluation_epsilon, 0.0)
agent_params.memory.max_size = (MemoryGranularity.Episodes, with_default(training_profile.max_episodes, 200))

for key, embedder in agent_params.network_wrappers['main'].input_embedders_parameters.items():
	embedder.activation_function = 'leaky_relu'
	embedder.batchnorm = with_default(model_profile.batch_normalization, True)

graph_manager = BasicRLGraphManager(
        agent_params=agent_params,
        env_params=env_params,
        vis_params=VisualizationParameters(print_networks_summary=True, tensorboard=False),
        schedule_params=SimpleSchedule(),
    )

# Ensure initialization
params = TaskParameters(experiment_path=agents_dir,
                        checkpoint_save_dir=os.path.join(agents_dir, 'checkpoint'))

graph_manager.create_graph(params)
graph_manager.task_parameters.experiment_path = agents_dir
graph_manager.task_parameters.checkpoint_restore_path = os.path.join(agents_dir, 'checkpoint')

graph_manager.improve_steps.num_steps = num_steps
graph_manager.steps_between_evaluation_periods.num_steps = 500
iterations = int(with_default(training_profile.timesteps, 1000000) / num_steps)

episodes_to_heatup = with_default(training_profile.exploration_heatup, 100)
graph_manager.heatup(EnvironmentSteps(episodes_to_heatup * env.max_steps))

for i in range(0, iterations):
	printout(f'Executing {i+1}/{iterations} iterations')
	graph_manager.improve()
	graph_manager.save_checkpoint()

I suggest you try running the Doom_Health_MMC preset to see if this might be a system configuration problem. This preset is running fine for me with the latest master code and with Tensorflow 1.14.
If it is working fine, then the only change that might be related to this failure is the recent batchnorm fix, so I would check whether your code works before and after this change.

Easy enough. I can confirm that d6795bd5245ba18604ce1b1ffa9fbee9c8ce7778 doesn't work and the commit before does.

Hi @redknightlois,  d6795bd fixed an issue with batchnorm for DDPG. Unfortunately, even with DDPG, we did not see any significant improvements with batchnorm being used.
At the moment, batchnorm is not supported generically enough to be applied for any other algorithm, other than DDPG. We might want to fix that at some later point, but have no short term plans to support batchnorm for other algorithms.

@gal-leibovich Good to know that there is a way to avoid the issue, wanted to try TD3 but master was misbehaving. One thing that striked me as odd when reading the code was that coach applies BatchNorm, the linear + activation and then dropout.
Recent research has been showing that with batch normalization order matters. I don't have the reference fresh though, but there are a few papers about it in the wild. The guys at FastAI which had tried almost everything has been using BatchNorm, Dropout, Linear + Activation instead.
Have you tried https://github.com/fastai/fastai/blob/master/fastai/layers.py#L44 ... I had been having excellent results on that setup on supervised environments.

@gal-leibovich This paper may shed some light into why BatchNorm is not showing improvements and also suggest a different normalization technique that may be of interest. https://arxiv.org/pdf/1902.05605.pdf

authors: gal-leibovich galnov redknightlois

repo: NervanaSystems/coach


text:
some wonderful algorithm

https://github.com/pathak22/noreward-rl
https://pathak22.github.io/noreward-rl/
realAI for Deep Reinforcement Learning
ICM algorithm ? （Curiosity-driven Exploration for Deep Reinforcement Learning - realAI

It is currently not planned, but we are open for contributions

https://github.com/openai/baselines/tree/master/baselines/her

We have an implementation of HER in a private branch, maybe will come with next release.

world models  https://worldmodels.github.io

Thanks for the references. We add new algorithms to Coach from time to time, but the field is growing too fast for us to add all of them. We are open for contributions and encourage you to add new implementations to Coach and submit them as PRs. I am closing this issue for now. Thanks again!

https://github.com/vitchyr/rlkit/blob/master/rlkit/torch/tdm/TDMs.md

https://github.com/createamind/Imagination-Augmented-Agents/blob/master/README.md

https://github.com/createamind/Imagination-Augmented-Agents/blob/master/README.md

authors: itaicaspi-intel zach-nervana zdx3578


text:
LRN layer

To achieve full compatibility  with ONNX we need to implement support for vgg16 and alexnet topologies but these models require currently unsupported LRN layer.
Are there any plans to implement this layer?

We will need to support it for ONNX, but preferably in terms of simpler more general ops.

Done. Thank you @Krovatkin

authors: diyessi postrational tsocha

repo: NervanaSystems/ngraph


text:
New macros for faster node validation checks

The current NODE_VALIDATION_ASSERT machinery is unfortunately kind of a drag on performance, because the use of streams forces us to build error messages even when we are not actually going to throw them. This adds a new macro called NODE_VALIDATION_CHECK, which pushes the explanation strings into the arguments of the macro, allowing them to be evaluated lazily.
This results in a big speedup of node validation for ops which have a lot of checks (like Convolution), and even a measurable improvement on ops that don't (like Add):
Time to construct 1,000,000 nodes
=================================

+------------+-----------------+----------------+
|            |  With old macros| With new macros|
|Op          |       Time (sec)|      Time (sec)|
+------------+-----------------+----------------+
|Add         |             5.2 |            3.4 |
|Convolution |            36.4 |            4.8 |
+------------+-----------------+----------------+

The underlying mechanism could eventually be used to replace NGRAPH_ASSERT as well.

BTW: we can do more ops in a follow-on PR. Wanted to do just the minimum to demonstrate that this was beneficial.

TESTNOW

Strange failure
OutOfMemoryOrKill-9

detect hudson status 137 which indicates an out-of-memory condition has been encountered
Indication 1

Rebuilding python-ci


text:
Ugrade backend question

I have some trident backends for which I would like to introduce new attributes to limit the size of the volumes that are generated. The parameters in question are the following: limitAggregateUsage and limitVolumeSize. Could there be any impact or disruption as far as the pods present?
I guess not, but would like to confirm.
Thanks

Hello, @mmcalcagni.  No, those parameters are applied only when provisioning new volumes.

Closing this issue as answered.

authors: clintonk gnarl mmcalcagni

repo: NetApp/trident


text:
Re-Use Connections When Publishing to the Aggregator

This should reduce the overhead per request.

The "Everything curl" docs on connection reuse:
https://everything.curl.dev/libcurl/connectionreuse

https://curl.se/libcurl/c/threadsafe.html

You must never share the same handle in multiple threads. You can pass the handles around among threads, but you must never use a single handle from more than one thread at any given time.

On the MacOS platform (apple-clang-15), we see two different ASAN errors:
container-overflow (related to Poco admin server, maybe false positive).
stack-use-after-scope (related to thread_local in CurlHandle).
On the Ubuntu Jammy platform:
g++-11 compiler does not report any ASAN errors.
clang-14 compiler reports stack-use-after-scope (related to thread_local in CurlHandle).
clang-14 compiler DOES NOT report a container-overflow error in the AdminServer tests.

repo: Netflix-Skunkworks/spectatord


text:
HTTS task support conductor

Hi Everyone,
Need help to call URL's which are HTTPS , currently getting below ERROR :
Failed to invoke HTTP task due to: java.lang.Exception: I/O error on POST request for "https://localhost:8080/uri": PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target; nested exception is javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
where to configure cert in conductor server

@Akash47 you need to add the public certificate to the trusted certificate store. For example, take a look at this from oracle as the certificate part is Java specific and not conductor specific https://docs.oracle.com/javase%2Ftutorial%2F/security/toolfilex/rstep1.html

repo: Netflix/conductor


text:
OAuth 2.0 Role Based Security - Forked Repository Update

Pull Request type

[x] Feature
[x] Community Contribution

Changes in this PR
Updated link and details of Forked Repo to Read Me.
Details
On the forked repo - Addition of feature to secure the APIs exposed by conductor server, based on a role based access, utilizing Spring Security and OAuth2.0. Adds feature https://github.com/Netflix/conductor/discussions/2189
Alternatives considered
No alternatives available other than securing the Jar hosting container (Docker) or host.

https://github.com/Netflix/conductor/pull/2274


text:
empty OU and date changes on UI

DigiCert will deprecate the Organizational Unit field (simply ignoring the field from the requests). To honor this change and make it transparent to users, Lemur will not render this field as empty in UI and make it optional form input

Considering the limit of 397 days of validity of certs issued by Public Issuers ( #3081 ), the date picker from UI is now changed to show dates only within the allowed range - PUBLIC_CA_MAX_VALIDITY_DAYS (default 397). For any other CA which is not configured as Public, Lemur will allow selecting dates within DEFAULT_MAX_VALIDITY_DAYS.

Coverage increased (+0.02%) to 57.919% when pulling 5b96b3a0320d6e446a952ad97c51bd3ad0addd3e on charhate:pub_issuer into 14b73b73cfce5463a96d0ef1f8aa9846ddf5b4d4 on Netflix:master.

authors: charhate coveralls

repo: Netflix/lemur


text:
feat: Replace secp_utils usage of big.Int with uint256 library.

Resolves #353

@rodrigo-pino  i have a few questions :
should i also modify SecPPacked and SecPSplit function?
Also, GetSecPBig for example now returns a uint256.Int, i guess i should also modify the code where this utils is used (i.e., zerohint_ec.go and zerohint_signature(s).go ) ?

Hey @TAdev0! Yes please add both functions since their values are never bigger than the 256 bits space. Regarding the code that uses them, it must be updated as well since we need the CI to pass in order to merge.
In case the consecuences of using uint64 library are very hard to integrate we can do smth good enough now and follow it up with another PR focused on that

@rodrigo-pino  ready for a first review. Not sure everything is correct with my syntax.

There are some errors. Especially compilations one. Could you please fix them.
Also you can test most of the CI by doing make unit.
This will compile & run all unit tests.

@rodrigo-pino  yeah thank you! i'm installing Go right now, will do that.

@rodrigo-pino I have residual mismatch issues, for example:
   zerohint_utils_test.go:163: value scope value mismatch:
            have: 25711014748331347274616151948719391133326249308066029554892800
            want: 25711014748331348032841661176477624755444844903972403171819520

I double checked that i correctly define constants in GetSecP , getBase and GetSecp256R1_P

I suspect that the issue comes from SecPPacked as it is the common denominator for all failing tests. But i'm struggling debugging efficiently, i checked if it could come from DivMod which behaves differently with BigInt and uint256, but it seems ok.

I see that's weird, maybe something to do with references? My tip for debugging would be testing the failing functions one by one with some prints scattered around. You'll eventually find the wrong piece of code

@rodrigo-pino  comments addressed. I still need to figure out this issue.

Ok left some other small ones, regarding the issue, I'll try to look it later. Can you debug it manually with prints?

@rodrigo-pino  ok so basically, i fail for all EcNegate tests (and others, but i think the root cause is the same). These tests call newEcNegateHint , which will use GetSecPUint256 and SecPPacked among other stuff i didnt change.
GetSecPUint256 returns a const which should be fine.
I tried printing different variables and indeed, the result value of newEcNegateHint, which is yBig , is always a little bit different, with generally 8 identical bytes and the rest different.
yBig is the NEG + MOD result of SecPPacked , and SecPPacked seems ok as well, using getBaseUint256 .
I even tried keeping BigInt for SecPPacked computation, without any modification, and i still have these errors.

I did a super quick check. In SecPPacked before returning the packedBig variable I tried converting it to a uint256 and then back to a big.Int and tests failed.
Before:
return *packedBig, nil

After:
packedUint256 := new(uint256.Int)
packedUint256.SetFromBig(packedBig)

return *packedUint256.ToBig(), nil

The failing tests seem to be using quite large values though. Could it be the test values are just unrealistic? Though I would say the results should match the python vm regardless.

By looking at the python VM code you immediately realize that input values are always less than 256 bits, and output values are always smaller as well. This means that assuming the current implementation is correct, the one with big.Ints was flawed. It is possible the tests are actually not returning a correct value by using wrong inputs.
The python and the go vm should always return the same value, but if the python vm expect always it's input to be in the 256 bits range, whatever we throw at it bigger than it is not valid for comparison. We are loooking to match the python vm in the 256 bit range not on bigger stuff, assuming of course, that to the python VM you could feed bigger stuff, to which there is not test to show it.

If there is a test that inputs a number bigger than 256 bits or returns as an output a number bigger than 256 bits, that test is not correct.

If there is a test that inputs a number bigger than 256 bits or returns as an output a number bigger than 256 bits, that test is not correct.

The inputs are not larger than 256 bits in the tests. The outputs can be. The output can be a scope value and not a memory value.

In the case of secp packed the result should be a 256 bit number though.

If there is a test that inputs a number bigger than 256 bits or returns as an output a number bigger than 256 bits, that test is not correct.

The inputs are not larger than 256 bits in the tests. The outputs can be. The output can be a scope value and not a memory value.

If it works like this, then it is also problematic in terms of replacing scope any interface with the new struct, if the values are bigger then 256 bits, but that is not relevant in this scope.

The weird thing is that my impl with uint256 is supposed to be the same. I guess there is some issue related to bigint to uint256 conversion  if all inputs are indeed < 256bits

The inputs are not larger than 256 bits in the tests. The outputs can be. The output can be a scope value and not a memory value.

How can they be? The only way to get a higher than 256 bits is in packed right? Looking at the Cairo VM description it is stated that the number that needs to be formed needs to be in that range.

... The output can be a scope value and not a memory value.

I am not convinced either that a scope value can be bigger than 256 bits. Obviously the python VM allows it (python allows many things by itself). The question is, is there any Cairo 0 code that could be written that could create a number bigger than 256 bits in the scope.
Also, remember that the Scope was defined by us as well, so using it as an argument of what it can have inside or not is not valid since we can always redefine it.

The weird thing is that my impl with uint256 is supposed to be the same. I guess there is some issue related to bigint to uint256 conversion for the output if all inputs are indeed < 256bits ...

I think you've solved it correctly and we are finding some inconsistencies unrelated with them. After this PR the VM will be better

The inputs are not larger than 256 bits in the tests. The outputs can be. The output can be a scope value and not a memory value.

How can they be? The only way to get a higher than 256 bits is in packed right? Looking at the Cairo VM description it is stated that the number that needs to be formed needs to be in that range.
That Python doesn't have statically typed values doesn't mean we have to follow through if it doesn't make sense. I haven't studied this part long enough, but it feels to me that both pack and split are meant to use in tandem. So I don't see why the inputs forpack should be bigger than 256 bits

No input in the tests are larger than 256 bits.
It's possible that the 3 values passed to pack is resulting in a value greater than 256 bits in the tests. I haven't checked this.
I'm guessing the programmer must assert the input ranges of the arguments to pack in the cairo code. If they don't then the python vm and our vm will result in differing results written to the scope. I don't know if any programmer will have a valid reason for doing something like this.

@har777  indeed if i replace SecPPacked with the previous version using bigInt, tests for ec pass. I confirm that the value after exponentiation and packing in SecPPacked will be greater than type(uint256).max . But i still have 2 tests failing  in this configuration:
--- FAIL: TestZeroHintEc (0.00s)
    --- FAIL: TestZeroHintEc/NondetBigint3V1_3 (0.00s)
        zerohint_utils_test.go:195: expected an error containing "num != 0", got nil err
--- FAIL: TestVerifyZeroHint (0.00s)
    --- FAIL: TestVerifyZeroHint/VerifyZero_1 (0.00s)
        zerohint_utils_test.go:197:
                Error Trace:    /Users/tristan/Desktop/Dev/cairo-vm-go/pkg/hintrunner/zero/zerohint_utils_test.go:197
                                                        /Users/tristan/Desktop/Dev/cairo-vm-go/pkg/hintrunner/zero/zerohint_test.go:255
                                                        /Users/tristan/Desktop/Dev/cairo-vm-go/pkg/hintrunner/zero/zerohint_test.go:267
                Error:          Error "verify_zero: Invalid input (1, 1, 1)" does not contain "verify_zero: Invalid input (1, 1, 1)."
                Test:           TestVerifyZeroHint/VerifyZero_1
                ```

I dont think so. I tried changing just that part:
num2 := new(uint256.Int)
num2.SetFromBig(num)
if num2.Cmp(uint256.NewInt(0)) != 0 {
  return nil, fmt.Errorf("num != 0")
}

And it passed.

I also tried for DivMod it passes as well

@har777 you want to remove all tests? what is the reason for the 2 others failing?

@har777 you want to remove all failing tests? what is the reason for the 2 others failing? I cannot find any reason for now.

Just this one:
    --- FAIL: TestZeroHintEc/NondetBigint3V1_3 (0.00s)
        zerohint_utils_test.go:195: expected an error containing "num != 0", got nil err

mmh i dont understand. If i remove this test, i still have many tests failing.

@rodrigo-pino  @har777  I annotated all failing tests so that tests pass for the CI.
For now, I use uint256 for everything in ec utils.
It includes :

a bunch of EcNegate
one FastEcAddAssignNewX test
one VerifyECDSASignature test
one GetPointFromX test
one VerifyZero test

@rodrigo-pino  comments addressed. I left the type where it makes sense to leave it, and remove in all other places

@rodrigo-pino  had a few conflicts, i have other tests failing now. It is getting a bit difficult to understand whats going on, maybe should we close this and do it once all hints are implemented? Or maybe merging this soon, because there will be additionnal conflicts after PR are merged

Hey @TAdev0 the solution is good, let's put it on hold until we can asses with clarity the uint256 vs BigInt situation

sure

I'm adding the blocked label here, so we know we won't be working on this rn

We want to wait until the hints are all merged, this means there are going to be a lot of conflicts to fix and a lot more of code to modify. I'm closing this PR for the moment, we can open a new one with fresh changes

repo: NethermindEth/cairo-vm-go


text:
Make the node_config block conditional

Rather than always having a node_config block on the cluster, make it conditional on
var.confidential_nodes_enabled (as it is only used for those).
Without this change:

changing var.machine_type causes terraform to delete and recreate
the whole cluster.
The cluster is marked as 'changed' every time terraform plan is
run, even if nothing has changed.

Also, this means it won't spin up the standard nodes on first deploy.

Hi!  Thanks for your PR!  At a glance it makes sense, but I'm on vacation right now, I'll take a closer look when I'm back.
Cheers,
GY

authors: Neutrollized whi-tw

repo: Neutrollized/free-tier-gke


text:
Responsive?

Anyone know how to make this responsive using Bootstrap? Changing sizes in media settings doesn't work.

I got this to work by creating several maps and hiding/showing in css. Not the most elegant and when I do this the labels are offset unless screen is refreshed.

I figured out something similar.. I resize the map on page load and also on window resize. It works pretty well. I created a function called resizeMap that sets variables for the width of the #map div and the svg to the window of a surround container (the surrounding container has a 'content' class. Then i call that function after calling the map and call it again on window.resize.
$(document).ready(function() {
function resizeMap() {
var mapWidth = $('.content').css('width');
var svgWidth = $('.content').width();
var mapHeight = svgWidth *.5;
('#map').css('width' , mapWidth).css('height' , mapHeight +'px');
$('#map svg').attr('width' , svgWidth).attr('height' , mapHeight);
};
   $('#map').usmap({});
   resizeMap();

   $(window).resize(function() {
   resizeMap();
  });

});

@Chay08 Is there any negative affect in regards to slowing down the page load time using the js above?

I haven't noticed any issues. I wouldn't expect it to since it's not re-initalizing or anything, it's just resizing a div and an svg.

I am using bootstrap and am displaying different maps in different screen sizes by creating two maps and hiding the one that is incorrect for the screen size. I am also displaying labels. The problem I ran into is that the "hidden" map would always have the y coordinate incorrect (x is fine) for the label unless the screen was reloaded at that size. I fixed this by cutting the y coordinate in half for the map that wasn't displayed at the time. Not sure why this works but it does. Would like to know the reason so I can come up with a better solution.

I'm having a weird problem with the labels, too. Using the solution I posted, I also hid the map on xs screens, because I need the states to be clickable and they are too tiny on phones. But when first loading (with map hidden) on xs screens, and then resizing to make the window wider (thereby showing the map), the label spacing is all messed up. The issue goes away when the map is visible on xs screens. I'll let you know if I find a solution.

Chay08. I did the same thing. I created a text div for phones, a smaller map for small screens and a larger map for bigger screens. For the ones that are hidden only I cut the y coordinate in half. That worked for me.

Silverforce, that does work! Thanks!

Yes it does but I just wish I knew why it works. And why is the x coordinate not affected?

Im using a simpler solution
css:
#us-map svg {     width: 100%;     height: 100%; }
js:
$('#us-map').css('width' , '100%').css('height' , 'auto')
as long as I set the width and height after the page has loaded the map is responsive.
I'm just using the basic map so I can't say if this works w/ labels or other extras.

authors: Chay08 daveerwin eweisbrot silverforce

repo: NewSignature/us-map


text:
MCS-217 Return Structural Object Metadata

Structural objects like walls are now assigned the SimObjPhysics script, so we can use the AI2-THOR code to determine if structural objects are visible (we mark them as kinematic so physics and gravity doesn't affect them).
Dynamically assign visibility points to walls, so bigger walls automatically have more visibility points.
Dynamically adjust the size of room walls so the output metadata makes more sense.
Adjusted properties of room walls in MCS scene, adding the SimObjPhysics script and other required components.
Return structural object metadata to the Python API.

Nothing jumped out at me.

@rartiss55 Yeah, and thanks for reminding me that I need to add a ticket to fix that.  I had wanted to avoid applying the SimObjPhysics script to them at all, but I couldn't without rewriting a bunch of code (like the method to determine whether each object is currently visible in the camera).  When I had tried simply changing their tags, I got some really weird behavior, so I think it will require some investigation.


text:
MCS-1777 Pipeline Improvements and Bug Fixes for Eval 7

Upgraded our ray version (thanks Phi!)
Changed p2.xlarge to p3.2xlarge
Added a controller timeout
Added an if statement to check for null case that was causing an error
Ensure the ray autoscaler will delete idle workers by deleting all references to finished ray objects.

This PR is ready for review and will be useful for validation and evaluation runs.

This PR is ready for review and will be useful for validation and evaluation runs.

Nice, I'll use this for CORA's run moving forward.

repo: NextCenturyCorporation/mcs-pipeline


text:
03-incremental-static-regeneration.mdx

@HeeyeonJeong

@ChanghyeonYoon 작업 시작했습니다.

authors: ChanghyeonYoon HeeyeonJeong


text:
Sub-domain redirection for Streams

Is your feature request related to a problem? Please describe:

Yes, I would like to be able to reach different game servers within my network from different sub-domains
Describe the solution you'd like:

If I specify a proxy host, I have the option to specify an input subdomain and an internal IP address as the destination, so far so good.
The other day I found out while browsing in the Web Interface that I can also specify a UDP port in the streams in addition to the TCP port, unfortunately I cannot specify an input subdomain as with the streams in order to be able to specify which traffic is forwarded from which address to which internal address.
As an example, it is not possible for me to access the server with the internal IP 192.168.178.2 (port 25665) via the domain vanilla.domain.de, and the internal IP 192.168.178.4 (port 25565) via the address dev.domain.de
Describe alternatives you've considered:

So far I haven't found any alternatives yet
Additional context:

This is what it could look like, if it can be implemented

Aren't streams just a TCP or UDP connection that nginx proxies onwards? so are just IP to IP, there is no way to distinguish between multiple subdomains that all use the same IP, the actual traffic which doesn't have to be http may not even contain the subdomain it was destined for only source and destination IPs. Or am I misunderstanding a tech I've not used.
I think the only way you can do this is have one use vanilla.domain.de:25565 -> 192.168.178.2:25565 and the other to use dev.domain.de:25566 -> 192.168.178.4:25565 (note the different port). Since these are just minecraft servers, the client does take a different port in the connection string.

I had thought that this information could be taken up when establishing a connection to make the forwarding.
After the days I had dealt with it again intensively, I think the only solution to this problem (without the users having to change the port) is an SRV record in the domain.
I don't know if that's possible because this information is not transmitted.
I wanted to avoid having to change the ports as much as possible because it leads to complications at some points
However, if there is no other option, and only http transmits this information when establishing the connection, I probably have to go the way with the ports.
However, now that I am writing this message I remember that the load balancer of Kemp supports this feature at least as far as I have noticed.

I think for minecraft the easiest solution for this is the addition of an SRV record with the non-standard port and its subdomain then a non-standard port will not be seen by the player, only the admin and the minecraft client (after the DNS lookup) will know its a non-standard port.
I've worked with load balancing/proxying that makes decisions on things other than the HTTP Host header, Apache and mod_security for example, but those are very complex tools which don't really live in a tool to simplify SSL certs and HTTP Proxying, there is always a battle to keep simple tools simple.

repo: NginxProxyManager/nginx-proxy-manager


text:
fix: distribution module account name

Description
Uses the correct distribution module account name.
Purpose
Trying to send funds to a non-existent module account causes a panic and a consensus failure.

lol

authors: NibiruHeisenberg Unique-Divine

repo: NibiruChain/nibiru


text:
Color picker is inaccurate when placing in HEX values

I was pasting in HEX values and was quite surprised at what they showed.
The color on the left is what it's supposed to show, the color on the right is what it actually shows.
The problem has something to do with it mixing around the numbers (it has the 61, 187, 210 correct, just in wrong order - and one of them was applied to alpha as well)

Try pasting #FF3DBBD2 instead.
I'll fix this by checking the length of the code.
Thanks.

Fixed. Now it will work like this:
If you paste #11 or just 11: It will apply 0xFF to the alpha value and 0x11 to RGB.
If you paste #F411 or just F411: It will apply 0xF4 to the alpha value and 0x11 to RGB.
If you paste #F41122 or just F41122: It will apply 0xFF to the alpha value and 0xF4 + 0x11 + 0x22 to RGB.
If you paste #FFF41122 or just FFF41122: It will work as usual.

authors: NickeManarin WELZ-gh

repo: NickeManarin/ScreenToGif

license: MS-PL


text:
protocolbuffers.inc.php error

Something stop work, or i did smth wrong? yesterday was working ok.
Fatal error:  Uncaught exception 'Exception' with message 'skip((1) 64-bit): Error seeking' in PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/protocolbuffers.inc.php:844
Stack trace:
#0 PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/POGOProtos/Data/PlayerData.php(163): Protobuf::skip_field(Resource id #58, 0)
#1 PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/protocolbuffers.inc.php(84): POGOProtos\Data\PlayerData->read(Resource id #58, 6)
#2 PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/POGOProtos/Data/PlayerData.php(31): ProtobufMessage->__construct(Resource id #58, 6)
#3 PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/POGOProtos/Networking/Responses/GetPlayerResponse.php(49): POGOProtos\Data\PlayerData->__construct(Resource id #58, 6)
#4 PokemonGoAPI-PHP/src/Requests/GetPlayerRequest.php(54): POGOProtos\Networking\Responses\GetPlayerResponse->read('\x08\x01\x12Y\x08\ in PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/protocolbuffers.inc.php on line 844

Same thing happened to me.
I guess it's because of Niantic banning most of cloud ISPs.
If you run this locally it should work, right ?

Nope. After some digging it looks like PlayerResponse packet got additional field.

Any idea how to fix this ?

PokemonGoAPI-PHP/vendor/nicklasw/pogoprotos-php/src/POGOProtos/Data/PlayerData.php
after case 14 add another one:
          case 15:
            if($wire !== 0) {
              throw new \Exception("Incorrect wire format for field $field, expected: 0 got: $wire");
            }
            $tmp = Protobuf::read_signed_varint($fp, $limit);
            if ($tmp === false) throw new \Exception('Protobuf::read_varint returned false');
            if ($tmp < Protobuf::MIN_INT32 || $tmp > Protobuf::MAX_INT32) throw new \Exception('int32 out of range');
              // echo $tmp;
            break;

@Gandaflux You're awesome. Thanks for the quick reply. It worked :)

I have updated the pogoprotos-php repo. Thanks for the help @Gandaflux

authors: Gandaflux NicklasWallgren lambasoft

repo: NicklasWallgren/PokemonGoAPI-PHP


text:
Fixed typo in README.rst

added missing parentheses.

Coverage remained the same at 97.647% when pulling 39fb750a30b368b316ffec3e7b72f5c16d381e07 on CosmosAtlas:master into a29ad18490b551b96c22a84a82e97deaf77c2cb7 on NicolasLM:master.

Thank you!

authors: CosmosAtlas NicolasLM coveralls

repo: NicolasLM/bplustree


text:
Auto-Open to the default Plugin Directory

Using the Prototype Converter it will pre-fill the Plugin Directory with a useful starting point:

However, if I click on the ... button, it shows me:

Ideally, it should open to the same directory as what's been proposed (if it exists), and if not, it should open to the plugins directory.

I can give the c4d.storage.LoadDialog() function a default path, but it does not seem like it actually uses that path. Not sure if that is a bug in the Python API or just how these file/directory opening dialogs work.
Same goes for #21

authors: NiklasRosenstein donovankeith


text:
Thesis link broken

The link (https://wr.informatik.uni-hamburg.de/_media/research:theses:felix_wiedemann_modern_storage_stack_with_key_value_store_interface_and_snapshots_based_on_copy_on_write_bε_trees.pdf) shows not found

@michaelkuhn Please have look :)
Link is broken here as well: https://wr.informatik.uni-hamburg.de/research/theses#section2018

That's what you get for using Unicode in your title. :wink:
The link should work now. (By the way: README.md still contains an outdated link.)

ping @Nilix007, please update the Readme and close this issue


text:
[BUG] Error near signup

Description
Instead of showing dont have account it is displayed as  "Already have an Account?"
Screenshots
No response
Any additional information?
No response
What browser are you seeing the problem on?
No response

hello @Nishitbaria,can you please assign this task to me and I am a Gssoc24 contributor

hello @Nishitbaria,can you please assign this task to me and I am a Gssoc24 contributor

Show me Video of that bug

repo: Nishitbaria/OpenGrame


text:
add agenix

agenix is a popular secrets management tool for NixOS.
https://github.com/ryantm/agenix

$ nix run nixos-search -- --json flake github:ryantm/agenix
Using saved setting for 'extra-substituters = https://nixos-search.cachix.org' from ~/.local/share/nix/trusted-settings.json.
Using saved setting for 'extra-trusted-public-keys = nixos-search.cachix.org-1:1HV3YF8az4fywnH+pAd+CXFEdpTXtv9WpoivPi+H70o=' from ~/.local/share/nix/trusted-settings.json.
[2023-04-27T08:17:43Z ERROR command_run] command 'nix eval --json --no-allow-import-from-derivation --no-write-lock-file -f '/nix/store/98f5014z23jnh0cg3j5gg52ipljsv0p8-flake-info/assets/commands/flake_info.nix' -I nixpkgs=channel:nixpkgs-unstable --override-flake input-flake github:ryantm/agenix --argstr flake github:ryantm/agenix all' failed: exit status: 1
    stdout:

    stderr:
    error: attribute 'pkgs' missing

           at /nix/store/6k86n3h3s0prrhbc84s800qrp5zwhqbi-source/lib/modules.nix:507:28:

              506|         builtins.addErrorContext (context name)
              507|           (args.${name} or config._module.args.${name})
                 |                            ^
              508|       ) (lib.functionArgs f);
    (use '--show-trace' to show detailed location information)

Error: Getting flake info caused an error: Failed to gather information about github:ryantm/agenix

Caused by:
    command 'nix eval --json --no-allow-import-from-derivation --no-write-lock-file -f '/nix/store/98f5014z23jnh0cg3j5gg52ipljsv0p8-flake-info/assets/commands/flake_info.nix' -I nixpkgs=channel:nixpkgs-unstable --override-flake input-flake github:ryantm/agenix --argstr flake github:ryantm/agenix all' failed: exit status: 1

This error is caused by using pkgs in an option default, which isn't available. Use defaultText and literalExpression to provide a textual representation of the default value.

authors: ncfavier ryantm

repo: NixOS/nixos-search


text:
CVE-2013-4549.patch not found when nix-env -u '*'

Steps taken:

execute sudo -i nixos-rebuild switch --upgrade
execute nix-env -u '*' which fails with this error:

...
building path(s) `/nix/store/y8mha2fs7mqyzj8dmk224qyzkjx5pwgi-CVE-2013-4549.patch'
  0  230M    0 1376k    0     0   201k      0  0:19:33  0:00:06  0:19:27  272k
trying https://projects.archlinux.org/svntogit/packages.git/plain/trunk/CVE-2013-4549.patch?h=packages/qt4
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:--  0:00:01 --:--:--     0
curl: (22) The requested URL returned error: 404 Not found
error: cannot download CVE-2013-4549.patch from any mirror
builder for `/nix/store/skq0lalsgza3sb91pip94limybzbw4wb-CVE-2013-4549.patch.drv' failed with exit code 1

All done here.

authors: domenkozar sjmackenzie

repo: NixOS/nixos


text:
DMD Marked Broken

@SuperSandro2000 @ThomasMader @lionello
DMD, on Master and Unstable, is marked as broken (88513c0) because hydra was failing to build it.  What is causing this issue? I just successfully built is on my rig.
The commit to update DMD to 2.095.1 (7e05c58) was done since it was marked as broken but not remove it.

Might this be due to DMD requiring some CPU features? See lib/systems/architectures.nix.

Can't reproduce. Builds locally fine.

authors: JonathanILevi SuperSandro2000 dotlambda

repo: NixOS/nixpkgs


text:
julia_15: failures in the official test suite

Describe the bug
The julia_15 derivation does not pass the official julia test suite, including a number of BLAS errors where numerical results are incorrect.
This bug report is a followup to https://github.com/NixOS/nixpkgs/pull/117881 and in particular https://github.com/NixOS/nixpkgs/pull/117881#issuecomment-828835929.
To Reproduce
This bug seems to only manifest on certain hardware configurations. All of the results I'm presenting were run on an AWS c5.2xlarge instance running NixOS 20.09.3301.42809feaa9f (Nightingale).
Steps to reproduce the behavior:

nix-build -A julia_15 in the nixpkgs repository.
result/bin/julia --check-bounds=yes --startup-file=no --depwarn=error `result/bin/julia -e 'println(joinpath(Sys.BINDIR, Base.DATAROOTDIR, "julia/test/runtests.jl"))'`
Observe test failures.

Expected behavior
The test suite to pass.
Screenshots
n/a
Additional context
We know that the patched official binaries from julia upstream do not have the same test failures, so this appears to be an issue with nixpkgs version of blas or that the julia-custom BLAS patches are relevant and that we should be using their vendored blas in the build process.
As I proposed in https://github.com/NixOS/nixpkgs/pull/117881#issuecomment-828835929, I think we should add the test suite to run in the julia_15 derivation and then either mark it as broken or find a fix. Of course we can mark as broken and then always find a fix later and update it.
Notify maintainers

@raskin @rob @garrison
other interested parties: @ninjin @7c6f434c
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
❯ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 5.4.100, NixOS, 20.09.3301.42809feaa9f (Nightingale)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.10`
 - channels(root): `"nixos-20.09.3301.42809feaa9f, nix-ld"`
 - channels(skainswo): `"home-manager-20.09, nixpkgs-unstable-21.05pre282548.4c87cb87a2d"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Maintainer information:
# a list of nixpkgs attributes affected by the problem
attribute: julia_15
# a list of nixos modules affected by the problem
module:

See also https://github.com/NixOS/nixpkgs/pull/118000 for a sense of what these errors look like.

After poking around at this for a few hours I am truly stumped. I began with the assumption that blas was to blame. So I proceeded by letting julia vendor in its own version of BLAS, and dropping the dependency on the nixpkgs blas. That didn't work, so I proceeded to one-by-one vendor in each dependency that has anything to do with numerics: blas, lapack, openlibm, mpfr, fftw, fftwSinglePrec, openspecfun. That leaves only libunwind, readline, utf8proc, zlib, curl, libgit2, and pcre2 as non-vendored dependencies. And yet still it fails the tests... Here's what I ended up with for anyone who's curious: https://gist.github.com/samuela/b50a0515fd70934f137518f7fc5e608f.
So I think we just mark julia_15 as broken and move on with our lives. @ninjin has a sick 1.6 derivation that does pass all the tests anyhow so people ought to just use that instead.
If anyone has any other ideas, do let me know! I'd be really curious to get to the bottom of this.

On Wed 28 Apr 2021, Samuel Ainsworth wrote:

After poking around at this for a few hours I am truly stumped. I began with the assumption that blas was to blame. So I proceeded by letting julia vendor in its own version of BLAS, and dropping the dependency on the nixpkgs blas. That didn't work, so I proceeded to one-by-one vendor in each dependency that has anything to do with numerics: blas, lapack, openlibm, mpfr, fftw, fftwSinglePrec, openspecfun. That leaves only libunwind, readline, utf8proc, zlib, curl, libgit2, and pcre2 as non-vendored dependencies. And yet still it fails the tests... Here's what I ended up with for anyone who's curious: https://gist.github.com/samuela/b50a0515fd70934f137518f7fc5e608f.
So I think we just mark julia_15 as broken and move on with our lives. @ninjin has a sick 1.6 derivation that does pass all the tests anyhow so people ought to just use that instead.
If anyone has any other ideas, do let me know! I'd be really curious to get to the bottom of this.

Odd, not seeing anything obvious apart from encouraging you to use doCheckInstall rather than doCheck as the former usually gets rid of a few spurious failures. If you do have a log I could have a look, although just like you I am inclined to think that we are better off leaving julia_15 marked as broken and moving to correct the state of things with a “clean” julia_16 expression.
If you are truly dedicated to get to the bottom of this, you could hypothetically grab my Julia fork 1 and apply my BinaryBuilder patch on master to release-1.5 to see if you can build the whole thing from source. Just beware that if you run make testall you are likely to get at least some failures for Sockets and friends depending on your network setup, but I guess we are mainly interested in the linear algebra portions anyway.

authors: ninjin samuela


text:
Vulnerability roundup 104: wolfssl-4.7.0: 1 advisory [9.8]

search, files

[ ] CVE-2021-37155 CVSSv3=9.8 (nixos-21.05, nixos-unstable)

CVE details
CVE-2021-37155
wolfSSL 4.6.x through 4.7.x before 4.8.0 does not produce a failure outcome when the serial number in an OCSP request differs from the serial number in the OCSP response.

Scanned versions: nixos-21.05: 2262d7863a6; nixos-unstable: 1905f5f2e55.
Cc @mcmtroffaes

It looks like we're already on wolfssl 4.8.1, so I don't think there's anything to worry about?

Apologies for my slow response here. I've reviewed the relevant PR, I hope that helps.
I will likely stand down as maintainer of the package as I'm not managing to stay on top of this in a timely manner...

@mcmtroffaes Standing down as maintainer is of course your decision. But in my opinion getting stuff fixed in 10 days' time is completely OK. Most of us are doing this kind of stuff in our spare time, including myself.

authors: ckauhaus mcmtroffaes samuela


text:
Enable parallel builds by default (at least enableParallelBuilding = true)

I keep stumbling on packages that use sequential build for seemingly no reason:

coreutils: https://github.com/NixOS/nixpkgs/pull/142026
rtorrent: https://github.com/NixOS/nixpkgs/pull/142318
gawk

On big parallel machines you can interactively notice which ones do not enable parallel builds and take more than a few seconds to build (especially during bootstrap).
Let's enable parallel builds by default and disable parallelism of select packages that break.
Many build systems already enable parallel builds. To name a few:

dotent
ocaml
go
haskell

About 1300 packages set enableParallelBuilding = true;.
PoC implementation for stdenv + make packages:
--- a/pkgs/stdenv/generic/make-derivation.nix
+++ b/pkgs/stdenv/generic/make-derivation.nix
@@ -60,6 +60,8 @@ in
     (stdenv.hostPlatform != stdenv.buildPlatform)
     [ "build" "host" ]

+, enableParallelBuilding ? true
+
 # TODO(@Ericson2314): Make unconditional / resolve #33599
 # Check phase
 , doCheck ? config.doCheckByDefault or false
@@ -310,7 +312,8 @@ else let
           llvm-config = 'llvm-config-native'
         '';
       in [ "--cross-file=${crossFile}" ] ++ mesonFlags;
-    } // lib.optionalAttrs (attrs.enableParallelBuilding or false) {
+    } // lib.optionalAttrs enableParallelBuilding {
+      inherit enableParallelBuilding;
       enableParallelChecking = attrs.enableParallelChecking or true;
     } // lib.optionalAttrs (hardeningDisable != [] || hardeningEnable != [] || stdenv.hostPlatform.isMusl) {
       NIX_HARDENING_ENABLE = enabledHardeningOptions;

Example run of this PoC on set of packages from my NixOS desktop reveals at least ~20 failures (of 2100 packages), ~1% of failures. For all of nixpkgs if we extrapolate to 40000 packages that should be about 400 failures (very rough estimate). Does not sound too bad, but needs a hydra run to get most of them before the default flip.
Some examples (to be fixed / worked around).

cramfsswap: https://github.com/NixOS/nixpkgs/pull/142478
discount: https://github.com/NixOS/nixpkgs/pull/142491
cdparanoiaIII: https://github.com/NixOS/nixpkgs/pull/142554
libomxil-bellagio: https://github.com/NixOS/nixpkgs/pull/142386
adns: https://github.com/NixOS/nixpkgs/pull/142549
portaudio: https://github.com/NixOS/nixpkgs/pull/142385
vde2: https://github.com/NixOS/nixpkgs/pull/142384
ocaml: https://github.com/NixOS/nixpkgs/pull/142723
gnome2.ORBit2: https://github.com/NixOS/nixpkgs/pull/142605
perlPackages.X11XCB: https://github.com/NixOS/nixpkgs/pull/142642
dmraid: https://github.com/NixOS/nixpkgs/pull/142381
directfb: https://github.com/NixOS/nixpkgs/pull/142646
pth: https://github.com/NixOS/nixpkgs/pull/142558
openjdk: https://github.com/NixOS/nixpkgs/pull/142745
libb64: https://github.com/NixOS/nixpkgs/pull/142770
m17n_lib: https://github.com/NixOS/nixpkgs/pull/142777
xalanc: https://github.com/NixOS/nixpkgs/pull/142780
ion3: https://github.com/NixOS/nixpkgs/pull/142834
espeak-ng: https://github.com/NixOS/nixpkgs/pull/142900
dhcp: https://github.com/NixOS/nixpkgs/pull/143225
judy: https://github.com/NixOS/nixpkgs/pull/143233
clisp: https://github.com/NixOS/nixpkgs/pull/144980
cloog: https://github.com/NixOS/nixpkgs/pull/144989
xfce.garcon: fails occasionally regardless of build parallelism: https://github.com/NixOS/nixpkgs/pull/144998
jade: https://github.com/NixOS/nixpkgs/pull/151927
gengetopt: https://github.com/NixOS/nixpkgs/pull/146596
most: https://github.com/NixOS/nixpkgs/pull/144382
dev86: https://github.com/NixOS/nixpkgs/pull/145797
afterstep: https://github.com/NixOS/nixpkgs/pull/148748
gsl_1: https://github.com/NixOS/nixpkgs/pull/147591
screen: https://github.com/NixOS/nixpkgs/pull/147990
re2: https://github.com/NixOS/nixpkgs/pull/147991
dozenal: https://github.com/NixOS/nixpkgs/pull/148110
cdk: https://github.com/NixOS/nixpkgs/pull/150227
[ ] muparser: https://github.com/NixOS/nixpkgs/pull/150912
[ ] alliance:
[ ] ats2:
[ ] cdesktopenv:
[ ] deadpixi-sam:
[ ] gnat6:
[ ] heimdal:
[ ] hylafaxplus:
[ ] ipvsadm:
[ ] ocamlPackages.camlidl:
[ ] lazarus-qt:
[ ] libappindicator-gtk3:
[ ] libappindicator-gtk2:
[ ] libf2c:
[ ] mlkit:
[ ] mlton20130715:
[ ] mltonHEAD:
[ ] munin:
[ ] netboot:
[ ] ocamlPackages.camlidl:
[ ] ocamlPackages_4_03.camlp4:
[ ] ocaml-ng.ocamlPackages_4_12.stdcompat:
[ ] perlPackages.CacheMemcachedFast:
[ ] perlPackages.Razor2ClientAgent:
[ ] patchutils:
[ ] procdump:
[ ] reaverwps:
[ ] tomboy:
[ ] uae:

might be worth checking out the comments of packages that disable it
rg -SpL -C 1 'enableParallelBuilding = false;' | less -RF

I would hazard a guess that most of the parallel fails are from raw makefiles. Usually autoconf generates sound dependency graphs but hand-written make rules can be dicey. Does that line up with the results from your PoC sample?

I started with reaverwps, I tried tomboy as well but it is broken... I think I should make a PR removing tomboy entirely as upstream development halted more than 3 years ago
@trofi I'll try to help getting this list done, I have a machine with 8 cores and one with 32

That's perfect. Thank you!

I think one of the problems behind this is finding a way to correctly capture knowledge about the package. Something like a trinary here would be very useful:
parallelBuilds = unknown | known-bad | known-good;

This records a fact about the software being built, and is less about the policy of how to build it.
I wonder if we could use/abuse the meta type checking: https://github.com/NixOS/nixpkgs/blob/master/pkgs/stdenv/generic/check-meta.nix to validate ternary status, assume it being undefined / null means "unknown", and then derive "enableParallelBuilding" from that.
cc @7c6f434c @roberth

Although it's highly desirable to have parallel builds, not all projects have build logic which supports being built in parallel; so I don't think this can be adopted by default.
Recent example: https://github.com/intel/linux-sgx/pull/784#issuecomment-1019636951
These issues are also very common in the python ecosystem, where pytest-xdist will cause certain assumptions to become invalid.
I've also seen clang and gcc SEGFAULT on builds with cores>32.

This issue has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/rfc-make-stdenv-to-build-in-parallel-by-default/15684/8

authors: Artturin dasj19 grahamc jonringer nixos-discourse r-burns trofi


text:
flake check mentions cabal2nix in its error message

I am writing a unit test for the experimental cli.
I need to run HelloWorld.hs.
running nix flake check produces:
error: a 'aarch64-linux' with features {} is required to build cabal2nix, but I am a 'x86_64-linux' with features {benchmark, big-parallel, kvm, nixos-test}
Do you have any thoughts on debuggin this error?
Thank you
I use this flake:
# https://magnus.therning.org/2022-03-13-simple-nix-flake-for-haskell-development.html
{
  inputs = {
    #nixpkgs.url = "github:nixos/nixpkgs";
    flake-utils.url = "github:numtide/flake-utils";
  };

  outputs = { self, nixpkgs, flake-utils }:
    flake-utils.lib.eachDefaultSystem (system:
      with nixpkgs.legacyPackages.${system};
      let
        t = lib.trivial;
        hl = haskell.lib;

        name = "project-name";

        project = devTools: # [1]
          let addBuildTools = (t.flip hl.addBuildTools) devTools;
          in haskellPackages.developPackage {
            root = lib.sourceFilesBySuffices ./. [ ".cabal" ".hs" ];
            name = name;
            returnShellEnv = !(devTools == [ ]); # [2]

            modifier = (t.flip t.pipe) [
              addBuildTools
              hl.dontHaddock
              hl.enableStaticLibraries
              hl.justStaticExecutables
              hl.disableLibraryProfiling
              hl.disableExecutableProfiling
            ];
          };

      in {
        packages.pkg = project [ ]; # [3]

        defaultPackage = self.packages.${system}.pkg;

        #warning: flake output attribute 'devShell' is deprecated; use 'devShells.<system>.default' instead
        devShell = project (with haskellPackages; [ # [4]
          cabal-fmt
          cabal-install
          haskell-language-server
          hlint
        ]);
      });
}

developPackage uses cabal2nix during evaluation via ifd, so to evalute packages.aarch64-linux requires building a derivation. Since your setup uses native compilation for this, it is impossible to evaluate this attribute path on x86_64-linux.
At least this would be my guess, I don't know what nix flake check does exactly. As I see it, this is not a bug, but a case of holding it wrong.

What's ifd?

That‘s right. nix flake check is incompatible with ifd. Nothing cabal2nix can do about this.

As I see it, this is not a bug, but a case of holding it wrong.

How do I "hold it right"? What can I use instead of developPackage that yields a similar result?

nix flake check evaluates all attributes of a flake (at least all which are in one of the well known namespaces of nix flakes) to make sure they can evaluate and that they have the right type.
I guess the correct but not quite satisfying solution would be to not check attributes for foreign plattforms (which use ifd).
I am not sure if this is a matter of holding it wrong or nix purposefully making live hard for IFD users.
Another solution would be to configure remote builders for every system. Or like sterni said avoiding ifd.
Yet another simple solution would be to only add attributes for x86_64 to flake in the first place.

nix flake check evaluates all attributes of a flake

Yet another simple solution would be to only add attributes for x86_64 to flake in the first place.

Is it possible to tell nix flake check to only check these attributes? I tried nix flake check --system x86_64-linux and nix flake check --arg system x86_64-linux, but that didn't work.

authors: aleeusgr maralorn sternenseemann turion


text:
Python 3.10.8 pointer being freed was not allocated

Describe the bug
Python 3.10.8's REPL  crashes another time with pointer being freed was not allocated.
Python 3.10.8 (main, Nov  5 2022, 22:39:44) [Clang 11.1.0 ] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> 36./11
3.272727272727273
>>> 2022-1953
69
>>> python(1572,0x1ebe7e500) malloc: *** error for object 0x104cd3ee4: pointer being freed was not allocated
python(1572,0x1ebe7e500) malloc: *** set a breakpoint in malloc_error_break to debug
[1]    1572 abort      python

Steps To Reproduce
Steps to reproduce the behavior:

have Python REPL open with a few "pocket calculator" expressions
forget about open REPL
come back to computer to find segfault

I should note that this isn't happening every time.
Expected behavior
A clear and concise description of what you expected to happen.
Notify maintainers
@FRidh
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
% nix-shell -p nix-info --run "nix-info -m"
these 2 paths will be fetched (0.01 MiB download, 0.11 MiB unpacked):
  /nix/store/6wszgsh6igfr953q3m0c30mjhnyv2gss-DarwinTools-1
  /nix/store/zla64n0bgd7mi62813ghm8268r4q3wzq-nix-info
copying path '/nix/store/6wszgsh6igfr953q3m0c30mjhnyv2gss-DarwinTools-1' from 'https://cache.nixos.org'...
copying path '/nix/store/zla64n0bgd7mi62813ghm8268r4q3wzq-nix-info' from 'https://cache.nixos.org'...
 - system: `"aarch64-darwin"`
 - host os: `Darwin 22.1.0, macOS 13.0.1`
 - multi-user?: `yes`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.11.1`
 - channels(root): `"nixpkgs"`
 - channels(holger): `"home-manager"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixpkgs`

I'm facing the same issue after a recent update. I've pasted the result of nix-shell -p nix-info --run "nix-info -m" below:
 - system: `"aarch64-darwin"`
 - host os: `Darwin 22.1.0, macOS 13.0.1`
 - multi-user?: `yes`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.11.0`
 - channels(root): `"nixpkgs"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixpkgs`

Would it be possible to attach lldb to the process, type continue to let it run, and extract a backtrace when it crashes?

I have some hope that this will also be fixed by https://github.com/NixOS/nixpkgs/pull/151090 (in staging currently).

I'm going to optimistically close this now that https://github.com/NixOS/nixpkgs/pull/151090 has made it to master. Please reopen if you can still reproduce the issue.

I confirm that this is fixed in unstable now (the issue originally being reproducible by resizing the window a couple of times or moving the terminal emulator to another display and back).

authors: HolgerPeters sersorrel siddharthverma314 tjni


text:
docker run --add-host=NAME:host-gateway does not work

Describe the bug
When trying to use the add-host feature from Docker, I get an nil entry in /etc/hosts inside of the container
Steps To Reproduce
Steps to reproduce the behavior:

docker run -ti --add-host=test:host-gateway ubuntu:latest
cat /etc/hosts
It will contain

<nil>    test

Expected behavior
/etc/hosts should contain a mapping between host's IP and test
Notify maintainers

@offline @tailhook @vdemeester @periklis @mikroskeem @maxeaubrey
Metadata
 - system: `"x86_64-linux"`
 - host os: `Linux 5.15.86, NixOS, 22.11 (Raccoon), 22.11.1421.e9ade2c8240`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.11.1`
 - channels(root): `"nixos-22.11.1421.e9ade2c8240"`
 - channels(yrashk): `"nixos-unstable-23.05pre439706.9813adc7f7c, release-22.11.tar.gz-22.11"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos

This sounds like upstream bug?

I have it working on Ubuntu, macOS, etc. That's what I thought it may be something NixOS specific, but I can't put my finger on it just yet.

I am also having this issue.

Does this issue still appear?
Built a system using nixos-22.11 channel (7dc71aef32e8faf065cb171700792cf8a65c152d), Docker version 20.10.21, and I couldn't reproduce this:
[root@docker-playground:~]# docker run --rm -ti --add-host=test:host-gateway ubuntu:latest
root@f5913104e560:/# cat /etc/hosts
127.0.0.1	localhost
::1	localhost ip6-localhost ip6-loopback
fe00::0	ip6-localnet
ff00::0	ip6-mcastprefix
ff02::1	ip6-allnodes
ff02::2	ip6-allrouters
172.17.0.1	test
172.17.0.2	f5913104e560

I am running the same versions and do see test mapped in. I can ping test but I cannot curl a website running on the host.

Do you have firewall enabled but Docker interface not added into networking.firewall.trustedInterfaces?

That does fix the issue. Thank you

I suppose that this problem has disappeared and issue can now be closed.

I have faced this issue.
this is a firewall-related issue. if anyone facing this issue you can disable the firewall.
networking.firewall.enable = false; ( not a good practice :) )

authors: Naim-Bijapure NateWright mikroskeem yrashk


text:
CUDA-Team: improve user experience

Improve user experience
This issue tracks the epic-level work to improve the user experience of interacting with CUDA-related software in Nixpkgs.

[ ] https://github.com/NixOS/nixpkgs/issues/232422
[ ] https://github.com/NixOS/nixpkgs/issues/232426
[ ] https://github.com/NixOS/nixpkgs/issues/232427
[ ] https://github.com/NixOS/nixpkgs/issues/232428

This issue has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/cuda-team-roadmap-and-call-for-sponsors/29495/1

This issue has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/cuda-team-roadmap-update-2023-08-29/32379/1

This issue has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/community-calendar/18589/103

authors: ConnorBaker nixos-discourse


text:
jdt-language-server crashes on startup

Describe the bug
jdt-language-server unconditionally fails to run, crashing on startup and writing a huge ass exception in the log
Steps To Reproduce
Steps to reproduce the behavior:

nix shell nixpkgs#jdt-language-server
jdt-language-server

Error:
Picked up _JAVA_OPTIONS: -Dsun.java2d.uiScale=2
An error has occurred. See the log file
/home/goose/.eclipse/213835391_linux_gtk_x86_64/configuration/1684495124914.log.

1684495124914.log
Expected behavior
It should not crash
Additional context
Tried with and without JAVA_HOME set. It wraps OpenJDK 19 to run, so it should work standalone, however, I'm not a java dev so I don't really know what else to try out
Notify maintainers
cc @matt-snider
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.2.11, NixOS, 23.05 (Stoat), 23.05.20230417.f00994e`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.3`
 - nixpkgs: `/etc/nix/path/nixpkgs`

jdt-language-server is supposed to be used with a language server client, could you test this with your editor (with the required lsp plugins) and see if it still crashes?

I've tried using Neovim with nvim-jdtls, and it immediately crashes on startup:

 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.28, NixOS, 23.05 (Stoat), 23.05.20230517.e6e3899`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.13.3`
 - channels(kylec): `""`
 - channels(root): `"home-manager-22.11.tar.gz, nixos-22.11"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Trying to run it directly from the terminal yields a similar error to WhiteBlackGoose's.

@figsoda still crashes (tried with nvim-jdtls).

Haha beat me to it

I can't reproduce my error, here is my nvim-jdtls config: https://github.com/figsoda/cfg/blob/52449c9931f4a5aee49c7d6e440a95ee0e9a0421/src/programs/neovim/configure/plugins.lua#L218-L254
What is your config and the java code you are working with?

My config:
if os.getenv("JDTLS") ~= nil then
    local jdtls_config = {
        cmd = { os.getenv("JDTLS"), '-data' },
        root_dir = vim.fs.dirname(vim.fs.find({'gradlew', '.git', 'mvnw'}, { upward = true })[1]),
    }
    require('jdtls').start_or_attach(jdtls_config)
end

Where JDTLS is env variable that points to the full path to jdt.
I tried yours btw, not sure what @ does in it, so removed settings and init_options, and got the same error.
The project is a maven tomcat web app.

I'm using the following configuration:
require("jdtls").start_or_attach({
    cmd = { "/etc/profiles/per-user/kylec/bin/jdt-language-server" },
    root_dir = vim.fs.dirname(vim.fs.find({ "gradlew", ".git", "mvnw" }, { upward = true })[1]),
})

I'm working on a Java compiler for an assignment.

It would be helpful to get the full command which is actually being run, not lua code or important values being hidden behind env vars. Those are things specific to your machine. Let us see what is actually being executed please.
Also some relevant entries from the log file would be a good start.

Hi, I tried running it directly, see the issue text. There's also log attached (I don't know what relevant there, tbh, I attached the whole file). See Steps to reproduce

@matt-snider
/nix/store/rrjsl3r0kazsbqf5wwbv44814jhnkphm-jdt-language-server-1.21.0/bin/jdt-language-server

hopefully I didn't change the inputs since then
what are you trying to compare it against? I don't see any nix store path mentioned in the part you quoted

Thanks! It's just helpful to see the exact derivation you're running and then the less precise but also useful jdtls version (1.21.0).
Did you search the upstream project at all? https://github.com/eclipse/eclipse.jdt.ls/issues/2194 seems to be the same (cryptic) error and the issue there was not including the -data /path/to/my/workspace option. It doesn't seem like you've done this when running the project manually from the command line.  Your config snippet (cmd = { os.getenv("JDTLS"), '-data'}) does not include a value for the -data option either.
eclipse.jdt.ls has this to say about it:

Choose a value for -data: An absolute path to your data directory. eclipse.jdt.ls stores workspace specific information in it. This should be unique per workspace/project.

I personally use  $XDG_CACHE_HOME/jdtls/$PWD, which ends up being something like $XDG_CACHE_HOME/jdtls/home/matt/projects/xyz` so each project is isolated.

I think we can probably close this, as the issue seems to be that both @WhiteBlackGoose and @kylechui did not specify a value for -data, but please confirm

Thanks, indeed. I didn't see it in the default config of the plugin, and the error wasn't very helpful. Thanks again

This did indeed fix it for me as well, sorry for the noise!

authors: WhiteBlackGoose figsoda kylechui matt-snider


text:
Module request: inadyn

ddclient was removed in #241462, with inadyn being the closest suggested replacement. inadyn is packaged in Nixpkgs, but does not have a NixOS module. An inadyn NixOS module would be useful as a replacement.

The first step is fixing inadyn itself, since it currently won't start due to a wrongly configured localstatedir, see #243785.

We will also need to decide if it's better to run as a systemd service, timer, or give the user the option to choose. I lean towards the latter.

AFAICS inadyn does not contain additional logic to detect IP address changes. Because of this I would also lean towards the timer functionality.

I think it does. Looking at inadyn.conf(5), inadyn will only update the ip if changed every preroid seconds and always update it every forced-update seconds. I'm not clear on how those options behave in oneshot mode.

Well, so far I called ddclient with cron, since the machine running will not easil see altered public IP change. I tried to use inadyn but can't get it to work with desec.io / dedyn.io.

I've had some time to poke around this a bit more, and it seems like inadyn cannot read credentials from the environment or a file separate to the config, so all your DDNS credentials will end up world-readable in the store.

I've made a pretty barebones module for my personal config here https://gitlab.com/lunik1/nix-config/-/blob/master/modules/system/inadyn.nix?ref_type=heads. It runs inadyn in oneshot mode using a timer, and is configured entirely by specufying a configFile.

Submitted a full NixOS module as https://github.com/NixOS/nixpkgs/pull/260962, I would appreciate if inadyn users could test it :slightly_smiling_face:.

Submitted a full NixOS module as #260962, I would appreciate if inadyn users could test it 🙂.

Add a small example for how to use it?

Sure, here's a config to use namecheap:
  services.inadyn = {
    enable = true;
    # controls how often your IP is checked, should be a format a systemd timer will understand
    interval = "*-*-* *:*:00";
    # these settings map 1:1 to those in inadyn.conf, check inadyn.conf (5)
    settings = {
      allow-ipv6 = false;
      forced-update = 60;
      custom."namecheap" = {
        # you can use include to keep your auth info in a seperate file and manage it with e.g. sops-nix
        include     = ./auth.txt;
        ddns-server = "dynamicdns.park-your-domain.com";
        ddns-path   = "/update?domain=%u&password=%p&host=%h&ip=%i";
        hostname    = [ "@" "*" ];
      };
    };
    # alternatively to settings, just speify a full config file
    # configFile = ./your/existing/inadyn.conf;
  };


text:
Build failure: systemd >=254-rc1 (cross-compiling to armv7l-linux)

Steps To Reproduce
Steps to reproduce the behavior:

build pkgsCross.armv7l-hf-multiplatform.systemd

Build log
[649/1779] Generating src/boot/efi/addonarm.efi.stub with a custom command
FAILED: src/boot/efi/addonarm.efi.stub
/build/source/tools/elf2efi.py --version-major=254 --version-minor=0 --efi-major=1 --efi-minor=1 --subsystem=10 --minimum-sections=7 src/boot/efi/addonarm.elf.stub src/boot/efi/addonarm.efi.stub
Traceback (most recent call last):
  File "/build/source/tools/elf2efi.py", line 593, in <module>
    main()
  File "/build/source/tools/elf2efi.py", line 589, in main
    elf2efi(parser.parse_args())
  File "/build/source/tools/elf2efi.py", line 493, in elf2efi
    pe_reloc_s = convert_elf_relocations(elf, opt, sections)
  File "/build/source/tools/elf2efi.py", line 384, in convert_elf_relocations
    raise RuntimeError("ELF .dynamic section is missing.")
RuntimeError: ELF .dynamic section is missing.

Full log: https://gist.github.com/2xsaiko/8543deb0e54d467ef71d177e0079a173
Additional context
Bisected to fe6e29938174d1548bdcf02e0100824b272442ed.
Notify maintainers
@flokli @Kloenk @Mic92
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 6.1.54, NixOS, 23.11 (Tapir), 23.11.20231005.9aae4ea`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.17.0`
 - nixpkgs: `/etc/nix/inputs/nixpkgs`

Same issue on master, since that PR is already merged, most likely not.

Ah! My bad, I should have cherry-picked it in the first place. That PR indeed fixes it.

No problem, thanks for confirming!
You can track the progress of this to hit the channels here: https://nixpk.gs/pr-tracker.html?pr=258373
Let's close this issue, nothing actionable here anymore.


text:
Gnome-shell ignores user settings.

Issue description
In Nix unstable, it seems that Gnome shell doesn't care about user settings.
Favorites, for example, are reset on each reboot.
Cannot change background (setting is saved but nothing happens).
Gnome tweak tools cannot affect gnome shell settings.
Everything works fine in NixOs 17.03.
Actually, reverting restores user settings as before.
Steps to reproduce
Install Gnome.
Update to NixOs 17.09.
Try to change background. ---> Does nothing.
Change favorites.
Reboot. ---> Favorites changes are discarded.
Technical details

System: 17.09pre111447.a7c8f5e419 (Hummingbird)
Nix version: nix-env (Nix) 1.11.13

Have a nice day,

See #25906.


text:
haskell: invariant violation: no "data" output for enableSeparateDataOuput with custom outputs

Issue description
If enableSeparateDataOutput is enabled, and if custom outputs are specified (which do not contain data) then the build fails.
Steps to reproduce
Create a haskell package with enableSeparateDataOutput = true; and outputs = ["out"]
Technical details
The generic builder assumes that enableSeparateDataOutput == true implies that $data is set. This is not guaranteed in case of custom outputs.
Found in current master.

The generic builder assumes that enableSeparateDataOutput == true implies that $data is set.

Yes, the generic builder assumes that and I see no reason why one might consider that a bug. If you have you no $data output, then you cannot enable enableSeparateDataOutput. What is the problem?

bug is probably a bit strong.
I think the question is whenever the caller of the function should be aware of the correlation or if enabling the flag should just add the "data" attribute to the outputs automatically. Depending on where both options are coming from it adds more coupling that necessary. #35040 proposes to add a bit more magic and append the "data" attribute automatically.

The problem is that it's bad UX: the behavior of enableSeparateDataOutput isn't documented and it's very easy to get the derivation in an inconsistent state, which takes a bit to debug. The only data I had when debugging this was mkdir -p: missing operand.

If you have you no $data output, then you cannot enable enableSeparateDataOutput.
This, especially, needs to either be made clear to the user (potentially in the documentation but especially in the error) or to be made impossible to not fulfill.

Here are some suggestions:

Throw an error early if enableSeparateDataOutput is true but $data doesn't exist, with a message mentioning what's expected
Insert $data in the outputs if enableSeparateDataOutput is set, regardless of whether outputs was customized or not
Infer enableSeparateDataOutput from the outputs.

@peti I'll be happy to submit a PR if you think one of these makes sense, or if you have other suggestions.

I still don't understand this issue. The generic Haskell builder does not even accept any argument called outputs. The API does not allow to create a Haskell package with outputs = ["out"] set.

My bad, in our code overrideAttrs has been used to change the outputs attribute.
The generic build branches on args.outputs if it's provided: https://github.com/NixOS/nixpkgs/pull/35040/files#diff-360bed088faac7580cee137eeffb39e0R194
So I guess the other option would be to remove the branch and disallow the use-case. Or add outputs and an explicit argument.

I cleaned that code up a bit in 25ee2516c2f8368eb348630ab3004bb72e2c73f0. Apparantly, that if-then-else conditional slipped in by accident when the multi-outputs PR was merged. It would be nice to guard against an inconsistent state, i.e. by means of an assertion. Not sure how to accomplish that in a way that's resistant against overrideAttrs, though.

In our case the package produces multiple binaries and it would be useful to retain the multiple outputs capability because they get used in different scenarios (multiple services, integration tests, DB migration tests, test logs).
I guess we could create more derivations from this one to split the outputs manually.

@peti thanks for 25ee251. I didn't realize we were bypassing the Haskell interface to override outputs.

I don't know ... I didn't want to expose the outputs attribute to users of this code precisely because that opens up a can of worms. The builder is quite complex and full of assumptions that may or may not hold. I felt that I'd rather not expose that stuff to random users of this code.
You can manipulate outputs in a somewhat controlled manner by providing your own mkDerivation function. It's just that when you do this, then you have a loaded shotgun pointed firmly at your foot and everyone assumes that you know know why you are doing this. :-)

authors: nmattia peti zimbatm


text:
couchdb: build fails with erlang issue

Issue description
Build fails.  See hydra output for full details, but the short-and-sweet is:
checking Erlang version compatibility... detected Erlang version: 8.3.5...compatible
init terminating in do_boot ()

Crash dump is being written to: erl_crash.dump...done
init terminating in do_boot ()

Crash dump is being written to: erl_crash.dump...done
configure: error: Could not find the Erlang crypto library.

Has Erlang been compiled with OpenSSL support?
builder for '/nix/store/yad8msfx5fm4qclqp4sq5cp0al3kp109-couchdb-1.7.1.drv' failed with exit code 1

I did a bisect to address the culprit CL.  It identified eb0368554661385ae470e245e50bd0bc10693bf0, upgrading gtk-doc.  I was initially skeptical that that could be the issue---I mean, gtk-doc?---but if I revert that one change, and then rebuild 1) it does rebuild erlang, and 2) the couchdb build does, in fact, succeed.
So somehow that gtk-doc change seems to be provoking erlang to be rebuilt, but then it isn't rebuilding correctly.

While with a different package I encountered a related issue building an erlang package. However in my case reverting the commit you indicated was not sufficient and I had to revert b3d2a87b532 as well!
There appears to be at least one more instance where a seemingly unrelated package deep down erlang's dependency chain causes strange failures - https://github.com/NixOS/nixpkgs/commit/fced35fa44098be0296d8b42166583bd5e505141#commitcomment-27974860 /cc @the-kenny

I'll open a separate issue for this. I haven't had any luck solving this issue yet.

Further data point - on my machine (NixOS 17.09 with nixStable2, building from recent-ish master) the gtk-doc reverts only work if I let Nix use Erlang from the binary cache. If I however try to rebuild both Erlang and the affected package then Erlang build succeeds but the package itself fails. If I do the same with Nix 1.11.16 then both Erlang and the package build.
This looks to be related to what can be seen on Hydra here - https://hydra.nixos.org/build/70845721/log -> CTRL-F "cp: cannot stat". The error looks to be produced by the Install script which I believe is ran by /bin/sh and contains the following statement:
cp -p ../releases/19/start_*.boot .

(I believe this is the source of the script - https://github.com/mfoemmel/erlang-otp/blob/master/erts/etc/unix/Install.src#L148)
A quick experiment shows that the sandbox /bin/sh on 17.09 with nixStable2 somehow cannot deal with such globbing pattern which doesn't get expanded and so the argument is treated literally, and results in files missing in the Erlang package.
So it seems the issue here is that something in the dependency triggers an Erlang rebuild and I suspect the build may land on a Hydra builder with a feature-limited sandbox /bin/sh producing a non-working Erlang package. It's a guess but perhaps the results vary between both the different builders and locally depending on the Nix version and from which nixpkgs version it was obtained.

Yes, this could be another symptom of /bin/sh impurity, see also #36669

erlang source has a lot of  #!/bin/sh shebangs. patchShebangs in preConfigure might help.

Should be fixed by #36919.

This does not appear to be fixed yet: https://hydra.nixos.org/build/71407019 , same error as OP.

Note that there's some progress in #36853 - I'm just now evaluating if my fix there is the "correct" one (@xeji's comment looks relevant there)

I just pushed 3e61f3b911c to master, hopefully fixing (or at least work around) the issue. Please try & report :)

Hydra builds look fine now. @mdorman please close after confirming.

authors: dtzWill mdorman pbogdan the-kenny xeji


text:
postgresql: backport parallel-make on macOS?

Issue description
Continues #51093. Parallel builds of postgresql have been disabled on darwin as a blunt fix. A patch was recently posted to the pgsql-bugs mailing list to fix this: https://git.postgresql.org/gitweb/?p=postgresql.git;a=patch;h=826eff57c4c23f77314ba7151d3dc506ce0fa24c
We may want to integrate this patch into nixpkgs, as the next upstream release is scheduled for February. I won't have time to do this, I'm afraid.
Ping @delroth , who can decide whether this is a worthwhile thing to backport, and close if not.

I think I'd rather see ranlib fixed as we talked about in #51221, if we can make it work.

Cool. I'll leave this for you to close, then, once you decide whether the ranlib patches are going to work?

Yes, this should be done in ranlib if possible and it can be fixed for all our Darwin builds. It seems like Postgres might not be the first or last to suffer from this.

I would not count on the fix being backported to 18.09. It depends on what we end up agreeing on. We may have to expose utimensat which is only available on macOS 10.13, breaking support for previous versions. That should probably just go to unstable. Just disabling parallel building in the latest release sounds like the safest idea to me.

@matthewbauer This bug isn't about backporting the ranlib fix to 18.09, but about backporting a build-system fix the postgres devs have proposed (the target for the .a file that the build races over gets an extra touch $@, which supports subsecond timestamps).

authors: delroth endgame matthewbauer thoughtpolice