text:
User-focused documentation of transport configuration

The extant documentation (https://github.com/Azure/azure-sdk-for-python/blob/master/sdk/core/azure-core/CLIENT_LIBRARY_DEVELOPER.md#transport) is written for client library developers. We should have a document describing how users can configure transport.

@chlowell do you have any users data that they want to configure a transport by themselves? In #9397, it seems to me they wanted to use aiohttp but saw non-helpful errors. We have #9399 to track that issue.

What I was looking for here is a document describing to users the prerequisites and configuration options for async transports. Something to link to from another library's readme so I can write "you need to install aiohttp for the default async stuff to work but there are other options, see this other document for more information". The best candidate I found is CLIENT_LIBRARY_DEVELOPER.md, which was written for SDK developers.

Seems like we are on same page.
What I plan to solve is:

Describe the prerequisites for async transports by solving #9399
A link to the documentation of transport options (https://aka.ms/azsdk/python/transport-configuration). I prefer to use aka.ms rather than hard-coding into README so we can have the flexibility of maintaining multiple versions and can always point user to the latest one by default.

Your options?

A better error message and more durable link are part of it but I'm thinking more about the document itself here. It has the best description I know of our async transport implementations and how to use them but from a user's perspective it contains a lot of noise about internal types and concepts. I opened this issue because it seems like we should have documentation for users who want to know more about transport selection and configuration, and the best we have is this one written for the SDK team.

The link points users to the available options for transport (we plan to uniform the transports so every transport expose same options by default). It looks like:

Parameters
Description

connection_timeout
A single float in seconds for the connection timeout. Defaults to 300 seconds.

read_timeout
A single float in seconds for the read timeout. Defaults to 300 seconds.

connection_verify
SSL certificate verification. Enabled by default. Set to False to disable, alternatively can be set to the path to a CA_BUNDLE file or directory with certificates of trusted CAs.

connection_cert
Client-side certificates. You can specify a local cert to use as client side certificate, as a single file (containing the private key and the certificate) or as a tuple of both files' paths.

proxies
Dictionary mapping protocol or protocol and hostname to the URL of the proxy.

cookies
Dict or CookieJar object to send with the Request.

stream
whether to immediately download the response content. Defaults to False.

connection_data_block_size
The block size of data sent over the connection. Defaults to 4096 bytes.

Did I miss anything?

Looks like all the relevant kwargs to me but I'm questioning whether that document is the right place for it. I think it's strange to point a user who wants to configure a proxy to a document that covers that and also the difference between SansIOHTTPPolicy and HTTPPolicy. Shouldn't we separate documentation for users from documentation for SDK developers?

Good question!
Now we have two options:

Have a separate documentation which only focuses on transport configurations. And the cons is we need to maintain multiple copies of the information.
We create the link which points to the transport configuration section in developer doc. like https://aka.ms/azsdk/python/transport-configuration.

@lmazuel @johanste any suggestions?

I agree with @chlowell - we have two different audiences; client library developers and developers using our client libraries.
The former should start with our python design guidelines. The latter should find a link that does not get into how the sausage is made. I don't think that they will be copies. And while there will be overlap, the client library developers should already understand/know how their stuff is supposed to be used, so that piece of documentation doesn't have to repeat things in detail.

There may also be a third set of developers; people who want to extend our library without being client library developer. The information they need should be in an advanced section on how things work.

The current PR duplicates too many things to me, by experience they will go inconsistent at some point in time:
https://github.com/Azure/azure-sdk-for-python/pull/15856
I see the README as valuable for both dev and sdk write, while client_dev.md for dev only.
In the case of transport kwargs, I see no reason to keep them SDK write only, since these are flags people will pass.

Fixed

Fixed

authors: chlowell johanste lmazuel xiangyan99


text:
[Key Vault] Update test-resources.json for new MHSM API

Due to a service change, deployments with the current ARM template now fail. This updates the resource API version and adds new required fields.

/check-enforcer reset

/check-enforcer reset

/azp run python - keyvault - ci

/check-enforcer override

source: gharchive/pull-request

repo: Azure/azure-sdk-for-python

license: MIT

license_type: permissive

license_source: github-api


text:
[Tables] Fix bug in update mode

Fix for bug found in #20247

/azp run python - tables - tests


text:
[ML] Add type discriminator for scale_settings subclasses

Description
Adding type discriminator for scale_settings type for DefaultScaleSettings and TargetUtilizationScaleSettings
Renamed scale_type to type
All SDK Contribution checklist:

[X] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[X] I have read the contribution guidelines.

General Guidelines and Best Practices

[X] Title of the pull request is clear and informative.
[X] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-ai-ml

authors: azure-sdk nancy-mejia


text:
[Bot Rules] Update service contacts for Text Analytics

Summary
The focus of these changes is to update the bot rules with the Text Analytics service contact from #27104.

/check-enforcer override


text:
[ML]: Resolve the cross references for MLClient, Resource and OnlineDeployment

Resolve the cross references for MLClient, Resource and Online Deployment and Endpoint.
Add description for project, modules and classes.
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[x] CHANGELOG is updated for new features, bug fixes or other significant changes.
[ ] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

Existing documentation for the packages (Empty table):

Updated the documentation for the packages:

Broken reference links for Online Deployment:

Resolved reference links for Online Deployment:


text:
[AutoPR] network/resource-manager

Created to accumulate context: network/resource-manager

(message created by the CI based on PR content)


text:
Update documented modules

Public modules have changed since preview 1. This ensures docs for azure-identity and azure-keyvault-secrets cover preview 2's public API. (azure-keyvault-keys docs are updated by #6537)

Can one of the admins verify this patch?

Seems reasonable to me! Did you double check that everything displays the way you expect in your local sphinx? If it looks good, check it in!

authors: adxsdk6 chlowell scbedd


text:
[AutoPR] sql/resource-manager

Created to accumulate context: sql/resource-manager

(message created by the CI based on PR content)


text:
sync permissions and prompt to overwrite

Which version of the AzCopy was used?
AzCopy/10.0.7-Preview Azure-Storage/0.4
Which platform are you using? (ex: Windows, Mac, Linux)
Linux
What command did you run?
azcopy sync . https://<account>.blob.core.windows.net/<container>/<path>/ --recursive --log-level INFO

What problem was encountered?

Permissions are weird. I ran it three times.  The first time I got this error:

Using OAuth token for authentication.

Job 6974d566-47b2-e642-5b96-3ac2527133ea has started

Log file is located at: /home/jobevers/.azcopy/6974d566-47b2-e642-5b96-3ac2527133ea.log
0 File Scanned at Source, 0 Files Scanned at Destination
Authentication Failed. The SAS is not correct or expired or does not have the correct permission -> github.com/Azure/azure-storage-azcopy/vendor/github.com/Azure/azure-storage-blob-go/azblob.NewResponseError, /go/src/github.com/Azure/azure-storage-azcopy/vendor/github.com/Azure/azure-storage-blob-go/azblob/zz_generated_response_error.go:29
===== RESPONSE ERROR (ServiceCode=AuthorizationPermissionMismatch) =====
Description=This request is not authorized to perform this operation using this permission.
RequestId:c4209a39-b01e-0060-01f1-c2ecc1000000
Time:2019-02-12T16:37:08.1763825Z, Details:
   Code: AuthorizationPermissionMismatch
   PUT [...]
   Authorization: REDACTED
   Content-Length: [8388608]
   User-Agent: [AzCopy/10.0.7-Preview Azure-Storage/0.4 (go1.10.3; linux)]
   X-Ms-Client-Request-Id: [fd1a2db8-0c74-458e-5cac-e787f56a3aad]
   X-Ms-Version: [2018-03-28]
   --------------------------------------------------------------------------------
   RESPONSE Status: 403 This request is not authorized to perform this operation using this permission.
   Content-Length: [279]
   Content-Type: [application/xml]
   Date: [Tue, 12 Feb 2019 16:37:07 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Error-Code: [AuthorizationPermissionMismatch]
   X-Ms-Request-Id: [c4209a39-b01e-0060-01f1-c2ecc1000000]
   X-Ms-Version: [2018-03-28]

Then I ran it again and got:
Using OAuth token for authentication.

Job cde3f1df-4f14-f84d-609c-77102577c08d has started

Log file is located at: /home/jobevers/.azcopy/cde3f1df-4f14-f84d-609c-77102577c08d.log
Sync has enumerated 36 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: y
583 Done, 0 Failed, 95 Pending, 678 Total, 2-sec Throughput (Mb/s): 6701.6566

Job cde3f1df-4f14-f84d-609c-77102577c08d summary
Elapsed Time (Minutes): 0.2669
Total Number Of Copy Transfers: 642
Total Number Of Delete Transfers: 36
Number of Copy Transfers Completed: 642
Number of Copy Transfers Failed: 0
Number of Delete Transfers Completed: 36
Number of Delete Transfers Failed: 0
Final Job Status: Completed

I thought it was weird that 36 files had managed to transfer the first time, so I tried a third time to see what would happen:
Using OAuth token for authentication.

Job 2be6dc02-1d1a-7b47-47e9-98b4df5d8770 has started

Log file is located at: /home/jobevers/.azcopy/2be6dc02-1d1a-7b47-47e9-98b4df5d8770.log
Sync has enumerated 627 files to delete from destination. Do you want to delete these files ? Please confirm with y/n: n
642 File Scanned at Source, 627 Files Scanned at Destination
Authentication Failed. The SAS is not correct or expired or does not have the correct permission -> github.com/Azure/azure-storage-azcopy/vendor/github.com/Azure/azure-storage-blob-go/azblob.NewResponseError, /go/src/github.com/Azure/azure-storage-azcopy/vendor/github.com/Azure/azure-storage-blob-go/azblob/zz_generated_response_error.go:29
===== RESPONSE ERROR (ServiceCode=AuthorizationPermissionMismatch) =====
Description=This request is not authorized to perform this operation using this permission.
RequestId:2ffea49d-701e-000d-57f2-c2588a000000
Time:2019-02-12T16:48:33.2693489Z, Details:
   Code: AuthorizationPermissionMismatch
   PUT [...]
   Authorization: REDACTED
   Content-Length: [2815385]
   User-Agent: [AzCopy/10.0.7-Preview Azure-Storage/0.4 (go1.10.3; linux)]
   X-Ms-Client-Request-Id: [2fc77bed-72f7-41d7-7407-9105768a1dcb]
   X-Ms-Version: [2018-03-28]
   --------------------------------------------------------------------------------
   RESPONSE Status: 403 This request is not authorized to perform this operation using this permission.
   Content-Length: [279]
   Content-Type: [application/xml]
   Date: [Tue, 12 Feb 2019 16:48:32 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Error-Code: [AuthorizationPermissionMismatch]
   X-Ms-Request-Id: [2ffea49d-701e-000d-57f2-c2588a000000]
   X-Ms-Version: [2018-03-28]

Why am I being prompted to delete files on the destination.  Isn't the point of sync to only copy newer files?

How can we reproduce the problem in the simplest way?
Run sync?
Have you found a mitigation/solution?
No.

Hi @jobevers, thanks for reaching out!
Sync replicates the source's content to the destination, this means that the extra files at the destination may need to be deleted in order to match the source. Please refer to this wiki page on a brief introduction.
Did you target the same container in all three invocations? Was there any permission change to your account?
Btw the sync command was re-written and will be shipped with the next release.

Hi @jobevers, the sync command was rewritten and released in v10.0.8. Please give the new version a try and let us know if you still encounter any problem.
Here is a wiki explaining how the new sync command works. Please feel free to reach out if you have any question or concern.

source: gharchive/issue

authors: jobevers zezha-msft

repo: Azure/azure-storage-azcopy


text:
logging to ILogger on config error

Should help address https://github.com/Azure/azure-webjobs-sdk/issues/1126 by making sure we're logging to both TraceWriter and (a default) ILogger if we have an error while building the configuration.

@fabiocav -- ping

@mamaso / @fabiocav -- can one of you take a quick look at this?

repo: Azure/azure-webjobs-sdk-script


text:
[Feature Request]: Function App binaries to Azure Blob

Description
The current CARML library deploys the function app binaries to a Local device instead of storing it in Azure blob. This would block the scaling of the function app. The users have to set explicitly following App settings but this can be done directly on CARML Module.
var websiteContentShare = !empty(storageAccountId) ? union({
    WEBSITE_CONTENTAZUREFILECONNECTIONSTRING: 'DefaultEndpointsProtocol=https;AccountName=${storageAccount.name};AccountKey=${storageAccount.listKeys().keys[0].value};'
  }, {
    WEBSITE_CONTENTSHARE: appName
  }) : {}

Hey @tsc-buddy ,
I just migrated this issue over from CARML. Please take a look and triage if still relevant :)

Hi There - Thanks for logging this issue. We shall triage this wc 15th July.

Hey @tsc-buddy,
please note that the bot will not give up until the label 'Needs: Triage' is gone 😄 A persistent fella

Hey There - I've just got back from vacation so will triage and look into this some more WC 12/8

Hey @tsc-buddy,
could you give this issue a triage spin? :)

authors: AlexanderSehr PoojithJain tsc-buddy

repo: Azure/bicep-registry-modules


text:
Module Dependency Support

Will module support dependency, such as Module1 depends on Module A, or an array of Modules, etc.?

It seems that dependsOn is automatically generated when referencing the outputs of the module from other modules. Therefore, I think there is a not need for an additional dependency definition mechanism.

In some cases, we are not able to figure out dependencies between modules. To deal with that, users need to be able to set the dependencies however they need. This will be accomplished via explicit dependsOn just like with resources.

authors: alanp-msft majastrz takekazuomi

repo: Azure/bicep


text:
Module outputs as input parameter is not referenced correctly

Bicep version
0.26.170
Describe the bug
I would like to use the output of a module as the input parameter of another module. The syntax is allowed but when at deployment time, the referenced properties is missing the value attribute.
To Reproduce
// moduleA.bicep
output webAppName string = 'test'
output nonusedOutput string = 'toto'

// moduleB.bicep
param input moduleAOutputType

type moduleAOutputType = {
    webAppName: string
}

// use input.webAppName

// main.bicep
module a 'moduleA.bicep' = {
}

// valid but do not deploy
module b 'moduleB.bicep' = {
    params: {
        input: a.outputs
    }
}

// deploy
module b 'moduleB.bicep' = {
    params: {
        input: {
             webAppName: a.outputs.webAppName
        }
    }
}

Additional context
Deployment template validation failed: 'The provided value for the template parameter 'input.webAppName' is not valid. Expected a value of type 'String, Uri', but received a value of type 'Object'. Please see https://aka.ms/arm-create-parameter-file for usage details.'. (Code: InvalidTemplate)

This is what is generated when creating the object manually (working case)
 "input": {
      "value": {
          "webAppName": "[reference('a').outputs.webAppName.value]"
      }
  }

When passing outputs directly (non working case)
"input": {
      "value": "[reference('a').outputs]"
  },

and then the value is reference with "[parameters('input').webAppName]", so I guess it missed the .value  part.
Could it be possible to either add the .value when the parameter is coming from the outputs object, or automatically create the value mapping ? The former would better as we may not use all properties of the output.
This would help to get rid of a lot mapping boilerplate code

This seems like a gap in how Bicep translates output references into ARM JSON expressions. In the second case, the ARM expression should look something like:
"input": {
  "value": "[toObject(items(reference('a').outputs), lambda('kvp', lambdaVariables('kvp').key), lambda('kvp', lambdaVariables('kvp').value.value))]"
}

We block using such an expression directly in Bicep since each property on a reference to module outputs uses the type of the output rather than an object with a value property:

Having the same issue right now 🙁 Another problem is that doing a dry run with -w switch doesn't show any errors, it just tells me that the resource I want to update/create is ignored. It would be nice to have some kind of error message too please.
I worked around this bug by importing an existing resource inside my module, rather than passing its name as a parameter:
param applicationInsightsName string

// Import the resource we created in parent main.bicep here
resource appInsights 'Microsoft.Insights/components@2020-02-02-preview' existing = {
  name: applicationInsightsName
  // no need to set scope, defaults to current resource group (I think)
}


text:
fix(chart): fix if-checks and add if wrappers to all optional values

Improved fix for #135

I'm cool with this version once it's rebased.
Looks like we all had approximately the same idea at approximately the same time.

rebased

oof, looks like the commit history got munged up in the rebase. Can you try the following?
$ git remote add upstream git@github.com:Azure/brigade
$ git checkout upstream/master
$ git checkout -b fix-135
$ git cherry-pick 25af0af79eb1d379ee91df721fc5fc7c478502f0
$ git push origin fix-135

And open a new PR? That would be the easiest way to fix this. :)

authors: bacongobbler lukepatrick technosophos

repo: Azure/brigade


text:
running azds behind corporate proxy

I was receiving an SSL handshake failure and turns out azds cli isn't recognizing my system proxy settings.  I was able to workaround that error by adding "System.Net.Http.UseSocketsHttpHandler": false to the azds.runtimeconfig.json where azds cli is installed.
I'm still running into issues, but not entirely sure its related to proxy yet, but wanted to report this as a bug as I would expect it to pull from system settings automatically instead of having to configure the cli.
System Info:
Windows 10 Enterprise 1709
Azure Dev Spaces CLI 1.0.20191204.4
API v3.2

thanks for reporting. we will investigate.

@jbockle, Can you share the logs of azds cli from %TEMP%/Azure Dev Spaces folder?
Also when you say running azds behind the firewall, do you mean running azds cli in a corporate network with a firewall or even your AKS cluster is behind a firewall?
If your aks cluster is also behind a firewall then you need to configure additional things to enable Azure Dev Spaces to work. Can you share the scenario that are not working for you and I let you know how to configure things to unblock you.

@rakeshvanga sorry I edited the post just now to correct, I meant behind a proxy

@jbockle, Thanks for the update. Are you facing any other issue while using our product other than working behind a proxy?

@rakeshvanga , yes, and unfortunately they are difficult to pinpoint due my companies many required security agents/proxy filters.  I did get a bit further.  Is there a list of required ports/endpoints/other requirements that should be considered in order to use it? I haven't been able to find anything specific for it yet.  Right now, I'm able to use 'azds up' to run, but using both the vs/vsc extensions to run and debug is not working.  I'm not on my work PC atm, so I will get back to you with more specifics/logs, but iirc I'm receiving an error along the lines of "Container not available".

@jbockle Thanks for the inputs.
Regarding ports we do a port forwarding to the AKS cluster from your machine. To define particular ports from your machine and the ports of the container, you can pass --port <local1>:<remote1> to azds up command and select ports that are enabled on your machine.
If you can provide the subscription you have used to create your AKS cluster, I can look up logs on the server-side to investigate the root cause.

sure the subscription id is 826d5ea2-cb82-48e4-b298-2a848d352edc.  My prelaunch vscode task does contain the --port switch.  I'm not sure what I did but after recreating my cluster, and setting up a fresh express api and prepping it for azds, I'm not even getting the error anymore, it just hangs on the prelaunch task, below is its output:
> Executing task: C:\Program Files\Microsoft SDKs\Azure\Azure Dev Spaces CLI\azds.exe up --port=58275:9229 --await-exec --keep-alive <

Synchronizing files...22s
Using dev space 'default' with target 'aks-cluster'
Installing Helm chart...1s
Waiting for container image build...3s
Building container image...
Step 1/7 : FROM node:lts
Step 2/7 : EXPOSE 3000
Step 3/7 : WORKDIR /nodeapp
Step 4/7 : COPY package.json .
Step 5/7 : RUN npm install
Step 6/7 : COPY . .
Step 7/7 : CMD ["npm", "start"]
Built container image in <1s
Waiting for container...3s
Service 'nodejs' port 'http' is available at http://default.nodejs.jpcfs649ql.eus2.azds.io/

I placed my sample project and the logs in this repo: https://github.com/jbockle/az-aks-azds-testing

hey, @jbockle I have investigated the logs and everything seems to fine. I have tried debugging through vscode your nodejs app and it ran successfully.
Can you try debugging again using vscode?

I'm still unable to get this working properly.  If I disconnect from my company's VPN and remove system proxy configuration, I can properly use the tooling.

also, the visual studio extension does not work at all, i don't believe it is using azds cli like vscode is, and I'm not sure where to set the "System.Net.Http.UseSocketsHttpHandler": false setting

@jbockle, With your company's VPN and proxy configuration enabled, can you check if you are able to port-forward using kubectl port-forward to any pod in the cluster?
For Azure Dev Spaces to work, we need to port-forward to the pod running on the cluster. I suspect your company's VPN/proxy configurations are restricting certain network traffic from your dev machine.
For Visual Studio, you can follow the steps mentioned here to add the setting to runtime.config file.
https://docs.microsoft.com/en-us/dotnet/api/system.net.http.socketshttphandler?view=netcore-3.1#remarks

Hi @rakeshvanga, unfortunately it's not possible over public internet as my company blocks that.  Theoretically, if my AKS cluster was behind an express route and I setup a custom ingress controller, would I be able to use "kubectl port-forward" over the express route instead of public internet from my dev machine?

If so, is there any documentation or guidance you can provide?
If not, is "kubectl proxy" an option?

@jbockle, sorry for the delayed response.
Yes, if you set up your dev machine and aks cluster to be in the same network via express route, you can use all the functionalities even without a custom ingress controller.
This documentation here provides detailed information about the networking requirements for Azure Dev Spaces:  https://docs.microsoft.com/en-us/azure/dev-spaces/configure-networking.

okay thanks, we'll give it a try in the coming months we are still working on setting up our aks infrastructure

authors: jbockle rakeshvanga xinyanmsft

repo: Azure/dev-spaces


text:
autorest/adal parseExpiresOn inconsistent return value

@jhendrixMSFT, I'm a little confused why parseExpiresOn() calculates the difference between t time.Time (the passed in and parsed s string) and time.Now().UTC(). That difference I believe is effectively the expires_in value (the TTL of the token).
However, when the strconv.ParseInt(s, 10, 64) logic is successful this parseExpiresOn function would be passing through the unix timestamp as far as I can tell (i.e. the actual time when the token expires and not the expires_in value).
That is, if a unix timestamp is passed in, a unix timestamp is returned. If a string formatted datetime is passed in a remaining TTL is returned.
From the IMDS docs - https://docs.microsoft.com/en-us/azure/active-directory/managed-identities-azure-resources/how-to-use-vm-token#get-a-token-using-http

expires_on - The timespan when the access token expires. The date is represented as the number of seconds from "1970-01-01T0:0:0Z UTC" (corresponds to the token's exp claim).

You're right, looks like the number format got confused with expires_in, so we're treating the unix timestamp as the number of seconds. :(

Fixed in autorest/adal/v0.9.10

authors: jhendrixMSFT mdgreenfield

repo: Azure/go-autorest

license_source: bigquery


text:
What to do about write-once properties?

Some ARM templates have properties that can be set on creation but not modified later. What do we do about these? Does Kubernetes have support/concepts that match this?

I noticed that Crossplane has an annotation +immutable, and Kubernetes seems to discuss this exact annotation here

authors: Porges matthchr


text:
Github is deprecating node16 on actions

Node 16 has reached End of Life (EoL)
Github supports node version 20 and we should move to use that instead
https://github.com/Azure/login/blob/45c3280904d6ab9d2fba45123b9e0aeb15ea9cd0/action.yml#L41

@eikooc thanks for your suggestion. You're right. And it's in our plan.

I'll close this issue since it's already tracked in #357.

Sorry, I totally missed that. I've made a PR that updates the action https://github.com/Azure/login/pull/392

authors: YanaXu eikooc

repo: Azure/login


text:
Add ability to enter an SSH key for Linux VM authentication in the Azure Portal Form

Benefit/Result/Outcome
So that an IT Admin using the Azure Portal Form is not limited to user name/password authentication on the Linux jump box.
Description
As part of #615 we had to remove the ability to enter an SSH key for Linux because the Azure Portal stopped supporting the user interface control named Microsoft.Compute.CredentialsCombo. A replacement UI control has been created in the schema but the portal does not support it yet. In the meantime we had to fall back to using Microsoft.Common.PasswordBox, which does not support SSH keys for Linux.
Acceptance Criteria

A user is able to choose between user name/password and SSH key authentication for the Linux jump box.

I updated the description and title to be pedantic 😅

I updated the description and title to be pedantic 😅

There should be an emoji for pendantic. 😹

@glennmusa and @brooke-hamilton Not sure this helps or not but here is a snippet I am borrowing for ASH UI that uses combo box selection to then offer either the SSH or Password box. The entire UI json is from ato-toolkit and can be found here: https://github.com/Azure/ato-toolkit/blob/111ee425a1716a216a4c31770a2f8b70fbf71bc2/stig/linux/createUiDefinition.json
                {
                    "name": "adminCredentials",
                    "type": "Microsoft.Compute.CredentialsCombo",
                    "label": {
                        "authenticationType": "Authentication type",
                        "password": "Password",
                        "confirmPassword": "Confirm password",
                        "sshPublicKey": "SSH public key"
                    },
                    "toolTip": {
                        "authenticationType": "Authentication type (password or ssh public key) to connect to the virtual machine",
                        "password": "Admin password for the virtual machine",
                        "sshPublicKey": "Admin ssh public key for the virtual machine"
                    },
                    "constraints": {
                        "required": true,
                        "customPasswordRegex": "^(?=.*[A-Z])(?=.*[.!@#$%^&*()-_=+])(?=.*[0-9])(?=.*[a-z]).{12,40}$",
                        "customValidationMessage": "Password must be at least 12 characters long, and contain upper case, lower case, number and symbol"
                    },
                    "options": {
                        "hideConfirmation": false,
                        "hidePassword": false
                    },
                    "osPlatform": "Linux",
                    "visible": true
                }

Depends on #627

authors: brooke-hamilton glennmusa shawngib

repo: Azure/missionlz


text:
deployment failed: failing invoking action 'provision'

I am following the README to deploy the RWA:
git clone https://github.com/Azure/reliable-web-app-pattern-java.git
cd reliable-web-app-pattern-java
azd config set alpha.terraform on
azd env new <your-environment>
azd env set DATABASE_PASSWORD "AV@lidPa33word"
azd env set APP_ENVIRONMENT prod
azd env set AZURE_LOCATION westus3
azd env set AZURE_LOCATION2 eastus
azd up

After a long time, the azd up command fails with the following errors:
│ Error: Could not create service principal
│
│   with module.ad[0].azuread_service_principal.application_service_principal,
│   on modules/active-directory/main.tf line 68, in resource "azuread_service_principal" "application_service_principal":
│   68: resource "azuread_service_principal" "application_service_principal" {
│
│ ServicePrincipalsClient.BaseClient.Post(): unexpected status 409 with OData error: Request_MultipleObjectsWithSameKeyValue: The service principal cannot be created, updated, or restored because the service principal name yyyyyyyyyyyy is already in use.
╵

It's the first time I try to deploy the application, so I don't understand why I get the service principal name yyyyyyyyyyyy is already in use.
Any idea?
Thanks
As for my environment, I have:
$ java -version
openjdk version "17.0.5" 2022-10-18

$ mvn --version
Apache Maven 3.8.8

$ azd version
azd version 1.1.0

This issue was corrected as part of our v1.1 upgrade.  Can you try out the new instructions?  Re-open if necessary.

authors: adrianhall agoncal

repo: Azure/reliable-web-app-pattern-java


text:
The number of files in the app content folder exceeds the limit of 15000.

I'm using Next JS app for front end and Azure devops to deploy to SWA.
I have azure devops task as below.
- task: AzureStaticWebApp@0 inputs:     app_location: 'NextJS/sample-app'     api_location: 'NextJS/api'     output_location: 'out' env:    azure_static_web_apps_api_token: $(deployment_token)
Pipeline Error
`Determining projects to restore...
Restored /working_dir/NextJS/api/SampleApi/SampleApi.csproj (in 2.83 sec).
Publishing to directory /ss-oryx/api...
Microsoft (R) Build Engine version 16.7.2+b60ddb6f4 for .NET
Copyright (C) Microsoft Corporation. All rights reserved.
Determining projects to restore...
All projects are up-to-date for restore.
SampleApi -> /working_dir/NextJS/api/SampleApi/bin/Release/netcoreapp3.1/SampleApi.dll
SampleApi -> /ss-oryx/api/
Preparing output...
Removing existing manifest file
Creating a manifest file...
Manifest file created.
Done in 16 sec(s).
---End of Oryx build logs---
Function Runtime Information. OS: Windows, Functions Runtime: v3, .NET Core version: 3.1
Finished building function app with Oryx
Zipping Api Artifacts
Done Zipping Api Artifacts
The content server has rejected the request with: BadRequest
Reason: The number of files in the app content folder exceeds the limit of 15000.`
I have tried to reduce the output of number of files then I received below error
---End of Oryx build logs--- Function Runtime Information. OS: Windows, Functions Runtime: v3, .NET Core version: 3.1 Finished building function app with Oryx Zipping Api Artifacts Done Zipping Api Artifacts The content server has rejected the request with: BadRequest Reason: The size of the app content was too large. The limit for this Static Web App is 262144000 bytes.
We are at a stage to productionalize our application but this is a deal breaker. We have around more than 25k files now and  that is only going to grow (significantly) larger over time.
I can't share repository details.

Any update on this issue please?

@anthonychu

We are running into the same issue, would be great if the file limit could be increased. When can we expect a resolution?

hello, i'm also bumping into this issue -- we have a site that hosts around 25k files, largely statically generated content. can someone please provide guidance on timelines, etc? tks.

Also receiving this error, any known workarounds for it?

This seems true even for the Standard Plan, regardless that all files combined are only ~320MB.
@MaximRouiller Any thoughts?

Found a dirty workaround https://github.com/Azure/static-web-apps/issues/782#issuecomment-1186322614

This is still a problem. We might have to look into other solutions if this can't be resolved very soon.

Please fix this issue as soon as possible. It is so easy to increase the limit to 1 000 000. Why are you limiting us to only 15 000?

@ytodorov We solved it by building the app in Github Actions and just uploading the built artifacts.
name: Build and Deploy Job
    steps:
      - uses: actions/checkout@v3
        with:
          submodules: true

      - uses: pnpm/action-setup@v2.2.2
        with:
          version: 7

      - name: Setup node
        uses: actions/setup-node@v3
        with:
          node-version: 16
          token: ${{ secrets.GITHUB_TOKEN }}
          cache: pnpm

      - name: Install
        run: pnpm install

      - name: Build
        run: pnpm run build

      - name: Remove 'node_modules'
        run: rm -rf node_modules/

      - name: Build And Deploy
        id: builddeploy
        uses: Azure/static-web-apps-deploy@v1
        with:
          azure_static_web_apps_api_token: ${{ secrets.AZURE_STATIC_WEB_APPS_API_TOKEN }}
          repo_token: ${{ secrets.GITHUB_TOKEN }}
          action: "upload"
          skip_app_build: true
          app_location: "/build"

No, this will not work for me. My build artefacts contain more than 15 000 files. I am using  and my website has more than 15 000 HTML pages (Not to mention that It has 10000+ images which are separate files). Any ideas?

We have the same issue. Any updates on this?

There are no updates in regards to this. I tried to deploy a very simple application which doesn't exceed the 500MB quota on the Standard plan. The file quota is something in addition that is not properly documented anywhere. Incredibly frustrating. Azure Static Web Apps is not a reliable solution for hosting, unless it is purely static content.

Hi all, thanks for the feedback on this limitation. We're working on improving our content distribution, and are looking into increases to this limit which could come out of this engineering effort.
To help us better understand how many files need to be supported, can any of you share any repos or file count ranges that you would hope to see supported by Azure Static Web Apps?

Is there a reason to have a hard file limit, as long as it doesn't exceed the said quota?
My use case was less than 30.000 html files - only real limit for practicality was the duration of the build and deploy.

Hi all, thanks for the feedback on this limitation. We're working on improving our content distribution, and are looking into increases to this limit which could come out of this engineering effort.
To help us better understand how many files need to be supported, can any of you share any repos or file count ranges that you would hope to see supported by Azure Static Web Apps?

Our use case is potentially a million static HTML files (or more), the files are just text and absolutely tiny <1KB.
After doing a bit of research, we going to skip Static Web Apps and go with Azure Blob Storage Static Site + CDN that should give us similar functionality without the limitation. We will miss out on a few features such as AAD auth and native functionApps but that is manageable.

Hi all, thanks for the feedback on this limitation. We're working on improving our content distribution, and are looking into increases to this limit which could come out of this engineering effort.
To help us better understand how many files need to be supported, can any of you share any repos or file count ranges that you would hope to see supported by Azure Static Web Apps?

I have a site where we use DocFx to build a static web site, it out puts roughly 35,000 files and with downloadable assets (zip files, etc) that equal approximately 1.2GB in size.
I would suspect a Standard application, for paying customers, should have a plan for at least 50,000 files with 5GB of space. Perhaps that just wishful thinking. 😄

Our site uses around 30000 files and is approximately 1.7 GB in size. So I would also like to see at least 3GB with a generous file limit

Hey all. Is there some sort of timeline for when we can expect the limit to be increased (both in terms of bundle size and file count)?

Hi all, thanks for the feedback on this limitation. We're working on improving our content distribution, and are looking into increases to this limit which could come out of this engineering effort.
To help us better understand how many files need to be supported, can any of you share any repos or file count ranges that you would hope to see supported by Azure Static Web Apps?

our use case is having large model exporting to HTML files with images separately (20,000+) and accessed as HTML online report, so it would be at least 30,000 files when adding other contents in the app, so please increase the limitation ASAP!

@chcomley Is there any update you could provide? Will the file count increase? And bundle size as well? Thank you

Hey folks! We definitely see the ask here, so thanks all for chiming in with feedback. We're going to be adding the file count limitation to the quota page, and we're actively working on improving our content distribution to support this use case

It's there any work around to this? Anything that we could do to reduce the amount of files, like a tool or something?

When will this be fixed please? This is a pretty non-sensical arbitrary limit which is obviously causing issues to multiple clients (for GIS apps 15000 files is way too low for our needs).

Hi @thomasgauvin, do you have an update on the work happening here? Thank you!

@thomasgauvin any updates on this please? thanks

We've heard the feedback and have been putting in the infrastructural improvements to have increased limits across the board for Static Web Apps, whether that be number of staging envs, file counts, app sizes, etc. We're still some months away from this at this time, I will continue to provide status updates in this thread.

@thomasgauvin would you have any update on this? Three months have passed by in the meantime. Thanks.

Thanks for the ping @BertVandenberghe, at this time, we're setting the investments to have a new SKU that would address this need.

We are currently closing this issue, as our feedback system is changing. For more information on our feedback systems, see https://aka.ms/ContentUserFeedback. Also, this is not an issue with the article itself and is more like a feature request. However, we can still participate in conversation within a closed issue if you want to follow up any further.
We appreciate your contributions and encourage you to propose any changes using public PRs  or submit feedback through our updated control at the top of the page, as we phase out Git Issues for this repo.
#please-close

So, several years later, no way for azure to catch up to 21st century?

Hi @thomasgauvin, any update on this? Is this new 'dedicated plan' supposed to have an increased number of files eventually? Or is there another plan coming up with more files? And when can this be expected?

authors: BertVandenberghe NoPodi SuperOfficeDevNet ajones-yondr berkus chcomley honeymustard hornta jmarti326 jmsfilipe kevin-george-ul kkankala laurekamalandua lawrenceong001 markblue777 miraj0072004 thomasgauvin wsaada19 yasenstar ytodorov

repo: Azure/static-web-apps


text:
chore: repository governance

Repository governance update
This PR was automatically created by the AVM Team hive-mind using the grept governance tool.
We have detected that some files need updating to meet the AVM governance standards.
Please review and merge with alacrity.
Grept config source: git::https://github.com/Azure/Azure-Verified-Modules-Grept.git//terraform
Thanks! The AVM team :heart:

Supersceeded by #55


text:
chore: repository governance

Repository governance update
This PR was automatically created by the AVM Team hive-mind using the grept governance tool.
We have detected that some files need updating to meet the AVM governance standards.
Please review and merge with alacrity.
Grept config source: git::https://github.com/Azure/Azure-Verified-Modules-Grept.git//terraform
Thanks! The AVM team :heart:

Supersceeded by #15

authors: lonegunmanb segraef


text:
[Bug][TCGC 0.41.4]: @clientName not work

Describe the bug
Try a TypeSpec spec including @clientName, like: https://github.com/Azure/azure-rest-api-specs/blob/2897e4040dd3d922061ae55bc002358aeaded619/specification/devcenter/DevCenter/client.tsp#L166
In the generated codes, @clientName is not honored. See this preview gen from csharp: https://github.com/Azure/azure-sdk-for-net/pull/43608
Looks like for some reason, the decorator value is not correctly saved:

Reproduction
Just try the above TypeSpec spec.
Checklist

[X] Follow our Code of Conduct
[X] Check that this issue is about the Azure libraries for typespec. For bug in the typespec language or core libraries file it in the TypeSpec repo
[X] Check that there isn't already an issue that request the same bug to avoid creating a duplicate.
[X] The provided reproduction is a minimal reproducible example of the bug.

@iscai-msft  / @tadelesh ,  could you help to resolve this with priority?  Seems it blocks our codegen to move to the latest version of TCGC.

Regression of versioning support for this issue: https://github.com/Azure/typespec-azure/issues/233. I've fixed it.

authors: archerzz lirenhe tadelesh

repo: Azure/typespec-azure


text:
Error creating cluster when no default SSH key under .ssh

Error: An RSA key file or key value must be supplied to SSH key Value. You can use --gnerate-ssh-keys to let CLI generate one for you.

Hmm, this happens if there isn't a default SSH key (id_rsa), but that should be caught by the prerequisites check.  Can you have a look in your .ssh directory and let me know what files you have in there please?

No, I don't have id_rsa there. It is better I could get the hint that I should have ssh key ready before I navigate to next step. Or give me the option to add additional parameter "--generate-ssh-keys" when I move to next step.

Yeah, it's meant to complain if you don't have the SSH key.  I'll check out why that isn't happening.
Was this AKS or ACS?

Can you check if you have both id_rsa and id_rsa.pub?  I think I've seen this error if you have the private key but not the public key.

Sorry for late response. It is AKS.
When there is no default SSH key under .ssh, could the extension create one instead of reporting errors? It will be more friendly.
I am using VS Code on Windows. The folder .ssh is under c:\user<my user name>.

@itowlson @kyliel Looks like we can use this beta feature in make use of ssh-keygen for key generation! https://blogs.msdn.microsoft.com/commandline/2018/01/22/openssh-in-windows-10/

Oh I think I already fixed this?  https://github.com/Azure/vscode-kubernetes-tools/pull/230

@itowlson yes this looks like you did do the thing

authors: bnookala itowlson kyliel

repo: Azure/vscode-kubernetes-tools


text:
IntegratedWindowsAuth example?

New to oauth, hope I'm asking the question correctly.  I feel like I'm really close but...
I registered the app in azure, and when I get a token using this code:
$scope = @("https://outlook.office365.com/.default") $msalParams = @{     ClientId = $azureClientId     TenantId = $azureTenantId      Scopes   = $scope     RedirectUri = "https://login.microsoftonline.com/common/oauth2/nativeclient" } $token = Get-MsalToken @msalParams
I'm prompted to login with an account that has access to the Exchange mailbox I'm working on.  The generated token works!! It comes back with all the assigned scopes, and I figured out how to refresh the token with -silent.  Amazing!!
I would really like to avoid the login prompt, use the "currently logged in user" (Running as a service account)
When I try with client secret, the token I get back doesn't have the scopes or IDToken properties, etc.  And that token doesn't get me to the resources I need in EWS.
I've been searching for examples but I can't find anything about how to either pass credentials to get-msalToken as a variable or somehow inherit the "windows login session token" (I'm making that term up) for the currently logged in user. I think I would use IntegratedWindowsAuth property but I don't know what I hand that property or what other fields need to be used.
Can anyone help or point me to a simple example?  Perhaps I need to change a property on the azure app registration or....
Thanks!! Fred

Thanks for the reply. Perhaps I'm missing something (forgive me I'm new to oauth so processes are not clear)
What I'm unclear about here is "creating a confidnetial client in AAD"
-I did create a ClientSecret.  But when I use client secret, I don't get the scopes back in the token.  When I try to feed the scopes to get-msaltoken, it complains they are not correct.  I try to follow suggestion putting /.default on the scope url, etc but, nothing works.  I even hand it back the scopes that come down when I login.  nadda,  The token looks entirely different.. smaller, fewer properties.
-when I login interactively, the scopes just come down with the token.
I'm sure I'm missing a key point here but, all the guides I've found seeem to assume I know the details of what I'm asking for.  Hard to be a newbie!

The only scope that works:
$scope = @("https://outlook.office365.com/.default")
Scopes from an interactive login on the token:
https://outlook.office365.com/EWS.AccessAsUser.All, https://outlook.office365.com/User.Read, https://outlook.office365.com/.default
I feed those to the get-MSALtoken as an array... it doesn't like em.  Add /.default to the end, etc as the error suggests.. no good.
But, since they come down without me specifying them, I would -hope- the same would happen with a non interactive login?
I feel so close, yet so far

When looking at the command structures, the only one that has the IntegratedWindowsAuth switch doesn't have clientsecret or cert in the parameters list.  When I try to provide them, I get error:
"Get-MsalToken: Parameter set cannot be resolved using the specified named parameters. One or more parameters issued cannot be used together or an insufficient number of parameters were provided"
So my original question was, how to get a token using current login account and I assume secret or cert?  Sorry I know I must be asking this wrong... I get excited that I get a working token but can't make the leap to the next step.  I looked up creating a confidential client in AAD and I -think- it's ok in azure.  I have the client secret value, not ID and it's in the form of a secure string.  Can't figure out where I'm missing something.
Get-MsalToken [-ClientId] <String> [-RedirectUri <Uri>] [-AzureCloudInstance ] [-TenantId <String>] [-Authority <Uri>] -IntegratedWindowsAuth  [-Scopes <String[]>] [-LoginHint <String>] [-CorrelationId <Guid>] [-ExtraQueryParameters <Hashtable>] [-ProofOfPossession <HttpRequestMessage>] [-Timeout <TimeSpan>] [<CommonParameters>]


text:
[Bug] AzureArcManagedIdentitySource looking for WWW-Authenticate response header while agent returns Www-Authenticate

Library version used
1.17.2
Java version
21
Scenario
Other - please specify
Is this a new or an existing app?
This is a new app or experiment
Issue description and reproduction steps
I am trying to log in my application running on an Azure Arc enabled Ubuntu 24.04 server. In the class AzureArcManagedIdentitySource, there is a check for existence of the WWW-Authenticate header. However, my agent returns the header without capitals: Www-Authenticate (see image).

I see the code used to check for Www-Authenticate but this changed with this commit: https://github.com/AzureAD/microsoft-authentication-library-for-java/commit/68bba5168b61726afd8ca223e70a54062ad09c01
Relevant code snippets
No response
Expected behavior
I expect my application to log in via the Azure Arc Managed Identity.
Identity provider
Microsoft Entra ID (Work and School accounts and Personal Microsoft accounts)
Regression
1.15.0
Solution and workarounds
I assume best option would be to make the check case-insensitive...

https://github.com/AzureAD/microsoft-authentication-library-for-java/pull/885

The fix for this was released as part of 1.18.0, thanks again for making the fix!

authors: Avery-Dunn blancqua

license: mit


text:
Can I use this library if I need a refresh token, or do I have to write everything from scratch

Can I use this library if I need a refresh token, or do I have to write everything from scratch
I am trying to build an email automation tool for microsoft outlook, and it seems your api only give access token. Maybe, you can add a link for those people in need of refresh token if you cannot use this library for microsoft.

@rjpruitt16 Msal v2.0 is currently in beta and will provide you with a refresh token. Please feel free to try it out and let us know what you think! Msal v1.x does not support refresh tokens as it implements the Implicit Grant Flow.

@tnorling thank you for the timely response


text:
Acquire token silently is not working

Library

[x] @azure/msal-angular@1.x.x

Description
I am using MsalInterceptor and MsalGuard to acquire token silently but it did not work.
My token id timespan in the azure b2c is 10 mins, then after 10 mins, I expect that I can get new token and keep working but could not.
Can anyone help to check my configuration?
Here is my configuration:
export function msalConfigFactory(): Configuration {
 return {
    auth: {
      clientId: 'xxx',
      authority: 'xxx',
      validateAuthority: false,
    },
    cache: {
      cacheLocation: CacheLocation.sessionStorage,
      storeAuthStateInCookie: isIE,
    },
    system: {
      logger: new Logger(msalLoggerCallback, {
        level: LogLevel.Verbose,
      }),
      tokenRenewalOffsetSeconds: 300,
    },
  };
}

export function msalAngularConfigFactory(): MsalAngularConfiguration {
  return {
    popUp: false,
    consentScopes: ['openid'],
    unprotectedResources: [],
    protectedResourceMap: [],
    extraQueryParameters: {},
  };
}

Thanks a lot.

@NhatDuy1407 What errors are you getting? Can you include logs from the MSAL logger?

I will send you soon.

Please have a look the screenshot @jo-arroyo

@NhatDuy1407 Is this error intermittent, or are you able to consistently reproduce it? Could you also provide the client-request-id from one of your requests?

Closing due to inactivity, please let us know if this is still an issue, thanks!

authors: NhatDuy1407 jasonnutter jo-arroyo


text:
Discovery calls not being cached

Core Library
MSAL Node (@azure/msal-node)
Core Library Version
1.14.2
Wrapper Library
Not Applicable
Wrapper Library Version
None
Public or Confidential Client?
Confidential
Description
When sending multiple calls to acquireTokenByClientCredential or acquireTokenOnBehalfOf in short period of time OIDC endpoint is being called for each request instead of reusing the same request.
Error Message
No response
Msal Logs
No response
MSAL Configuration
auth: {
                    clientId: clientId,
                    knownAuthorities: [authority],
                    clientCertificate: {
                        privateKey: cert.privateRSAKey,
                        thumbprint: cert.publicCER.getThumbprintHex(),
                        x5c: cert.publicCER.asPEM()
                    }
                },
                system: {
                    networkClient: this.httpModule
                }

Relevant Code Snippets
Send multiple requests on a for loop to acquireTokenByClientCredential or acquireTokenOnBehalfOf and log http requests made to OIDC

Reproduction Steps
When sending multiple calls to acquireTokenByClientCredential or acquireTokenOnBehalfOf in short period of time OIDC endpoint is being called for each request instead of reusing the same request.
Expected Behavior
One call is send to OIDC and response is reused across other calls
Identity Provider
Azure AD / MSA
Browsers Affected (Select all that apply)
None (Server)
Regression
No response
Source
Internal (Microsoft)

@hectormmg @thomas-oo @sameerag - do you have any suggestions on how to fix this ? It is common for web sites / web apis to create a confidential client app object for each request, possibly with a different tenant_id. But this leads to a lot of OIDC calls. Explicit cache might not be used.
Is it possible to cache OIDC metadata in some static variable ?

@sameerag may have more context here. We generally try to stay away from static variables, but we do leverage a sort of request cache in msal-browser that prevents multiple identical requests from being sent out to the network. Is this something we can do in-memory? In other words, if the request thumbprint matches one stored in the in-memory cache, we return the cached response instead of sending out an identical request.

It should be caching the responses for these calls within a single instance of CCA/PCA. If you're using a single instance and this isn't working it's a bug. If you're using multiple instances you can do the calls yourself and pass the resulting JSON objects into cloudDiscoveryMetadata and authorityMetadata configuration parameters.
@aleknik Can you confirm if you're reinstantiating CCA for each request?

@aleknik is creating a CCA object per request. This is a way to ensure that the cache scales. So looking more for a mechanism liek @hectormmg described or a static cache.

Large scale apps, which need to serve millions of tenants or users, cannot use a single instance of the token cache because the token cache operations are O(N). Today, we ask these apps to create 1 CCA object per request or 1 CCA object per tenant to do a "poor-man's cache partitioning". Even if we fix the cache, it's safer from threading perspective to have 1 CCA object per request.
So CCA objects need to share instance discovery and OIDC discovery between them, without developer intervention.
I see that Typescript / JS supports "static" - is there any limitation of the language or of Node to use static?

So CCA objects need to share instance discovery and OIDC discovery between them, without developer intervention.

Sure fair enough. What I'm saying though is that if this is a blocker we do have a solution that is supported today with minimal developer intervention. The "no developer intervention" bit is the part that's not supported today and would be a feature request.

I see that Typescript / JS supports "static" - is there any limitation of the language or of Node to use static?

No limitation that I'm aware of, however, we made a conscious decision not to do this sort of thing when we implemented the original instance discovery caching design. Let's maybe discuss this idea offline.

Agreed, it's a feature request.

authors: aleknik bgavrilMS hectormmg tnorling


text:
We can't set the license expiration in the custom policy

We can't set the license expiration in the custom policy.

@Kammy6679, there was time conversion error which has been fixed in https://github.com/AzureAD/rms-sdk-for-cpp/pull/45 PR.
To set expiration time please use ContentValidUntil method of PolicyDescriptor. It will work now.

We can use ContentValidUntil method is to set the content expiration. But this is not what we want.
We want to use OfflineCacheLifetimeInDays method(it is a method in RMS SDK for OS X) to set the license expiration.

@Kammy6679, @gurgenh wrote here: https://github.com/AzureAD/rms-sdk-for-cpp/issues/5:

OfflineCacheLifetimeInDays should be replaced by a boolean (OfflineAccess). The app should set whether caching is allowed or not, but it shouldn't specify or make any assumptions about the longevity of the cache.

So, now it's transformed to AllowOfflineAccess boolean variable.
Please don't close the issue. I will discuss about it one more time.

@Kammy6679, as @AgentRX noted OfflineCacheLifetimeInDays is no longer recommended. We recommend AllowOfflineAccess first, and ContentValidUntil second.
@gurgenh @munjaldoshi do you agree?

If there are further questions on this please put them in #5.

authors: AgentRX Kammy6679 joshgav

repo: AzureAD/rms-sdk-for-cpp


text:
Nether portals spawning on nether roof

Hi, I'm using version 1.0.2 on Forge 1.20.1, I registered a custom portal, but when I build, ignite and go through, it connects to the other side just fine, but spawns me on the roof of the nether, above the bedrock...
Wondering if there's something I'm doing wrong or if theres something i can do, would greatly appreciate it :)
    private void commonSetup(final FMLCommonSetupEvent event) {         CustomPortalBuilder.beginPortal()                 .frameBlock(Blocks.CRYING_OBSIDIAN)                 .lightWithItem(ModItems.LIGHTERITEM.get())                 .destDimID(new ResourceLocation("the_nether"))                 .tintColor(45, 65, 101)                 .registerPortal(); }

Looks correct, but version of Forge are you using exactly? I built against NeoForge/Forge 47.1.3, Anything newer then that will be unsupported.

Unable to recreate this in dev or prod.

authors: AzureDoom rohbust

repo: AzureDoom/customportalapi-reforged


text:
Trying to test checkpoint of a model during training process

I tried to merge Lora adapter of a model in training process, but I get this result
Loading Bunny from base model...
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Traceback (most recent call last):
File ".../Bunny/script/merge_lora_weights.py", line 26, in
merge_lora(args)
File ".../Bunny/script/merge_lora_weights.py", line 10, in merge_lora
tokenizer, model, image_processor, context_len = load_pretrained_model(model_path, args.model_base, model_name,
File ".../Bunny/bunny/model/builder.py", line 67, in load_pretrained_model
model = BunnyLlamaForCausalLM.from_pretrained(model_base, low_cpu_mem_usage=True,
File ".../.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4225, in from_pretrained
) = cls._load_pretrained_model(
File ".../.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4728, in _load_pretrained_model
new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
File ".../.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 993, in _load_state_dict_into_meta_model
set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs)
File ".../.local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 286, in set_module_tensor_to_device
raise ValueError(
ValueError: Trying to set a tensor of shape torch.Size([128256, 4096]) in "weight" (which has shape torch.Size([32000, 4096])), this looks incorrect.
$ls run_dir
checkpoint-2400
I only see the checkpoint dir,
$ls run_dir/checkpoint-2400
adapter_config.json        latest           rng_state_1.pth  special_tokens_map.json  trainer_state.json
adapter_model.safetensors  README.md        rng_state_2.pth  tokenizer_config.json    training_args.bin
global_step2400            rng_state_0.pth  scheduler.pt     tokenizer.json           zero_to_fp32.py
How to merge Lora before training finish? It take long time and I want to check if the model is ok (by checking generation) before it is done.
Setup: Llama-3
deepspeed 2 lora finetuning

Ok solved
I can just point at "bunny-lora-llama3-8b-Full-dataset-copy/checkpoint-2400"
model = AutoPeftModelForCausalLM.from_pretrained(
checkpoint_path,
device_map="auto",  # Automatically distributes the model across available GPUs/CPU
trust_remote_code=True,
torch_dtype=torch.float16
)

repo: BAAI-DCAI/Bunny


text:
Wraith 'efficient mode'

For each screen width, Wraith currently:

visits the page
waits for it to load
runs any global JS you’ve defined
runs any local JS you’ve defined
takes the screenshot

In efficient mode, Wraith could do all of the above, but instead of doing it all over again for every screen width, it would just resize to the next screen width, take the screenshot, resize, take the screenshot, etc. …should be a heck of a lot quicker!
Advantages:

significantly quicker Wraith tests

Disadvantages:

environment consistency... some bugs might not be caught. If you start off at 1500px and load the desktop assets then scale down to 300px, it might be a very different experience to loading at 300px width directly. This would probably have to be optional, e.g. resize_or_reload = 'resize', which might be at the root level of the YAML file, or at the path level.

This is a really good idea, so long as it can be toggled on/off for people who use (e.g.) HTTP client hints.
To jump on the efficiency bandwagon, we could also add support for loading pages concurrently. I'm pretty sure PhantomJS has relatively good support for this. We would need some significant changes, though: Wraith would have to push the config into the client (Phantom, Slimer, etc) and the client would be responsible for doing much of what Wraith currently does.
In a way this is a much cleaner architecture -- Wraith effectively acts as a back-end and only cares about reading configs, calculating diffs, and creating the gallery.

Implemented in 3.0

authors: ChrisBAshton wildlyinaccurate

repo: BBC-News/wraith


text:
Replace Facilitator on event

Facilitator should be replaced with a contact name and contact info for the program.

PR merged, closing issue

authors: Andersonstettner bledsoef

repo: BCStudentSoftwareDevTeam/celts


text:
Remove all occurences of endDate

Issue Description
Fixes issue #1348

End date is current a field in our database for events but it is never needed nor necessary. Remove it from the database and wherever else it appears.

Changes

Deleted endDate from the event model
Deleted all unnecessary references to endDate in the tests.
It should be noted that endDate is still necessary in some instances for event preprocessing for recurring events, but it should never make it to the database.

Testing

Checkout 1348_remove_end_data
Source setup
Reset database
Run tests
Go through event functionality like creating recurring and non recurring events, viewing events, etc. and verify nothing is breaking or working incorrectly.
Look through code and tests.

 Remove all occurrences of endDate

I created a recurring on December 3rd, with the end date being December 23th. It successfully generated three weekly events, which occur on 3rd, 10th, and 17th. However, on the edit page for each, their start date is marked as 23rd.

That inconsistency needs to be addressed.

authors: bledsoef stevensonmichel


text:
scrollToPosition not working

hi, scrollToPosition method not working for call galleryLayoutManager.scrollToPosition(position). It only works with galleryLayoutManager.attach(recyclerView, position) method.

this method can be used instead,
smoothScrollToPosition(RecyclerView recyclerView, RecyclerView.State state, int position)

repo: BCsl/GalleryLayoutManager


text:
algorithm宏包应当加选项按章编号

\usepackage[chapter]{algorithm}

手册里描述这件事。
如果没加这个选项，不给修改编号格式。
更新 BIThesis-wiki。

Relates-to: #456

由于用的人比较多，甚至可以在模板里面加一些注视

algorithm2e用得多还是algorithm+X用得多呢？

不清楚😂

repo: BITNP/BIThesis


text:
IA-2556: Webpack dev server upgrade

use newer version of Webpack dev server to improve dev
Related JIRA tickets : IA-2556
Self proofreading checklist

[ ] Did I use eslint and black formatters
[ ] Is my code clear enough and well documented
[ ] Are my typescript files well typed
[ ] New translations have been added or updated if new strings have been introduced in the frontend
[ ] My migrations file are included
[ ] Are there enough tests
[ ] Documentation has been included (for new feature)

Changes

upgrade webpack-bundle-tracker to 1.0.0-alpha.1
patch django-webpack-loader version 1.3.0 here
use patched version of webpack loader
modify script to launch dev server

How to test
Reinstall front and back and launch dev server. Check that hot reload is working
Notes
This should be merged to master and we can use the new commit hash in requirement.txt

@quang-le docker should be ok now

Pour moi sur mac m1, après avoir rebuild mes images docker et env, ça fonctionne sur localhost:8081 (pas 0.0.0.0:8081) et il faut attendre la première compilation terminée de NPM ..
For me on mac 1, after erase all my docker images and containers (except DB), and waiting for it to finish compiling successfully, it works on localhost:8081 (not 0.0.0.0:8081)

authors: beygorghor mathvdh

repo: BLSQ/iaso


text:
Javítva a #3 issue 4-es pontja

Kijavítja:

Attempts should not be made to update "const" variables

Konfliktust javítottam, így már okés, megy a merge.

authors: Sipor hellcsaba


text:
ActionController::InvalidAuthenticityToken: ActionController::InvalidAuthenticityToken

View details in Rollbar: https://rollbar.com/trystant/BOW/items/448/

ActionController::InvalidAuthenticityToken: ActionController::InvalidAuthenticityToken
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/request_forgery_protection.rb", line 181, in handle_unverified_request
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/request_forgery_protection.rb", line 209, in handle_unverified_request
  File "/app/vendor/bundle/ruby/2.3.0/gems/devise-3.5.6/lib/devise/controllers/helpers.rb", line 257, in handle_unverified_request
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/request_forgery_protection.rb", line 204, in verify_authenticity_token
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 432, in block in make_lambda
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 164, in block in halting
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 504, in block in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 504, in each
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 504, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 92, in __run_callbacks__
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 778, in _run_process_action_callbacks
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 81, in run_callbacks
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/abstract_controller/callbacks.rb", line 19, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/rescue.rb", line 29, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/instrumentation.rb", line 32, in block in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/notifications.rb", line 164, in block in instrument
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/notifications/instrumenter.rb", line 20, in instrument
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/notifications.rb", line 164, in instrument
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/instrumentation.rb", line 30, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/params_wrapper.rb", line 250, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/searchkick-1.2.1/lib/searchkick/logging.rb", line 153, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/activerecord-4.2.6/lib/active_record/railties/controller_runtime.rb", line 18, in process_action
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/abstract_controller/base.rb", line 137, in process
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionview-4.2.6/lib/action_view/rendering.rb", line 30, in process
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal.rb", line 196, in dispatch
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal/rack_delegation.rb", line 13, in dispatch
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_controller/metal.rb", line 237, in block in action
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/routing/route_set.rb", line 74, in dispatch
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/routing/route_set.rb", line 43, in serve
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/routing/mapper.rb", line 49, in serve
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/journey/router.rb", line 43, in block in serve
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/journey/router.rb", line 30, in each
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/journey/router.rb", line 30, in serve
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/routing/route_set.rb", line 817, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-pjax-0.8.0/lib/rack/pjax.rb", line 12, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-attack-4.4.1/lib/rack/attack.rb", line 107, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/bullet-5.0.0/lib/bullet/rack.rb", line 10, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb", line 35, in block in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb", line 34, in catch
  File "/app/vendor/bundle/ruby/2.3.0/gems/warden-1.2.6/lib/warden/manager.rb", line 34, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-1.6.4/lib/rack/etag.rb", line 24, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-1.6.4/lib/rack/conditionalget.rb", line 38, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-1.6.4/lib/rack/head.rb", line 13, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/remotipart-1.2.1/lib/remotipart/middleware.rb", line 27, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/middleware/params_parser.rb", line 27, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/middleware/flash.rb", line 260, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-1.6.4/lib/rack/session/abstract/id.rb", line 225, in context
  File "/app/vendor/bundle/ruby/2.3.0/gems/rack-1.6.4/lib/rack/session/abstract/id.rb", line 220, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/middleware/cookies.rb", line 560, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/activerecord-4.2.6/lib/active_record/query_cache.rb", line 36, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/activerecord-4.2.6/lib/active_record/connection_adapters/abstract/connection_pool.rb", line 653, in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/middleware/callbacks.rb", line 29, in block in call
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 88, in __run_callbacks__
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 778, in _run_call_callbacks
  File "/app/vendor/bundle/ruby/2.3.0/gems/activesupport-4.2.6/lib/active_support/callbacks.rb", line 81, in run_callbacks
  File "/app/vendor/bundle/ruby/2.3.0/gems/actionpack-4.2.6/lib/action_dispatch/midd

AFAICT, this means that this is working as planned.

repo: BOWiki/BOW


text:
ViT模型验证时要求数据集必须有训练集和验证集不太合理

Describe the bug
在使用ViT基于Imagenet2012数据集进行模型验证时，因为数据集比较大，仅下载了验证数据集。执行模型验证命令，报错，提示没有训练集数据。
经排查，
main_single_gpu.py 在进行模型验证前，需要先加载训练集和验证集。
建议单独增加一个模型验证的脚本。

Thanks for the issue!
Yes, that is a real problem if someone only needs to run the validation without touching the training data.
I will fix this and update the code as soon as possible!

Describe the bug 在使用ViT基于Imagenet2012数据集进行模型验证时，因为数据集比较大，仅下载了验证数据集。执行模型验证命令，报错，提示没有训练集数据。
经排查， main_single_gpu.py 在进行模型验证前，需要先加载训练集和验证集。
建议单独增加一个模型验证的脚本。

你的建议非常重要

@xnli This issue has been fixed in ViT, will update to other models asap.
Please see commit 9a7c105 for detailed changes.
I will start a new issue to update other main scripts, so I close this issue

authors: lmk123568 xnli xperzy

repo: BR-IDL/PaddleViT


text:
Is that possible to add a new metric in the GUI ?

In GitLab by @acarreri on Dec 13, 2021, 15:34
Hi @wuruchi,
I'm sorry to ask something that may be useful only for me (totally egoistic request)...
Is that possible to add the "SBU" metric also in the GUI performance page, when the experiment is running on cca?
I don't know if the future machine will use also this metric: @etourign @mcastril ? If not, I shouldn't ask to add this feature. If yes, maybe it can be useful for others?
Thanks
Aude

In GitLab by @acarreri on Dec 13, 2021, 17:00
Hi @wuruchi ,
You can find this metric in the .out files of SIM jobs, such as: /esarchive/autosubmit/a459/tmp/LOG_a459/a459_19600101_fc03_12_SIM.20211213051756.out almost at the end, line 12389:
## INFO SBU                       : 189595.759808 units

Let me know if you need something else.
Aude

In GitLab by @wuruchi on Dec 14, 2021, 10:38
Hello @acarreri
I can see the result in the file but I am not sure about the formula to calculate that metric. From what I understand, it is related to the CPU hours metric.

In GitLab by @mcastril on Dec 13, 2021, 17:15
We take all the information from calls to the scheduler and the job information that Autosubmit provides.

As @acarreri says in the description, I think that we first should know if they will keep this metric in the new Atos cluster before implementing it.
If they continue using it, then it surely will be easier to get it from the scheduler, because they will implement Slurm.

In GitLab by @etourign on Dec 13, 2021, 16:40
@acarreri please point him to a SIM*.out job and point out where the SBU is located towards the end of the file.

In GitLab by @etourign on Dec 13, 2021, 16:23
in principle we can compute SBU from CPUh (the ratio is around 17, there is an ECMWF page for that). But it's interesting to get the real usages for the job.

In GitLab by @wuruchi on Dec 13, 2021, 16:38
Hello @acarreri @etourign
I don't know much about that metric SBU, but if you provide a definition and if we have the data available, then it can be added.

In GitLab by @mcastril on Dec 14, 2021, 10:44
@wuruchi it can be directly calculated from the CHPSY. But they wanted to know the real value, and it only appears in the file epilog, I think.
That's why I preferred to wait to see if we can get the real value from the scheduler in the next platform.
In the meantime, I would suggest that users apply the formula to the CHPSY value provided in the Performance tab. If you find big deviations between the SBU's and the calculated value, please tell us.

In GitLab by @dbeltran on Apr 27, 2023, 09:49
Maybe @jberlin should look at this? and moved to autosubmit GUI project ( or API )

In GitLab by @etourign on Dec 14, 2021, 11:18
SBU can be computed from CHPSY, as long as you use CHPSY from the scheduler and not from the SIM.out log which only includes the time the model has run.  The link above is the correct one : 16.11 for CCA/CCB and for ATOS the ratio will be 18.84 .

In GitLab by @acarreri on Dec 14, 2021, 11:11
I found this page on ecmwf: https://confluence.ecmwf.int/display/UDOC/HPC+accounting, mentioning:
A serial job using 1 hour (3600 seconds) of elapsed time will be charged about 16.11 SBU.

I will use this value to compare.
They say also that it will be a similar formula with the new ATOS machine.

In GitLab by @mcastril on Dec 14, 2021, 12:40
What I was suggesting is to take the CHPSY value given by the GUI (that measures the cost of the full job) and from there calculate the SBUs.
From CHPSY you can obtain the cost (by multiplying by the simulated time) and from there get the SBUs.

In GitLab by @dbeltran on Mar 2, 2023, 09:00
Not sure of the status of this one, but it should be moved to the Autosubmit GUI project @mcastril

In GitLab by @mcastril on Dec 14, 2021, 17:31
I'll explain it better:
The absolute cost is the cost per year by the number of simulated years
CHSY * Y = CH
According to the documentation, 1 CH is 16.11 SBU
so CHSY * Y * 16.11 = SBU

In GitLab by @mcastril on Apr 7, 2022, 10:50
unassigned @wuruchi

In GitLab by @acarreri on Dec 14, 2021, 11:31
I don't know where to find this value from the scheduler. Is that the one that the GUI shows? Where can I find the information?

In GitLab by @dbeltran on May 29, 2023, 09:18
I moved this one to the gui

In GitLab by @dbeltran on Dec 13, 2021, 15:34
moved from autosubmit#761

repo: BSC-ES/autosubmit-gui


text:
Depth peeling - WIP for review

This Playground is what I was using locally to work on this. It's an example of how to use depth peeling to blend many layers using simple alpha-blending (i.e. opacity).
Of course, it won't work without the code in this PR.
https://playground.babylonjs.com/#4N8PQJ

We already have #10659 regarding depth peeling, so I'm not quite sure how we should handle the current PR. @sebavan / @deltakosh ?
As I can see it, #10659 is more integrated into the core whereas the current PR is more lightweight but requires the user to do a bit of work.

The intent of this PR was to provide a simple way to do depth peeling. The user is then free to use it how they wish. My Playground example shows how you could use it to do under-blending of many alpha layers. However, this is NOT how I'm most interested in using it and we should be careful that Babylon's implementation doesn't only provide this.
In PBR, transmission involves reflection, absorption, scattering, dispersion, etc. so simple alpha blending is not sufficient and doesn't have many real-world analogs (maybe porous, non-reflective materials like gauze or burlap). In the past, I had implemented what I called "deferred transparency" in Babylon (this branch) where each depth-peeled layer was output in a g-buffer containing the relevant information needed to composite the scene back together and account for absorption, scattering, refraction, reflection, etc. My intent with this PR was to start the process of re-implementing this and getting the necessary pieces back into the core Babylon. As it is, I've had to abandon my old code in order to update our viewer to the latest Babylon and I want to avoid that in the future.
As for the rendering differences between the two PR's, I don't know for sure. My method renders 5 layers (you can change this in the Playground, of course) and renders from front to back, using "under" blending (instead of the usual "over" blending). I wouldn't risk much money betting that mine is more "correct" but it does look better, in my eyes.

If I compare with a rendering without OIT in a camera position where the green sphere is drawn before the red sphere (as the green sphere is inside the red sphere) I get:

Without OIT (green before red)
#10659
this PR

It's more in line with #10659 (it's not exactly the same rendering because of the back faces that are not drawn in the right order in the first screenshot).
In your PR, the green sphere does not look like being inside the red sphere to my eyes. The rendering of this green sphere is not unlike the one we get when not doing OIT but having the green sphere displayed after the red one:

Without OIT (green after red)
this PR

Ah, I misread your previous post and thought that the incorrect rendering was coming from #10659. I agree that the rendering from this PR looks wrong. I probably have the wrong blend equation setup.
However, it's not really that important for this PR since the playground project isn't part of the PR. What I'm trying to do is provide a way to do depth peeling and use the results of it in further rendering. Having a simple, integrated way to do OIT alpha blending as in #10659 is great but it's not what I need.

Hey @MiiBond, may I ask how you intent to use it ? is it mostly for OIT or do you have any other use ? I am wondering how to leverage @CraigFeldspar PR to provide you with the thing you need so that we do not have 2 Depth peeling features in the Framework ?

I'm using it for OIT but I need control over the passes and blending. I use the depth peel layers to render out MRT's from the PBR uber shader for each layer (basically a series of g-buffers). I then composite those MRT's together, computing things like absorption, refraction, dispersion, etc.
I had implemented this all a couple of years ago but wanted to redo it in a newer version of Babylon and in a way that was more future proof as Babylon gets updated. I had so many hacks and changes in pbr.fragment.fx that it just wasn't going to be doable to merge.

@CraigFeldspar is it something we could somehow control from the pre pass ?

authors: MiiBond Popov72 sebavan


text:
Move type out of import clause

TypeScript 4.5 introduces inline type imports. But for anyone who uses typescript < 4.5 the build will fail.
There is no lint rule to disallow that, as it is a perfectly correct syntax. I will keep on checking for that.

Please make sure to label your PR with "bug", "new feature" or "breaking change" label(s).
To prevent this PR from going to the changelog marked it with the "skip changelog" label.

Snapshot stored with reference name:
refs/pull/14459/merge
Test environment:
https://babylonsnapshots.z22.web.core.windows.net/refs/pull/14459/merge/index.html
To test a playground add it to the URL, for example:
https://babylonsnapshots.z22.web.core.windows.net/refs/pull/14459/merge/index.html#WGZLGJ#4600
Links to test babylon tools with this snapshot:
https://playground.babylonjs.com/?snapshot=refs/pull/14459/merge
https://sandbox.babylonjs.com/?snapshot=refs/pull/14459/merge
https://gui.babylonjs.com/?snapshot=refs/pull/14459/merge
https://nme.babylonjs.com/?snapshot=refs/pull/14459/merge
To test the snapshot in the playground with a playground ID add it after the snapshot query string:
https://playground.babylonjs.com/?snapshot=refs/pull/14459/merge#BCU1XR#0

There is no lint rule to disallow that, as it is a perfectly correct syntax. I will keep on checking for that.

Would be great even if it is a custom one we add as I am pretty sure we will soon reintroduce it otherwise.

authors: RaananW bjsplat sebavan


text:
Feedback (/about-us) - resolve design feedback

Tasks

[ ] Make the background black (#000000)
[ ] background gradient, can be an SVG if CSS isnt doing justice
[ ] (WANT ALPHA ?) was ommitted
[ ] image & GIF cards have a bordr radius of 10px
[ ] DAO flag is a GIF also, do let us know if you need to get this assets.
[ ] Wrong video was used on the About Us page, do let us know for the video

Design feedback doc
https://docs.google.com/document/d/16rgUYfjsiRM338j70WWRnDX3tj6UM7ZMs-B88NGwGyg/edit

[ ] Mobile break points are broken. example look at 1000 width screen
[ ] Subpages not responsive at lower screen sizes
[ ] Title is not responsive to lower screen sizes

repo: BanklessDAO/bankless-website


text:
🛑 Executive and Indigenous Affairs is down

In d949bcf, Executive and Indigenous Affairs (https://www.eia.gov.nt.ca) was down:

HTTP code: 503
Response time: 10016 ms

Resolved: Executive and Indigenous Affairs is back up in 090e8cb after 10 minutes.

repo: Barctic/gnwt-monitor


text:
🛑 Executive and Indigenous Affairs is down

In f542457, Executive and Indigenous Affairs (https://www.eia.gov.nt.ca) was down:

HTTP code: 504
Response time: 307 ms

Resolved: Executive and Indigenous Affairs is back up in 0bebf8a after 8 minutes.


text:
🛑 Finance is down

In 1e0e47a, Finance (https://www.fin.gov.nt.ca) was down:

HTTP code: 503
Response time: 10015 ms

Resolved: Finance is back up in b23b6f9 after 8 minutes.


text:
TravisCI environment downgrade

This commit forces the TravisCI environment back to its state before
the last environment upgrade happened. This does not fix compatilibility with
clang 5, but instead provides a temporary workaround for failing CI
builds.
[BUG] #557 - clang 5 vmm link error
Signed-off-by: JaredWright jared.wright12@gmail.com

Although this fixes the issue, it doesn't fix the actual problem. In Travis CI, we are defining clang-4.0, but if you look at the build, it is using clang 5.0. We should be more explicit about what compile we want to use. If we state 4.0, it should use 4.0.
I'm going to close this issue as I'd like to the underlying issue resolved instead.

authors: JaredWright rianquinn

repo: Bareflank/hypervisor


text:
🛑 QBitTorrent webUI is down

In 19a8fbf, QBitTorrent webUI (https://qbittorrent.jonthan.xyz) was down:

HTTP code: 404
Response time: 614 ms

Resolved: QBitTorrent webUI is back up in 174f0c6 after 6 minutes.

repo: Baronhez/upptime


text:
🛑 QBitTorrent webUI is down

In be917fd, QBitTorrent webUI (https://qbittorrent.local.jonthan.xyz) was down:

HTTP code: 404
Response time: 588 ms

Resolved: QBitTorrent webUI is back up in f97606e after 6 minutes.


text:
Running report Error: Rscript ENONENT

When trying to run uploaded R scripts I'm getting Error: spawn Rscript Enoent.
syscall:'spawn Rscript'
My upload path is fine something to do with the RscriptExecutable in the user.config?

I presume that the RscriptExecutablevalue is still Rscript?
What happens when you call Rscript from the terminal? Does it run? If not, make sure Rscript is on the PATH.

Hi,
Yes the RscriptExecutable is still the default of "Rscript".
No when i call Rscript from power shell terminal it doesn't run :( but the path is Rscript.

Duhh I'm new to this...got to set the path for where the Rscript executable is located.
"RscriptExecutable": "C:\Program Files\R\R-3.2.0\bin\x64"

What about when running markdowns...
Error: self signed certificate in certificate chain?
I can feel I'm so close to getting full funtionality ;)

What happens when you open a console and enter Rscript? If you get an 'not found'-like error, Rscript's directory is not in the PATH variable.

I've added Rscript to the path variable which is "C:\Users\name\AppData\Roaming\npm"
I've also added it to the root directory I'm running ScheduleR out of.
I can get the task running now but still getting the Self_signed_cert_in_chain error.

You should definitely not start copying the Rscript executable (which is what I understand from your comment).
Please open up a console windows, type echo %path% and let me know what the output is. Next, in the same console window, type Rscript and let me know what the output is.

Opening cmd and typing echo %path% gives...

And your right typing Rscript shows "system cannot find the path specified"

Ok sorted add R\R-3.2.0\bin to the path and now refer to the environment variable in the configuration json. Typing Rscript in the console now runs Rscript. However still getting self signed certificate error.

what is now the value of the RscriptExecutable in the user.config.json?

Simply "Rscript" now.

hmm getting closer, but can't really place the certificate thing. can you try to schedule the test_rmd_html.Rmd file in the /examples folder to see what that gives?

thanks for your help! getting very close now!
I've scheduled test_rmd_html.Rmd and I now get  "The system cannot find the path specified." but running Rscript from the terminal works i.e. its in the path variable.

did you specify the uploadDir in the user.config.json?

Yeah i just created a folder in the working directory called uploads and they go in there :)

is pandoc installed?

I thought it was an optional dependency but I have installed it now..is there any other setup I need for pandoc?

closing; old issue


text:
Add Yidi Sprei Personality Plugin

Description:
This pull request adds the "Yidi Sprei" personality plugin to the platform. This plugin embodies the personality of Yidi Sprei, a 22-year-old software developer, and founder of Infuzu, with a conversational style that is sarcastic, playful, and honest. The plugin will allow users to engage in a conversational style that reflects Yidi's personality and background.
Key Features:

Name: Yidi Sprei
Author: Infuzu.com
Description: Personality of Yidi Sprei, embodying a sarcastic, playful, and sincere conversational style.
Capabilities: chat
Personality Traits:

22-year-old software developer and founder of Infuzu (AI aggregator for healthcare compliance).
Former co-founder of Civil Discourse, a project focused on reducing political divisiveness.
Youngest Instructor Trainer for the American Red Cross in almost all programs.
Graduated from the University at Albany with a BA in Political Science (May 2023).
Grew up in Brooklyn, NY.
Conversational style is sarcastic and playful but with honest and logical advice.
Enjoys wearing crocs, dislikes societal norms, and owns a cat named Phoenix.

Why This Plugin:
This plugin brings a unique personality to the platform that is both fun and logical, appealing to users who appreciate witty banter, sarcasm, and straightforward advice. Yidi's diverse experiences from running a startup to working in healthcare and politics make this personality plugin versatile for various interactions.
Example Interaction:
When engaged, the plugin responds in a sarcastic but honest manner, offering logical advice based on the user's inquiries, with references to Yidi's work, love for crocs, and background in Brooklyn.
Notes:

Added the plugin configuration following the standard format.
Included an image for the plugin's logo.

Summary by CodeRabbit

New Features

Introduced a new plugin, "Yidi Sprei," featuring a playful and sarcastic personality for enhanced chat interactions.

Bug Fixes

Removed outdated plugins: "psychologist" and "news-checker" to streamline the available options.

lgtm @infuzu-yidisprei 🥳

authors: beastoin infuzu-yidisprei

repo: BasedHardware/omi