text:
Azure storage does not support concatenation

Technical Knowledge of User
I'm new to using tusd and the tus-js-client, so I'll be happy if anybody can point out any problems in my setup for testing.
Describe the bug
While running tusd with an Azure Storage backend, I found that the transfer would always fail on the last HTTP POST with a missing or invalid Upload-Length header. This only occurs when parallel upload (connections) are set to at least 2.

Tested with the demo client included in tus-js-client and a nodejs client using tus-js-client.

Snippet of tusd logs during the end of a transfer:
[tusd] 2022/10/31 04:54:05.053405 event="ResponseOutgoing" status="201" method="POST" path="" requestId="" body=""
[tusd] 2022/10/31 04:54:05.063695 event="RequestIncoming" method="PATCH" path="14ef5595737703227cbbe4c006cc7920" requestId=""
[tusd] 2022/10/31 04:54:05.064181 event="RequestIncoming" method="PATCH" path="9d5eb446624ade5a25d719f07865fdd8" requestId=""
[tusd] 2022/10/31 04:54:05.105852 event="ChunkWriteStart" id="9d5eb446624ade5a25d719f07865fdd8" maxSize="57738292" offset="0"
[tusd] 2022/10/31 04:54:05.107953 event="ChunkWriteStart" id="14ef5595737703227cbbe4c006cc7920" maxSize="57738292" offset="0"
[tusd] 2022/10/31 04:54:13.957541 event="ChunkWriteComplete" id="14ef5595737703227cbbe4c006cc7920" bytesWritten="57738292"
[tusd] 2022/10/31 04:54:13.976012 event="ResponseOutgoing" status="204" method="PATCH" path="14ef5595737703227cbbe4c006cc7920" requestId="" body=""
[tusd] 2022/10/31 04:54:13.976043 event="UploadFinished" id="14ef5595737703227cbbe4c006cc7920" size="57738292"
[tusd] 2022/10/31 04:54:17.708767 event="ChunkWriteComplete" id="9d5eb446624ade5a25d719f07865fdd8" bytesWritten="57738292"
[tusd] 2022/10/31 04:54:17.740995 event="ResponseOutgoing" status="204" method="PATCH" path="9d5eb446624ade5a25d719f07865fdd8" requestId="" body=""
[tusd] 2022/10/31 04:54:17.741020 event="UploadFinished" id="9d5eb446624ade5a25d719f07865fdd8" size="57738292"
[tusd] 2022/10/31 04:54:17.742362 event="RequestIncoming" method="POST" path="" requestId=""
[tusd] 2022/10/31 04:54:17.742385 event="ResponseOutgoing" status="400" method="POST" path="" requestId="" body="ERR_INVALID_UPLOAD_LENGTH: missing or invalid Upload-Length header

Client side NodeJS using tus-js-client
0 115476584 0.00%
0 115476584 0.00%
65536 115476584 0.06%
131072 115476584 0.11%
31260672 115476584 27.07%
63569920 115476584 55.05%
90113076 115476584 78.04%
115476584 115476584 100.00%
Failed because: Error: tus: unexpected response while creating upload, originated from request (method: POST, url: http://127.0.0.1:47280/files/, response code: 400, response text: ERR_INVALID_UPLOAD_LENGTH: missing or invalid Upload-Length header
, request id: n/a)

To Reproduce
Steps to reproduce the behavior:

Start up tusd server with Azure backend storage.
podman run -p 47280:47280 -v /tmp/host/tus:/srv/ --env AZURE_STORAGE_ACCOUNT=<storage account name> --env AZURE_STORAGE_KEY=<azure storage key> docker.io/tusproject/tusd:v1.10.0 -port=47280 -azure-blob-access-tier=hot -azure-object-prefix=tus-prefix -azure-storage=tus-file-container -azure-endpoint=https://<storage account name>.blob.core.windows.net
Run the client demo or a nodejs client, set the parallel upload to 2.
Upload a file.
Watch the last POST message fail, and the file fail to combine - even though all the parts has been successfully sent.

Expected behavior
I expect parallel uploads to work.
Setup details
Please provide following details, if applicable to your situation:

Operating System: Linux (Ubuntu 22.04 LTS) and the docker image OS is running for tus
Used tusd version: Tried both tusd:v1.10.0 and tusd:2.0.0rc17
Used tusd data storage: Azure Storage
Used tusd configuration:  -port=47280 -azure-blob-access-tier=hot -azure-object-prefix=tus-prefix -azure-storage=tus-file-container -azure-endpoint=https://<storage account name>.blob.core.windows.net
Used tus client library: tus-js-client using nodejs and the tus-js-client demo

NodeJS client code
const fs = require('fs');
const tus = require("tus-js-client");

const path = "file.txt"
const file = fs.createReadStream(path)

const upload = new tus.Upload(file, {
  endpoint: 'http://127.0.0.1:47280/files/',
  parallelUploads: 2,

  // Callback for errors which cannot be fixed using retries
  onError: function(error) {
    console.log("Failed because: " + error)
  },

  // Callback for reporting upload progress
  onProgress: function(bytesUploaded, bytesTotal) {
    const percentage = (bytesUploaded / bytesTotal * 100).toFixed(2)
    console.log(bytesUploaded, bytesTotal, percentage + "%")
  },

  // Callback for once the upload is completed
  onSuccess: function() {
    console.log("Download %s from %s", upload.file.name, upload.url)
  }
});

// Check if there are any previous uploads to continue.
upload.findPreviousUploads()
  .then((previousUploads) => {

    // Found previous uploads so we select the first one.
    if (previousUploads.length) {
      upload.resumeFromPreviousUpload(previousUploads[0])
    }

    // Start the upload
    upload.start()
})

Ah, can't tell if this is a bug or if this requires an feature request.
I noticed that tusd with Azure backend do not support the concatenation extension:
[tusd] 2022/10/31 21:38:36.132883 Supported tus extensions: creation,creation-with-upload,termination,creation-defer-length

I noticed that tusd with Azure backend do not support the concatenation extension

Exactly! The azurestore does not yet support this extension, so parallelUploads from tus-js-client cannot be used with azurestore. I do not know who much effort it would be to implement this. Maybe @omBratteng knows more about this?

I was looking at implementing it, but I was a bit unsure how to exactly do it. Theoretically, you could upload the chunks in any order you'd like, as long as you know their original order before you commit the blob. So I chose to not implement it at the time.

I'm not sure if that is possible? @Acconut?
Perhaps it's something to consider for the v2 spec? Where the client pre-determines the list of chunks?

I am not sure I understand the question fully. Are you looking for a way to tell the server, which chunks will be concatenated, before a single chunk is uploaded? Because right now, we do the reverse: first upload the chunks and then tell the sever in which order to concatenate them.

I'm not sure if that is possible? @Acconut?
Perhaps it's something to consider for the v2 spec? Where the client pre-determines the list of chunks?

I am not sure I understand the question fully. Are you looking for a way to tell the server, which chunks will be concatenated, before a single chunk is uploaded? Because right now, we do the reverse: first upload the chunks and then tell the sever in which order to concatenate them.

Shouldn't in in that case not already work to just push the file chunks in parallel (allowing parallelUploads) and 'comitting' by telling Azure how to concatenate the chunks (from 1 specific file if completed)?
For my use case related to this is how easy would it be to run tusd (in combination with the tus-js-client) to support multiple HTTP channels? I noticed that locally you can easily reach speeds to 100+ MBps but as soon as you try to reach Azure production it caps at 15MBps even though my local bandwith is in the range of 100 MBps

Shouldn't in in that case not already work to just push the file chunks in parallel (allowing parallelUploads) and 'comitting' by telling Azure how to concatenate the chunks (from 1 specific file if completed)?

I have no experience with Azure, but the procedure you described is exactly how it is performed for S3 and GCS. I don't know Azure's APIs but I assume it would work similarly, yes.

Because right now, we do the reverse: first upload the chunks and then tell the sever in which order to concatenate them.

Does the client know which order it uploaded the chunks in?
I haven't looked in any detail of tus-js-client, as our uploader was already created. But as I am refactoring our entire uploader, I will probably know more myself.

Does the client know which order it uploaded the chunks in?

The order should not matter in this way. Chunks might be uploaded in parallel, so there is no order of time. However, the client knows in which order the chunks should be concatenated and tells this order to the server in the POST request for the concatenation. Does this make sense? If not, I believe we are talking about different things here.

I think I understand. And I think I need to do some testing/debugging to fully understand in the concept of how Azure Blob Storage does it.
Could you link to where in the js client it tells the server the order of chunks to concatenate?

Sure, the entire relevant code for parallel uploads and concatenation is at https://github.com/tus/tus-js-client/blob/a456406f8e4232db416705952da5ef49a661c7ef/lib/upload.js#L255-L364.
It begins by slicing the entire file into multiple parts and uploading each part concurrently. Once the upload URL is available for a single part, it is stored in an array while preserving the positions of the part in the entire file: https://github.com/tus/tus-js-client/blob/a456406f8e4232db416705952da5ef49a661c7ef/lib/upload.js#L315
Finally, these URLs are POSTed to the tus server for concatentation: https://github.com/tus/tus-js-client/blob/a456406f8e4232db416705952da5ef49a661c7ef/lib/upload.js#L335-L336

That's great. Is there also a method to list these blocks? If so, a lot of code from the s3store could be reused for this.

That's great. Is there also a method to list these blocks? If so, a lot of code from the s3store could be reused for this.

Yes, there is.
https://learn.microsoft.com/en-us/javascript/api/@azure/storage-blob/blockblobclient?view=azure-node-latest#@azure-storage-blob-blockblobclient-getblocklist

Great! In that case, it seems easy to implement a similar function for concatenation as already exists in the s3store: https://github.com/tus/tusd/blob/9cf626bf0ca5109815450eac49d8ea34072edc3e/pkg/s3store/s3store.go#L695-L819 It has two methods for concatenation because S3 has some quirks with small parts, so maybe it would be simpler for Azure.
However, I think this could be implemented easily. Let me know if someone is interested in doing so :)

I guess I could take a run at it, but I can't promise any timeframe as I am a bit busy with selling my apartment and moving at the moment.

No worries, good luck with your move!

Hi, I was wondering if there was any follow-up discussion behind the scenes on concat with azure?

Every discussion on this topic has happened in this issue, so there is nothing hidden from the public :) We all agree that we would like to accept support for concatenation in the Azure storage. Somebody just needs to have the time to implement it. Let me know if you are interested in doing so!

I don't have to much go experience, but am busy implementing it right now.  I don't think the code will be near good enough to make a PR, but if somebody that is more familiar with the code base wants to have a look that would be great.
That being said, here is the current branch that is working so far.
https://github.com/LeftOfHere/tusd/tree/feature/azure-concat
By that I mean if I upload an image in chunks it gets combined and the image still works as an image.
Only been able to test it on smallish files, ~20MB, and on my local machine, but will be pushing this to my staging k8s deployment to see how it handles large files in terms of memory usage.
And here is the changes so far.
https://github.com/LeftOfHere/tusd/commit/957b07750512ffbdf57d05a62bac7c898645b16b

authors: Acconut LeftOfHere OlafHaalstra abdulmomin703 boris-ning-usds omBratteng sebasptsch

repo: tus/tusd


text:
How get json in OnFileComplete event

Hi !
I would like to know how I can get an address in the metadata of the file.
Currently I'm trying like this:
var dataJson = metadataDict ["datajson"]. GetString (Encoding.UTF8);
but the return is a string "[object object]"
Thank you !

Sounds like an encoding error from the client.  "[object object]" is what you get if you do obj.toString() in JavaScript instead of JSON encoding (using JSON.stringify).

Did you manage to solve this issue?

No answer for 6 days. Closing due to inactivity.

source: gharchive/issue

authors: guiraamos smatsson

repo: tusdotnet/tusdotnet

license: mit

license_type: permissive

license_source: bigquery


text:
"DetectionCfg" problem  in Argo2Dataset

Hello. I've been testing your model on av2.
But I have a problem DetectionCFG which is in "mmdet3d>datasets>argo2_dataset.py>Argo2Dataset line 481".
DetectionCfg in latest av2 library might has no "split" argument I think ...
Probably, I think this is the library version problem.
So Can I ask What version is your av2 libary?

My av2 version is 0.1.0.. Some users use 0.2.0.

I think that I can recover performances by deleting the below line in argo==0.2.0
https://github.com/tusen-ai/SST/blob/a42fcab3d5827492c95721b50c3871d47aa30335/mmdet3d/datasets/argo2_dataset.py#L481
Below  is the result that I tested

Thanks for reminding me! Glad to see that!

repo: tusen-ai/SST

license_source: github-api


text:
Datatable Filter element in children

TuSimple/naive-ui version (版本)
2.31.0
Vue version (Vue 版本)
3.2.37
Browser and its version (浏览器及其版本)
Firefox(102.0)
System and its version (系统及其版本)
Windows10
Node version (Node 版本)
Reappearance link (重现链接)
https://codesandbox.io/s/mystifying-monad-0u29kk?file=/src/Demo.vue
Reappearance steps (重现步骤)
In the datatable, filter by percent and it doesnt work
Expected results (期望的结果)
Filter data
Actual results (实际的结果)
Return empty array
Remarks (补充说明)

I'm curious what you guys think about the correct behavior here.

All parents, i.e., the direct parent, the grandparent, etc., should be kept no matter whether their values satisfy the filter or not
Like the above one, but only the direct parent should be kept
Only the satisfied child should be kept

I'm curious what you guys think about the correct behavior here.

All parents, i.e., the direct parent, the grandparent, etc., should be kept no matter whether their values satisfy the filter or not
Like the above one, but only the direct parent should be kept
Only the satisfied child should be kept

I think we should provide different modes. Keep current behavior & filter children in mode 3.

This issue does not have any recent activity. If you are still experiencing similar problems, open a new error, including a minimal copy of the problem

authors: 07akioni OlivierLB equt jahnli

repo: tusen-ai/naive-ui

license: MIT


text:
UI

Future Prospects
Preferably develop a UI with inputs, post which the plots will be generated and displayed.

alright

@Zenith053 please give me an outline of how you're going to build the UI after which i'll assign you the issue. Most preferably i'll be making a project out of this for better development flow.


text:
Invalid index at line 124

My debugger is occasionally reporting an invalid index error in recaptchalib.php at line 124. I recommend the following change.
Replace:
$recaptchaResponse->errorCodes = $answers['error-codes'];
With:
if (array_key_exists('error-codes', $answers) === true) {     $recaptchaResponse->errorCodes = $answers['error-codes']; }

Thank you


text:
Neurons Decay membrane potential on a timer not on ticks

The Neuron.prototype.decay function isn't used and neurons only decay based on the decay function which use a timer. Need to make this depend on a tick based clock. Proposing this change where if a neuron doesn't receive a signal then it decays using the decay function:

Neuron.prototype.decay = function(){
	this.acc = 0.9 * this.acc;
	if (this.acc < 0)
		this.acc = 0;
}
Neuron.prototype.fireIfCan = function(neuralNet, currentTime)
{
	var ret = [false, null];
	if (this.willFire())
	{
		if (this.receivedSignal) {
			var astrocyte = this.astrocyteWithEnergy();
			if (astrocyte != null) { // Astrocyte mode
				var prevacc = this.acc;
				this.fire();
				ret = [true, prevacc]
				astrocyte.deplete();
				this.lastSignalRelease = currentTime;
				neuralNet.releaseSignalAt(this);
			} else {
				ret = [false, this.astrocyte.availableEnergy];
			}
			this.receivedSignal = false; // if neuron received signal but still in delay reset it
		} else {
			this.decay();
		}
	}
	return ret;
}

I think this is much better than the timer.

One question I have is setting the decay rate. This is set to 0.9, but will be that way regardless of the amount of time one tick represents. Do we want to set it to something relative to the time of one tick? For example we want ticks to be at 1ms but want it to decay to 0.9*acc at 10ms. So we have a decay rate of 0.1 per 10 ms with 1ms update ticks.  So we should calculate decay to be 1 - (decay_rate/(decay_time/update_time) = 1 - (0.1/(10/1)) = 1 - 0.01 = 0.99.
Does this seem right to everyone?

authors: ScottJordan tvachnad

repo: tvachnad/Neural-Network


text:
[JOSS Review] Set docs website default version to stable

The documentation website seems to have its default version set to latest (main branch docs). It might be best to change it to the stable version (most recent tag docs) so users are shown the docs for the most recent version they can get from pip install bayes_spec.

Thanks for the suggestion! I've updated the README and changed the default version on readthedocs to stable.

Fixed by https://github.com/tvwenger/bayes_spec/pull/48

authors: ConorMacBride tvwenger


text:
更新失败

是不是之前按照issue手动覆盖过签名，你可以试试卸载这个重新安装最新版本即可


text:
Use higher precision when calculating breakpoint-max values

Bootstrap is currently using 0.1 as the value for calculating breakpoint-max. This causes an issue when using the hidden-*-down classes.
For example (assume font-size: 16px):
md: 48em, // 48 * 16 = 768px
breakpoint-max(md, (xs: 0, sm: 34rem, md: 48rem)): 47.9 // 47.9 * 16 = 766.4
This leaves a ~2px window where elements with hidden-md-down will show up unexpectedly.
I'm proposing changing the precision value to 0.00001. I'm not sure that 5 places are needed (too much?), but since that seems to be the default precision for SASS, I went with that.
I opened pull request #17283 for this issue.

No longer relevant—we're back to pixels for media queries and containers.

authors: chrisnicotera mdo

repo: twbs/bootstrap


text:
Add sticky table header

Sticky table headers are a key concept on all mobile platforms. Since the display sizes are quite small, you usually can't see the table header any more if the height of the table is bigger than the height of the screen. The project stickyRows gives a good demonstration of what I mean.
This project is a bit too complicated though, because it includes handling of different types of table headers and stacking of those. What I think should really be part of Bootstrap 4, is a class like .table-sticky-header (similarly to .navbar-fixed-top) that you can add to each .table and then Bootstrap does the rest and always keeps the current <thead>-section on the top until the last row scrolled to the top or the next <thead>-section goes up.

Duplicate of #19546.

authors: cvrebert martenlehmann


text:
btn-group inside of tabs not setting correctly active tab

When creating a tab interface and including a btn-group on the first tab.  The entire tab active function becomes confused.  As you click back and forth between the tabs the btn-group will deactivate each btn-group until all are exhausted and then it will start displaying the tabs correctly.
However, after that the btn-groups are non-functional.
https://www.bootply.com/uRr63yABIZ

Already fixed by : https://github.com/twbs/bootstrap/pull/23087
will be available in our next release :+1:

authors: Johann-S foonster


text:
bug

Before opening:

Search for duplicate or closed issues
Validate and lint any HTML to avoid common problems
Read the contributing guidelines

Bug reports must include:

Operating system and version (Windows, macOS, Android, iOS, Win10 Mobile)
Browser and version (Chrome, Firefox, Safari, IE, MS Edge, Opera 15+, Android Browser)
Reduced test case and suggested fix using CodePen or JS Bin

@RaghulReearg not quite sure what you're trying to do here, but...please stop and/or work out how to post issues in github first

authors: RaghulReearg patrickhlauke


text:
added variables to fix card-outline-*

added
border-style: $card-border-style;
border-width: $card-border-width;
to @mixin card-outline-variant
added
$card-border-style:   solid !default;
to _variables.scss
so card-outline-* would work
@mdo this fixes https://github.com/twbs/bootstrap/issues/19097

With this, cards that have card-outline-* have both a shadow and a border, making it look a tiny bit weird. It doesn't affect much, but it might be a problem to some people.

I'd rather have that than no outline

@Starsam80 I don't see any shadows on my cards at all. Let alone those with outlines.

Without shadows/My branch
With shadows/Your branch
Notice with your branch it's a little more fuzzy? That's because there's both a border and a box-shadow

@Starsam80 No, actually they look identical to me.

@Starsam80 I test in Chrome and Firefox.

@Starsam80 the main repository has the box-shadow on it. Not sure why yours doesn't.

@indymx It's because I reverted the commit that broke card outlines in the first place (a32fcc6c58af4c0b00e2e20160c9563c9fc6155f) but that PR got rejected.

@Starsam80 Ahh.. must have introduced other things that they liked. The shadow doesn't really bother me, it's pretty hard to see, but lack of border color is a show stopper. Gotta have it.

I've avoided doing variables for the border-style in the past, so skipping that for now and fixing the issue with #19861. Thanks though!

source: gharchive/pull-request

authors: Starsam80 indymx mdo


text:
Remove custom fallbackPlacements from the dropdown

Closes #32648
Why to remove fallbackPlacements option from the dropdown:

This restricts the flipping behavior of the dropdown to four directions only and it does not let the dropdown flip in the exact opposite side of the current placement.
I believe that there should be an option in the dropdown's configuration to override the customized (by bootstrap) configuration of the popper. It is not available for fallbackPlacements right now.

Why to keep fallbackPlacements option in Tooltip/Popover:
Because it provides better placements to Tooltip/Popover IMO (Since there is no official special handing for the placement of Tooltip/Popover on the edges, like- dropstart and dropend for dropdowns). Popper's default value for fallbackPlacements is [oppositePlacement] it means:

If the popper has placement set to bottom, but there isn't enough space to position the popper in that direction, it will change the popper placement to top (opposite side). As soon as enough space is detected on the bottom, the placement will be reverted to the bottom side. But if the top placement doesn't fit (while Popper trying to flip the element), it reverts back to the original placement (to the bottom side even if there was not enough space in the viewport that made Popper try to flip the element). And this behavior causes the issue: #32384.

More in the description of #32437. So its better to have more fallback placements by default for Tooltip/Popover.

And the flip modifier can be added with fallbackPlacements by the popperConfig option in case the same issue like #32384 is caused with dropdowns as well (Which is rare in case of dropdowns IMO).

@mdo how do we proceed with this?

@XhmikosR @rohit2sharma95 I don't see the issue in #32648 in our production site at https://getbootstrap.com/docs/5.0/components/dropdowns/#menu-alignment. Should I be looking in a particular browser or OS?

Actually I just saw the issue in another PR on the RTL cheatsheet: https://deploy-preview-32986--twbs-bootstrap.netlify.app/docs/5.0/examples/cheatsheet-rtl/.

authors: XhmikosR mdo rohit2sharma95


text:
fix undefined is not an object (evaluating 'this._config.backdrop')

Description
if the element failed to initialize (this._element never being set), proceeding with constructor will result in errors, the first one being undefined is not an object (evaluating 'this._config.backdrop') in _initializeBackDrop .
Motivation & Context
i have issues in my bug tracker :-)
see https://github.com/twbs/bootstrap/issues/37305 for context
Type of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Refactoring (non-breaking change)
[ ] Breaking change (fix or feature that would change existing functionality)

Checklist

[x] I have read the contributing guidelines
[x] My code follows the code style of the project (using npm run lint)
[ ] My change introduces changes to the documentation
[ ] I have updated the documentation accordingly
[ ] I have added tests to cover my changes
[ ] All new and existing tests passed

i didn't run the unit tests because i made the edit live on github, but if you consider the change, i'd be happy to run them since in quite sure it doesn't break anything :-)
Live previews
not necessary

Hey @lekoala. I can understand what are you trying to protect of, however this defensive approach could be used before initialize the modal.
YES for sure, is better to have the check embedded on components code, but as this could be a breaking change, it will have to be postponed for v6
check here too #37442

authors: GeoSot lekoala


text:
Report benchmarks in original order

The report generated by --pretty shows the benchmarks in (pseudo-) random order.
printReports :: HashMap Text Report -> IO ()
printReports report = do
  putDoc $ foldMap formatReport (elems report)

elems returns the elements using whatever order is used inside the hash map (probably ordered by hashes). It would be great to have the results reported in the order defined in the user code.

quick search finds https://hackage.haskell.org/package/linkedhashmap-0.4.0.0/docs/Data-LinkedHashMap-Seq.html

Is there benefit of using HashMap there? Do we use random accesses there?

I just ran into this.  It would also be nice to group or intent the pretty output.
Quite annoying to have to manually edit the text..

authors: Fuuzetsu mgsloan nmattia qnikst

repo: tweag/hyperion


text:
Add real account and parody account for News topic listings

Create one Topic "News"
Add real and fake accounts for CNN, BBC Sports, and The Onion
Each account listing is linked to the "News" topic

This is an update to #21

Closed for fixup.

repo: tweet-squared/Tweet-Squared-App


text:
Updating fails when an object with has a relationship in 'camelCase'

Im trying to do this
await jsonApi.update("match", {
    id: this.match.id,
    date: date,
    homeTeam: { id: homeTeam.id },
    visitTeam: { id: visitTeam.id },
    tournament: { id: tournament.id }
});

It returns a bad request because homeTeam is serialized to "homeTeam" not "home-team" like it should be.
I tried this with postman and it worked as expected.
{   "data": {   	"id": 1,     "type": "matches",     "attributes": {       "date": "2019-08-12T11:40:57.747-09:00"     },     "relationships": {     	"home-team": {         	"data": {         		"type": "teams",         		"id": 5 	        	} 	    	} 		} 	} }
What am I doing wrong?
Thanks ❤

@dcantu96 I'm not sure if we're translating camelCase names to kebab-case names automatically anymore since we've run into several issues with that and it's hard to make it consistently perform as expected across all JSON:API implementations. Are you able to do something like:
await jsonApi.update("match", {
    id: this.match.id,
    date: date,
    'home-team': { id: homeTeam.id },
    'visit-team': { id: visitTeam.id },
    tournament: { id: tournament.id }
});

repo: twg/devour

license: ISC


text:
Symbol.iterator not taken into account

When trying to iterate an es6 class which implements a Symbol.Iterator method, the twig 'for in' loop actually iterates the object properties rather than invoking the iterator.
class test {
  constructor () {
    this.__children = ["a", "b", "c"]
  }
  [Symbol.iterator] () {
    var index = -1;
    return {
      next: () => ({ value: this.__children[++index], done: !(index in this.__children) })
    };
  }
}

{% for child in test %}
{{ child }}
{% endfor %}

It will print the single value '3' (length of children array)

This project does not currently support looping over more complex data structures. Similar to #427.

authors: twifty willrowe


text:
chore: specify MSRV for Clippy

This means Clippy won't report lints that require a newer version of Rust, like unnested_or_patterns which requires 1.53+.

Sorry for the late reply on this, we had some stuff going on that prevented us from reviewing this. I'm in favor of this change because it has broken CI before and I'd prefer to update Clippy whenever we actually bump MSRV, but others have expressed disinterest. I'll run CI for now and get back to this.

Thanks

authors: LeSeulArtichaut zeylahellyer

repo: twilight-rs/twilight


text:
Issue: Video Call with Accept and Reject at other user

Hi,
I want to know that is it possible to accept/reject option to other user for accept/reject the video call which is calling by user? Because I have downloaded the demo but there is not this feature available. How can I do it to develop this feature? Please give me suggestion or help.
Thanks
Nikunj

Hi,
Thanks for your feedback. Using Twilio Notify, When I send notification other user, is it available with accept and reject option via push notification? Please let me know.

Hi Nikunj,
Hopefully I can help clarify things a little here. The Android / Twilio Notify example implements one half of the Invite experience. Imagine Alice wants to invite Bob to a video call.

Alice and Bob register for push notifications.
Alice sends a push notification to Bob inviting him to a Room.
Alice joins the Room contained in the notification.
If Bob accepts, Bob joins the same Room.
Alice and Bob are in a video call.

As far as I understand the Android example does not signal from Bob back to Alice. So, if Bob were to reject the call (by not joining the Room) then Alice wouldn't know about it. In order to support rejecting a call you would need to send an additional notification from Bob back to Alice indicating the acceptance or decline of the Invite.
I'm trying to fill in for Ryan here as I happened to be online. Both Ryan and I are out of the office on Monday but I believe @ptankTwilio can help you out further if you have any more questions.
Thank you,
Chris Eagleston

Hi @Nik20112,
I'm bringing the discussion into your original ticket. We will do our best to integrate push notifications into our QS CallKit example in the future. However, if this is blocking you from getting started now I would suggest that you take a look at the Android example. The server side component is the same regardless of wether you use iOS or Android as the client (just replace FCM with APNS as the notification system).
https://github.com/twilio/video-quickstart-android/tree/master/exampleVideoInvite
https://github.com/TwilioDevEd/sdk-starter-java
Regards,
Chris Eagleston

Hi @Nik20112 ,
Let us know if you are running into any issue while using Twilio SDKs to achieve the used case of Accept/Reject the video call.
Thanks,
Piyush

Hey @ceaglest, @piyushtank . How can we show a call screen like WhatsApp/Skype/Telegram etc even when the app is killed or/and the device is locked? Any suggestions on achieving that with Twilio notify?

@jishindev Yes Twilio Notify can solve the problem. When your app is killed, and if iOS receives a push notification when app is killed or in backgroun suspended, iOS will wake your app up. Upon receiving the push notification in your app, in push notification handler, you may want to connect to a Room.
Let me know if you have any questions.

Thanks @piyushtank for the response. How about doing the same in android? Does the app wake up happen there as well?

@jishindev Everyone from our Android team is on vacation at the moment, they will be back next week. My best guess is the behavior would be similar in Android too, but I can confirm with our Android team when they are back and let you know.

Hey @jishindev
Yes, the behavior is similar on Android. In the quickstart example that uses Notify your application will be informed of a push notification (even if your app is killed ) via a subclass of FirebaseMessagingService. The example shows a notification and sends a local broadcast, but you could implement any logic required in the onMessage callback.
Let me know if I need to clarify anything. Thanks!

Hi @aaalaniz @piyushtank ,
Already, we have tried with Firebase Push Notification service. So, my doubt is what is the advantage of using Twilio Notify over the Firebase Push Notification.
If we really have any new features we will migrate from Firebase Push Notification to Twilio Notify.
Thanks,
Sathish Kumar G

Hi @aaalaniz @piyushtank ,
Already, we have tried with Firebase Push Notification service. So, my doubt is what is the advantage of using Twilio Notify over the Firebase Push Notification.
If we really have any new features we will migrate from Firebase Push Notification to Twilio Notify.
Thanks,
Sathish Kumar G

Hi @aaalaniz @piyushtank ,
Can anyone check it out this because we have to implement on our end.

@sathishvgs Myself and Aaron we work in Voice and Video SDK team. I have reached out to our notify team to help you out. I will get back to you once I heard back from notify which should tomorrow. But in the meantime, I would recommend going over the notify-documentation to go over the the feature set notify provides. Thanks.

Hey @aaalaniz, I've implemented the twilio notify on our app but having delay in getting video notification on Android 9 devices. Any clue why this would be happening?

@sathishvgs if you are using only the Firebase push notifications for making and receiving calls, you may not see additional benefit if you move to Twilio Notify per the TwilioNotify team. Let me know if you have any more questions, however we recommend Twilio Notify for signaling on top of Video SDK.

@piyushtank
Thanks for the info.

HI, i have an issue when i send try to a video call and other user accept the call just after that call automatically gets rejected.
this one is specific issue or just a case with me?
Please help me with this.

authors: Nik20112 aaalaniz ceaglest jishindev piyushtank ptankTwilio pwndhull sathishvgs

repo: twilio/video-quickstart-ios


text:
AHOYAPPS-743: Use AppScreenSource from SDK for in-app screen capture

Use AppScreenSource from SDK instead of using RPScreenRecorder directly.
Contributing to Twilio

All third-party contributors acknowledge that any contributions they provide will be made under the same open-source license that the open-source project is provided under.

[X] I acknowledge that all my contributions will be made under the project's license.

We need to have a public SDK release with in-app screen capture included before this can be merged.


text:
Rich links work now

Description
Rich links work now
Attach Screenshot

Let's all test the hell out of this feature

@PuruVJ merge conflicts 😀

Merge resolved

authors: PuruVJ proful

repo: twindle-co/twindle


text:
[ISSUE]Multiple follows_list in a program is returning the same list everytime despite using clean_follows_list() everytime

Make sure you've checked the following:

[x] Python version is 3.6;
[x] Updated Twint with pip3 install --user --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint;
[x] I have searched the issues and there are no duplicates of this issue/question/request.

Command Ran

Please provide the exact command ran including the username/search/code so I may reproduce the issue.

import twint
import json
import time

i = 0
dic = {}
c = twint.Config()
while i<2:
 i+= 1
 c.Username = "rajsahuofficial"
 c.Hide_output = True
 c.Store_object = True

 while True:
     try:
         twint.run.Lookup(c)
         break
     except Exception as e:
         print(e)
         print("Retrying in 1 sec")
         time.sleep(1)
 fol = twint.output.users_list[:]
 dic["followers"] = fol[0].followers
 dic["following"] = fol[0].following
 while True:
     try:
         twint.run.Followers(c)
         break
     except Exception as e:
         print(e)
         print("Retrying in 1 sec")
         time.sleep(1)

 lst = twint.output.follows_list[:]
 dic["followers_list"] = lst
 twint.output.clean_follow_list()

 while True:
     try:
         twint.run.Following(c)
         break
     except Exception as e:
         print(e)
         print("Retrying in 1 sec")
         time.sleep(1)

 lst1 = twint.output.follows_list[:]
 dic["following_list"] = lst1
 twint.output.clean_follow_list()
 print(dic)

Output of the above code
I have run the fetch command for the same user 2 times to show the error. In the debugger, I watched the dic(profile dictionary) for the actual followers and following count. Then I took the length of dic["followers_list"] and that for following_list at both the iterations.
For i=0

Here, Number of followers : 53, number of following: 97
So len(dic["followers_list"]) = 53
But len(dic["following_list"]) = 150, probably because last list is appended by new output.
For i=1

Since in last iteration, the final list size was 150, and num of followers = 53. they both are getting added this time to give 203 as new size.
Again in the case of following_list, since latest size was 203 and number of following = 97, they both get added to give new list as 300.
Hence, at i=1, following list becomes of size 300.
Description of Issue
I am trying to build a complete profile for a list of users. As a start, I selected a user randomly, and tried to get his/he users_list, and both the follows_list(one for followers and other for following) in the same iteration.
Once I call twint.run.Followers(c) and save it to my dictionary, and then calling twint.run.Following(c) and doing the same process, I am getting a sum total of all followers and following as the list indexed to my dictionary.
Environment Details
Ubuntu 18.04.3 LTS
Running on : VsCode Bash
Help needed
How to generate the correct list in the same program in one iteration itself.

@pielco11 can u please help?

@rjsu26 quite busy these days
New code is being pushed. clean_follow_list was used to clean (objects) used by Pandas' DataFrames.
I renamed that function to a "private" one, _clean_follow_list. If you are not doing an advanced usage of Twint and so using core functions, you should not use it. To clean lists you may want to do twint.output.users_list = [], I added a function called twint.output.clean_lists to reset users_list,tweets_list and follows_list.

So, we now need to use both of the new features of any one of them?

No, if you want to clean the lists, each of them, just call twint.output.clean_lists()

That worked like a charm. Thanks for the immediate correction @pielco11
Also, can you reason out why even though the lists must be getting fetched in batches of 20, my resume files are of many many lines for even small number of followers/followings.
Example: for following count of 20, there are about 25 lines in resume.raw file being generated. While for 700 800 followings, its done in 30 lines max.

Probably Twint retries the requests

Yes, It was somewhat that you pointed about. Thanks for your help @pielco11 .

repo: twintproject/twint


text:
fix SPDY headers so dependent projects can stop using pch files

when attempting to build our project that depends upon
CocoaSPDY without precompiled headers, we found a
couple of errors:

SPDYError.h refers to NSString

solution: import Foundation.h

SPDYError.h has externs that could be in C, C++ or Objective-C code

solution: use FOUNDATION_IMPORT, found in Foundation.h

SPDYLogger.h refers to NSString

solution: import Foundation.h

Thanks!

authors: goaway johnkdoe

repo: twitter/CocoaSPDY


text:
2.0 wip: Fix vertical layout for navbars with different heights

I just added a little bit of LESS math to make the layout in the navbar to scale properly if you change the value of the navBarHeight variable. This will affect the vertical position of links, buttons, search fields and brands. It also makes the vertical dividers stretch to the full height.
This is my first pull request so let me know if I've done anything wrong!

Great idea to make the navbar more easily customized

Cool... I'll try to think of a cleaner way to do this when I have some free time!

authors: dfm tonycoco

repo: twitter/bootstrap


text:
2.0 wip Typeahead Documentation

This should close: https://github.com/twitter/bootstrap/issues/1203#issuecomment-3653733
I'm afraid I'm not entirely clear how to associate this wil issue: 1203 anyways, here's some documentation for Typeahead's options, and also a sensible default for Typeahead's data.

changed it to data-source and added a note in the docs - thanks!

authors: adamsanderson fat


text:
Remove broken tweets section

This section seems to be supposed to show tweets but it doesn't work (anymore). This maybe because of the API changes but even if it would work, the account TwitterOSS probably won't be used anymore in the future as Twitter rebranded to X.
Before:

After:

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

authors: CLAassistant WebSnke

repo: twitter/opensource-website


text:
Bring back self.from_json and to_json for CSP

Added in https://github.com/twitter/secureheaders/pull/163 and removed in the 3.x upgrade, it may be worth adding this back.
While there's no official spec representation, CSP clearly maps to a json object.
We should guarantee interop with anyone else who has implemented it

[ ] Figure out who supports this
[ ] Implement parity for lib X
[ ] Implement parity for lib Y

Most of the complexity comes from parsing a policy and applying any "merge" conditions as defined in https://gist.github.com/jonathanKingston/5699b440f608960dc089. to_json is trival at worst.
/cc @jonathanKingston in case he can help me define that task list of libraries with which I should verify interop.

props to https://twitter.com/call_user_func/status/723353164703891457 for making me think about this again.

Until we have a use case...

repo: twitter/secureheaders


text:
<!--https://github.com/twitter/twemoji/issues/471

Description

Feature Workflow

[First Action]
[Second Action]
[and so on...]

Additional Information

Provide pictures or links that demonstrate a similar feature or concept.
See How Can I Contribute for additional guidelines.

Originally posted by @BROSVORN in https://github.com/MarlinFirmware/Marlin/issues/21101

https://github.com/twitter/twemoji/issues/471

repo: twitter/twemoji


text:
port forwarding breaks when connecting to a Zookeeper node

Runtime error: an error occurred forwarding 2888 -> 2888: error forwarding port 2888 to pod xxxxx, uid: exit status 1: socat[29346] E connect(5, AF=2 127.0.0.1:2888, 16): Connection refused

Are you able to use `kubectl port-forward'?

@cjimti Thanks for looking into it. Appreciate your help :-) The problem does not lie with kubefwd. There was an issue with the way the service was setup.

authors: cjimti karannparikh


text:
Outdated href for X Premium breaks hiding of its nav entry.

It has changed from /premium to i/premium_sign_up

I made a PR #211 that fixes this.

repo: typefully/minimal-twitter


text:
paragraph block non editable in visual mode

Hey Sebastian,
When a header had been typed in raw mode followed by a paragraph of text and they are not separated by an empty line (only a line break), it's OK in markdown. They are correctly rendered in html.
But if you switch to Visual mode, it 's impossible to edit the paragraph to make a change. Both header and paragraph end up on the same block. Simply adding and empty line between them in raw mode is enough to solve this but that seems to be a bug...
Olivier

Hi Olivier,
yes, the visual markdown editor has not a super clean markdown logic, will add a fix-label, but to clean it up completely I have to analyse the whole markdown document in depth and I want to avoid it right now...

#55 with more bugs with markdown parsing.

starting with version 1.4.0 the markdown-blocks for the visual editor are detected with the parsedown-library, this should solve all issues with markdown in visual mode.

published with version 1.4.0

authors: oliviercrouzet trendschau

repo: typemill/typemill


text:
is api.typings.org, down?

Prerequisites
Please first check README. There are breaking changes from 0.x to 1.0

[x] Did you check the FAQ?
[x] Did you search open and closed issues to see if your issue has already been reported?

Description
typings ERR! message Unable to connect to "https://api.typings.org/entries/dt/es6-shim/tags/0.31.2%2B20160317120654"
Also using Chrome, not behind firewall and on my cell phone to try and connect https://api.typings.org
and it seems to be down. Is this the case when can we expect it to be up again?
[Description of the bug or feature]
Steps to Reproduce

[First Step]
[Second Step]
[and so on...]

Expected behavior: [What did you expect to happen?]
Actual behavior: [What actually happened?]
Versions
[From typings -v]

It's up for me.

Can you confirm it's actually down and not a 404 on api.typings.org (because the 404 is correct).

Its a 404, I guess is up.  So do i need update the typings install or the shim?

No. Is your computer behind a proxy or something else blocking the connection? Can you check the connectivity of your laptop? Can you provide the Typings version?

Hi, I'm having issues too.
typings ERR! caused by https://api.typings.org/entries/npm/es6-shim/versions/latest responded with 404, expected it to equal 200

@towrz Read the README. A 404 is not down.

@towrz For reference, you should look at closed issues. E.g. https://github.com/typings/typings/issues/517, https://github.com/typings/typings/issues/519, https://github.com/typings/typings/issues/518 are all the same thing as you just wrote. It's not just you that does this, but it takes a lot of time to be responding to (non)issues.

authors: blakeembrey justridelow towrz

repo: typings/typings


text:
Mermaid support?

Do you plan to support https://mermaid.js.org ? I think it might be great way to generate graphs diagrams in typst.

There's a couple of similar requests which involve supporting some markup language inside of Typst (eg. #184)
I don't think any of these will supported as a primitive in Typst, but rather Typst will allow you to write functions that parse and render your custom Markup language.
As the language and ecosystem evolve, I think we'll move towards a system where users can import libraries which provide such functions, but we are not there yet.

repo: typst/typst


text:
Raw text in grid makes figure a listing

Description
When there is raw text in a grid in a figure it becomes a listing.
@tingerrr (I assume this is his account here) told me to report this on discord
Code to reproduce:
#figure(
  grid(
    gutter: auto,
    [I'm a Figure],
  ),
  caption: "foo"
)

#figure(
  grid(
    gutter: auto,
    [
      ```
      I'm a Listing
      ```
    ],
  ),
  caption: "bar"
)

produces

with typst version typst 0.11.0 (2bf9f95d)
Reproduction URL
No response
Operating system
Linux
Typst version

[X] I am using the latest version of Typst

It seems to just query for the first element which can be used to represent a figure, which is interesting. I assume this is to avoid interference with block / box / etc. being used to decorate the figure.
https://github.com/typst/typst/blob/105d7156f8f9d95e16b3eefdf0fa97e5be7fbe5b/crates/typst/src/model/figure.rs#L236-L242
Whether or not this is desirable is possible to discuss, but I'd say that one should explicitly specify the kind when the default isn't "good enough" either way (with kind: image for the default and kind: raw or kind: table or kind: "custom string" for other options).

I think for something like grid, it kind of makes sense if all of its items had the same element type, but assuming a kind for figure(grid(raw(...), image(...))) seems weird to me.

In principle, everything is working as intended here, so I'll convert this into a discussion.

authors: GamerBene19 PgBiel laurmaedje tingerrr


text:
Replace once_cell's Lazy as much as possible

Excited about LazyCell and LazyLock making it into std , I worked myself into replacing it in typst. I bumped the MSRV as well but it is failing the CI tests. Unsure why.

Since LazyLock is just a small niceness of not needing once_cell, I'd like to not bump the MSRV for now (we just recently bumped from 1.74 to 1.77). I think this reduces churn for people that aren't always on the very latest toolchain, and also helps with some package managers that aren't always 100% up to date. But I'm open to discussion if others think it's pointless. Intuitively, my instinct would be to stay 1-3 versions behind, with the exception being that a really nice feature comes along.

I'd be fine with bumping the MSRV to 1.80 now, since we're at 1.82.

Thanks!

authors: asibahi laurmaedje


text:
⚠ Tyre Pharmacy has degraded performance

In 5da2327, Tyre Pharmacy (https://tyrepharm.ru/) experienced degraded performance:

HTTP code: 200
Response time: 5398 ms

Resolved: Tyre Pharmacy performance has improved in 666b230 after 12 hours, 44 minutes.

repo: tyrepharm/upptime


text:
Allow for customization of breakpoint names

Let users use other breakpoint names besides just xs, sm, md, lg, and xl. The only restrictions should be that one breakpoint value is 0 and that no two breakpoint values are the same. The hook should figure out the order of the breakpoints by sorting the values in ascending order.

I'd also like to allow entering, instead of a breakpoint set object, a string corresponding to the name of a popular CSS framework, indicating that that framework's default breakpoints should be used. Here are a few initial options, with links to the pages where they lay out their breakpoints:

Bootstrap
Tailwind CSS
Material Design
Material-UI
Foundation

Also, in the case of such a string, I want to add an option called additionalBreakpoints, where the user can add one or more extra breakpoints to a CSS framework's defaults. An example:
const breakpoint = useWindowWidthBreakpoints("tailwind", {
  additionalBreakpoints: { xxl: 9000 },
});

Breakpoints here will override breakpoints in the first argument's set.

repo: tywmick/use-window-width-breakpoints


text:
vue3分支重构todo

Todo

[x] vue-cli, webpack -> vite
[x] js -> ts
[x] 打包导出ts类型
[x] 选项式api -> 组合式api
[x] 左上角全屏按钮点击体验优化（当前点击范围不够大，只有点中心才生效；放大后再次点击，无法恢复之前大小）
[x] 去除python编译脚本，替换为bash、js等
[ ] 默认状态下输入不在可输入范围内的命令，会直接卡死, 应改为报错?
[x] 清理==null判空
[ ] json 下拉框无法选择（github.io可复现）
[x] 考虑去除codemirror和highlightjs依赖
[x] header slot 恢复支持
[x] eslint告警清理
[x] demo和组件通过monorepo方式管理(pnpm workspace)
[ ] demo js -> ts
[x] demo调试时支持加载sourcemap
[x] external dep(外部依赖)配置
[ ] demo 拖动, code显示问题

暂时无法实现

导出的类型是否可带上文档（tsdoc）(vue-tsc当前不支持👎)

感谢贡献👍  当你看到源码的时候应该不难看出，我对前端的模块设计、代码等不是很规范，毕竟非前端专业选手，感谢大佬改造，改造过程中有细节方面需要沟通可以加我微信。

碰到个打包结果里有import require$$0 from "vue";导致报错的问题, 排查了半天是vue-json-viewer里面vue3引入有问题
不应该用import Vue from "vue"
原来不是vite的坑
我看看json-viewer能不能换成别的库吧

你微信号是多少呀
README里面有写 beifeng-tz

碰到个打包结果里有import require$$0 from "vue";导致报错的问题, 排查了半天是vue-json-viewer里面vue3引入有问题 不应该用import Vue from "vue" 原来不是vite的坑 我看看json-viewer能不能换成别的库吧

嗯嗯 这个库我也有计划替换掉，之前想自己做一个，无奈一直没时间

全屏为什么要判断_isSafari? 我看edge也是有问题的, 是不是直接不判断就好了 @tzfun

全屏为什么要判断_isSafari? 我看edge也是有问题的, 是不是直接不判断就好了 @tzfun

实测下来Safari浏览器的全屏功能不太兼容，需要单独处理

todo已迁移到pr中维护

authors: birdmanmandbir tzfun

repo: tzfun/vue-web-terminal


text:
Wildcard routing ws with get

After fixing https://github.com/uNetworking/uWebSockets.js/issues/98, I am having a different problem
I am doing
uWs.App()
  .ws('/*', options)
  .get('/ok', (res) => res.end('ok'))
  .get('/*', (res) => res.end('not ok'))

But when I go to /ok I get not ok, if I remove .get('/*') it works, if I remove .ws(/*) it works, but together they do not. 🤔

I also experience issues with routing. For example:
This code works correctly - opens WebSocket on upgrade request to / and HTML on regular GET request:
app
.ws("/*", { open, drain, message, close })
.get("/", (response: HttpResponse, request: HttpRequest) => {
    response.end("some HTML");
})

But if I put WebSocket handling on non-wildcard route it always processes regular GET request and opens HTML, even if upgrade header sent:

```JS
app
.ws("/", { open, drain, message, close })
.get("/", (response: HttpResponse, request: HttpRequest) => {
    response.end("some HTML");
})

authors: aadityataparia mrlika


text:
Autoselect language based on default browser language

How can you reproduce the problem?

Set your Chrome browser default language to Turkish (can also try with any of our available languages: Arabic, Farsi and Vietnamese)
Restart uProxy

What is the expected output?
uProxy should appear in Turkish
And what do you see instead?
Even though our browser is Turkish, and uProxy has Turkish translations, uProxy will still appear in English.

I'm going to work on this problem.

authors: ghoshkaj zahoriea

repo: uProxy/uproxy


text:
Display all projects instead of top 3

Limiting the view to only top 3 projects is too restrictive given how much time interactive issue creation saves.
Another problem with the current approach is that starting a new project or transferring teams will cause your new active project to be low rank and likely missing from the issue creation list for a while until you get more tasks.

We're targeting 95% cases, transferring project to another team is an edge case which will hinder experience for most of the users which work with their project and almost never transfer

In worst case there is going to be 50 project (1 unique project per task, task fetching is limited at 50), let's see if people start complaining about it.

authors: artms dgladkov

repo: uber/arcanist


text:
Update 01-server-installation.md

The domain specified in the "Register Domain Using the CLI" section should be "samples-domain" vs "test-domain"

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

authors: CLAassistant damrit

repo: uber/cadence-docs


text:
Fix replication task nil bug

Replication task generator will return nil if the version is mismatch. We should return if the task is nil.

Coverage decreased (-0.09%) to 66.781% when pulling db5df3ebb3128e1bd0b0ace57570b24f931108be on fix-nil-rrt into 519b92b9ff7aae7b1fe237bd010c0029f15275e8 on master.

repo: uber/cadence


text:
Use new resource struct for history

Use resource struct for history service, history handler, shard controller and shard context.
We can also consider use the resource struct in history engine, but will leave this as a future work.

Coverage increased (+0.7%) to 68.052% when pulling 1aa1abcb93794413fb0793b2b10ebefcfc1e8ce0 on yycptt:history-resource into 245075c199b6b32b9ba3e8bfe1f0e9f76b797253 on uber:master.

Everything looks good when running canary on my local machine.

authors: coveralls yycptt


text:
Rename metric name SignalInfo to SignalInfoSize

Describe what has changed in this PR:
Fix the SignalInfoSize metric name from signal_info to signal_info_size
Tell your future self why have you made these changes:
signal_info is a timer which means it implicitly also creates a signal_info_count metric in prometheus/Otel style metrics, this conflicts with the SignalInfoCount metric defined on line 2345
How have you verified this change? Tested locally? Added a unit test? Checked in staging env?:
Deployed and tested in a production environment
Assuming the worst case, what can be broken when deploying this change to production?:
Metric names is changed and Cadence users should update dashboard if they use this metric.

cc @longquanzheng

Coverage decreased (-0.03%) to 64.549% when pulling e05441be8fd3789851583d2ae4fab2b0d48a1704 on AngerM:manger-fix-prom-metrics into 4b548e27123a65be08e251747674e5332ace2307 on uber:master.

authors: AngerM coveralls


text:
IconLayer renders icons at small sizeScales with significant loss of quality

I'm trying to render a small triangle pointing to the direction of travel on a map.
Here's the asset I'm currently using:

Dimension: 7 x 10
When rendered on a map, I see that there is significant loss of quality, along with significant distortion (tracked in issue 834).

Here's how I'm instantiating the layer:
    new IconLayer({
      id: 'direction-pointer',
      data: arrows,
      fp64: true,
      getColor: (d, i) => {
        const opacity = d.index < currentIndex ? 255 : 0;
        return [0, 0, 0, opacity];
      },
      iconAtlas: assetUrl('/static/direction-pointer.png'),
      iconMapping:  {
        marker: {
          x: 0,
          y: 0,
          width: 7,
          height: 10,
          mask: true
        }
      },
      sizeScale: 10
    });

@1chandu @ibgreen Could this be related to the power-of-two texture change in luma v4?

Luma v4 uses WebGL2 by default,  NPOT (non power-of-two textures) textures are supported and shouldn't cause any issue.
I will take a look at this issue, after I wrap my current tasks, should be in next couple of days.

Need to re-test this with #834 fix (@rivulet-zhang working on it).

@1chandu #900 handles the distortion caused by rotation. As a separate issue, the scaling of the icon seems to be inaccurate, which could relate to this issue. Say I am rendering an icon with getSize: d => s1 and sizeScale = s2, the resulting icon actually has a much smaller size as opposed to s1 * s2. This exists in the original version and #900 does not handle this for now. Let me know if you want me to look into this.

@1chandu @ibgreen Could this be related to the power-of-two texture change in luma v4?

Kind of, I was more thinking that this could be related to a change in default texture filtering parameters. We need to make sure we are using the best texture filtering.

Say I am rendering an icon with getSize: d => s1 and sizeScale = s2, the resulting icon actually has a much smaller size as opposed to s1 * s2. This exists in the original version and #900 does not handle this for now. Let me know if you want me to look into this.

@rivulet-zhang Yes it sounds like this is worth another look.

authors: 1chandu Pessimistress ibgreen rivulet-zhang tangential


text:
Support renaming NativeMethods and H3_EXPORT

We should support the same renaming features as H3 itself.

I think to support shading we would need to rename the artifact directories to be under the package name.


text:
Changing the optimizer fails

Hi -
First of all, thanks for the great work. A fantastic tool box. I am struggling to change the optimizer. E.g.
ludwig train --data_csv annotations_all_zoom.csv --model_definition "{input_features: [{name: image_path, type: image, encoder: stacked_cnn}], output_features: [{name: class, type: category}], training: {optimizer: {type: sgd, lr: 0.0004, nesterov: True}, reduce_learning_rate_on_plateau: 10, early_stop: 10, learning_rate: 0.0004, batch_size: 32}}"

leads to
 Traceback (most recent call last):
   File "/usr/local/bin/ludwig", line 11, in <module>
  load_entry_point('ludwig==0.1.0', 'console_scripts', 'ludwig')()
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/cli.py", line 86, in main
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/cli.py", line 64, in __init__
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/cli.py", line 70, in train
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/train.py", line 663, in cli
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/train.py", line 151, in full_train
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/utils/defaults.py", line 162, in merge_with_defaults
  File "/usr/local/lib/python3.5/dist-packages/ludwig-0.1.0-py3.5.egg/ludwig/utils/defaults.py", line 119, in get_default_optimizer_params
ValueError: Incorrect optimizer type: sgd

I can call the default adam optimizer this way as well and it works. Am I missing something?

Thank you!
I pushed a fix so that now you can use the sgd type.
Anyway your model definition won't work, for a couple reasons (I should probably detail this better in the documentation):

all the optimizer parameters can be specified there in the optimizer dictionary, everyone but learning_rate. The reason is that Ludwig has a different way to deal with the learning rate, passing a placeholder to the optimizer and modifying the learning rate outside tensorflow with a specific logic (for instance reducing it when validation accuracy platoes). So don't pass your learning rate inside optimizer, but inside training, and Ludwig will take care of it.
TensorFlow's GradientOptimizer does not have a momentum parameter. In TF in order to use a sgd with momentum, there's a different optimizer called MomentumOptimizer. Ludwig wraps this optimizer with the keyword momentum.
Given these two reasons, the correct model definition would be:

ludwig train --data_csv annotations_all_zoom.csv --model_definition "{input_features: [{name: image_path, type: image, encoder: stacked_cnn}], output_features: [{name: class, type: category}], training: {optimizer: {type: momentum, momentum: 0.1, use_nesterov: True}, reduce_learning_rate_on_plateau: 10, early_stop: 10, learning_rate: 0.0004, batch_size: 32}}"

Let me know if this solves your issue and close it in case.

Thanks for the quick fix. Works perfectly now. Also thanks for clarifying the optimizer usage. Since you were linking to the TF documentation of the optimizer classes I was just assuming one could pass these parameters on. You also link the keras optimizers in the documentation which caused the confusion about SGD with momentum I guess

Thanks! Glad it solved the problem.
Yeah, I'm not using Keras optimizers. I will clarify in the docs about the specifics of the optimizer options.

repo: uber/ludwig


text:
java.lang.NullPointerException

After the upgrade to 2.0 I get the following error. The previous (old) version was working fine:
ERROR: Build step failed with exception
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to [redacted]
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
		at hudson.remoting.Channel.call(Channel.java:955)
		at hudson.FilePath.act(FilePath.java:1036)
		at hudson.FilePath.act(FilePath.java:1025)
		at hudson.FilePath.list(FilePath.java:1840)
		at hudson.FilePath.list(FilePath.java:1824)
		at hudson.FilePath.list(FilePath.java:1809)
		at com.uber.jenkins.phabricator.PhabricatorNotifier.copyCoverageToJenkinsMaster(PhabricatorNotifier.java:353)
		at com.uber.jenkins.phabricator.PhabricatorNotifier.getCoverageProvider(PhabricatorNotifier.java:330)
		at com.uber.jenkins.phabricator.PhabricatorNotifier.perform(PhabricatorNotifier.java:232)
		at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
		at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
		at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
		at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
		at hudson.model.Build$BuildExecution.post2(Build.java:186)
		at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
		at hudson.model.Run.execute(Run.java:1823)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
		at hudson.model.ResourceController.execute(ResourceController.java:97)
		at hudson.model.Executor.run(Executor.java:429)
java.lang.NullPointerException
	at hudson.FilePath.isAbsolute(FilePath.java:305)
	at hudson.FilePath.glob(FilePath.java:1862)
	at hudson.FilePath.access$2400(FilePath.java:209)
	at hudson.FilePath$23.invoke(FilePath.java:1843)
	at hudson.FilePath$23.invoke(FilePath.java:1840)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2913)
	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
	at hudson.remoting.Request$2.run(Request.java:369)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Build step 'Post to Phabricator' marked build as failure
Finished: FAILURE

Any idea?

Confirmed this works, thanks a lot !

repo: uber/phabricator-jenkins-plugin


text:
Further enhancements / changes to Replay Poutine for MCMC

There are a few enhancements to Replay Poutine that could simplify the implementation of MCMC algorithms:

Return param site from the replayed trace instead of from the param store, by implementing _pyro_param method. This will be useful for HMC (see #579), as we will not require a separate clean-up stage to remove the accumulated gradients on the parameters in the param store, otherwise. From what I can see, this should not impact existing algorithms, but we may need to be careful.
Allow mode where Replay Poutine only replays from the trace if the function name and arguments match. This will be useful for Metropolis Hastings (see #180).

HMC does not need this anymore since we are using grad method directly. Will re-open if this needs to be revisited.

repo: uber/pyro


text:
MarkSeries strokeWidth prop

I'd like to be able to change the strokeWidth of the dots in a <MarkSeries /> just like you can for a <LineSeries />.  Could it be added ?

Thanks !

I just addressed this ticket in #333, and should have a version up of react-vis sometime in the next few hours. In the future if you don't want to wait for us to version packages and stuff, many properties (including stroke-width) can be manipulated via css!

authors: LoicUV mcnuttandrew

repo: uber/react-vis


text:
Membership update speedup

This is a WIP, but currently trying to speed up membership updates for large clusters, especially during the join process.

This was getting too big. Breaking it up in favor of smaller PRs.

repo: uber/ringpop


text:
draw results in the video stream

hi, I want to send live video stream or video file into the browser and draw some pictures on every frame to show the perception result. Of course the perception result is sent from the server.
How to implement this via uber's avs tools?

We don't have direct support for this right now at a high level what you want to render the 3D world from the perspective of the camera image you are sending, then draw the image behind that world so it overlays on top of it.
Concretely you would:

Send the images as XVIZ image stream
Send what you want to draw as XVIZ streams
Render the image to a full screen Quad
Adjust the camera parameters of deck.gl to match that of the camera your image came from

This is actually a long term planned feature but we have not implemented it yet.

Hi,
are there still plans for this feature to implemented anytime soon? I am actively using streetscape for visualization of our vehicle data, and this feature is highly anticipated.
I am looking forward to read from you guys soon.

Hello!
Are there any updates on this feature?

authors: gouchaoer jlisee pgebhardt soodla


text:
Incentivize based on contribution

Resolves https://github.com/ubiquity/ubiquibot/issues/272

1/ let me fix the conflicts by merging the devleoment branch.
2/ still doing refactors but will follow up the ones you guys commented

repo: ubiquity/ubiquibot


text:
Decouple bluefin-main from silverblue-main

I don't think it's worth depending on rpmfusion for non-nvidia machines since we're going all in on flathub anyway. I'd like to find a way to build bluefin-main from upstream silverblue and also spit out the nvidia versions of images from the same repo.
In the meantime I've prototyped an upstream-only version of bluefin here: https://github.com/projectbluefin/bluefin

Afaik main isnt dependant on rpmfusion only nvidia is

repo: ublue-os/bluefin


text:
Can't log into cockpit

This used to work but I think when I adjusted the packages I broke something.

fixed by #347

authors: bketelsen castrojo


text:
feat(framework): Stop enabling power-profile-switcher in ublue-user-setup

power-profile-switcher is a good extension to install, but it's not a great default to start with; see the attached issue.
Remove enabling the switcher during user setup.
Fixes #1276

My eyeballing of the checks is that they are transient 503 errors pulling the blobs. @castrojo : I you need to give it another kick :)

Enough of them passed, wanted to merge this to catch the cronned dailies, thanks!

Ok so we added some notifications to make it clearer that this is a managed configuration, but unfortunately it's non trivial for us to modify the menu to make a checkbox like "[ ] Automanage power" or something but this will at least give people breadcrumbs that it's managing your power. I'll add this to the docs so it's clearer.
It's not ideal but at least gets us some feature parity with KDE, maybe someday the GNOME Power Manager will be able to manage power. 😄

authors: castrojo cflewis


text:
feat: create ucore builds with and without ZFS

Previously ALL ucore builds included ZFS, but should have some without it.
closes #46

LGTM
cc @castrojo

authors: bsherman jeefy

repo: ublue-os/ucore


text:
Add error  handling

Adding error handling ensures that the input lists are of the same length, and the angles are within a valid range (0 to 360 degrees)

Why was this closed?

there is a confllict

So why don’t you resolve the conflict. Closing it does not mean that this is resolved

authors: LinxuanHu laserlab tirthbha


text:
조직위원회 명단 추가 (임시)

현 시점에서 등재 가능한 조직위원 명단 추가하였습니다.
소개 페이지(한국어)에 연도 표기 오타가 있어 수정했습니다.
장소 관련하여 홀 전경 사진은 재활용 가능할 듯하여 임시로 작년 이미지 추가하였습니다.

수고하셨습니다 :)


text:
error: cannot perform the following tasks:

Hello World!
My environment:
$ cat /etc/debian_version
kali-rolling
$ uname -a
Linux x.x.x 5.2.0-kali2-amd64 #1 SMP Debian 5.2.9-2kali1 (2019-08-22) x86_64 GNU/Linux
$

I'm trying to install microk8s on my Linux, by issuing following command:

snap install microk8s --classic

yet running into following error:
$ sudo snap install microk8s --classic
error: cannot perform the following tasks:
- Run install hook of "microk8s" snap if present (run hook "install":
-----
+ export LD_LIBRARY_PATH=/snap/microk8s/920/lib:/snap/microk8s/920/usr/lib:/snap/microk8s/920/lib/x86_64-linux-gnu:/snap/microk8s/920/usr/lib/x86_64-linux-gnu
+ LD_LIBRARY_PATH=/snap/microk8s/920/lib:/snap/microk8s/920/usr/lib:/snap/microk8s/920/lib/x86_64-linux-gnu:/snap/microk8s/920/usr/lib/x86_64-linux-gnu
+ export PATH=/snap/microk8s/920/usr/sbin:/snap/microk8s/920/usr/bin:/snap/microk8s/920/sbin:/snap/microk8s/920/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/usr/bin:/usr/local/bin
+ PATH=/snap/microk8s/920/usr/sbin:/snap/microk8s/920/usr/bin:/snap/microk8s/920/sbin:/snap/microk8s/920/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin:/usr/bin:/usr/local/bin
+ source /snap/microk8s/920/actions/common/utils.sh
+ cp -r /snap/microk8s/920/default-args /var/snap/microk8s/920/args
+ mkdir /var/snap/microk8s/920/certs
+ cp /snap/microk8s/920/certs/csr.conf.template /var/snap/microk8s/920/certs/csr.conf.template
+ produce_certs
+ for key in serviceaccount.key ca.key server.key front-proxy-client.key
+ '[' -f /var/snap/microk8s/920/certs/serviceaccount.key ']'
+ openssl genrsa -out /var/snap/microk8s/920/certs/serviceaccount.key 2048
Error configuring OpenSSL
140035786077848:error:25066067:DSO support routines:DLFCN_LOAD:could not load the shared library:dso_dlfcn.c:187:filename(libssl_conf.so): libssl_conf.so: cannot open shared object file: No such file or directory
140035786077848:error:25070067:DSO support routines:DSO_load:could not load the shared library:dso_lib.c:233:
140035786077848:error:0E07506E:configuration file routines:MODULE_LOAD_DSO:error loading dso:conf_mod.c:271:module=ssl_conf, path=ssl_conf
140035786077848:error:0E076071:configuration file routines:MODULE_RUN:unknown module name:conf_mod.c:212:module=ssl_conf
-----)
$

Please advise.

@a1exus could you use the 1.15 track while we work on this issue? (sudo snap install microk8s --classic --channel=1.15/stable). Thank you.

The snap on edge fixes this issue. Try it with:
``
sudo snap install microk8s --classic --edge

Thank you @DomFleischmann your work on #691

@a1exus, feel free to reopen if the issue persists for you.


text:
网卡流量抛空指针异常

当搜索不到网卡时， 代码中写死“eth0”, 导致空指针异常。

已修复，1.0.2-beta版本发布

repo: ucarGroup/DataLink


text:
Add images folder

Maddie - adding images folder underneath Assets so that I may add background or heading images.

Added image folder and single image of James Bond with a martini.


text:
Folium multiple legends issue

Hi James and Michael,
As discussed in today's meeting, I'm having trouble with displaying the heat maps for different years of the same geographic areas. Currently, if a user selects 3 years, 3 heat maps are generated and three legends appear on the first map (instead of one unique legend per map). My methodology for creating the heat maps involves looping through each year's data, making a new map, and saving the HTML file and its path (which is then called in the dataandvisualize.html template).
The code associated with this issue is lines 153-264 in the views.py file (DataForGood-chicago/dataforgood/main/views.py)  in the front-back-merge testing branch. The code associated with calling the map's HTML path in dataandvisualize.html (DataForGood-chicago/dataforgood/main/templates/dataandvisualize.html) in the front-back-merge testing branch is lines 477-486.

I don't have a specific fix for you here, but a few thoughts on what is happening now:

The function is very long and tough to follow, I'd recommend more comments and/or breaking into smaller functions. I spent a bit of time with it and think I understand the relevant portion now, but less than confident I didn't miss something.
I think that one thing that would help would be factoring out the map generation code so you can run/test it independently. Even if it's a manual test, it'd be good to be able to generate a single map in a function instead of having all of the code nested in a for loop.

These would likely help surface the issue, which is likely due to some state being shared between subsequent calls to the mapping functions.
Finally this isn't the cause of the issue, but if you are refactoring a bit to solve the problem it may be worth considering this: I'm not sure if implementing this will be practical, but there are some bigger picture architectural issues with writing HTML to disk and serving it out that way.  Writing to disk is slow & unreliable, and this approach will eventually fill a machine's disk space causing failures.  (Also hosts like Heroku may not allow deployment of things that write to disk in this way.)
Instead wherever you want specific HTML, in a web context you typically write a new view, with a new URL, something like /heatmap/?city=chicago&year=2023 that would return the HTML as a response.  Then you can use those URLs instead of HTML from disk.


text:
Dataset used and results in Gemma-2-9B results

Thanks for the great product.
I am so impressed with your research that I have tried it many times.
However, the results with Gemma-2-9B are very different from your results.
The score was even Iter-3 lower than the original Gemma2-9B-it.
My question is, what did you use,
UCLA-AGI/data-mistral-7b-instruct-sppo-iter[x]?
I am aware that these or others were based on UltraFeedBack, and the Github code was the same.
Sincelery, Kazuya

Incidentally, another Prompt dataset I prepared scored better.
But the Iter3 Gemma-2-9B you provided scored even better.
So I have my doubts that the data set was achieved with 3 iterations of about 20,000 cases.

@hodachi-axcxept ,  the UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 was achieved by running the script https://github.com/uclaml/SPPO/blob/main/run_sppo_gemma-2.sh. This is the exact script we used (batch size and accumulation steps might differ for different models, all other hyperparameters are the same).
The prompt sets used are UCLA-AGI/data-mistral-7b-instruct-sppo-iter${i}

@angelahzyuan
Thanks for the thoughtful reply.That's what I needed to hear.So it looks like the results are not constant.I used the same shell, same data set.

@hodachi-axcxept We've never seen that happened. The same settings always work for all models that we tried. Pretty stable on our end.
Please report more details. e.g. your results of both 3 iterations, your config and prompt when during evaluation. Your machine used. So that we could discuss potential reasons.

@angelahzyuan
Thanks for checking.
I rather believe in your research. That's why I'm doing a lot of research to prove it and to instill this research as a technique to create a lightweight model future. So I wanted to clarify if it is a matter of my methodology or if there is something I don't know.
From now on I will try again but the configuration I went with is as follows
Machine and environment (otherwise as installed on Github)
A100×8 (Runpod) 80GB
pytorch 2.3+py3.10+cuda11.9.0 ubuntu22.04
VLLM (https://github.com/vllm-project/vllm/commit/80ca1e6a3a28a0373dc00c5b4fe956c16de952fa)
Contents of run_sppo_gemma-2.sh.
#! /bin/bash
iter_num=3
for i in $(seq 1 $iter_num); do
if [ "$i" -eq 1 ]; then
MODEL="google/gemma-2-9b-it"
else
MODEL=$OUTPUT_DIR
fi
OUTPUT_DIR="checkpoints/Gemma-2-9B-SPPO-It-Iter${i}"
PROMPT="UCLA-AGI/data-mistral-7b-instruct-sppo-iter${i}"
OUT="data-gemma-2-9b-it-sppo-iter${i}"
echo "running epoch $i"
bash scripts/generate.sh --model $MODEL --prompt $PROMPT --out_path $OUT
bash scripts/pipeline.sh --model $MODEL --iter $i --dataset "synthetic_data_gemma-2-9b-it-sppo-iter${i}_score" --output_dir $OUTPUT_DIR -- num 1 --batch_size 2 --accumulate 2
done
If this is not changed, the upload process uploads the data to UCLA-AGI, so "--org"--"HODACHI" is added in compute_prob.py in generate.sh.
Other than that, nothing else has been changed.
Note that a memory violation occurs in the latest vllm.
Also, when I used UCLA-AGI's PROMPT, it was not uploaded to HuggingFace, so it does not remain there.
If you use my dataset instead, it is below.
HODACHI/mine_synthetic_data_gemma-2-9b-it-sppo-iter1_score
HODACHI/mine_data_gemma-2-9b-it-sppo-iter1_generated
HODACHI/mine_data-gemma-2-9b-it-sppo-iter2_generated
HODACHI/mine_synthetic_data_gemma-2-9b-it-sppo-iter2_score
HODACHI/mine_data-gemma-2-9b-it-sppo-iter3_generated
HODACHI/mine_synthetic_data_gemma-2-9b-it-sppo-iter3_score

The score was better when I did it with my data set described above than with the data set you had prepared. However, my results were lower than your iter3.

@hodachi-axcxept The dataset provided in "UCLA-AGI/data-mistral-7b-instruct-sppo-iter${i}" should not be used for training. It should only be used for prompts. You are supposed to regenerate new dataset for training, just as what you seem to have done above.

@angelahzyuan
Thank you for response.
My understanding is that if "UCLA-AGI/data-mistral-7b-instruct-sppo-iter[i]" is specified, a data set is automatically created with the results generated using that Prompt, ranked by rank. I am aware that training is then performed based on that dataset, and that is what happened when I traced the sh file.
I used that sh, so I don't think it affects the results, no?

For example, responses_0_0.json looks like this
The principle is that 5 of these are created, and after ranking these, the training date set is the best one created, right?
0"latex \documentclass{article} \usepackage{tabular} \usepackage{amssymb} \begin{document} \section{Results} This section presents the findings of the study comparing the two groups. \subsection{Group Comparison} A significant difference was observed between the two groups on the primary outcome measure. This difference is summarized in the table below: \begin{table}[h] \centering \begin{tabular}{|l|c|c|c|} \hline \textbf{Variable} & \textbf{Group 1} & \textbf{Group 2} & \textbf{p-value} \\ \hline Outcome Measure & Mean $\pm$ SD & Mean $\pm$ SD & \\ \hline \end{tabular} \caption{Comparison of Outcome Measure between Group 1 and Group 2} \label{tab:group_comparison} \end{table} \subsection{Treatment Effectiveness} The treatment was found to be effective for a wide range of conditions. \subsection{Statistical Analysis} Statistical analysis was performed using a [insert specific statistical test, e.g., t-test, ANOVA]. The [insert specific software, e.g., SPSS, R] software package was used for all analyses. \begin{lstlisting}[language=R] # Example R code snippet t.test(Outcome_Measure ~ Group, data = study_data) \end{lstlisting} \end{document}  Please Note: * You will need to replace the placeholders in the table and code snippet with the actual data and statistical details from your study. * You should also include a description of the outcome measure and the specific conditions for which the treatment was found effective. This LaTeX code provides a basic structure for presenting your results. You can customize it further to meet the specific requirements of your publication. "

@hodachi-axcxept I haven't checked other details yet. What I see here is the batch size is different than ours. If you use batch size=2, accumulation steps should be 4. That might be our typo, if batchsize 4 is too large for A100 80G.

@angelahzyuan
I see. So there is a possibility that there is no convergence thereby.
Thanks for the tip. I'll give it a try.

Hi @angelahzyuan thanks for your work! I want to know if the number of epochs per iteration is 1 or 18 in the case of gemma2. Also, what is the motivation for the same.

authors: Arnav0400 angelahzyuan hodachi-axcxept

repo: uclaml/SPPO


text:
removed unneeded description from Jokes Controller

Removed unneeded description based on the example frontend

LGTM

authors: aardvarkzone bonniehuynh