text:
RFC: file formatting change

As this list has grown and matured the quality of coverage has grown.
to curate the list comments have become more frequent, such as
0.0.0.0 adelogs.adobe.com  #See http://www.theregister.co.uk/2014/10/07/adobe_digital_editions_4_caught_snooping_into_ebook_collections_of_users/
or 0.0.0.0 static.smni.com  # Santa Monica - popunders
this is really useful at a glance, however it makes using the list as a data source for conversion to larger scale functions, eg: dns servers, in my specific usecase bind for RPZ zones quite trouble some as the bind (common in all dns servers though ) format of
"IP" "ZONE "RECORD TYPE"
ends up with
"IP" "ZONE" "COMMENT-RECORDTYPE MERGED"
for example
0.0.0.0 adelogs.adobe.com  #See http://www.theregister.co.uk/2014/10/07/adobe_digital_editions_4_caught_snooping_into_ebook_collections_of_users/ CNAME .
This is possible to overcome but it does require more complex regex than is needed if a file format change was applied where the comments where placed above the offending line - it would be easy to filter content from comment
eg:
#See http://www.theregister.co.uk/2014/10/07/adobe_digital_editions_4_caught_snooping_into_ebook_collections_of_users/
0.0.0.0 adelogs.adobe.com
that way filtering anything that didn't start with 0.0.0.0 as valid content is simple, comments are still possible and applications that honour # as a comment are not impacted.

Hi Matt @ikonia I'm toying with the concept of providing compact version of all our hosts files.

Pure hosts files with no comments, sorted by domain asc, tld asc, subdomain asc, subsubdomain asc (pseudocode)
List of domains, sorted as above, without the IP address prefix.

My hostsTools repo (written in Go) can do this now but, beware, I still need to document that.  It's coming.
The plan is to add that, or a variation of that feature, to this repo.

@StevenBlack that seems a really good approach, I do see the value in the comments as the list grows, but maybe this would go away if it was split out into multiple smaller lists, which the definition of the list the individual URLS fell into would act as a guideline or top level comment.
I'll have a look at your host tools repo and will be a happy guinea pig on this, as I really see the value of these lists, I'd just like to try to get it a little more generic format so that the lists can maintain their high standard of curation, while also being available for use for generic solutions.

authors: StevenBlack ikonia

repo: StevenBlack/hosts


text:
List of Windows 10 tracking / telemetry / ads hosts?

I want to do some research into this whole Windows 10 tracking / telemetry / ads fiasco.
To give me a head start, is there a list of known hosts used for those purposes?
IOW, not a list of hosts for used by every advertising / tracking provider in the world: just a specific list for hosts used by Windows 10 for tracking / telemetry / ads.

https://github.com/StevenBlack/hosts/issues/154#issuecomment-236422378

i also just came across this so im going to try it https://www.safer-networking.org/spybot-anti-beacon/

seems like a good program, added some extra protection. the only extra host it added was:
0.0.0.0 choice.microsoft.com.nstac.net

@berrythesoftwarecodeprogrammar Thanks so much Berry.  Are there any curated lists that are being kept updated for this purpose?  With the forced-updates design of Windows 10, MS can add/modify which hosts all Windows 10 systems connect to at any time (or even have some systems connect to certain hosts, while other systems connect to different hosts).
For the spybot anti beacon software you mentioned, did it just include that one host, or was that just the only host that was not included in this repo?

@Gitoffthelawn that was just the only one not included in the other list i pasted. which was a list i think i extracted from the Destroy Windows Spying program, or something similar

There are just a variety of programs which aim to stop windows spying, especially W10 related stuff. A bunch of them bundle hosts entries with them and I put together the ones which I used. I trust the Spybot team, since I've used their software for a long time and I think they would have the most reliable and up to date list of hosts.

Here are the previous links and more, for anyone who hasn't seen the other thread:
https://www.privacytools.io/#win10 -- Links to various tools and information about Windows 10 spying
https://fix10.isleaked.com/ -- Guide to disabling most of the bad features in Windows 10
https://fix10.isleaked.com/oldwindows.html -- Guide to removing bad updates from Windows 7/8
https://www.safer-networking.org/spybot-anti-beacon/ -- Software to stop telemetry in Windows 7/8/10
http://dws.wzor.net/ -- Software to stop and/or remove unwanted features of Windows 7/8/10
http://ultimateoutsider.com/downloads/ -- GWX Control Panel; Prevent Windows 7/8 from updating to 10

I use the tyzbit hosts file and I have these Microsoft/Windows related entries in my myhosts file:
0.0.0.0 a-0001.a-msedge.net
0.0.0.0 a.ads1.msn.com
0.0.0.0 a.ads2.msn.com
0.0.0.0 ad.doubleclick.net
0.0.0.0 adnexus.net
0.0.0.0 adnxs.com
0.0.0.0 ads.msn.com
0.0.0.0 ads1.msads.net
0.0.0.0 ads1.msn.com
0.0.0.0 az361816.vo.msecnd.net
0.0.0.0 az512334.vo.msecnd.net
0.0.0.0 ca.telemetry.microsoft.com
0.0.0.0 cache.datamart.windows.com
0.0.0.0 choice.microsoft.com
0.0.0.0 choice.microsoft.com.nsatc.net
0.0.0.0 choice.microsoft.com.nstac.net
0.0.0.0 compatexchange.cloudapp.net
0.0.0.0 corp.sts.microsoft.com
0.0.0.0 corpext.msitadfs.glbdns2.microsoft.com
0.0.0.0 cs1.wpc.v0cdn.net
0.0.0.0 db3wns2011111.wns.windows.com
0.0.0.0 df.telemetry.microsoft.com
0.0.0.0 diagnostics.support.microsoft.com
0.0.0.0 fe2.update.microsoft.com.akadns.net
0.0.0.0 fe3.delivery.dsp.mp.microsoft.com.nsatc.net
0.0.0.0 feedback.microsoft-hohm.com
0.0.0.0 feedback.search.microsoft.com
0.0.0.0 feedback.windows.com
0.0.0.0 i1.services.social.microsoft.com
0.0.0.0 i1.services.social.microsoft.com.nsatc.net
0.0.0.0 msnbot-207-46-194-33.search.msn.com
0.0.0.0 oca.telemetry.microsoft.com
0.0.0.0 oca.telemetry.microsoft.com.nsatc.net
0.0.0.0 pre.footprintpredict.com
0.0.0.0 preview.msn.com
0.0.0.0 rad.msn.com
0.0.0.0 redir.metaservices.microsoft.com
0.0.0.0 reports.wes.df.telemetry.microsoft.com
0.0.0.0 s0.2mdn.net
0.0.0.0 services.wes.df.telemetry.microsoft.com
0.0.0.0 settings-sandbox.data.microsoft.com
0.0.0.0 settings-win.data.microsoft.com
0.0.0.0 settings.data.microsof.com
0.0.0.0 sls.update.microsoft.com.akadns.net
0.0.0.0 spynet2.microsoft.com
0.0.0.0 spynetalt.microsoft.com
0.0.0.0 sqm.df.telemetry.microsoft.com
0.0.0.0 sqm.telemetry.microsoft.com
0.0.0.0 sqm.telemetry.microsoft.com.nsatc.net
0.0.0.0 ssw.live.com
0.0.0.0 statsfe1.ws.microsoft.com
0.0.0.0 statsfe2.update.microsoft.com.akadns.net
0.0.0.0 statsfe2.ws.microsoft.com
0.0.0.0 survey.watson.microsoft.com
0.0.0.0 telecommand.telemetry.microsoft.com
0.0.0.0 telecommand.telemetry.microsoft.com.nsatc.net
0.0.0.0 telemetry.appex.bing.net
0.0.0.0 telemetry.microsoft.com
0.0.0.0 telemetry.urs.microsoft.com
0.0.0.0 v10.vortex-win.data.microsoft.com
0.0.0.0 view.atdmt.com
0.0.0.0 vortex-sandbox.data.microsoft.com
0.0.0.0 vortex-win.data.microsoft.com
0.0.0.0 vortex.data.microsoft.com
0.0.0.0 watson.live.com
0.0.0.0 watson.microsoft.com
0.0.0.0 watson.ppe.telemetry.microsoft.com
0.0.0.0 watson.telemetry.microsoft.com
0.0.0.0 watson.telemetry.microsoft.com.nsatc.net
0.0.0.0 wes.df.telemetry.microsoft.com
0.0.0.0 win10.ipv6.microsoft.com

The mentioned stuff is an relict from earlier Windows previews. You only need one source, which constalty gets updated, it's this one. The mentioned hosts entries are really used (mostly because Windows Store or search). All others aren't in usage anymore.

Well, we already have someonewhocares.org.

@CHEF-KOCH Thanks, but that list contains much more than just MS Win10 stuff... well, at least I hope so! :wink:

Domains added by DisableWinTracking prevented the store app from downloading updates (potentially no longer the case): https://github.com/10se1ucgo/DisableWinTracking

I see as a plus when something like the store doesn't work: it means that the block works.

@StevenBlack this issue can be closed cause
https://github.com/StevenBlack/hosts/commit/590eeac32ce1a2a6321ba577f732c6c017334827#diff-c36f927ba928cc2158b97e706cc80057R27503
Regards

@FadeMind That's a very useful diff, thank you!
But since it's a static diff, it doesn't provide a continually up-to-date source as the relevant hosts will undoubtedly change over time.

@Gitoffthelawn see: https://github.com/StevenBlack/hosts/pull/185
and https://github.com/FadeMind/hosts.extras

Thanks Tomasz @FadeMind.

@FadeMind Thank you Tomasz!

Hey steven how are u, thanks for the hostslist, but i need in ".txt" mode and direct link, not in a "raw version". please, you could to create in text format for that i can add yours host in "Hosts manager from abelhas". it doesn't not allow to add list in raw without extensions.

Whenever  you use the 'raw' format and put the url into (no matter what program or extension) HOSTS manager it always catches the latest version and merges it with your current hosts file.

CHEF-KOCH CANNOT TO DO WHAT YOU SAY.
https://lut.im/vnr0ezcAW4/ClnsNV0e9CCMsYgT.png

Post the url you used over here.

http://raw.githubusercontent.com/StevenBlack/hosts/master/alternates/social/hosts

Hi @monstertruckpa can you try using a non-Github mirror link – see the last column in the table in the readme.
http://sbc.io/hosts/hosts
Or, say,
http://sbc.io/hosts/alternates/social/hosts

@STEVENBLACK The secondary mirror filehost, works perfectly!, gave me not problems. thanks steven, im so happy with abelhas program updater + your yappaplus hosts block list. YUPI!

Remember:

Hosts file was never designed to block ads the way people using it today
Hosts file is slow compared to solutions which can work with regex
It doesn't block all ads on your entire network, only for your local machine
Pi-Hole does the job besser and blocks ads on your entire network before they reach your router, so no extensions/root or other stuff necessary
DNSname resolution slows down DNS upstream resolution, especially while you use your own DNS with e.g. Pi-Hole, Unbound or in case you need to valide via e.g. DNSCrypt
Windows 10 by default can bypass certain (FDQN's](https://www.petri.com/windows-10-ignoring-hosts-file-specific-name-resolution)
Windows 10 RS 3+ never connects to any of these mentioned hosts, I tried that and I can proof it, depending on the telemetry option you choosed on the setup or afterwards via gpedit.msc it uses akamai CDN's instead (Pro versions calling more often home compared to Enterprise version).
ASN blocking is 2x faster, more efficient and easier

I like your ideas, @CHEF-KOCH. Modern Windows versions come standard with the Windows Firewall which can also block IP ranges/networks. I have a geoIP project I started for local resolutions using the GeoLite2 files from MaxMind, and this could easily be integrated with Steven Black's hosts files by first resolving all the NS records for a domain, and then resolving those IPs to networks/ASNs as you have described above. I see you don't yet support IPv6, I have also been slow to support it just because I have been a bit lazy to implement the calculations for it. But making a seamless process to join Steven Black's hosts files + GeoLite2 + Windows Firewall would be a great smart firewall that doesn't require any additional executables and can be solely scripted to do the resolutions from the hosts files and then configure the firewall. I realize this does nothing for your Linux project, but I just wanted you to know I have definitely been inspired by your comments.

Wait, you are setting rules to Firewall as ADMINISTRATOR.

Windows 10 by default can bypass certain FDQN's

That's because the OS has user profiles with more privileges than Admin (You).
Just use Process Explorer by Sysinternals and look at the properties of some svchost.exe instances. You'll see:
USERDOMAIN: NT AUTHORITY
USERNAME: LOCAL SERVICE

This user profile is the system itself and is greater than Admin.

LOCAL SERVICE can override the Firewall rules set by ADMINISTRATOR

Not correct and neither not an reliable solution:

MS patches dnsapi.dll here and there.
DNS lookups not use hosts file, before windows 8 they used deprecated gethostbyname() method.
User rights have nothing much to do with firewall blocking, cause this is by WMI, which runs at the same rights then the RPC mapper to monitor the events otherwise a normal admin would't even see any of the events, gaining NT autority rights is anyway easy peasy via ms own PsExcec e.g. psexec.exe -i -s %SystemRoot%\system32\cmd.exe but that not changes the fact that windows own solution is related on AD DS, which is a real problem

I'm not going more into details because it's not really helpful since you simply can turn off and use alternatives (which e.g. also supporting regex and other things to make your life easier).

Thank You CHEFKOCH for your explanation. very helpful all what you tell us.

@Tobias-B-Besemer, maybe you're crew might be interested in another project? A binary package to configure both the hosts file and Windows Firewall (see my post above). I have been dabbling in my geoIP project for a while just because I do have a day job and haven't gotten to completing the actual search script yet, but the core calculations for IPv4 are all there if you want to use my script as pseudo code for your project. Or you can wait for a while for me to draft up a script which actually does all that and then you can use it as pseudo code and port it to C#.

CC @D4rkCr0w, as he made the code...

Hi Steve. I need to exclude telemetry, from whiteip. Do you have any file (download url) about this? Thanks in advance

I'm not sure I understand, @maravento.
The  whiteurls list will need modification to prefix 0.0.0.0 or 127.0.0.1 on each line, then you'll need to add its details to an update.json file, then generate your own hosts file using updatehosts.py.
Is that what you're asking?

I just need a telemetry list. It does not matter if the list has prefixes or not (0.etc or 127.etc)

There is no separate extension or specific data source for telemetry, they are all grouped together with malware, adware, and other generic unwanted players. You would have to go through and manually read the comments to separate out telemetry from everything else. Our sources are usually pretty well commented, so that is probably your best option.

It would be good to build a list dedicated exclusively to telemetry. I am trying to make one (HERE), which I have obtained from different sources, but I have not been able to use it because it has many false positives. Keep investigating. Thanks for your help

If someone wants to take on a personal project, you could reach out to each of the data sources to see if they would be willing to use standardized tagging of some kind using comments to categorize each entry for why they curate each entry. If all of the data sources can agree on a standard, then the aggregate here can easily be filtered through a script to separate out categories further. There's nothing really we can do downstream once it gets to our end though and all of the data sources use their own disparate curation methods

here is my test repository, in case you want to continue with this project (since I do not work with windows host format) https://github.com/maravento/telemetry
pd: the repository will be removed soon

There exist a PowerShell project https://github.com/W4RH4WK/Debloat-Windows-10 but there seems to be a lot of issues with it (https://github.com/Microsoft/MS-DOS/issues/395#issuecomment-478330019).

There exist a PowerShell project https://github.com/W4RH4WK/Debloat-Windows-10 but there seems to be a lot of issues with it (Microsoft/MS-DOS#395 (comment)).

Don't use the one by W4RH4WK ! It's buggy beyond functional, use https://github.com/Sycnex/Windows10Debloater instead.

Just an FYI, blocking watson.telemetry.microsoft.com caused XBox Update to fail to start updating with the latest Xbox OS patch. I'm leaving this comment here for posterity. Maybe it'll help someone else.

@CraigHead Thanks for posting Craig. That's real ugly behavior if MS is breaking things when telemetry is blocked.

Windows Debloater is pointless, it does not offer more than GPO/registry already does and instead that people actually read the GPO toggles and switching it themselves (or use the already existing script by MS they run into gimmick tools which getting abandoned after 1 year - most of them are "dead").
In later Windows 10 versions (1903/1909+) Telemetry is (not that much of a problem anymore), see source here, here and the original source. From my observation there is only telemetry once WUS is triggered or if you on a lower Windows 10 version (Home/pro) under other circumstances too e.g. via App updates/store updates (ads in general delivered via apps -> but that's ads/tracking/statistics).
However, since I'm not a BSI "fan" I know this analysis is not fully objective (and they - this time after my complaint - wrote "might be different in the real-world"). Which means MS still can change, improve or bork it with each new KB or major update.
Most of the mentioned domains are in no relationship with telemetry and added based on pure speculation as well as "guessing" e.g. the live.login domain.

Most of the mentioned domains are in no relationship with telemetry and added based on pure speculation as well as "guessing" e.g. the live.login domain.

Interestingly I was working on a Windows 10 machine and I accidentally clicked on some help dialog and Microsoft Edge popped open, which is not the default Web browser, and AVG actually popped up with a threat detection and made the following report:

AVG Real-time Shield Scan Report
This file is generated automatically

Started on: Thursday, February 6, 2020 4:16:13 PM

2/6/2020 6:09:19 PM	https://login.live.com/login.srf? CENSORED - [L] URL:Phishing (0)

I censored the full URL from the report, but obviously the Avast team agrees that login.live.com is a threat indicator. Anybody else get any similar reports from other antivirus or similar software? I am by no means saying I agree with everything the Avast team has to say, but I will say there does seem to be a professional consensus around this particular topic. I'll also note that login.live.com is not currently on any of our blacklists.
From doing some quick research, it seems like login.live.com has been involved in several high-volume e-mail phishing scams. I cannot say if the domain itself is malicious, but I believe malicious players are using it to such a degree in phishing campaigns as to make the domain itself an indicator of possible threat, even though it itself may not be a threat itself.

Microsoft's forums as well as every other top 1000 domains are well known for phishing attempts, fake login pages, XSS etc. What's the news here. Top-level domains and logins are always be a high level target.
Again this is not related regarding telemetry and AVs are known to be snake oil. As they very often lead in privacy as well as security problems (MITM, data leakages, etc).

I completely agree with everything you've said, @CHEF-KOCH, don't get me wrong. Obviously the highest profile domains are the ones that are going to get attacked the most. However, that varies slightly from this particular case of BEC, business e-mail compromise, which is currently the number one fraud threat for organizations. I am not talking about attacking Microsoft, I am talking about misrepresenting Microsoft domains to target Microsoft end users with phishing scams, which in turn degrades the reputation data of otherwise known good domains by associating them at high volume to threat actors.
So the real targets here are not the owners of the high-profile domains, but rather the end users, which are obviously many in number and work well with cold e-mails and doesn't necessarily have to employ any special spear phishing tactics to be effective. High-profile domains getting flagged as a result of this reputation data is just collateral damage, possibly even secondary targets, but they are not the primary targets or focus of these attacks.
I think the thing to remember for all of us, especially those security professionals among us, is that although we may have been trained to subconsciously detect phishing e-mails and spam at this point, this vector is still wildly successful and is still a serious threat to those some of us are charged to protect. I still feel perplexed every time a family member or friend comes to me and tells me how deep they got pulled into an e-mail scam of some kind. They just don't have the same mental filters of those technically and security-inclined, as such things are just not top of mind for the average person.
Obviously no matter how you take any of this it still may seem like a silly idea to flag such high-profile domains based solely on this reputation data, especially since the domain operators did nothing wrong and their domains pose absolutely no risk by themselves. However, most threat protection is automated to a high degree these days and even high-profile domains are not differentiated if the indicators are all there to raise alarm. And I am by no means making an excuse for the possible high number of false positives, but the systems are currently set up to as rapidly as possible respond to threats and protect the greatest number of people possible, which is obviously going to have many errors like any numbers game.
Domains owned by Netflix and PayPal also get flagged all the time for similar reasons. It's basically impossible to stop them from popping up on blacklists during sustained high-volume phishing campaigns or times where it's trending to misrepresent specific companies in such campaigns because of the sheer volume of data being generated, albeit possibly completely irrelevant data. For the most part, hackers are "monkey see, monkey do" and try copying attacks they read about in the news, so a lot of times you'll see Netflix scams trending for a while, PayPal scams, Microsoft scams, etc. Again, I am not making any excuses, just putting it out there that these things will inevitably happen until our current implementations of machine learning and artificial intelligence can discern such situations on their own.

I personally like the Windows 10 Exorcist on github (sorry I forgot the link).

source: gharchive/issue

authors: 07416 Atavic CHEF-KOCH CraigHead FadeMind Gitoffthelawn MegaphatNetworks ScriptTiger StevenBlack Tobias-B-Besemer berrythesoftwarecodeprogrammar maravento monstertruckpa rautamiekka

license: mit

license_type: permissive

license_source: bigquery


text:
remove codecguide.com site from fakenews-gambling-porn

Hi, I noticed the fakenews-gambling-porn list contains the codecguide.com site twice. I've downloaded the K-Lite Codec Pack for years from there. I just recently added this list to uBlock Origin, but I'm not sure why it's on any list. It's not fake news, gambling, or porn, or even malware. Thanks.

@lucknaumann good catch,definitely false-positive.
If you don't mind report this directly upstream for removal: https://github.com/Clefspeare13/pornhosts/issues
Thanks 👍

authors: dnmTX lucknaumann


text:
Mistake on line 22

I got this error:
bad address at /etc/hosts line 22
This is the line:
fe80::1%lo0 localhost
source: http://sbc.io/hosts/hosts

Thank you for this Waheedullah @waheedullahkhan001.
This is not a mistake. Refs:

https://stackoverflow.com/questions/30851101/localhost-meaning-of-fe801lo0
https://superuser.com/questions/241642/what-is-the-relevance-of-fe801lo0-localhost-in-etc-hosts

Closing.


text:
About GIOU code

    boxes1 = tf.concat([tf.minimum(boxes1[..., :2], boxes1[..., 2:]),                         tf.maximum(boxes1[..., :2], boxes1[..., 2:])], axis=-1)     boxes2 = tf.concat([tf.minimum(boxes2[..., :2], boxes2[..., 2:]),                         tf.maximum(boxes2[..., :2], boxes2[..., 2:])], axis=-1)
It seems like this code is actually doing nothing

@Apostatee To ensure xmin <= xmax, ymin <= ymax;

authors: Apostatee Stinky-Tofu

repo: Stinky-Tofu/Stronger-yolo

license: MIT

license_source: github-api


text:
Travis build has started failing?

https://travis-ci.org/StoDevX/cs251-toolkit/builds/476146856

Looks like it was actually a problem with pytest-cov. Build passes successfully now.

@hawkrives Looks like now it's having trouble logging into Docker: https://travis-ci.org/StoDevX/cs251-toolkit/jobs/476147635#L856

The DOCKER_USERNAME env variable is secret… not sure who set it up, but it's entirely possible that it was me and that my monthly password change policy for public-facing things broke the builds.
I copied my new DOCKER_PASSWORD into a var on Travis, if the build suddenly works then we'll know it was my fault. If not, it might have been @hawkrives—either way I'll set DOCKER_USERNAME to kryestofer and make it not secret so there isn't confusion in the future.

Changed DOCKER_USERNAME to be visible.
Closing again.

Thanks. I'm going to run the deploy to pypi job on there because that version hasn't been uploaded yet.

authors: hawkrives maxnz rye


text:
Implement timeout for download from slow farmers

If a farmer is slow (default: <1mbps), a new pointer is got and a new download for that shard is tried

Coverage decreased (-0.5%) to 46.926% when pulling 45175f310666edcb14b33228f0ad35dbfb593038 on marcorosa:feat-timeout into 5a78febec7019e656575fe950dc3f0e238933bf1 on Storj:develop.

source: gharchive/pull-request

authors: coveralls marcorosa

repo: Storj/storj-python-sdk


text:
Process Mode init in _ready

Hey, cool addon! I found a problem when I was using it. I've tried to upload results in my own Autoload script and found that  PlayfabManager is not working in Pause mode. Is that made intentionally?

Hey! Thanks! But I don't know what to do in the text example scene for this change. I just faced an issue, that when you have get_tree().paused = true  - my own helper class which used the PlayFabManager stopped working. I have added this line to my own class at first with no luck, but after some thinking - I come up with this solution and all worked.

Hey! Should I just create test example where I pause something, and the Plugin stopped working? :)

I am so sorry for the long wait! life and not reading my notifications cam in between 😬
Well, I imagine a pause button, while in the background you can still see the checks for whether events are batched to be sent (shown in console).
Another thing to consider is, that the mode should really be settable by the developer via the Plugin config. But I suppose that can be a separate task.

Thinking about this more: this change would introduce a breaking change. In order to not make this breaking, this must be a project setting that defaults to PROCESS_MODE_INHERIT.

authors: JEuler Structed

repo: Structed/godot-playfab


text:
🛑 Nextcloud Papa is down

In 86fd146, Nextcloud Papa ($NEXTCLOUD_2) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Nextcloud Papa is back up in deb80c1.

repo: StudFu-WordToMD/status


text:
🛑 Nextcloud Papa is down

In 14f58cd, Nextcloud Papa ($NEXTCLOUD_2) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Nextcloud Papa is back up in b8791f1.


text:
Eject from Expo and configure Android and iOS part separately

Describe the bug
Google, Facebook sign-in don't authorize requests coming from the Expo Go app. This prevents the users from signing into the app from any platform that uses Expo Go app(i.e. other than web).
To Reproduce
Steps to reproduce the behavior:

Go to Login/Register page.
Click on 'Google' or 'Facebook'
See error on Terminal.

Expected behavior
Although this is the expected behavior since Firebase documentation says it doesn't support React Native, we can eject from Expo and use bare React Native app for Android(We would obviously need to setup every module from the Android and iOS side of things).
Screenshots
None
Desktop (please complete the following information):

OS: iOS or Android
Browser: None
Version: Not required

Smartphone (please complete the following information):

Device: Pixel 4a
OS: Android 11
Browser: Not required
Version: Not required

Additional context
None

Android setup fixed after ejecting from Expo with the latest commits.


text:
rock paper scissors game

please assign this to me

@lordvader501 Assign to you


text:
linter for jade templating engine

Please find linter for jade templates:
https://github.com/tardyp/SublimeLinter-jade
Its very basic, as the original jade tool does not provide too much diagnostics, but that is better than nothing.
This is a request for inclusion in official linters.

It's early days, but I'm working on a Jade Linter that will pick up parser errors and allow users to force style conventions; https://github.com/benedfit/jadelint
I can keep you posted on how is progressing if you're interested?

Please do! Once you feel ready you should consider creating a plugins or it  as well.

I've created the plugin for an early version of the linter (more rules to lint against still under development) in #309

Closed thanks to @benedfit

authors: benedfit grotewold tardyp


text:
field / method names highlighting should be consistent when ( ) used

Moved to https://github.com/PowerShell/EditorSyntax/issues/107

repo: SublimeText/PowerShell


text:
BUG: Increase card's width in blogs section

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
the cards are very close to each other and width is small it is not looking good need to improve the cards in blogs section.
Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

Blog section is already being handeled by someone.

authors: Suchitra-Sahoo jahnaviyallamelli

repo: Suchitra-Sahoo/AgriLearnNetwork


text:
Renaming PDF fields doesn't seem to work on fields used more than once

I.e. if the there's two fields with the same name, the tool can't seem to rename any of them, even if all of the renames that you give to each are the same name. Gonna take a quick look at this now, it wasn't blocking, but did confuse me for a bit.

Realizing how light of a wrapper this is over FormFyxer. This issue is almost certainly something wrong on that side, so I'll move it to that repo.

repo: SuffolkLITLab/docassemble-ALDashboard


text:
Add clarifying text to help people understand they need to list all income of each kind in one box

Question ID
What expenses do you have right now

language
Other income (previous screen), other expenses, other debt payments. It would be great if we can make these into a loop for each one, but that functionality can be added later. For now, we should tell the user if they have more than 1 additional item, they should list them all in the text field and add up the total in the $ field. (obviously with better language.)

Other information

Variable being sought
user_expense_none

Package version
1.1.4

Maturity target
Level 4 - this is purely an enhancement to improve user experience

Tester contact info
mnewsted

@mnewsted the biggest issue for this is that the question asks for "total income". But it could be a good future goal to make the monthly income into a list.
A compromise is to ask for just the "other income" on its own page.

We could ask for the total income for each category, but still let people add multiples. Avoiding issue of income changing six months through the year.
We could have a pop-up calculator.
We could have a radio button that lets people switch back and forth between "calculate it for me" and "my income varied over the last 12 months"

i like the compromise suggestion. Can we have all the "other" items (income in last month, income in last year, expenses, debt) on a separate page if the other... is checked? If checked, then ask for source/debt/expense (short title/name) and amount. Having an +Add another button on the same screen would make it easy. Could we use a generic object as long as we define the description of what we are asking for? For other income in the last 12 months, i'm inclined to leave this blank for the user. I am okay with not including an automatic calculation function (calculate it for me), but a pop-up calculator might be helpful, pretty much on any of the $ amount screens.

repo: SuffolkLITLab/docassemble-IlFeeWaiver


text:
🛑 Sukanyeah Blog is down

In 97e0063, Sukanyeah Blog (https://ml.sukanyeah.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Sukanyeah Blog is back up in e5f8987 after 9 minutes.

repo: Sukanyeah/Uptime


text:
Add Angry Bird Game.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
What problem is this feature trying to solve?
How do we know when the feature is complete?

@Sulagna-Dutta-Roy Please assign me this issue.

repo: Sulagna-Dutta-Roy/GGExtensions


text:
uno game extension

Is your feature request related to a problem? Please describe.
this feature includes an uno game extension.
Describe the solution you'd like
Uno is a fast-paced card game where players aim to be the first to empty their hand by matching cards in color or number, while strategically using action cards to disrupt opponents' progress.
What problem is this feature trying to solve?
Uno is known for its simple rules and dynamic gameplay, fostering lively competition and strategic thinking among players of all ages.
How do we know when the feature is complete?
the user will be able to play uno game

Someone already raised before #731 #793. Kindly raise new Issues


text:
🛑 Chem Exper is down

In 821292d, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 6449eee.

repo: Sulstice/Uptime-Cheminformatics


text:
🛑 Chem Exper is down

In d018f20, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 113dec1.


text:
🛑 Chem Exper is down

In a3c620a, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 09e2e2f.


text:
🛑 Chem Exper is down

In 69aabf8, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 8970871.


text:
🛑 Chem Exper is down

In 7ec1e93, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 5586538.


text:
🛑 Chem Exper is down

In 2239aee, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in d86dee4.


text:
🛑 Adverse Drug Reaction Classification System is down

In 0adf8de, Adverse Drug Reaction Classification System (http://bioinf.xmu.edu.cn/ADReCS/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Adverse Drug Reaction Classification System is back up in 98e98d1.


text:
🛑 Zinc 15 is down

In 885bc71, Zinc 15 (https://zinc15.docking.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Zinc 15 is back up in 86601e6.


text:
🛑 Zinc 20 is down

In f659291, Zinc 20 (https://zinc20.docking.org) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Zinc 20 is back up in 05f9e51.


text:
🛑 Binding Database is down

In 5a4d9ec, Binding Database (http://www.bindingdb.org/bind/index.jsp) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Binding Database is back up in fddbbdd after 18 minutes.


text:
🛑 Chem Exper is down

In df3a72b, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 0f947f5 after 9 minutes.


text:
🛑 Chem Exper is down

In d45df43, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in afeee53 after 13 minutes.


text:
🛑 Comparative Toxicogenomics Database is down

In 9520bc6, Comparative Toxicogenomics Database (http://ctdbase.org/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Comparative Toxicogenomics Database is back up in 70de8b1 after 11 minutes.


text:
🛑 Chem Exper is down

In d0397dc, Chem Exper (http://www.chemexper.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Chem Exper is back up in 190052f after 31 minutes.


text:
🛑 Metabolites Biological Role is down

In 8414e1c, Metabolites Biological Role (http://csbg.cnb.csic.es/mbrole2/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Metabolites Biological Role is back up in a2606aa after 31 minutes.


text:
🛑 Binding Database is down

In 08c4f55, Binding Database (http://www.bindingdb.org/bind/index.jsp) was down:

HTTP code: 404
Response time: 913 ms

Resolved: Binding Database is back up in 10580ac after 17 minutes.


text:
🛑 Adverse Drug Reaction Classification System is down

In a63f2fa, Adverse Drug Reaction Classification System (http://bioinf.xmu.edu.cn/ADReCS/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Adverse Drug Reaction Classification System is back up in 8213598 after 6 minutes.


text:
🛑 ITK Analysis of Large Histology Datasets is down

In 5b25dcd, ITK Analysis of Large Histology Datasets (http://www.na-mic.org/Wiki/index.php/ITK_Analysis_of_Large_Histology_Datasets) was down:

HTTP code: 502
Response time: 242 ms

Resolved: ITK Analysis of Large Histology Datasets is back up in 2bc7fba after 18 minutes.

repo: Sulstice/Uptime-Medical-Informatics


text:
docs-testing

Purpose of this pull request
This pull request (PR) ...
Issue number:

Select the type of change:

[ ] Minor Changes - Typos, formatting, slight revisions
[ ] Update Content - Revisions and updating sections
[ ] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - Updates, maintenance, and new packages for the site, Gatsby, React, etc

thank you again for your help, @bhargavisumo !

authors: bhargavisumo kimsauce

repo: SumoLogic/sumologic-documentation


text:
Update existing-collectors-and-sources.md

Update the windows commands to the correct values. Net restart is not a valid windows command.
Purpose of this pull request
Update the windows commands to the correct values. Net restart is not a valid windows command.
Select the type of change

[ ] Minor Changes - Typos, formatting, slight revisions
[ x ] Update Content - Revisions, updating sections
[ ] New Content - New features, sections, pages, tutorials
[ ] Site and Tools - .clabot, version updates, maintenance, dependencies, new packages for the site (Docusaurus, Gatsby, React, etc.)

Ticket (if applicable)

thanks, @itsthepo !

authors: itsthepo kimsauce


text:
docs: change logLevel to loglevel for Logging exporter

logLevel only worked due to a bug in the upstream that was "fixed" in v0.71.0, breaking many configurations.

Shouldn't it be verbosity: detailed?

https://github.com/open-telemetry/opentelemetry-collector/tree/v0.72.0/exporter/loggingexporter#getting-started

I wanted to do this separately, but I can change it right into verbosity.

repo: SumoLogic/sumologic-otel-collector


text:
ctx.request.form empty on version 2.0.2

from kyoukai import Kyoukai
app = Kyoukai("app")

@app.route("/test", methods=["POST"])
async def test(ctx):
    print(ctx.request.form)

app.run()

Testing with a request requests.post('http://localhost:4444/test', json={'message': 'test'}) gives me ImmutableMultiDict([]) on version 2.0.2 but on version 1.9.2.1 it works and displays {'message': 'test'}.

I don't think Werkzeug parses the body as form data when it's passed as json.
You can probably use get_data to get the body data then manually load it for now. I'll add a custom form data parser that runs on content-type application/json.

Latest commit should allow this. Untested, please let me know if it breaks.

authors: AlbertoOS SunDwarf

repo: SunDwarf/Kyoukai


text:
Issue #LR-676 feat: Delete user

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Type of change
Please choose appropriate options.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Enhancement (additive changes to improve performance)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes in the below checkboxes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[ ] Ran Test A
[ ] Ran Test B

Test Configuration:

Software versions:
Hardware versions:

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

It was a test PR

repo: Sunbird-Lern/userorg-service


text:
Dropdown allignment issue

Student performance
Choose a block and choose a cluster Dropdowns are not alligned properly

Textbook distribution (Textbook distribution LO table and map)
Choose a block and choose a cluster Dropdowns are not alligned properly and font size is different compare to other dropdown

midday meal (both tabs)
Choose a block and choose a cluster Dropdowns are not alligned properly and font size is different compare to other dropdown

This issue is not covered in v5.0 and needs to be analysed.

@htvenkatesh @pandutibil - request you to include this enhancement in v5.0 as part of February sprints

PAT reports are not taken in this version needs to analyzed

authors: RNarmatha TanushreeSG ananya-jain1

repo: Sunbird-cQube/community


text:
Can´t use Version 1.2.0

Hi, after update to 1.2.0 I can't use your Plugin. It missed the http _port option that I can set by my self.
1.1.4 works fine.

It now reads the HTTP port from the homebridge-camera-ffmpeg plugin that is required to be set anyways.

I use your plugin in combination with the homebridge-camara-ui Plugin from Seydx. It need to set the http_port to get a Message.

Ah, I didn't consider that people used it with that. I will see about either reading their config or just allowing an override.
Will give it some thought today and determine the best way forward.

Added override_http in v1.2.1

repo: Sunoo/homebridge-smtp-motion


text:
Web Interface: Code Sharing for DataSource and FeatureSet pages

Right now the two pages have a lot of duplicate code, lets see if we can 'code share'  some of the duplicate code.

Okay, so the DataSource and FeatureSet pages are now in sync, they are using shared web_components but there a lot of code, callbacks, layout, etc that's duplicated. We'll have to circle back to this.

repo: SuperCowPowers/sageworks


text:
🛑 Matrix redirection is down

In 21a10a8, Matrix redirection (https://supersandro.de/_matrix/key/v2/server) was down:

HTTP code: 502
Response time: 179 ms

Resolved: Matrix redirection is back up in 05c668f after 12 minutes.


text:
🛑 Matrix Federation Tester is down

In 40f56ff, Matrix Federation Tester (https://federationtester.matrix.org/api/report?server_name=supersandro.de) was down:

HTTP code: 200
Response time: 9913 ms

Resolved: Matrix Federation Tester is back up in 319a08f.


text:
🛑 Main site is down

In 311a74d, Main site (https://www.superdocu.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Main site is back up in fce1d5c after 9 minutes.

repo: Superdocu/status-page


text:
Repository is outdated, need help maintaining it?

Not really much of an issue. Just that this bot has a lot of potential

yeah sure man, please drop ur discord i really need help
my discord btw:- akshayalok

authors: JadedSieger SupernovaBotDeveloper


text:
ReactJs CheatSheet

hey @Suryansh1720001 Assign me with this issue . I am going to create PR for this.

Hello @Rimjhim20
Go for it. And go through the readme and contributing file first before sending the pull request.
( Also please keep this in mind - don't send any Plagiarized content. )
Thank you

I want to contribute in this repository by adding a ReactJs cheatsheet. Please assign this task to me under Hacktoberfest label.
Thank You!


text:
服务无法安装以及启动

系统环境:
Ubuntu 18.04.5 LTS (GNU/Linux 4.15.0-140-generic aarch64)
面板版本:
github最新
Node 版本:
未知
出现概率:
每次
出现的问题 (BUG):
安装时的问题 (BUG):
--------------- Node Version ---------------
bash: line 34: /usr/bin/node: cannot execute binary file: Exec format error
/usr/bin/node: 1: /usr/bin/node: ELF: not found
/usr/bin/node: 12: /usr/bin/node: Syntax error: word unexpected (expecting ")")
node:
npm:
--------------- Node Version ---------------
Installing git...
bash: line 44: yum: command not found
Reading package lists... Done
Building dependency tree
Reading state information... Done
git is already the newest version (1:2.17.1-1ubuntu0.8).
The following packages were automatically installed and are no longer required:
libdrm-etnaviv1 libllvm8 linux-headers-4.15.0-55 linux-headers-4.15.0-55-generic linux-image-4.15.0-55-generic linux-modules-4.15.0-55-generic
linux-modules-extra-4.15.0-55-generic
Use 'apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
bash: line 46: pacman: command not found
complete.
Download MCSManager...
fatal: destination path 'MCSManager' already exists and is not an empty directory.
complete.
Start to install dependent libraries...
/usr/bin/node: 1: /usr/bin/node: ELF: not found
启动时报错
root@ecs-kc1-large-2-linux-20210409083932:~/129# systemctl status mcsm
● mcsm.service - MCSManager
Loaded: loaded (/lib/systemd/system/mcsm.service; disabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Fri 2021-04-09 09:09:00 CST; 29min ago
Main PID: 1821 (code=exited, status=203/EXEC)
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Main process exited, code=exited, status=203/EXEC
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Failed with result 'exit-code'.
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Service hold-off time over, scheduling restart.
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Scheduled restart job, restart counter is at 5.
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: Stopped MCSManager.
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Start request repeated too quickly.
Apr 09 09:09:00 ecs-kc1-large-2-linux-20210409083932 systemd[1]: mcsm.service: Failed with result 'exit-cod
复现操作步骤:
无法安装，无法启用
即使进入安装文件夹下，使用npm i 也会报错

刚刚你在另外一个 issue 发表问题，我把另外一个关闭了，有情况可以在这里继续讨论。
根据 bash: line 34: /usr/bin/node: cannot execute binary file: Exec format error 相比是 node 环境安装时有错误导致安装失败，一键安装脚本应该会自动化安装好 node 环境才对，但是看起来因为某些因素此环境没有成功安装。
建议尝试手动安装方案：
https://github.com/Suwings/MCSManager/wiki/Linux-下安装与使用详解

如果依然出现问题，可以自行搜索Linux安装nodejs环境，安装最新稳定版即可。

authors: EITSxiaozhai Suwings

repo: Suwings/MCSManager


text:
Chained chainers with fast input causes horrendous performance

https://spark.lucko.me/ieZdfigT10

Images of the setup used:

pack being Craftoria v0.8.0

Seems to happen when machines it triest to insert into are full

Should be fixed in 1.7.2, let me know if the issue persists :)

repo: Swedz/Extended-Industrialization


text:
Farmer doesn't plant or havest Kelp

Idk if this is a bug or not but it would be rly nice

This is already a planned feature. I will mark this issue as planned :)

authors: Swedz ZygZagGaming


text:
Error: SwiftSyntax parser library isn't compatible

Hello @mattt ,
I am trying to use the source code installation method and I get the error provided as the Issue title when running the following commands building up the tool and generating docs and coverage maps:
        swift run swift-doc generate "${SOURCE_CODE}" --module-name <MODULE_NAME> --output "${REPO_DOCS}"
        swift run swift-doc coverage "${SOURCE_CODE}" --output "${REPO_DOCS}/docCoverage.json"
        swift run swift-doc diagram "${SOURCE_CODE}" > "${REPO_DOCS}/graph.dot"

Output - CI (Catalina, Xcode 12):
ld: warning: dylib (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/swift/macosx/lib_InternalSwiftSyntaxParser.dylib) was built for newer macOS version (10.12) than being linked (10.10)
[310/310] Linking swift-doc

Error: SwiftSyntax parser library isn't compatible

Output - Locally (Big Sur, Xcode 12):
ld: warning: dylib (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/swift/macosx/lib_InternalSwiftSyntaxParser.dylib) was built for newer macOS version (10.12) than being linked (10.10)
[310/310] Linking swift-doc
Error: SwiftSyntax parser library isn't compatible

Hi @Panajev, we recently merged support for Swift 5.3 with #183. Working from the latest HEAD of master, I'm unable to reproduce these problems on Catalina with Xcode 12.
$ xcodebuild -version
Xcode 12.0
Build version 12A7209
$ swift --version
Apple Swift version 5.3 (swiftlang-1200.0.29.2 clang-1200.0.30.1)
Target: x86_64-apple-darwin19.6.0
$ swift run swift-doc generate Sources/SwiftDoc --module-name SwiftDoc --format html

I plan to cut a release for Swift 5.3 later today. In the meantime, please try building from the latest on master.

See also #165, #176

This is fixed in swift-doc 1.0.0-beta.5

authors: Panajev mattt

repo: SwiftDocOrg/swift-doc


text:
🛑 swiftfiddle.com/runner/5.6 is down

In 3ed4f20, swiftfiddle.com/runner/5.6 (https://swiftfiddle.com/runner/5.6.3/run) was down:

HTTP code: 503
Response time: 22 ms

Resolved: swiftfiddle.com/runner/5.6 is back up in d8a4aaa.


text:
🛑 swiftfiddle.com/runner/nightly-main is down

In 7e3f41a, swiftfiddle.com/runner/nightly-main (https://swiftfiddle.com/runner/nightly-main/run) was down:

HTTP code: 503
Response time: 64 ms

Resolved: swiftfiddle.com/runner/nightly-main is back up in 7d1abff after 33 minutes.


text:
玩转 Xcode Playground

推荐收录
链接
https://mp.weixin.qq.com/s/rHNrTt7CReTLL8aubz0SqQ
https://mp.weixin.qq.com/s/_kggsB9kL5jYi-40KDMsrQ

辛苦 @anotheren 和 #3141 一起看下，看是不是可以写一段里面

repo: SwiftOldDriver/iOS-Weekly


text:
Regression after Xcode 13 beta SwiftUIX fails to compile

My app fails to compile due to SwiftUIX internal errors after Xcode 13 Beta. It compiles fine on latest Xcode 12. I created a new empty Xcode 13 beta project and was able to reproduce the exact same error.
However, the error only occurs when building for iOS, not macOS. I understand it's a crazy time with the dub dub 2021 and we are only on the 1st beta, so it might take time for you to fix this bug.
Reproduce

Create new empty Xcode project
Add SwiftUIX through SPM
Compile on iOS will always fail

@jevonmao this is fixed on master, I'll be cutting out a new release tomorrow as well. It would seem that you're currently on version 0.0.6 as opposed to master.

@vmanot Thank you!

@jevonmao you should update to 0.0.7 - just released a new version :)

authors: jevonmao vmanot

repo: SwiftUIX/SwiftUIX


text:
JOSS paper: authors contribution

While the repository contain contribution from both the first and last authors I could not find contributions from the other three. Would adding a section/comment detailing the contributions of each authors as is done in other journals be possible ?
https://github.com/openjournals/joss-reviews/issues/4752

We’ve added a section for the author contributions.  The SwiftVISA project started as a Colorado School of Mines’ Computer Science Field Session project.  These students are credited as authors since they demonstrated the that concept works and developed a SwiftVISA wrapper that still works to date.  This includes: Connor Barnes, Luke Henke, Lorena Henke, and Ivan Krukov with Owen Hildreth overseeing the project.  After SwiftVISA was working,  I hired Connor Barnes to write some instrumentation control software using SwiftVISA.  We soon saw the limitations of using a wrapper around the VISA framework and Connor Barnes worked write the rest of the SwiftVISA frameworks, packages, and frameworks.
Added/Updated Text
Contributions
Connor Barnes, Luke Henke, Lorena Henke, and Ivan Krukov wrote the original SwiftVISA framework[@GH_SwiftVISA] wrapping the pre-compiled NI-VISA framework[@NI-VISA_download] with Owen Hildreth supervising their work.  Connor Barnes continued to work and develop the rest of the frameworks, services, and Swift packages in the SwiftVISA organization.  Owen Hildreth continues to supervise the work and maintain the repositories.

authors: MatthieuDartiailh OHildreth

repo: SwiftVISA/SwiftVISASwift


text:
arm64 is missing from ARCHS

Swinject itself builds for M1 Macs, but for some reason SwinjectAutoregistration doesn't:
SwinjectAutoregistration on  master
❯ grep ARCHS .
./Configurations/Base/Common.xcconfig
11:ARCHS = $(ARCHS_STANDARD)

./Configurations/Mac OS X/Mac-Base.xcconfig
19:VALID_ARCHS = x86_64

Could you please fix that?

i have same issue with new carthage 0.37.0 version and xcframeworks.

same issue

made pull request with fix #68

Merged PR #68. Thank you😃

authors: captainOfM pshirshov serg-vinnie yoichitgy

repo: Swinject/SwinjectAutoregistration


text:
Fix build under Swift 5/Xcode 10.2: UIViewNoIntrinsicMetric

Seems like this project was updated to Swift 5, but I wasn't able to build without this additional change.

Xcode 10.2 and Swift 5 changes are mutually exclusive. UIView.noIntrinsicMetric was changed as part of Swift 5. You are likely using Xcode 10.2 but not Swift 5, use an earlier version of SwipeCellKit as indicated in the README.

authors: cardoso kurabi

repo: SwipeCellKit/SwipeCellKit


text:
Adding back performance updates

In favour of: #8

To be merged when these changes are on production again

repo: Swrve/ember-model


text:
How to correctly override templates from UiBundle?

I have created my own custom theme (eg CrimsonTheme) with a third party css-framework and I need to override the templates from the UiBundle (eg Grid); I could put my templates in this location themes/CrimsonTheme/templates/bundles/SyliusUiBundle as stated in the documentation, but this bundle is shared by the default theme for both the shop and the admin UI, so I need a different approach where my new shared templates will only be available for my custom themes, how can I organize this?

@zpi12lmm, this should be overridden in %kernel.project_dir%/templates/bundles/SyliusUiBundle/... not under the themes directory..

@zpi12lmm, this should be overridden in %kernel.project_dir%/templates/bundles/SyliusUiBundle/... not under the themes directory..

In this case, this will override the templates for both SyliusAdminBundle and SyliusShopBundle because they both use templates from SyliusUiBundle, meaning they are shared.
Here's a great example of how to fix this in case anyone else runs into this problem: https://github.com/royalphp/sylius-bootstrap-theme/blob/main/docs/installation_overrides.md

repo: Sylius/SyliusThemeBundle


text:
Many comics deleted from http://thegentlemansarmchair.com/

It leads the script to crash with 404 error.
I'll try to contact the author asap.

For some reason, http://thegentlemansarmchair.com/comic/life-before-facebook/ is the last on the website but on the RSS feed, we can see there there used to be more http://feeds.feedburner.com/TheGentlemansArmchair .
Also, these (and more) can be found on Webtoon: http://www.webtoons.com/en/comedy/the-gentlemans-armchair/list?title_no=469 . Maybe there is an exclusivity deal with webtoon...
Anyway, I've contacted the author and in the meantime, I'll flag local comics as deleted to ensure the retriever doesn't crash on 404 error.

It seems like the website does not exist anymore.

A corresponding tumblr is online though: https://thegentlemansarmchair.tumblr.com

It seems like the original issue does not affect the tumblr.
Let's close this for the time being.

repo: SylvainDe/ComicBookMaker


text:
build: bundle extension with esbuild

目标：使用esbuild压缩与发布somanyconflicts release版本。
分支：build
参考：https://code.visualstudio.com/api/working-with-extensions/bundling-extension

目前写了一个配置，但是貌似TreeSitter会有问题，你知道如何解决吗？ @Shigma

试试看这个？
import TreeSitter from 'tree-sitter'

试试看这个？
import TreeSitter from 'tree-sitter'

提示需要在tsconfig中设置"esModuleInterop": true,

但设置之后会在编译test/index.ts（使用yo初始化项目时自动产生的test suite）时出现错误：

移除index.ts之后可以正常运行，vsce package不再警告，但独立安装后仍有 Error: Cannot find module './build/Release/tree_sitter_runtime_binding'错误

刚刚重新看了一下 dts 文件，之前我说的有误。我先说一下 ts 中模块导出和引入的三种方法：

使用 export { xxx } 导出（export const / function / class / namespace / type xxx 同理），此时应该使用 import { xxx } from 导入。
使用 export default xxx 导出，此时应该使用 import xxx from 导入。
使用 export = xxx 导出（这种写法是 ts 为了 node 兼容性引入的，非 es 标准语法），此时有三种解决方案：

使用 import xxx from 导入
使用 import { xxx } from 导入，同时配置 esModuleInterop
使用 import xxx = require() 导入（这种写法同样也非 es 标准语法，导入的模块同样会有类型标注不用担心）

然后 tree-sitter 和 mocha 的类型定义都是 export = xxx 形式的，所以还是应该直接 import xxx from（同时也不需要配置 esModuleInterop）。
那么为啥 esbuid 会报 warning 呢？这里牵扯到 esmodule 标准执行的问题。
cjs 在 esm 标准被推广之前就已经大行其道，在 cjs 中模块的导出无非就是一个对象，其他模块 require 这个模块的时候，返回的就是这个对象本身，因此这个对象的所有属性都是可以被修改的。
// 1.js
module.exports = { foo: 'bar' }

// 2.js
const ns = require('1.js')
ns.foo = 'baz'

// 3.js
const ns = require('1.js')
require('2.js')
console.log(ns.foo) // baz

然而根据 esm 规范：

9.4.6.8 [[Set]] ( P, V, Receiver )
When the [[Set]] internal method of a module namespace exotic object O is called with property key P, value V, and ECMAScript language value Receiver, the following steps are taken:
Return false.

因此，将上面的写法换成 esm，得到的结果就会不同：
// 1.js
export const foo = 'bar'

// 2.js
import * as ns from '1.js'
ns.foo = 'baz'

// 3.js
import * as ns from '1.js'
import '2.js'
console.log(ns.foo) // bar

回到上面列举的三种导出方法，为什么 ts 要创造一种有别于 esm 的新语法呢？这是因为 cjs 没有 export default，在 esModuleInterop 的帮助下，ts 用户可以使用任何一种方式导入上面的文件，非常方便：
// 源文件 1.ts
const ns = { foo: 'bar' }
export = ns

// 编译后的 1.d.ts
declare ns: { foo: string }
export = ns

// 编译后的 1.js，简化了各种 helper
const ns = { foo: 'bar' }
Object.defineProperty(ns, 'esModule', { value: true })
Object.defineProperty(ns, 'default', { value: ns })
module.exports = ns

// some-file.ts
import { foo } from '1.js'
import ns from '1.js'

这对于 ts 自身的生态没有问题，但是当有了 esbuild 就不一样了。esbuild 作者坚持使用符合标准的实现，导致所有 import xxx from 都会被打包一层 helper，将其中的所有属性都变成 getter，这会导致许多库都没法正常导入。在这种情况下使用上文中提及的第三种方法导入才是最稳妥的选择。
如果要在测试环境也使用 esbuild，同样需要把 mocha 的导入也改掉。

authors: Shigma Symbolk

repo: Symbolk/somanyconflicts


text:
Fatal error in master

After updating to master because of configurable cache, I see this error. Any ideas?
PHP Fatal error:  Declaration of Symplify\EasyCodingStandard\DependencyInjection\EasyCodingStandardKernel::getContainerLoader(Symfony\Component\DependencyInjection\ContainerInterface $container): Symfony\Component\Config\Loader\LoaderInterface must be compatible with Symplify\PackageBuilder\HttpKernel\AbstractCliKernel::getContainerLoader(Symfony\Component\DependencyInjection\ContainerInterface $container): Symfony\Component\Config\Loader\DelegatingLoader in /home/liquid/projects/ehub/portal/vendor/symplify/easy-coding-standard/src/DependencyInjection/EasyCodingStandardKernel.php on line 23

Thanks, I probably used wrong return typehint, trhat is now checked on PHP 7.2.
Do you use 7.2?

Fixed: https://github.com/Symplify/Symplify/commit/6622aa55e0bde4dbfa881be99f29d5611827db74
Tests are passing: https://travis-ci.org/Symplify/EasyCodingStandard

Yes, I am using PHP 7.2. Looks good now. Thanks

authors: TomasVotruba foxycode

repo: Symplify/Symplify


text:
wasm-bindgen version conflict...

Does it not work with the latest wasm-bindgen (0.2.95) ??
cargo metadata exited with an error:     Updating crates.io index
error: failed to select a version for wasm-bindgen.
... required by package leptos-use v0.13.5
... which satisfies dependency leptos-use = "^0.13.5" of package ...
versions that meet the requirements =0.2.93 are: 0.2.93

Are you using cargo-leptos?

Yes.

In this case you're stuck at version 0.2.93 for now. Do you absolutely need the latest version?

I see there is a pull request, is something blocking it getting merged in?
https://github.com/leptos-rs/cargo-leptos/pull/372
My only problem is the version conflict but it makes me nervous because it affects everything in a workspace. web-sys and js-sys also need to be kept at the older version.

This is an unfortunate reality at the moment with the whole web-sys ecosystem. It's still very unstable and has sometimes breaking changes even on patch version increases so it's necessary to pin the versions down.
It's not so bad though because this is "just" a binding for the actual browser JavaScript APIs which are what they are in any case.
I'll release an updated version as soon as cargo-leptos updates.

In my case the problem was fixed simply by deleting Cargo.lock and running cargo check again.

Leptos unpinned wasm-bindgen and is using version 0.2.95 since leptos-0.7.0-rc1. See leptos-rs/leptos#3186.

authors: Nutomic duncanawoods jheuel maccesch sobamemil

repo: Synphonyte/leptos-use


text:
[💡 Feature]: Synpress with fully parallel run with metamask windows

Is your feature request related to a problem?
The problem
Due to hardcoded line await browser.contexts()[0].pages(); in assignWindows function that placed in commands/playwright.js
you not able to run tests with metamask in parallel mode, because context always assigned to the first context during tests run, and all operations with metamask using this first instance.
Describe the solution you'd like.
💡 ### Idea already implemented and in personal use
@noahlitvin @maxhoheiser @r3kt-eth @drptbl @neuodev
📦 The problem
Due to hardcoded line await browser.contexts()[0].pages(); in assignWindows function that placed in commands/playwright.js
you not able to run tests with metamask in parallel mode, because context always assigned to the first context during tests run, and all operations with metamask using this first instance.
📃 Solution (Game changer)
The main idea to set thought initialSetup and init functions the context you want to run each matamask separately.
@noahlitvin
The code follow backward compatibility (e.g previous usage of updated methods is not ruin a code):
📋 commands/metamask.js
...
  //"context" parameter added by Oleksii_Kvasov
  async initialSetup(
    playwrightInstance,
    context,
    {
      secretWordsOrPrivateKey,
      network,
      password,
      enableAdvancedSettings,
      enableExperimentalSettings,
    },
  ) {
    //"context" as a parameter added into "init" by Oleksii_Kvasov
    if (playwrightInstance) {
      await playwright.init(playwrightInstance, context);
    } else {
      await playwright.init(undefined, context);
    }
...

📋commands/playwright.js
...
  //"playwrightContext" (game changer for parralel run) added by Oleksii_Kvasov
  let playwrightContext;
  let retries = 0;
  module.exports = {
...
  //"context" parameter added by Oleksii_Kvasov
  async init(playwrightInstance, context) {
    ...
    //context initializing added by Oleksii_Kvasov
    if(context) {
      playwrightContext = context;
    } else {
      playwrightContext = browser.contexts()[0] //default first context
    }
    return browser.isConnected();
  },
...
  async assignWindows( ) {
    //context pages changed added by Oleksii_Kvasov
    let pages = playwrightContext.pages();
...
  async switchToMetamaskNotification() {
    //context pages changed added by Oleksii_Kvasov
    let pages = playwrightContext.pages();
...

In case if new functions will be added - and another functions that use context for navigation.
Also need to update cypress functions in synpress to use it with cypress commands
Example of use the implemented idea:

You need to run 5 different tests with different metamask wallets in parallel
After updating commands that described above
Add fullyParallel: true into playwright config file
Run your tests with parallel logic
You will have 5 different contexts(browser instances) and 5 different metamask wallets that will run parallel
Green checkmark for passed tests

❗Note: if you adding new network into metamask make sure that for each parallel wallet you have unique rpc url, either you will get 429 error in metamask.
Please make this post more popular, then I will create PR with this updates
Thanks in advance!
Just to simplify search in google:
Parallelisation for synpress using playwright
Parallel run of metamask in synpress
Describe alternatives you've considered.
No response
Additional context
No response

Please guys make this post more popular, then I will create PR with this updates
Thanks in advance!

I created test example for public use:
import { test } from '../src/common/fixtures'
import { initialSetup, acceptAccess } from '@synthetixio/synpress/commands/metamask'
import { Browser, BrowserContext } from '@playwright/test'
import * as playwright from '@synthetixio/synpress/commands/playwright'
import { generateMnemonic } from '@e2eUtils'

test.describe('Connect wallet opensea', function () {
  async function metamaskSetupWithContext(context: BrowserContext, browser: Browser, rpc: string) {
    await context.pages()[0].waitForTimeout(3000)
    const network = {
      networkName: process.env.NETWORK_NAME,
      rpcUrl: rpc,
      chainId: process.env.CHAIN_ID,
      symbol: process.env.SYMBOL,
      isTestnet: process.env.IS_TESTNET,
    }
    const playwrightInstance = browser.browserType()
    const mnemonic = generateMnemonic()
    await initialSetup(playwrightInstance, context, {
      secretWordsOrPrivateKey: mnemonic,
      network,
      password: process.env.METAMASK_PASSWORD,
      enableAdvancedSettings: true,
      enableExperimentalSettings: false,
    })
    await playwright.waitUntilStable()
  }

  test.beforeEach(async function({ context, browser }, testInfo) {
    if (testInfo.title.includes("1")) {
      const rpc = "<rpc_url1>"
      await metamaskSetupWithContext(context, browser, rpc)
    } else {
      const rpc = "<rpc_url2>"
      await metamaskSetupWithContext(context, browser, rpc)
    }
  })

  test('test 1', async function({ page, accountMenuPage, context, browser }) {
    await page.goto('https://testnets.opensea.io/')
    await page.locator('//*[@type="button" and contains(.,"Connect wallet")]').click()
    await page.locator('//li/button[contains(.,"MetaMask")]').click()
    await page.locator('//button[contains(.,"Accept and sign")]').click()
    await acceptAccess(
      {
        signInSignature: true,
      },
    )
  })
  test('test 2', async function({ page, accountMenuPage, context, browser }) {
    await page.goto('https://testnets.opensea.io/')
    await page.locator('//*[@type="button" and contains(.,"Connect wallet")]').click()
    await page.locator('//li/button[contains(.,"MetaMask")]').click()
    await page.locator('//button[contains(.,"Accept and sign")]').click()
    await acceptAccess(
      {
        signInSignature: true,
      },
    )
  })
})

Great work @itev4n7! Would love to see this as a pull request. Cheers!

repo: Synthetixio/synpress


text:
Optimize TUI portion with latest notcurses

I would love to see this optimized for use with the notcurses library to bring better graphics input/output to terminals. https://github.com/dankamongmen/notcurses/releases Example usage: https://github.com/dankamongmen/colloquy

@MarioHewardt Could you bring this up with your SysInt peers who work on this project? The maintainer is a MS employee himself.

Updated title as it's not just the TUI that can be enhanced.

repo: Sysinternals/ProcMon-for-Linux


text:
Update scalafmt-core to 3.7.14

About this PR
📦 Updates org.scalameta:scalafmt-core from 3.4.3 to 3.7.14
📜 GitHub Release Notes - Version Diff
Usage
✅ Please merge!
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

⚙ Adjust future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.scalameta", artifactId = "scalafmt-core" } ]

Or, add this to slow down future updates of this dependency:
dependencyOverrides = [{
  pullRequests = { frequency = "30 days" },
  dependency = { groupId = "org.scalameta", artifactId = "scalafmt-core" }
}]

labels: library-update, early-semver-minor, semver-spec-minor, commit-count:n:3

Superseded by #222.

repo: SystemFw/upperbound


text:
🛑 Beripharma is down

In 3c70700, Beripharma (https://beripharma.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Beripharma is back up in c8da19e.


text:
detects weekStart from momentjs's current locale setting

removed global setting moment.locale
removed weekStart from default params
added setting weekStart from momentjs localeData, if not already set in
options

just to make clear what this is about:
in my language settings, weekStart should be 1 instead of 0.
since we have momentjs already initialized, we can access its settings.
See momentjs docs: Accessing locale specific functionality


text:
No duplicate players

Added checks before a player can join the game.

I updated the tests and now everything should work as expected


text:
Travis using conda envs.

This PR use the latest conda and conda envs for testing.
PS: I am (very slowly) preparing travis to run the tests we have available, so we can use it as a first step to evaluate/review PRs.

@efiring This PR is ready for review now.  Sorry for the apperant "massive" changes in one PR, but they are simple and break down to:

Removed the raw string (r""") in all docstrings. Raw strings are needed only when using math in Sphinx.
Fixed references indentation so Sphinx can render them properly.  BTW I am thinking about removing the reference directive entirely.  What do you think?
Removed unnecessary TODO/FIXME markings in the docstrings.
Removed the "See Also" directive from the docstrings.
Changed comment blocks from tiple quotes to "#".  Triple quotes inside the code can cause some confusion when compiling the docs.

The important changes are some docstrings comparison results and a new travis config that runs the docstring.  I am working on another PR to get check_functions.py working as well.


text:
[Refactor] HTMLreport from SUT protocols to DefaultProtocol

The HTML report is being created in the same way for the different SUT protocols (Desktop, Webdriver, Android, iOS).
https://github.com/TESTARtool/TESTAR_dev/blob/6007a958999dca3ec724771b6157c119786c691c/testar/src/org/testar/protocols/DesktopProtocol.java#L56
https://github.com/TESTARtool/TESTAR_dev/blob/6007a958999dca3ec724771b6157c119786c691c/testar/src/org/testar/protocols/WebdriverProtocol.java#L86
We should refactor it to a common protocol class.

Done with #379


text:
无法安装微调所需要的依赖

System Info / 系統信息
系统信息，加微信14727136596可以获得虚拟机登录方式
Ubuntu 22.04 server 64bit with Tesla Driver 535.1
(jupyterLab) root@ecs-e2fa:~/ChatGLM3/finetune_demo# python --version
Python 3.10.13
(jupyterLab) root@ecs-e2fa:~/ChatGLM3/finetune_demo# nvidia-smi | grep -i cuda
| NVIDIA-SMI 535.154.05             Driver Version: 535.154.05   CUDA Version: 12.2     |
transformers              4.39.2
Who can help? / 谁可以帮助到您？
No response
Information / 问题信息

[ ] The official example scripts / 官方的示例脚本
[ ] My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程
pip install -f finetune_demo/requirements.txt
Building wheels for collected packages: deepspeed, jieba, mpi4py
Building wheel for deepspeed (setup.py) ... done
Created wheel for deepspeed: filename=deepspeed-0.13.1-py3-none-any.whl size=1350305 sha256=caea77ea5ad0f1e8f6c67ecd1a00f8738f08aac38bb43fa1ea52e0c64a73f4c1
Stored in directory: /root/.cache/pip/wheels/0f/fb/b5/b159b3500525eca167d8ca6e3a7e224b6075045cac90f47cf7
Building wheel for jieba (setup.py) ... done
Created wheel for jieba: filename=jieba-0.42.1-py3-none-any.whl size=19314458 sha256=5aa84ed9d26a22361d4606fc59eaec0fd26f30c305e2d79b277df2fefda419a0
Stored in directory: /root/.cache/pip/wheels/c9/69/31/d56d90b22a1777b0b231e234b00302a55be255930f8bd92dcd
Building wheel for mpi4py (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for mpi4py (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [148 lines of output]
running bdist_wheel
running build
running build_src
running build_py
creating build
creating build/lib.linux-x86_64-cpython-310
creating build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/main.py -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/bench.py -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/run.py -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/init.py -> build/lib.linux-x86_64-cpython-310/mpi4py
creating build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/_lib.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/main.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/init.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/aplus.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/server.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/pool.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/_base.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/_core.py -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
creating build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/util/dtlib.py -> build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/util/init.py -> build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/util/pkl5.py -> build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/MPI.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/init.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/main.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/run.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/bench.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/dl.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/py.typed -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/MPI.pxd -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/init.pxd -> build/lib.linux-x86_64-cpython-310/mpi4py
copying src/mpi4py/libmpi.pxd -> build/lib.linux-x86_64-cpython-310/mpi4py
creating build/lib.linux-x86_64-cpython-310/mpi4py/include
creating build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-x86_64-cpython-310/mpi4py/include/mpi4py
copying src/mpi4py/futures/init.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/_lib.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/main.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/_core.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/pool.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/server.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/futures/aplus.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/futures
copying src/mpi4py/util/init.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/util/pkl5.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/util
copying src/mpi4py/util/dtlib.pyi -> build/lib.linux-x86_64-cpython-310/mpi4py/util
running build_clib
MPI configuration: [mpi] from 'mpi.cfg'
checking for library 'lmpe' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -llmpe -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -llmpe: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
building 'mpe' dylib library
creating build/temp.linux-x86_64-cpython-310
creating build/temp.linux-x86_64-cpython-310/src
creating build/temp.linux-x86_64-cpython-310/src/lib-pmpi
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-x86_64-cpython-310/src/lib-pmpi/mpe.o
creating build/lib.linux-x86_64-cpython-310/mpi4py/lib-pmpi
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -shared -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,--no-as-needed build/temp.linux-x86_64-cpython-310/src/lib-pmpi/mpe.o -o build/lib.linux-x86_64-cpython-310/mpi4py/lib-pmpi/libmpe.so
checking for library 'vt-mpi' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt-mpi -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt-mpi: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
checking for library 'vt.mpi' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt.mpi -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt.mpi: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
building 'vt' dylib library
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -shared -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,--no-as-needed build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt.o -o build/lib.linux-x86_64-cpython-310/mpi4py/lib-pmpi/libvt.so
checking for library 'vt-mpi' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt-mpi -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt-mpi: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
checking for library 'vt.mpi' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt.mpi -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt.mpi: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
building 'vt-mpi' dylib library
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt-mpi.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -shared -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,--no-as-needed build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt-mpi.o -o build/lib.linux-x86_64-cpython-310/mpi4py/lib-pmpi/libvt-mpi.so
checking for library 'vt-hyb' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt-hyb -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt-hyb: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
checking for library 'vt.ompi' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -lvt.ompi -o _configtest
/root/anaconda3/envs/jupyterLab/compiler_compat/ld: cannot find -lvt.ompi: No such file or directory
collect2: error: ld returned 1 exit status
failure.
removing: _configtest.c _configtest.o
building 'vt-hyb' dylib library
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt-hyb.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -shared -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,--no-as-needed build/temp.linux-x86_64-cpython-310/src/lib-pmpi/vt-hyb.o -o build/lib.linux-x86_64-cpython-310/mpi4py/lib-pmpi/libvt-hyb.so
running build_ext
MPI configuration: [mpi] from 'mpi.cfg'
checking for dlopen() availability ...
checking for header 'dlfcn.h' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -I/root/anaconda3/envs/jupyterLab/include/python3.10 -c _configtest.c -o _configtest.o
success!
removing: _configtest.c _configtest.o
success!
checking for library 'dl' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -I/root/anaconda3/envs/jupyterLab/include/python3.10 -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -Lbuild/temp.linux-x86_64-cpython-310 -ldl -o _configtest
success!
removing: _configtest.c _configtest.o _configtest
checking for function 'dlopen' ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -I/root/anaconda3/envs/jupyterLab/include/python3.10 -c _configtest.c -o _configtest.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat _configtest.o -Lbuild/temp.linux-x86_64-cpython-310 -ldl -o _configtest
success!
removing: _configtest.c _configtest.o _configtest
building 'mpi4py.dl' extension
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/root/anaconda3/envs/jupyterLab/include/python3.10 -c src/dynload.c -o build/temp.linux-x86_64-cpython-310/src/dynload.o
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -shared -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath,/root/anaconda3/envs/jupyterLab/lib -Wl,-rpath-link,/root/anaconda3/envs/jupyterLab/lib -L/root/anaconda3/envs/jupyterLab/lib build/temp.linux-x86_64-cpython-310/src/dynload.o -Lbuild/temp.linux-x86_64-cpython-310 -ldl -o build/lib.linux-x86_64-cpython-310/mpi4py/dl.cpython-310-x86_64-linux-gnu.so
checking for MPI compile and link ...
gcc -pthread -B /root/anaconda3/envs/jupyterLab/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -O2 -isystem /root/anaconda3/envs/jupyterLab/include -fPIC -I/root/anaconda3/envs/jupyterLab/include/python3.10 -c _configtest.c -o _configtest.o
_configtest.c:2:10: fatal error: mpi.h: No such file or directory
2 | #include <mpi.h>
|          ^~~~~~~
compilation terminated.
failure.
removing: _configtest.c _configtest.o
error: Cannot compile MPI programs. Check your configuration!!!
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for mpi4py
Successfully built deepspeed jieba
Failed to build mpi4py
ERROR: Could not build wheels for mpi4py, which is required to install pyproject.toml-based projects
Expected behavior / 期待表现
安装成功

我也遇到这样的问题，请问最终是如何解决的？

装一个合适版本的mpich:
yum install mpich-3.2.x86_64
验证是否安装正确
which mpicc
如路径不对，则手工加mpicc的PATH
export PATH=$PATH:/data/anaconda3/bin
使路径生效
source ~/.bashrc
pip install mpi4py


text:
微调- chat模型输入输出格式微调样本结构和base 模型的微调样本结构有什么区别

System Info / 系統信息
官方配置A100 4卡
Who can help? / 谁可以帮助到您？
No response
Information / 问题信息

[X] The official example scripts / 官方的示例脚本
[X] My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程
数据准备不存在复现过程
Expected behavior / 期待表现
chat模型输入输出格式微调样本结构和base 模型的微调样本结构有什么区别，前者还具备多轮会话能力吗？

base模型没有对话能力，chat模型有

authors: cssaudrey zRzRzRzRzRzRzR


text:
Map时总会报错或超时

  在 6 * A800 80GB 上微调 GLM-4V，数据用量7500+ 例单轮VQA
在Map时报错如下：
Map (num_proc=6):   0%|                                                                                | 0/7593 [01:30<?, ? examples/s]

[rank2]: ╭─────────────────────────────── Traceback (most recent call last)

.....................
[rank5]: ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
[rank5]: │ /alldata/shared/VLM_project/GLM-4/finetune_demo/finetune_vision.py:458 in main                   │
[rank5]: │                                                                                │
[rank5]: │   455 │   print(Split.TRAIN)                                                                     │
[rank5]: │   456 │   print(process_batch)                                                                   │
[rank5]: │   457 │                                                                                │
[rank5]: │ ❱ 458 │   train_dataset = data_manager.get_dataset(                                              │
[rank5]: │   459 │   │   Split.TRAIN,                                                                       │
[rank5]: │   460 │   │   functools.partial(                                                                 │
[rank5]: │   461 │   │   │   process_batch,                                                                 │
[rank5]: │                                                                                │
[rank5]: │ /alldata/shared/VLM_project/GLM-4/finetune_demo/finetune_vision.py:241 in get_dataset            │
[rank5]: │                                                                                │
[rank5]: │   238 │   │   else:                                                                              │
[rank5]: │   239 │   │   │   remove_columns = None                                                          │
[rank5]: │   240 │   │                                                                                │
[rank5]: │ ❱ 241 │   │   return orig_dataset.map(                                                           │
[rank5]: │   242 │   │   │   process_fn,                                                                    │
[rank5]: │   243 │   │   │   batched=batched,                                                               │
[rank5]: │   244 │   │   │   remove_columns=remove_columns,                                                 │
[rank5]: │                                                                                │
[rank5]: │ /home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/datasets/arrow_dataset.py: │
[rank5]: │ 602 in wrapper                                                                                │
[rank5]: │                                                                                │
[rank5]: │    599 │   │   else:                                                                             │
[rank5]: │    600 │   │   │   self: "Dataset" = kwargs.pop("self")                                          │
[rank5]: │    601 │   │   # apply actual function                                                           │
[rank5]: │ ❱  602 │   │   out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)                │
[rank5]: │    603 │   │   datasets: List["Dataset"] = list(out.values()) if isinstance(out, dict) else [ou  │
[rank5]: │    604 │   │   for dataset in datasets:                                                          │
[rank5]: │    605 │   │   │   # Remove task templates if a column mapping of the template is no longer val  │
[rank5]: │                                                                                │
[rank5]: │ /home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/datasets/arrow_dataset.py: │
[rank5]: │ 567 in wrapper                                                                                │
[rank5]: │                                                                                │
[rank5]: │    564 │   │   │   "output_all_columns": self._output_all_columns,                               │
[rank5]: │    565 │   │   }                                                                                │
[rank5]: │    566 │   │   # apply actual function                                                           │
[rank5]: │ ❱  567 │   │   out: Union["Dataset", "DatasetDict"] = func(self, *args, **kwargs)                │
[rank5]: │    568 │   │   datasets: List["Dataset"] = list(out.values()) if isinstance(out, dict) else [ou  │
[rank5]: │    569 │   │   # re-apply format to the output                                                   │
[rank5]: │    570 │   │   for dataset in datasets:                                                          │
[rank5]: │                                                                                │
[rank5]: │ /home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/datasets/arrow_dataset.py: │
[rank5]: │ 3253 in map                                                                                │
[rank5]: │                                                                                │
[rank5]: │   3250 │   │   │   │   │   │   total=pbar_total,                                                 │
[rank5]: │   3251 │   │   │   │   │   │   desc=(desc or "Map") + f" (num_proc={num_proc})",                 │
[rank5]: │   3252 │   │   │   │   │   ) as pbar:                                                            │
[rank5]: │ ❱ 3253 │   │   │   │   │   │   for rank, done, content in iflatmap_unordered(                    │
[rank5]: │   3254 │   │   │   │   │   │   │   pool, Dataset._map_single, kwargs_iterable=kwargs_per_job     │
[rank5]: │   3255 │   │   │   │   │   │   ):                                                                │
[rank5]: │   3256 │   │   │   │   │   │   │   if done:                                                      │
[rank5]: │                                                                                │
[rank5]: │ /home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/datasets/utils/py_utils.py │
[rank5]: │ :711 in iflatmap_unordered                                                                       │
[rank5]: │                                                                                │
[rank5]: │   708 │   │   │   │   if _get_pool_pid(pool) != initial_pool_pid:                                │
[rank5]: │   709 │   │   │   │   │   pool_changed = True                                                    │
[rank5]: │   710 │   │   │   │   │   # One of the subprocesses has died. We should not wait forever.        │
[rank5]: │ ❱ 711 │   │   │   │   │   raise RuntimeError(                                                    │
[rank5]: │   712 │   │   │   │   │   │   "One of the subprocesses has abruptly died during map operation.   │
[rank5]: │   713 │   │   │   │   │   │   "To debug the error, disable multiprocessing."                     │
[rank5]: │   714 │   │   │   │   │   )                                                                      │
[rank5]: ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
[rank5]: RuntimeError: One of the subprocesses has abruptly died during map operation.To debug the error, disable multiprocessing.
W0702 17:07:27.441000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3021360 closing signal SIGTERM
W0702 17:07:27.471000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3021361 closing signal SIGTERM
W0702 17:07:27.472000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3021363 closing signal SIGTERM
W0702 17:07:27.473000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3021364 closing signal SIGTERM
W0702 17:07:27.474000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3021365 closing signal SIGTERM
E0702 17:07:28.341000 139890717414016 torch/distributed/elastic/multiprocessing/api.py:826] failed (exitcode: 1) local_rank: 2 (pid: 3021362) of binary: /home/WCzhou/workspace/anaconda/envs/GLM/bin/python
Traceback (most recent call last):
  File "/home/WCzhou/workspace/anaconda/envs/GLM/bin/torchrun", line 8, in <module>
    sys.exit(main())
  File "/home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 347, in wrapper
    return f(*args, **kwargs)
  File "/home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/torch/distributed/run.py", line 879, in main
    run(args)
  File "/home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/torch/distributed/run.py", line 870, in run
    elastic_launch(
  File "/home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 132, in __call__
    return launch_agent(self._config, self._entrypoint, list(args))
  File "/home/WCzhou/workspace/anaconda/envs/GLM/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 263, in launch_agent
    raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
============================================================
/alldata/shared/VLM_project/GLM-4/finetune_demo/finetune_vision.py FAILED
------------------------------------------------------------
Failures:
  <NO_OTHER_FAILURES>
------------------------------------------------------------
Root Cause (first observed failure):
[0]:
  time      : 2024-07-02_17:07:27
  host      : comp
  rank      : 2 (local_rank: 2)
  exitcode  : 1 (pid: 3021362)
  error_file: <N/A>
  traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html

同样的问题

所以这个是什么报错我咋没看懂，我自己的jsonl是200是可以

我是1.8w的jsonl，同样的报错，看监控感觉像是内存爆掉了

内存没测过，但是可能要比显存还多？

500G的内存，超过200条数据就报错

我也尝试了一下减少数据到1000左右，但是在Map发现内存占用逐渐增高，最后报错

报错如下

orig_dataset.map()里面batch_size默认1000，改小点可以 return orig_dataset.map(
process_fn,
batched=batched,
remove_columns=remove_columns,
num_proc=self._num_proc,
batch_size = 100,
)

authors: WEIC-7 zRzRzRzRzRzRzR zhouzhoumd