text:
media replication

this should either be a separate module or a plugin, using hyperdrive

It seems like hypercore will fit into osm-p2p-db the browser better right now.

Just back from the field working with a local community monitoring team and have been putting a bit more thought into this.
I don't know if it's necessary to integrate the media storage/replication into osm-p2p-db at all. I think we just need to give each image a URI/UUID and use a standard key/value tag pair on the OSM element.
I think image ids/URIs should include a bucket ID and an image ID. The image ID can be initially derived from its hash, but should remain stable if the image is re-sized: we may want multiple sizes of the image and maintain the ID. If the initial ID is derived from the hash that provides an easy way to check whether we have the original image or a resized/modified version. A bucket ID allows us to keep collections of media in sync online and offline for specific projects. I think in a fully online environment this bucket can sit on a server, but we don't need the server address in the image ID/URI - I think this should be configured at run time when setting up an app with osm-p2p, setting the server or the local sync storage where the image bucket is stored.
I think in many applications storage will quickly become an issue, that means we can't just rely on browser storage. Ideally we will use an external drive as media storage - for size considerations, and also to avoid data loss when a laptop dies (even though the hard drive can sometimes be removed and recovered from a dead laptop, it is often hard to find someone with the skills locally to do that, and laptops die all the time in remote environments). This means that any storage needs to be able to directly access storage and external drives, via electron or a Chrome App wrapper.
We also need to figure out the concepts of selective sync and reduced size sync. For selective sync read-only clients might be all we need: a client will sync all of its media to another peer, but not sync any media from that peer. Since many devices in use will have limited storage as the media bucket grows, need need a way to only sync reduced-size media to some clients. The challenge with this is how to ensure that full-size media eventually reaches where it needs to reach e.g. clients A and B are cellphones, client C is a laptop. Client A has a full-size image, and syncs with B, but only syncs a reduced-size image. Then B syncs with C, but will only have a reduced size image to sync. I think we can work with an eventual consistency scenario where original images are preferred by certain clients, so that in this scenario client C will eventually sync with A, and replace the reduced-size image with the original.

I think image ids/URIs should include a bucket ID and an image ID. The image ID can be initially derived from its hash, but should remain stable if the image is re-sized: we may want multiple sizes of the image and maintain the ID.

This is similar to how osm-p2p-db generates keys for the hyperlog. The initial bucket key is a random string and does not change.

We also need to figure out the concepts of selective sync and reduced size sync.

I think this problem is straightforward to solve in the replication layer but difficult to present to users in an intuitive way that maps to what they want to achieve.
Perhaps the replication UI could consist of a list of checkboxes for:

[x] replicate map
[ ] replicate thumbnail images
[ ] replicate full images

and buttons for adding or excluding specific thumbnail or full images, along with lists of the files that are going to be replicated and a size estimate of the data transfer over the wire for each file and for everything.
This UI would address several use cases:

phone -> phone replication previews to avoid duplicating image collection of some features: select all thumbnails
device -> device replication to share several full size images of specific items of interest to a local community: select the list of full images to replicate manually
phone -> laptop data dump: check all the boxes
phone -> phone replication of only map data: check only replicate map

In the data model, every modification (resize, crop) should point at the hash of the original source image. The metadata for images should be small, so it can be replicated fully.

This issue was moved to digidem/osm-p2p-observations#6

authors: gmaclennan substack


text:
Update mocha, chai, chai-as-promised deps.

I propose this would be a minor version bump.

@mattcollier,

I propose this would be a minor version bump.

Why not just a patch? What's new that is exposed by bedrock? Are mocha and chai exposed in tests outside of the module without those other modules including mocha and chai on their own? If so, we should remedy this in the future (potentially with a bedrock-mocha package as discussed elsewhere).

@dlongley minor because we're doing major upgrades on 3 dependencies.  I imagine there is some breaking change in there somewhere (although I don't know of any specifics).  Seems to me that in a case like this, being able to control an upgrade via semver is desirable.

@mattcollier,
If those dependencies are only used internally, however, it shouldn't matter. If bedrock's behavior via its own API has changed in no way, there's no reason to do a minor version bump.

source: gharchive/pull-request

authors: dlongley mattcollier

repo: digitalbazaar/bedrock

license_type: permissive

license_source: github-api


text:
Missing translation "searchTermDescription"

Describe the Bug
Translation is missing
Steps to Reproduce

Go to 'http://localhost:9000/testumgebung/de/search/?query=gcbcg'
Check Label "searchTermDescription"

Expected Behavior
Translation Text should be displayed

Actual Behavior
Translation Text is not displayed
Additional Information

Traceback

Did you see that on your branch? Did you change the description accidentally? On main this is working

On webnext I can reproduce it (https://webnext.integreat.app/testumgebung/de/search/?query=jjj), not on beta or production though. I guess it got lost during a merge.

source: gharchive/issue

repo: digitalfabrik/integreat-app

license: MIT


text:
[Still in Progress] Add test for media library

Short description

This PR adds test for media library (integreat_cms/cms/views/media/media_actions.py).
Proposed changes

Expand the test for the following actions.

[x] Uploading files
[x] Renaming files
[x] Changing alt texts of files
[x] Replacing files
[x] Deleting files
[x] Creating directories
[x] Renaming directories
[x] Deleting directories

Side effects

Add some new test data
Existing test media file objects are changed to .png, because thumbnail generation during replacing fails with .svg and replacement cannot be testet.
Expected API responses are adjusted due to 2.

Resolved issues

Fixes: #1997 (#2492)

Pull Request Review Guidelines

The test is successfull in a local run but not on git. Could somebody help me with that? 🙏

The test is successfull in a local run but not on git. Could somebody help me with that? 🙏

What I have found so far:
✳ Files integreat-logo.png and malte-logo.png are not created in the directory /media/global on the CI server.
As I understand, they are created locally by loadtestdata.sh, but this script is not running on the CI server.
✳ The replace media file action is the only action, that requires the file to actually exist.

Thank you for review 😸
I've added the last three of your suggestions.

Verify the data received from the various media library endpoints

What do you mean exactly here?

I think this means checking the json in the response itself. Might make sense especially for GET requests, because for POST we check the changes at least in the database now.

Yes, this is what I meant :)

@david-venhoff @seluianova
Thank you for the replies. That's added now 👍

authors: MizukiTemma david-venhoff seluianova

repo: digitalfabrik/integreat-cms


text:
Store integreat-cms.log as an artifact after test run in CI

Short description
Sometimes we encounter test failures in CI that are not reproduced locally.
We can see some pieces of the log in the test output, but sometimes it's not enough to localize the problem.
To make the analysis a bit easier, I suggest attaching full integreat-cms.log as a job artifact.
It will only be available when there are test failures:

Proposed changes

add step "Copy CMS log" to the test job in CI

Side effects
No?
I think it would also be useful to set the logging level to DEBUG, but I couldn't find how to do that :(
I thought this was supposed to be managed by
#: Use debug logging on CircleCI
LOG_LEVEL = "DEBUG"

in circleci_settings.py, but no.
The actual log level in CI is currently INFO.
log example
Maybe someone has some ideas on how to change this?
Resolved issues
Fixes: #2256

Pull Request Review Guidelines

@timobrembeck thank you!
Added logging configuration for integreat_cms and integreat_cms.core.management.commands.
I assume this should be sufficient for analyzing test failures.


text:
sort lists for correct comparison later

I sometimes noticed objects (like devices) are reporting True on .save(), but there where actually no changes.
I found out that the tags list of the initial and changed object sometimes don't have the same ordering, which is fixed by this PR.
I thought of adding a test like this to tests/unit/test_response.py:
def test_serialize_tag_list(self):
    test_values1 = {"id": 123, "tags": ["foo", "bar"]}
    test1 = Record(test_values1, None, None).serialize()
    test_values2 = {"id": 123, "tags": ["bar", "foo"]}
    test2 = Record(test_values2, None, None).serialize()
    self.assertEqual(test1, test2)

But as this test will only fail sometimes, I think it makes no sense to add this test.
But maybe you have a better idea.

Would like to dig more into why we're reordering lists. Have any more specifics around when it happens? Can it be consistently reproduced?

The NetBox API doesn't return tags sorted:
curl -sX GET -H "Authorization: Token $NETBOX_API_TOKEN" -H "Accept: application/json; indent=2" "$NETBOX_URL/api/dcim/devices/?q=xxx" |jq '.results[0].tags'
[
  "san",
  "nfs",
  "gpfs"
]

Also users who update tags maybe doesn't have them sorted.
But to correctly detect a change in tags, you have to sort them both.

We don't have to sort to compare them. I think ideally we'd like to preserve the order from NetBox, but it doesn't seem that's happening at all. Suspect it's being reordered in conversion from set to list, but need to dig into it more.

If you compare lists, you have to sort them:
>>> list1 = ["foo", "bar"]
>>> list2 = ["bar", "foo"]
>>> list1 == list2
False

If you convert a list to a set, the items are maybe reordered:
>>> list1 = ["foo", "bar"]
>>> set(list1)
{'bar', 'foo'}

I say maybe here because: https://docs.python.org/3.6/library/stdtypes.html#set-types-set-frozenset

A set object is an unordered collection of distinct hashable objects.

So you can't rely on the ordering here.
pynetbox is really great in only updating objects in NetBox if they have changes.
But this doesn't work for tags, which this PR fixes for me.
Just add the test I mentioned above and run the tests multiple times.
You will see that it sometimes fails.
With the change from this PR, this test doesn't fail anymore.

If you compare lists, you have to sort them

Yeah, comparing lists considers order, but it doesn't necessitate sorting. Not that I think it's common, or sane, but the order itself can convey meaning that'd be lost if we took it upon ourselves to sort. This may all be pointless if order from NetBox is inconsistent, but I pushed a PR that should fix the issue and preserve order we receive in #271. Thanks for reporting the issue and the PR.

authors: cloos zachmoody

repo: digitalocean/pynetbox


text:
chore(enable typescript-eslint type awareness)

This PR enables typescript-eslint linting with type information. It also fixes a number of resulting lint errors, adding FIXME's to the rest, and overall reorganizes the overridden lint rules in a more sensible way.

enable typed linting
disable all erring rules
remove unused "camelcase" eslint-ignores
remove unused no-unsafe-argument ignores
remove duplicate/redundant rules, reorganize ignores for clarity
remove unnecessary comments from eslint rule overrides

To see the specific tasks where the Asana app for GitHub is being used, see below:

https://app.asana.com/0/0/1208684460890641

Making this a draft PR before it gets way too bloated. Will need to fix (most) of the FIXME's and reevaluate/debate the style rules. Unfortunately tsc errors are not caught by this mode, meaning we can't get rid of the typecheck step :(


text:
Look for .htaccess only on Apache or LiteSpeed

Doesn't make any sense to look for a .htaccess file if bludit is running on other web server that isn't Apache or Litespeed. I've just placed a small verification to not generate errors if you try to install it using Nginx, for example, and the .htaccess file isn't in place.

Can someone test it and provide feedback?

Hi, and what happen if the webserver doesn't have the variable SERVER_SOFTWARE.
Regards

Just pushed a commit to verify if the server has SERVER_SOFTWARE defined. If the variable isn't defined it still doesn't make sense to ask for the .htaccess as it definitively isn't Apache or LiteSpeed (or is a very strange self compiled version of those softwares).

Hi, some web server packages, such as XAMP and similar has Apache and the variable is not defined, there is a lot of users who check Bludit on his own servers. I'm looking another solution.

What about this code..
`if( !file_exists(PATH_ROOT.'.htaccess') ) {
$htaccessWebservers = array('apache', 'litespeed');

if ( !isset($_SERVER['SERVER_SOFTWARE']) || in_array($_SERVER['SERVER_SOFTWARE'], $htaccessWebservers) ) {
	echo 'FILE MISSING';
}

}
`

@dignajar I didn't know that XAMP doesn't define it. Well, I actually like your solution, I think it should work.

I used your code..
	// Check .htaccess file for different webservers
	if( !file_exists(PATH_ROOT.'.htaccess') ) {

		if (	!isset($_SERVER['SERVER_SOFTWARE']) ||
			stripos($_SERVER['SERVER_SOFTWARE'], 'Apache') !== false ||
			stripos($_SERVER['SERVER_SOFTWARE'], 'LiteSpeed') !== false
		) {
			$errorText = 'Missing file, upload the file .htaccess (ERR_201)';
			error_log($errorText, 0);

			$tmp['title'] = 'File .htaccess';
			$tmp['errorText'] = $errorText;
			array_push($stdOut, $tmp);

		}
	}

authors: alexandreteles dignajar

repo: dignajar/bludit


text:
🛑 Fullhauz is down

In f81204d, Fullhauz (https://fullhauz.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Fullhauz is back up in 80e680e after 6 minutes.

repo: dimitrovleonardo/accesco


text:
Could you add a mock family name generator too ?

Typical valus would be:
"Smith"
"Jones"
"Anderson"
"Jameson"

Hi @RoarGronmo . Thank you for taking interest in project.
I'll look into implementing the requested feature soon. I'm not working with dart on regular basis as I used to before so I think it will be simple as lib/src/mock_name.dart only called differently.
If you are in hurry, I'm also accepting PRs for this project, so feel free to make Pull Request before me 👍

Hi @RoarGronmo
I just pushed to master branch. I'm not going to publish my changes currently on pub.dev , but feel free to include this dependency from master branch or from commit using:
dependencies:
  mock_data:
    git:
      url: https://github.com/dinkopehar/mock_data.git
      ref: main # branch name

Thanx !

authors: RoarGronmo dinkopehar


text:
Thanks For code

Thanks For code,but i am facing one issue that you can see in attach pic. thank you in advance. please help me.

Most probably an issue with getting the data from twitter. Either authentication issue or twitteR auth mechanism has changed. Try seeing if you can fetch tweets first.

I am getting the same error. I think it is an issue with ggplot or withProgress() function. Could you please help me out. :)
http://stackoverflow.com/questions/31793520/shiny-app-for-twitter-not-functioning-need-help-debugging?answertab=oldest#tab-top

authors: dhruvshahh dipanjanS durgeshsamariya

repo: dipanjanS/MyShinyApps

license: mit

license_source: bigquery


text:
Unable to login with swedish letters in nick

i was trying to connect to hub via nmdc using nick Lördag containing swedish letters using encoding CP1251. hub disconnects me with message:
handshake failed: read tcp 51.77.46.171:1411->A.B.C.D:59640: i/o timeout

I'm getting a different error:
invalid name: encoding: rune not supported by encoding. ("Lördag")

This one is from the name validation - it tries to convert the name to a fallback encoding (CP1251 for that hub) and fails. This check is to make sure that NMDC clients will still see the whole user list.
Your error is different though.

but what is solution for this? some clients maybe have this nick and want to use your hub, they can not? letter ö in CP1252 is same byte as ц in CP1251. why hub can not use CP1251 (as defult) instead? like every other nmdc hubs without encoding support do > Lцrdag.

Because it won't be possible to enter with Lцrdag name. Hub will have to track that name collision as well.
I agree that this is a problem, but the only "good" and correct solution would be to not show users with UTF-8 names to users with CP1251. Or switch clients to UTF-8.

ok. so maybe hub should atleast send message to client saying that he should add this hub to favorites and select UTF-8 encoding in favorute hub settings? so he can use hub properly.

Makes sense. Although I want to try a different approach first.
As described in nmdc/1 draft, we can make a new protocol version called "nmdc/1" and make it work with only UTF-8. This will only work with ALPN, of course.
Currently, only Ncdc does full ALPN negotiation, but this is not a problem because switching NMDC<->ADC is harder than switching to a new protocol version.
So I plan to first make a few more changes to clients so they support ALPN with a single protocol properly, then make redirects to nmdcs://. Next, then most of the users are connected via TLS, we can discuss the features included in "nmdc/1" and I will update the hub and the clients to support it and force UTF-8 on it.

authors: RoLex dennwc

repo: direct-connect/go-dcpp


text:
Fixes a bug when using sendFile/sendFiles

Description of the PR
Fixes a bug where GroupDMChannel will error out when using sendFile/sendFiles
Changes Proposed in this Pull Request (List new items in CHANGELOG.MD)

Adds sendFile/sendFiles partials to GroupDMChannel

Semver Classification

[ ] This PR only includes documentation or non-code changes.
[x] This PR fixes a bug and does not change the (intended) framework interface.
[ ] This PR adds methods or properties to the framework interface.
[ ] This PR removes or renames methods or properties in the framework interface.

Group DM channels were removed tho...?

mb, someone was on old d.js version :(

authors: MrJacz vladfrangu

repo: dirigeants/klasa


text:
Is this what you mean by "passphrase"?

What is your username and discriminator?
Mallchad#8188
Why did you join Discord Linux?
To learn about linux
Where did you hear about Discord Linux?
Programming discord
What is the passphrase that was assigned to you by the bot?
200281668173430784

Closing as it has been more than 24 hours.

repo: discordlinux/rules


text:
UX: makes oneboxes full width to prevent different width

Before:

After:

Yiss 🤩

authors: CvX jjaffeux

repo: discourse/discourse-chat


text:
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

I'm trying to install mini_racer in ubuntu 16.04 but getting the error like Failed to build gem native extension
It's working fine with ruby 2.4.1 but not working with my ruby-version 2.3.0
Fetching mini_racer 0.2.0
Installing mini_racer 0.2.0 with native extensions
Gem::Ext::BuildError: ERROR: Failed to build gem native extension.

    current directory: /home/hp/.rvm/gems/ruby-2.3.0/gems/mini_racer-0.2.0/ext/mini_racer_extension
/home/hp/.rvm/rubies/ruby-2.3.0/bin/ruby -r ./siteconf20180820-3863-1jyuums.rb extconf.rb
checking for main() in -lpthread... yes
creating Makefile

To see why this extension failed to compile, please check the mkmf.log which can be found here:

  /home/hp/.rvm/gems/ruby-2.3.0/extensions/x86_64-linux/2.3.0/mini_racer-0.2.0/mkmf.log

current directory: /home/hp/.rvm/gems/ruby-2.3.0/gems/mini_racer-0.2.0/ext/mini_racer_extension
make "DESTDIR=" clean

current directory: /home/hp/.rvm/gems/ruby-2.3.0/gems/mini_racer-0.2.0/ext/mini_racer_extension
make "DESTDIR="
compiling mini_racer_extension.cc
In file included from /home/hp/.rvm/rubies/ruby-2.3.0/include/ruby-2.3.0/ruby.h:33:0,
                 from mini_racer_extension.cc:2:
mini_racer_extension.cc: In function ‘VALUE protected_callback(VALUE)’:
/home/hp/.rvm/rubies/ruby-2.3.0/include/ruby-2.3.0/ruby/ruby.h:882:52: error: ‘__builtin_choose_expr’ was not declared in this scope
      OBJ_WB_UNPROTECT((VALUE)(obj)), ((VALUE)(obj))))
                                                    ^
/home/hp/.rvm/rubies/ruby-2.3.0/include/ruby-2.3.0/ruby/ruby.h:1039:48: note: in definition of macro ‘RARRAY_CONST_PTR’
 #define RARRAY_CONST_PTR(a) rb_array_const_ptr(a)
                                                ^
/home/hp/.rvm/rubies/ruby-2.3.0/include/ruby-2.3.0/ruby/ruby.h:1059:50: note: in expansion of macro ‘RB_OBJ_WB_UNPROTECT_FOR’
 #define RARRAY_PTR(a) ((VALUE *)RARRAY_CONST_PTR(RB_OBJ_WB_UNPROTECT_FOR(ARRAY, a)))
                                                  ^
mini_racer_extension.cc:850:9: note: in expansion of macro ‘RARRAY_PTR’
         RARRAY_PTR(data->ruby_args));
         ^
Makefile:206: recipe for target 'mini_racer_extension.o' failed
make: *** [mini_racer_extension.o] Error 1

make failed, exit code 2

Is there a solution?

interesting ... can you try Ruby 2.3.7 ?

Also, could you paste the output of gcc -v?

Yeah @SamSaffron, I have switch the ruby version 2.3.0 to 2.3.7
@ignisf here is the data
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/5/lto-wrapper
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 5.4.0-6ubuntu1~16.04.10' --with-bugurl=file:///usr/share/doc/gcc-5/README.Bugs --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --prefix=/usr --program-suffix=-5 --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --with-system-zlib --disable-browser-plugin --enable-java-awt=gtk --enable-gtk-cairo --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-5-amd64/jre --enable-java-home --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-5-amd64 --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-5-amd64 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --enable-objc-gc --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)

authors: SamSaffron djadma ignisf


text:
SSH issue

Does anyone know why is this happening I can not submit anything.
http://imgur.com/a/6B3WL

Got it I used python 2.7 instead of 3. If youre using linux just check it with python --version

repo: discreteoptimization/assignment


text:
README.md should reflect presumptive usage

The README.md is bare.
It should:

include the description of what this provider does and can accomplish in broader configurations.
include install notes
include testing notes

Installation will presumably look like this:
apiVersion: pkg.crossplane.io/v1alpha1
kind: Provider
metadata:
  name: provider-cloud-init
spec:
  package: "crossplane/provider-cloud-init:master"

Configuration and usage will need to be determined.
Inspiration for this provider comes from https://registry.terraform.io/providers/hashicorp/template/latest/docs/data-sources/cloudinit_config (now https://registry.terraform.io/providers/hashicorp/cloudinit/latest/docs/data-sources/cloudinit_config).
The syntax of that provider allows for rendered cloud-init with several benefits, including gzip, multipart mime encoding, and implicitly, HCL templating and variable interpolation (especially from other TF managed resources).
An example of this Terraform provider in action is offered at https://registry.terraform.io/providers/hashicorp/template/latest/docs/data-sources/cloudinit_config#example-usage (reproduced here):
data "template_file" "script" {
  template = "${file("${path.module}/init.tpl")}"

  vars = {
    consul_address = "${aws_instance.consul.private_ip}"
  }
}

# Render a multi-part cloud-init config making use of the part
# above, and other source files
data "template_cloudinit_config" "config" {
  gzip          = true
  base64_encode = true

  # Main cloud-config configuration file.
  part {
    filename     = "init.cfg"
    content_type = "text/cloud-config"
    content      = "${data.template_file.script.rendered}"
  }

  part {
    content_type = "text/x-shellscript"
    content      = "baz"
  }

  part {
    content_type = "text/x-shellscript"
    content      = "ffbaz"
  }
}

# Start an AWS instance with the cloud-init config as user data
resource "aws_instance" "web" {
  ami              = "ami-d05e75b8"
  instance_type    = "t2.micro"
  user_data_base64 = "${data.template_cloudinit_config.config.rendered}"
}

For Crossplane providers that depend on userdata, and would benefit from cloud-init interpolation, this provider could serve an important role.
What features will we need?

to produce a multi-part mime encoded document
to gzip that document
to store that document in a configmap
to read content a spec parameter or from a configmap
to be used in larger configurations, allowing for HCL like interpolation (take the address of a provisioned resource and include it in a cloud-init part, via substitution.
not have a ready status until all configmaps are ready and rendered with all needed inputs (how will get these?)

repo: displague/provider-cloud-init


text:
🛑 DSAT is down

In f56bbfa, DSAT (https://www.cptec.inpe.br/dsat) was down:

HTTP code: 0
Response time: 0 ms

Resolved: DSAT is back up in ce73ffb after 24 minutes.

repo: dissm-inpe/dsat-upptime


text:
preprocess2 does not handle force-unique==true correctly in an HTML transformation

Expected Behavior
Given multiple instances of a topic in a map:
<map>
  <title>My Map</title>
  <topicref href="topic.dita" keys="topic_use1"/>
  <topicref href="topic.dita" keys="topic_use2"/>
</map>

if force-unique==true is used in an HTML-based transformation, then the output should include two instances of the topic and those instances should be referenced correctly.
Actual Behavior
The output directory contains two copies of the topic as expected:
$ ls out
commonltr.css  commonrtl.css  index.html  topic.html  topic_2.html

but the index.html file contains an invalid link to the second topic:

Topic

Topic

Possible Solution
I am not sure yet.
Steps to Reproduce

Modify your html5 transformation to use preprocess2.
Download the following testcase:
4070.zip
Run the following command:
dita --project project.xml
Inspect the out/index.html file.

Environment

DITA-OT version: 4.0
Operating system and version: Ubuntu 20.04 LTS
How did you run DITA-OT? dita command
Transformation type: HTML5

I see the same result when using copy-to
`
My Map

`
I know copy-to is not part of the future dita v2.0 but I think it is good to keep it working for those that are not ready.
Result:
`

Topic
Topic
Topic

`

Can someone add a "preprocess2" label on this issue? We may want to elevate this bug as the dita-ot moves to preprocess2 as a default setting for html5.
@raducoravu, when I test with webhelp-responsive-preprocess2 I see these symptoms.

@jomjohn the webhelp-responsive-preprocess2 is exprimental. Also the fact HTML5 moves to preprocess2 in a future DITA OT does not make automatically the installed webhelp plugin to move to preprocess2 as the build.xml from the WebHelp plugin explicitly calls "preprocess" for its main transformation type.
Can you also drop us an email (support@oxygenxml.com) about your interest in this particular issue? We could have an internal issue also on our side about it.
Also there have been quite a lot of preprocess2-related fixes lately, maybe you can try to download the latest DITA OT sources, compile them, add the webhelp plugin, install it and try things with the latest unreleased DITA OT changes:
https://github.com/dita-ot/dita-ot#development

Thanks @raducoravu, I am currently testing with DITA-OT 4.1.1. I will test with the latest development version to be sure it is still an issue.

authors: chrispy-snps jomjohn raducoravu

repo: dita-ot/dita-ot


text:
Update Android patch #2

Android patch #2 (package/lib-caffe-bvlc-opencl-clblast-universal/patch.android/android.fgg.patch2) to  CMakeLists.txt is currently 69 lines off (and may break):
Patching source directory ...
/home/anton/CK_REPOS/ck-caffe/package/lib-caffe-bvlc-opencl-clblast-universal/patch.android/android.fgg.patch1
patching file examples/CMakeLists.txt
patching file tools/CMakeLists.txt
/home/anton/CK_REPOS/ck-caffe/package/lib-caffe-bvlc-opencl-clblast-universal/patch.android/android.fgg.patch2
patching file src/caffe/CMakeLists.txt
Hunk #1 succeeded at 94 with fuzz 2 (offset 69 lines).

I believe I fixed that now.

authors: gfursin psyhtest

repo: dividiti/ck-caffe


text:
graceful exceptions for orphaned apphooks in db

When adding and removing apps a lot, one often runs into a whole site going down, just because there is an apphook still defined in the database that no longer exists in code. Sure there is the management command to force remove a specific apphook, but in some many circumstances this is impractical. I would not want my whole site to go down because of an issue that comes purely from the contents of the database.
There is also the inverse problem, of one adding an app, but not having added the apphook to a page yet. Apps should fail gracefully in that case and not bring the whole site down. But that is a problem for a other ticket.
I propose to no longer raise a hard exception in the case where the apphook saved in the database no longer exists in code. Instead show the apphook in the pagetree as "broken" or red and allow removing it over the advanced settings of the page. The urls should be loaded as if that apphook did not exist.
If the old behaviour should be maintained and the new behaviour could be provided through a setting could also be discussed.
The exceptions are currently raised here:

https://github.com/divio/django-cms/blob/6060ea14edb9066f07cfa12dc656d9f0ea7df377/cms/apphook_pool.py#L15-L29
https://github.com/divio/django-cms/blob/6060ea14edb9066f07cfa12dc656d9f0ea7df377/cms/apphook_pool.py#L71

Fixed by https://github.com/divio/django-cms/pull/4871

authors: czpython stefanfoulis

repo: divio/django-cms


text:
Add support for 'active' items in a cms.toolbar.items.SubMenu

It would be useful if there was support for marking an item as 'active' in a cms.toolbar.items.SubMenu.

I don't think this make sense (there was never a need for it and the mac menu doesn't offer this either) @mkoistinen what do you think, is this still relevant?

@mkoistinen I think this was addressed in https://github.com/divio/django-cms/pull/5268. Can you confirm?

I think we can close this. The issue was opened when I was working on Aldryn Segmentation, some time ago.

authors: FinalAngel czpython mkoistinen


text:
Fix reachability of pages with expired ancestors

Fix #4098

@mkoistinen please review this

Coverage decreased (-0.07%) to 87.741% when pulling b1a758b65091474db2481b0b3c754eefd1128546 on yakky:feature/fix_expired_ancestors into 1cb8f0d5a1a72bddea6030f2859ce00ce2c94bc0 on divio:support/3.0.x.

Coverage decreased (-0.07%) to 87.741% when pulling b1a758b65091474db2481b0b3c754eefd1128546 on yakky:feature/fix_expired_ancestors into 1cb8f0d5a1a72bddea6030f2859ce00ce2c94bc0 on divio:support/3.0.x.

authors: coveralls yakky


text:
Issues with current changelog workflow

Current Issue
The current changelog generation doesn't go well with BORS. I'd like to setup everything so that only BORS is allowed to commit to core, but with the current changelog action, this isn't possible since the changelog runs after a merge. In addtion, there is currently irrelevant junk in the changelog because of github-changelog-generator/github-changelog-generator#940.
Alternatives

I like git-journal, but it kinda seems like it's unmaintained at this point with no release in about 2 years.

We could attempt to address the issue in the upstream changelog generator as it shouldn't be too difficult if we can just isolate the proper github API call. Doesn't seem like discussion features are well documented yet, however, as I believe they are still in beta. Once this is accomplished, we could convert the GitHub action into a pre-commit hook.

There are a host of other changelog generation tools as well, if anyone has a good experience with another tool, please mention.

Another alternative since the plan is to have devos releases, is to just generate the changelog whenever a release is tagged. I've seen many projects do that instead. I think its cleaner, since its easier to generate a changelog off of previous commits and then format it and clean it as you wish. Also the current method is really unnecessary until a release, since you could just look at the commit message to get the same information. Its only when you have a release its useful to document everything that was included in the release.

There are no bigger features planned yet.

Maybe git journal is feature complete. 😄
I like that git journal shifts the task left and thereby is hosting provider agnostic. This goes at the cost of needing to "tag" commit messages, which fromy first read seem to just be natural language perfect verb forms.

authors: Pacman99 blaggacao nrdxp

repo: divnix/devos


text:
Version 2.0.0 not found when using ansible-galaxy requirements.yml

Describe the bug
When trying to install this role using the following ansible-galaxy workflow, it fails :
$ ansible-galaxy install dj-wasabi.zabbix-agent
$ ansible-galaxy list > galaxy-reqs.yml
$ cat galaxy-reqs.yml
- dj-wasabi.zabbix-agent, 2.0.0
$ ansible-galaxy install -r galaxy-reqs.yml
[WARNING]: - dj-wasabi.zabbix-agent was NOT installed successfully: - the specified version ( 2.0.0) of dj-wasabi
.zabbix-agent was not found in the list of available versions ....

---> Looks like an extra space between "," and "2.0.0" is causing the issue
I'm not sure
Installation method/version

Ansible Galaxy, role version: 2.0.0

Ansible Version
ansible --version
ansible 2.7.7
  config file = /home/steph/Code/ansible-tools/ansible.cfg
  configured module search path = [u'/home/steph/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python2.7/site-packages/ansible
  executable location = /usr/bin/ansible
  python version = 2.7.5 (default, Oct 30 2018, 23:45:53) [GCC 4.8.5 20150623 (Red Hat 4.8.5-36)]

ansible-galaxy --version
ansible-galaxy 2.7.7
  config file = /home/steph/Code/ansible-tools/ansible.cfg
  configured module search path = [u'/home/steph/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python2.7/site-packages/ansible
  executable location = /usr/bin/ansible-galaxy
  python version = 2.7.5 (default, Oct 30 2018, 23:45:53) [GCC 4.8.5 20150623 (Red Hat 4.8.5-36)]

Targetted hosts
Concerns the following OS(es):

CentOS

Expected behavior
I expect the role to be installed accordignly

Hi @steph-ben
I'm not sure how I should solve this. This is an ansible-galaxy command on which I don't have any control on. Is this the correct procedure way of configuring the version in the requirement file?
The role itself is installed correctly, so I can not help you. I therefor close this issue.

Fair enough.
I was thinking maybe it's related with the way you describe the version.
I'll try to report it to ansible-galaxy repo, if I have time.

authors: dj-wasabi steph-ben

repo: dj-wasabi/ansible-zabbix-agent


text:
Nitpick: Avoid calling the widget a RichTextField

Rich text hearkens back the days of the rich text format (rtf) that was popular before HTML. I had to double-check that this widget does not, in fact, store data in rtf, but, rather, HTML. I'm new to CKEditor, so I am not sure what it is actually capable of.
I understand that this a nitpick and probably not worth the headache it will cause for legacy users. Nevertheless, I raise this issue to bring the naming of things to the forefront of our brains.
The django-tinymce package actually uses HTMLField, which is what it is. It's not a rich text field.

Makes sense. It is already stored in the brain.

You're not wrong.
I'm not sure the rename is worth the hassle. If you want to submit a backwards-compatible change renaming the field and allowing us to remove the RichText* aliasses later I'll probably merge it since I generally agree that naming is important. However, I certainly won't do the work myself.
(anecdotal data from https://support.microsoft.com/en-us/office/create-or-delete-a-rich-text-field-9f86237d-dbbc-4a85-b12c-9d8dca824630

)

Well, I need updated myself. I had no idea that Access had switched over to HTML markup in their RichText widgets.

authors: bobort matthiask prosper1

repo: django-ckeditor/django-ckeditor


text:
Toolbar javascript not compatible with django-compressor/sekizai

I've had issues (see #4808) with the CMS CSS/JS where browsers will use the cached version of the files rather than the new versions after upgrading django-cms.
I attempted to solve this problem by using django-compressor's post processor function on the sekizai tag. However, this leads to very incorrect results since https://github.com/divio/django-cms/blob/develop/cms/templates/cms/toolbar/toolbar_javascript.html contains dynamic variables.
The variables change per request, so this leads to django-compressor generating a lot of *.js files that differ only in these variables. This causes issues because server 1 may generate the HTML containing the reference to this *.js but server 2 might answer the call and return a 404 since it doesn't have the generated file.The only quick fix for now is to disable post-processing the js block but then we're just back to the problem in #4808.

We are looking into replacing the javascript initialisation using a JSON object rather than a JS instance. This is though, valid FE practice. I don't know too much about django-compressor functionality. @jrief has his fair share of knowledge, can you recommend a better path?

Hello @jsma,
Thank you very much for your contribution to the django CMS project. The django CMS project has recently joined forces under the banner of the newly founded django CMS Association to revive the development of django CMS. For this reason we have analyzed all pull requests and issues in detail and decided which ones fit the product vision we want to go with django CMS.
Due to the age of this issue we are unable to safely accept the contribution. If you feel this issue is still required please inform a member of our technical committee: nicolai@django-cms.org.
Nevertheless we thank you for your participation and would like to emphasize that we do not want to discourage you in your contribution to the django CMS project. On the contrary, we encourage everyone who is interested in the success of django CMS to join us!
If you want to learn more about the work of the technical committee, our product vision and how you can become a member of the dCA, you can find all information here:

The Technical Committee of the django CMS Association
Technical Roadmap and Product Vision for django CMS
How to become a member of the django CMS Association

We are looking forward to every companion who would like to shape the future of django CMS together with us!
If you have any questions, feel free to reach out to Nicolai, our Community Manager: nicolai@django-cms.org
Sign up for the Association now!

authors: Aiky30 FinalAngel jsma

repo: django-cms/django-cms


text:
Fix simple typo: specifiv -> specific

Issue Type
[x] Bug (Typo)
Steps to Replicate

Examine runtests.py.
Search for specifiv.

Expected Behaviour

Should read specific.

The file no longer exists. Thanks again @timgates42

The file no longer exists. Thanks again @timgates42

repo: django-hijack/django-hijack


text:
How do you deal with server timeouts?

I found an issue that was created a few years back but the answer is not valid anymore: https://github.com/django-import-export/django-import-export/issues/301
I believe this is a common problem if you're importing a large dataset. We should document how to get around server timeouts.

If this is a problem you're experiencing at the moment, I have an open PR for bulk imports.  Obviously this won't solve the issue of timeouts, but might help if it is a pressing problem for you now.
My current project involves the import of large data sets, and my solution is not to perform the import in the server process.  There is a synchronous upload of data files, which then kicks off an async server process to perform the import, and then returns.  Users can poll a URL to check on the status of the import.

Closing as it can perhaps be solved with bulk imports! If it doesnt solve it, please feel free to reopen.

authors: andrewgy8 charleshan matthewhegarty


text:
GitHub bmihelac -> django-import-export Account Update

Updating both the CONTRIBUTING documentation as well as the url defined
in setup tools for the package.

merged, thanks!

authors: bmihelac mgrdcm


text:
Allowing OSCAR_HIDDEN_FEATURES apps to be excluded from URLConf

I have config
OSCAR_HIDDEN_FEATURES = ['reviews', 'voucher', 'wishlists']

Voucher is very deeply coupled with basket internals, so couldnt possibly be removed entirely.
I can appreciate that "hidden" means the apps oscar.apps.wishlist & oscar.apps.catalogue.reviews still need to be in INSTALLED_APPS, however I believe they should be excluded from URL paths.  Exposing these features on the site isnt really 'hidden' in my perspective.  I am assuming that those views will be inoperative, to some extent, but they really should not be exposed at all.  Leaving them on the site, but hidden, is a concern that they might be used by hackers, but they are out of sight, out of mind, from the site admins.
CustomerConfig depends on wishlists, and DashboardConfig tries to load reviews_dashboard.  BasketConfig doesnt require voucher, but deeper down there were some reverse which require the voucher views.
I have hacked those so they dont emit url patterns for those apps, if they are in OSCAR_HIDDEN_FEATURES.  Is that a direction Oscar wants to go in?  If so, I am happy to contribute that.
If there is interest, I would be happy to take it a bit further to allow excluding reviews or wishlists apps from INSTALLED_APPS, however I suspect this will be harder to build tests for.  This is less important afaics - my primary goal was removing those apps from the URLConf, but removing them from INSTALLED_APPS was a way to validate that there wasnt any remaining unknown hooks into those hidden features.  we are running without reviews or wishlists in INSTALLED_APPS - vouchers is not worth the pain to remove, and likely we would want its functionality in the near future anyway.

A couple of thoughts on this:

In the long run we need to try to decouple Oscar's apps as much as possible, and make them pluggable. reviews and wishlists could without too much effort be made completely standalone and optional. voucher is trickier but there are still unnecessary interdependencies which could be improved.

I would like to drop OSCAR_HIDDEN_FEATURES entirely and instead move to a pluggable app architecture: to disable you reviews you would simply remove it app from INSTALLED_APPS. In templates, iffeature would then just become a wrapper for if apps.is_installed() (or replaced by some equivalent).

The reviews and/or wishlist apps would I think be a good test case to validate that this approach is viable, so if you have time to work on it that would be great.

voucher is trickier but there are still unnecessary interdependencies which could be improved.

Basket model has m2m relation to voucher model, so not sure how to decouple this. My only particular idea is to implement mixin class and include voucher-related fields and methods only if voucher application is enable.
@solarissmoke please share your thoughts/ideas about that.

Basket model has m2m relation to voucher model.

I have not looked into it closely, but in theory it should be possible to move the field into the Voucher model? Since it is an M2M it would be the same relationship either way.

authors: jayvdb sasha0 solarissmoke

repo: django-oscar/django-oscar


text:
Predefined product options

This looks something like this:

Just found this! :D and will be following the state of this PR - as this is --- naturally --- exactly what I was looking to implement on www.simple3dprints.com
Will be rolling to 3.2 when this comes out

Looks good. @viggo-devries , we will need to clearly document the change to JSONField in the release notes.

Yeah definitely!

authors: alexsabb specialunderwear viggo-devries


text:
move tests to github actions?

Hi noticed all the tests are failing right now. Would you accept a PR moving them to github actions? If so, I could work on it if you'd like.

Yes, please! It would be great to also fix https://github.com/django-webpack/django-webpack-loader

PRs for this change are merged. Thanks everyone!

authors: amandasavluchinske fjsj shapiromatron

repo: django-webpack/webpack-bundle-tracker


text:
Enabled build-system isolation via pip.

This is described in https://pip.pypa.io/en/stable/reference/pip/#pep-517-and-518-support and enables build system isolation via PEP-517. In practice this means that pip will use an environment where it downloads setuptools and wheel first and as such will not conflict with whatever is active in the current python env. This is a good thing (tm) :D This now allows for installation in virtualenvs that do not have setuptools/wheel but only pip.
The new behavior (compare against master) of a pip install can be observed due to the following output:
  Building wheel for Django (PEP 517) ... done

if the loglevel is increased further one sees that pip now downloads setuptools & wheel.

For reference, using pyproject.toml was last discussed in #12013.
It's been ~14 months - have your opinions changed @carltongibson? (By the time 4.0 is released it'll be ~2 years.)
We should also update the reusable apps documentation - there was vaguely some discussion in #12006 too.

Just to clarify: To the best of my knowledge pip always builds a wheel nowadays. I just made the minimal changes (that even keep setup.py) to enable build isolation.

PEP 518 is at least final now, which does make a difference.

So I think an empty pyproject.toml would be minimal. :thinking:

Yes, but I thought it would not hurt to write it out explicitly, so the intentions are clear. Or we'd at least have to have a comment in it.

This (I think) is the source of my Meh: if we're just using setuptools, why declare it? Who exactly is in this imagined virtualenv that doesn't have a recent enough setuptools? Who's using this?

I do not have setuptools in my venv at all. Why should I install it? Django has no runtime dependency on it after all. The only thing I have is pip. Why should I put setuptools into my environment just to install Django -- after the install I can immediately remove it. FWIW it is not just about us doing python setup.py sdist to generate a tarball for release but every pip install of Django that disabled binaries (for whatever reason). Why do we need to force setuptools on those users when it is not required during runtime?

Last time, we declined the pyproject.toml because of the extra wheel building steps for sdist installations. #12013 (comment) — we hadn't managed to state — beyond "(tm)" — what were the benefits?

FWIW if people install the sdist nowdays (I did have to fetch it via the url, because --no-binary would also disable wheel generation), pip does generate wheels even with the current source dists:
➜  Downloads pip install https://files.pythonhosted.org/packages/3b/84/6ed065944dd7ab438e1d19d7bb1b1911b27629946a5e0f8c007a692cc1a7/Django-3.1.6.tar.gz
Collecting https://files.pythonhosted.org/packages/3b/84/6ed065944dd7ab438e1d19d7bb1b1911b27629946a5e0f8c007a692cc1a7/Django-3.1.6.tar.gz
  Using cached Django-3.1.6.tar.gz (9.6 MB)
Requirement already satisfied: asgiref<4,>=3.2.10 in /home/florian/.local/share/virtualenvs/98465d75e1822c5/lib/python3.9/site-packages (from Django==3.1.6) (3.3.1)
Requirement already satisfied: pytz in /home/florian/.local/share/virtualenvs/98465d75e1822c5/lib/python3.9/site-packages (from Django==3.1.6) (2021.1)
Requirement already satisfied: sqlparse>=0.2.2 in /home/florian/.local/share/virtualenvs/98465d75e1822c5/lib/python3.9/site-packages (from Django==3.1.6) (0.4.1)
Building wheels for collected packages: Django
  Building wheel for Django (setup.py) ... done
  Created wheel for Django: filename=Django-3.1.6-py3-none-any.whl size=7834188 sha256=06d44f0a0c11a28e29d23525779ee06bcc171fa2ddacb23e337214d7a8c1e1dd
  Stored in directory: /home/florian/.cache/pip/wheels/fe/b1/e2/935393601036015d3029e937a98ef9bdab66e054b262475638
Successfully built Django
Installing collected packages: Django
Successfully installed Django-3.1.6

beyond "(tm)" — what were the benefits?

It does not clutter a minimal environment with dependencies that are not needed at runtime. In practice it also has the possibility to prevent conflicts with other packages in the environment (granted those are rather slim because everyone is afraid of setuptools anyways :D) -- I am not 100% sure, but probably also with broken setuptools entrypoints in the venv; I did had problems with those in the past.

But, again, not something I'm stuck to. If you all feel that this is important to add then no problem…

Well it is not the end of the world if we don't include it. But why prevent people with a valid virtualenv from installing the Django .tar.gz? I wouldn't argue at all if it would not make any difference, but here we prevent an allowed/valid setup from working.

We should also update the reusable apps documentation - there was vaguely some discussion in #12006 too.

We can do this in a separate PR.

It's been ~14 months - have your opinions changed @carltongibson? (By the time 4.0 is released it'll be ~2 years.)

I've changed my mind :shrug:  Now I can see the benefits (pointed out by Florian). For example, installation of Django 3.1.6 crashed for me:
python -m pip install https://www.djangoproject.com/m/releases/3.1./Django-3.1.6.tar.gz
Collecting https://www.djangoproject.com/m/releases/3.1/Django-3.1.6.tar.gz
  Using cached https://www.djangoproject.com/m/releases/3.1/Django-3.1.6.tar.gz (9.6 MB)
Collecting asgiref<4,>=3.2.10
  Using cached asgiref-3.3.1-py3-none-any.whl (19 kB)
Collecting pytz
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting sqlparse>=0.2.2
  Using cached sqlparse-0.4.1-py3-none-any.whl (42 kB)
Building wheels for collected packages: Django
  Building wheel for Django (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /tmp/django-pip/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-8sb0wlav/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-8sb0wlav/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-tlc1z3n7
       cwd: /tmp/pip-req-build-8sb0wlav/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help

  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for Django
  Running setup.py clean for Django
Failed to build Django
Installing collected packages: asgiref, pytz, sqlparse, Django
    Running setup.py install for Django ... done
Successfully installed Django-3.1.6 asgiref-3.3.1 pytz-2021.1 sqlparse-0.4.1

but it went smoothly with pyproject.toml:
Processing Django-3.1.7.tar.gz
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting pytz
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting asgiref<4,>=3.2.10
  Using cached asgiref-3.3.1-py3-none-any.whl (19 kB)
Collecting sqlparse>=0.2.2
  Using cached sqlparse-0.4.1-py3-none-any.whl (42 kB)
Building wheels for collected packages: Django
  Building wheel for Django (PEP 517) ... done
  Created wheel for Django: filename=Django-3.1.7-py3-none-any.whl size=7834206 sha256=a2be4af8af7a13016665b9679dd4751147e01269b1a64bf20b8147d173bf0883
  Stored in directory: /pip/wheels/a0/f1/20/887b5a6e9edea5a797413ab142f67fcddab9d6fa811bc7a508
Successfully built Django
Installing collected packages: pytz, asgiref, sqlparse, Django
Successfully installed Django-3.1.7 asgiref-3.3.1 pytz-2021.1 sqlparse-0.4.1

For what it's worth, this broke django-cockroachdb's build at the step pip install -e /path/to/django as described in https://github.com/pypa/pip/issues/7953#issuecomment-618210657. I haven't read up on the details to understand the issue, but perhaps this merits a release note to explain what to do if you encounter this problem.

Thanks for the update Tim. I need to have a play to work out exactly what's going on, since we still have the minimal setup.py (so it should™ work) and I'm able to do an editable install locally now (testing that). The weeds get long quickly here, but yes, some advice to the release notes seems reasonable. 🤔

I can reproduce this locally adding the --user option:
$ pip install --user -e ~/code/django
Obtaining file:///home/tim/code/django
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting asgiref>=3.3.2
  Downloading asgiref-3.4.0-py3-none-any.whl (25 kB)
Collecting sqlparse>=0.2.2
  Using cached sqlparse-0.4.1-py3-none-any.whl (42 kB)
Requirement already satisfied: pytz in /usr/lib/python3/dist-packages (from Django==4.0.dev20210628094637) (2019.3)
Installing collected packages: asgiref, sqlparse, Django
  Running setup.py develop for Django
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/tim/code/django/setup.py'"'"'; __file__='"'"'/home/tim/code/django/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps --user --prefix=
         cwd: /home/tim/code/django/
    Complete output (28 lines):
    running develop
    WARNING: The user site-packages directory is disabled.
    error: can't create or remove files in install directory

    The following error occurred while trying to add or remove files in the
    installation directory:

        [Errno 13] Permission denied: '/usr/local/lib/python3.8/dist-packages/test-easy-install-18076.write-test'

    The installation directory you specified (via --install-dir, --prefix, or
    the distutils default setting) was:

        /usr/local/lib/python3.8/dist-packages/

    Perhaps your account does not have write access to this directory?  If the
    installation directory is a system-owned directory, you may need to sign in
    as the administrator or "root" account.  If you do not have administrative
    access to this machine, you may wish to choose a different installation
    directory, preferably one that is listed in your PYTHONPATH environment
    variable.

    For information on other options, you may wish to consult the
    documentation at:

      https://setuptools.readthedocs.io/en/latest/easy_install.html

    Please make the appropriate changes for your system and try again.

    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/tim/code/django/setup.py'"'"'; __file__='"'"'/home/tim/code/django/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' develop --no-deps --user --prefix= Check the logs for full command output.

Hmmm. This looks setup dependent.
~ $ pip install --user -e ~/Documents/Django-Stack/django
Obtaining file:///Users/carlton/Documents/Django-Stack/django
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... done
Collecting sqlparse>=0.2.2
  Using cached sqlparse-0.4.1-py3-none-any.whl (42 kB)
Requirement already satisfied: pytz in ./.pyenv/versions/3.8.3/lib/python3.8/site-packages (from Django==4.0.dev20210623125341) (2021.1)
Collecting asgiref>=3.3.2
  Downloading asgiref-3.4.0-py3-none-any.whl (25 kB)
Installing collected packages: sqlparse, asgiref, Django
  Running setup.py develop for Django
Successfully installed Django asgiref-3.4.0 sqlparse-0.4.1
~ $

@cjerdonek is more knowledgable here 😀 — are we missing something? Is there some comment we could add to guide people who get stuck?

Looking at the output of @timgraham

WARNING: The user site-packages directory is disabled.

This is weird, why was it disabled? The rest is just a follow up. If user site-packages are disabled, then it will try to install globally which will fail due to permissions. But this should similarly fail for every other packages as well.

Looking at the output of @timgraham

WARNING: The user site-packages directory is disabled.

This is weird, why was it disabled?

This was what I noticed too. What output do you get from the following?
$ python -m site
sys.path = [
    '/home/nick',
    '/usr/lib/python39.zip',
    '/usr/lib/python3.9',
    '/usr/lib/python3.9/lib-dynload',
    '/home/nick/.local/lib/python3.9/site-packages',
    '/usr/lib/python3.9/site-packages',
]
USER_BASE: '/home/nick/.local' (exists)
USER_SITE: '/home/nick/.local/lib/python3.9/site-packages' (exists)
ENABLE_USER_SITE: True

You don't happen to have the PYTHONNOUSERSITE environment variable defined somewhere? See site.ENABLE_USER_SITE for more details. I also noted the following line:

None means it was disabled for security reasons (mismatch between user or group id and effective id) or by an administrator.

So if you see False, you must have some configuration disabling it. If you see None, then maybe the ownership of your ~/.local path is wonky.

This is on Ubuntu 20.04.
$ python -m site
sys.path = [
    '/home/tim',
    '/usr/lib/python38.zip',
    '/usr/lib/python3.8',
    '/usr/lib/python3.8/lib-dynload',
    '/home/tim/.local/lib/python3.8/site-packages',
    '/usr/local/lib/python3.8/dist-packages',
    '/usr/lib/python3/dist-packages',
]
USER_BASE: '/home/tim/.local' (exists)
USER_SITE: '/home/tim/.local/lib/python3.8/site-packages' (exists)
ENABLE_USER_SITE: True

PYTHONNOUSERSITE isn't set.

In the description of https://github.com/pypa/pip/issues/7953, you can see that pip sets PYTHONNOUSERSITE when it runs.

Yes, yuck. And I managed to see the issue for myself with this reproducer.
It seems that nobody is interested in fixing this because PEP 517 doesn't officially make provision for editable installs. It looks like there are two competing solutions in the works though, so hopefully in the next 6~12 months we'll have a blessed solution to this problem.
In the meantime, it looks as though this only affects --editable installs with --user (or where --user is assumed because there is no permission to write to global site-packages). Virtual environments seem to be unaffected.
pypa/pip#9990 seems to imply that build isolation should be automatically disabled for editable installs, but, after a quick scan through the source, there is no logic that makes any decision about this other than the --no-build-isolation flag.
The three options open to us seem to be:

The documentation approach -- using --no-build-isolation with pip install --editable --user will work.
Add the following hack to setup.py in Django:import site
import sys
site.ENABLE_USER_SITE = '--user' in sys.argv[1:]

Revert the change that added build-system isolation until there is a blessed solution for editable installs with PEP 517.

Thanks for those proposals, Nick. This discussion can continue on the ticket I created.

repo: django/django


text:
Add an optional positional argument to inspectdb to allow choosing what table/views should be inspected

This adds a new option to the inspectdb command so that, instead of automatically detecting and inspecting all existing views and tables in a database, the user can input what tables and views should be inspected.
Usage is simple:
./manage.py inspectdb tablename1 viewname2

Trac ticket: https://code.djangoproject.com/ticket/25658#ticket

add docs and release notes

Added docs and release notes!

Jose, could you have a reply to my question on the mailing list? https://groups.google.com/d/msg/django-developers/CuczZovhp74/Ecw2s0MfAwAJ

Tim, did you check my response in the mailing list?

buildbot, add to whitelist.

Closing per ticket.

merged in 39a16dd2e003f9ca82a6d061a022ced6904bd243, thanks!

authors: JoseTomasTocino auvipy timgraham


text:
Version 0.8 with GeoFeatureModelSerializer and null DateTimeField causes Error

I'm pretty new to this project, but am impressed. Thanks for your work on this. I've just tested out the recent v0.8 with DRF 3.0.4 on an existing project, and have issues with a DateTimeField that has a null value while using the GeoFeatureModelSerializer.
Interestingly, using the GeoModelSerializer instead does not cause an error.
When using GeoFeatureModelSerializer with null DateTimeField, I get the following:
'NoneType' object has no attribute 'isoformat'
Exception Location:	/<path>/lib/python2.7/site-packages/rest_framework/fields.py in to_representation, line 869
Python Executable:	/<path>/bin/python
Python Version:	2.7.8

Relates to #30

any failing test possible?

I think this might be fixed in pull request https://github.com/djangonauts/django-rest-framework-gis/pull/43

I ended up scrapping my work with this add-on for the time being, so don't have a good setup for testing my reported case w/the pull request fix.

I close the issue, anyone feel free to reopen if you still experience the issue with the latest version and have at least some instructions on how to replicate it in the test enviornment.

authors: jessemorton mattxbart nemesisdesign

repo: djangonauts/django-rest-framework-gis


text:
Stream does not expose method to get mutated struct

Hi,
For both of the input and output streams, it's unclear how to get the mutated struct that the callback uses since ownership is handed over.
Would it be sensible if the stop function returned a Result<T> rather than Result<()>?

Thanks for raising this issue. The callback struct is a bit of an experiment in trying to make the cubeb C callbacks more rust-like.  To help me understand, can you explain how you're using the callback struct?

I see.
I was attempting to port the record example from the c repository. It essentially defines a c struct, mutates it within the callback and then asserts whether the struct has had a field changed after the callback has stopped executing.
This isn't particularly nice in rust because once you've handed over the struct, rust basically says (correctly imo) that you've handed over ownership and I should probably be using channels to communicate between the threads. However with the callback tied to struct it's not particularly easy to do - ideally this should be similar to the threading API with closures.
This is just doing it implicitly rather than explicitly like is currently being done. There's some info here.
Ideally on the cubeb::Context I'd like to have methods like,
    fn input_stream<T, F>(&self, params: StreamParameters<T>, f: F) -> Stream
    where
        F: FnMut(&[T]) -> Cont,
        F: Send + 'static,
    {

        unimplemented!()
    }

    fn output_stream<T, F>(&self, params: StreamParameters<T>, f: F) -> Stream
    where
        F: FnMut(&mut [T]) -> Cont,
        F: Send + 'static,
    {
        unimplemented!()
    }

    fn duplex_stream<T1, T2, F>(&self, input_params: StreamParameters<T1>, output_params: StreamParameters<T2>, f: F) -> Stream
    where
        F: FnMut(&[T1], &mut [T2]) -> Cont,
    {
        unimplemented!()
    }

and output_stream, 'duplex_streamand maybescan` variants with two callbacks (for state and normal like you've done since the struct essentially has to be shared between both).
So then the syntax looks something more like,
    let mut a = Foo(1);
    let stream = ctx.input_stream(
        StreamParameters {
            layout: 1,
            rate: 4,
            channels: 1,
            format: SampleFormat::Float32BE
        },
        move |x| {
            a.0 = 4;
            Cont::Next(x.len())
        }
    );

The Stream handle returned would essentially give you back something to do your queries and stop()/start().
I'm aware that this is quite a departure from your current API though, so I'm happy to a) do the work and submit a PR or b) leave the alternative API in a different place.

Hi @yilinwei, The interface to stream callbacks has been totally reworked in v0.4.  If you are still using this crate could you give it a try and report back?
thanks,
Dan

@djg Will do; I'll try and set aside some time this weekend and report back.

authors: djg yilinwei

repo: djg/cubeb-rs

license: isc


text:
🛑 lynx.re is down

In 5709294, lynx.re (https://lynx.re) was down:

HTTP code: 0
Response time: 0 ms

Resolved: lynx.re is back up in fbc32f5 after 11 minutes.


text:
KeyError: 'operation' in start_retrieve_sensitive_info

Perhaps this is similar to https://github.com/djtimca/hagooglewifi/issues/30 but I thought I should log it anyways. I get two KeyErrors every few days at least. Sometimes more frequently.
One is this one which I couldn't find any existing issue for, hence this one being written. I'm using the latest version of both HA and the googlewifi integration via hacs.

Logger: custom_components.googlewifi
Source: custom_components/googlewifi/__init__.py:171
Integration: Google WiFi (documentation, issues)
First occurred: 20:03:15 (1 occurrences)
Last logged: 20:03:15

Unexpected error fetching GoogleWifi data: 'operation'
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 187, in _async_refresh
    self.data = await self._async_update_data()
  File "/config/custom_components/googlewifi/__init__.py", line 171, in _async_update_data
    system_data = await self.api.get_systems()
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 191, in get_systems
    return await self.structure_systems(response)
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 284, in structure_systems
    sensitive_info = await self.get_sensitive_info(system_id=this_system["id"], station_ids=station_ids)
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 611, in get_sensitive_info
    operation_id = await self.start_retrieve_sensitive_info(
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 589, in start_retrieve_sensitive_info
    operation_id = response["operation"]["operationId"]
KeyError: 'operation'

Thanks - this is from the underlying library (https://github.com/djtimca/googlewifi-api). Working on on update there and will include handling for this one there.

Thank you! I have updated to the latest HA integration this evening. I am seeing some new errors there, do you think I should log them as issues against hagooglewifi or against the googlewifi-api you had mentioned, or perhaps an upcoming googlewifi-api is planning to look to resolve these?
In short summary its throwing errors for me like
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 289, in structure_systems
    for this_station in system_metrics.get("stationMetrics"):
TypeError: 'NoneType' object is not iterable

and
  File "/usr/local/lib/python3.9/site-packages/googlewifi/__init__.py", line 589, in start_retrieve_sensitive_info
    operation_id = response.get("operation",[]).get("operationId")
AttributeError: 'list' object has no attribute 'get'

Thank you.

Should be against the API. Thanks

Great thank you, I have logged those here https://github.com/djtimca/googlewifi-api/issues/5

repo: djtimca/hagooglewifi


text:
Add App Store links and new apps

Hi I add these new apps + add App Store links

Thx @iOS6martinaa but the JSON file is no longer in correct format. Could you update ? You can use https://jsonlint.com/ to help
Sent with GitHawk

sorry for me too hard.

can you make this?

repo: dkhamsing/open-source-ios-apps


text:
Add nbviewer and license badges to README

The nbviewer badge added to the README is hyperlinked to the nbviewer page for the MachineLearningStatistics repo. This makes it easier to view the notebooks as a set of nicely rendered notes in browser (as compared to the view of the notebook that GitHub offers).

@dkirkby I was talking with @alexarmstrongvi at CERN today and he mentioned this repo to me (quite nice). Just thought that it might be nice to add some badges to the README especially if people are going to try to read them as in browser static notes in addition to using the Jupyter notebooks.
Let me know if you have any requests or edits that you'd like.

Thanks, I didn't know about nbviewer badges.  The performance (and rendering) are much nicer for read-only browsing.
Perhaps a link to the Contents notebook would be a more useful entry point than the notebooks dir?
Btw, a condensed and somewhat overlapping set of notebooks from a recent summer school are here.

Are these badges documented anywhere?  I only found some issue traffic.  I am wondering if there is a similar badge for starting nbviewer in the "View as slides" mode.

Perhaps a link to the Contents notebook would be a more useful entry point than the notebooks dir?

Sure. That actually works really nicely on nbviewer too.
Any interest in having a duplicated README.md in notebooks? This would have the advantage that it would automatically load when the dir is visited on GitHub.

Btw, a condensed and somewhat overlapping set of notebooks from a recent summer school are here.

Thanks! I'll check them out too.

Are these badges documented anywhere?

They're all generated automatically from https://shields.io/

Is [there] a similar badge for starting nbviewer in the "View as slides" mode.

The answer seems to be kinda, but using slideviewer instead of nbviewer. However, slideviewer seems to require a url to an actual Jupyter notebook, instead of just a directory above where they exist. So you could create individual badges, but maybe not just a single one. However, this was also just from 5 minutes of searching so there might be a better solution in a GitHub Issue somewhere.
For my own (local and Binder) personal presentations I just use RISE. Example here (click the "launch binder" badge and then navigate to Notebooks/Slides.ipynb for a live demo).

@dkirkby Okay, with ad8485c1e755e5d53c73f72881053917cde21d24 the nbviewer badge now links to the TOC notebook.

Any interest in having a duplicate of the Contents.ipynb content in a README.md in notebooks?

The Contents nb already contains most of the info in the README, and I try to avoid linking to the directory.

I just added a "slides" badge to this README that links directly to nbviewer with /format/slides/ in the URL.

The Contents nb already contains most of the info in the README, and I try to avoid linking to the directory.

Sure. Just to be clear on what I was suggesting (I may have not done a good job of describing it) was to take the TOC from Contents.ipynb and add that to a notebooks/README.md so that if someone were to visit MachineLearningStatistics/notebooks they would see the rendered TOC instead of all of the files. But maybe you're linking to the directory comment is associated with the idea that you aren't expecting people to be navigating around on GitHub so much, especially if nbviewer is in place.

I just added a "slides" badge to this README that links directly to nbviewer with /format/slides/ in the URL.

Hey that's great! Thanks for the tip. :+1:

Just to be clear on what I was suggesting

Ok, I misunderstood.

they would see the rendered TOC instead of just all of the files

Wouldn't the rendered TOC still appear below the (longish) listing of files?

you aren't expecting people to be navigating around on GitHub so much

Yes, that's what I meant.

Wouldn't the rendered TOC still appear below the (longish) listing of files?

True. So probably not really worth it.

Btw, are you working with Bob Kehoe at SMU?  (We collaborate on DESI).

@dkirkby Nope. I work with @stephensekula on ATLAS.

authors: dkirkby matthewfeickert

repo: dkirkby/MachineLearningStatistics


text:
Is it possible to search only the current buffer

Hello , thank you for making an awesome plugin. This plugin is definitely a productivity booster. I wanted to know if it is possible to search only the buffer you are in ? Also if it is possible to specify a path to search in like  :Grep /search/this/path word . Any feedback on this would be great. Again thank you for giving us a great plugin.

According to the document, there is no "Current buffer" mode as of now, only "Open buffers". I would love to see this feature get implemented, too.

Yeah I realized that. That is why i am no longer using this plugin and am using ack . Simple and very effective.

Added g:EasyGrepSearchCurrentBufferOnly  in commit 106b39f0cca0cb98d3c35a83ed6db48bb38c6081 . To use it set:
let g:EasyGrepMode = 1
let g:EasyGrepSearchCurrentBufferOnly = 1

repo: dkprice/vim-easygrep

license: unlicense


text:
Can't use type that containers reference as a key type

Function like HashMap.keys is trying to cast from const(K) to K. When K contains reference, this won't work.
My idea is to return const(K)[] instead in that case.

Referenced without fix / close.

authors: BBasile yshui

repo: dlang-community/containers


text:
std.algorithm.searching: Fix a -dip1000 compilable issue

Eliminates an error from std.algorithm.searching (the remaining errors are from std.algorithm.comparison and std.uni):
make -f posix.mak std/algorithm/searching.test  [-dip1000 for std.algorithm.searching.d (the posix.mak I'm using is master+ https://github.com/dlang/phobos/pull/6195] + -dip1000 for searching.d; master at Latest commit 4820a49)]:
std/algorithm/searching.d(2101): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2102): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2103): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2104): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2105): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2106): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2424): Error: @safe function std.algorithm.searching.__unittest_L2416_C7 cannot call @system function std.algorithm.searching.find!(string, binaryFun, string).find
std/algorithm/searching.d(2436): Error: @safe function std.algorithm.searching.__unittest_L2430_C7 cannot call @system function std.algorithm.searching.find!(int[], binaryFun, int[]).find
std/algorithm/searching.d(2437): Error: @safe function std.algorithm.searching.__unittest_L2430_C7 cannot call @system function std.algorithm.searching.find!(int[], binaryFun, int[]).find
std/algorithm/searching.d(2443): Error: @safe function std.algorithm.searching.__unittest_L2440_C7 cannot call @system function std.algorithm.searching.find!(string, binaryFun, string).find

PR applied and function
R1 find(alias pred = "a == b", R1, R2)(R1 haystack, scope R2 needle)
temporarily attributed @safe, results in:
std/algorithm/searching.d(1969): Error: scope variable needle assigned to non-scope parameter r2 calling std.algorithm.comparison.mismatch!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).mismatch
std/algorithm/searching.d(2101): Error: template instance `std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b"))` error instantiating
std/uni.d(2553): Error: reference to local variable __tmpfordtor1666 assigned to non-scope parameter this calling std.uni.InversionList!(GcPolicy).InversionList.byInterval
std/uni.d(1976): Error: template instance `std.uni.InversionList!(GcPolicy)` error instantiating

Since I opened this PR 12 days ago, the errors changed to these:
make -f posix.mak std/algorithm/searching.test (aa[std.algorithm.searching]=-dip1000 in https://github.com/dlang/phobos/pull/6278):
...
T=`mktemp -d /tmp/.dmd-run-test.XXXXXX` &&                                                              \
  (                                                                                \
    ../dmd/generated/linux/release/64/dmd -od$T -conf= -I../druntime/import  -w -de -dip25 -m64 -fPIC -transition=complex -O -release -dip1000  -main -unittest generated/linux/release/64/libphobos2.a -defaultlib= -debuglib= -L-ldl -cov -run std/algorithm/searching.d ;     \
    RET=$? ; rm -rf $T ; exit $RET                                                                   \
  )
std/algorithm/searching.d(2101): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2101): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2101): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2102): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2102): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2102): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2103): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2103): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2103): Error: struct `std.range.SortedRange!(int[], "a < b").SortedRange` member _input is not accessible from @safe code
std/algorithm/searching.d(2104): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2105): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2106): Error: @safe function std.algorithm.searching.__unittest_L2088_C7 cannot call @system function std.algorithm.searching.find!("a == b", SortedRange!(int[], "a < b"), SortedRange!(int[], "a < b")).find
std/algorithm/searching.d(2424): Error: @safe function std.algorithm.searching.__unittest_L2416_C7 cannot call @system function std.algorithm.searching.find!(string, binaryFun, string).find
std/algorithm/searching.d(2436): Error: @safe function std.algorithm.searching.__unittest_L2430_C7 cannot call @system function std.algorithm.searching.find!(int[], binaryFun, int[]).find
std/algorithm/searching.d(2437): Error: @safe function std.algorithm.searching.__unittest_L2430_C7 cannot call @system function std.algorithm.searching.find!(int[], binaryFun, int[]).find
std/algorithm/searching.d(2443): Error: @safe function std.algorithm.searching.__unittest_L2440_C7 cannot call @system function std.algorithm.searching.find!(string, binaryFun, string).find

The additional ones can be removed again by removing protection attribute private from:
std.range.package. struct SortedRange(Range, alias pred = "a < b"). private Range _input;
which is probably not the right direction to go

Since this is congruent with the D vision, I added the Vision label and this is a priority issue. https://wiki.dlang.org/Vision/2018H1

If it still compiles successfully and passes the test suite after adding scope, then the addition is good to go. If that does turn out to break things, then the test suite (at least) is inadequate.

authors: WalterBright carblue

repo: dlang/phobos


text:
Add support to unicode characters on email validation

This solves issue #19

Coverage remained the same at 100.0% when pulling 610bfa8dcef2fccc3977335c1207c211a533657c on smaniotto:email-unicode into 9a6fb9915326f711617a22d5392a19f59ba3bb20 on dleitee:master.

Perfect!

authors: coveralls dleitee smaniotto


text:
Line breaks not shown in char array PV

Support for converting from char array to string for display was recently added.
The current operator message contains line breaks. These are not being displayed properly.
Please add support for line breaks.

This issue has been fixed in PR: https://github.com/dls-controls/cs-web-lib/pull/9

repo: dls-controls/cs-web-lib


text:
Installation problem

Dear,
I encountered this problem while doing ./manage.sh init
  Downloading tensorflow-2.2.2-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB)
     |████████████████████████████████| 516.2 MB 16.7 MB/s eta 0:00:01Traceback (most recent call last):
  File "DNNV/.venv/bin/flit", line 8, in <module>
    sys.exit(main())
  File "DNNV/.venv/lib/python3.7/site-packages/flit/__init__.py", line 172, in main
    pth=args.pth_file).install()
  File "DNNV/.venv/lib/python3.7/site-packages/flit/install.py", line 413, in install
    self.install_directly()
  File "DNNV/.venv/lib/python3.7/site-packages/flit/install.py", line 298, in install_directly
    self.install_requirements()
  File "DNNV/.venv/lib/python3.7/site-packages/flit/install.py", line 252, in install_requirements
    check_call(cmd)
  File "/usr/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['DNNV/.venv/bin/python', '-m', 'pip', 'install', '-r', '/tmp/tmpyu8k0ec7requirements.txt']' died with <Signals.SIGKILL: 9>.

What should I do to fix it? Other libraries are installed successfully.
Thank you for your help. Have a great day.
Best regards,
Max Nguyen

I have successfully installed it on a separate server. It may be due to a local configuration. If you have any possible solution, please let me know.

I have successfully installed it on a separate server. It may be due to a local configuration. If you have any possible solution, please let me know.

repo: dlshriver/DNNV


text:
Capital letter in email claim stopping pgp generation (UAT)

Context
If I enter an email claim with a capital letter and click set up pgp key - I am returned with an error
AC

Given I have completed my name claim and I enter an email address with a capital letter
When I click set up pgp
Then I will be able to select to either generate or import my pgp key

Relates to #538 & #537

repo: dltxio/idem-mobile


text:
Add website thumbnail

Whenever sharing links to my blog posts, there is no website thumbnail. The thumbnail should be my profile picture. The image should be optimized for the web.
The first image appearing on a page will always be the thumbnail. I could put a smaller version of my profile picture in the top navigation.

Addressed in #48


text:
DateTimeOffset

.net6 DateTimeOffset 无法映射到 TIMESTAMP

我只是打包了达梦的驱动。这个问题你得问达梦了哈。

authors: LittleLionet aaasoft


text:
🛑 Vagonmaster.com is down

In ecbca03, Vagonmaster.com (https://www.vagonmaster.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Vagonmaster.com is back up in 813bbde after 6 minutes.


text:
Cannot run text_generation sample script

Description
I am trying text generation example with GTP2 as shown here:
I am using the latest dev version of gluon-nlp (a fresh git pull)
Mxnet-version = mxnet-cu100==1.5.1.post0
The command I am using is  python sequence_sampling.py random-sample --bos 'Deep learning and natural language processing' --beam-size 1 --lm-model gpt2_117m --max-length 1024 --print-num 1
Error Message
Namespace(beam_size=1, bos='alexa', command='random-sample', gpu=0, lm_model='gpt2_117m', max_length=1024, print_num=1, temperature=1.0, use_top_k=None)
Sampling Parameters: beam_size=1, temperature=1.0, use_top_k=None
Traceback (most recent call last):
  File "sequence_sampling.py", line 222, in <module>
    generate()
  File "sequence_sampling.py", line 202, in generate
    inputs, begin_states = get_initial_input_state(decoder, bos_ids)
  File "sequence_sampling.py", line 157, in get_initial_input_state
    mx.nd.array([bos_ids], dtype=np.int32, ctx=ctx), None
  File "/home/ec2-user/anaconda3/envs/devnlp/lib/python3.7/site-packages/mxnet/gluon/block.py", line 548, in __call__
    out = self.forward(*args)
  File "/home/ec2-user/anaconda3/envs/devnlp/lib/python3.7/site-packages/mxnet/gluon/block.py", line 925, in forward
    return self.hybrid_forward(ndarray, x, *args, **params)
  File "/home/ec2-user/projects/gluon-nlp/scripts/text_generation/model/gpt.py", line 275, in hybrid_forward
    data_pos = F.contrib.arange_like(data, axis=1).astype('int32')
AttributeError: module 'mxnet.ndarray.contrib' has no attribute 'arange_like'

Environment
----------Python Info----------
Version      : 3.7.5
Compiler     : GCC 7.3.0
Build        : ('default', 'Oct 25 2019 15:51:11')
Arch         : ('64bit', '')
------------Pip Info-----------
Version      : 19.3.1
Directory    : /home/ec2-user/anaconda3/envs/devnlp/lib/python3.7/site-packages/pip
----------MXNet Info-----------
Version      : 1.5.1
Directory    : /home/ec2-user/anaconda3/envs/devnlp/lib/python3.7/site-packages/mxnet
Num GPUs     : 1
Commit Hash   : c9818480680f84daa6e281a974ab263691302ba8
----------System Info----------
Platform     : Linux-4.14.146-93.123.amzn1.x86_64-x86_64-with-glibc2.10
system       : Linux
node         : ip-172-31-18-232
release      : 4.14.146-93.123.amzn1.x86_64
version      : #1 SMP Tue Sep 24 00:45:23 UTC 2019
----------Hardware Info----------
machine      : x86_64
processor    : x86_64
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                8
On-line CPU(s) list:   0-7
Thread(s) per core:    2
Core(s) per socket:    4
Socket(s):             1
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 79
Model name:            Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
Stepping:              1
CPU MHz:               2701.607
CPU max MHz:           3000.0000
CPU min MHz:           1200.0000
BogoMIPS:              4600.12
Hypervisor vendor:     Xen
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              46080K
NUMA node0 CPU(s):     0-7
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx xsaveopt
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0024 sec, LOAD: 0.8949 sec.
Timing for GluonNLP GitHub: https://github.com/dmlc/gluon-nlp, DNS: 0.0004 sec, LOAD: 0.7312 sec.
Timing for GluonNLP: http://gluon-nlp.mxnet.io, DNS: 0.0821 sec, LOAD: 0.2978 sec.
Timing for D2L: http://d2l.ai, DNS: 0.0134 sec, LOAD: 0.2999 sec.
Timing for D2L (zh-cn): http://zh.d2l.ai, DNS: 0.0170 sec, LOAD: 0.1823 sec.
Timing for FashionMNIST: https://repo.mxnet.io/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.1048 sec, LOAD: 0.6563 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0040 sec, LOAD: 0.4681 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0036 sec, LOAD: 0.2458 sec.

Hi @zeeshansayyed. We recently updated the script which now relies on the master version of mxnet. Can you try installing the nightly version of mxnet instead? http://gluon-nlp.mxnet.io/master/install.html

authors: szha zeeshansayyed

repo: dmlc/gluon-nlp


text:
[FEATURE]Horovod support for training transformer (PART 2)

Checklist
Essentials

[x] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[x] Changes are complete (i.e. I finished coding on this PR)
[ ] All changes have test coverage
[ ] Code is well-documented

Changes

add horovodrun example in machine_translation/README.md
transformer base/large result (test and valid bleu)
ShardedIterator (to split sampler) and testcase
add test case to test situation that fail downloading in test_util_misc.py

For the diff check failure, it might be caused by the fact that the exception is not triggered:
https://github.com/dmlc/gluon-nlp/blob/32e87d4d4aa20a6eb658ee90d765ccffbd160571/src/gluonnlp/utils/misc.py#L562-L568
Thus, we may try to add a test-case which downloads an non-existing file and use pytest.assertRaises.

I find that the codecov is not very stable, especially the diff hit. @szha @leezu Would you know how could we improve it?

assuming no race issue in result upload, this can be a result of non-determinism in tests, and the code path in the same test can vary.
if that's the case, we can mock the randomness to deterministically test each path. or if we still require the randomness, we can increase the trial number

authors: hymzoque sxjscience szha


text:
[TUTORIAL] Use FixedBucketSampler in BERT tutorial for better performance

Description
Follow up on BERT tutorial https://github.com/dmlc/gluon-nlp/issues/425 - use FixedBucketSampler for better wall clock performance.
Checklist
Essentials

[X] PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
[X] Changes are complete (i.e. I finished coding on this PR)

Job PR-506/1 is complete.
Docs are uploaded to http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR-506/1/index.html

Do you mind also replacing
        grads = [p.grad(c) for p in params for c in [ctx]]
        gluon.utils.clip_global_norm(grads, grad_clip)

with
      nlp.utils.clip_grad_global_norm(params, grad_clip)

Like what was did in https://github.com/dmlc/gluon-nlp/blob/master/scripts/bert/finetune_classifier.py#L215

authors: Ishitori eric-haibin-lin mli


text:
Convert image-classification to new programing API

The old FeedForward module API is deprecated.
I also added --monitor to help debug.

let me know if this is still able to catch 0.9 train (master branch)

@mli

lgtm to me. it would be great if you can test the distributed training.

I tested in two GPUS which works fine, except no big difference even for
cifar10 on resent.
I don't have environment to test multi machine.
On Wed, Dec 21, 2016 at 5:56 AM Mu Li notifications@github.com wrote:

lgtm to me. it would be great if you can test the distributed training.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dmlc/mxnet/pull/4307#issuecomment-268370981, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAuzRDXJw-w-PoSNh_D7-j8z8pYsZdfEks5rKE8LgaJpZM4LR8bE
.

--
-Howard

authors: howard0su mli piiswrong

repo: dmlc/mxnet


text:
python: Fix assert

should work in the case num_data == 1 and batch_size == 1
@piiswrong

Thanks for contribution, I have added your name to https://github.com/dmlc/mxnet/blob/master/CONTRIBUTORS.md , please feel free to add more detail about you, or help the community to improve mxnet.

authors: ry tqchen


text:
minor doc fixes

minor doc fixes in overview.md, index.md

Thanks for the fixes

Your welcome- great project by the way

authors: redwrasse szha

repo: dmlc/ps-lite


text:
Is there any relation between nWorkers of rabit and executors of spark?

Using the xgboost on spark, I usually have to set the parameters of nWorkers of rabit and executors of spark. Is there any relation between them?
For example, if the nWorkers param is set to be 100, then the executors should be 100, too?
Is the definition of worker in rabit the same as executor in spark?

nWorker is basically the number of distributed/parallel workers. Your dataset will be repartitioned into nWorker parts, and each worker trains on its own part. Finally, Rabit uses Allreduce to combine and synchronize between workers.
In terms of executors, it depends on the configurations.

spark.executor.cores controls how many cores each executor has
spark.task.cpus controls how many CPUs each task can use.

If you have 12 cores for an executor, and allocate 3 CPUs for each task, then within each executor you will have 4 tasks. Therefore in total you need 25 executors to make up for the 100 workers.

Of course in order to maximize the efficiency and utilize all the resources, set nthread to match spark.task.cpus so that within each task, the training is conducted in parallel.

authors: FanBit xydrolase

repo: dmlc/xgboost


text:
Did xgb.save and xgb.load change?

We have been using a fork of the xgboost package that we recently caught up to the latest master. However, older models whose binary was saved using xgb.save is no longer being correctly deserialized using xgb.load; instead, we see:
Error in xgb.Booster(modelfile = modelfile) :
  BoostLearner: wrong model format

Is there any hope to salvage these binaries, or should we xgb.load from an older version of the package to load them? Did the serialization format change in a systematic way?

I do not think this was due to format change, but this could due to the new support for using R's save function. @hetong007 should be able to look into this and what was going on

Hi, @robertzk can you please provide more information? For example what is the process and where did this error appear. It would be great if you can provide a minimum reproducible example.

Any updates on the issue? If we can have a reproducible example and hashtag of a version where if we save the model, the change breaks. @hetong007 or I can take a look at it. There is no intention break of backward compatibility since 3.0

This appears to be my fault of tiny change of model structure that cause backward incompatibility. I have pushed a hack to fix the problem, so the old model can still be loaded

authors: hetong007 robertzk tqchen


text:
Xgboost-spark unstable

we use version 0.80, ‘XGBoostClassifier’ to train, ‘auc’ to evaluate, but if set ‘numWorkers’ > 1, the auc result is unstable(test several times with same params, the ‘auc’ result may be different, and not awalys different). if set ‘numWorkers’ = 1 and same params, the ‘auc’ result always same. I don't know why.

Read XGBoost KDD paper, it’s because of the approximate algorithm in distributed setting

Read XGBoost KDD paper, it’s because of the approximate algorithm in distributed setting

Thanks, but how can we set params to get a stable 'auc' result when use distribute train?

authors: CodingCat xuchaoqun


text:
deprecate single node multi-gpu mode

First step for #4531
@canonizer @RAMitchell @trivialfis

Can we add a LOG(WARNING) maybe in the initialisation of gpu_hist to detect if someone is using this?

@RAMitchell added warning message.

authors: RAMitchell rongou