text:
Dynamic labels for sidekiq jobs

Hi, thanks for this beautiful gem.
I see that we can added static labels in sidekiq job (on official page of a gem):
Custom labels can be added for individual jobs by defining a class method on the job class. These labels will be added to all Sidekiq metrics written by the job:
  class WorkerWithCustomLabels
    def self.custom_labels
      { my_label: 'value-here', other_label: 'second-val' }
    end

    def perform; end
  end

but, what about dynamic labels? How we can add those labels?

I think you would need to extend the class to support that. What exactly are you trying to achieve?

So, for example above with static label when we start sidekiq job - WorkerWithCustomLabels it will add two labels - my_label = 'value-here' and other_label = 'second-val', those labels are static.
But, in some cases we want to add dynamic labels, for example:
class SomeTestJob   def perform(event_id)     event = Event.find(event_id)     label = event.type   end   end
and I want set this label for this job with - label = event.type. type of this label is not static - it's dynamic label.
And my question: how can we add those type of labels to Sidekiq jobs?
Thanks!

It's seems to me that it should look something like this https://github.com/yabeda-rb/yabeda/issues/12

authors: SamSaffron edenisn


text:
Result-marks api added

🎯 Title and Issue Number
College-Result Api
it is college result api that i have mentioned details in issue
i have checked all of th endpoints in my local database
anyone who want to add this api in his/her project can simple replace mongodb url here you go
he/she will be able to use this api
Closes #128

🗒 Checklist:

[x] I have mentioned the issue number in my Pull Request.
[x]  I have gone through rules of when PR will get merged.
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have created a helpful and easy to understand README.md
[x] I have followed proper file structure.
[x] I have gone through CONTRIBUTING GUIDELINES.md.

Thank you for contributing!❤
Don't forget to show some love by ⭐ the repository!

Hey @Yashgabani845, Thank you for creating PR! We will review it super soon. 😇❣
As we continue to evolve and innovate, we encourage you to share your ideas, feedback, and code to help us push the boundaries of what's possible in the world of APIs🚀.
We hope you have followed CONTRIBUTING GUIDELINES.
Thank you for being an essential part of our community. Together, we'll keep building amazing things!
Don’t forget to ⭐ our repository!
Happy Coding!✨
Will See you soon❣

As per you said i am making 2 Different PRs

@Yashgabani845 We're thrilled to inform you that your pull request has been successfully merged into the APIverse🚀🎁
Your hard work, dedication, and expertise have made a significant impact on our project, and we couldn't be more grateful for your contributions.😇
Your code will now be a part of our growing ecosystem, helping developers worldwide to create exceptional APIs.❣🔥
Happy Coding! ✨
Will See you soon❣

/assign

source: gharchive/pull-request

license: MIT

license_type: permissive

license_source: github-api


text:
[DISQ-16] Adding Travis CI configuration.

Fixes #16.

This looks like a good start to me (of course we can make changes later). It would be good to get this in and set up Travis to test #14.

Thanks, @tomwhite!

authors: heuermh tomwhite

repo: disq-bio/disq


text:
AMP comment count

Hi,
Great work on Disqus AMP, it works without any problems but in our implemented we would also like to have comment count but the AMP pages are cached on CDN's so it is impossible to make it work.
Are you planning to implement solution for it for example using ?
https://amp.dev/documentation/components/amp-script/?format=websites
Here are some examples:
https://amp.dev/documentation/examples/components/amp-script/?format=websites
Thanks in advance
Maciej

After bringing this up to Disqus engineering, there's no current recommendation for this feature, but they're looking into it.

Any updates?
We could probably use this endpoint:
https://disqus.com/api/3.0/threads/details.json?api_key=......&forum=......&thread:ident=......
But in order to do that it must allow cors requests, also this endpoint has a lot of data we don't need for comment count so I think the best solution is that you will create another endpoint that returns only post/thread ID and comments number and also it allows cors requests
Then it could be used like this:
JSON from your enpoint:
{"thread/post_id":"comments_number"}
AMP html:
<amp-list noloading="" single-item="" items="." layout="fixed-height" height="12" src="https://disqus.com/api/3.0/[post-count-endpoint]"> <template type="amp-mustache">{{thread/post_id}}</template> ... </amp-list>

Hi,
We updated our AMP install instructions to include information about comment counts using our count.js in #39. It still takes a while for comments counts to update because they're cached
I don’t see any issues using an <amp-list> and our API so feel free to continue using it if you’re happy with it. However, because not every publisher has API access, I opted for another solution using count.js like you typically see on sites showing their comment counts.
Best,
Hovsep

Thank you, @Hovspian. To clarify, does this solution work on all comment counts on the page and batches multiple comment count requests into one call?

Yes it will. It works the same way as the comment counts for non-AMP pages. It's just that using it on an AMP page requires some modifications to the HTML.

Hi @Hovspian
Can you help me out?
As per AMP documentation remote scripts can be loaded via <amp-script> and if they are cross-origin then "script hash" must be added to
https://amp.dev/documentation/components/amp-script/?format=websites#load-javascript-from-a-remote-url
 (Step 2) fails with:

The attribute 'async' may not appear in tag 'amp-script extension local script'.
The attribute 'src' may not appear in tag 'amp-script extension local script'.

at https://search.google.com/test/amp

Hi,
Sorry that it took so long to update, but I put up a new PR (#41) that updates the installation instructions to use an <amp-list> like @maciejmackowiak originally suggested. The new instructions use a new endpoint created for AMP comment counts that complies with the <amp-list> requirements.

@Hovspian This looks promising, not requiring custom JS. I left a comment in the PR about OTHER_URL and FOURTH_THREAD_IDENTIFIER.

I'm closing this issue now that #41 is merged. Anyone should be able to add comment counts to AMP pages with the updated instructions.

Thanks for the fix. We've moved to this new solution on androidpolice.com. For example: https://www.androidpolice.com/2020/05/12/google-is-testing-imessage-like-reactions-for-rcs-chats-in-its-messages-app/?amp.

source: gharchive/issue

authors: Hovspian MrCsabaToth archon810 maciejmackowiak

repo: disqus/disqus-install-examples


text:
Bad gateway and no logs with minimal traefik setup

Hi, with the following super minimal docker-compose.yaml setup, with the service getting exposed through Traefik, hitting the server via http returns me a 502 bad gateway error, and I’m getting no error logs in registry’s dedicated container. Any ideas why?
version: '3.9'

services:
  myregistry:
    image: registry:2
    environment:
      REGISTRY_STORAGE_FILESYSTEM_ROOTDIRECTORY: /data
    volumes:
      - ./data:/data
    restart: always
    ports:
      - 5000:5000
    networks:
      - proxy
      - default
    labels:
      traefik.enable: true
      traefik.docker.network: proxy
      traefik.http.routers.docker-registry-secure.entrypoints: websecure
      traefik.http.routers.docker-registry-secure.rule: Host(`myregistry.mydomain.tld`)
      traefik.http.services.docker-registry-secure.loadbalancer.server.port: 5000

networks:
  proxy:
    external: true

I'm not familiar with how traefik works, I'm afraid but I'd expect traefik to log something when the upstream server fails to respond for whatever reason. I'd also suggest opening this in the discussions (https://github.com/distribution/distribution-library-image/discussions/landing) instead of as a GH issue.

authors: hood milosgajdos

repo: distribution/distribution-library-image


text:
Update to listing of companies that rely on DITA-OT

Add Vasont CMS
Break (increasingly lengthy) list into categories: Authoring tools, content management systems, delivery systems, print

@keberlein Look at https://github.com/dita-ot/dita-ot.github.io/pull/29/commits, the PR still contains the old PR's commit and the merge commit. The problem is that update branch has been branched of from your master branch, not dita-ot.github.io repo's master branch.
This PR should not be merged as is. Instead, cherry pick 100da4d408eeabac25506fd5b810b29f9c11dae7 and close the PR without merging.

Thank you for the explanation and help. I'll straighten this out.

Superseded by #30.

authors: infotexture jelovirt keberlein


text:
Fixed some UI bugs

Well detailed description of the change :
 I worked on the SearchByUsersList.js , SearchByPostsList.js , Error404Page.js, Error500Page.js, Error404Page.css, LoginOrSignUp.css, Error500Page.css and SearchByUsersAndPostList.css.

Context of the change :
 There are UI bugs in these files, i tried to fix them

Type of change :

[x] Bug fix

Screenshots :
Text not visible in /login
Before :

Now :

Condensed text in search + the "4 4" color isn't following the STYLE_GUIDE.md
Before :

Now :

The Mumble Logo in 404 and 500 : (mobile view)
Before:

Now :

Checklist:

[x] I have read the CONTRIBUTING document.
[x] My code follows the STYLE_GUIDE of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas

closes #300 #299

@MidouWebDev Add 1 empty line in Error404.css and Error500.css files

@Hrithik5 okey !


text:
Bug with moving a page

Moving a page to the root of pages can result in a 500 error under the following circumstances reported by @mkoistinen

Add 4 pages nested within each other so that Alpha is the parent of Beta which is the parent of Gamma which is the parent of Delta.
Publish each page.
Move Beta to beneath Alpha but at the root.

The error is caused by this line.
Calling get_last_root_node can result in a draft or live page, so certain operations like moving a page that assume the passed page is a draft, will fail and potentially corrupt the tree because it can result in operations being done directly to the live page vs the intended draft page.

Fixed on 3.3 by https://github.com/divio/django-cms/pull/5294

repo: divio/django-cms


text:
Release/2.16.3

Let's use this PR for more next release.

The maintainers of this repo require that all pull request submitters agree and adhere to the following:

[ ] I have read and agree to the contribution guidelines.
(required)
[ ] All related documentation has been updated to reflect the changes made. (required)
[ ] My commit messages are cleaned up and ready to merge. (required)

The maintainers of this repository require you to select the semantic version type that
the changes in this pull request represent.  Please select one of the following:

[ ]  major
[ ]  minor
[x]  patch
[ ]  documentation only

Shall I tag 2.17.0 instead?

Cause it was new features 2.16.3 is ok since there are no super exciting features.

I just imagine that there would be an urgent bug that we need to fix and that would be 2.16.3 instead. I've never used git flow` to manage a project, is it a more common practice to release a minor than a patch version?

We need to also prepare a change log.

Added a message file, please review again.

it looks like maintainerd is not auto tagging the release.

I pushed 2.16.4 manually https://github.com/divmain/GitSavvy/releases/tag/2.16.4

repo: divmain/GitSavvy

license: mit

license_source: bigquery


text:
Deprecated types definition dependencies

commander, ora and table provide their own type definitions, no need to depend on the corresponding @types/<package>'s.

Thanks for reporting! Fixed now 👍

authors: georges-gomes nizhib

repo: divriots/jampack


text:
🛑 Arcadja is down

In d25bcad, Arcadja (https://www.arcadja.com/auctions/en/) was down:

HTTP code: 404
Response time: 957 ms

Resolved: Arcadja is back up in 28b519e after 7 minutes.

repo: divtiply/artupptime


text:
Not working

I tried this package but it doesn't work I tried an older version but not working too, can you fix it

The problem was fixed successfully


text:
[BUG] "django.db.utils.OperationalError: error in index cms_cmsplugin_level_0ccc318d after drop column: no such column: level"

Description
I started a new project, following the virtualenv instructions, and sqlite. When trying to run migrations, it fails when trying to drop what appear to be old MPTT fields (level, lft, rght, etc), which don't appear to exist:
Applying cms.0006_auto_20140924_1110...Traceback (most recent call last):
  File "<redacted>/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
  File "<redacted>/site-packages/django/db/backends/sqlite3/base.py", line 357, in execute
    return Database.Cursor.execute(self, query, params)
sqlite3.OperationalError: error in index cms_cmsplugin_level_0ccc318d after drop column: no such column: level

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/jamalex/fle/learningequality.org-v3/le_cms/manage.py", line 22, in <module>
    main()
  File "/home/jamalex/fle/learningequality.org-v3/le_cms/manage.py", line 18, in main
    execute_from_command_line(sys.argv)
  File "<redacted>/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "<redacted>/site-packages/django/core/management/__init__.py", line 440, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "<redacted>/site-packages/django/core/management/base.py", line 402, in run_from_argv
    self.execute(*args, **cmd_options)
  File "<redacted>/site-packages/django/core/management/base.py", line 448, in execute
    output = self.handle(*args, **options)
  File "<redacted>/site-packages/django/core/management/base.py", line 96, in wrapped
    res = handle_func(*args, **kwargs)
  File "<redacted>/site-packages/django/core/management/commands/migrate.py", line 349, in handle
    post_migrate_state = executor.migrate(
  File "<redacted>/site-packages/django/db/migrations/executor.py", line 135, in migrate
    state = self._migrate_all_forwards(
  File "<redacted>/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
    state = self.apply_migration(
  File "<redacted>/site-packages/django/db/migrations/executor.py", line 252, in apply_migration
    state = migration.apply(state, schema_editor)
  File "<redacted>/site-packages/django/db/migrations/migration.py", line 130, in apply
    operation.database_forwards(
  File "<redacted>/site-packages/django/db/migrations/operations/fields.py", line 170, in database_forwards
    schema_editor.remove_field(
  File "<redacted>/site-packages/django/db/backends/sqlite3/schema.py", line 417, in remove_field
    super().remove_field(model, field)
  File "<redacted>/site-packages/django/db/backends/base/schema.py", line 720, in remove_field
    self.execute(sql)
  File "<redacted>/site-packages/django/db/backends/base/schema.py", line 199, in execute
    cursor.execute(sql, params)
  File "<redacted>/site-packages/django/db/backends/utils.py", line 103, in execute
    return super().execute(sql, params)
  File "<redacted>/site-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
  File "<redacted>/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
  File "<redacted>/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
  File "<redacted>/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "<redacted>/site-packages/django/db/backends/utils.py", line 89, in _execute
    return self.cursor.execute(sql, params)
  File "<redacted>/site-packages/django/db/backends/sqlite3/base.py", line 357, in execute
    return Database.Cursor.execute(self, query, params)
django.db.utils.OperationalError: error in index cms_cmsplugin_level_0ccc318d after drop column: no such column: level

Steps to reproduce
Followed the instructions at https://docs.django-cms.org/en/latest/how_to/install.html#installation
with settings:
"""
Django settings for le_cms project.

Generated by 'django-admin startproject' using Django 4.1.

For more information on this file, see
https://docs.djangoproject.com/en/4.1/topics/settings/

For the full list of settings and their values, see
https://docs.djangoproject.com/en/4.1/ref/settings/
"""

from pathlib import Path

# Build paths inside the project like this: BASE_DIR / 'subdir'.
BASE_DIR = Path(__file__).resolve().parent.parent

# Quick-start development settings - unsuitable for production
# See https://docs.djangoproject.com/en/4.1/howto/deployment/checklist/

# SECURITY WARNING: keep the secret key used in production secret!
SECRET_KEY = "<redacted>"

# SECURITY WARNING: don't run with debug turned on in production!
DEBUG = True

ALLOWED_HOSTS = []

SITE_ID = 1

# Application definition

INSTALLED_APPS = [
    "djangocms_admin_style",
    "django.contrib.admin",
    "django.contrib.auth",
    "django.contrib.contenttypes",
    "django.contrib.sessions",
    "django.contrib.messages",
    "django.contrib.staticfiles",
    "django.contrib.sites",
    "cms",
    "menus",
    "treebeard",
]

MIDDLEWARE = [
    "django.middleware.security.SecurityMiddleware",
    "django.contrib.sessions.middleware.SessionMiddleware",
    "django.middleware.common.CommonMiddleware",
    "django.middleware.csrf.CsrfViewMiddleware",
    "django.contrib.auth.middleware.AuthenticationMiddleware",
    "django.contrib.messages.middleware.MessageMiddleware",
    "django.middleware.clickjacking.XFrameOptionsMiddleware",
]

ROOT_URLCONF = "le_cms.urls"

TEMPLATES = [
    {
        "BACKEND": "django.template.backends.django.DjangoTemplates",
        "DIRS": [],
        "APP_DIRS": True,
        "OPTIONS": {
            "context_processors": [
                "django.template.context_processors.debug",
                "django.template.context_processors.request",
                "django.contrib.auth.context_processors.auth",
                "django.contrib.messages.context_processors.messages",
            ],
        },
    },
]

WSGI_APPLICATION = "le_cms.wsgi.application"

# Database
# https://docs.djangoproject.com/en/4.1/ref/settings/#databases

DATABASES = {
    "default": {
        "ENGINE": "django.db.backends.sqlite3",
        "NAME": BASE_DIR / "db.sqlite3",
    }
}

# Password validation
# https://docs.djangoproject.com/en/4.1/ref/settings/#auth-password-validators

AUTH_PASSWORD_VALIDATORS = [
    {
        "NAME": "django.contrib.auth.password_validation.UserAttributeSimilarityValidator",
    },
    {
        "NAME": "django.contrib.auth.password_validation.MinimumLengthValidator",
    },
    {
        "NAME": "django.contrib.auth.password_validation.CommonPasswordValidator",
    },
    {
        "NAME": "django.contrib.auth.password_validation.NumericPasswordValidator",
    },
]

# Internationalization
# https://docs.djangoproject.com/en/4.1/topics/i18n/

LANGUAGES = [
    ("en", "English"),
    ("es", "Español"),
]

LANGUAGE_CODE = "en"

TIME_ZONE = "UTC"

USE_I18N = True

USE_TZ = True

# Static files (CSS, JavaScript, Images)
# https://docs.djangoproject.com/en/4.1/howto/static-files/

STATIC_URL = "static/"

# Default primary key field type
# https://docs.djangoproject.com/en/4.1/ref/settings/#default-auto-field

DEFAULT_AUTO_FIELD = "django.db.models.BigAutoField"

Expected behaviour
Successful migration run.
Actual behaviour
Traceback shown above is displayed, and migrations are interrupted. Deleting the database and trying to migrate again gives the same result.
Additional information (CMS/Python/Django versions)
$ python -V
Python 3.9.7

$ pip freeze
asgiref==3.5.2
Django==4.1
django-classy-tags==3.0.1
django-cms==3.11.0
django-formtools==2.3
django-sekizai==4.0.0
django-treebeard==4.5.1
djangocms-admin-style==3.2.0

Do you want to help fix this issue?

[ ] Yes, I want to help fix this issue and I will join #workgroup-pr-review on Slack to confirm with the community that a PR is welcome.
[x] No, I only want to report the issue.

I note that commenting out these lines in the migration allow it to complete, but I'm not sure whether that would cause other issues down the line:
from django.db import models, migrations

class Migration(migrations.Migration):

    dependencies = [
        ('cms', '0005_auto_20140924_1039'),
    ]

    operations = [
        migrations.AlterModelOptions(
            name='page',
            options={'ordering': ('path',), 'verbose_name': 'page', 'verbose_name_plural': 'pages', 'permissions': (('view_page', 'Can view page'), ('publish_page', 'Can publish page'), ('edit_static_placeholder', 'Can edit static placeholders'))},
        ),
        # migrations.RemoveField(
        #     model_name='cmsplugin',
        #     name='level',
        # ),
        # migrations.RemoveField(
        #     model_name='cmsplugin',
        #     name='lft',
        # ),
        # migrations.RemoveField(
        #     model_name='cmsplugin',
        #     name='rght',
        # ),
        # migrations.RemoveField(
        #     model_name='cmsplugin',
        #     name='tree_id',
        # ),
        # migrations.RemoveField(
        #     model_name='page',
        #     name='level',
        # ),
        # migrations.RemoveField(
        #     model_name='page',
        #     name='lft',
        # ),
        # migrations.RemoveField(
        #     model_name='page',
        #     name='rght',
        # ),
        # migrations.RemoveField(
        #     model_name='page',
        #     name='tree_id',
        # ),
        migrations.AlterField(
            model_name='cmsplugin',
            name='depth',
            field=models.PositiveIntegerField(editable=False),
        ),
        migrations.AlterField(
            model_name='cmsplugin',
            name='numchild',
            field=models.PositiveIntegerField(default=0, editable=False),
        ),
        migrations.AlterField(
            model_name='cmsplugin',
            name='path',
            field=models.CharField(unique=True, max_length=255, editable=False),
        ),
    ]

Sorry, I missed this line in one of the callouts on the instructions page:

For the cms to work correctly, you will need django version 3.2. Work with newer versions can be unstable.

I downgraded to Django 3.2 and it no longer gave this error with the original migration. Sorry!

@jamalex I note the settings generated using django 4.1. I think django-cms 3.11 supports 4.0, but I don't think we support 4.1 yet.

authors: jamalex marksweb

repo: django-cms/django-cms


text:
Fixed incorrect docker commands

Should be docker-compose not docker compose.
Description

Related resources

#...
#...

Checklist

[x] I have opened this pull request against develop
[x] I have added or modified the tests when changing logic
[x] I have followed the conventional commits guidelines to add meaningful information into the changelog
[x] I have read the contribution guidelines  and I have joined #workgroup-pr-review on Slack to find a “pr review buddy” who is going to review my pull request.

Hello!
Thanks a lot for Pull request!
Docker Compose is now included inside Docker. That's because the comments have been changed to docker compose
You can read more about that here!: https://docs.docker.com/compose/cli-command/

authors: crydotsnake stukev


text:
runserver_plus does not work with werkzeug 2.1.0

Werkzeug just released version 2.1.0 on March 28, 2022 (4-5 hours ago as of writing this).  When using runserver_plus with that version of werkzeug, the development server cannot be started.
As part of werkzeug 2.1.0, some previously deprecated code was removed, including werkzeug.server.shutdown
From the werkzeug release notes:  "Remove the non-standard shutdown function from the WSGI environ when running the development server. See the docs for alternatives."
In django-extensions runserver_plus.py - line 326 we have this:
del environ['werkzeug.server.shutdown']
which results in a KeyError since shutdown was removed
Rolling back to werkzeug <2.1 (2.0.3) resolves the issue.
This is the first time I've looked into code for runserver_plus -- but would be happy to provide a PR if anyone with more familiarity can provide some rough guidance.
Also, while making this change, perhaps the preceding line is from runserver_plus (if not options['keep_meta_shutdown_func']:) is also no longer needed as well...?

I just commented out the two lines in runserver_plus and so far the server is working fine in debug mode.

I just commented out the two lines in runserver_plus and so far the server is working fine in debug mode.

Same here, lines 325 and 326. No problems after a few hours of heavy Django testing.

This is affecting me too, namely because of:
  File "/path/to/lib/python3.9/site-packages/django_extensions/management/commands/runserver_plus.py", line 326, in make_environ
    del environ['werkzeug.server.shutdown']
KeyError: 'werkzeug.server.shutdown'

This is affecting me too, namely because of:
  File "/path/to/lib/python3.9/site-packages/django_extensions/management/commands/runserver_plus.py", line 326, in make_environ
    del environ['werkzeug.server.shutdown']
KeyError: 'werkzeug.server.shutdown'

If you open runserver_plus.py and comment out lines 325 and 326, the problem should go away.

So a
if 'werkzeug.server.shutdown' in environ:
    del environ['werkzeug.server.shutdown']

should fix this for all versions ?

There is actually a workaround for this that doesn't involve locally editing runserver_plus.py (or creating a fork): the --keep-meta-shutdown option seems to prevent exactly this behaviour (wanting to delete that key from environ). So you can just add that to the runserver_plus command line, until it gets fixed.

authors: atleta bchip50 cpontvieux-systra farridav fortin hamblin

repo: django-extensions/django-extensions


text:
Fix for hanging when printing large SQL quires

When printing large quires it would hang, this just cuts it off to ensure it doesn't go out of hand. A common large query is bulk insert.

Coverage decreased (-0.01%) to 38.56% when pulling ad3c3068fe2453fe3d42416edffa916df0b0e77b on maxnordlund:truncate-large-sql into e79cf5141b3aa056fd50f332111165fec9cafcbf on django-extensions:master.

Can you add a configuration option for the cutoff point ? Then if users want to set it to truncate to shorter (or longer) queries they could do so.
Thanks !

Sure thing, what would be a good name you recon?

Was thinking something like settings.EXTENSIONS_PRINT_SQL_TRUNCATE.
For shell_plus there is already settings.SHELL_PLUS_PRINT_SQL however there is no runserver_plus equivalent of that.
Maybe settings.SHELL_PLUS_PRINT_SQL_TRUNCATE and settings.RUNSERVER_PLUS_PRINT_SQL_TRUNCATE ?
But I'm completely open to other suggestions as well :)

Sounds like a plan.

Coverage decreased (-0.2%) to 38.41% when pulling 76a837f212e88aae1f919e420622230a3a1dc2a5 on maxnordlund:truncate-large-sql into e79cf5141b3aa056fd50f332111165fec9cafcbf on django-extensions:master.

Thanks !

No problemo

authors: coveralls maxnordlund trbs


text:
fix: package name is django-hurricane

package name in installation instruction is just "hurricane" it needs to be "django-hurricane"

coverage: 89.068%. remained the same when pulling 95962d45d0cd975dc19f9f04bc556ae2069549e7 on hng:fix/readme-installation-package into 6b1b51669bd7fcfb479c10c1adbc6e094324bb37 on django-hurricane:main.

Thank you very much for your contribution! Good catch!

authors: SteinRobert coveralls hng

repo: django-hurricane/django-hurricane


text:
Proposal: make the Export action similar to Delete action

I made some tweaks to django-import-export locally and I'm wondering if there is interest in a PR. (my code is not quite PR-ready right now, hence my asking).
The tweak is to add a regular "Export" action that does not need an additional dropdown for the formats. Instead, the formats are chosen on a separate view, similar to how the delete action shows a separate view for confirmation.

Then after clicking "Go" we see an intermediate view. The view already exists in django-import-export, it is being reused here with minor changes:

Finally, I'm currently sending a download link via messages, but it might be better to use some JS to trigger the download, not yet sure on this point:

So, any interest in having a PR with this? Currently I'm implementing this as an additional mixin, leaving the other action as is.

BTW, my reason for doing this tweak is that I'm using a little JS hack that turns the action dropdown into a bunch of buttons. The extra dropdown wasn't really working well with this:
https://github.com/frnhr/django-admin-action-buttons
Shameless plug: that's my app ☝
But I'm guessing this approach is simple to make compatible with other apps (Grappelli, etc.)

Hmm, very interesting @frnhr .  IMHO, I see nothing wrong with this in the import-export project as it falls into its scope as far as I am concerned.
Personally, I would welcome a PR! You can always submit it and then see what others have to say.


text:
Added blocks to import template

Problem
Described in #1487
Solution
Added blocks for each section of the import template listed below:
1- confirm_import_form block for the confirm import form.
2- import_form block for the import form.
3- errors block for the import errors.
4- validation_errors block for the validation errors.
5- preview block for the preview.

Thanks for submitting this.  I think that this should go into our forthcoming 3.0 release, just in case there are any clashes with existing implementations, so I have changed the base branch.
Feel free to add your name to AUTHORS

I also adjusted the indentation so we can see the difference with 'release-3-x'

authors: TheRealVizard matthewhegarty


text:
Add support for postgres ArrayField

Add postgres ArrayField to widget_from_django_field() lookup and have it return a new widget, SimpleArrayWidget, when running Django >= 1.8.

Resolves #469

Thanks @thauk-copperleaf. Would it be possible to add some test with new functionality? It would make it much easier for other developers that are not familiar with ArrayField (like I am )

Here's a test. It took me a while how to elegantly create a migration that would only create the model for postgres.

Merged, thanks a lot!

authors: bmihelac thauk-copperleaf


text:
Question: Simple Checkout without multiple steps

I'm evaluation django oscar for a project atm and looking at how hard it would be to customize the checkout to one (ajax) request (No signup).
So far it seems like the checkout requires multiple stages and redirects and I found #1678 which seems something in that direction.
Therefore my question: How hard is it at the moment to create a whole order from scratch within one request ? Is this even possible or do I have to use multiple steps ?
If it is possible, could someone please point me in the right direction one how this could be done ?
thanks

Hi @steffenmllr,
With released versions of oscar you'd have to copy together code from a number of places to create an order. So it's possible, but only because oscar is open source :)
We're using this branch https://github.com/machtfit/django-oscar/tree/machtfit right now, and we have a one-step checkout process. However, we do require signing in and we have no basket functionality (only one product, quantity always 1).
I do hope to get all of his into oscar proper, but only time will tell whether that'll happen.
HTH
Markus
P.S. feel free to reopen if you have further questions.

Additionally, take a look at https://github.com/django-oscar/django-oscar/blob/master/src/oscar/apps/order/utils.py#L38
This class is responsible for creating the final order, so if you collect the required info on some other way (remember it's all just Django) and you pass them to this method then all will be fine :-)

authors: mbertheau mvantellingen steffenmllr

repo: django-oscar/django-oscar


text:
Fixed #30393 -- Added validation to target of startapp command

https://code.djangoproject.com/ticket/30393

@felixxm Thanks to your kind review!
I tried to fix according to your review
could you review again?

@jdufresne @felixxm
Thanks to your reviews :+1:
I made test_invalid_target_name and used unittest.subTest

@MyungSeKyo Thanks! I rebased from master and pushed small final edits.

authors: MyungSeKyo felixxm

repo: django/django


text:
Refs #25466 -- Removed unused DeprecationInstanceCheck.

Unused since ff419de263138e905dff44c5cb806310c70f32aa.

DeprecationInstanceCheck is a deprecation shim (like warn_about_renamed_method) that can be useful for a future deprecation (we should use them more often).

This specific deprecation shim has been used exactly once since its introduction in 2015 (8d1a001ef6dcbbe8053da05cdb3ec99965b0953f). I question if this specific shim is truly useful in practice or will continue to go unused in the coming years.

authors: felixxm jdufresne


text:
Fixed #33061 -- Fixed handling nonexistent keys with negative deltas in incr()/decr() in memcached backends.

This PR makes sure a ValueError is raised when a user tries to increment or decrement the value of a key that does not exist.
According to the ticket (33061), this may or may not have been true before, but now should always be true.
Here are the relevant docs stating the intended behavior. Specifically, this sentence was brought up in the ticket discussion as relevant:

A ValueError will be raised if you attempt to increment or decrement a nonexistent cache key.

The ticket has some more context if anything is unclear 🙂

I had a little bit of trouble running the right tests locally:
❯ ./tests/runtests.py cache.tests.PyMemcacheCacheTests
Testing against Django installed in '/Users/sondrelg/Documents/django/django'
Found 58 test(s).
Creating test database for alias 'default'...
System check identified no issues (0 silenced).
ssssssssssssssssssssssssssssssssssssssssssssssssssssssssss
----------------------------------------------------------------------
Ran 58 tests in 0.001s

OK (skipped=58)
Destroying test database for alias 'default'...

For anyone reviewing this, do you know (off the top of your head) how to enable a specific cache backend in the test settings?

For anyone reviewing this, do you know (off the top of your head) how to enable a specific cache backend in the test settings?

You need to install memcached and pylibmc/pymemcache locally, and define a CACHES setting that points at your memcached instance, see docs.

It was defining the CACHES setting I was a little bit confused by, but I ended up just changing global_settings temporarily and that at least did the trick. Thanks for the feedback 🙂
With PyMemcacheCache enabled, the first commits regression tests fail as intended in 94d7c2a04d8c4136a6f4590a2722753 👍
❯ git checkout 94d7c2a04d8c4136a6f4590a2722753d8e1d2f37
Note: switching to '94d7c2a04d8c4136a6f4590a2722753d8e1d2f37'.

...

HEAD is now at 94d7c2a04d Refs #33061 -- Add regression test

❯ ./tests/runtests.py cache.tests
Testing against Django installed in '/Users/sondrelg/Documents/django/django'
Found 546 test(s).
Creating test database for alias 'default'...
Creating test database for alias 'other'...
System check identified no issues (0 silenced).
..............................................................................................................................................................................ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss...............ss..F.................F..................s.......................................................................................................................................................................................................
======================================================================
FAIL: test_decr (cache.tests.PyMemcacheCacheTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sondrelg/Documents/django/tests/cache/tests.py", line 398, in test_decr
    cache.incr('does_not_exist', -1)
AssertionError: ValueError not raised

======================================================================
FAIL: test_incr (cache.tests.PyMemcacheCacheTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sondrelg/Documents/django/tests/cache/tests.py", line 382, in test_incr
    cache.incr('does_not_exist', -1)
AssertionError: ValueError not raised

----------------------------------------------------------------------
Ran 546 tests in 86.253s

FAILED (failures=2, skipped=119)

@sondrelg Thanks :1st_place_medal:  Welcome aboard :boat:
@cjerdonek Thanks for the review :+1:

authors: felixxm sondrelg


text:
Ticket #14497 - Better display for read only file fields

Based on patch by Adam J Forster, Paul Collins and Julien.

Updated pull request after @collinanderson review suggesting to use conditional_escape on displayed values

buildbot, test this please

@collinanderson hopefully fixed tests failing because of SimpleTestCase.urls deprecations

buildbot, test this please

flake8 warnings:
../tests/admin_widgets/widgetadmin.py:26:1: E302 expected 2 blank lines, found 1
../tests/admin_widgets/widgetadmin.py:30:1: E302 expected 2 blank lines, found 1
../tests/admin_widgets/tests.py:386:120: E201 whitespace after '{'
../tests/admin_widgets/tests.py:386:159: E202 whitespace before '}'
Also, start your commit message like: Fixed #14497 --

Il 03/02/2015 21:29, Collin Anderson ha scritto:

flake8 warnings:
../tests/admin_widgets/widgetadmin.py:26:1: E302 expected 2 blank lines,
found 1
../tests/admin_widgets/widgetadmin.py:30:1: E302 expected 2 blank lines,
found 1
../tests/admin_widgets/tests.py:386:120: E201 whitespace after '{'
../tests/admin_widgets/tests.py:386:159: E202 whitespace before '}'

Fixed

Also, start your commit message like: Fixed #14497 --

Done

buildbot, test this please

merged in 2be621e44c1b5b68c895383f3e20b1f17ddb447a, thanks.

authors: collinanderson timgraham xrmx


text:
#21 API to collect details for newspaper

#21 Implemented API for collecting details for the newsletter.
Checklist

[x] Code follows project conventions
[x] Reviewed locally

Notes for Reviewers
@DevilsAutumn Please review the following text and let me know if there are any opportunities to make changes. Thank you.
Related Issues
https://github.com/djangoindia/djangoindia.org/issues/21

@DevilsAutumn  Bhaiya why there are so many commit messages. is it fine or not?

This is not wrong but not the best way. You are basically updating your branch with latest changes from main repo. Best way to do this is rebasing. update your forked branch and rebase your working branch on your main branch and then force push changes.

Yes Bhaiya, I have tested it locally.
I will make the changes that were asked for.  👍


text:
Attribute to apply transparent wrappers to fields

Most rkyv functionality can be implemented in terms of wrapper types around some data. For example:
pub struct Compress<T>(T);

// implement archive, serialize, and deserialize

#[derive(Archive, Serialize, Deserialize)]
pub struct Example {
    name: Compress<String>,
}

This is a great way to take advantage of type extensions to quickly leverage other libraries. However, we're still left with a Wrapper<T> which is just noise for the unarchived field. A better option would be to have the derive macros automatically perform this transformation for us. This would ideally lead to some syntax like:
#[derive(Archive, Serialize, Deserialize)]
pub struct Example {
    #[with(Compress)]
    name: String,
}

that would wrap the field &T in a Wrapper<T> and archive the &Wrapper<&T>. During deserialization, it would deserialize it into the original type. Applying multiple wrappers should also be easy:
#[derive(Archive, Serialize, Deserialize)]
pub struct Example {
    #[with(Intern, Compress)]
    name: String,
}

with wrappers being applied left to right (i.e. Intern<&Compress<&T>>).
Wrapper types should already be expressible using the traits currently available:
pub struct Wrap<'a, T>(&'a T);

pub struct ArchivedWrap<T>(T);

pub struct WrapResolver<T: Archive>(T::Resolver);

impl<'a, T> Archive for Wrap<'a, T> {
    type Archived = ArchivedWrap<T::Archived>;
    type Resolver = WrapResolver<T>;

    fn resolve(&self, pos: usize, resolver: Self::Resolver, out: &mut MaybeUninit<Self::Archived>) {
        self.0.resolve(pos, resolver.0, project_struct!(out: Self::Archived => 0);
    }
}

impl<'a, T: Serialize<S>, S: Fallible + ?Sized> Serialize<S> for Wrap<'a, T> {
    fn serialize(&self, serializer: &mut S) -> Result<Self::Resolver, S::Error> {
        Ok(WrapResolver(self.0.serialize(serializer)?))
    }
}

impl<'a, T: Archive, D: Fallible + ?Sized> Deserialize<T, D> for ArchivedWrap<T::Archived>
where
    T::Archived: Deserialize<T, D>,
{
    fn deserialize(&self, deserializer: &mut D) -> Result<T, D::Error> {
        Ok(self.0.deserialize(deserializer))
    }
}

but the bound T: Archive<Archived = Self> may need to be lifted from Deserialize.

Need to make sure we can support enum variants, e.g.
enum Segment<&'a T> {
    Primary(&'a T),
    Secondary(&'a T),
}

// wrapper implementation

#[derive(Archive, Serialize, Deserialize)]
pub struct Example {
    #[with(Segment::Secondary)]
    name: String,
}

I think it should be okay as long as the arguments are treated as constructors.

Fixed by cd320234423b076b3edd7c29e31eb66964e02377

repo: djkoloski/rkyv


text:
🛑 Writeguard is down

In 6b5d341, Writeguard (https://www.writeguard.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Writeguard is back up in bd34489.


text:
🛑 Writeguard is down

In 2585e62, Writeguard (https://www.writeguard.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Writeguard is back up in cbe5fc6.


text:
Scrolling

Would be great to have a feature that allows to scroll horizontal/vertical. Using an upper div-container will allow scrolling, but wouldn't keep the axis visible.

I've added pan and zoom support on a fork - see what you think...

authors: Dalanie ajlimbert


text:
added json option

This is the command line option to allow for a json output file
one can now type -j FILENAME and the output will be in json
Added option for json output

This is the command line option to allow for a json output file
one can now type -j FILENAME and the output will be in json
Added option for json output
PS- Not sure really what Im doing here as this is my second ever GITHUB pull request and first time ever contributing to the open source community.

We're all learning, thank you for contributing.

authors: dkovar malzoek

repo: dkovar/analyzeMFT


text:
Refactor + activate daily cron for all main D repos

I finally got around fixing the crashes of the daily cron.
For now, the bot is very quiet. It will just add labels.
Once we are confident in the labelling, we can do more things, like e.g.
commenting on the PR.

I ran this locally in simulate mode for all repositories and with --cron-daily for Phobos. There's quite a chunk of PRs which need a rebase:
needs work: https://github.com/dlang/phobos/pulls?q=is%3Aopen+is%3Apr+label%3A"needs+work"
needs rebase: https://github.com/dlang/phobos/pulls?utf8=✓&q=is%3Aopen+is%3Apr+label%3A"needs+rebase"+
stalled: https://github.com/dlang/phobos/pulls?utf8=✓&q=is%3Aopen+is%3Apr+label%3A"stalled"+

Okay, so I am going to be bold and finally turn it on.
If anything goes wrong, it just adds labels, which is easy to revert.

repo: dlang-bots/dlang-bot


text:
Move allSatisfy, anySatisfy and staticIndexOf to searching category in the quick index table

Follow up to #4376

LGTM

@ZombineDev sorry for the extra work - LGTM.

Auto-merge toggled on

Thanks!
@wilzbach no worries.

authors: DmitryOlshansky ZombineDev wilzbach

repo: dlang/phobos


text:
Remove AliasSeq when following __traits is directly aliasable

There's just one remaining AliasSeq!(__traits but it's not aliasable (getAliasThis).
edit: it will be after fix for blocker merged.

Blocker is https://issues.dlang.org/show_bug.cgi?id=19420. I'm not against some help with that. It must be possible to get the symbol for an expression requiring this since it works in the AliasSeq but for now i don't see how with the public API.

Is this still blocked?

No, it will go into the green zone now.

Well, I forgot about that but  still need to fix D-Scanner

Buildkite is still failing but i'm not involved in this stuff. Hope it will be fixed ASAP so that we could get nice green checkers everywhere.

you can remove the blocked label now.

done.

The Buildkite failures are unrelated.

Buildkite is still failing but i'm not involved in this stuff. Hope it will be fixed ASAP so that we could get nice green checkers everywhere

Yup, that would be nice, but sadly seems to be a bit challenging. See e.g.
https://github.com/dlang/ci/pull/340
https://github.com/dlang/ci/pull/344
https://github.com/dlang/ci/pull/346
https://github.com/dlang/ci/pull/350
https://github.com/dlang/ci/pull/351

Thanks for the merge and my sorries for the remaining work ion dlang ci :wink:

authors: BBasile thewilsonator wilzbach


text:
🛑 CBU Online Website is down

In 30d16dc, CBU Online Website (https://cbuonline.edu) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CBU Online Website is back up in 6fa2396.

repo: dlee-calbaptist/monitor


text:
onSuccess event

In the previous version we had an onSuccess callback function that passed back the resulting css and some stats about the running time of the compilation process.
Can this be made available again in gulp-sass 2.x, or has it also disappeared from node-sass?

I don't think I'd be interested in re-implementing onSuccess; this is Gulp and we pass the compiled CSS down through the pipe, if a user wants to work with the compiled CSS, they should do it through standard piping.
I'd consider attaching the stats info to the file object being passed down the pipe, but it doesn't give much information that Gulp doesn't have already; the only real insight it gives above and beyond what you already get with Gulp is includedFiles.
@dlmanning @Keats thoughts on that?

We like to use the stats to see when it is feasible to use sync vs async compilation.
When too many files get pushed in the pipeline together, the concurrent compilation breaks down the system and makes compilation go slower instead of faster.
The easiest way to see this difference is a compile duration per file, exactly was is available in the stats object. It's not actually the css i'm that interested in.
Gulp-sass would just be the wrapper that passes options to node-sass and returns the result as is. Doesn't look like going beyond its intended behavior to me.

Like I said, I'd consider adding the stats object to the file being passed down the pipe, that way it can be retrieved in following functions. Looking for feedback from the other maintainers

As long as it doesn't interfere with basic usage, I'm ok with it

I added it before, so I don't suppose I have any objections to adding it again.

Any updates on this? Need a PR?

authors: HeadOnAPlate Keats Snugug dlmanning mattidupre

repo: dlmanning/gulp-sass


text:
Service Request by [JESSICA NEUFELD] for demographic data

[ ] Qualtrics Service Request Form was received from User
[ ] e-mail acknowledging that User's Qualtrics Service Request Form was sent
[ ] Problem NOT RESOLVED
[ ] Problem PARTIALLY RESOLVED
[ ] Problem FULLY RESOLVED and Issue is Closed
[ ] Qualtrics Post-Service Request Survey was sent to User

Use comments feature (below) to document:

A clear and concise description of the solution.

A clear and concise description of any alternative solutions or features you've considered.

Any additional context, such as screenshots about the problem.

From: Jessica Neufeld <jn2434@columbia.edu>Date: Tuesday, November 9, 2021 at 3:37 PMTo: Donrie Purcell <donrie.purcell@einsteinmed.org>Subject: Re: DATA as promised
CAUTION: This email comes from an external source; the attachments and/or links may compromise our secure environment. Do not open or click on suspicious emails. Please click on the “Phish Alert” button on the top right of the Outlook dashboard to report any suspicious emails.
Hi Donrie, Thanks for sending this. Is it possible to get this for all of Putnam's measures?  Also it looks like you hid columns A-M in the Measures Monitoring tab. There is no need to hide them since I will need the dates this information is reported on. For instance, I need to know how many kits were delivered in August and the demographics of the individuals who received kits in August verse September. I've given the data coordinators a deadline of 11/10 to get their measures into the tracker.  Would it be possible to get the breakdown for Putnam's demographics and the measures monitoring date on 11/11 or latest 11/12? Thanks again, Jessica

From: Jessica Neufeld <jn2434@columbia.edu>Date: Thursday, November 11, 2021 at 3:56 PMTo: Donrie Purcell <donrie.purcell@einsteinmed.org>Cc: david lounsbury <david.lounsbury@einsteinmed.org>Subject: Re: Data as Promised !
CAUTION: This email comes from an external source; the attachments and/or links may compromise our secure environment. Do not open or click on suspicious emails. Please click on the “Phish Alert” button on the top right of the Outlook dashboard to report any suspicious emails.
Thank you Donrie!  On Thu, Nov 11, 2021 at 2:41 PM Donrie Purcell <donrie.purcell@einsteinmed.org> wrote:Hi Jessica Please see attached the requested data.If you look on the Measures Monitoring tab you will see all the fields that were filled out to date. RegardsDonrie Purcell, PhD, MPH Every generation has the obligation to free men's minds for a look at new worlds,....to look out from a higher plateau than the last generation.Ellison S. Onizuka CONFIDENTIALITY: This email (including any attachments) may contain confidential, proprietary and/or privileged information. Any duplication, copying, distribution, dissemination, transmission, disclosure or use in any manner of this email (including any attachments) without the authorization of the sender is strictly prohibited. If you receive this email (including any attachments) in error, please notify the sender and delete this email (including any attachments) from your system. Thank you.

repo: dlounsbu/NYHEALing-IPAtracker-support


text:
Add supports RA74

Check list:

xqsystem/login: 🟢
xqsystem/init_info: 🟢
misystem/status: 🟢
xqnetwork/mode: 🟢
misystem/topo_graph: 🟢
xqsystem/check_rom_update: 🟢
xqnetwork/wan_info: 🟢
misystem/led: 🟢
xqnetwork/wifi_detail_all: 🟢
xqnetwork/wifi_diag_detail_all: 🟢
xqnetwork/avaliable_channels: 🟢
xqnetwork/wifi_connect_devices: 🟢
misystem/devicelist: 🟢
xqnetwork/wifiap_signal: 🟢
misystem/newstatus: 🟢
xqsystem/reboot: ⚪
xqsystem/upgrade_rom: ⚪
xqsystem/flash_permission: ⚪
xqnetwork/set_wifi: ⚪
xqnetwork/set_wifi_without_restart: ⚪

can you put the Ukrainian language?

repo: dmamontov/hass-miwifi


text:
Kinesis Consumer / Producer

Kinesis sink and stream

Completed with https://github.com/dmateusp/fs2-aws/pull/7 and https://github.com/dmateusp/fs2-aws/pull/6

authors: dmateusp kiambogo


text:
OAuth2AccessToken#scope() returns requested, not the issued scope

Hi,
an "authorization server MAY fully or partially ignore the scope requested by the client" [RFC6749, Sect. 3.3]. In the authorization server's access token response, the scope field is "OPTIONAL, if identical to the scope requested by the client; otherwise, REQUIRED" [RFC6749, Sect. 5.1].
I have a client that obtains an access token using the client credentials flow, using oauth-essentials 0.8. The scope issued by the authorization server is in fact different from the requested scope.
With the debugger, I can see the issued scope in the field JsonAccessToken#mTokenresponse. However, if I try to inspect the scope programatically by calling OAuth2AccessToken#scope(), I get the value of the field JsonAccessToken#mScope which is passed in (via TokenResponseHandler from ClientCredentialsTokenRequest.
Is this a bug or did I miss something?
Cheers,
Christoph

Looks like a bug indeed. I'll take care of this.

#37 will fix this. It should be released as 0.8.1 by tomorrow afternoon.

Great, thanks!

Fixed in 0.8.1

authors: chludwig-haufe dmfs


text:
Use dlib 1.1.0

Fix compilation by using latest dlib.

Thank you!


text:
cpp-package: Cannot open include file: 'mxnet-cpp/op.h'

I synced latest code and tried to build mxnet . Build fails with the following error message.
cpp-package\include\mxnet-cpp/optimizer.hpp(19): fatal error C1083: Cannot open include file: 'mxnet-cpp/op.h': No such file or directory
It seems 00b2b47f70283e0706256b8585b97b63efd25c57 change set removed mxnet-cpp/op.h.
but other code is still including "mxnet-cpp/op.h"
MxNetCpp.h
optimizer.hpp
.cpp files under cpp-package/example/
these file include "mxnet-cpp/op.h".
Environment info
Operating System:Windows 10
Compiler: Visual Studio 2013
Package used (Python/R/Scala/Julia):Cpp-package
MXNet commit hash (git rev-parse HEAD):3f75c41fb3cd176089bfd06ab76a0e04723cefe0
Error Message:
10>D:\nvTFS2\External\Mxnet\mxnet_20170517_3f75c41fb3cd176089bfd06ab76a0e04723cefe0\cpp-package\include\mxnet-cpp/optimizer.hpp(19): fatal error C1083: Cannot open include file: 'mxnet-cpp/op.h': No such file or directory
Minimum reproducible example
#include "MxNetCpp.h"

Did you try to set USE_CPP_PACKAGE=1 and make -j from ~/mxnet?

How did you create the project in vs?

I use cmake

What's the output when building in visual studio. Could you searchRunning OpWrapperGenerator.py in the output window?

I see . Does OpWrapperGeneratoer.py generate op.h?
I miss this error.
9>  "Running: OpWrapperGenerator.py"
9>  Traceback (most recent call last):
9>    File "OpWrapperGenerator.py", line 402, in
9>      raise(e)
9>  WindowsError: [Error 126] The specified module could not be found
Which python package do I need to install?
I could not find setupenv.cmd which is mentioned at http://mxnet.io/get_started/windows_setup.html.

Could you edit this line https://github.com/dmlc/mxnet/blob/master/cpp-package/CMakeLists.txt#L14
to
COMMAND echo "Running: OpWrapperGenerator.py $<TARGET_FILE:mxnet>"
then regenerate the solution and paste the output here?

i know what's happening. some dependencies (probably blas or opencv) are missing. you need to register the dlls systemwide.

Built is succeeded after I edited CmakeList.txt and added blas path.
Thank you.

i meet  the same problem but my error tip is
7>"Running: OpWrapperGenerator.py E:/MxNet/incubator-mxnet/build/Debug/libmxnet.dll"
7>Traceback (most recent call last):
7>  File "OpWrapperGenerator.py", line 426, in
7>    raise(e)
7>WindowsError: [Error 126]
how can i solve this ?
thank for much

@Rangocold Do you have openblas dll registered?

Alright. I have the same problem than explained here. But I would be interested to know how @rococopeach  managed to solve the problem! Because I have no idea why openblas can't be found, and if it is really openblas that is the problem...

@dmidge8
i give up openblas because i config the environment many days but not work
i use mkl final, it works
when u cmake , add an item ENABLE_MODULE_MKL is key
if u want to use openblas, i find a video may help u
https://www.bilibili.com/video/av18047152/

@Rangocold  Thank you for your help! Unfortunately, I still didn't manage to make it work. Except the fact that I didn't include OpenCV during the Cmake (there is the USE_OPENCV that you can turn off if you want to avoid using it).
And I confirm, openblas is hard to properly use, it seems... If MKL is the Intel Math Kernel Library, I would rather not use it.
But it seems the problem comes from the header file that is not generated, because the python script get stucks with OSError: [WinError 126]. The problem is during the cdll.LoadLibrary. Would it be possible to generate the header file another way?

@dmidge8 You have to use some linear algebra library (openblas, MKL or something equivalent)  to make it work, because if the header generator can't read the API information from the mxnet dll, it means other programs that depend on mxnet.dll won't work either.

@lx75249 Indeed. But I have Openblas in my path, which is also configured in cmake, and I even tried to put openblas directly in the build\Debug\libmxnet.dll folder, altogether with other possibly missing dlls...

Alright, I get it a bit better.
Openblas requires some MinGW library to have all its dependencies satisfied. I had to download them and make them available in the path to have them working.

Had the same problem, "Cannot open include file: 'mxnet-cpp/op.h".
I fixed it by edit output_file_name = "cpp-package/include/mxnet-cpp/op.h",  in OpWrapperGenerator.py file.

Hi,
I got the same problem when generating op.h:
I ran D:\Paul\libs_sources\mxnet14\cpp-package\scripts>python OpWrapperGenerator.py d:/Paul/libs_sources/mxnet14/build/Release/libmxnet.dll
and got an error:
kernel32 0
dll name to load d:/Paul/libs_sources/mxnet14/build/Release/libmxnet.dll
d:/Paul/libs_sources/mxnet14/build/Release/libmxnet.dll 0
Traceback (most recent call last):
  File "OpWrapperGenerator.py", line 432, in <module>
    raise(e)
  File "OpWrapperGenerator.py", line 426, in <module>
    f.write(patternStr % ParseAllOps())
  File "OpWrapperGenerator.py", line 319, in ParseAllOps
    cdll.libmxnet = cdll.LoadLibrary(sys.argv[1])
  File "C:\Users\dev_admin\AppData\Local\Continuum\anaconda3\envs\Mxnet131GPUPy36\lib\ctypes\__init__.py", line 428, in LoadLibrary
    return self._dlltype(name)
  File "C:\Users\dev_admin\AppData\Local\Continuum\anaconda3\envs\Mxnet131GPUPy36\lib\ctypes\__init__.py", line 349, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: [WinError 126] The specified module could not be found

Do you know how to generate correctly op.h, help please!

You need to put every dependency dll of mxnet.dll in your windows path (and restart visual studio to be sure that the change is applied).

repo: dmlc/mxnet


text:
some problems of mx.nd.Convolution() ....

NO.1
According :https://github.com/dmlc/mxnet/pull/5096
I try to test 3D-convolution, but why the result are all zeros ?
import mxnet as mx
def test_Convolution3D(conv3D):
data = mx.nd.arange(24).reshape((2,1,2,2,3))
conv3D_ex = conv3D.simple_bind(mx.cpu(), arg_dicts={'data':data})
conv3D_ex.forward()
return conv3D_ex.outputs[0].asnumpy()
x = mx.sym.Variable('data', shape=(2,1,2,2,3))
conv3D = mx.sym.Convolution(data=x, kernel=(2, 2, 3), pad=(1, 1, 1), num_filter=2)
print test_Convolution3D(conv3D)
NO.2
and another question:
import mxnet as mx
a = mx.nd.arange(24).reshape((2,1,2,2,3))
b = mx.nd.Convolution(data=a, kernel=(2, 2, 3), no_bias=True, pad=(1, 1, 1), num_filter=2)
print b.asnumpy()
Error  message:
MXNetError: [22:39:32] src/c_api/c_api_ndarray.cc:55: Check failed: num_inputs == infered_num_inputs (1 vs. 2) Expecting 2 inputs, got 1 in operator Convolution

No. 1
You used simple_bind, so all the ndarrays are initialized in backend as zeros. You can initialize those ndarrays before calling forward using the arg_dict interface of the executor conv3D_ex.
No. 2
Convolution takes two arguments when bias is off, data and weight. In order to use the imperative interface, you need to provide both. Consider the following:
import mxnet as mx
a = mx.nd.arange(24).reshape((2,1,2,2,3))
weight = mx.nd.ones((2, 1, 2, 2, 3))
b = mx.nd.Convolution(data=a, weight=weight, kernel=(2, 2, 3), no_bias=True, pad=(1, 1, 1), num_filter=2)
print b.asnumpy()

This issue is closed due to lack of activity in the last 90 days. Feel free to ping me to reopen if this is still an active issue. Thanks!

authors: kobenaxie reminisce szha


text:
[WIP] fix wd, replace pickle with misc pickle

@piiswrong

It's probably better to make it work like lr_scale? instead of feeding in names, just feed in wd_scale and assign the scales in model?

@mavenlin @mli I added pickle which is able to pack classes but not test yet in distributed environment. Cloud you take a look whether it works?

@piiswrong It is a little bit mass currently, the final goal is to make optimizer aware each parameter, and use a special group of wd/lr/momentum/gamma/schedule for each one. However, the parameter is somehow related to symbol, and our optimizer is not symbol, which makes it a little headache.

@antinucleon self.kwargs["arg_names"] = arg_names this is going to break other optimizers that doesn't have arg_names as argument. I think it should be moved to base Optimizer class as a set_wd_scale method.

@piiswrong I tested misc.pickle has some problem when pickle optimizer. Ideally, it will pack code together with object, however when it involves heritage, it doesn't work. I will close this PR and send a new PR for the wd issue.

@antinucleon remember to move arg_names to the base class as a method. It's currently breaking all optimizers other than SGD

authors: antinucleon piiswrong


text:
[RELAY][PASS] FoldScaleAxis Forward

This is a first serious attempt to implement an NN related optimization pass on relay. This PR contains the following changes:

[x] Make squeeze's attrs numpy compatible
[x] Add option to type resolver to write back checked_type to type_annotation if the original one is None

There could be some debate on whether we should do so, but it is in general helpful in NN optimizations, where later phase of optimization will rely on knowing types of all arguments  @jroesch

[x] Support a general FoldScaleAxis Forward

So far only forward direction is implemented.

Hopefully, this can serve as an example of how optimizations can be done in NNVMv2(relay) IR, and how the infrastructure of relay makes writing optimization in a more principled fashion.
The Algorithm
While so far only the forward direction is implemented. The general idea is that we transform Expr to tuple of (value, axes, scale), where the final result satiesfies:
result = value
for i, k in enumerate(axes):
   k-ith dimension of result *= i-th dimension of scale

Then we can propagate this signal along and fold the scale if necessary.  However, it is possible that certain scale may never be consumed if there is no dense/conv2d that follow multiplication.
In order to make sure all the scale we sent out can be consumed eventually, we run a backward "preparation phase", which propagates the demand of the potential axes scaling back to its input.
The new pass is more general than the FoldScaleAxis in nnvm

The new pass support arbitrary scaling of multiple axes(although the further implementation is necessary), which could be helpful in NHWCc case,
The new pass support folding forward into two separate path of conv2d, which was not possible in NNVM.

@jroesch @ZihengJiang @yzhliu @zhiics @FrozenGene @merrymercy @srkreddy1238 @masahi please review

Thanks @zhiics @ZihengJiang for helpful reviews, please check again

repo: dmlc/tvm


text:
early stopping doesn't work in Spark package

I believe that early stopping is broken in the Spark package. Here is a minimal example:
scala> val data = sc.parallelize(List(1.0 -> Vectors.dense(Array(1.0)))).toDF("label", "features")
data: org.apache.spark.sql.DataFrame = [label: double, features: vector]

scala> val model = new XGBoostClassifier(Map[String, Any]()).setNumEarlyStoppingRounds(10).fit(data)
java.lang.IllegalArgumentException: custom_eval does not support early stopping
  at ml.dmlc.xgboost4j.scala.spark.XGBoostExecutionParamsFactory.overrideParams(XGBoost.scala:150)
  at ml.dmlc.xgboost4j.scala.spark.XGBoostExecutionParamsFactory.<init>(XGBoost.scala:96)
  at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainDistributed(XGBoost.scala:535)
  at ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier.train(XGBoostClassifier.scala:190)
  at ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier.train(XGBoostClassifier.scala:40)
  at org.apache.spark.ml.Predictor.fit(Predictor.scala:118)
  ... 49 elided

However, I am not setting custom_eval in my params. Checking the logs, these are the parameters that XGBoost is running with (clipped for brevity):
21/01/28 21:04:57 INFO XGBoostSpark: Running XGBoost 1.1.2 with parameters:
num_early_stopping_rounds -> 10
custom_eval -> null

So, it seems that internally, XGBoost is setting custom_eval to null, and then later checking to see if the key exists. But, it always exists, since it is set with a default value of null.
I believe the correct behavior should be to not set a default value, or modify the check appropriately.
I am using version 1.1.2 and Spark 2.4.0.

I just encountered this issue yesterday and found a workaround:
This line means that if you have "maximize_evaluation_metrics" set then it won't check for whether the custom_eval key exists:
https://github.com/dmlc/xgboost/blob/master/jvm-packages/xgboost4j-spark/src/main/scala/ml/dmlc/xgboost4j/scala/spark/XGBoost.scala#L151
So if you add .setMaximizeEvaluationMetrics(maximizeEvaluationMetrics) to your model then it works. maximizeEvaluationMetrics should be a boolean value

I just encountered this issue yesterday and found a workaround:
This line means that if you have "maximize_evaluation_metrics" set then it won't check for whether the custom_eval key exists:
https://github.com/dmlc/xgboost/blob/master/jvm-packages/xgboost4j-spark/src/main/scala/ml/dmlc/xgboost4j/scala/spark/XGBoost.scala#L151
So if you add .setMaximizeEvaluationMetrics(maximizeEvaluationMetrics) to your model then it works. maximizeEvaluationMetrics should be a boolean value

any response from the maintainers? not being able to use early stopping is a major bug

Would you like to open a PR?

https://github.com/dmlc/xgboost/pull/6708

could we change the checking instead? setting default would make it consistent with other params

authors: CodingCat r-luo sammynammari trivialfis

repo: dmlc/xgboost


text:
Expand categorical node.

This PR includes expanding tree on categorical feature, saving/loading such trees.  It's partly extracted from https://github.com/dmlc/xgboost/pull/5949 , with changes that now the saved tree model contains actual categories instead of bitsets.

The test is quite limited as there's no way to build categorical splits right now except for manually expanding nodes.  So I will leave better tests for later PRs.

Codecov Report

Merging #6028 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #6028   +/-   ##
=======================================
  Coverage   79.14%   79.14%
=======================================
  Files          12       12
  Lines        3040     3040
=======================================
  Hits         2406     2406
  Misses        634      634

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4d99c58...693f334. Read the comment docs.

This PR brought significant impact on performance as it adds 1 extra vector for each node.  I will work on another PR to restore the performance as I can't revert it cleanly.

authors: codecov-commenter trivialfis


text:
Failed request to chrome devtools protocol

I'm getting an error lately, running the tests locally and on the ci.

Failed request to chrome devtools protocol. This can happen if cypress lost connection to the browser or the command itself is not valid. Original cypress error: Error: Invalid parameters (Failed to deserialize params.x - BINDINGS: double value expected at position 27)
node_modules/cypress-real-events/fireCdpCommand.js:19:1

@Amitkahlon using a browser other than chrome?
This error appears for me when using webkit.

@admalik100 I actually found out I was doing something wrong! sorry for bothering...

repo: dmtrKovalenko/cypress-real-events


text:
set required py2-future version in submit.sh where python is setup

Impact of the new feature
WMAgent
Is your feature request related to a problem? Please describe.
it costed me a some wasted time when I copied from submit.sh into CRAB wrapper,
since the python dependency is listed in an unexpected place. Makes cose harder
to read IMHO, Also you may want to be free to use different py2-future releases
for different archs at lines 121-126
Describe the solution you'd like
move these lines
https://github.com/dmwm/WMCore/blob/6362413ccbaeed76f9d09e33e11b5dab24a13eef/etc/submit.sh#L51-L52
to the place where python is bootstrapped ? Currently Line 120 and below.
Describe alternatives you've considered
leaving it like this. Which increases chances of mistakes in the future.
Additional context

Stefano, just to make sure I understand what you requested here:

move the PY_FUTURE_VERSION (constant) variable closer to where the python logic is. Basically inside the block "WMAgent COMP Python bootstrap starting";
and an auto-discovery logic for the latest py2-future version?

If so, my comments are:

PY_FUTURE_VERSION is defined where the other constants and command line parameters are
before we change the py2-future version, I hope we can actually stop depending on it.

I was only suggesting the first bulled. Was not suggesting any autodiscovery logic. We clearly disagree on what is the best place for such constant, but if you have in mind to stop depending on this.. who cares. This request was mostly triggered by the desire to put all of the "env. bootstrap" into a separate script which I can source in CRAB.

I guess we discussed enough, and came to conclusion that it is better not to change things

authors: amaltaro belforte

repo: dmwm/WMCore


text:
Improve REST Validation error reporting

Impact of the new feature
all systems which use WMCore/REST
Inform which systems would be affected by this new feature. WMAgent? ReqMgr2? WorkQueue? WMStats? MicroServices? etc
Is your feature request related to a problem? Please describe.
When a client makes  REST call with an invalid parameter, the server log onlys reports the param name, not the value. E.g.
[20/May/2021:17:59:25]    InvalidParameter: InvalidParameter 87e4709cea7386b2865e745b4355173a [HTTP 400, APP 302, MSG 'Invalid input parameter', INFO "Incorrect 'activity' parameter", ERR None]
[20/May/2021:17:59:25] crabserver-77df9f796d-cbbmk 137.138.120.6 "PUT /crabserver/prod/workflow HTTP/1.1" 400 Bad Request [data: 2228 in 733 out 4193 us ] [auth: OK "/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=sciaba/CN=430796/CN=Andrea Sciaba" "" ] [ref: "" "CRABClient/3.3.1705.patch4" ]

One has to correlate with client logs to know which exact call was made. With distributed clients like CRABClient (and also when debugging new code) this is quite annoying and lead to much wasted time.  Printing the refused value in server log
would make things much faster. Remember that server log only has the base url, not the  data part of the query.
Describe the solution you'd like
Code should be change in
https://github.com/dmwm/WMCore/blob/e62fe1b309d6ff3bf8e5a167838933fac7026f80/src/python/WMCore/REST/Validation.py#L31-L53
so that in line 42 the invalid value is also printed, not only the parameter name
Same for other basic checks, although I have never seen  a REST call failing validation other than on a (u)string check.
Describe alternatives you've considered
There is no practical way to capture current exception higher up in REST code and re-raise with additional info, code is like
https://github.com/dmwm/CRABServer/blob/cbd0a86868d76c9c58fc641a1a32ab59a24738db/src/python/CRABInterface/RESTUserWorkflow.py#L331-L346
etc.
Additional context
I can not imagine any reason not to do this. Lack of imagination ?
In theory this could impact tools which automatically parse REST logs, but I do not think we have any. Also those could be smart enough to survive adding things to the log. Existing text does not need to change.
Let me know if you'd like me to test this in CRAB and submit a tested PR, but I will not do if you do not like the idea or know of reasons not to do it.

Hi @belforte,
I just checked, and I can see the current version of the code actually does return the value itdelf in combination with the value name and type: https://github.com/dmwm/WMCore/blob/2d3f8d89137ef89ec46441ce16e5dc48dcd2c7e3/src/python/WMCore/REST/Validation.py#L48  At least when it comes to string values (as I understand from the initial description). I hope I am not missing something here. Can you confirm this is still needed?
FYI @amaltaro

WOW
yes, it is exactly what I was asking for, looks like @mapellidario found it useful too https://github.com/dmwm/WMCore/commit/02da765bcb96f81739cd8092b6d6c146f722a219#diff-4777b993af8a3d85e3b3ae9c0a1581455964bdadbaaff4aa17b0cc216211e410
Thanks Todor
Thanks Dario
This can be closed as obsolete.

thanks @belforte

authors: belforte todor-ivanov


text:
Error Installing 9.3 - 9.3.1

Description of bug
Clean Installation Error at 18%
Error log
1:03 Minutes   |   18% ERROR occured - System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. Drop constraints from dbo.[TabModuleSettings] Drop constraints from dbo.[TabModules] Drop constraints from dbo.[ModuleSettings] Drop constraints from dbo.[Modules] Drop constraint FK_CoreMessaging_Subscriptions_Modules from dbo.[CoreMessaging_Subscriptions] Drop constraint FK_ModulePermission_Modules from dbo.[ModulePermission] Drop constraints from dbo.[ModuleControls] Drop constraints from dbo.[CoreMessaging_NotificationTypeActions] Drop constraints from dbo.[Skins] Drop constraints from dbo.[ModuleDefinitions] Drop constraints from dbo.[CoreMessaging_NotificationTypes] Drop constraint FK_CoreMessaging_Messages_CoreMessaging_NotificationTypes from dbo.[CoreMessaging_Messages] Drop constraints from dbo.[ContentItems_Tags] Drop constraints from dbo.[Taxonomy_Terms] Drop constraints from dbo.[Tabs] Drop constraint FK_TabPermission_Tabs from dbo.[TabPermission] Drop constraint FK_TabSettings_Tabs from dbo.[TabSettings] Drop constraint FK_TabUrls_Tabs from dbo.[TabUrls] Drop constraint FK_TabVersions_TabId from dbo.[TabVersions] Drop constraints from dbo.[SkinPackages] Drop constraints from dbo.[SkinControls] Drop constraints from dbo.[DesktopModules] Drop constraint FK_PortalDesktopModules_DesktopModules from dbo.[PortalDesktopModules] Drop constraints from dbo.[Authentication] Drop constraints from dbo.[Assemblies] Drop constraints from dbo.[Taxonomy_Vocabularies] Drop constraints from dbo.[Packages] Drop constraint FK_JavaScriptLibrariesPackages from dbo.[JavaScriptLibraries] Drop constraint FK_LanguagePacks_Packages from dbo.[LanguagePacks] Drop constraint FK_PackageDependencies_Packages from dbo.[PackageDependencies] Drop constraints from dbo.[EventLogConfig] Drop constraint FK_EventLog_EventLogConfig from dbo.[EventLog] Drop constraints from dbo.[ContentItems] Drop constraint FK_ContentItems_MetaData_ContentItems from dbo.[ContentItems_MetaData] Drop constraint FK_ContentWorkflowLogs_ContentItems from dbo.[ContentWorkflowLogs] Drop constraint FK_Files_ContentItems from dbo.[Files] Drop constraint FK_ScheduleItemSettings_Schedule from dbo.[ScheduleItemSettings] Drop constraints from dbo.[Roles] Drop constraint FK_DesktopModulePermission_Roles from dbo.[DesktopModulePermission] Drop constraint FK_FolderPermission_Roles from dbo.[FolderPermission] Drop constraint FK_ModulePermission_Roles from dbo.[ModulePermission] Drop constraint FK_TabPermission_Roles from dbo.[TabPermission] Drop constraint FK_UserRoles_Roles from dbo.[UserRoles] Drop constraint FK_Relationships_RelationshipTypes from dbo.[Relationships] Drop constraints from dbo.[ProfilePropertyDefinition] Drop constraint FK_UserProfile_ProfilePropertyDefinition from dbo.[UserProfile] Drop constraint FK_ContentWorkflowStatePermission_Permission from dbo.[ContentWorkflowStatePermission] Drop constraint FK_DesktopModulePermission_Permission from dbo.[DesktopModulePermission] Drop constraint FK_FolderPermission_Permission from dbo.[FolderPermission] Drop constraint FK_ModulePermission_Permission from dbo.[ModulePermission] Drop constraint FK_TabPermission_Permission from dbo.[TabPermission] Drop constraint FK_ContentItems_MetaDataMetaData from dbo.[ContentItems_MetaData] Drop constraint FK_PortalLanguages_PortalLanguages from dbo.[PortalLanguages] Drop constraints from dbo.[FolderMappings] Drop constraint FK_FolderMappingsSettings_FolderMappings from dbo.[FolderMappingsSettings] Drop constraint FK_Folders_FolderMappings from dbo.[Folders] Drop constraint FK_EventLog_EventLogTypes from dbo.[EventLog] Drop constraint FK_ContentWorkflowActions_ContentTypes from dbo.[ContentWorkflowActions] Add 6 rows to dbo.[ContentTypes] Add 146 rows to dbo.[EventLogTypes] Add 3 rows to dbo.[FolderMappings] Add 1 row to dbo.[IPFilter] Add 35 rows to dbo.[Journal_Types] Add 1 row to dbo.[Languages] Add 5126 rows to dbo.[Lists] ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) at System.Data.SqlClient.SqlCommand.RunExecuteNonQueryTds(String methodName, Boolean async, Int32 timeout, Boolean asyncWrite) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry) at System.Data.SqlClient.SqlCommand.ExecuteNonQuery() at DotNetNuke.Data.SqlDatabaseConnectionProvider.ExecuteNonQuery(String connectionString, CommandType commandType, Int32 commandTimeout, String query) at DotNetNuke.Data.SqlDataProvider.ExecuteScriptInternal(String connectionString, String script, Int32 timeoutSec) ClientConnectionId:05449aa8-8ba7-486b-9255-58a617502490 Error Number:-2,State:0,Class:11 // / SqlDataProvider / / / / / / Note: To manually execute this script you must / / perform a search and replace operation / / for dbo. and / / / // -- Pointer used for text / image updates. This might not be needed, but is declared here just in case DECLARE @pv binary(16) -- minimum date to set for all creted on last modified on columns DECLARE @CreateBy int = -1 DECLARE @UpdateBy int = NULL DECLARE @UpdateByNotNull int = -1 DECLARE @CreateOn datetime = {ts '2000-01-01 00:00:00'} DECLARE @UpdateOn datetime = NULL DECLARE @UpdateOnNotNull datetime = {ts '2000-01-01 00:00:00'} PRINT(N'Drop constraints from dbo.[TabModuleSettings]') ALTER TABLE dbo.[TabModuleSettings] NOCHECK CONSTRAINT [FK_TabModuleSettings_TabModules] PRINT(N'Drop constraints from dbo.[TabModules]') ALTER TABLE dbo.[TabModules] NOCHECK CONSTRAINT [FK_TabModules_Modules] ALTER TABLE dbo.[TabModules] NOCHECK CONSTRAINT
.... super duper long log error
2012 server, sql 2014
Additional context
I clean installed 9.2.2 ok, upgraded to 9.3.1 RC0 ok and without the banner rotator security error #2650
I was upgrading to 9.3.0 another site instance and it bugged out locked the site up with a DNN installation error saying the connection was busy with another installation... I see that build is no longer downloadable.  Had to go to backup...
Affected version

[x] 9.3.0

[ ] Chrome

[x] Firefox

[ ] Safari

[ ] Internet Explorer

[ ] Edge

I get the same error when trying install on a clean Azure db.
04/04/2019 18:56:08 [ERROR] DotNetNuke.Services.Upgrade.Upgrade System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.

DNN9.3.1 Installation error
I get the same erro when trying to install on a clean SQL db.

i had ot use 9.2.2 then upgrade from that

I was also only able to upgrade from DNN9.2.2

Exact same issue here, mine was a clean install using the install file, clean database / fresh install, i hit the retry several times and same thing. Guess I need to go back a version.

I highly recommend to everyone experiencing this issue to give a try to the 9.3.2 RC0. I think this is related to a timeout issue that should be resolved in 9.3.2.
Obviously it is an RC (Release Candidate) so do not use that in production, but it would help a lot to get your testing on this, I think this is resolved but since it does not happen on all environments, it would be very nice to have your testing on this to know if the fix is good or not while we are still in the RC phase.
You can download it here:
https://github.com/dnnsoftware/Dnn.Platform/releases/tag/v9.3.2-rc0

@valadas I got the same error installing 9.3.2-RC0 on a free tier Azure app service. When I get time, I'll give it another go with some more DTUs.
This was a blank slate install, not an upgrade. I created an Azure app service using the DNN Platform 9.1.0 template, then used KUDU to delete all the files in wwwroot folder, and uploaded the 9.3.2-RC0 install files instead. Then visited the site to start installation.

I did a clean install now of DNN932 RC0 without any errors.

@pjkruger I had a timeout installing 9.3.1 on a low end server (not azure though) and 9.3.2 RC0 did install fine. We are progressing...
@OllyHodgson I guess we still need to improve this more, I know 9.4.x will have a few more enhancements to the install process, crossing fingers.

Same error here on a clean install of 9.3.1. (not azure)

Tried a clean 932 (9.3.2-rc0_install) install, again a timeout error:
18% ERROR occured - System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
Add 1 row to dbo.[Languages]
Add 5126 rows to dbo.[Lists] ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction)  at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)  at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)  at System.Data.SqlClient.SqlCommand.RunExecuteNonQueryTds(String methodName, Boolean async, Int32 timeout, Boolean asyncWrite)  at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
at DotNetNuke.Data.SqlDatabaseConnectionProvider.ExecuteNonQuery(String connectionString, CommandType commandType, Int32 commandTimeout, String query)
at DotNetNuke.Data.SqlDataProvider.ExecuteScriptInternal(String connectionString, String script, Int32 timeoutSec)
ClientConnectionId:e58e2691-2766-4649-aba1-d3657560915c
Error Number:-2,State:0,Class:11
DECLARE @CreateBy int = -1
DECLARE @UpdateBy int = NULL
DECLARE @UpdateByNotNull int = -1
DECLARE @CreateOn datetime = {ts '2000-01-01 00:00:00'}
DECLARE @UpdateOn datetime = NULL
DECLARE @UpdateOnNotNull datetime = {ts '2000-01-01 00:00:00'}
PRINT(N'Add 1 row to dbo.[Languages]')
SET

went back to 9.2.2. and did clean install without errors

9.3.2 Release worked for me too.

There was some final improvements after the RC in this regards which I think solves this issue and I am closing it for that reason, you you can still reproduce using 9.3.2 official release, please open a new issue.

It is back again in latest 9.9.0. Same error at 18% of the installation when I Install in shared hosting.
But in local IIS in Windows 10 installation with the same MSQL server 2017 worked without a problem.
Is this mean we can't install DNN in to shared hosting anymore?

the original error (Timeout) sounds like a performance issue. If this happens ins hosting environment, there might be a performance lack of the shared SQL Server, being much slower than a local one, maybe due to not enough memory for caching.

authors: OllyHodgson beckerben dush-a idasbv pjkruger sleupold thabaum valadas winsider


text:
Downloading Linux on Chromebook; cannot run command "sudo startxfce4". Please Help!

Please paste the output of the following command here: sudo edit-chroot -all

name: xenial
encrypted: no
Entering /mnt/stateful_partition/crouton/chroots/xenial...
crouton: version 1-20190902190258~master:9a594a66
release: xenial
architecture: armhf
xmethod: xorg
targets: xfce
host: version 11316.165.0 (Official Build) stable-channel daisy_spring
kernel: Linux localhost 3.8.11 #1 SMP Sun Mar 3 22:44:20 PST 2019 armv7l armv7l armv7l GNU/Linux
freon: yes
Unmounting /mnt/stateful_partition/crouton/chroots/xenial...
Please describe your issue:
I am trying to do coursework for Flatiron and when trying to open my IDE inside of the webpage, I am greeted with a message that says "Google Chrome OS can't open this page". I followed this (https://www.youtube.com/watch?v=QB9puwi2qTo) video exactly to gain access to Linux hoping that would fix this issue. That all seemed to work well until the “sudo startxfce4” command when it failed and said:
(WW) warning, (EE) error, (NI) not implemented, (??) unknown.
(++) Log file: "/tmp/Xorg.crouton.1.log", Time: Wed Sep  4 14:26:29 2019
(==) Using system config directory "/usr/share/X11/xorg.conf.d"
Error org.freedesktop.DBus.Error.ServiceUnknown: The name org.chromium.LibCrosService was not provided by any .service files
method return time=1567621590.112735 sender=:1.11 -> destination=:1.56 serial=989 reply_serial=2
boolean true
MESA-LOADER: failed to retrieve device information
gbm: failed to open any driver (search paths /usr/lib/arm-linux-gnueabihf/dri:${ORIGIN}/dri:/usr/lib/dri)
gbm: Last dlopen error: /usr/lib/dri/exynos_dri.so: cannot open shared object file: No such file or directory
failed to load driver: exynos
EGL_MESA_drm_image required.
(EE)
Fatal server error:
(EE) AddScreen/ScreenInit failed for driver 1
(EE)
(EE)
Please consult the The X.Org Foundation support
at http://wiki.x.org
for help.
(EE) Please also check the log file at "/tmp/Xorg.crouton.1.log" for additional information.
(EE)
Error org.freedesktop.DBus.Error.ServiceUnknown: The name org.chromium.LibCrosService was not provided by any .service files
method return time=1567621590.656952 sender=:1.11 -> destination=:1.58 serial=990 reply_serial=2
boolean true
(EE) Server terminated with error (1). Closing log file.
/usr/bin/xinit: giving up
/usr/bin/xinit: unable to connect to X server: Connection refused
/usr/bin/xinit: server error
Unmounting /mnt/stateful_partition/crouton/chroots/xenial...
Please help!
If known, describe the steps to reproduce the issue:

I'm having a very simlar problem. Have you tried the common issues process from the wiki? (https://github.com/dnschneid/crouton/wiki/Common-issues-and-reporting) Also, did you follow the process from #4026 ? Nothing from either helped me unfortunately, but maybe they'd help you.

@zclay1,
That's a nice simple video that's easy to understand but it doesn't go into some of the other options available like xiwi probably for good reason as it does get more complicated.
The ARM devices like your HP Chromebook 11 G1 seem to have problems with the xorg xmethod.
I would suggest adding the 'xiwi' xmethod and then try launching your xfce4 desktop.
For your chroot you can add xiwi using the update method with the following:

sudo crouton -n xenial -t xiwi -u

As noted in the installation you'll also have to add the 'crouton integration' extension
Hope this helps,
-DennisLfromGA

repo: dnschneid/crouton


text:
⚠ Site ANTS has degraded performance

In 87f8925, Site ANTS (https://ants.gouv.fr) experienced degraded performance:

HTTP code: 200
Response time: 3367 ms

Resolved: Site ANTS performance has improved in 6000192.

repo: dnum-mi/stats-sites-api


text:
Cant change url for prodcution

It seems in you docker file that you are setting the url for the ghost server to http://localost:2368.
How are you supposed to change this?, setting up the config does not seem to have any affect.

Set "url" as an environment variable on your container and it'll overwrite
the value in the config.

@skindc An explanation on how to do this can be found in the Ghost docs: https://docs.ghost.org/v1/docs/config/#section-running-ghost-with-config-env-variables
Closing this as there's a defined way to set config values and this isn't a bug 😄

Hi,
Im so sorry, I had read all of this and has everything I need to do this. It was very late and I was too quick to post.
Just a quick note for anybody else, if you are using a docker-compose.yaml file you can do set the any of the environment variables mentioned in the docs mentioned by acburdine using declarations like so.
service:
...
environment:
-  url=https://blog.skindc.co.uk
...
Also if you are using Nginx and ssl as a seperate service in in the docker composition ensure you set  the following header on the proxy.
proxy_set_header X-Forwarded-Proto $scheme;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

authors: acburdine skindc tianon

repo: docker-library/ghost


text:
Local registry don't have instruction on how to activate local account

I setup a local docker-registry and run docker run -d -p 5000:5000 registry, it start up no problem.
When I push a image to localhost:5000/ubuntu/ping, I was been asked user name and password, email. Then I got these message:
Account created. Please see the documentation of the registry http://localhost:5000/v1/ for instructions how to activate it.
The problem is: http://localhost:5000/v1 does not existing. I have no instruction on how to continue.
When push image, I got error: Error: Status 403 trying to push repository ubuntu/ping: "Access denied, you don't have access to this repo"
I tried with standalone:true in configure file, it is same.
FYI: I didnot get email too. Don't know how the registry localhost handling the email.
Anything else need to do in order to local registry access local user?
Thanks.

whenever there is an error
FATA[0000] Error response from daemon: v1 ping attempt failed with error: Get https://registry.access.redhat.com/v1/_ping: dial tcp: lookup registry.access.redhat.com: no such host. If this private registry supports only HTTP or HTTPS with an unknown CA certificate, please add --insecure-registry registry.access.redhat.com to the daemon's arguments. In the case of HTTPS, if you have access to the registry's CA certificate, no need for the flag; simply place the CA certificate at /etc/docker/certs.d/registry.access.redhat.com/ca.crt
solution to this is creation of account using the docker
docker login registry.access.redhat.com ( complete the details like username, password , email address) after sometime account will be created and message will be get display.
login to the server using the account created
docker login < user_name>
and run the docker pull command to download the registry from redhat.

Didnot worked. Adding --insecure-registry

repo: docker/docker-registry


text:
Registry catalog doesn't survive a restart

Our registry is configured to store all the images on a mounted NAS file system and is hosted in it's own Docker image.
It is configured with SQLAlchemy for search.
When the registry container is restarted, it's coming clean - doesn't know anything about previously stored images on the mounted NAS, even though, all the files and folders are still there.
Is it even possible to seed the registry on start from the stored files?
I have a feeling that it's a missing issue with the SQLAlchemy - it's not preserving the information between the restarts, right? Is it possible to overcome?

SqlAlchemy configuration let you specify where your database live: https://github.com/docker/docker-registry#sqlalchemy
By mounting that database file from a volume, it will survive container destruction.
Does that answer your question?

Can this file be shared across multiple registries? (i.e. HA configuration)
If the file get corrupted, can it be reseeded?

If you want that, then don't use sqlite - but instead postgres / mysql / other.
More about that in the SQLAlchemy documentation.


text:
URL for repo doesn't work

File: engine/installation/linux/rhel.md, CC @mstanleyjones

Elipses (...) are me obfuscating the license
[brian@brian-test1 ~]$ sudo yum-config-manager \
>     --add-repo \
>     https://storebits.docker.com/ee/linux/sub-3...e/docker-ee.repo
Loaded plugins: langpacks, product-id
adding repo from: https://storebits.docker.com/ee/linux/sub-3...e/docker-ee.repo
grabbing file https://storebits.docker.com/ee/linux/sub-3...e/docker-ee.repo to /etc/yum.repos.d/docker-ee.repo
Could not fetch/save url https://storebits.docker.com/ee/linux/sub-3...e/docker-ee.repo to file /etc/yum.repos.d/docker-ee.repo: [Errno 14] HTTPS Error 404 - Not Found

I found adding "rhel" to the path worked
[brian@brian-test1 ~]$ sudo yum-config-manager \
> --add-repo https://storebits.docker.com/ee/linux/sub-3...e/**rhel**/docker-ee.repo
Loaded plugins: langpacks, product-id
adding repo from: https://storebits.docker.com/ee/linux/sub-3...e/rhel/docker-ee.repo
grabbing file https://storebits.docker.com/ee/linux/sub-3...e/rhel/docker-ee.repo to /etc/yum.repos.d/docker-ee.repo
repo saved to /etc/yum.repos.d/docker-ee.repo

Also appears this affects an earlier instruction as well.  I'm now thinking this may be the result of me using a license for Docker for Linux rather than Docker for RHEL.  I need to check whether the URL returned from the store is different for RHEL (i.e. has the edition type as a subdirectory).

These are the instructions for Docker EE for RHEL. Docker EE for Linux uses a different URL scheme, as documented on the Docker Store installation docs. The Store installation docs describe what you need to do to modify the instructions.
The Docker EE for Linux offering is not yet searchable on Store and not separately documented.

centos instructions have "rhel" in the path, but replacing that with "centos" works
ex:
sudo -E yum-config-manager
--add-repo
"$DOCKERURL/centos/docker-ee.repo"

authors: briantd krishna03312018 mstanleyjones


text:
"All nodes participate in an ingress routing mesh" is incorrect

File: engine/swarm/ingress.md, CC @mistyhacks
my testing suggests that the ingress is from manager nodes only. The DOCs suggest ANY node. When I tried to connect to the webservice on a worker I received connectino refused.

@rbucker my tests show that worker nodes can also receive and route connections. Can you share your tests, to see if I'm missing something?
Keep in mind that if you're using a cloud edition like AWS, there might be firewalls or security groups causing the behavior you're seeing.
I'll close this issue for now, but please comment to make sure the docs are correct.

Here's my test setup, one manager and one worker:
docker node ls

HOSTNAME            STATUS              AVAILABILITY        MANAGER STATUS
node-1              Ready               Active              Leader
node-2              Ready               Active

Deploy the service and make it listen on port 8000 of the ingress routing mesh. Not that it matters to the test, but let's also force the service to be scheduled on the manager node.
service create --name wordpress --constraint "node.role==manager" --publish 8000:80 wordpress

Now try to access wordpress from the worker node to see if it works:
curl -IL <worker-node-ip>:8000

HTTP/1.1 302 Found
Date: Fri, 17 Nov 2017 19:00:33 GMT
Server: Apache/2.4.10 (Debian)
X-Powered-By: PHP/5.6.32
Location: http://192.168.99.101:8000/wp-admin/setup-config.php
Content-Type: text/html; charset=UTF-8

HTTP/1.1 200 OK
Date: Fri, 17 Nov 2017 19:00:33 GMT
Server: Apache/2.4.10 (Debian)
X-Powered-By: PHP/5.6.32
Expires: Wed, 11 Jan 1984 05:00:00 GMT
Cache-Control: no-cache, must-revalidate, max-age=0
Content-Type: text/html; charset=utf-8

As long as the endpoint-mode is vip and the mode for any port publications is ingress then hitting a published port on any swarm node will invoke the routing mesh, which will route the work to a valid worker node which is running the service. If you are using Docker for Mac or Docker for Windows, this is obscured by the fact that your Docker host is running inside a thin VM and not directly on your host OS.

authors: joaofnfernandes mistyhacks rbucker


text:
Example for env-file

File: compose/env-file.md, CC @gbarr01
If the documentation simply had one quick example it would be far more useful than it is now (if I'm missing an example, then it's not very clear)

Closing this ticket due to its age, and the impending refactor. If you think this is in error, feel free to reopen. Thanks!

authors: L-Hudson phillijw


text:
404 at: https://docs.docker.com/engine/userguide/dockerimages/

URL: https://docs.docker.com/engine/userguide/dockerimages/

Fixed in 9fd1c9ad27a5735046944623216481e5564abb78


text:
Update upgrade-offline.md

Proposed changes

Unreleased project version (optional)

Related issues (optional)

Thanks, @scjane :)

CC @joaofnfernandes I'm seeing a lot of instances of "login into" when it should simple be "log in to"

authors: johndmulhausen scjane