text:
Moving up some parameter checks in the class hierarchy

Fixes #3282
@nonhermitian notices that parameters are too broadly checked. I moved some of the checks up the class hierarchy. This allows to be more prices in the kind of check and normalization for each class. Also, it can be improved further with a better class hierarchy for Instructions. But that's story for another time.
All the tests are passing. If reviewers find a uncovered case, let's add the test!

Oh, I just came up with a fun example:
from qiskit import *
from qiskit.extensions import *
from qiskit.providers.basicaer import BasicAer

sim = BasicAer.get_backend('qasm_simulator')
qc = QuantumCircuit(2)
qc.h(0)
qc.cx(0, 1)

barrier = Barrier(2)
barrier.params = qc
qc.append(barrier, [0, 1])
print(qc)
print(execute(qc, sim).result().get_counts())

Running this with this PR branch results in a Qobj jsonschema validation error in basic aer because it has a quantum circuit object in the qobj for a parameter. If you run that on master it fails trying to set params with a CircuitError. Not that this is really a sane example, but I think that reinforces my thinking on why the checking was there, because of limitations on the output format from circuits for running. Personally I don't think I really have convinced myself one way or the other.

57854df24 adds validate_parameter to barrier.


text:
Adding permutation synthesis algorithm for LNN

Summary
This commit add the depth-efficient synthesis algorithm for Permutation over the linear nearest-neighbor architecture (LNN) following the paper https://arxiv.org/abs/quant-ph/0701194, chapter 6. This is the second task in #9036.
Any permutation can be synthesized over LNN using a network of SWAP gates with depth at most n and size at most n(n-1)/2 (where both depth and size are measured with respect to SWAPs), or equivalently with depth at most 3n and size at most 3n(n-1)/2 (measured with respect to CNOTs).
Additional (minor) changes include improving the documentation of what a "permutation pattern" is, and moving _get_ordered_swaps to qiskit/synthesis/permutation/permutation_utils.py (and test_get_ordered_swap to test/python/circuit/library/test_permutation.py.
The next step (that would be handled in a follow-up PR) is to add a high-level synthesis plugin for Permutation (this may also require changing Permutation from QuantumCircuit to Gate).
Co-authored with https://github.com/NirGavrielov (Nir Gavrielov).

Oh, also I realized I think we're not adding this new function to the doc tree anywhere we probably should add it so we're publishing the documentation for this algorithm.

@mtreinish, thanks for the comments, it took me quite a number of attempts to get the docstrings working, but now all seems to be good.

source: gharchive/pull-request

authors: alexanderivrii mtreinish

repo: Qiskit/qiskit-terra

license_type: permissive

license_source: github-api


text:
Preliminary representation of rvalue classical expressions in Terra

This is a proposal for initial representation of classical expressions in Terra.  It is simple bit-level operations only on effectively Clbit and ClassicalRegister, and is deliberately designed to be separable from the rest of Terra so it can be replaced in the future if necessary, without painful decoupling of these objects from core Terra ones.
This proposal notably does not require any new public methods or trackers on QuantumCircuit, Clbit or ClassicalRegister.  This includes not having a way to store a runtime expression in a variable of QuantumCircuit for re-use, nor of using these expressions in the parameters to gates.  These may come in the future, but are deliberately excluded from prelim exploratory representations.

I just realised that I didn't include QPY support in the RFC, but I think for the MVP use-case we can actually get away without it; the known places that would support these dynamic-circuits paths (i.e. just IBM's qiskit-ibm-provider atm) export to OQ3 on the client side.

I just realised that I didn't include QPY support in the RFC, but I think for the MVP use-case we can actually get away without it; the known places that would support these dynamic-circuits paths (i.e. just IBM's qiskit-ibm-provider atm) export to OQ3 on the client side.

Unless something has changed recently it actually does the OQ3 export server-side and submits the circuit as a qpy payload to the ibm runtime environment which calls the op3 export as part of the runner program.

Oh no sorry, you're right and I'm totally misremembering.  I'll update to add QPY support as a requirement for release.

I hadn't actually considered chaining at all - honestly, I hadn't really considered anything much beyond what I wrote because I was rushing to get it up before the meeting yesterday.  My rough thoughts on it are:

it's definitely acceptable per the goal of "we can tear this out again";
it doesn't have the problem that the magic methods have of not being able to override the Python logical operators;
I'm not certain it's significantly less verbose than just using all the methods directly, which was the main UX-y goal of the builder interface + overload;
I'm not fully sold that expression trees are best represented as chains. I feel like they have a habit of over-promoting the left operand of a binary expression - a.and(b) looks asymmetric, and it's worse when a and b are more complex;
(minor) there's a few method names in the chain that wouldn't be allowed - and, not and or would need different names, because they're Python keywords.

On balance, I think I personally still prefer the magic-method arithmetic form, but I'm happy to go with the crowd.

authors: jakelishman mtreinish

repo: Qiskit/rfcs


text:
crashed

When i call xlsx.saveAs() api.  A crash occurred inside Excel，Qt6.6.0 + Msvc2019

I found the reason. Sorry, it was caused by my encryption software.

This will also happen without encryption software

source: gharchive/issue

repo: QtExcel/QXlsx

license: MIT


text:
add data download via fdsn for local sensors

data download for local sensors

depends on #10
FYI @miili

repo: QuakeSaver/quakesaver-client


text:
Add Workshop materials to compass

Need to add the assets from the a11y workshop to the Compass media section

@isabela-pf we did do this right?

Everything is in quansight-labs/jupyter-accessibility-workshops/events, but I have not yet opened a PR to link to these resources from anywhere else.
I thought this needed a PR to jupyter/accessibility, but by compass do you mean the compass in this repo? Sorry for the confusion.

Send a PR with a link to https://github.com/Quansight-Labs/jupyter-accessibility-workshops/tree/main/events

I have two PRs for this.

#127 adds the links to this team compass
Quansight-Labs/accessibility #7 (because I think this should also be in the jupyter/accessibility repo.

I opened a PR at jupyter/accessibility #94 for this.

authors: isabela-pf trallard


text:
Fix wrong result with as_subchunks and num_subchunks with integer arrays

Fixes #170

FYI @peytondmurray @ArvidJB, this bug affects versioned-hdf5:
>>> import h5py
>>> import numpy as np
>>> from versioned_hdf5 import VersionedHDF5File
>>> f = h5py.File('test.hdf5', 'w')
>>> file = VersionedHDF5File(f)
>>> with file.stage_version('version1') as vf:
...     data = np.arange(4).reshape((2, 2))
...     d = vf.create_dataset('test', data=data, chunks=(1, 1))
>>> file.close()
>>> f.close()
>>> f = h5py.File('test.hdf5', 'a')
>>> file = VersionedHDF5File(f)
>>> with file.stage_version('version2') as vf:
...     d = vf['test']
...     d[[[False, True], [True, True]]] = -1
Traceback (most recent call last):
  File "<stdin>", line 3, in <module>
  File "/Users/aaronmeurer/Documents/versioned-hdf5/versioned_hdf5/wrappers.py", line 1228, in __setitem__
    self.dataset.__setitem__(index, value)
  File "h5py/_objects.pyx", line 54, in h5py._objects.with_phil.wrapper
  File "h5py/_objects.pyx", line 55, in h5py._objects.with_phil.wrapper
  File "/Users/aaronmeurer/Documents/versioned-hdf5/versioned_hdf5/wrappers.py", line 867, in __setitem__
    index = idx.as_subindex(c)
            ^^^^^^^^^^^^^^^^^^
  File "/Users/aaronmeurer/miniconda3/envs/versioned-hdf5/lib/python3.12/site-packages/ndindex/booleanarray.py", line 168, in as_subindex
    return Tuple(*self.array.nonzero()).as_subindex(index)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/aaronmeurer/miniconda3/envs/versioned-hdf5/lib/python3.12/site-packages/ndindex/tuple.py", line 730, in as_subindex
    raise ValueError("Indices do not intersect")
ValueError: Indices do not intersect

With this PR:
>>> import h5py
>>> import numpy as np
>>> from versioned_hdf5 import VersionedHDF5File
>>> f = h5py.File('test.hdf5', 'w')
>>> file = VersionedHDF5File(f)
>>> with file.stage_version('version1') as vf:
...     data = np.arange(4).reshape((2, 2))
...     d = vf.create_dataset('test', data=data, chunks=(1, 1))
>>> file.close()
>>> f.close()
>>> f = h5py.File('test.hdf5', 'a')
>>> file = VersionedHDF5File(f)
>>> with file.stage_version('version2') as vf:
...     d = vf['test']
...     d[[[False, True], [True, True]]] = -1
>>> file['version2']['test'][:]
array([[ 0, -1],
       [-1, -1]])

repo: Quansight-Labs/ndindex


text:
Unable to Import Python Module in Algorithms Frameworks Example

Expected Behaviour: Successfully running a backtest that ranks every pair combination by its Pearson correlation and trades the pair with the highest correlation.
Actual Behaviour: Returns a algorithm.initialze error and says "unable to import python module"
Reproducing the problem: Run the exact example code at this link https://github.com/QuantConnect/Lean/blob/master/Algorithm.Python/PearsonCorrelationPairsTradingAlphaModelFrameworkAlgorithm.py
Note: This problem persists with all framework example algorithms
Checklist

[Y ] I have completely filled out this template
[ Y] I have confirmed that this issue exists on the current master branch
[Y ] I have confirmed that this is not a duplicate issue by searching issues

[ Y] I have provided detailed steps to reproduce the issue

Hi @MuellerDave !
Just tested PearsonCorrelationPairsTradingAlphaModelFrameworkAlgorithm.py locally and it worked correctly - Have you followed the python setup steps? https://github.com/QuantConnect/Lean/blob/master/Algorithm.Python/readme.md - If the issue persists we would need some more information: setup information (OS, mono version, python version, etc) and the error in detail (log file, snapshot)

Hi Martin!
I am not running the algorithm locally; it is being run online in the QuantConnect IDE. How does that affect it?
Dave
From: Martin-Molinero notifications@github.com
Reply-To: QuantConnect/Lean reply@reply.github.com
Date: Thursday, September 5, 2019 at 8:35 AM
To: QuantConnect/Lean Lean@noreply.github.com
Cc: MuellerDave david.mueller1@ucalgary.ca, Mention mention@noreply.github.com
Subject: Re: [QuantConnect/Lean] Unable to Import Python Module in Algorithms Frameworks Example (#3551)
Hi @MuellerDavehttps://github.com/MuellerDave !
Just tested PearsonCorrelationPairsTradingAlphaModelFrameworkAlgorithm.py locally and it worked correctly - Have you followed the python setup steps? https://github.com/QuantConnect/Lean/blob/master/Algorithm.Python/readme.md - If the issue persists we would need some more information: setup information (OS, mono version, python version, etc) and the error in detail (log file, snapshot)
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/QuantConnect/Lean/issues/3551?email_source=notifications&email_token=ALQEKNGUVSXTU3USXCIRKLLQIEKKDA5CNFSM4ISSIUCKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD57KK2Y#issuecomment-528393579, or mute the threadhttps://github.com/notifications/unsubscribe-auth/ALQEKNCH62DJ4U73BVU3G5LQIEKKDANCNFSM4ISSIUCA.

Tested creating an empty python project and pasting the PearsonCorrelationPairsTradingAlphaModelFrameworkAlgorithm.py code into main.py and it successfully finished.
For Cloud support please open a support ticket or post in the forums sharing the algorithm with the issue. These GH issues reserved for Lean open source issues.

authors: Martin-Molinero MuellerDave

repo: QuantConnect/Lean


text:
Data and Empirics: Pandas Exercise Error

In the first exercise, where the goal is to calculate the percentage price change over the year 2013 for an array of tickers, it appears the graph showing the solution is incorrect. The code appears to work, albeit not the most eloquent solution. The "solution" graph appears to show AAPL price change of ~-50% when really Apple appreciated in 2013.
Here is a cleaner implementation of the solution that leverages more of pandas' great functionality.
ticker_list = {'INTC': 'Intel',
               'MSFT': 'Microsoft',
               'IBM': 'IBM',
               'BHP': 'BHP',
               'TM': 'Toyota',
               'AAPL': 'Apple',
               'AMZN': 'Amazon',
               'BA': 'Boeing',
               'QCOM': 'Qualcomm',
               'KO': 'Coca-Cola',
               'GOOG': 'Google',
               'SNE': 'Sony',
               'PTR': 'PetroChina'}

syms = list(ticker_list.keys()) # use to filter columns

path = 'https://github.com/QuantEcon/QuantEcon.lectures.code/raw/master/pandas/data/ticker_data.csv'

# set the index col to the date column and parse it as datetime type.
# Slice out only relevant columns
df = pd.read_csv(path, index_col=0, parse_dates=[0]).loc[:, syms]

# resample by year (2013), take the first value and last value.
# use pandas builtin pct_change() method across the axis of first/last share price value
answer = 100 * pd.concat([df.resample('A').first(), df.resample('A').last()]).pct_change().dropna()

# replace ticker symbols with company names for aesthetics
answer.rename(columns=ticker_list, inplace=True)

# Create bar plot of percent change
answer.T.plot.bar()

Thanks @duncangh, much appreciated!  We'll review this and I'm sure it will benefit from your feedback.

Hi @duncangh thanks for the feedback! You're correct - the plot was wrong.
I agree .pct_change() is a cool method, although in this example it's a little tricky to use as we want to calculate it for only the first and last day of 2013. Your method works well, however it becomes tricky to sort as the result is a DataFrame, and therefore we'd need to rename the column etc.
I have gone ahead and updated the code a little to get rid of the dictionary to Series conversion though.

authors: duncangh jstac natashawatkins


text:
Styling margin directive from sphinx-book-theme

Desktop :

Mobile:

TODO:

[x]  interaction with right sidebar toc

thanks @AakashGfude this is looking nice.
does the margin note need to have a title (or is that optional?)

@mmcky, that is optional, but it currently has a fixed title space. The style coming from Pydata:

Unlike that in sbt:

I will fix it.

@mmcky I have done this here, for margins without title:

thanks @AakashGfude happy for your to go ahead and merge when you're ready.
can you add that this is supported to the docs as well

@mmcky, this has been added to the docs. What do you think?

@mmcky I have also cleaned the design a bit, mimicking the sphinx-book-theme now:

Responsive:

What do you think?
There are a few additional changes/additions for margin content:

[ ] handling the tag figclass: margin-caption for making figure captions behave as margins.
[ ] making margins responsive (handling for phone screens).
[ ] styling notes code blocks for margins.

thanks @AakashGfude this is looking nice -- much better.
Last question -- what happens on the latex side of things for margin notes?

@mmcky, I have this planned this week—the latex thing. The latex build was failing in my system, so I could not test it immediately. I will correct that first.

@mmcky for latex build, the margin is looking like this:-

What do you think is the best UI for margins? Given they cant hang on the side like websites. Let me check jupyter book as well

thanks @AakashGfude if they don't break LaTeX builds that is great news.
That means we can deploy this theme update without potential lack of support on the pdf side causing build failures.
Of course it would be good to add support for it over time to sphinx-jupyterbook-latex
Perhaps next steps are:

Open an Issue in sphinx-jupyterbook-latex to make improvements to margin object support in pdf
I think this is probably the most common practice in terms of TeX support https://www.overleaf.com/learn/latex/Margin_notes

That sounds excellent @mmcky. Thanks, I will do that.

authors: AakashGfude mmcky

repo: QuantEcon/quantecon-book-theme


text:
Article in medium for commenting (part 2 of learning graphs with ipycytoscape)

Dear @marimeireles & @ianhi,
I have ready a second article:
https://joseberlines.medium.com/part-2-learning-graphs-with-ipycytoscape-the-train-rail-net-grows-up-db2daa2f453d
it is yet unlisted.
If you have time the coming days can you please have a look and make any comment here before I made it available to everyone?
thanks

Hi @joseberlines, it's awesome that you're writing things like this. Overall I think that this could be very helpful to someone starting out learning how to visualize graphs! Content wise I don't think you've any mistakes, however one really nice improvement to the graphs could be to make the sizes of the edges correspond to the speed of that train connection.
I also have a few practical notes:

It would be nice to have a link to the first article at the beginning
Some of the lists don't seem be formatting such that they are properly indented. For example I'd expect this to have each point indented:

There are some grammar and spelling errors scattered throughout. For stuff like this I like using https://www.grammarly.com/ as it will help with phrasing in addition to the spelling of words.

Thanks. I will revisit grammar. My English is quite ok but i am not used to write articles.

Can you give me a hand here?

Hi @joseberlines, ... however one really nice improvement to the graphs could be to make the sizes of the edges correspond to the speed of that train connection.

I would love to do that but:
I see in the style file of the Gene graph the following:
"width": "mapData(score, 0, 0.006769776522008331, 20, 60)",
"height": "mapData(score, 0, 0.006769776522008331, 20, 60)",
So it looks like it is proportional to the score.
Why width and height if they are circles? I would expect a unique parameter like radius.
In the same file I see that there is another node with shape "rectangle" but that one without height and width.
Let me know how you pass the size and I would add it to the notebook and article.
thx

Hey @joseberlines check it out this part of the docs: https://js.cytoscape.org/#getting-started/specifying-basic-options
I think it might help, they have a json tweaking edges:
     selector: 'edge',
      style: {
        'width': 3,
        'line-color': '#ccc',
        'target-arrow-color': '#ccc',
        'target-arrow-shape': 'triangle',
        'curve-style': 'bezier'
      }

authors: ianhi joseberlines marimeireles

repo: QuantStack/ipycytoscape


text:
Jupyter CAD opens to blank window in localhost from cmd line

After installing with pip into blank conda env, no gui or jupyter framework is visible on the screen after loading.
I have no clue as to why this would be happening, given a clean conda env install presents no errors.
What would be helpful in debugging this issue?

Thank you for your feedback, indeed it's an issue with the pip package, I'm fixing it in #181.
The JupyterLab extension should work as expected.

0.2.2 release fixed the issue

authors: strategos-nzr trungleduc

repo: QuantStack/jupytercad


text:
Error Message: Client credentials are not valid

Hi Guys,
I'm trying to Manually retrieve token as shown in Wiki but on Step 4. I get the "Client credentials are not valid" Message.
Any Ideas how to fix this?

exactly the same

Sorry, my fault. I have now created a new dev account at miele and reconfigured the plugin. Everything works now! Thanks!

authors: Chimpepe bsoener

repo: QuickSander/homebridge-mieleathome


text:
urlMappingStrategy missing rewriteDefault option

https://github.com/QuiiBz/next-international/blob/040728a29fee89869e4cf9b2699f30a27e76741a/packages/next-international/src/types.ts#L55
https://next-international.vercel.app/docs/app-middleware-configuration#rewrite-the-url-to-hide-the-locale

You're looking at the documentation for the v1 version, which hasn't been released yet. See the release notes in the PR here:

https://github.com/QuiiBz/next-international/pull/126

I've just published 1.0.0-rc.5 that includes this new rewriteDefault strategy, if you already want to upgrade and test it.

authors: QuiiBz o-az

repo: QuiiBz/next-international


text:
Remove duplicate libraries

The current method of replacing "org.quiltmc:hashed" with "net.fabricmc:intermediary" will result in duplicate entries for "net.fabricmc:intermediary" if the JSON already contains such an entry.
These libraries then get downloaded in parallel, resulting in an "AccessDeniedException" (tested on Windows Server 2019) because the two processes will attempt to write to the same file simultaneously:
Downloading library at: https://maven.fabricmc.net/net/fabricmc/intermediary/1.20.1/intermediary-1.20.1.jar
Downloading library at: https://maven.fabricmc.net/net/fabricmc/intermediary/1.20.1/intermediary-1.20.1.jar
java.util.concurrent.CompletionException: java.io.UncheckedIOException: java.nio.file.AccessDeniedException: .\libraries\net\fabricmc\intermediary\1.20.1\intermediary-1.20.1.jar
        at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(Unknown Source)
        at java.base/java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source)
        at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source)
        at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.exec(Unknown Source)
        at java.base/java.util.concurrent.ForkJoinTask.doExec(Unknown Source)
        at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(Unknown Source)
        at java.base/java.util.concurrent.ForkJoinPool.scan(Unknown Source)
        at java.base/java.util.concurrent.ForkJoinPool.runWorker(Unknown Source)
        at java.base/java.util.concurrent.ForkJoinWorkerThread.run(Unknown Source)
Caused by: java.io.UncheckedIOException: java.nio.file.AccessDeniedException: .\libraries\net\fabricmc\intermediary\1.20.1\intermediary-1.20.1.jar
        at org.quiltmc.installer.action.InstallServer.lambda$downloadLibrary$8(InstallServer.java:272)
        ... 7 more
Caused by: java.nio.file.AccessDeniedException: .\libraries\net\fabricmc\intermediary\1.20.1\intermediary-1.20.1.jar
        at java.base/sun.nio.fs.WindowsException.translateToIOException(Unknown Source)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(Unknown Source)
        at java.base/sun.nio.fs.WindowsFileSystemProvider.newByteChannel(Unknown Source)
        at java.base/java.nio.file.spi.FileSystemProvider.newOutputStream(Unknown Source)
        at java.base/java.nio.file.Files.newOutputStream(Unknown Source)
        at java.base/java.nio.file.Files.copy(Unknown Source)
        at org.quiltmc.installer.action.InstallServer.lambda$downloadLibrary$8(InstallServer.java:267)
        ... 7 more

The suggested change removes duplicate entries from the library list, which solves the issue on my test system.

Thank you for the quick reply! That does sound better, yeah.
I'd suggest incorporating this change until the version-specific workaround is in place. This way, it will work for all versions in the meantime.

repo: QuiltMC/quilt-installer


text:
No signature of method: hash.android() is applicable for argument types

Hello,
Environment:
Android: API 31
BuildTools: 31.0.0
GradleWrapper: 6.7.1
Android Gradle Plugin: 3.6.4
Kotlin: 1.6.21
During the build of version 1.1.7 this error below is occurring.
> Configure project :flutter_contacts

WARNING: The option 'android.enableR8' is deprecated and should not be used anymore.

It will be removed in a future version of the Android Gradle plugin, and will no longer allow you to disable R8.

FAILURE: Build failed with an exception.

* Where:

Build file '/Users/vagrant/.pub-cache/hosted/[pub.dev/flutter_contacts-1.1.7/android/build.gradle](http://pub.dev/flutter_contacts-1.1.7/android/build.gradle)' line: 30

* What went wrong:

A problem occurred evaluating project ':flutter_contacts'.

> No signature of method: build_9udfh814bypf1noppqbc8eqkz.android() is applicable for argument types: (build_9udfh814bypf1noppqbc8eqkz$_run_closure2) values: [build_9udfh814bypf1noppqbc8eqkz$_run_closure2@27da07e5]

* Try:

Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

Thanks for reporting and fixing @trfiladelfo !

Hello, you don't want to make your contact list eternal / The version from a few years ago


text:
Operator warning

オペレータクラスで std 下の関数が呼び出されているため GPU で正常に動作しません。
これは warning 扱いで CI を通ってしまうため、ついでに -Werror オプションを付けたいです。

Werror オプションは見送っています


text:
Can you please offer secure httpS for your site/API?

Most modern browsers will now block mixed content, ie. content from http resource (your API) coming from a secure site.
I personally paid $8.40 with my domain registrar (INTERNET.BS) for setting up httpS but I read in several places the cost now is free through places like cloudfare.com
Let me know if you need it and I can share my log of the steps I went thru to set it up (it's fairly trivial).
I tried looking into automatic fixing/rewrites but it won't apply because at the end the resource (here an API) has to be able to load via https.  You can read about it here.
https://blog.cloudflare.com/fixing-the-mixed-content-problem-with-automatic-https-rewrites/

Thank you for you understanding and efforts.

Please offer https protcol for your api, my website refuse to connect because mixed content, and thank you.

authors: AlGantori YousofSayed


text:
[WIP] Remove cached datasets

See #9 and QutBioacoustics/baw-server#189

Coverage decreased (-0.39%) to 84.59% when pulling 2a61126088480e68ccf549478437cf907d10da24 on feature-remove-cached-datasets into 5c57f693a797544dcc48879d09952c1bc5b5e655 on master.

This looks good to go

authors: atruskie cofiem coveralls

repo: QutBioacoustics/baw-workers

license_source: bigquery


text:
QMAPS-2088 Use ?q= intention bbox as initial map position

Description
Add a new Express middleware to interpret incoming root urls containing a ?q= param. If it resolves to a multi-place intention or a geocoding result, redirect to either a /places or a /place url, allowing to use the bbox or POI center as the initial map position (as now supported by https://github.com/Qwant/erdapfel/pull/1064 and https://github.com/Qwant/erdapfel/pull/1055).
Why
Prevents the map initializing on a different start position before "jumping" to the bbox when the data is asynchronously fetched by the client app.

@amatissart Thanks for the encoding remark.
About the telemetry/simplification, I'll do it in a separate PR as agreed IRL :)

repo: Qwant/erdapfel


text:
Minimize all panels on user interaction on the map

Description
Automatically minimize all the mobile panels when the user interacts with the map, like we already do with the POI panel.
Why
Give the user the maximum screen space when they want to interact with the map.

I've amended the commit to remove the exception for the DirectionPanel, after the design confirmed it's ok to have the same behavior for the route result panel.

repo: QwantResearch/erdapfel


text:
[BUG] <执行finetune.py去微调项目遇到ModuleNotFoundError: No module named 'torch._six'>

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

[X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

[X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior
requirements里面的依赖都安装了
finetune.py 需要的deepspeed也安装了，windows适配的版本是 0.3.16
修改好模型和训练数据集等path路径 运行finetune.py
遇到↓
Traceback (most recent call last):
File "E:\wrl\PythonCode\Qwen\finetune.py", line 12, in
from deepspeed import zero
File "E:\wrl\PythonCode\Qwen\venv\lib\site-packages\deepspeed_init_.py", line 9, in
from .runtime.engine import DeepSpeedEngine
File "E:\wrl\PythonCode\Qwen\venv\lib\site-packages\deepspeed\runtime\engine.py", line 18, in
from deepspeed.runtime.utils import see_memory_usage
File "E:\wrl\PythonCode\Qwen\venv\lib\site-packages\deepspeed\runtime\utils.py", line 18, in
from torch._six import inf
ModuleNotFoundError: No module named 'torch._six'
期望行为 | Expected Behavior
这个ModuleNotFoundError: No module named 'torch._six'是torch2.0.0之后就有的问题，希望能给出解决这个问题的方案
复现方法 | Steps To Reproduce
finetune.py 需要的deepspeed依赖包也安装了，windows适配的版本是 0.3.16
根据运行环境配置之后运行finetune.py
运行环境 | Environment
- OS:win10
- Python:3.10
- Transformers:4.32.0
- PyTorch:2.1.0
- CUDA (`python -c 'import torch; print(torch.version.cuda)'`):12.1

备注 | Anything else?
No response

您好，请参考 https://github.com/microsoft/DeepSpeed/issues/2845 看是否能解决您的问题

repo: QwenLM/Qwen


text:
Are Route components unmounted on route change?

Hi there, excellent plugin, many thanks for it.
I'm wondering if Route components are unmounted when route is changed.
I've LoginScreen component decorated with redux-ui to save username into state, but password should not be stored and cleared on route transition. Redux-ui automatically reset props componentWillUnmount, but it seems to me that components are not unmounted on route change.
Let say I've defined routes as:
class Routes extends Component {
  render() {
    return (
      <Router {...this.props}>
        <Route name="login" component={LoginScreen} type="reset" />
        <Route name="main" component={MainScreen} />
      </Router>
    );
  }
}

And LoginScreen as:
@ui({
  key: 'login',
  persist: false, // ui state keys (username, password) should be reset on component unmount
  state: {
    username: (props, state) => state.login.username,
    password: '',
  }
})
@connect(mapStateToProps, mapActions(loginActions))
class LoginScreen extends Component {
....
  componentWillUnmount() {
    //seems not to be called -> is component still mounted? even we're already on different route?
  }
....
}

After user login, I'm changing route from LoginScreen -> MainScreen. And on user logout from MainScreen -> LoginScreen.
The problem is that password is still filled and I believe it's because LoginScreen was not unmounted. Can you please confirm? Thanks

Sure i can look into this

repo: Qwikly/react-native-router-redux


text:
[FD] General Small Changes

Removes the AssaultSetFightRadius for nuke titans, this prevents them from stopping and shooting at things, now they head straight for the harvester without distractions
Removes the damage scaling on self-inflicted damage to more accurately mimic vanilla
scip -> skip

I believe it gets set to 0 when they are spawned, however I also remember that the console complained that it was below the minimum value for nuke titans (32), so we should probably be using that instead of 0 really?

I believe it gets set to 0 when they are spawned, however I also remember that the console complained that it was below the minimum value for nuke titans (32), so we should probably be using that instead of 0 really?

hmm I don't believe nuke titans ever stop moving to shoot at something tho, think its safer to keep it at 0


text:
[FD] why is there an extra }

aaaaa

it probably was because of merge of main


text:
🛑 R3 Pilot RSE (Tembo Tool) is down

In 5f82ec0, R3 Pilot RSE (Tembo Tool) (https://app.tembo-tool.io/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: R3 Pilot RSE (Tembo Tool) is back up in 4c67628 after 7 minutes.


text:
Error running RiVEC Bencmark Suite on this gem5 rvv simulator

RiVEC Benchmark Suite: https://github.com/RALC88/riscv-vectorized-benchmark-suite. (branch rvv-1.0)
I tried axpy, blackscholes and canneal, the benchmarks run well on spike, but not on this rvv simulator. The serial version works well, but not the vector version.
The output (canneal_vector for example):
warn: CheckedInt already exists in allParams. This may be caused by the Python 2.7 compatibility layer.
warn: Enum already exists in allParams. This may be caused by the Python 2.7 compatibility layer.
warn: ScopedEnum already exists in allParams. This may be caused by the Python 2.7 compatibility layer.
gem5 Simulator System.  http://gem5.org
gem5 is copyrighted software; use the --copyright option for details.

gem5 version [DEVELOP-FOR-V20.1]
gem5 compiled Nov 24 2021 11:05:07
gem5 started Nov 26 2021 21:19:00
gem5 executing on 85d9b18d236f, pid 252615
command line: /home/gem5/build/RISCV/gem5.opt ../test_gem5/simple.py

Global frequency set at 1000000000000 ticks per second
warn: No dot file generated. Please install pydot to generate the dot file and pdf.
warn: DRAM device capacity (8192 Mbytes) does not match the address range assigned (512 Mbytes)
warn: Unknown operating system; assuming Linux.
0: system.remote_gdb: listening for remote gdb on port 7000
Beginning simulation!
info: Entering event queue @ 0.  Starting simulation...
PARSEC Benchmark Suite
Threadcount: 1
100 swaps per temperature step
start temperature: 300
netlist filename: /home/riscv-vectorized-benchmark-suite/_canneal/input/100.nets
number of temperature steps: 8
locs created
locs assigned
netlist created. 100 elements.

Initialization took 0.07918000 secs
panic: Illegal instruction 0xc22025f3 at pc 0x00000000000108d0:
Memory Usage: 611208 KBytes
Program aborted at tick 85855631000
--- BEGIN LIBC BACKTRACE ---
/home/gem5/build/RISCV/gem5.opt(+0x18069d0)[0x55faed2c89d0]
/home/gem5/build/RISCV/gem5.opt(+0x181a4ee)[0x55faed2dc4ee]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7f478780f3c0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f47872e418b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f47872c3859]
/home/gem5/build/RISCV/gem5.opt(+0xbc5935)[0x55faec687935]
/home/gem5/build/RISCV/gem5.opt(+0xf0f2f1)[0x55faec9d12f1]
/home/gem5/build/RISCV/gem5.opt(+0xf1105b)[0x55faec9d305b]
/home/gem5/build/RISCV/gem5.opt(+0x162810d)[0x55faed0ea10d]
/home/gem5/build/RISCV/gem5.opt(+0x1623d67)[0x55faed0e5d67]
/home/gem5/build/RISCV/gem5.opt(+0x162348e)[0x55faed0e548e]
/home/gem5/build/RISCV/gem5.opt(+0x180ea4d)[0x55faed2d0a4d]
/home/gem5/build/RISCV/gem5.opt(+0x182eff8)[0x55faed2f0ff8]
/home/gem5/build/RISCV/gem5.opt(+0x182fded)[0x55faed2f1ded]
/home/gem5/build/RISCV/gem5.opt(+0xc2c200)[0x55faec6ee200]
/home/gem5/build/RISCV/gem5.opt(+0xc13bf1)[0x55faec6d5bf1]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x2a8738)[0x7f4787ac5738]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x8dd8)[0x7f478789af48]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7f47879e7e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x94)[0x7f4787ac5114]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7f4787891d6d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x7d86)[0x7f4787899ef6]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7f47879e7e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(PyEval_EvalCodeEx+0x42)[0x7f47879e81c2]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(PyEval_EvalCode+0x1f)[0x7f47879e85af]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x1cfbf1)[0x7f47879ecbf1]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x25f537)[0x7f4787a7c537]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7f4787891d6d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x12fd)[0x7f478789346d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7f47879e7e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x94)[0x7f4787ac5114]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7f4787891d6d]
--- END LIBC BACKTRACE ---
Aborted (core dumped)

Environment setup:
OS: Ubuntu20.04
llvm: https://github.com/plctlab/llvm-project (branch rvv-iscas)
riscv-gnu-toolchain: https://github.com/riscv-collab/riscv-gnu-toolchain (Newlib)
gem5: https://github.com/RALC88/gem5 (branch develop)
Is it a matter of rvv version? Does this simulator support rvv-1.0?
Or, is the error caused by some other reasons?

I tried RiVEC benchmark suite of rvv-0.7. But it still did not check out. Here is part of the output log.
Beginning simulation!
info: Entering event queue @ 0.  Starting simulation...
PARSEC Benchmark Suite
info: Increasing stack size by one page.
Num of Options: 512
Num of Runs: 100
Size of data: 20480

BlackScholes Initialization took 0.35585400 secs
panic: Vector instruction had it's execute() called!
Memory Usage: 606860 KBytes
Program aborted at tick 358723760000
--- BEGIN LIBC BACKTRACE ---
/home/gem5/build/RISCV/gem5.opt(+0x18069d0)[0x55f20fa829d0]
/home/gem5/build/RISCV/gem5.opt(+0x181a4ee)[0x55f20fa964ee]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7ff0960ba3c0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7ff095b8f18b]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7ff095b6e859]
/home/gem5/build/RISCV/gem5.opt(+0xbc5935)[0x55f20ee41935]
/home/gem5/build/RISCV/gem5.opt(+0xf61531)[0x55f20f1dd531]
/home/gem5/build/RISCV/gem5.opt(+0x1623433)[0x55f20f89f433]
/home/gem5/build/RISCV/gem5.opt(+0x180ea4d)[0x55f20fa8aa4d]
/home/gem5/build/RISCV/gem5.opt(+0x182eff8)[0x55f20faaaff8]
/home/gem5/build/RISCV/gem5.opt(+0x182fded)[0x55f20faabded]
/home/gem5/build/RISCV/gem5.opt(+0xc2c200)[0x55f20eea8200]
/home/gem5/build/RISCV/gem5.opt(+0xc13bf1)[0x55f20ee8fbf1]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x2a8738)[0x7ff096370738]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x8dd8)[0x7ff096145f48]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7ff096292e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x94)[0x7ff096370114]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7ff09613cd6d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x7d86)[0x7ff096144ef6]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7ff096292e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(PyEval_EvalCodeEx+0x42)[0x7ff0962931c2]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(PyEval_EvalCode+0x1f)[0x7ff0962935af]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x1cfbf1)[0x7ff096297bf1]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x25f537)[0x7ff096327537]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7ff09613cd6d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x12fd)[0x7ff09613e46d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7ff096292e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyFunction_Vectorcall+0x94)[0x7ff096370114]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(+0x74d6d)[0x7ff09613cd6d]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalFrameDefault+0x7d86)[0x7ff096144ef6]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(_PyEval_EvalCodeWithName+0x8fb)[0x7ff096292e3b]
/lib/x86_64-linux-gnu/libpython3.8.so.1.0(PyEval_EvalCodeEx+0x42)[0x7ff0962931c2]
--- END LIBC BACKTRACE ---
Aborted (core dumped)


text:
favicon needs to be fixed on portfolio pages

favicon is linking to old location, needs to be linked to root tag

root adjusted on all portfolio pages


text:
Git normalizes end-of-line codes

Git normalizes end-of-line encoding to the operating system that the repo was cloned too.  HSS code is specifically meant to run on Ubuntu Linux, so Windows based developers receive files with incompatible encoding.  Windows = 0x0D 0x0A.  a.k.a. \r\n or ^M^J.  Unix/Linux/Mac OS X = 0x0A (\n or ^J) only.  This prevents Windows devs from provisioning a Vagrant VM server for development.  However, the issue is actually caused by Git, not Vagrant.

End line normalization can be desigated in .gitattributes file.  This is currently missing in the repo, so I will create one.

Problem persists after Merge #291.  I am continuing to investigate.

Merge #295 open,

Merge #295 has corrected the EOL normalization issue with Windows development.  However, Vagrant still failed to provision a development VM.  Here is a snippet examples from the extensive list of errors:
==> default: sed: can't read __CONFIGURE__FILLIN__HSS_INSTALL_DIR__/bin/untrusted_execute.c: No such file or directory

This issue has technically been fixed.  Closing this issue.  Opened #297 to address the additional problem(s) explained in the comment above.

repo: RCOS-Grading-Server/HWserver


text:
[GRDM-28275] WEKO3公開API対応

WEKO3の公開APIに対応しました。
本PRは公開APIへの対応です。Status Code401に対するOAuth 2.0フローについては未実装 (NotImplementedErrorをスロー) です。

repo2dockerの修正に対応しています: https://github.com/RCOSDP/CS-repo2docker/pull/4

Codecov Report

Merging #6 (34e187a) into master (e7c83fa) will decrease coverage by 0.20%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master       #6      +/-   ##
==========================================
- Coverage   80.64%   80.44%   -0.21%
==========================================
  Files          23       23
  Lines        2573     2562      -11
==========================================
- Hits         2075     2061      -14
- Misses        498      501       +3

Impacted Files
Coverage Δ

binderhub/repoproviders.py
83.15% <0.00%> (+0.72%)
:arrow_up:

binderhub/health.py
82.50% <0.00%> (-7.50%)
:arrow_down:

binderhub/log.py
90.90% <0.00%> (-1.30%)
:arrow_down:

binderhub/launcher.py
86.60% <0.00%> (+0.89%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e7c83fa...34e187a. Read the comment docs.

repo: RCOSDP/CS-binderhub


text:
Add the option for a full clone

On a project there should be the option to do with a full clone or a shallow clone
Currently all projects are just shallow clones but on development/staging environments you may want a full clone so you can easily access history to resolve bugs in code.
The initial clone will be slower, but we can use the reference and dissociate options in git to use a previous clone as a starting point, this only works with git 2.3+
git clone --quiet --branch master --recursive -q --reference /var/www/releases/previous_release --dissociate git@git.example.com:repository/code.git  /var/www/releases/new_release

Thinking of scrapping this and instead doing something like https://github.com/Block8/PHPCI/pull/838

Scrapped this as it doesn't make a huge amount of sense

repo: REBELinBLUE/deployer

license: mit


text:
sys is deprecated. Use util instead.

DeprecationWarning: sys is deprecated. Use util instead.

merged thanks!

authors: RIAEvangelist SamuelSchepp

repo: RIAEvangelist/serialport-js


text:
🛑 RC Documentation is down

In eca69ac, RC Documentation ($URL_RC_DOCUMENTATION) was down:

HTTP code: 0
Response time: 0 ms

Resolved: RC Documentation is back up in 54ab098 after 5 minutes.

repo: RIT-RC/rc-status-page


text:
Install Issue for the newest mac M1 pro chip

Could you upgrade the package for the newest MacBook pro package installation? It appears that the package will be compiled into an incompatible type for the MacBook pro M1 chip.

same issue! fix it ?thanks.


text:
🛑 Cleanse Drops Kidney is down

In c04bd33, Cleanse Drops Kidney (http://cleansedropskidney.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Cleanse Drops Kidney is back up in 4bd2d69 after 12 minutes.

repo: RJVCA/uptime


text:
🛑 Cleanse Drops Kidney is down

In 4d46264, Cleanse Drops Kidney (http://cleansedropskidney.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Cleanse Drops Kidney is back up in 6e3ca72.


text:
🛑 Cleanse Drops Kidney is down

In dc15acf, Cleanse Drops Kidney (http://cleansedropskidney.com/) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Cleanse Drops Kidney is back up in cf30707.


text:
🛑 Sensor Tracker login is down

In ceaa6e2, Sensor Tracker login (https://stg.ceotr.ca/sensor_tracker) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Sensor tracker login is back up in 8386a26 after .

repo: RKTowse/upptime


text:
🛑 CEOTR Home Page loads is down

In ebca9e7, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 1334486 after 2 minutes.


text:
🛑 CEOTR Home Page loads is down

In 5097aee, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 16dfb9d after 2 minutes.


text:
🛑 Sensor Tracker login is down

In 4b62985, Sensor Tracker login (https://stg.ceotr.ca/sensor_tracker) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Sensor tracker login is back up in f5e2042 after 1 minute.


text:
🛑 CEOTR Home Page loads is down

In 8883e92, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in c813d29 after 2 minutes.


text:
🛑 CEOTR Home Page loads is down

In 48bd680, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 6b0ef35 after 2 minutes.


text:
🛑 CEOTR Home Page loads is down

In 7a69914, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 1091409 after 2 minutes.


text:
🛑 CEOTR Home Page loads is down

In 077b390, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 63a1fb5 after 2 minutes.


text:
🛑 CEOTR Home Page loads is down

In 7294dd6, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 5b842db after 14 days, 5 hours, 25 minutes.


text:
🛑 Sensor Tracker login is down

In 9411428, Sensor Tracker login (https://stg.ceotr.ca/sensor_tracker) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Sensor tracker login is back up in 7d3c865 after .


text:
🛑 CEOTR Home Page loads is down

In 349ef57, CEOTR Home Page loads (https://stg.ceotr.ca CEOTR Home) was down:

HTTP code: 0
Response time: 0 ms

Resolved: CEOTR Home Page loads is back up in 43873eb after 2 minutes.


text:
Wierd behaviour on backslashes in literals

Found on version 5.0.0 and 4.15.0:
Single backslashes are eaten, double backslashes are output as double backslashes, triple backslashes are output as double backslahes.
A testcase is provided in attached file.
Remark: version 4.12.0 always output twice the number of backslashes in the input.
issue.zip

Hi @mvanbrab !
Do you get the same behavior if the data is in JSON?

Well no, but in equivalent JSON input I have to provide two slashes where I mean one, so this is the input then and the output is OK (also contains the same amount of backslashes as the input), but that seems like a no-brainer to me...
[
  {
    "id": "1",
    "description": "One backslash:     \\."
  },
  {
    "id": "2",
    "description": "Two backslashes:   \\\\."
  },
  {
    "id": "3",
    "description": "Three backslashes: \\\\\\"
  },
  {
    "id": "4",
    "description": "A backslash before the '{': a ∈ ℝ⁺₀\\{1}."
  }
]```

Aha! That confirms my hypothesis: a few versions ago, we switched from Apache CSV to Open CSV to parse CSV files.
That library is probably eating the \ characters for lunch.

It seems that this is a common problem: https://dzone.com/articles/properly-handling-backslashes-using-opencsv

Tested the solution from dzone.com.
It works for this case but breaks other edge cases.

authors: DylanVanAssche mvanbrab

repo: RMLio/rmlmapper-java


text:
TestMergeBranch

Before issuing a pull request, please see the contributing page.
Proba imbinare

2-10-2-10


text:
[Feature]: Little test app to check if ROCm/HIP works

Suggestion Description
Is there a little test/prg to check if ROCm/HIP (AMDGPU Driver) actually works? (Linux, Ubuntu 22.04)
Operating System
Ubuntu
GPU
AMD Radeon RX 6500 XT
ROCm Component
all

https://github.com/ROCm/HIP-Examples

Thanks @cjatin.  @HerbertBlenderman, please close the ticket if you don't have any further question.  Thanks.

Closing the ticket as HIP examples  has been provided.

authors: HerbertBlenderman cjatin nartmada

repo: ROCm/ROCm


text:
Audio PR - Augmentation support [PreEmphasis Filter]

Add Pre-Emphasis Filter support in rocAL

MIVisionX PR Link : PR#1314
NOTE: PR#120 to be merged before this PR - Then the actual file changes should reduce to 14

@swetha097 -- please resolve the merge conflicts

@swetha097 can you resolve merge conflicts

Please address the review comments

Addressed the comments @rrawther @LakshmiKumar23

@LakshmiKumar23 @rrawther -- we need to review the deps with mivisionx & rpp

@LakshmiKumar23 @rrawther -- we need to review the deps with mivisionx & rpp

Yes, I have approved MIVisionX PR1314

@swetha097 please add the MIVisionX version check and disable this feature until the next version of MIVisionX where audio feature will be enabled

@swetha097 please add the MIVisionX version check and disable this feature until the next version of MIVisionX where audio feature will be enabled

@kiritigowda The CMake changes for Audio is done. Can we merge this?

@swetha097 please resolve merge conflicts

@swetha097 please resolve merge conflicts

Done

repo: ROCm/rocAL


text:
Upgrade our CI from ROCm4.2.0 to the latest supported release

We use a stable ROCm driver as the basis for our CI tests.  As time moves on, so does ROCm.  The goal here is to upgrade our CI infrastructure to use the most recent ROCm.  It could be ROCm 4.3.0 or something newer.  To go above and beyond, the developer completing this assignment could design it in such a way that makes it easy to point to any ROCm driver.  After all, testing with a stable release is great but having the ability to test with a "still in development" driver on demand would be even better.

Issue #994 will resolve this issue

repo: ROCmSoftwarePlatform/AMDMIGraphX


text:
Query : How to invoke a non device function from a device function

In the below code we are trying to invoke a non-device function from device function.
/* host function */
int my_rand(void)
{
static thrust::default_random_engine rng;
static thrust::uniform_int_distribution dist(0, 9999);
return dist(rng);
}
int main(void)
{
// generate random data on the host
thrust::generate(h_vec.begin(), h_vec.end(), my_rand);   /* generate(device function) internally invokes my_rand(host function)*/
}
Called function is host function and has __  host  __ as qualifier
Calling function is device function and has  __  device  __as qualifier
Facing the below issue while compiling an application in Thrust/examples
./thrust/detail/function.h:52:31: error: call from AMP-restricted function to CPU-restricted function
We tried to compile by adding __ device __ keyword while declaring the m_f function variable but the issue persists
Steps to reproduce the above error:
Step 1: Clone thrust repository from https://github.com/ROCmSoftwarePlatform/Thrust.git
Step 2:In Thrust/thrust/detail/function.h line no:51
-#ifdef  __ HIP_PLATFORM_NVCC __
return static_cast(m_f(thrust::raw_reference_cast(x)));
-#endif
Step 3:In Thrust/examples/sum.cpp line:20(Uncomment that line)
+thrust::generate(h_vec.begin(), h_vec.end(), my_rand);
Step 4: Compile using the below command
$  cp sum.cu sum.cpp
$ /opt/rocm/hip/bin/hipcc sum.cpp -I ../ -o sum.cpp.out
full_log.txt

@sriharikarnam  considering that this is actively against the CUDA specification as I understand it, I am rather certain that is not what you want to do. In fact, the error that you are getting is EXACTLY expected behaviour, please read Appendix B from here: http://docs.nvidia.com/cuda/pdf/CUDA_C_Programming_Guide.pdf, specially B.1.3, which specifically states (paraphrasing) "a host function [...] is callable from the host only". What are you actually trying to achieve? Either the example is bad or you are asking about how to do something which is illegal, the answer to that inquiry being you do not do it.

Thanks Alex we rectified the issue earlier by guarding the host function to be called from host code .
We can close this issue.

authors: AlexVlx sriharikarnam

repo: ROCmSoftwarePlatform/Thrust


text:
Use absolute paths for all file names to hipify.

This fixes issues where some files with names in relative paths were not handled correctly.

@wenchenvincent ,
The changes looks fine. But I havent come across this error. Can you please explain what was the issue happening due to relative paths for my understanding. Also I am not if any side effects of this change.

I had two issues, which were addressed by the two additions in the PR:
I had some relative paths in the header_include_dirs. So the all_files list would include the relative paths of these header files. But when hipify_torch was processing the include lines in a file, it would look up using the absolute file path. So those include will not be replaced with their hipified header files. I had to use the absolute path to work around this, but I felt it would be more robust to have hipify_torch do it.
I had some relative paths in the cuda_source_list. When replace_cuda_with_hip_files.py looks for the hipified list, hipified_result dict uses absolute paths as keys. So we would also need to supply the cuda_source_list with absolute paths.

Requested @wenchenvincent to provide reproductions details offline for further debug. At first glance, it seems that the change in  hipify_python.py should not be required, but the change in replace_cuda_with_hip_files.py looks correct.


text:
[r2.11-rocm-enhanced] Add template specialization for HIP_vector_type update

https://github.com/ROCmSoftwarePlatform/frameworks-internal/issues/2918

retest Ubuntu-CPU please

retest Ubuntu-CPU please

retest Ubuntu-CPU please

retest Ubuntu-CPU please

retest Ubuntu-GPU-multi please

retest Ubuntu-GPU-single please

retest Ubuntu-GPU-single please

retest Ubuntu-GPU-single please

retest Ubuntu-GPU-single please

retest Ubuntu-GPU-single  please

retest Ubuntu-GPU-single please

retest Ubuntu-GPU-single please


text:
Decide a better name for the Python module

The name "auto-soh" didn't have much thought go into it and I at least want to the concept of "Advanced State of Health" (ASOH) in to emphasize that we're defining the health of a storage system many, nuanced parameters.
A few ideas:

Just go to "Auto-ASOH", then name the modules "aasoh." However, I'm not sure how to pronounce that.
Something more metaphorical like "health bar," which isn't yet taken on PyPI (somehow!?)
Something esoteric like "Lachesis" or "Atropos," one of the three Fates. The library kind of deals with looking at the life history of a battery then judging its worth.

One thing to keep in mind: will we integrate this with the forecasting models here, as part of the same package, or separately? To me, it makes a bit more sense to integrate them separately, but, if we want to do it all as part of the same package, that might impact our choice of name.

I'm not sure, but I do like the idea of integrating in the prognostics. That's making me feel Lachesis (or Decima, her Roman mirror) as an option. (I like metaphorical names for codes)

Crazy idea as I am reading through the wikipedia link you shared: keep them separate, call the diagnostics one Clotho, the prognostics one, Lachesis, and the place where we integrate them all, Moerae. Need to find something to be Atropos...

Or, maybe, the toolkit is Clotho, the diagnostics is Lachesis, and the prognosis is Atropos. Together, they form Moerae

Sounds good! Message me when you merge these changes so I can pull them.

authors: WardLT victorventuri

repo: ROVI-org/auto-soh


text:
How can I set timeout for request?

Hi all, I am using rss-bridge to fetch content from a site which is very slow. I am using that feed to parse to feedparser. But it keeps loading for around 30 seconds and then the error is displayed. I want to set a timeout for the bridge to 10 seconds so that after 10 seconds it should display the error in rss feed.
Is it possible to do? How can I do it?

It worked by setting
curl_setopt($ch, CURLOPT_TIMEOUT, 30);
In lib/content.php

repo: RSS-Bridge/rss-bridge

license: unlicense


text:
Problems with Facebook on public RSS-Bridge instances

Due to many recent You must be logged in to view this page. This is not supported by RSS-Bridge issues coming from Facebook users (https://github.com/RSS-Bridge/rss-bridge/issues/2041, comments from https://github.com/RSS-Bridge/rss-bridge/issues/2014, https://github.com/RSS-Bridge/rss-bridge/issues/2037) I investigated those issues more clearly.
If I open "https://www.facebook.com/facebook/posts" from my home laptop, everything is fine posts are returned.
If I open "https://www.facebook.com/facebook/posts" from my public instance (https://feed.eugenemolotov.ru), it will return redirect to login page.
Looks like FacebookBridge has the same problems as InstagramBridge (https://github.com/RSS-Bridge/rss-bridge/issues/1891), which breaks using FacebookBridge on public RSS-Bridge instances.
Possible solutions for users (same as in metioned InstagramBridge):

Deploy RSS-Bridge on your personal PC or laptop and use FacebookBridge from there.
Deploy RSS-Bridge on your VPS, make sure that only certain people use it and use FacebookBridge from there.

Thank you very much for investigating. I'm using shared hosting for mine and it's folder protected so only I have access, but it probably just checks the IP and since it's shared hosting, it's heavily used. May have to pay for a private IP in that case.

I installed it on my vps and I am the only one using it. Unfortunately it doesn't work either.
I tried to visit a Facebook page with Firefox and it automatically redirects me to the login page.

I'm running my single-user RSS bridge instance on Digital Ocean, and feeds which were giving me error 500 since April 1st just started working again.

I am having exactly this problem for 1 week. Over 100 feeds created through Facebook main site bridge result in errors. I am using my personal laptop, so this cannot be the reason.
Yesterday, 3 feeds (out of the 100+) delivered lots of previous missed articles ; today, only 1 out of 100+ is working. Looks like it is random and erratic.
I am using them to deliver a daily news digest, it's been 1 week I cannot do it properly and need to check all sources 1 by 1. It is not efficient and time-consuming. What should I do?

Hi,
Your tests above seem to be just for "Personal" Facebook profiles.
Public Page feeds are also broken - those that can be accessed anywhere by anyone (without a login).
For example https://www.facebook.com/bbcnews
Are you able to get these public page feeds working again please?
Thanks !

If I open "https://www.facebook.com/facebook/posts" from my home laptop, everything is fine posts are returned.
If I open "https://www.facebook.com/facebook/posts" from my public instance (https://feed.eugenemolotov.ru), it will return redirect to login page.

Hi,
If you remove the /posts part of the url then you don't get the login page show
eg https://www.facebook.com/facebook/posts (redirect to login page)
https://www.facebook.com/facebook (no redirect, page content shown).
Did you try that?

@tstanbur I have the same problem than @Noutladeesse I dont understand how I can modify https://www.facebook.com/facebook/posts to https://www.facebook.com/facebook, I have an rss feed without facebook inside.

@tstanbur I have the same problem than @Noutladeesse I dont understand how I can modify https://www.facebook.com/facebook/posts to https://www.facebook.com/facebook, I have an rss feed without facebook inside.

I have the same issue too!
I was just trying to help fix it, hopefully @em92  can (I think he's the author?)

@tstanbur understand, my english is too poor. :)

@tstanbur understand, my english is too poor. :)

@cborne :  @tstanbur a le même problème que nous bien que ses RSS feeds ne soient pas de feeds de Facebook, il demande si @em92 est l'auteur et s'il peut nous aider à résoudre le problème (je traduis !)

@Noutladeesse merci j'ai fini par comprendre par la suite, au départ je ne comprenais pas ce que faisaient les urls en facebook au milieu mais il s'agit d'une proposition de correction pour @em92. L'anglais c'est pas vraiment comme le vélo, quand tu le pratiques pas ça revient pas tout seul. :)

@Noutladeesse merci j'ai fini par comprendre par la suite, au départ je ne comprenais pas ce que faisaient les urls en facebook au milieu mais il s'agit d'une proposition de correction pour @em92. L'anglais c'est pas vraiment comme le vélo, quand tu le pratiques pas ça revient pas tout seul. :)

:-D
Oui c'est une proposition de correction, mais ça ne marche pas pour les feeds déjà créés.

Just another small "me too". I'm running RSS-Bridge on my personal VPS (only user) since a long while (~2 years) and I'm also affected by the issue. It started about 1-2 weeks ago, then it started working on Monday and was ok for about 2 days and now it stopped again.
It does seem like an Facebook action to block RSS-Bridge (probably with their silly reasoning that this would somehow make the people go back to using their awful service…)

Here just one more ''me too''. I specifically signed up here on Github to ask a few things about the Facebook bridge. Until last week, I had been using a public host from Eugene Molotov to my full satisfaction for about a year (thanks a lot). I don't have any technical background, so it is sometimes difficult for me to be able to keep up with all the terms that come up with this topic here.
I wonder if the above and below option mentioned by em92 still works and how I could get it running on my own PC:
Deploy RSS-Bridge on your personal PC or laptop and use FacebookBridge from there.
I would be very happy if I could still use the Facebook Bridge in this way, but I am not sure if this still works and how to install it on my own PC. I have looked through github quite a bit, but unfortunately I can't figure it out myself, which is why I decided to sign up.
If users could confirm or deny that this feature still works, I would be happy with that. Then my next question would be how I can best put the bridge on my own PC or who I can ask for help or get information how to do so. I also think it would be a very good idea to start a donation fund to get a developer to maintain the facebook bridge and make also the instagram bridge work again. That way, we can all contribute to get our beloved feeds going again. Greetings from the Netherlands and thanks for your great work over the years!

Same here. Since April I got different errors in the same Feeds, like:
"Facebook Bridge | Main Site was unable to receive or process the remote website's content!
Error message: `You must be logged in to view this page. This is not supported by RSS-Bridge."
"Facebook Bridge | Main Site was unable to receive or process the remote website's content!
Error message: `The requested resource cannot be found!"
"Facebook Bridge | Main Site was unable to receive or process the remote website's content!
Error message: Call to a member function children() on null
Query string: action=display&bridge=Facebook&u=hyperlitemountaingear&media_type=all&limit=1000&format=Atom
Version: dev.2020-11-10"
Latest version of RSS-Bridge…

I've been having these errors as well and I found that changing the cache_timeout parameter in FacebookBridge seems to reset the bridge, but it only works for a little while. I've tried 86400, 43200, 21600, 1, 0, and even eliminating the parameter. Somehow resetting the cache every time the bridge is called might be the solution to this problem?

I've been having these errors as well and I found that changing the cache_timeout parameter in FacebookBridge seems to reset the bridge, but it only works for a little while. I've tried 86400, 43200, 21600, 1, 0, and even eliminating the parameter. Somehow resetting the cache every time the bridge is called might be the solution to this problem?

Thank you for suggesting @Mthmgcn05
How do you reset the cache? (I am not an IT professional, only a user)

After more testing and thought, it may be every time I redeployed, it worked for five minutes, so that could have been resetting it.

It's seems that adding cookie "c_user=XXXX" where XXXX is my ID from Facebook cookie helped. I don't know how to add this only via Bridge, so I did it via contents.php for all requests, which is really bad, but... maybe it's the way for better solution :-)

@miwcz on my public instance I used c_user and xs values. Quick and dirty patch looks like this:
diff --git a/bridges/FacebookBridge.php b/bridges/FacebookBridge.php
index c03de4e..fafeabd 100644
--- a/bridges/FacebookBridge.php
+++ b/bridges/FacebookBridge.php
@@ -174,6 +174,8 @@ class FacebookBridge extends BridgeAbstract {
 		} else {
 			$header = array();
 		}
+		$header[] = 'Cookie: c_user=xxxx; xs=yyyy;';
+

 		$touchURI = str_replace(
 			'https://www.facebook',
@@ -560,11 +562,15 @@ EOD;
 				$header = array();
 			}

+			$header[] = 'Cookie: c_user=xxxx; xs=yyyy;';
+
+
 			$html = getSimpleHTMLDOM($this->getURI(), $header)
 				or returnServerError('No results for this query.');

 		}

 		// Handle captcha form?
 		$captcha = $html->find('div.captcha_interstitial', 0);

So far, so good.

So far, so good.
I meant it is working on my instance at the moment.

@tstanbur

hopefully @em92 can (I think he's the author?)

I am not author of this bridge. I maintain RSS-Bridge in general (reviewing pull requests, pinging bridge maintainers in issues) and bridges for Pikabu and Vk.
Usually maintainer of the bridge does fix bugs, but we don't have maintainer for Facebook bridge. I have little time to fix bugs in bridges, that I don't maintain.

I have 20+ facebook feeds and this is working only for 4-5 first requests. It seems that facebook is blocking mutliple requests after short while.

@tstanbur

hopefully @em92 can (I think he's the author?)

I am not author of this bridge. I maintain RSS-Bridge in general (reviewing pull requests, pinging bridge maintainers in issues) and bridges for Pikabu and Vk.
Usually maintainer of the bridge does fix bugs, but we don't have maintainer for Facebook bridge. I have little time to fix bugs in bridges, that I don't maintain.

Is there anyone who maintains Facebook bridge? @em92

I meant it is working on my instance at the moment.

Now it does not. Facebook disabled my account 'cos my account violates it's community standards. It pursuaded me to upload my photo (I did it, the real photo of me) and now I am waiting for reviewing.

@Noutladeesse

Is there anyone who maintains Facebook bridge?

No.

I don't have any new information to add that other users haven't already discussed. I'm only here to say that it is happening to me too. I am running FB Bridge on Heroku and using Feedly to save the feeds. I started getting Bridge returned error 500! around the beginning of April.
Some feeds only get the error occasionally. Other feeds keep getting the error constantly, which makes those feeds useless.
Example error message:
Facebook Bridge | Main Site was unable to receive or process the remote website's content!
Error message: `You must be logged in to view this page. This is not supported by RSS-Bridge.`
Query string: `action=display&bridge=Facebook&context=User&u=[REDACTED]&media_type=all&limit=-1&format=Atom`
Version: `dev.2020-02-26`

    Press Return to check your input parameters
    Press F5 to retry
    Check if this issue was already reported on GitHub (give it a thumbs-up)
    Open a GitHub Issue if this error persists

teromene, logmanoriginal

Here is final of my story, where I tried to make FacebookBridge work in my public instance (https://feed.eugenemolotov.ru) using my account with real phone number and patch from https://github.com/RSS-Bridge/rss-bridge/issues/2047#issuecomment-817099508.

I didn't read their paper with title "Community standards", but it looks like it sharing posts via RSS does not follow it.

It most likely boils down to "overusing API" or "harvesting data". Which just a tad silly.
For me using RSS-Bridge (and RSS in general) it to avoid having facebook account and be able to follow some websites that for some twisted reason are being present only there...

So I think I may have possibly discovered the issue.
I have put rss-bridge on my own server on my computer and realized after putting in the switch for debugging that Facebook responds in two different ways in the url header:
https://www.facebook.com/login/?next=https%3A%2F%2Fwww.facebook.com%2FXXXXXXXXXXXXX%2Fposts
and
https://www.facebook.com/XXXXXXXXXXXXX/posts?_fb_noscript=1
where XXXXXXXXXXXXX is the page id.
I'm no programmer, but if one could clean up the first response to make it look like the second and then continue onto the rest of the code, I think the bridge would work.

@Mthmgcn05 I already mentioned this facebook behavior in first message of this issue.

Ha! It's been so long since I looked at the beginning, I forgot where we began.

timeline RSS works fine, it already run 1 week, refresh every 6 minutes. maximal use the resource

timeline RSS works fine, it already run 1 week, refresh every 6 minutes. maximal use the resource

@10362227 Could you explain further? How do you get it to work without errors? Is it because you are running it on your home computer?

After redeploying changes to figure out what works, Heroku, which is what I use, gives RSS-Bridge a new IP address, and each time that works for about five minutes. I use Inoreader to request updates and this requests so many times that it gets blocked again. I think there needs to be a system of queuing requests within a certain time frame that doesn't get the IP address blocked. And this many fix other bridges if we can figure out how often is too often and how to queue requests.

i wrote a simple script for myself, it grabs FB homepage timeline (https://www.facebook.com/?sk=h_chr). but you need an account
first, then follow some people

Hi,
I did the changes mentionned in #2047 (comment)
but nothing works and error occured at line 588 because the array is empty ($html->find('#pagelet_timeline_main_column') returns empty array).
$element = $html
                ->find('#pagelet_timeline_main_column')[0]
                ->children(0)
                ->children(0)
                ->next_sibling()
                ->children(0);

Any ideas why?
What I tried as well is to echo $html just before and commenting the returnServerError.
So like this:
if($loginForm != null) {
    //returnServerError('You must be logged in to view this page. This is not$
}

echo $html;

$element = $html
                ->find('#pagelet_timeline_main_column')[0]
                ->children(0)
                ->children(0)
                ->next_sibling()
                ->children(0);

And I got a login page when going to the rss bridge html view:
https://mydomain/?action=display&bridge=Facebook&context=User&u=fondationtaraocean&media_type=all&limit=-1&format=Html

@floviolleau, I am not speaking French, but I think you need to accept Facebook's new terms of usage

Yes but I did an echo so this page is rendered inside rss bridge html view and it is not going working like this 😉. Just to say that for whatever reason, it is asking to login and the problem for me is intermittent.

The issue is not with the cookies per se but with FB blocking crawling. I just ran a local instance on my machine - I was able to open the /posts endpoint in any browser, then launched RRS-Bridge, put it to crawl the page every couple of seconds and to no surprise, i got the error after a couple of minutes and then I was blocking me constantly and nagging to log-in.
Logging-in (and using session cookie) won't work in the long term because because FB will just block your account like it did in @em92 case.
The only possibility I see is try to extract posts from main page (i.e. https://www.facebook.com/XXXXXXXXXXXXX/?_fb_noscript=1 instead of https://www.facebook.com/XXXXXXXXXXXXX/posts?_fb_noscript=1) but that has the following issues:

main page is a mess of everything and only display 2 posts on initial load
you have to scroll down to load regular posts feed, but I'm not sure how to handle that here.

I'd say that the situation is quite dire. For me, I just looked for the interesting pages on different sites (twitter usually, as quite often they use same tool to push to various "social media") and if some weren't present elsewhere I nagged the admins to be present.
I keep my fingers crossed that maybe the EU will somehow force those platforms via legislation to be interoperable instead of darn walled-gardens :|

I don't think the Api would help.
https://developers.facebook.com/docs/apps/review/feature#reference-PAGES_ACCESS
"This permission or feature is only available with business verification. You may also need to sign additional contracts before your app can access data. Learn More."
So every Bridge has to get verification, as i don't think that you can deploy the tokens of your account ;)

"This permission or feature is only available with business verification. You may also need to sign additional contracts before your app can access data. Learn More."

Found it here: https://developers.facebook.com/docs/apps/features-reference/page-public-content-access
Thanks for mentioning it @simarilius

This is huge problem for many - I've decided to use Python and it works. Facebook are trying to prevent bots and scrapers. On Python you actually sign into your personal facebook account by using Selenium (headless browser) and from there you scrape whatever you need

Thank you @bull for suggesting.Can you elaborate a little bit? I am not a programmer but is there anything I can do through Python to solve the bridge problem?
Le jeudi 22 avril 2021 à 07:07:14 UTC+3, Bull ***@***.***> a écrit :

This is huge problem for many - I've decided to use Python and it works. Facebook are trying to prevent bots and scrapers. On Python you actually sign into your personal facebook account by using Selenium (headless browser) and from there you scrape whatever you need
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

I entered my Facebook cookie into the bridge and that does work to get to the right page; however, the page is under the new design and this bridge is not configured to gather information from the new design. So there's two possible solutions: either configure some rate limit and caching requests so the login screen doesn't appear without the need to have an account or the bridge needs to be reconfigured to gather information from the new design using the cookie method to bypass the login screen.

Hi,
I have been having the same issue for over a month so I deployed RSS Bridge on the  Docker application https://hub.docker.com/r/rssbridge/rss-bridge Downloaded Docker copied the rssbridge pull command docker and now it's working perfectly - https://docs.docker.com/get-started/
Hope that helps

I have RSS-bridge on my own deployment (docker doesn't matter here much) and the issue happens from time to time still...

Anyone got a fix for the facebook Rss problem?

Anyone got a fix for the facebook Rss problem?

No, Facebook have intentionally made scraping much harder than before.

Done a little bit of research and found this app called Feedbro definitely scrapes facebook but dosen't convert the feed to Rss. Free so worth a try https://nodetics.com/feedbro/

I haven't looked at Feedbro but it probably leverages the fact that the browser is logged into Facebook whereas rss-bridge is not.

Just checked... it doesn't need to be logged in, also will pull personal profiles into the reader...If only I could find a way to schedule posts it would be perfect as it doesn't spit out true rss feeds but will produce an opml.

Yesterday, I switched my Facebook bridge from public to private in order to see if it will solve this error 500 problem. And it does solve it, in 24 hours ! So maybe there is a solution, where we just limit the number of requests we send to Facebook :

by increasing the cache timeout,
by applying a rate limit of query per second at the reverse proxy level.

In my nginx configuration, I added the following line to switch the Facebook bridge to private:
location ~ ^.+?\.php(/.*)?$ {

    error_page 420 = @fb_routes;

    if ($args ~ "bridge=Facebook") {
       return 420;
    }
.... normal configuration
}

  location @fb_routes {
     allow my ip;
     allow 192.168.1.1/24;
     allow my other ip;
     deny  all;
.... normal configuration
}

Maybe there is a way to add a rate limitation in the fb_routes.

As suggested, I've increased the default cache timeout on PR #2149 which has helped on my instance

Hey, got an quick Idea!
Facebook has an embed Feature for pages (timelines)
Can't the Bridge just index the Embed for Codes?
How to create one: https://developers.facebook.com/docs/plugins/page-plugin

The Domain would look like this:
https://www.facebook.com/plugins/page.php?href=https%3A%2F%2Fwww.facebook.com%2F[page_slug]&tabs=timeline&small_header=true&hide_cover=true&show_facepile=false

Good idea @dhuschde , the Facebook page plugin must fetch content regardless of whether the browser is logged in, so it should be suitable for our purposes.
The actual content payload seems to exist within a url beginning as such:
https://www.facebook.com/platform/plugin/tab/renderer/?key=timeline
There are several seemingly dynamic parameters within the url so deconstructing the plugin to obtain the content payload url may not be trivial.

On a really quick check, I was able to extract the name of the Page on a shared Host. (Never worked with the original Bridge)
Preview
URL: https://www.facebook.com/plugins/page.php?href=tommysblogde&tabs=timeline&small_header=true&hide_cover=true&show_facepile=false
Selector: /html/body/div[1]/div/div/div[1]/div/div[1]/div/div/div/div[1]
Title: .//a/@title
Bridge: XPath
Tho, it doesn't seem to get IP Blocked with the Embed...
But I didn't get any Posts, I think this is due to the late loading of them...

Maybe it gets blocked...
with a Bridge, that doesn't cache (or another Page) I can't get the Name...
The Bridge:
<?php

class TestBridge extends XPathAbstract {
    const NAME = 'Test';
    const URI = 'https://test.co';
    const DESCRIPTION = 'Test';
    const MAINTAINER = 'dhuschde';
    const CACHE_TIMEOUT = 1;

    const FEED_SOURCE_URL = 'https://www.facebook.com/plugins/page.php?href=facebook&tabs=timeline&small_header=true&hide_cover=true&show_facepile=false';
    const XPATH_EXPRESSION_ITEM = '/html/body/div[1]/div/div/div[1]/div/div[1]/div/div/div/div[1]';
    const XPATH_EXPRESSION_ITEM_TITLE = './/a/@title';
    const XPATH_EXPRESSION_ITEM_CONTENT = '';
    const XPATH_EXPRESSION_ITEM_URI = '';
    const XPATH_EXPRESSION_ITEM_AUTHOR = '';
    const XPATH_EXPRESSION_ITEM_TIMESTAMP = '';
    const XPATH_EXPRESSION_ITEM_ENCLOSURES = '';
    const SETTING_FIX_ENCODING = false;
}

Preview

One example is here:
https://www.facebook.com/plugins/page.php?href=https%3A%2F%2Fwww.facebook.com%2Fbbcnews%2F&tabs=timeline&width=340&height=500&small_header=false&adapt_container_width=true&hide_cover=false&show_facepile=true&appId
The payload url is here:
https://www.facebook.com/platform/plugin/tab/renderer/?key=timeline&config_json={"app_id"%3A"776730922422337"%2C"href"%3A"https%3A%2F%2Fwww.facebook.com%2Fbbcnews%2F"%2C"width"%3A340%2C"height"%3A500%2C"has_cta"%3Atrue%2C"has_small_header"%3Afalse%2C"has_adapt_container_width"%3Atrue%2C"has_cover"%3Atrue%2C"has_posts"%3Afalse%2C"tabs"%3A"timeline"%2C"can_personalize"%3Afalse%2C"is_xfbml"%3Afalse%2C"referer_uri"%3A""}&fb_dtsg_ag&__user=0&__a=1&__dyn=7xeUmxa13xu1syUbAihwRwqo98nwgU5Gex-ewSwMwNw8OdwJwvHwdK4o4O0C82Vwb-q1ewcG0KEswaq1xwEwlU-0nSUS1vwqUcE7e2l2Utw6awZwaOfxW0D83mwkE5G0zE5W0HU1jo6iazo&__csr=&__req=1&__hs=18814.PHASED%3Aplugin_default_pkg.2.0.0.0&dpr=1&__ccg=EXCELLENT&__rev=1004078508&__s=%3A%3Ashrp5t&__hsi=6981805842735414406&__comet_req=0&__sp=1
We need to work out how the Javascript arrives at the second url via the code from the first.

By the way, the second URL should be loaded Incognito, if you are logged into Facebook it won't work.

I've minimised the second URL to just three parameters, and it still loads the payload:
https://www.facebook.com/platform/plugin/tab/renderer/?key=timeline&config_json={"app_id"%3A"776730922422337"%2C"href"%3A"https%3A%2F%2Fwww.facebook.com%2Fbbcnews%2F"%2C"width"%3A340%2C"height"%3A500%2C"has_cta"%3Atrue%2C"has_small_header"%3Afalse%2C"has_adapt_container_width"%3Atrue%2C"has_cover"%3Atrue%2C"has_posts"%3Afalse%2C"tabs"%3A"timeline"%2C"can_personalize"%3Afalse%2C"is_xfbml"%3Afalse%2C"referer_uri"%3A""}&__a=1
Simply changing the "bbcnews" in that URL will fetch any page, we just need to parse the data. I think we are back in business!

Using XPath, I again was able to fetch the Content of the site...
I used the last URL u send...
However, sadly, this is the Output:

The Data:
Bridge: XPath
URL: the one you send
selector: *
description: *
Bridge as Code
<?php

class TestBridge extends XPathAbstract {
    const NAME = 'Test';
    const URI = 'https://test.co';
    const DESCRIPTION = 'FacebookTest';
    const MAINTAINER = 'dhuschde';
    const CACHE_TIMEOUT = 1;

    const FEED_SOURCE_URL = 'https://www.facebook.com/platform/plugin/tab/renderer/?key=timeline&config_json=%7B%22app_id%22%3A%22776730922422337%22%2C%22href%22%3A%22https%3A%2F%2Fwww.facebook.com%2Fbbcnews%2F%22%2C%22width%22%3A340%2C%22height%22%3A500%2C%22has_cta%22%3Atrue%2C%22has_small_header%22%3Afalse%2C%22has_adapt_container_width%22%3Atrue%2C%22has_cover%22%3Atrue%2C%22has_posts%22%3Afalse%2C%22tabs%22%3A%22timeline%22%2C%22can_personalize%22%3Afalse%2C%22is_xfbml%22%3Afalse%2C%22referer_uri%22%3A%22%22%7D&__a=1';
    const XPATH_EXPRESSION_ITEM = '*';
    const XPATH_EXPRESSION_ITEM_TITLE = '';
    const XPATH_EXPRESSION_ITEM_CONTENT = '*';
    const XPATH_EXPRESSION_ITEM_URI = '';
    const XPATH_EXPRESSION_ITEM_AUTHOR = '';
    const XPATH_EXPRESSION_ITEM_TIMESTAMP = '';
    const XPATH_EXPRESSION_ITEM_ENCLOSURES = '';
    const SETTING_FIX_ENCODING = false;
}

Preview

As you can see in the Content, it still has this Login stuff in the Code...

@dhuschde if you load my URL in Chrome Incognito, can you see the post content?

I am able to see this in both Incognito and normal, as I don't have an Account:

But I'm not in the same network as my Bridge. This is hosted by one.com

Can you paste the full contents you see in pastebin?

From incognito:
https://bin.snopyta.org/?2c6a8a8bc912358d#4iEZPn65NTn9x8mMhqLQeCSfsbdyazVjWKBJd6tkJ3dH
From Bridge:
https://bin.snopyta.org/?1e08d688f8144c83#DdX2jfuA64729XnZWP73hLAM3Lt4rfLz714QwGqcFon5
From Normal (non-Incognito):
https://bin.snopyta.org/?5649c9cd08d81c0a#9XDm2WwKBbhMt7RemdDGgW7qPsnUTYs1eQZEjDdrR31t
I'm using Firefox on the newest Ubuntu version, if you need that too...

Thanks, so the browser test works and the posts are visible, ready for scraping.

When I copy-paste the first URL into Chorme, I get this

And when I copy-paste the second URL, I get this

@Noutladeesse it will not work if you are logged into Facebook.

One other thing of interest, this command returns post contents on my home PC:
curl "https://www.facebook.com/platform/plugin/tab/renderer/?key=timeline&config_json=%7B%22app_id%22%3A%22776730922422337%22%2C%22href%22%3A%22https%3A%2F%2Fwww.facebook.com%2Fbbcnews%2F%22%2C%22width%22%3A340%2C%22height%22%3A500%2C%22has_cta%22%3Atrue%2C%22has_small_header%22%3Afalse%2C%22has_adapt_container_width%22%3Atrue%2C%22has_cover%22%3Atrue%2C%22has_posts%22%3Afalse%2C%22tabs%22%3A%22timeline%22%2C%22can_personalize%22%3Afalse%2C%22is_xfbml%22%3Afalse%2C%22referer_uri%22%3A%22%22%7D&__a=1"
But on two cloud VM's I tried, it did not return the posts, which could indicate some IP-level restrictions.

But on two cloud VM's I tried, it did not return the posts, which could indicate some IP-level restrictions.

That would make sense - Instagram rate-limits/blocks known cloud provider IPs: https://git.sr.ht/~cadence/bibliogram-docs/tree/master/docs/Instagram rate limits.md

It doesn't get blocked due to the over usage in a network, but by known hosts... (At least it appears to be)
Got redirected to the Login Page (or even completely blocked...)

But the payload still works...

Copied to pastebin
So maybe we can use the Tor Network, just like Bibliogram...

Even the embed got blocked...

The current version of Facebook is working ok on my home IP, albeit with usage limits. I suppose the question then is whether the embed plugin url is more lenient on usage limits than what we have now.

@triatic
The current version of Facebook is working ok on my home IP, albeit with usage limits. I suppose the question then is whether the embed plugin url is more lenient on usage limits than what we have now.

As I showed here, using the Tor Browser, the Embed is as limited as the Front Page.
But the Payload did still work, so the Payload is only limited to known Host IPs. Which Bibliogram did came across using the Tor Network, as I know...
https://github.com/RSS-Bridge/rss-bridge/issues/2047#issuecomment-875093377
https://github.com/RSS-Bridge/rss-bridge/issues/2047#issuecomment-875097081

Sometimes it doesn't work on the Tor Network too...
So we need to recognize the Login Redirect code and then reload using another Tor Cycle

A new test shows me the same results, I got redirected to Login using facebook.com/bbcnews, but the Payload still worked...

The problem with switching to Tor is that the bridge could be blocked more often than a "good" IP address (such as the one I use at home).

The thing is, if it is the thing with known Hosts, the Bridge would either
always work or never.
So maybe we give the Host the option to turn it on and off. Just like the
Instagram Bridge did it with Bibliogram...

Ok, but is there an equivalent of Bilbliogram for Facebook?

I cannot access any public facebook page that I tried without being logged into facebook. Did facebook make all pages private?

Did facebook make all pages private?

No, but they are subject to stringent rate-limiting and IP-blocking, and there isn't much we can do about that.

Oh damn. And I use  VPN and tried like 10 locations so they are all blocked?! Then it means is so easy to block our server that hosts rss-bridge based on a single IP that we have.

Yah...no surprise actually....thx for the info.

I use https://fetchrss.com/prices to get a few feeds once a day, there isn't much choice now.

Feedbro is a  RSS chrome extension that can scrape FB "even personal profiles" but not generate RSS feeds so it's a matter of checking manually. It's the best there is that I have found...

Feedbro is a RSS chrome extension that can scrape FB "even personal profiles" but not generate RSS feeds so it's a matter of checking manually. It's the best there is that I have found...

It's pretty useful but it's not really portable. I prefer to have a centralised solution where I can rely on from my laptop or android.

@dvikan Is the Facebook bridge still broken? Is it still without a maintainer? I cannot find the maintainers list anymore here on GitHub.

It was totally broken for me as soon as Facebook instigated an IP address block on cloud computing providers.

It was totally broken for me as soon as Facebook instigated an IP address block on cloud computing providers.

For me too.
I'd like to know if any maintainer has worked on this problem since then (due to the issue management done 10 days ago) and if it makes sense to re-test the bridge or will I face the same issues?

Same here, I initially solved it by hosting the bridge at home. Though a few months after that Facebook migrated the pages I was monitoring to the new design which requires javascript to load, which of course completely broke the bridge. So as the new Facebook site is being rolled out, fewer pages will function and at some point the bridge will be completely borked.

Facebook is one of the hardest to maintain and it also has a few key limiters, even if it's maintained. Public instances almost always run into some form of facebook detection, so it's barely possible to keep it working for the people who run it at home.
Also, because facebook is constantly evolving and doing rolling releases, one feed might work while the other is broken, because fb changed the site underneath.

Is there currently a way to rate-limit locally? That is, prevent my self-hosted bridge from making too many requests to a given site too quickly? I'd probably also need my feed reader to refresh feeds in a random order.

@mdemoss you can increase CACHE_TIMEOUT in the bridge code.

@mdemoss you can increase CACHE_TIMEOUT in the bridge code.

That would be a timeout per URL, right? I'm thinking a timeout per domain might be necessary since some of these sites are pretty aggressive about rate-limiting.

@mdemoss you can increase CACHE_TIMEOUT in the bridge code.

That would be a timeout per URL, right? I'm thinking a timeout per domain might be necessary since some of these sites are pretty aggressive about rate-limiting.

Yes, per URL. RSS-Bridge has no per domain rate limiting, if you are thinking in terms of it generating HTTP 503 responses. Which to me would be just as ugly as remote rate limiting.

As far as I can tell the facebook posts tab is forever gone. E.g.
https://www.facebook.com/eminem/posts
https://www.facebook.com/ladygaga/posts
https://www.facebook.com/Starbucks/posts
They all redirect to the main page.

Data is fetched via a POST request to https://www.facebook.com/api/graphql/
Finding the correct request payload could be a challenge.

We need someone with very much perseverance and patience to scrape the graphql api.

Maybe get some ideas from other projects:
https://github.com/kevinzg/facebook-scraper

Maybe get some ideas from other projects: https://github.com/kevinzg/facebook-scraper

That doesn't seem to work for me, from a normal residential IP.

authors: 10362227 Bockiii Frankytyrone INPoppoRTUNE Mthmgcn05 Noutladeesse PoppoPopporation RealDutchie arcctgx bdutro bullride cborne dhuschde dvikan em92 floviolleau grivanov hellmachine2000 himatech juanjosepablos laBecasse mdemoss miwcz mrtpcet mwalbeck pin-grid-array simarilius somini tio-trom triatic tstanbur woj-tek


text:
Inforge.net - XenForo Bridge failed with error 400

Exception Exception: The URL you provided is invalid! at lib/error.php line 26

#0 index.php:7
#1 lib/RssBridge.php:15
#2 lib/RssBridge.php:63
#3 actions/DisplayAction.php:137
#4 bridges/XenForoBridge.php:84
#5 lib/error.php:36
#6 lib/error.php:26

Query string: action=display&bridge=XenForoBridge&context=Thread&url=www.inforge.net%2Fforum%2Fforums%2Fmanuali-di-hacking-e-it-security.773&limit=10&format=Html
Version: dev.2022-06-14 (git.master.5a9336d)
Os: Linux
PHP version: 7.4.30

Login is not needed to read the forum, it's a xenforo based forum, do you know why there is this error?
The full link was: https://www.inforge.net/forum/forums/manuali-di-hacking-e-it-security.773/?order=post_date&direction=desc but I tested it without query and without https://, the error is the same.

The url must have a protocol e.g. http:// or https://. This particular website is protected by cloudflare. I'm getting 403 Forbidden.

I tried with/without https:// but the result is the same, I suppose cloudflare is blocking such a "page scraping"

authors: dvikan prestidigitonium


text:
Linq JContainer class converstion in TS client fails

Hi!
When I use JContainer in any DTO, NSwag generates this TypeSCript interface:
interface JContainer extends any {
    // ... Some uninteresting fields
}

The extends any part is invalid and causes a syntax error.
Where does this come from? Is it because JContainer inherits from JToken which in turn inherits from System.Object?

I think JContainer should just be treated as object, i.e. any and not show up in the TS, right?

i.e. add JContainer here:
https://github.com/RSuter/NJsonSchema/blob/master/src/NJsonSchema/Generation/JsonSchemaGenerator.cs#L429

Maybe we just change it to
 if (type is JToken || type == typeof(object))

should match all these any types, right?
I think there are no tests for that yet, you can add one...

Yes, i think so too 👍

type is JToken won't work since we'd need not the type but the actual object itself. I'll introduce more conditions in the if statement for now.
Details on inheritance with typeof / is: https://stackoverflow.com/questions/1218178/c-net-how-can-i-get-typeof-to-work-with-inheritance

You can use type.IsAssignableTo(“JToken), Name) (a NJS extension method)

I'll verify the fix as soon as possible and then close this issue :)

NJS release: https://github.com/RSuter/NJsonSchema/pull/817

authors: FabianTe RSuter

repo: RSuter/NSwag


text:
🛑 Schedule (.dev) is down

In 7c0719f, Schedule (.dev) (https://schedule-rtu.rtuitlab.dev/api/schedule/get_groups) was down:

HTTP code: 502
Response time: 5026 ms

Resolved: Schedule (.dev) is back up in 5fd2203.

repo: RTUITLab/upptime


text:
停顿和逗号的问题

我用800个样本训练了一个有关停顿（通过SP/SP2/SP3/UNK标识）的模型，结果好像停顿不起作用了，V1没有问题的，不知道作者有没有测试过这个？还有逗号的问题，第一次推理正常后我随便在语句中加一个逗号，可能会出现逗号前的句子被吞的情况，有没有可能是缓存的问题？
感谢作者，这个项目很好，音色效果的确比V1版本更好。

一样遇到了，V2好像的停顿不如V1

我用800个样本训练了一个有关停顿（通过SP/SP2/SP3/UNK标识）的模型

歪个楼，请教一下，方便透露是怎么训的吗，我目前能训一些特殊文本对应特殊发音(如 UVLT 对应笑声)，但是我没想到要用什么来训练停顿

repo: RVC-Boss/GPT-SoVITS


text:
Make link color cool

Make folder links blue. Red hurts my eye 😭

Done


text:
Weird mobile performance problem.

I tried to use this library and it works really great on my laptop, but there is a weird problem when i try to open the website on my phone. It causes some major lags.
This only happened because this library uses Pixi v7, when i try to use the default pixi-live2d-display with Pixi v6, it works smoothly on mobile.
Please let me know if there is a solution to this, your fork is great!

Thankss...
You can use the old version for now. (It uses a bit different way to handle
lipsync)
I'll try testing it. Can you please tell me about your mobile model and
share your live2d model (or its file size and vertex count and load)
On Mon, Oct 28, 2024, 6:37 PM Vincent Timothy @.***>
wrote:

I tried to use this library and it works really great on my laptop, but
there is a weird problem when i try to open the website on my phone. It
causes some major lags.
This only happened because this library uses Pixi v7, when i try to use
the default pixi-live2d-display with Pixi v6, it works smoothly on mobile.
Please let me know if there is a solution to this, your fork is great!
—
Reply to this email directly, view it on GitHub
https://github.com/RaSan147/pixi-live2d-display/issues/14, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AIDNL24RI6OERKWNOA3BZDLZ5YV2BAVCNFSM6AAAAABQXKHVWSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGYYTQMZQG44DKOI
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

I use this template model: https://cdn.jsdelivr.net/gh/Eikanya/Live2d-model/Live2D/Senko_Normals/senko.model3.json from guansss' website. Btw, i use Xiaomi 13T, which has decent performance in games so i think it's not a hardware problem.

Thankss... You can use the old version for now. (It uses a bit different way to handle lipsync) I'll try testing it. Can you please tell me about your mobile model and share your live2d model (or its file size and vertex count and load)
…
On Mon, Oct 28, 2024, 6:37 PM Vincent Timothy @.> wrote: I tried to use this library and it works really great on my laptop, but there is a weird problem when i try to open the website on my phone. It causes some major lags. This only happened because this library uses Pixi v7, when i try to use the default pixi-live2d-display with Pixi v6, it works smoothly on mobile. Please let me know if there is a solution to this, your fork is great! — Reply to this email directly, view it on GitHub <#14>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIDNL24RI6OERKWNOA3BZDLZ5YV2BAVCNFSM6AAAAABQXKHVWSVHI2DSMVQWIX3LMV43ASLTON2WKOZSGYYTQMZQG44DKOI . You are receiving this because you are subscribed to this thread.Message ID: @.>

i really love your .speak function, that's why im using the latest ver

Yes I just checked on it.
What it seems to me is that at 1st its laggy, after a while it becomes normal speed.
Sadly the pixi js has already moved to v8 (while we are still on v7, guansss sensei is taking his time on this one now. Hope he's doing well)
I'll look into the code and find if there's any similar issue on pixi and live2d. And any workaround.
Thabks