text:
Contributing updates v2

Hello
This PR is meant to continue the work done by @samphippen on #1705. I answered to few of the comments of @ashleygwilliams and @myronmarston.
My english is not that good. So feel free to make any comments.
Their is a related PR on rspec-core https://github.com/rspec/rspec-core/pull/2485 that could be added into CONTRIBUTING.md and referenced from the issue template.
On the top of CONTRIBUTING.md their is this text:
<!---
 This file was generated on 2015-12-07T22:01:06+11:00 from the rspec-dev repo.
 DO NOT modify it by hand as your changes will get lost the next time it is generated.
 -->

Is it still the case? Should I make this PR against : https://github.com/rspec/rspec-dev/blob/master/common_markdown_files/CONTRIBUTING.md.erb ?
Thanks in advance for the review.

Sorry for the delay. Still one point to fix. But I have no idea how to improve.

Thanks for the previous commit.
Where is that? I could suggest something.

Sorry I'm on my phone. See the comment on "Dev environment". Thanks
On April 16, 2018 6:11:21 PM GMT+02:00, Yusuke Ebihara notifications@github.com wrote:

Thanks for the previous commit.
Where is that? I could suggest something.
--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:
https://github.com/rspec/rspec-rails/pull/1925#issuecomment-381660260

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

CI fail seems unrelated : https://travis-ci.org/rspec/rspec-rails/jobs/367774520

Oups sorry. Thanks for the rebuild. It turned green.

Thanks @benoittgt

authors: JonRowe benoittgt ebihara99999

repo: rspec/rspec-rails


text:
Error on Connect instruction on new machine

sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (4008): Gateway in port (8880) did not respond.
Path: C:\Users\bortz_g\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, "C:\Users\bortz_g\Documents\R\win-library\3.3\sparklyr\java\sparklyr-2.0-2.11.jar", 8880, 4008

An output log follows the above.
Question: What java versions do I need and how do I set the Java Home and path ..are these needed? Must they be installed prior to SparklyR.
Log:
---- Output Log ----
java.lang.UnsupportedClassVersionError: org/apache/spark/launcher/Main : Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(Unknown Source)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.security.SecureClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.access$000(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
Could not find the main class: org.apache.spark.launcher.Main.  Program will exit.
Exception in thread "main"
---- Error Log ----
In addition: Warning message:
In readLines(output_file) :
incomplete final line found on 'C:\Users\bortz_g\AppData\Local\Temp\RtmpK2fOBS\fileabc2e4727dd_spark.log'

An output log follows the above.
Question: What java versions do I need and how do I set the Java Home and path ..are these needed? Must they be installed prior to SparklyR.
Log:
---- Output Log ----
java.lang.UnsupportedClassVersionError: org/apache/spark/launcher/Main : Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(Unknown Source)
at java.lang.ClassLoader.defineClass(Unknown Source)
at java.security.SecureClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.defineClass(Unknown Source)
at java.net.URLClassLoader.access$000(Unknown Source)
at java.net.URLClassLoader$1.run(Unknown Source)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
Could not find the main class: org.apache.spark.launcher.Main.  Program will exit.
Exception in thread "main"
---- Error Log ----
In addition: Warning message:
In readLines(output_file) :
incomplete final line found on 'C:\Users\bortz_g\AppData\Local\Temp\RtmpK2fOBS\fileabc2e4727dd_spark.log'

Hi @gbortz27, yes, you'll need to have a version of Java installed in your pc, check under C:/Program Files/Java to see if you may already have 1.8 installed.
If it's there, or once you download and install it, you can setup the path inside your R Script, this one is the one I use on my Windows pc:
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)
library(sparklyr)
sc <- spark_connect(master = "local")

Hi @gbortz27, yes, you'll need to have a version of Java installed in your pc, check under C:/Program Files/Java to see if you may already have 1.8 installed.
If it's there, or once you download and install it, you can setup the path inside your R Script, this one is the one I use on my Windows pc:
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)
library(sparklyr)
sc <- spark_connect(master = "local")

The Spark directory doesn't look right to me, can you send me the result to these commands please?
spark_home_dir()
spark_installed_versions()

The Spark directory doesn't look right to me, can you send me the result to these commands please?
spark_home_dir()
spark_installed_versions()

spark_home_dir()
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/spark-1.6.2-bin-hadoop2.6"

spark_installed_versions()
spark hadoop                       dir
1 1.6.2    2.6 spark-1.6.2-bin-hadoop2.6

Is something getting mixed up?
I also installed the latest  Sparkly R from github ..I send you the
response to this and the sc connect
I saw some people had the problem sorted out when doing this ,
unfortunately not with me !
devtools::install_github("rstudio/sparklyr")
Downloading GitHub repo rstudio/sparklyr@master
from URL https://api.github.com/repos/rstudio/sparklyr/zipball/master
Installing sparklyr
"C:/PROGRA~1/R/R-33~1.2/bin/x64/R" --no-site-file --no-environ --no-save
--no-restore --quiet CMD INSTALL  \
"C:/Users/grbortz/AppData/Local/Temp/RtmpSqkfxY/devtools22bc65a57149/rstudio-sparklyr-1a614a2"

--library="C:/Users/grbortz/Documents/R/win-library/3.2" --install-tests

installing source package 'sparklyr' ...
** R
** inst
** tests
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded
*** arch - i386
*** arch - x64
DONE (sparklyr)
Reloading installed sparklyr

sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (4449):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 4449

---- Output Log ----
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:09:42 INFO sparklyr: Session (4449) starting
17/01/01 23:09:42 INFO sparklyr: Registering session (4449) into gateway
port (8880)
(17/01/01 23:10:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 10:46 PM, Edgar Ruiz notifications@github.com
wrote:

The Spark directory doesn't look right to me, can you send me the result
to these commands please?
spark_home_dir()
spark_installed_versions()
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269918917,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEjF4L9OKh9x-eDQo76CClxpII-Y-ks5rOBC1gaJpZM4LYuVY
.

spark_home_dir()
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/spark-1.6.2-bin-hadoop2.6"

spark_installed_versions()
spark hadoop                       dir
1 1.6.2    2.6 spark-1.6.2-bin-hadoop2.6

Is something getting mixed up?
I also installed the latest  Sparkly R from github ..I send you the
response to this and the sc connect
I saw some people had the problem sorted out when doing this ,
unfortunately not with me !
devtools::install_github("rstudio/sparklyr")
Downloading GitHub repo rstudio/sparklyr@master
from URL https://api.github.com/repos/rstudio/sparklyr/zipball/master
Installing sparklyr
"C:/PROGRA~1/R/R-33~1.2/bin/x64/R" --no-site-file --no-environ --no-save
--no-restore --quiet CMD INSTALL  \
"C:/Users/grbortz/AppData/Local/Temp/RtmpSqkfxY/devtools22bc65a57149/rstudio-sparklyr-1a614a2"

--library="C:/Users/grbortz/Documents/R/win-library/3.2" --install-tests

installing source package 'sparklyr' ...
** R
** inst
** tests
** preparing package for lazy loading
** help
*** installing help indices
** building package indices
** testing if installed package can be loaded
*** arch - i386
*** arch - x64
DONE (sparklyr)
Reloading installed sparklyr

sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (4449):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 4449

---- Output Log ----
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:09:42 INFO sparklyr: Session (4449) starting
17/01/01 23:09:42 INFO sparklyr: Registering session (4449) into gateway
port (8880)
(17/01/01 23:10:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 10:46 PM, Edgar Ruiz notifications@github.com
wrote:

The Spark directory doesn't look right to me, can you send me the result
to these commands please?
spark_home_dir()
spark_installed_versions()
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269918917,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEjF4L9OKh9x-eDQo76CClxpII-Y-ks5rOBC1gaJpZM4LYuVY
.

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/spark-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (2970):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/spark-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (2970):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar
C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed the
8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/
spark-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (2970):
Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache
spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/
Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed the
8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/
spark-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (2970):
Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache
spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/
Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/
win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

See my environmental variables, attached
I do not have a Spark Home here ..but isnt that what we set in R studio. I
do have a java home though.
But check my Hadoop Home and its pointing to my Spark 2.0.2 install ..Is
this correct??
Graham
On Sun, Jan 1, 2017 at 11:41 PM, Graham Bortz gbortz27@gmail.com wrote:

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed
the 8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/s
park-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(2970): Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.
6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/
grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

See my environmental variables, attached
I do not have a Spark Home here ..but isnt that what we set in R studio. I
do have a java home though.
But check my Hadoop Home and its pointing to my Spark 2.0.2 install ..Is
this correct??
Graham
On Sun, Jan 1, 2017 at 11:41 PM, Graham Bortz gbortz27@gmail.com wrote:

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed
the 8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/s
park-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(2970): Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.
6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/
grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Hi
After correcting the Haddoop home directory I now get the following
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Warning messages:
1: In value[3L] :
java.lang.RuntimeException: java.lang.RuntimeException: The root scratch
dir:
C:/Users/grbortz/AppData/Local/rstudio/spark/Cache/spark-1.6.2-bin-hadoop2.6/tmp/hive
on HDFS should be writable. Current permissions are: rw-rw-rw-
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
at
org.apache.spark.sql.hive.client.ClientWrapper.(ClientWrapper.scala:204)
at
org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:238)
at
org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:218)
at
org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:208)
at org.apache.spark.sql.hive.HiveContext.setConf(HiveContext.scala:440)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:272)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:271)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.for [... truncated]
2: In create_hive_context_v1(sc) :
Failed to create Hive context, falling back to SQL. Some operations, like
window-functions, will not work

The command
sc
gives the following

sc
$master
[1] "local[4]"

$method
[1] "shell"
$app_name
[1] "sparklyr"
$config
$config$sparklyr.cores.local
[1] 4
$config$spark.sql.shuffle.partitions.local
[1] 4
$config$spark.env.SPARK_LOCAL_IP.local
[1] "127.0.0.1"
$config$sparklyr.csv.embedded
[1] "^1.*"
$config$sparklyr.shell.driver-class-path
[1] ""
attr(,"config")
[1] "default"
attr(,"file")
[1]
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\conf\config-template.yml"
$spark_home
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6"
$backend
description               class                mode
text
"->localhost:59938"          "sockconn"                "wb"
"binary"
opened            can read           can write
"opened"               "yes"               "yes"
$monitor
description              class               mode               text
"->localhost:8880"         "sockconn"               "rb"           "binary"
opened           can read          can write
"opened"              "yes"              "yes"
$output_file
[1]
"C:\Users\grbortz\AppData\Local\Temp\RtmpEb40w1\file119c4d754316_spark.log"
$spark_context
<jobj[5]>
class org.apache.spark.SparkContext
org.apache.spark.SparkContext@393ce018
$java_context
<jobj[6]>
class org.apache.spark.api.java.JavaSparkContext
org.apache.spark.api.java.JavaSparkContext@73a43424
$hive_context
<jobj[8]>
class org.apache.spark.sql.SQLContext
org.apache.spark.sql.SQLContext@75168a30
attr(,"class")
[1] "spark_connection"       "spark_shell_connection" "DBIConnection"
BUT THEN GIVING THE COMMAND
iris_tbl <- copy_to(sc, iris)
RESULTS IN
Error: org.apache.spark.SparkException: Job aborted due to stage failure:
Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in
stage 0.0 (TID 0, localhost): java.io.IOException: No FileSystem for
scheme: C
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.spark.util.Utils$.getHadoopFileSystem(Utils.scala:1686)
at org.apache.spark.util.Utils$.doFetchFile(Utils.scala:598)
at org.apache.spark.util.Utils$.fetchFile(Utils.scala:395)
at
org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:430)
at
org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:422)
at
scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
..............
Are we progressing ?
Graham
On Sun, Jan 1, 2017 at 11:47 PM, Graham Bortz gbortz27@gmail.com wrote:

See my environmental variables, attached
I do not have a Spark Home here ..but isnt that what we set in R studio. I
do have a java home though.
But check my Hadoop Home and its pointing to my Spark 2.0.2 install ..Is
this correct??
Graham
On Sun, Jan 1, 2017 at 11:41 PM, Graham Bortz gbortz27@gmail.com wrote:

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed
the 8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/s
park-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(2970): Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6
.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grb
ortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Hi
After correcting the Haddoop home directory I now get the following
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Warning messages:
1: In value[3L] :
java.lang.RuntimeException: java.lang.RuntimeException: The root scratch
dir:
C:/Users/grbortz/AppData/Local/rstudio/spark/Cache/spark-1.6.2-bin-hadoop2.6/tmp/hive
on HDFS should be writable. Current permissions are: rw-rw-rw-
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
at
org.apache.spark.sql.hive.client.ClientWrapper.(ClientWrapper.scala:204)
at
org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:238)
at
org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:218)
at
org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:208)
at org.apache.spark.sql.hive.HiveContext.setConf(HiveContext.scala:440)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:272)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:271)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.for [... truncated]
2: In create_hive_context_v1(sc) :
Failed to create Hive context, falling back to SQL. Some operations, like
window-functions, will not work

The command
sc
gives the following

sc
$master
[1] "local[4]"

$method
[1] "shell"
$app_name
[1] "sparklyr"
$config
$config$sparklyr.cores.local
[1] 4
$config$spark.sql.shuffle.partitions.local
[1] 4
$config$spark.env.SPARK_LOCAL_IP.local
[1] "127.0.0.1"
$config$sparklyr.csv.embedded
[1] "^1.*"
$config$sparklyr.shell.driver-class-path
[1] ""
attr(,"config")
[1] "default"
attr(,"file")
[1]
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\conf\config-template.yml"
$spark_home
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6"
$backend
description               class                mode
text
"->localhost:59938"          "sockconn"                "wb"
"binary"
opened            can read           can write
"opened"               "yes"               "yes"
$monitor
description              class               mode               text
"->localhost:8880"         "sockconn"               "rb"           "binary"
opened           can read          can write
"opened"              "yes"              "yes"
$output_file
[1]
"C:\Users\grbortz\AppData\Local\Temp\RtmpEb40w1\file119c4d754316_spark.log"
$spark_context
<jobj[5]>
class org.apache.spark.SparkContext
org.apache.spark.SparkContext@393ce018
$java_context
<jobj[6]>
class org.apache.spark.api.java.JavaSparkContext
org.apache.spark.api.java.JavaSparkContext@73a43424
$hive_context
<jobj[8]>
class org.apache.spark.sql.SQLContext
org.apache.spark.sql.SQLContext@75168a30
attr(,"class")
[1] "spark_connection"       "spark_shell_connection" "DBIConnection"
BUT THEN GIVING THE COMMAND
iris_tbl <- copy_to(sc, iris)
RESULTS IN
Error: org.apache.spark.SparkException: Job aborted due to stage failure:
Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in
stage 0.0 (TID 0, localhost): java.io.IOException: No FileSystem for
scheme: C
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.spark.util.Utils$.getHadoopFileSystem(Utils.scala:1686)
at org.apache.spark.util.Utils$.doFetchFile(Utils.scala:598)
at org.apache.spark.util.Utils$.fetchFile(Utils.scala:395)
at
org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:430)
at
org.apache.spark.executor.Executor$$anonfun$org$apache$spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:422)
at
scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
..............
Are we progressing ?
Graham
On Sun, Jan 1, 2017 at 11:47 PM, Graham Bortz gbortz27@gmail.com wrote:

See my environmental variables, attached
I do not have a Spark Home here ..but isnt that what we set in R studio. I
do have a java home though.
But check my Hadoop Home and its pointing to my Spark 2.0.2 install ..Is
this correct??
Graham
On Sun, Jan 1, 2017 at 11:41 PM, Graham Bortz gbortz27@gmail.com wrote:

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed
the 8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/s
park-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(2970): Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6
.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grb
ortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into gateway
port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Back to this now
sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (6062):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 6062
On Mon, Jan 2, 2017 at 12:15 AM, Graham Bortz gbortz27@gmail.com wrote:

Hi
After correcting the Haddoop home directory I now get the following
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Warning messages:
1: In value[3L] :
java.lang.RuntimeException: java.lang.RuntimeException: The root scratch
dir: C:/Users/grbortz/AppData/Local/rstudio/spark/Cache/
spark-1.6.2-bin-hadoop2.6/tmp/hive on HDFS should be writable. Current
permissions are: rw-rw-rw-
at org.apache.hadoop.hive.ql.session.SessionState.start(
SessionState.java:522)
at org.apache.spark.sql.hive.client.ClientWrapper.(
ClientWrapper.scala:204)
at org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(
IsolatedClientLoader.scala:238)
at org.apache.spark.sql.hive.HiveContext.executionHive$
lzycompute(HiveContext.scala:218)
at org.apache.spark.sql.hive.HiveContext.executionHive(
HiveContext.scala:208)
at org.apache.spark.sql.hive.HiveContext.setConf(HiveContext.scala:440)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:272)
at org.apache.spark.sql.SQLContext$$anonfun$4.apply(SQLContext.scala:271)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.for [... truncated]
2: In create_hive_context_v1(sc) :
Failed to create Hive context, falling back to SQL. Some operations,
like window-functions, will not work

The command
sc
gives the following

sc
$master
[1] "local[4]"

$method
[1] "shell"
$app_name
[1] "sparklyr"
$config
$config$sparklyr.cores.local
[1] 4
$config$spark.sql.shuffle.partitions.local
[1] 4
$config$spark.env.SPARK_LOCAL_IP.local
[1] "127.0.0.1"
$config$sparklyr.csv.embedded
[1] "^1.*"
$config$sparklyr.shell.driver-class-path
[1] ""
attr(,"config")
[1] "default"
attr(,"file")
[1] "C:\Users\grbortz\Documents\R\win-library\3.
2\sparklyr\conf\config-template.yml"
$spark_home
[1] "C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\
spark-1.6.2-bin-hadoop2.6"
$backend
description               class                mode
text
"->localhost:59938"          "sockconn"                "wb"
"binary"
opened            can read           can write
"opened"               "yes"               "yes"
$monitor
description              class               mode
text
"->localhost:8880"         "sockconn"               "rb"
"binary"
opened           can read          can write
"opened"              "yes"              "yes"
$output_file
[1] "C:\Users\grbortz\AppData\Local\Temp\RtmpEb40w1\
file119c4d754316_spark.log"
$spark_context
<jobj[5]>
class org.apache.spark.SparkContext
org.apache.spark.SparkContext@393ce018
$java_context
<jobj[6]>
class org.apache.spark.api.java.JavaSparkContext
org.apache.spark.api.java.JavaSparkContext@73a43424
$hive_context
<jobj[8]>
class org.apache.spark.sql.SQLContext
org.apache.spark.sql.SQLContext@75168a30
attr(,"class")
[1] "spark_connection"       "spark_shell_connection" "DBIConnection"
BUT THEN GIVING THE COMMAND
iris_tbl <- copy_to(sc, iris)
RESULTS IN
Error: org.apache.spark.SparkException: Job aborted due to stage failure:
Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in
stage 0.0 (TID 0, localhost): java.io.IOException: No FileSystem for
scheme: C
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(
FileSystem.java:2584)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.spark.util.Utils$.getHadoopFileSystem(Utils.scala:1686)
at org.apache.spark.util.Utils$.doFetchFile(Utils.scala:598)
at org.apache.spark.util.Utils$.fetchFile(Utils.scala:395)
at org.apache.spark.executor.Executor$$anonfun$org$apache$
spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:430)
at org.apache.spark.executor.Executor$$anonfun$org$apache$
spark$executor$Executor$$updateDependencies$5.apply(Executor.scala:422)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(
TraversableLike.scala:772)
..............
Are we progressing ?
Graham
On Sun, Jan 1, 2017 at 11:47 PM, Graham Bortz gbortz27@gmail.com wrote:

See my environmental variables, attached
I do not have a Spark Home here ..but isnt that what we set in R studio.
I do have a java home though.
But check my Hadoop Home and its pointing to my Spark 2.0.2 install ..Is
this correct??
Graham
On Sun, Jan 1, 2017 at 11:41 PM, Graham Bortz gbortz27@gmail.com wrote:

Do you not believe I have a firewall on? How do i switch it off?
Strange that the loading of Sparkly from Github ( asI have done ) fixed
the 8880 port problem for other people as noted on the Sparkly R studio site
Graham
On Sun, Jan 1, 2017 at 11:39 PM, Graham Bortz gbortz27@gmail.com
wrote:

SAME RESULT.   SEE BELOW

Question:is it ok to have the one forward forward slash in the path  ie
after "Cache" below.?
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache/s
park-1.6.2-bin-hadoop2.6"
Also do we not have to add the bin directory to the path? ie
.....spark-1.6.2-bin-hadoop2.6\bin
I used the following command  in the .R file: before running sc
".libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))"
is this correct
HERE IS THE RESULT OF YOUR SUGGESTION!
sc <- spark_connect(master="local", spark_home=spark_home_dir())
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(2970): Gateway in port (8880) did not respond.
Path: C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-1.6
.2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/grbortz/Documents/R/win-library/3.2/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/grbortz/Documents/R/win-
library/3.2/sparklyr/java/commons-csv-1.1.jar","C:/Users/grb
ortz/Documents/R/win-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 2970
---- Output Log ----
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/spark-csv_2.11-1.3.0.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/commons-csv-1.1.jar.
Warning: Skip remote jar C:/Users/grbortz/Documents/R/w
in-library/3.2/sparklyr/java/univocity-parsers-1.5.1.jar.
17/01/01 23:30:42 INFO sparklyr: Session (2970) starting
17/01/01 23:30:42 INFO sparklyr: Registering session (2970) into
gateway port (8880)
(17/01/01 23:31:03 ERROR sparklyr: Server shutting down: failed with
exception ,java.net.ConnectException: Connection timed out: connect)
---- Error Log ----
On Sun, Jan 1, 2017 at 11:23 PM, Edgar Ruiz notifications@github.com
wrote:

Ok, can we try this?
sc <- spark_connect(master="local", spark_home=spark_home_dir())
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269920259,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEj_xDZFczJBqExvgd48n16fWUdBTks5rOBlYgaJpZM4LYuVY
.

Ok, I think I was able to recreate the error.  And solved it once I setup the JAVA_HOME to an existing installation in my laptop .
Before:
Created default hadoop bin directory under: C:\Users\Edgar\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\tmp\hadoop
Error in force(code) :
  Failed while connecting to sparklyr to port (8880) for sessionid (7382): Sparklyr gateway did not respond while retrieving ports information after 60 seconds
    Path: C:\Users\Edgar\AppData\Local\rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
    Parameters: --class, sparklyr.Backend, --jars, "C:/Users/Edgar/Documents/R/win-library/3.3/sparklyr/java/spark-csv_2.11-1.3.0.jar","C:/Users/Edgar/Documents/R/win-library/3.3/sparklyr/java/commons-csv-1.1.jar","C:/Users/Edgar/Documents/R/win-library/3.3/sparklyr/java/univocity-parsers-1.5.1.jar", "C:\Users\Edgar\Documents\R\win-library\3.3\sparklyr\java\sparklyr-1.6-2.10.jar", 8880, 7382

This is how I set the Java Home...
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)

I recall you have a jdk path, maybe trying it with a jre?
From you comment:
Sys.getenv('JAVA_HOME') [1] "C:\\Program Files\\Java\\jdk1.8.0_112"

Hi Edgar
Really appreciate you helping me.
I changed it to read from my jre version now
No difference. It should work with jdk though.
Thanks
Graham
On 4 Jan 2017 03:26, "Edgar Ruiz" notifications@github.com wrote:

Ok, I think I was able to recreate the error. And solved it once I setup
the JAVA_HOME to an existing installation in my laptop .
Before:
Created default hadoop bin directory under: C:\Users\Edgar\AppData\Local
rstudio\spark\Cache\spark-1.6.2-bin-hadoop2.6\tmp\hadoop
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid
(7382): Sparklyr gateway did not respond while retrieving ports information
after 60 seconds
Path: C:\Users\Edgar\AppData\Local\rstudio\spark\Cache\spark-1.6.
2-bin-hadoop2.6\bin\spark-submit2.cmd
Parameters: --class, sparklyr.Backend, --jars,
"C:/Users/Edgar/Documents/R/win-library/3.3/sparklyr/java/
spark-csv_2.11-1.3.0.jar","C:/Users/Edgar/Documents/R/win-
library/3.3/sparklyr/java/commons-csv-1.1.jar","C:/
Users/Edgar/Documents/R/win-library/3.3/sparklyr/java/univocity-parsers-1.5.1.jar",
"C:\Users\Edgar\Documents\R\win-library\3.3\sparklyr\java\sparklyr-1.6-2.10.jar",
8880, 7382
This is how I set the Java Home...
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)
I recall you have a jdk path, maybe trying it with a jre?
From you comment:
Sys.getenv('JAVA_HOME') [1] "C:\Program Files\Java\jdk1.8.0_112"
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.

@gbortz27 , can we try installing and connecting to a 2.0.0 version instead of 1.6.2?

I am on version 2.0.2
On Wed, Jan 4, 2017 at 5:34 PM, Edgar Ruiz notifications@github.com wrote:

@gbortz27 https://github.com/gbortz27 , can we try installing and
connecting to a 2.0.0 version instead of 1.6.2?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-270399876,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEsXfoeWxIxwqyseS-ikyK81faXFCks5rO7wEgaJpZM4LYuVY
.

Oh, you latest comment had this:
sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (6062):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\ spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd

This is what happened now!

library(sparklyr)
spark_install(version="2.0.2")
Spark 2.0.2 for Hadoop 2.7 or later already installed.
Sys.getenv('JAVA_HOME')
[1] "C:\Program Files\Java\jre1.8.0_112"
Sys.getenv('SPARK_HOME')
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7"
Sys.getenv("HADOOP_HOME")
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7\tmp\hadoop"

sc <- spark_connect(master = "local")
Error in file(con, "r") : cannot open the connection
In addition: Warning message:
In file(con, "r") :

cannot open file
'C:\Users\grbortz\AppData\Local\Temp\Rtmp6zaoRi\file214834723dcf_spark.log':
Permission denied*

I tried it again !!!

sc <- spark_connect(master = "local")
*Error in force(code) : *

Failed while connecting to sparklyr to port (8880) for sessionid (6885):
Gateway in port (8880) did not respond.*
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7\bin\spark-submit2.cmd*
Parameters: --class, sparklyr.Backend,
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-2.0-2.11.jar",
8880, 6885*

---- Output Log ----17/01/04 21:13:38 INFO sparklyr: Session (6885)
starting17/01/04 21:13:38 INFO sparklyr: Registering session (6885) into
gateway port (8880)(17/01/04 21:13:59 ERROR sparklyr: Server shutting down:
failed with exception ,java.net.ConnectException: Connection timed out:
connect)
Ithink there is something major going on here. I tried to run SparkR and it
came back saying the Java Virtual Machine wont run
Thanks
Graham
On Wed, Jan 4, 2017 at 8:43 PM, Edgar Ruiz notifications@github.com wrote:

Oh, you latest comment had this:
sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (6062):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache
spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-270450785,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEpTsppwwivRr11tHLvd2T3H21FGYks5rO-hQgaJpZM4LYuVY
.

my connection is up
but on the dplyr command i get R code execution error block coming up
and then
Error: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
at java.lang.reflect.Constructor.newInstance(Unknown Source)
at
org.apache.spark.sql.hive.client.IsolatedClientLoader.createClient(IsolatedClientLoader.scala:258)
at
org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:359)
at
org.apache.spark.sql.hive.HiveUtils$.newClientForMetadata(HiveUtils.scala:263)
at
org.apache.spark.sql.hive.HiveSharedState.metadataHive$lzycompute(HiveSharedState.scala:39)
at
org.apache.spark.sql.hive.HiveSharedState.metadataHive(HiveSharedState.scala:38)
at org.apache.spark.sql.hive.HiveSharedState.externalCatalog$lzycomp
On Wed, Jan 4, 2017 at 9:19 PM, Graham Bortz gbortz27@gmail.com wrote:

This is what happened now!

library(sparklyr)
spark_install(version="2.0.2")
Spark 2.0.2 for Hadoop 2.7 or later already installed.
Sys.getenv('JAVA_HOME')
[1] "C:\Program Files\Java\jre1.8.0_112"
Sys.getenv('SPARK_HOME')
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7"
Sys.getenv("HADOOP_HOME")
[1]
"C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7\tmp\hadoop"

sc <- spark_connect(master = "local")
Error in file(con, "r") : cannot open the connection
In addition: Warning message:
In file(con, "r") :

cannot open file
'C:\Users\grbortz\AppData\Local\Temp\Rtmp6zaoRi\file214834723dcf_spark.log':
Permission denied*

I tried it again !!!

sc <- spark_connect(master = "local")
*Error in force(code) : *

Failed while connecting to sparklyr to port (8880) for sessionid
(6885): Gateway in port (8880) did not respond.*
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache\spark-2.0.2-bin-hadoop2.7\bin\spark-submit2.cmd*
Parameters: --class, sparklyr.Backend,
"C:\Users\grbortz\Documents\R\win-library\3.2\sparklyr\java\sparklyr-2.0-2.11.jar",
8880, 6885*

---- Output Log ----17/01/04 21:13:38 INFO sparklyr: Session (6885)
starting17/01/04 21:13:38 INFO sparklyr: Registering session (6885) into
gateway port (8880)(17/01/04 21:13:59 ERROR sparklyr: Server shutting down:
failed with exception ,java.net.ConnectException: Connection timed out:
connect)
Ithink there is something major going on here. I tried to run SparkR and
it came back saying the Java Virtual Machine wont run
Thanks
Graham
On Wed, Jan 4, 2017 at 8:43 PM, Edgar Ruiz notifications@github.com
wrote:

Oh, you latest comment had this:
sc <- spark_connect(master = "local")
Error in force(code) :
Failed while connecting to sparklyr to port (8880) for sessionid (6062):
Gateway in port (8880) did not respond.
Path:
C:\Users\grbortz\AppData\Local\rstudio\spark\Cache
spark-1.6.2-bin-hadoop2.6\bin\spark-submit2.cmd
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-270450785,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEpTsppwwivRr11tHLvd2T3H21FGYks5rO-hQgaJpZM4LYuVY
.

Seeing this and your other issue, I think @kevinushey is right, all is left are security restrictions.

I have all this done from the start
On 1 Jan 2017 19:32, "Edgar Ruiz" notifications@github.com wrote:

Hi @gbortz27 https://github.com/gbortz27, yes, you'll need to have a
version of Java installed in your pc, check under C:/Program Files/Java to
see if you may already have 1.8 installed.
If it's there, or once you download and install it, you can setup the path
inside your R Script, this one is the one I use on my Windows pc:
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)
library(sparklyr)
sc <- spark_connect(master = "local")
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269911694,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEjWNbevkl2dLLKpRPntQUhiPJjwMks5rN-M1gaJpZM4LYuVY
.

Can i use jdk instead of jre..1.8 of course0
On 1 Jan 2017 19:32, "Edgar Ruiz" notifications@github.com wrote:

Hi @gbortz27 https://github.com/gbortz27, yes, you'll need to have a
version of Java installed in your pc, check under C:/Program Files/Java to
see if you may already have 1.8 installed.
If it's there, or once you download and install it, you can setup the path
inside your R Script, this one is the one I use on my Windows pc:
java_path <- normalizePath('C:/Program Files/Java/jre1.8.0_66')
Sys.setenv(JAVA_HOME=java_path)
library(sparklyr)
sc <- spark_connect(master = "local")
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/rstudio/sparklyr/issues/398#issuecomment-269911694,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AGglEjWNbevkl2dLLKpRPntQUhiPJjwMks5rN-M1gaJpZM4LYuVY
.

@gbortz27 this error No FileSystem for scheme: C is now fixed with the latest version of sparklyr, this was a regression introduced during January that is now resolved. It affected Windows systems and Spark 1.6.
Looks like the comment you provided on January 1st got you to the No FileSystem for scheme error, if you follow those same steps, this error should not be present anymore.
Feel free to reopen this issue if there is more to investigate, thank you!

To upgrade to this fix is enough to:
remove.packages("sparklyr")
install.packages("sparklyr")

source: gharchive/issue

authors: edgararuiz gbortz27 javierluraschi

repo: rstudio/sparklyr

license_type: permissive

license_source: bigquery


text:
collect kubernetes configuration when possible

collect all describe pod and get pod -o yaml and get pod -o yaml json
collect controlling statefulset  get pod -o yaml, get pod -o json and describe pod
if possible using defaults of helm chart attempt to collect all the known items configured by helm chart

@rsvihladremio - so with this would all the helm items still be kubernetes artefacts? i.e a statefulset is read via kubectl get statefulset or are we looking to run some kind of helm commands here?
Some folks may only use the helm charts to generate manifest files and then apply using their own tooling.

I think the raw kubernetes yamls are the principal things we are interested in

we have had some form of this for awhile now

license_source: github-api


text:
パラメータの追加 （#34）

What does this implement/fix?

Does this close any currently open issues?

#34 の対応です。
wheel_diameter, wheel_base, PULSES_PER_REVOLUTIONの3つをROSパラメータ化しました。
How has this been tested?

手元のロボットで動作確認を行いました。
$ ros2 launch raspimouse_ros2_examples teleop_joy.launch.py joyconfig:=f710

このとき、ロボット側のraspimouse_ros2_examplesにあるconfig/mouse.ymlファイルに以下の3行を追加して実行しました。
    wheel_diameter : 0.048
    wheel_base : 0.09
    PULSES_PER_REVOLUTION : 400.0

パラメータの確認方法として、以下のコマンドを実行しました。
$ ros2 param get /raspimouse wheel_base
Double value is: 0.09

Any other comments?

Checklists

[x]  I have read the CONTRIBUTING guidelines.
[x]  I have checked to ensure there aren't other open Pull Requests for the same change.

https://github.com/rt-net/raspimouse2/pull/36#discussion_r749910898
パラメータ変更のコールバックを実装しなくてくても、get_parameter()を実行するだけで変更されたパラメータが反映されるようなので、どのパラメータも毎周期get_parameter()を実行するという方針にしましょう。

source: gharchive/pull-request

authors: ShotaAk shu-rt


text:
Carousel view -  Display Single Story on Mobile Viewport

Currently, while swiping the stories in carousel layout on mobile, stories are partially shown and sharing screenspace as seen below.

Accepted Criteria
Only a single story on the story should be displayed on the screen at any swiping instance.

@divyarajmasani please do share your findings for this issue, we can take the action for this issue accordingly.

This has been taken care of, with the carousel updates. We can test it once and close this issue if all looks good.
@maitreyie-chavan

@divyarajmasani This is still a valid issue, with addition of stories overlapping/appearing too close. Latest screenshot attached below

On AMP pages we do not have control over number of slides shown, this may not be fixed but I've added the space between the stories. @maitreyie-chavan

On AMP pages we do not have control over number of slides shown, this may not be fixed but I've added the space between the stories. @maitreyie-chavan

authors: divyarajmasani maitreyie-chavan

repo: rtCamp/web-stories-wp


text:
Remove localmendia and search parameters

These aren't used anywhere, as we always depend on the config (or project) for this decisions.
I'm also removing the HTML_ONLY_PROJECTS setting, I guess that was acting as a feature flag a long time ago when users couldn't disable epub and pdf by themselves?

https://codecov.io/gh/rtfd/readthedocs.org/pull/4895/diff seeing that, I need to add tests for the mkdocs case p:

note: I just close/reopen this to trigger travis

I'm curious if the projects in prod are still active. We can probably just ping each 4 of them and ask them to configure formats, and be done with it.

This seems to make sense to me I think, though I think this will require complimentary changes on our commercial code as well

I always wanted an excuse to touch that code 😄

authors: ericholscher stsewd

license: MIT


text:
插件面板优化功能：插件分类

您的功能请求是否与问题相关？ 请简单描述.
有些时候记不得插件有哪些，也不好归纳整理和访问。
请描述一下您想要的解决方案
希望有一个 JSON 或 YML 的配置界面，支持结构折叠和打标签注释，支持分类给插件起别名。
可以维护一个自用的rubisk己安装插件关键字手册，输入 ls 来查看
描述你考虑过的替代方案
Utools有一个闪电启动插件实现了部分类似功能，它支持正则的智能分类和全局本地区别，不过不能检测哪些被分类过。
我觉得还是原生支持要比插件实现舒服。

@Yang-Kyle  嗯... 是个不错的建议，我先调研一下

authors: Yang-Kyle muwoo

repo: rubickCenter/rubick


text:
Rails.root.join is listed as an offense while written using string interpolation

Actual behavior
While using string interpolation in ruby, Rails.root.join is listed as an offense but I am not sure if it should be. I have attached a screenshot to describe the actual behaviour below.

RuboCop version
I am using rubocop v0.53.0 in Travis CI.

This issue has been fixed in #5461 and will not be reproduced in RuboCop 0.57.2. Please upgrade RuboCop to a new version. Thank you.

repo: rubocop-hq/rubocop


text:
Style/Lambda with unused argument bug

Context
When using --auto-correct with a "stabby lambda" function where arguments are unused results in syntactically incorrect code:
c = -> event do
  puts 'Hello world'
end

Is autocorrected to the following:
c = lambda(_) do |_event|
  puts 'Hello world'
end

Which returns the following error when executed:
test.rb:3:in `<main>': undefined local variable or method `_' for main:Object (NameError)

Expected behavior
Should not inject _ arguments into lambda e.g. lambda(_) this is not allowed in Ruby. The result should be the following code:
c = lambda do |_event|
  puts 'Hello world'
end

Actual behavior
Inserts _ as an argument to lambda function e.g. lambda(_)
Steps to reproduce the problem

Insert the example code in the above context into a file.
Run rubocop --auto-correct on the file.
Try executing the formatted code, it will not work.

RuboCop version
$ [bundle exec] rubocop -V
0.67.2 (using Parser 2.6.2.1, running on ruby 2.4.5 x86_64-darwin18)

Ruby version
$ ruby -v
ruby 2.4.5p335 (2018-10-18 revision 65137) [x86_64-darwin18]

Thanks for your feedback. I opened a PR #6958.

authors: koic rramsden


text:
Cop idea: restrict expect { ... }.not_to raise_error()

Suggested by @Darhazer here.
expect { raise 'dffd' }
  .not_to raise_error

would fail with
  1) is expected not to raise Exception
     Failure/Error: expect { raise 'dffd' }.not_to raise_error

       expected no Exception, got #<RuntimeError: dffd> with backtrace:

Without expect { }:
     Failure/Error: raise 'fddf'

     RuntimeError:
       dffd

rspec-expectations would NOT warn about such a usage.
But in general, it's at best pointless.
❓ Discussion point: should the cop only be triggered when there's an expectation inside expect { expect(...).to ... }, or just the use of not_to raise_error in general?

I was just suggesting that, in scope of the Capybara cops, we may want not to use assertion methods that would raise, and expect not to raise, but instead use the methods that would return value, and expect against that return value

My point here was that it's pointless to write
expect { something }.not_to raise_error

when one can just write
something

and that would fail with roughly the same output.
However, I agree that some may prefer to be explicit, and that writing
it "doesn't fail" do
  something
end

is an example with zero expectations.
@ydah Would you agree with the above styling that @Darhazer suggests for capybara cops, would it always apply? May I kindly ask you to file a ticket if so?

authors: Darhazer pirj

repo: rubocop/rubocop-rspec


text:
Add RSpec/FactoryBot/AssociationStyle cop

In FactoryBot, there are 2 ways to define associations.
# implicit style
factory :article do
  user
end

# explicit style
factory :article do
  association :user
end

These styles are documented at the following section:

https://github.com/thoughtbot/factory_bot/blob/ec71611954d07419c9b668be03641332443dcd78/GETTING_STARTED.md#associations

(Stricyly speaking, there is also inline style, but it behaves differently from the above 2 styles.)
It would be nice to have a cop for consistent use of only one of the styles. This Pull Request has been created for this purpose.

Before submitting the PR make sure the following are checked:

[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Updated documentation.
[x] Added an entry to the CHANGELOG.md if the new code introduces user-observable changes.
[x] The build (bundle exec rake) passes (be sure to run this locally, since it may produce updated documentation that you will need to commit).

If you have created a new cop:

[x] Added the new cop to config/default.yml.
[x] The cop is configured as Enabled: pending in config/default.yml.
[x] The cop is configured as Enabled: true in .rubocop.yml.
[x] The cop documents examples of good and bad code.
[x] The tests assert both that bad code is reported and that good code is not reported.
[x] Set VersionAdded in default/config.yml to the next minor version.

If you have modified an existing cop's configuration options:

[ ] Set VersionChanged in config/default.yml to the next major version.

It seems that over time, all the three progressed. I was still believing that the implicit way didn't allow specifying factory: as it was in 5.0. Good to know FB improved so much on this front.
Personally, I strongly prefer the inline definition, for three reasons:

usage of instance (could be done before 6.0 with some hack, too) to refer to the model from association definitions
refer to (transient) attributes
with one-to-many associations an approach with no need for after(:create) that implies create strategy, or multiple per-strategy hooks that tend to get out of sync

The downside is that it's the most verbose out of the three in most of the cases.

it behaves differently from the above 2 styles

Is there anything else that I'm missing?

The implicit style run with real-world-rspec yields some false positives:
/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/issues.rb:49:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    factory :closed_issue, traits: [:closed]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/issues.rb:50:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    factory :reopened_issue, traits: [:opened]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

The explicit style run results in some errors:
An error occurred while RSpec/FactoryBot/AssociationStyle cop was inspecting /Users/pirj/source/real-world-rspec/cartodb/spec/factories/likes.rb:2:2.
undefined method `begin_type?' for nil:NilClass
/Users/pirj/source/rubocop-rspec/lib/rubocop/cop/rspec/factory_bot/association_style.rb:154:in `children_of_factory_block'
/Users/pirj/source/rubocop-rspec/lib/rubocop/cop/rspec/factory_bot/association_style.rb:142:in `bad_associations_in'
/Users/pirj/source/rubocop-rspec/lib/rubocop/cop/rspec/factory_bot/association_style.rb:45:in `on_send'

for e.g.:
FactoryBot.define do
  factory :like, class: Carto::Like do
  end
end

    factory 'valid site' do
      # after(:build) { |valid_site| valid_site.stubs(:valid?).returns(true) }
    end

Implicit:
57497 files inspected, 191 offenses detected, 191 offenses autocorrectable

Explicit:
57497 files inspected, 911 offenses detected, 911 offenses autocorrectable

Going with the implicit as the default enforced style seems reasonable 👍

For the reference, this (apart from probably pending -> true) was needed to run the cop against real-world-rspec:

it behaves differently from the above 2 styles

Is there anything else that I'm missing?

As noted in the documentation, attributes defined by inline-style return nil when called with attributes_for strategy.
My personal preference is to use inline-style only when I need it and not otherwise. If I always use inline-style, it makes difficult to infer from the code whether I am doing so because inline-style is necessary in the case or not.
If there seems to be a certain number of people who want to use the inline-style all the time, it might be nice to have a style in this cop that always prefers the inline-style. The downside is that it is quite difficult to autocorrect from inline-style to the other styles for the reasons mentioned above.

implicit
57497 files inspected, 206 offenses detected, 206 offenses autocorrectable

Concerns
/Users/pirj/source/real-world-rspec/hound/spec/factories.rb:77:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use implicit style to define associations.
    association :repo, :active, :private
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/clusters/kubernetes_namespaces.rb:5:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use implicit style to define
associations.
    association :cluster, :project, :provided_by_gcp
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Would the following be a valid FactoryBot syntax?
repo :active, :private
cluster :project, :provided_by_gcp

Using traits with associations only has examples with the explicit syntax.
explicit
57497 files inspected, 1026 offenses detected, 1026 offenses autocorrectable

False positives
Static attributes
Static attributes were deprecated in FactoryBot 4.11 and removed in 5.0.
4.11 is nearly 5 years old, but I don't think it is a reasonable decision to break support for it for several major repos.
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:535:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    version           '1'
    ^^^^^^^^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:536:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    content           CustomLandingPage::ExampleData::DATA_STR
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:541:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    enabled           true
    ^^^^^^^^^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:545:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    listing_id 123
    ^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:546:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    blocked_at Date.current
    ^^^^^^^^^^^^^^^^^^^^^^^

What do you think if the cop should only register an offence if the first argument is a hash?
Another option would be to introduce TargetFactoryBotVersion. Wondering if this is something we can do in a minor release, @bquorning @Darhazer ?
Blockpass
/Users/pirj/source/real-world-rspec/diaspora/spec/factories.rb:69:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    password_confirmation(&:password)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

build_association
/Users/pirj/source/real-world-rspec/sharetribe/spec/factories.rb:499:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    build_association(:paypal_account)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

sequence
/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/terraform/state_version.rb:9:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    sequence(:version)
    ^^^^^^^^^^^^^^^^^^

/Users/pirj/source/real-world-rspec/chatwoot/spec/factories/channel/channel_widget.rb:6:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associat
ions.
    sequence(:widget_color, &:to_s)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

factory
/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/keys.rb:22:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    factory :deploy_key, class: 'DeployKey'
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
/Users/pirj/source/real-world-rspec/gitlabhq/spec/factories/issues.rb:48:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    factory :closed_issue, traits: [:closed]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

to_create
/Users/pirj/source/real-world-rspec/cartodb/spec/factories/geocodings.rb:4:5: C: [Correctable] RSpec/FactoryBot/AssociationStyle: Use explicit style to define associations.
    to_create(&:save)
    ^^^^^^^^^^^^^^^^^

❓ Side note about using traits
This is ambiguous:
factory :word do
  letters { "bar" }
  type { "noun" }

  trait :article do
    type { :article }
  end

  factory :the do
    article
    letters { "the" }
  end

Unless we parse traits in context, it's hard to understand if article is an association or a trait.
With factory :verb, parent: :word placed in a separate file, this is getting impossible.
An alternative syntax makes it unambiguous:
  factory :the, traits: [:article] do
    letters { "the" }
  end

Might be an idea for a cop. Still, we won't be able to rely on that cop to be turned on and all traits to be defined in a factory call.

I can also think of traits_for_enum for completeness. Wondering if there's anything else available to use/override in the context of a factory that we have to consider ignoring.

Would the following be a valid FactoryBot syntax?
repo :active, :private
cluster :project, :provided_by_gcp

It seems that the implicit style does not allow such trait usage, so I need to fix #autocorrect_to_implicit_style for this.
# frozen_string_literal: true

require 'bundler/inline'

gemfile do
  source 'https://rubygems.org'

  gem 'factory_bot'
end

FactoryBot.define do
  factory :article do
    trait :active do
      active { true }
    end
  end

  factory :comment do
    article :active
  end
end

$ ruby wrong_association.rb
/home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/definition_proxy.rb:99:in `method_missing': undefined method 'article' in 'comment' factory (NoMethodError)
Did you mean? 'article { :active }'

        raise NoMethodError.new(<<~MSG)
        ^^^^^
        from wrong_association.rb:19:in `block (2 levels) in <main>'
        from /home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/syntax/default.rb:18:in `instance_eval'
        from /home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/syntax/default.rb:18:in `factory'
        from wrong_association.rb:18:in `block in <main>'
        from /home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/syntax/default.rb:37:in `instance_eval'
        from /home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/syntax/default.rb:37:in `run'
        from /home/r7kamura/.rbenv/versions/3.1.2/lib/ruby/gems/3.1.0/gems/factory_bot-6.2.1/lib/factory_bot/syntax/default.rb:7:in `define'
        from wrong_association.rb:11:in `<main>'

Instead, it can be written by using factory option:
# frozen_string_literal: true

require 'bundler/inline'

gemfile do
  source 'https://rubygems.org'

  gem 'activerecord', '~> 7.0.0'
  gem 'factory_bot'
  gem 'sqlite3'
end

require 'active_record'
require 'logger'
require 'minitest/autorun'

ActiveRecord::Base.establish_connection(
  adapter: 'sqlite3',
  database: ':memory:'
)

ActiveRecord::Schema.define do
  create_table :articles, force: true do |t|
    t.boolean :active, default: false
  end

  create_table :comments, force: true do |t|
    t.references :article
  end
end

class Article < ActiveRecord::Base
end

class Comment < ActiveRecord::Base
  belongs_to :article
end

FactoryBot.define do
  factory :article do
    trait :active do
      active { true }
    end
  end

  factory :comment do
    article factory: [:article, :active]
  end
end

class FactoryTest < Minitest::Test
  def test_association
    assert ::FactoryBot.create(:comment).article.active
  end
end

$ ruby example.rb
-- create_table(:articles, {:force=>true})
   -> 0.0024s
-- create_table(:comments, {:force=>true})
   -> 0.0003s
Run options: --seed 55593

# Running:

.

Finished in 0.010602s, 94.3227 runs/s, 94.3227 assertions/s.

1 runs, 1 assertions, 0 failures, 0 errors, 0 skips

I might be talking nonsense, but as an alternative to
article factory: [:article, :active]

would it be possible to write it as
article traits: [:active]

Which one would you prefer?

I feel you. I actually tried that example before posting the previous comment too, but I couldn't use :traits option on implicit style. In that example, I don't want to write "article" twice, and I too think that ideally :traits should be available here.

@r7kamura Would you re-target this to rubocop-factory_bot, please?

Recreated on rubocop-factory_bot repo:

https://github.com/rubocop/rubocop-factory_bot/pull/33


text:
Rubocop warns that department needs migration, but doesn't migrate

Expected behavior
When RuboCop warns the user that no department name is given and that the Migration cop needs to be run it should successfully migrate the cop comments.
Actual behavior
I have a bit of ruby code that contains a rubocop disable comment like this:
    # rubocop : disable CyclomaticComplexity
    def merge(predicate, hash1, force = false)
      raise "the predicate should be of type: boolean, not: #{predicate.class.name}" unless [true, false].include?(predicate)
      return if hash1.nil?
      @hash = @hash.merge(hash1) if predicate && !force
      @hash = @hash.merge!(hash1) if predicate && force
    end
    # rubocop : enable CyclomaticComplexity

When running rubocop these legacy department-less comments produce a warning:
Inspecting 1 file
/Users/tsmith/dev/the_world/mapr/libraries/mapr_utils.rb: Warning: no department given for CyclomaticComplexity. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/tsmith/dev/the_world/mapr/libraries/mapr_utils.rb: Warning: no department given for CyclomaticComplexity. Run `rubocop -a --only Migration/DepartmentName` to fix.
.

The problem is that running this command produces the same output:
rubocop -a --only Migration/DepartmentName /Users/tsmith/dev/the_world/mapr/libraries/mapr_utils.rb
Inspecting 1 file
/Users/tsmith/dev/the_world/mapr/libraries/mapr_utils.rb: Warning: no department given for CyclomaticComplexity. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/tsmith/dev/the_world/mapr/libraries/mapr_utils.rb: Warning: no department given for CyclomaticComplexity. Run `rubocop -a --only Migration/DepartmentName` to fix.

RuboCop version
0.78.0

This is still (or again?) happening on latest release, 1.44.1
$  bundle exec rubocop -v
1.44.1

$ bundle exec rubocop -a --only Migration/DepartmentName
/Users/pboling/src/.../client.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../client.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../client.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../client.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../listener.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../listener.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../listener.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
/Users/pboling/src/.../listener.rb: Warning: no department given for RescueException. Run `rubocop -a --only Migration/DepartmentName` to fix.
Inspecting 515 files
...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................

515 files inspected, no offenses detected

It doesn't fix the offense, despite saying it will.

repo: rubocop/rubocop


text:
Allow to write generics type of rbs-inline annotation after subclass definition in Style/CommentedKeyword

rbs-inline is a utility to embed RBS type declarations into Ruby code as comments.
This allows to write generics type rbs-inline annotation comment just after subclass definition in Style/CommentedKeyword.
refs: https://github.com/soutaro/rbs-inline/wiki/Syntax-guide#defining-classes
Follow https://github.com/rubocop/rubocop/pull/13222

Before submitting the PR make sure the following are checked:

[x] The PR relates to only one subject with a clear title and description in grammatically correct, complete sentences.
[x] Wrote good commit messages.
[ ] Commit message starts with [Fix #issue-number] (if the related issue exists).
[x] Feature branch is up-to-date with master (if not - rebase it).
[x] Squashed related commits together.
[x] Added tests.
[x] Ran bundle exec rake default. It executes all tests and runs RuboCop on its own code.
[x] Added an entry (file) to the changelog folder named {change_type}_{change_description}.md if the new code introduces user-observable changes. See changelog entry format for details.

Thanks!


text:
Rename MissingGroupType and UnsupportedGroupType

This PR renames MissingGroupTypeError and UnsupportedGroupTypeError for consistency.

I'd be happy to merge with a backwards compatible assignment of old name = new name, or a bump to 1.7.

This is a breaking change for anyone relying on this, so would need at least a bump to 1.7. But maybe we can make it in a backward compatible way with MissingGroupTypeError = MissingGroupType?

I could make an alias and we deprecate it on the next version

This is a breaking change for anyone relying on this, so would need at least a bump to 1.7. But maybe we can make it in a backward compatible way with MissingGroupTypeError = MissingGroupType?

I could make an alias and we deprecate it on the next version

That works for me.

@ericproulx Looks like CI is having trouble on master beyond rack-edge now, care to take a look?

I’ll take a look :)
On Mon 14 Feb 2022 at 23:34 Daniel Doubrovkine (dB.) <
@.***> wrote:

@ericproulx https://github.com/ericproulx Looks like CI is having
trouble on master beyond rack-edge now, care to take a look?
—
Reply to this email directly, view it on GitHub
https://github.com/ruby-grape/grape/pull/2227#issuecomment-1039640440,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACAHJI24RI5OWGDKLUFDMRLU3F7OJANCNFSM5LFICWAA
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

--
Avertissement
 Ce message est destiné uniquement à la personne ou à
l’organisation à laquelle il est adressé et il peut contenir des
informations privilégiées, confidentielles ou non divulgables en vertu de
la loi. Si vous n’êtes pas le destinataire du présent message ni la
personne chargée de remettre le présent message à son destinataire, il vous
est strictement interdit de le divulguer, de le distribuer, de le copier ou
de l’utiliser de quelque façon que ce soit. Si vous avez reçu la présente
communication par erreur, veuillez en aviser l’expéditeur et détruire ou
effacer tous les exemplaires que vous avez reçus.

*Warning
 *This message
is intended only for the use of the individual or entity to which it is
addressed, and may contain information which is privileged, confidential,
proprietary or exempt from disclosure under applicable law. If you are not
the intended recipient or the person responsible for delivering the message
to the intended recipient, you are strictly prohibited from disclosing,
distributing, copying or in any way using this message. If you have
received this communication in error, please notify the sender, and destroy
and delete any copies you may have received.

While testing locally,
https://github.com/ruby-grape/grape/blob/e93d27897fbf5f360fd11064d7b3c4d8094b7c53/lib/grape/validations/types/file.rb#L1-L15
input.nil? is false on rack-edge but true on a rack 2.2.3
A quick fix would be to check input.blank? but I'm not sure it's what we want

A quick fix would be to check input.blank? but I'm not sure it's what we want

So input is an empty string? Weird.

authors: dblock ericproulx

repo: ruby-grape/grape


text:
Release 2.1

rdf-vocab now depends on rdf 2.1, which apparently never got released.

released.

repo: ruby-rdf/rdf

license: unlicense


text:
build/toolchain/binaryen/bin/wasm-opt: No such file or directory

I ran the following command
rake npm:ruby-head-wasm-wasi

The command succeeds.
However, I get an error in the execution log.
/home/ledsun/ruby.wasm/packages/npm-packages/ruby-head-wasm-wasi/. /ruby-wasm-wasi/tools/pack-ruby-wasm.sh: line 18: /home/ledsun/ruby.wasm/build/toolchain/binaryen/bin/wasm-opt: no such file or directory

And packages/npm-packages/ruby-head-wasm-wasi/dist/ruby.stdlib.wasm was not created.
The full execution log can be found at https://gist.github.com/ledsun/b76fb84feb5b6cff97a52ae2fac43d4e .

Thank you for reporting :)
I hope it has been fixed by https://github.com/ruby/ruby.wasm/commit/a3c501708ca577cb094e3de79da4d9c022bbe5b0 :pray:

authors: kateinoigakukun ledsun


text:
Fix core/rational/minus_spec.rb

The shared examples are defined in shared/rational/minus.rb but the spec is not making use of them.

Actually, since the specs in shared/rational/minus.rb don't seem used anywhere else, could you just move them to core/rational/minus_spec.rb and "unshare" them?

Closing in favour of #922

authors: eregon timcraft

repo: ruby/spec

license: mit


text:
Delete and Hide Deactivated Partners

Summary
We currently have the ability to deactivate partners using the PartnerDeactivateService from a button on the partner#show page but partners who have been accidentally created and have not been invited should be deletable. Additionally, any partners who have been deactivated should not show up in the partners list by default and instead should be viewed only when selected.
Things to Consider
We have soft delete functionality on Items that may be applicable.
Criteria for Completion

[ ] Update the button on the partner show page to read Deactivate/Delete instead of Deactivate
[ ] Partner should be deleted if it is uninvited, has no distributions, users, or any other associations to it
[ ] Deactivated partners should not show up in the partner index page unless deactivated partners are selected
[ ] Tests verifying functionality

@seanmarcia if we hide the deactivated partner from the list by default, is there really a point to deleting it? Isn't a soft delete essentially the same as a deactivation? I might be missing something.

I think the idea is that a partner who gets soft deleted is a partner that has a history to them -- they've received diapers and period supplies in the past. That partner get reactivated again in the future and start receiving period supplies/diapers again. A partner that was accidentally entered should be "hard" deleted and shouldn't show up when they view the deactivated partners.

That's fair - but then shouldn't this ticket be for "hard" deletion? The description references soft delete functionality on Item which sounds like we want an additional soft deleted status here.
We can limit the deletion to those partners who have not been approved yet to make sure it really does only apply to accidentally created ones.

Good point! I referenced Item because it overrides the delete functionality where it first checks to see if the item has any history to it and does a soft delete if so, otherwise calls super for the hard delete. It also has the pattern of hiding soft deleted items by default and only showing them if selected. Note that I haven't looked at how it is done just that there may be patterns that could be replicated.

authors: dorner seanmarcia

repo: rubyforgood/human-essentials


text:
How to use localstorage for 'index' module (default)

In few places in my app I am using default store (not namespaced) and I also want to have it synced with local storage.

Is it possible to set somehow localstorage working also for store/index.js values without moving it into named module (non-index) ?
While using 'index' it is not working... :/

Check this.
//  nuxt.config.js
module.exports = {
  modules: [
    ['nuxt-vuex-localstorage', {
      localStorage: ['foo', 'bar'],  //  If not entered, “localStorage” is the default value
      sessionStorage: ['sfoo', 'sbar']  //  If not entered, “sessionStorage” is the default value
    }]
  ]
}

// store/index.js
export const state = () => ({
  foo: {
    anyValues: 0
  },
  bar: {
    anyValues: 0
  },
  sfoo: {
    anyValues: 0
  },
  sbar: {
    anyValues: 0
  }
})

Use ['foo', 'bar', 'tumbleRabbit', 'sweet', 'dino'] instead of ['index', 'tumbleRabbit', 'sweet', 'dino']
This module would observe all items of store with deep options.
store/tumbleRabbit.js in nuxt store module usage is the same as this of store/index.js
// store/index.js
export const state = () => ({
  tumbleRabbit: value
})

Please add it to read me, very useful information ;)

Fine thank you

authors: Albertbol pun-ky rubystarashe

repo: rubystarashe/nuxt-vuex-localstorage


text:
TypeError: Layer sequential_1_input does not support masking, but was passed an input_mask: Tensor("concatenate_1/All:0", shape=(?, 78), dtype=bool)

Hi,
I am interested in your work. I run your code, but I encountered the error which is "TypeError: Layer sequential_1_input does not support masking, but was passed an input_mask: Tensor("concatenate_1/All:0", shape=(?, 78), dtype=bool)
" when building AE model.
My tensorflow version is 1.10.0
Anyone can help me ? Thanks so much !
Bests,
Connie Tong

In model.py, line  230, I met the problem.
if args.aspect_layers > 0:
aspect_output = aspect_cnn(aspect_output)

You can check the dependency section in README for package versions.

Thanks. Fixed it.

Thanks. Fixed it.

请问您最终使用的tensorflow版本是什么，我改成python3代码后没有找到tensorflow1.4.1版本
What is the version of tensorflow you finally used, I did not find the version of tensorflow 1.4.1 after I changed the code to python3

@dongyang12138 目前代码只在python2的环境测试过， 直接换成python3可能有些问题。

您好，感谢您的回复，我现在遇到一个问题就是训练集loss全为0，验证集缺正常，然后在后面就出现了除0错误，请问您知道是哪里出了问题吗？
感激来信。
2020-07-31 17:36:33,927 INFO [Train] loss: 0.0000, [Sentiment] loss: 0.0000, [Domain] loss: 0.0000, [Sentiment] acc: 0.0000, [Domain] acc: 0.0000,
2020-07-31 17:38:20,377 INFO [Validation] loss: 0.5878, [Sentiment] loss: 0.5649, [Domain] loss: 0.0229, [Sentiment] acc: 0.7527, [Domain] acc: 0.9927,
在 2020-07-30 12:11:04，"Ruidan He" notifications@github.com 写道：
@dongyang12138 目前代码只在python2的环境测试过， 直接换成python3可能有些问题。
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

谢谢，我知道问题出在哪里了，我把python2代码转python3的时候，除号“/”转换成了“//”，成了取整除，所以结果为0了
还有个问题想问您，您的代码中做的除法是不是都是保留小数的除法？
在 2020-07-31 19:26:43，"董洋" dongyang12138@163.com 写道：
您好，感谢您的回复，我现在遇到一个问题就是训练集loss全为0，验证集缺正常，然后在后面就出现了除0错误，请问您知道是哪里出了问题吗？
感激来信。
2020-07-31 17:36:33,927 INFO [Train] loss: 0.0000, [Sentiment] loss: 0.0000, [Domain] loss: 0.0000, [Sentiment] acc: 0.0000, [Domain] acc: 0.0000,
2020-07-31 17:38:20,377 INFO [Validation] loss: 0.5878, [Sentiment] loss: 0.5649, [Domain] loss: 0.0229, [Sentiment] acc: 0.7527, [Domain] acc: 0.9927,
在 2020-07-30 12:11:04，"Ruidan He" notifications@github.com 写道：
@dongyang12138 目前代码只在python2的环境测试过， 直接换成python3可能有些问题。
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or unsubscribe.

authors: ConnieTong dongyang12138 ruidan


text:
Any plan for selenium wrap the headless chrome

just like https://github.com/SeleniumHQ/selenium/wiki/ChromeDriver, we can use a real browser.

Playwright is much better

repo: ruippeixotog/scala-scraper