text:
Scaladoc build errors

Description
When compiling the docs, there are a number of errors and warnings while generating the scaladocs.  Sample output is below:
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package; scaladoc `find . -type f -name "*.scala" | egrep "\/core|\/infer" | egrep -v "Suite"`; exit 0"
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:23: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:61: error: not found: type Logger
  val logger: Logger = LoggerFactory.getLogger(classOf[FeedForward])
              ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:61: error: not found: value LoggerFactory
  val logger: Logger = LoggerFactory.getLogger(classOf[FeedForward])
                       ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:292: error: not found: type Logger
          logger: Logger, workLoadList: Seq[Float]): Unit = {
                  ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:369: error: not found: type Logger
                  batchEndCallback: BatchEndCallback = null, logger: Logger = FeedForward.logger,
                                                                     ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:328: error: not found: type Logger
          batchEndCallback: BatchEndCallback, logger: Logger,
                                                      ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:464: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[FeedForward])
                      ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:464: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[FeedForward])
                               ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:542: error: not found: type Logger
    private var logger: Logger = FeedForward.logger
                        ^
./core/src/main/scala/org/apache/mxnet/FeedForward.scala:697: error: not found: type Logger
    def setLogger(logger: Logger): Builder = {
                          ^
./core/src/main/scala/org/apache/mxnet/IO.scala:23: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/IO.scala:35: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[DataIter])
                       ^
./core/src/main/scala/org/apache/mxnet/IO.scala:385: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[DataDesc])
                       ^
./core/src/main/scala/org/apache/mxnet/SymbolAPI.scala:22: error: not found: type AddSymbolAPIs
@AddSymbolAPIs(false)
 ^
./core/src/main/scala/org/apache/mxnet/util/WarnIfNotDisposed.scala:20: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/util/WarnIfNotDisposed.scala:27: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[WarnIfNotDisposed])
                      ^
./core/src/main/scala/org/apache/mxnet/util/WarnIfNotDisposed.scala:27: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[WarnIfNotDisposed])
                               ^
./core/src/main/scala/org/apache/mxnet/util/NativeLibraryLoader.scala:22: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/util/NativeLibraryLoader.scala:27: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[NativeLibraryLoader])
                      ^
./core/src/main/scala/org/apache/mxnet/util/NativeLibraryLoader.scala:27: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[NativeLibraryLoader])
                               ^
./core/src/main/scala/org/apache/mxnet/Monitor.scala:21: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/Monitor.scala:37: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[Monitor])
                       ^
./core/src/main/scala/org/apache/mxnet/Serializer.scala:24: error: object commons is not a member of package org.apache
import org.apache.commons.codec.binary.Base64
                  ^
./core/src/main/scala/org/apache/mxnet/Serializer.scala:52: error: not found: value Base64
    new String(Base64.encodeBase64(bytes.array), UTF8)
               ^
./core/src/main/scala/org/apache/mxnet/Serializer.scala:56: error: not found: value Base64
    ByteBuffer.wrap(Base64.decodeBase64(str.getBytes(UTF8)))
                    ^
./core/src/main/scala/org/apache/mxnet/ExecutorManager.scala:21: error: object slf4j is not a member of package org
import org.slf4j.{LoggerFactory, Logger}
           ^
./core/src/main/scala/org/apache/mxnet/ExecutorManager.scala:174: error: not found: type Logger
  val logger: Logger = LoggerFactory.getLogger(classOf[DataParallelExecutorManager])
              ^
./core/src/main/scala/org/apache/mxnet/ExecutorManager.scala:174: error: not found: value LoggerFactory
  val logger: Logger = LoggerFactory.getLogger(classOf[DataParallelExecutorManager])
                       ^
./core/src/main/scala/org/apache/mxnet/Base.scala:21: error: object slf4j is not a member of package org
import org.slf4j.{LoggerFactory, Logger}
           ^
./core/src/main/scala/org/apache/mxnet/Base.scala:24: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger("MXNetJVM")
                      ^
./core/src/main/scala/org/apache/mxnet/Base.scala:24: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger("MXNetJVM")
                               ^
./core/src/main/scala/org/apache/mxnet/KVStore.scala:23: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/KVStore.scala:56: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStore])
                      ^
./core/src/main/scala/org/apache/mxnet/KVStore.scala:56: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStore])
                               ^
./core/src/main/scala/org/apache/mxnet/NDArrayCollector.scala:22: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/NDArrayCollector.scala:68: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[NDArrayCollector])
                       ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:22: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:90: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[ResourceScope])
                       ^
./core/src/main/scala/org/apache/mxnet/io/MXDataIter.scala:24: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/io/MXDataIter.scala:38: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[MXDataIter])
                       ^
./core/src/main/scala/org/apache/mxnet/io/ResizeIter.scala:24: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/io/ResizeIter.scala:43: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[ResizeIter])
                       ^
./core/src/main/scala/org/apache/mxnet/io/PrefetchingIter.scala:21: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/io/PrefetchingIter.scala:41: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[PrefetchingIter])
                       ^
./core/src/main/scala/org/apache/mxnet/io/NDArrayIter.scala:25: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/io/NDArrayIter.scala:69: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[NDArrayIter])
                       ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:24: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:34: error: not found: type AddNDArrayFunctions
@AddNDArrayFunctions(false)
 ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:37: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[NDArray])
                       ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:22: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:33: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[Symbol])
                      ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:33: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[Symbol])
                               ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:836: error: not found: type AddSymbolFunctions
@AddSymbolFunctions(false)
 ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:839: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[Symbol])
                       ^
./core/src/main/scala/org/apache/mxnet/contrib/NDArray.scala:21: error: object AddNDArrayFunctions is not a member of package org.apache.mxnet
import org.apache.mxnet.AddNDArrayFunctions
       ^
./core/src/main/scala/org/apache/mxnet/contrib/NDArray.scala:23: error: not found: type AddNDArrayFunctions
@AddNDArrayFunctions(true)
 ^
./core/src/main/scala/org/apache/mxnet/contrib/Symbol.scala:21: error: object AddSymbolFunctions is not a member of package org.apache.mxnet
import org.apache.mxnet.AddSymbolFunctions
       ^
./core/src/main/scala/org/apache/mxnet/contrib/Symbol.scala:23: error: not found: type AddSymbolFunctions
@AddSymbolFunctions(true)
 ^
./core/src/main/scala/org/apache/mxnet/Model.scala:22: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/Model.scala:31: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[Model])
                       ^
./core/src/main/scala/org/apache/mxnet/NDArrayAPI.scala:18: error: not found: type AddNDArrayAPIs
@AddNDArrayAPIs(false)
 ^
./core/src/main/scala/org/apache/mxnet/LRScheduler.scala:19: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/LRScheduler.scala:56: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[FactorScheduler])
                       ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:26: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:46: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[Module])
                       ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:23: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:29: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[DataParallelExecutorGroup])
                      ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:29: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[DataParallelExecutorGroup])
                               ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:24: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:25: error: object slf4j is not a member of package org
import org.slf4j.Logger
           ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:36: error: not found: type Logger
    typeName: String, throws: Boolean, logger: Logger): Unit = {
                                               ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:136: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[BaseModule])
                       ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:21: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:22: error: object slf4j is not a member of package org
import org.slf4j.Logger
           ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:41: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[BucketingModule])
                       ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:21: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:34: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[SequentialModule])
                       ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:21: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:60: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[Executor])
                      ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:60: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[Executor])
                               ^
./core/src/main/scala/org/apache/mxnet/KVStoreServer.scala:21: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/KVStoreServer.scala:24: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStoreServer])
                      ^
./core/src/main/scala/org/apache/mxnet/KVStoreServer.scala:24: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStoreServer])
                               ^
./core/src/main/scala/org/apache/mxnet/KVStoreServer.scala:49: error: not found: type Logger
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStoreServer])
                      ^
./core/src/main/scala/org/apache/mxnet/KVStoreServer.scala:49: error: not found: value LoggerFactory
  private val logger: Logger = LoggerFactory.getLogger(classOf[KVStoreServer])
                               ^
./core/src/main/scala/org/apache/mxnet/Callback.scala:20: error: object slf4j is not a member of package org
import org.slf4j.{Logger, LoggerFactory}
           ^
./core/src/main/scala/org/apache/mxnet/Callback.scala:28: error: not found: type Logger
    private val logger: Logger = LoggerFactory.getLogger(classOf[Speedometer])
                        ^
./core/src/main/scala/org/apache/mxnet/Callback.scala:28: error: not found: value LoggerFactory
    private val logger: Logger = LoggerFactory.getLogger(classOf[Speedometer])
                                 ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:22: error: object benchmark is not a member of package org.apache.mxnetexamples
import org.apache.mxnetexamples.benchmark.CLIParserBase
                                ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:28: error: object kohsuke is not a member of package org
import org.kohsuke.args4j.{CmdLineParser, Option}
           ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:29: error: object slf4j is not a member of package org
import org.slf4j.LoggerFactory
           ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:34: error: object InferBase is not a member of package org.apache.mxnetexamples
import org.apache.mxnetexamples.InferBase
       ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:205: error: not found: type InferBase
  extends InferBase {
          ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:48: error: not found: value LoggerFactory
  private val logger = LoggerFactory.getLogger(classOf[SSDClassifierExample])
                       ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:195: error: not found: type CLIParserBase
class CLIParser extends CLIParserBase {
                        ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:112: error: not found: type CmdLineParser
    val parser : CmdLineParser = new CmdLineParser(inst)
                 ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:112: error: not found: type CmdLineParser
    val parser : CmdLineParser = new CmdLineParser(inst)
                                     ^
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:196: error: class Option is abstract; cannot be instantiated
  @Option(name = "--model-path-prefix", usage = "the input model directory and prefix of the model")
   ^
warning: no valid targets for annotation on value modelPathPrefix - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:198: error: class Option is abstract; cannot be instantiated
  @Option(name = "--input-image", usage = "the input image")
   ^
warning: no valid targets for annotation on value inputImagePath - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
./examples/src/main/scala/org/apache/mxnetexamples/infer/objectdetector/SSDClassifierExample.scala:200: error: class Option is abstract; cannot be instantiated
  @Option(name = "--input-dir", usage = "the input batch of images directory")
   ^
warning: no valid targets for annotation on value inputImageDir - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
warning: no valid targets for annotation on value modelPathPrefix - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
warning: no valid targets for annotation on value inputImagePath - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
warning: no valid targets for annotation on value inputImageDir - it is discarded unused. You may specify targets with meta-annotations, e.g. @(<error> @getter)
warning: there were 12 deprecation warnings; re-run with -deprecation for details
warning: there were 17 feature warnings; re-run with -feature for details
model contains 149 documentable templates
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:29: warning: Could not find any member to link for "NativeResource".
/**
^
./core/src/main/scala/org/apache/mxnet/Executor.scala:260: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:248: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:236: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:224: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:368: warning: Could not find any member to link for "IOException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:369: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:345: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:206: warning: Could not find any member to link for "out1_batch1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:362: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:338: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:518: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:500: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:538: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:516: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:509: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:485: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/SymbolAPIBase.scala:1473: warning: Could not find any member to link for "batch_index,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/NDArrayAPIBase.scala:1473: warning: Could not find any member to link for "batch_index,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:45: warning: Could not find any member to link for "NativeResource".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:45: warning: Could not find any member to link for "NativeResource.close()".
  /**
  ^
29 warnings found
120 errors found
Execute "rm -rf /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "mkdir -p /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f index /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f index.html /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f org /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f lib /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f index.js /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"
Execute "cd /home/ubuntu/incubator-mxnet/docs/../scala-package && mv -f package.html /home/ubuntu/incubator-mxnet/docs/_build/html/api/scala/docs"

@mxnet-label-bot[Doc, Scala]

Some errors are suppressed by default and should be noted.  The build output after a partial fix from https://github.com/apache/incubator-mxnet/pull/13189/commits/bb7f4b872d000d9d899e1fc41c8da356db7123ba (to clear up the output a bit) but with the flags to show the warnings (-deprecated -feature) is:
ubuntu@ip-172-31-68-239:~/incubator-mxnet/scala-package$ scaladoc `find . -type f -name "*.scala" | egrep "\.\/core|\.\/infer" | egrep -v "Suite"` -classpath `find native -name "*.jar" | grep "target/lib/" | tr '\n' ':'`:`find macros -name "*-SNAPSHOT.jar"` -deprecation -feature
./core/src/main/scala/org/apache/mxnet/IO.scala:343: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/IO.scala:347: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/IO.scala:407: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/IO.scala:408: warning: implicit conversion method ListMap2Descs should be enabled
by making the implicit value scala.language.implicitConversions visible.
This can be achieved by adding the import clause 'import scala.language.implicitConversions'
or by setting the compiler option -language:implicitConversions.
See the Scala docs for value scala.language.implicitConversions for a discussion
why the feature should be explicitly enabled.
  implicit def ListMap2Descs(shapes: ListMap[String, Shape]): IndexedSeq[DataDesc] = {
               ^
./core/src/main/scala/org/apache/mxnet/Visualization.scala:149: warning: postfix operator ! should be enabled
by making the implicit value scala.language.postfixOps visible.
This can be achieved by adding the import clause 'import scala.language.postfixOps'
or by setting the compiler option -language:postfixOps.
See the Scala docs for value scala.language.postfixOps for a discussion
why the feature should be explicitly enabled.
        args !
             ^
./core/src/main/scala/org/apache/mxnet/javaapi/Shape.scala:49: warning: implicit conversion method fromShape should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def fromShape(shape: org.apache.mxnet.Shape): Shape = new Shape(shape)
               ^
./core/src/main/scala/org/apache/mxnet/javaapi/Shape.scala:51: warning: implicit conversion method toShape should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def toShape(jShape: Shape): org.apache.mxnet.Shape = jShape.shape
               ^
./core/src/main/scala/org/apache/mxnet/javaapi/IO.scala:29: warning: implicit conversion method fromDataDesc should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def fromDataDesc(dDesc: org.apache.mxnet.DataDesc): DataDesc = new DataDesc(dDesc)
               ^
./core/src/main/scala/org/apache/mxnet/javaapi/IO.scala:31: warning: implicit conversion method toDataDesc should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def toDataDesc(dataDesc: DataDesc): org.apache.mxnet.DataDesc = dataDesc.dataDesc
               ^
./core/src/main/scala/org/apache/mxnet/javaapi/Context.scala:38: warning: implicit conversion method fromContext should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def fromContext(context: org.apache.mxnet.Context): Context = new Context(context)
               ^
./core/src/main/scala/org/apache/mxnet/javaapi/Context.scala:39: warning: implicit conversion method toContext should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def toContext(jContext: Context): org.apache.mxnet.Context = jContext.context
               ^
./core/src/main/scala/org/apache/mxnet/KVStore.scala:289: warning: postfix operator != should be enabled
by making the implicit value scala.language.postfixOps visible.
        val bArray = Stream.continually (bis.read).takeWhile (- 1 !=).map (_.toByte).toArray
                                                                  ^
./core/src/main/scala/org/apache/mxnet/io/MXDataIter.scala:161: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/MXDataIter.scala:165: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/ResizeIter.scala:137: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/ResizeIter.scala:143: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/PrefetchingIter.scala:181: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/PrefetchingIter.scala:185: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/NDArrayIter.scala:240: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/io/NDArrayIter.scala:244: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated
   ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:36: warning: implicit conversion method getFirstResult should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def getFirstResult(ret: NDArrayFuncReturn): NDArray = ret(0)
               ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:1047: warning: implicit conversion method int2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def int2Scalar(x: Int): NDArrayConversions = new NDArrayConversions(x.toFloat)
               ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:1048: warning: implicit conversion method double2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def double2Scalar(x: Double): NDArrayConversions = new NDArrayConversions(x.toFloat)
               ^
./core/src/main/scala/org/apache/mxnet/NDArray.scala:1049: warning: implicit conversion method float2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def float2Scalar(x: Float): NDArrayConversions = new NDArrayConversions(x)
               ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:1291: warning: implicit conversion method int2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def int2Scalar(x: Int): SymbolConversions[Int] = new SymbolConversions(x)
               ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:1292: warning: implicit conversion method double2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def double2Scalar(x: Double): SymbolConversions[Double] = new SymbolConversions(x)
               ^
./core/src/main/scala/org/apache/mxnet/Symbol.scala:1293: warning: implicit conversion method float2Scalar should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def float2Scalar(x: Float): SymbolConversions[Float] = new SymbolConversions(x)
               ^
./core/src/main/scala/org/apache/mxnet/Optimizer.scala:147: warning: @deprecated now takes two arguments; see the scaladoc.
  @deprecated("Use setLrMult instead.")
   ^
./core/src/main/scala/org/apache/mxnet/Context.scala:35: warning: implicit conversion method ctx2Array should be enabled
by making the implicit value scala.language.implicitConversions visible.
  implicit def ctx2Array(ctx: Context): Array[Context] = Array(ctx)
               ^
model contains 139 documentable templates
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:29: warning: Could not find any member to link for "NativeResource".
/**
^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:368: warning: Could not find any member to link for "IOException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:362: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BucketingModule.scala:338: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:206: warning: Could not find any member to link for "out1_batch1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:509: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/Module.scala:485: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:369: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/SequentialModule.scala:345: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:538: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/DataParallelExecutorGroup.scala:516: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:518: warning: Could not find any member to link for "grad1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:500: warning: Could not find any member to link for "out1_dev1,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/SymbolAPIBase.scala:1541: warning: Could not find any member to link for "batch_index,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:45: warning: Could not find any member to link for "NativeResource".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/ResourceScope.scala:45: warning: Could not find any member to link for "NativeResource.close()".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/NDArrayAPIBase.scala:1541: warning: Could not find any member to link for "batch_index,".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:260: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:248: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:236: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
./core/src/main/scala/org/apache/mxnet/Executor.scala:224: warning: Could not find any member to link for "IllegalArgumentException".
  /**
  ^
50 warnings found

After progress with https://github.com/apache/incubator-mxnet/pull/13210 and https://github.com/apache/incubator-mxnet/pull/13189, the original 12 deprecation warnings, 17 feature warnings, 29 warnings, and 120 errors has been reduced to one warning.  The build command and output (when not run through /docs/Makefile html) are:
ubuntu@ip-172-31-68-239:~/incubator-mxnet/scala-package$ scaladoc `find . -type f -name "*.scala" | egrep "\.\/core|\.\/infer" | egrep -v "Suite"` -classpath `find native -name "*.jar" | grep "target/lib/" | tr '\n' ':'`:`find macros -name "*-SNAPSHOT.jar"` -feature -deprecation
model contains 139 documentable templates
./core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:368: warning: Could not find any member to link for "IOException".
  /**
  ^
one warning found

The IOException warning is because there is no javadoc page to link to for the java standard library's IOException. I believe it requires an addition of the -doc-external-doc flag to the scaladoc command, but I was unable to get it working. I am leaving this issue open to fix the remaining warning.

At some point, I found a JIRA bug within the scaladoc that explains why the -doc-external-doc flag is not resolving the warning. It was not fixed until a later version of the compiler so this issue requires upgrading the scala compiler past 2.11.8 to fix IOException.

repo: apache/incubator-mxnet


text:
Output different between GPU and CPU.

I am coding with c_api and I am trying to do feature extract with a pre-trained model (in the model gallery).
Everything seems good except that the output feature vectors changes when I change the global context(from GPU to CPU and vice versa).
And the differences are huge.
I've been debugging the code for a while and not be able to solve it.
Could someone tells me some possible causes?
Thanks a lot~

Which platform are you working on?
Could you try to locate the layer that is causing this?

My platform:
Red Hat 4.4.7-4.
Linux version 2.6.32-431.el6.x86_64.
The only difference in the code is kCPU or kGPU.
I wondered it was because of the data copy between CPU and GPU,  so I add ndarray_wait_all() everywhere, but it seems not to be the answer.

Try running only the first layer, then the first two. See if you can locate the layer that cause mismatching results.

@piiswrong
Thanks for your suggestion.
I'll try that.

Seems CPU are giving a wrong results?
The output of bn_conv1_output given by CPU are all -6.85604e+09.
While the GPU results are a lot more resonable.
(The output of conv_conv1_output of GPU and CPU are identical)
What will this mean?
The first few layers of the model:
[16:48:26] feature_extract.cpp:26: data
[16:48:26] feature_extract.cpp:26: conv_conv1_weight
[16:48:26] feature_extract.cpp:26: conv_conv1_bias
[16:48:26] feature_extract.cpp:26: conv_conv1_output
[16:48:26] feature_extract.cpp:26: bn_conv1_gamma
[16:48:26] feature_extract.cpp:26: bn_conv1_beta
[16:48:26] feature_extract.cpp:26: bn_conv1_output

So I find the cause.
I didn't load the aux parameters from the Model.
close the issue.

Hi，I am tring to use C++ to extract feature from middle layer,which is so easy in Python(such as API：get_internals), but I don't know how to implement it in C++. Could you please share your idea or code ?Thanks a lot!

source: gharchive/issue

license_type: permissive

license_source: github-api


text:
Newbie Q: Slow Training

Hey folks---Sorry if this isn't the best place to ask, since this isn't a problem with {mxnet} but a question. I'm using {mxnet} to fit a feed forward network for text classification, where I'm categorizing documents into one of 10 classes.
When I fit one- or two-layer network, learning seems to happen pretty quickly. Accuracy might stay at 10% for a few iterations, but then picks up. When I try fitting a deeper network, the accuracy might stay ~10% for many iterations---sometimes nearly 200---before the rate starts to steadily increase. I've tried toying with the learning rate, from 0.5 to 1e-4, but it doesn't seem to make the learning happen faster.
This seems abnormal, but I don't know what I'm missing. Is there a particular parameter that I'm not thinking to adjust? Is this a common 'noob' problem in fitting a FF network?
As an aside: when I fit the network using 10 nodes on my last layer (because I have a 10-category target), my results converge to predicting a single category for every document, and learning never goes past that. When I specify 11 nodes, learning happens. Is this normal?
Thanks again!

If it's helpful, it seems that the default initialization was just too small for some applications. Using the sqrt(3/Number of hidden nodes) rule worked to get things moving quite a bit faster.

This issue is closed due to lack of activity in the last 90 days. Feel free to reopen if this is still an active issue. Thanks!

authors: bdlacree phunterlau


text:
[MXNET-854] SVRG Optimization in Python Module API

Description
SVRG stands for Stochastic Variance Reduced Gradient, which is an optimization technique that complements SGD. It is introduced in the paper Accelerating Stochastic Gradient Descent using Predicative Variance Reduction in 2013.
Key Characteristics of SVRG:

Explicit Variance Reduction
Converge much faster compared to SGD on strongly convex smooth functions

SVRG Module should:

seamlessly supports both dense and sparse data, run on CPU and GPU instances on single machine and in distributed setting.
minimize the API differences with Python Module API.

Checklist
Essentials
Please feel free to remove inapplicable items for your PR.

[x] The PR title starts with [MXNET-854], where MXNET-854 refers to the relevant JIRA issue created (except PRs with tiny changes)
[x] All changes have test coverage:
[x] Code is well-documented:
For user-facing API changes, API doc string has been updated.
For new examples, README.md is added to explain the what the example does, the source of the dataset, expected performance on test set and reference to the original paper if applicable
[x] To the my best knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change

Changes

SVRGModule inherits from Python Module and minimizes the API changes of Module API. Both intermediate level and high level APIs are supported
Functional tests and unittests have been tested for SVRGModule and SVRG Optimizer.

Comments

Design decisions of why using Python Module instead of Optimizer can be found in the design doc here
This version of SVRGModule supports single machine run with single cpu, single gpu and multiple-gpus. Distributed SVRGModule is soon to be updated.
Benchmarking has been performed on this single machine version SVRGModule on single cpu on linear regression model. Distributed SVRGModule to be updated soon. Benchmarking results can be found in contrib/svrg_optimization_python/benchmarks.

Thanks @StephanieYuan - Welcome to MXNet community!
@piiswrong @eric-haibin-lin @anirudhacharya @Roshrini @vandanavk - You will be interested to have a look at this.

Move svrg_optimization to python/contrib package.

@xcgoner Thank you for the pointer! I'd like to try out the improvements in the later iterations of this project.

Also the way svrg_optimizer.py is written it leaves a few questions open.
From your design document I understand that SVRGOptimizer cannot be used with Module API which is why you wrote the SVRGModule API which will use SVRGOptimizer under the hood instead of the usual SGD or other optimizers. Can you explain why in greater detail?
Also if this is indeed the case, then the SVRGOptimizer class needs to be declared private using a leading underscore in its name, else it will be very misleading to the user who might try to use SVRGOptimizer with the plain vanilla Module API. Also it should be made clear in the doc string for the SRVGOptimizer that this optimizer is to be used with the SVRGModule alone.
Also you might want to consider moving the SVRGOptimizer to the optimizer.py file and keep SVRGModule alone in the contrib folder. But I am not sure of this, you might want to get a second opinion on this. @piiswrong @eric-haibin-lin

Great progress here. Thanks everyone.
@StephanieYuan

Please rebase and resolve conflicts.
Please comment about tests added and coverage.
We had discussed in above comment, to verify this implementation with MNIST to confirm correctness per the claims in paper. Please comment.

@anirudhacharya - I would still prefer keeping SVRG optimizer in contrib and allow it to evolve. As mentioned in above comments and design doc, Other combination like Adam+SVRG could also be used but not benchmarked. I would set the default optimizer for SVRGModule to be SVRGOptimizer but not remove the option altogether and make SVRGOptimizer internal. Thoughts?

Thanks everyone for the feedback and input!
I've rebased and resolved the conflict with master.  I have also added some more unittests for SVRGModule especially on verifying SVRG gradients calculations and the test coverage is now:
mxnet/contrib/svrg_optimization/svrg_module.py                        175     21    88%
mxnet/contrib/svrg_optimization/svrg_optimizer.py                      38      1    97%
@sandeep-krishnamurthy I'm working on creating the MNIST example but I'm expecting it will take a few more days as I have other tasks in queue. Maybe I can include the example in my next PR on SVRG in distributed mode?
@anirudhacharya SVRGOptimizer is designed to be used with SVRGModule alone. The actual SVRG optimization logic is implemented in the SVRGModule and the SVRGOptimizer is designed to assist the full gradients accumulation in the KVStore. I've made SVRGOptimizer a private class and added the reasonings behind the design in greater detail in the docs/api/python/contrib/svrg_optimization. Hopefully it clarifies things a bit.
@aaronmarkham I've added pointer about the svrg_optimization in index.md and refined the docs in the example/svrg_module/README.

@sandeep-krishnamurthy it now looks better after SVRGOptimizer was made private. Including SVRGOptimizer in optimizer.py file instead of the contrib folder was just a thought. I am okay either ways. Will take a look at @StephanieYuan 's changes and approve it accordingly.

@anirudhacharya I'll fix it soon. Is there a way that I can see the rendered view before it gets pushed?

@StephanieYuan some of the issues are with the content of the docs and few are with how the content renders. @aaronmarkham might be able to help with how the docs renders. You will probably have to build the docs and have to deploy it locally.

I just updated the how-to guide for building the docs.
https://cwiki.apache.org/confluence/display/MXNET/How+to+Build+the+Website
Let me know if you have any questions.

@aaronmarkham Thanks for the pointer!
I'm thinking to exclude SVRGModule from module.md since SVRGModule will be a contrib package at current stage.

@anirudhacharya Sounds good! It's a Jupyter Notebook. I'll add it to the example folder.

source: gharchive/pull-request

authors: StephanieYuan aaronmarkham anirudhacharya sandeep-krishnamurthy


text:
API Gateway - Support updating API definitions.

This is a feature request for the experimental API Gateway service.
Add a new command wsk api update which will modify the API definitions. For example, this would allow people to change the Action bound to a route, supporting "blue/green deployments".
Currently, the user has to delete the entire API definition and re-create as new, which leads to a new URL endpoint.

@mdeuser @csantanapr done?

@rabbah - no, not yet.

authors: jthomas mdeuser rabbah

repo: apache/incubator-openwhisk


text:
help my page is not working

performance very low
mxplantae.com
what can i do im not a devp or know anything of tecno please keep it easy

Are you using pagespeed module?

authors: Lofesa mxplantae

repo: apache/incubator-pagespeed-mod


text:
link validator fails due to changed url

Url opensource.org/licenses/BSD-3-Clause changed to opensource.org/blog/license/bsd-3-clause

Are we sure that was intentional? That doesn't seem like an improvement and perhaps something they'll rollback?

Not sure, at least it changed for all licenses: https://opensource.org/licenses

asked on https://merveilles.town/@raboof/111974245965562026

I will open an issue on https://github.com/OpenSourceOrg/dotOrg maybe we get an answer there

a found it at https://github.com/OpenSourceOrg/dotOrg/issues/60, great

They will revert back to the original URL

authors: nvollmar raboof

repo: apache/incubator-pekko


text:
Fix: Compaction with last deleted keys not completing compaction

Motivation
Right now, topic-compaction ignores the message-id with empty payload but if the last message in the ledger has empty payload then compactor doesn't complete the compaction because compactor ignores last message and doesn't complete the result-future so, caller never sees complete result.
Modifications

Compactor calculates from and to position for compacted ledger according to last non-deleted active key.
Compactor handles tail deleted keys from the ledger and completes compaction process gracefully.

Result
compactor can successfully compact ledger whose last message is also deleted.

it also requires for #2549

Have added test where all the records are deleted in the ledger.

repo: apache/incubator-pulsar


text:
[REEF-96] Update C# namespace referenced in Reef bridge project

We have prepared to move .Net Reef code to Apache Git. We also updated namespaces for .Net code. In Reef bridge code, driver.dll is used whose name space need to be updated to Org.Apache.Reef.Driver.
In Tang serialization testing for cross languages, we also referenced .Net name space. It needs to be updated as well. Class hierarchy files used in test also need to be updated.
This PR is to:
Update name space in bridge project
Update driver file
Updated name space used in Tang test and examples
Update class hierarchy files in testing
This is for REEF-96 https://issues.apache.org/jira/browse/REEF-96
Author: Julia Wang
Email: jwang98052@yahoo.com

Please merge current master and make sure the bridge-project reference the parent pom.xml in the right places.

Merged from master. build passed.

merging this

repo: apache/incubator-reef


text:
[Feature][Jdbc] Improve sqlserver sink

Search before asking

[X] I had searched in the feature and found no similar feature requirement.

Description
Currently jdbc SqlServerDialect using INSERT INTO ${database}.${table}
https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/sqlserver/SqlServerDialect.java
https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-connectors-v2/connector-jdbc/src/main/java/org/apache/seatunnel/connectors/seatunnel/jdbc/internal/dialect/JdbcDialect.java#L78
SQLServer SQL only allows ${database}.${schema}.${table} or ${schema}.${table} as table identifier
Changes
        // pseudocode
        String sqlServerTable;
        String[] tableNames = tableName.split("\\.");
        if (tableNames.length == 1 || tableNames.length == 3) {
            sqlServerTable = tableName;
        } else if (tableNames.length == 2) {
            sqlServerTable = database + "." + tableName;
        } else {
            throw new IllegalArgumentException();
        }
        return String.format("INSERT INTO %s (%s) VALUES (%s)",
            sqlServerTable, columns, placeholders);

Validate
Add e2e testcase
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

pls assigned to me tks

repo: apache/incubator-seatunnel


text:
[SCB-693] registry microservice failed if failed to  get host address

Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[ ] Each commit in the pull request should have a meaningful subject line and body.
[ ] Format the pull request title like [SCB-XXX] Fixes bug in ApproximateQuantiles, where you replace SCB-XXX with the appropriate JIRA issue.
[ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[ ] Run mvn clean install to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

I commited another PR

Coverage decreased (-0.08%) to 87.085% when pulling cb4096fbfcb564170ce34de0da6855f3fac58f8c on laijianbin:patch-7 into a2bbd882bd7e3cf75633eb987bb5349cf33c0373 on apache:master.

I hava been committed another PR

authors: coveralls laijianbin


text:
antlr4 version 4.7.1 report an error

When I use
"mvn clean package -Dmaven.test.skip=true -Dmaven.javadoc.skip=true"
An error was reported here.
The error message is
“A required class was missing while executing org.antlr:antlr4-maven-plugin:4.7.1:antlr4: org/antlr/v4/Tool”
When I update the version of antlr4 to 4.7.2   evething is ok.

Can you submit a pull request to fix this issue?

Closed for no response any more, if the issue still existed, please create a new issue

authors: sunjiabo terrymanu

repo: apache/incubator-shardingsphere

license_source: bigquery


text:
Support Consul as soul-register-center

Feature Request

Is your feature request related to a problem? Please describe
A clear and concise description of what the problem is. Ex. I have an issue when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen. Add any considered drawbacks.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Please read the Contribution Guideline before submitting the PR

let me do this

spring-cloud-starter-consul-discovery
For the compatibility of the project is not high fault tolerance
Personally, I’m more inclined use this client

repo: apache/incubator-shenyu


text:
Does Trace Data Protocol have any upgrade plan in 5.x series?

skywalking是一个很好的开源项目，我这边准备直接在公司试用，但是由于5.0对比3.x有协议变更，为了避免升级的麻烦，准备直接上5.0，请问作者有什么好的建议没？另外，还有如题的疑问，辛苦作者 ：）

Translation
SkyWalking is a good open source project, I am going to use it in my company. But the Trace Data Protocol is changed in 5.0 from 3.0. So for avoid the problems, we are going to use 5.0 directly. So I want to ask for suggestions. And does the project team have any upgrade plan?
By @wu-sheng

FYI @HouZhiHouJue , I just translate your issue, please keep it in English.

Thanks for be interesting in our project. We are going to release the 5.0.0-beta in this month.

Does Trace Data Protocol have any upgrade plan in 5.x series?

One of our PMC, @peng-yongsheng , asked for some changes, but didn't be accepted by the project yet. We will be very careful about the upgrade.
But, I have to say, if you are only using it, you should not care too much about the protocol. Because, the agent, collector and UI always match in our release. For new release, even I assume we change the protocol, the hardest thing you did will be that, upgrade your all agents.
Unless, you are going to process the trace data by your own, or want to work on some other agents or SDKs. If that case, please notice our team, we will ping you before the changes, just like we will ping @liuhaoyang 's .NET agent and @ascrutae 's nodejs agent teams.

ok, thanks.

authors: HouZhiHouJue wu-sheng

repo: apache/incubator-skywalking


text:
Add [Agent] Jedis LETTUCE client plugin

Please answer these questions before submitting pull request

Why submit this pull request?

[x] New feature provided

Add [Agent] Jedis LETTUCE client plugin

Related issues
Jedis LETTUCE client plugin #766

Bug fix

Bug description.

How to fix?

New feature or improvement

Describe the details and related test reports.

@lytscu Please sync to master and update the version number to SNAPSHOT

authors: lytscu wu-sheng


text:
[Feature] Implement Sql gateway interface with kyuubi

Search before asking

[X] I had searched in the feature and found no similar feature requirement.

Description
Implement Sql gateway interface with kyuubi.
Usage Scenario
The integration with Flink SQL gateway.
Related issues
https://github.com/apache/incubator-streampark/issues/2274
Are you willing to submit a PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Hi @wolfboys, please assign this ticket to @Jiabao-Sun?

I have open a issue to kyuubi https://github.com/apache/kyuubi/issues/4227 . If openapi yaml have supplied, we can generate api client  just like streampark moudle streampark-flink-sql-gateway-flink by openapi-generator-maven-plugin . cc @SteNicholas @Jiabao-Sun.

cc @Jiabao-Sun Please reply: "please assign me", I will assign you

repo: apache/incubator-streampark


text:
[Improve] Make sure this role is not bound by the user before removing the role

What problem does this PR solve?
Issue Number: close #1727
Problem Summary:

Make sure this role is not bound by the user before removing the role
when delete a role, delete menu mapping of this role

What is changed and how it works?
Proposal: xxx
Feel free to ping committers for the review!
Contribution Checklist

Make sure that the pull request corresponds to a GITHUB issue.

Name the pull request in the form "[Feature] [component] Title of the pull request", where Feature can be replaced by Hotfix, Bug, etc.

Minor fixes should be named following this pattern: [hotfix] [docs] Fix typo in README.md doc.

Purpose of this pull request

Make sure this role is not bound by the user before removing the role
when delete a role, delete menu mapping of this role

Thanks for your contribution, I will review it later.

@wolfboys Thanks for your review.


text:
How to change the pinyin in mapbox to Chinese？

How to change the pinyin in mapbox to Chinese？

It seem like a bug

authors: panxuexue zhaoyongjie

repo: apache/incubator-superset


text:
fix: specify VARCHAR size when loading examples

SUMMARY

superset load_examples is failing on Mysql:
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/elements.py", line 481, in compile
    return self._compiler(dialect, bind=bind, **kw)
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/ddl.py", line 29, in _compiler
    return dialect.ddl_compiler(dialect, self, **kw)
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/compiler.py", line 322, in __init__
    self.string = self.process(self.statement, **compile_kwargs)
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/compiler.py", line 352, in process
    return obj._compiler_dispatch(self, **kwargs)
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/visitors.py", line 96, in _compiler_dispatch
    return meth(self, **kw)
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/sql/compiler.py", line 2918, in visit_create_table
    from_=ce,
  File "/Users/max/.pyenv/versions/3.7.7/envs/env37/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
    raise exception
sqlalchemy.exc.CompileError: (in table 'video_game_sales', column 'Name'): VARCHAR requires a length on dialect mysql

This PR fixes it by adding a default size for VARCHAR columns.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

N/A
TEST PLAN

superset load_examples now work on MySQL.
ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

Codecov Report

Merging #12186 (8fe9dd2) into master (9b110b2) will decrease coverage by 1.83%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #12186      +/-   ##
==========================================
- Coverage   63.07%   61.23%   -1.84%
==========================================
  Files         994      510     -484
  Lines       49065    19303   -29762
  Branches     4982     4982
==========================================
- Hits        30946    11821   -19125
+ Misses      17919     7282   -10637
  Partials      200      200

Flag
Coverage Δ

javascript
61.23% <ø> (ø)

python
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

superset/datasets/commands/importers/v0.py

...igrations/versions/763d4b211ec9_fixing_audit_fk.py

superset/annotation_layers/commands/update.py

superset/charts/dao.py

superset/datasets/commands/update.py

superset/dao/exceptions.py

...erset/queries/saved_queries/commands/exceptions.py

...grations/versions/a8173232b786_add_path_to_logs.py

superset/queries/dao.py

...s/versions/db0c65b146bd_update_slice_model_json.py

... and 473 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9b110b2...8fe9dd2. Read the comment docs.

authors: betodealmeida codecov-io


text:
Added order_by() to SqlaTable to ensure alphabetically ordered filter options values.

Added order_by(column_name) to SqlaTable model to ensure correctly ordered value choices in filter controls.

I feel like this should be done on the backend. From my experience it's been sorted, I'm guessing the SELECT DISTINCT will often do this, though it's not guaranteed. What backend do you use?

We should add an .order here:
https://github.com/apache/incubator-superset/blob/master/superset/connectors/sqla/models.py#L396
and get the database to do the work.

Well, in terms of database in use, I just popped open the dev setup. Non-alphabetical values can be spotted by setting up a dev environment using the test data as per the documentation.
A good example would be the response of http://localhost:8088/superset/filter/table/2/country_code/, where "DZA" is popped in there with the A's.
I rolled back the client side array sort and instead added an order_by() as suggested.
This is also a valid solution 👍

Codecov Report

Merging #4712 into master will increase coverage by 0.41%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #4712      +/-   ##
==========================================
+ Coverage   71.87%   72.29%   +0.41%
==========================================
  Files         204      208       +4
  Lines       15323    15522     +199
  Branches     1177     1202      +25
==========================================
+ Hits        11014    11222     +208
+ Misses       4306     4297       -9
  Partials        3        3

Impacted Files
Coverage Δ

superset/connectors/sqla/models.py
77.08% <ø> (-0.21%)
:arrow_down:

...ipts/explore/components/controls/FilterControl.jsx
97.29% <100%> (ø)
:arrow_up:

superset/assets/javascripts/modules/sandbox.js
93.75% <0%> (-6.25%)
:arrow_down:

...explore/components/controls/SelectAsyncControl.jsx
63.15% <0%> (-1.55%)
:arrow_down:

...s/javascripts/explore/components/ControlHeader.jsx
73.52% <0%> (-1.48%)
:arrow_down:

...set/assets/javascripts/explore/stores/controls.jsx
38.02% <0%> (-1.24%)
:arrow_down:

superset/viz.py
78.41% <0%> (-1.21%)
:arrow_down:

superset/dataframe.py
97.7% <0%> (-1.05%)
:arrow_down:

superset/cli.py
46.83% <0%> (-0.91%)
:arrow_down:

...javascripts/SqlLab/components/AceEditorWrapper.jsx
76.05% <0%> (-0.42%)
:arrow_down:

... and 30 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 68dec24...bdb540e. Read the comment docs.

authors: JeppeSigaard codecov-io mistercrunch


text:
[bugfix] fix timegrain addon regression

CATEGORY

[x] Bug Fix
[ ] Enhancement (new features, refinement)
[x] Refactor
[x] Add tests
[ ] Build / Development Environment
[ ] Documentation

SUMMARY
Custom timegrains defined in superset_config.py stopped working between 0.32 and 0.34. This fixes the regression and renames some functions and variables to more clearly indicate what is public and private. The tests were also lacking, as they only tested private methods, not the actual end result of making changes to the config file. Now both blacklisted and addon grains are tested properly.
BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TEST PLAN
Local testing + CI
ADDITIONAL INFORMATION

[ ] Has associated issue: Closes #8162
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

REVIEWERS
@lilila @mistercrunch

Codecov Report

Merging #8165 into master will increase coverage by 7.7%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           master    #8165      +/-   ##
==========================================
+ Coverage   66.06%   73.76%    +7.7%
==========================================
  Files         479      115     -364
  Lines       22930    12057   -10873
  Branches     2524        0    -2524
==========================================
- Hits        15148     8894    -6254
+ Misses       7648     3163    -4485
+ Partials      134        0     -134

Impacted Files
Coverage Δ

superset/db_engine_specs/bigquery.py
52.23% <100%> (ø)
:arrow_up:

superset/db_engine_specs/presto.py
77.8% <100%> (ø)
:arrow_up:

superset/db_engine_specs/drill.py
54.16% <100%> (ø)
:arrow_up:

superset/db_engine_specs/kylin.py
53.84% <100%> (ø)
:arrow_up:

superset/db_engine_specs/db2.py
85.71% <100%> (ø)
:arrow_up:

superset/db_engine_specs/teradata.py
88.88% <100%> (ø)
:arrow_up:

superset/db_engine_specs/athena.py
57.89% <100%> (ø)
:arrow_up:

superset/db_engine_specs/druid.py
100% <100%> (ø)
:arrow_up:

superset/db_engine_specs/impala.py
65% <100%> (ø)
:arrow_up:

superset/db_engine_specs/snowflake.py
59.09% <100%> (ø)
:arrow_up:

... and 375 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ee24539...2609c3b. Read the comment docs.

This should be ready for review.

Thank you @villebro , it works well (at least for mysql db)

authors: codecov-io lilila villebro


text:
[WIP] Add sql query to cache_key

CATEGORY
Choose one

[x] Bug Fix
[ ] Enhancement (new features, refinement)
[ ] Refactor
[ ] Add tests
[ ] Build / Development Environment
[ ] Documentation

SUMMARY
When changing the SQL query in a datasource, the cache key doesn't reflect this change, as only the datasource id is added to the cache key. This PR adds the sql property of the datasource to the dict on which cache_key is based.
While this fixes the problem for SQL "views", this doesn't address other potential changes in the datasource, e.g. changes in expressions. An alternative approach would be to add the changed_on value from the datasource, which would change the cache key every time the datasource is updated. By doing so we would not need to add all properties that need change checking from the datasource to the cache key; however, it might result in unnecessary cache misses if minor changes to the datasource are done regularly.
TEST PLAN
Tested locally by replicating the problem in the issue, and ensuring that the bug goes away with this diff. Unit tests to be added once we decide how to handle change tracking of datasource properties.
ADDITIONAL INFORMATION

[ ] Has associated issue: closes #8898
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

REVIEWERS
@durchgedreht

Codecov Report

Merging #8901 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #8901   +/-   ##
=======================================
  Coverage   58.97%   58.97%
=======================================
  Files         359      359
  Lines       11333    11333
  Branches     2787     2787
=======================================
  Hits         6684     6684
  Misses       4471     4471
  Partials      178      178

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 191aca1...7713e08. Read the comment docs.

Thanks for this @villebro! My recommendation would be to go with the changed_on timestamp instead of the sql column. As you mention, Datasources define a number of different things that could affect cache behavior or results. Causing cache misses on every Datasource update feels more future-proof, as this logic won't need to change every time Datasource behavior changes. We may cause some unnecessary cache misses, but I think we should lean in the direction of ensuring correctness first and thinking about performance second.

Thanks for chiming in @willbarrett ; personally I also started leaning towards using changed_on instead of all potentially interesting attributes. I'll update the PR to reflect this. It would be valuable to hear if large deployments of Superset are using large scale automated metadata refreshes of existing datasources, and if this might cause unnecessary cache misses. @john-bodley @etr2460 @betodealmeida any feedback would be valuable to understand if this would be a blocker in your deployments?

As there doesn't seem to be any objections to adding changed_on to cache_key, I'll try to finalize this in the coming days.

FYI working on this fix+unit tests surfaced some other issues I will be addressing with this PR, i.e. will take slightly longer to complete than anticipated.

This is ready for review.

@villebro do you think there is merit in adding a line item to UPDATING.md to mention that this PR will invalidate the entire cache given that the hashing logic has changed?

@john-bodley oh absolutely, good idea. Will add a note in UPDATING.

authors: codecov-io john-bodley villebro willbarrett


text:
[TARGET] Add layout_transform, clip and expand_dims in onnx converter

This PR adds support for more operator support in onnx converter.
New operator added:

layout_transform
clip
expand_dims

Thanks for contributing to TVM!   Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from Reviewers by @ them in the pull request thread.

@zxy844288792 can you re-trigger CI? It seems I cannot merge it

Thanks @zxy844288792 @leandron @comaniac @junrushao1994

repo: apache/incubator-tvm


text:
[Bug] Duplicate blockId causes shuffle Server network to be full.

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Search before asking

[X] I have searched in the issues and found no similar issues.

Describe the bug
In Netty mode, if BlockId is duplicated, GetInMemoryShuffleData loops through the same BlockId, causing the single Shuffle Server machine network to be full and the Spark Application to be jammed.
The following is a log of reading the duplicate BlockId：

Affects Version(s)
0.10.0
Uniffle Server Log Output
No response
Uniffle Engine Log Output
No response
Uniffle Server Configurations
No response
Uniffle Engine Configurations
No response
Additional context
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

@zuston @jerqi @maobaolong PATL.

@zuston @maobaolong @jerqi @xianjingfeng Have you encountered this problem when using it?

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

BlockId should guanratee not change the order.

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

BlockId should guanratee not change the order.

I can't figure out what caused BlockId to repeat, I thought it was a client timeout at first, but I checked all the logs and there was no timeout.

@lwllvyb Is it similar with our issue?

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

You can try ShuffleBufferWithSkipList

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

BlockId should guanratee not change the order.

Using LinkedHashSet ensures both de-duplication and order.

In ShuffleServer,using ShuffleBufferWithLinkedList, Should the ShuffleBufferWithLinkedList class List Change to Set?

BlockId should guanratee not change the order.

Using LinkedHashSet ensures both de-duplication and order.

Could you paste some more information about this? If it can ensure them, it's ok.

Hash table and linked list implementation of the Set interface, with predictable iteration order. This implementation differs from HashSet in that it maintains a doubly-linked list running through all of its entries. This linked list defines the iteration ordering, which is the order in which elements were inserted into the set (insertion-order). Note that insertion order is not affected if an element is re-inserted into the set. (An element e is reinserted into a set s if s.add(e) is invoked when s.contains(e) would return true immediately prior to the invocation.)
https://docs.oracle.com/javase/8/docs/api/java/util/LinkedHashSet.html

authors: jerqi maobaolong xianjingfeng yl09099

repo: apache/incubator-uniffle


text:
Assign partition again if registerShuffleServers failed

What changes were proposed in this pull request?

Assign partition again if registerShuffleServers failed
Why are the changes needed?

If registerShuffleServers failed, task will fail and then application will failed
Does this PR introduce any user-facing change?

No
How was this patch tested?

Already added

We also support mr client, could we also support the feature in the mr client?
Could you add a integration-test case?

Codecov Report

Merging #115 (5d87435) into master (deb7fe4) will decrease coverage by 0.79%.
The diff coverage is 71.42%.

@@             Coverage Diff              @@
##             master     #115      +/-   ##
============================================
- Coverage     56.52%   55.73%   -0.80%
+ Complexity     1183     1115      -68
============================================
  Files           149      141       -8
  Lines          8019     7665     -354
  Branches        767      739      -28
============================================
- Hits           4533     4272     -261
+ Misses         3242     3156      -86
+ Partials        244      237       -7

Impacted Files
Coverage Δ

...ava/org/apache/uniffle/common/util/RetryUtils.java
71.42% <71.42%> (ø)

...storage/handler/impl/DataSkippableReadHandler.java
81.25% <0.00%> (-3.13%)
:arrow_down:

...e/uniffle/server/storage/SingleStorageManager.java
65.57% <0.00%> (-1.64%)
:arrow_down:

.../apache/uniffle/coordinator/ClientConfManager.java
91.54% <0.00%> (-1.41%)
:arrow_down:

...ava/org/apache/spark/shuffle/RssShuffleHandle.java

...org/apache/spark/shuffle/writer/AddBlockEvent.java

.../java/org/apache/spark/shuffle/RssSparkConfig.java

...pache/spark/shuffle/writer/WriteBufferManager.java

.../org/apache/spark/shuffle/writer/WriterBuffer.java

...k/shuffle/writer/WrappedByteArrayOutputStream.java

... and 4 more

Help us with your feedback. Take ten seconds to tell us how you rate us.

Could you add a integration-test case?

I don't know how to write this ut, it is difficult to stop shuffle server when registerShuffleServers.Do you have a good idea?

You can follow the steps:

assign shuffle server for clients
stop the shuffle server
register shuffle servers
retry and assign other servers.
You can see https://github.com/apache/incubator-uniffle/blob/351275d532bdf61e12bd4efd3f8f8a68b091c67d/integration-test/common/src/test/java/org/apache/uniffle/test/ShuffleWithRssClientTest.java#L144

authors: codecov-commenter jerqi xianjingfeng


text:
用了weex被AppStore下架了

2018年11月27日 上午8:04
发件人 Apple
Hello,
We are writing to let you know about new information regarding your app currently live on the App Store.
Upon re-evaluation, we found that your app is not in compliance with the App Store Review Guidelines. Specifically, we found:
Performance - 2.5.2
Your app, extension, or linked framework appears to contain code designed explicitly with the capability to change your app’s behavior or functionality after App Review approval, which is not in compliance with App Store Review Guideline 2.5.2 and section 3.3.2 of the Apple Developer Program License Agreement.
For this reason, your app will be removed from sale on the App Store at this time.
Deliberate disregard of the App Store Review Guidelines and attempts to deceive users or undermine the review process are unacceptable and is a direct violation Section 3.2(f) of the Apple Developer Program License Agreement. Continuing to violate the Terms & Conditions of the Apple Developer Program will result in the termination of your account, as well as any related or linked accounts, and the removal of all your associated apps from the App Store.
Future submissions of this app may require a longer review time, and this app will not be eligible for an expedited review.
If you have any questions about this information, please reply to this message to let us know.
Best regards,
App Store Review
使用了weex动态分发页面，被下架了，有遇到相同情况的吗？

Do you still have other dynamic fixes? Like js patch? Weex did not appear to be removed

你们最近有发布改动非常大的页面吗？应用都上架了，怎么会被苹果发现？

Do you still have other dynamic fixes? Like js patch? Weex did not appear to be removed

we app not used JSPatch. only use weex

可以给苹果回复邮件，说明自己的App并没有在应用审核后，利用任何动态能力修改应用行为。言辞一定要肯定。

如果有问题可以留一下电话，详细沟通一下。

可以给苹果回复邮件，说明自己的App并没有在应用审核后，利用任何动态能力修改应用行为。言辞一定要肯定。

已经上架将近1个月的时间了，最近突然被下架了，可能是因为苹果的复查机制

What are you App? @Luis-X

你们最近有发布改动非常大的页面吗？应用都上架了，怎么会被苹果发现？

如果有问题可以留一下电话，详细沟通一下。

参考一下这边文章：   https://www.sohu.com/a/246858026_100180134

你们最近有发布改动非常大的页面吗？应用都上架了，怎么会被苹果发现？

如果有问题可以留一下电话，详细沟通一下。

参考一下这边文章： https://www.sohu.com/a/246858026_100180134

狗年大礼包和我这问题没啥太大关系啊

涉及该开发者两个App，与苹果沟通后，其中已经已经恢复上架，另一个正在等待中。Weex团队会继续关注此问题，随时沟通，该Issue先关闭。

authors: Luis-X TenzeTseng wqyfavor zshshr

repo: apache/incubator-weex


text:
Show IDs in lens

Closes #2507

can you update the image?

Sorry, I don't know what should I update 🤔

oh when asked we thought maybe best to always show ids in light font (not bold) instead of clicking button

Can I ask for the reason of displaying it inline instead of a list? Not a
UI expert but feels not natural to me (personal opinion).
fre. 19. apr. 2019, 10:37 skrev Adrian Cole notifications@github.com:

oh when asked we thought maybe best to always show ids in light font (not
bold) instead of clicking button
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-zipkin/pull/2518#issuecomment-484810681,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAXOYAWPUHIJ32PN7ZSO4Y3PRGAFHANCNFSM4HHCA33Q
.

about same line is less space taken. in the new ui we can compare spans
with another but real estate is a problem. one id per line makes this worse
especially as almost no one will want the parent id

:+1: makes totally sense.
fre. 19. apr. 2019, 10:51 skrev Adrian Cole notifications@github.com:

about same line is less space taken. in the new ui we can compare spans
with another but real estate is a problem. one id per line makes this worse
especially as almost no one will want the parent id
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-zipkin/pull/2518#issuecomment-484814689,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAXOYASIGCHLY2YQJ6KUBHLPRGBYRANCNFSM4HHCA33Q
.

Ah, I see.
Sorry, I thought that you said only we should use light font (Above image uses light font already).
As you said, id info are unnecessary for many users, so I think it is not bad to hide them by default.
What do you think?

I meant to say no boxing only light font. no outline just very light font so looks almost invisible and not distracting. personally I think the "show ids" button is distracting vs ids mentioned in a light font with no boxing or bolding... single same font for name of id and value of it

Ah, I got it.
I'll do so.

Update!

authors: adriancole jcchavezs tacigar

repo: apache/incubator-zipkin


text:
[To rel/1.2] Pipe: fix some minor concurrent issues & collect pipe's logs into a separate file (#10990)

Pipe: fix some minor concurrent issues

Logback: seperate pipe's logs

enabled -> enable

Update IoTDBConfig.java

(cherry picked from commit 1357cede80d67a8ecc0d8db75f629efd00d1f69d)

coverage: 47.679% (+0.004%) from 47.675% when pulling b65ee8781b4172a5dd854855594cd91e374e63f6 on pipe-con-fix into 2b8c1b46fc775925d007b5f83915e3047cb7aad6 on rel/1.2.

authors: SteveYurongSu coveralls

repo: apache/iotdb


text:
Fix concurrent bug in PartitonCache

more details can be seen in https://jira.infra.timecho.com:8443/browse/TIMECHODB-447
we can find that if the cache is cleared between these two line, we will try to create an already existing database.

Codecov Report
Attention: 5 lines in your changes are missing coverage. Please review.

Comparison is base (b5214cb) 49.00% compared to head (65363a3) 49.00%.
Report is 2 commits behind head on master.

Files
Patch %
Lines

...e/plan/analyze/cache/partition/PartitionCache.java
0.00%
5 Missing :warning:

Additional details and impacted files
@@            Coverage Diff            @@
##             master   #11622   +/-   ##
=========================================
  Coverage     49.00%   49.00%
- Complexity    24883    24890    +7
=========================================
  Files          2810     2810
  Lines        175991   175991
  Branches      21116    21116
=========================================
+ Hits          86250    86251    +1
+ Misses        89741    89740    -1

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


text:
[IOTDB-1132] username, password and rolename shouldn't contain spaces

Description
We need to check the spaces and throw the exception to match the description on our user guide.

This PR has:

[ ] been self-reviewed.

[ ] concurrent read
[ ] concurrent write
[ ] concurrent read and write

[ ] added documentation for new or modified features or behaviors.
[ ] added Javadocs for most classes and all non-trivial methods.
[ ] added or updated version, license, or notice information
[ ] added comments explaining the "why" and the intent of the code wherever would not be obvious
for an unfamiliar reader.
[x] added unit tests or modified existing tests to cover new code paths, ensuring the threshold
for code coverage.
[ ] added integration tests.
[ ] been tested in a test IoTDB cluster.

Key changed/added classes (or packages if there are too many classes) in this PR


text:
[IOTDB-1540] [To rel/0.12] Bug Fix: 500 when using IN operator

Does master have this bug?

Does master have this bug?

I will cherry-pick to master.

Merge the latest rel/0.12? The CI has been fixed.


text:
[IOTDB-2249] Fix query NPE when an aligned column with duplicated time is deleted

Description
See IOTDB-2249 .

Coverage decreased (-0.006%) to 67.448% when pulling e03033b06670241950b6ef485abc9400f05934eb on iotdb_2249 into 010af34dda85847b249775f7241e06594a740b9f on master.

authors: HTHou coveralls


text:
KAFKA-12476: Prevent herder tick thread from sleeping excessively after slow operations

The current method of computing the member poll duration does not take into account the time spent on connector operations in tick(), which may be significant. This can cause a worker to sleep for longer than intended, and miss execution of background operations such as retries, REST calls, cooperative rebalance delays, and internal signing key rotations.
Instead, the computation should measure the system time at the end of tick() and use that for computing the time to the next background operation.
In addition to the title change, add a repro test which fails when the patch is not applied, and refactor the DistributedHerderTest with more accurate expectations for background operations being queued and task configurations being generated.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Thanks @gharris1727; just one comment left RE the expectQueueHerderOperation and then this should be good to go.

repo: apache/kafka


text:
KAFKA-15235: No test coverage reports for Java due to settings for Jacoco being incompatible with Gradle 8.x

Fixing the Jacoco report generation issue, in the current Gradle version 8.x
Committer Checklist (excluded from commit message)

[x] Verify design and implementation
[ ] Verify test coverage and CI build status
[x] Verify documentation (including upgrade notes)

Please add how did you test this and the before/after results. Thanks!

@divijvaidya  Before those changes, the generation of tests jacoco coverage report fails because of this error
"Could not set unknown property 'enabled' for Report html of type org.gradle.api.reporting.internal.TaskGeneratedSingleDirectoryReport"
With the related changes, the generation of the coverage reports works and the reports (xml and html) are well generated in  build/reports/jacoco/test/html/index.html and build/reports/jacoco/test/jacocoTestReport.xml  paths

Test failures are not related. Merging this one. Nice catch @bmscomp! I am surprised that this wasn't caught earlier. I will also backport this to 3.5.

authors: bmscomp divijvaidya


text:
KAFKA-16223 Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest (1/3)

This is the last remaining Kafka Connect test that needs migration from PowerMock/EasyMock to Mockito.
Following the same approach as the WorkerSinkTaskTest migration, which was migrated in 1 2 3 separate batches, this PR contains just ~ 1/3 of the total number of test methods, which should make the review "easier".
As usual, I Iook forward for your comments and feedback @C0urante @gharris1727 @divijvaidya @clolov @mukkachaitanya
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Test failures appear unrelated, and the connect runtime tests pass locally.


text:
KAFKA-16855 : Based on tiered state of topic, check for tasks

Resolves https://issues.apache.org/jira/browse/KAFKA-16855
Based on the comments from jira :
Replaying a TopicRecord

If a topic has tiering enabled then it should have both copy and expire tasks
If a topic doesn't have tiering enabled then it should have only expire tasks

Records are replayed in ReplicaManager#applyDelta
Committer Checklist (excluded from commit message)

[X] Verify design and implementation
[X] Verify test coverage and CI build status
[X] Verify documentation (including upgrade notes)

@clolov @showuon
Can you pls take a look at this draft pr if this approach makes any sense.

From the KIP-950, when user changes remote.storage.enable to false, we should do:

The controller creates a ConfigRecord and persists it in the metadata topic. (this is done in current KRaft)
The controller creates a TopicRecord to increment the tiered_epoch and update the tiered_state to DISABLED state. (this should be added)
Broker detects the configuration change, it calls the ConfigHandler to process the ConfigRecord change with tiered storage disablement. (this is done in current KRaft)
The broker ConfigHandler calls RemoteLogManager#stopPartitions(). (this should be added)
Execution of RemoteLogManager#stopPartitions(): (this should be added)
5.1. Removes the scheduled tasks for the topic-partition from the thread pool responsible for archiving logs to remote storage.
5.2. If the disablement policy is set to delete, the Log start offset (LSO) is updated to match the Local Log Start Offset and the remote log is deleted by calling the RemoteStorageManager#deleteLogSegmentData().
5.3. If the disablement policy is set to retain, there is no extra call required to delete remote data as the RemoteLogManager leader partition task will periodically expire segments that are earlier than the log start offset.

I didn't see we do anything based on the KIP description. Could you let me know why? And how we should continue?

@clolov , do you have POC for KRaft implementation? If no, please let me know. I might need some time to implement it.

@muralibasani @kamalcph @clolov , I've created a drafted PR to demonstrate my thought about this task. Please take a look. Thanks.

@muralibasani @kamalcph @clolov , I've created a drafted PR to demonstrate my thought about this task. Please take a look. Thanks.

@showuon Thanks a million. That really helps. Will look into it.

I'm not clear what this PR does. @muralibasani Could you please write a summary about the changes made? Thanks!

I'm not clear what this PR does. @muralibasani Could you please write a summary about the changes made? Thanks!

@kamalcph I apologize for the confusion. I have now updated the summary. It's based on the comments from @clolov in jira.
However, am not sure if this is everything expected from this ticket. Waiting for Chris to take another look.

Based on the recent conversations on the other related PR, I assume this PR is not required anymore ?

Based on the recent conversations on the other related PR, I assume this PR is not required anymore ?

Correct. Thanks for your contribution @muralibasani !

authors: kamalcph muralibasani showuon


text:
KAFKA-17067; Fix KRaft transition to CandidateState

Only voters should be able to transition to Candidate state.
This removes VotedState as one of the EpochStates and moves voted information into a subclass (VotedState) of UnattachedState. While the subclass isn't necessary, I felt it is clean enough and allows us to continue to refer to voted information as "voted state" and retain some familiar semantics (e.g. transitionToVoted -> addVotedState).
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Updated title to trigger a new build.


text:
KAFKA-16907: Fix RaftUtil's type complexity

JIRA: KAFKA-16907
This PR aims to fix the ClassDataAbstractionCoupling and ClassFanOutComplexity issues in RaftUtils.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

Will fix conflicts after 3.9 RC

Hi @jsancio,
Could you please take a look at this PR when you have some time?
Many thanks! 😺

Hi @chia7712
Could you please take a look?
Many thanks 😺


text:
KAFKA-5056: Add shuffling of FetchRequest requestInfo back to old consumer

KIP-74 removed the shuffle of requestInfo from the FetchRequest constructor, moving the logic to the replica fetcher and new consumer API. This adds a shuffle back to the old consumer that uses the same logic as the deprecated constructor.

Thanks for the PR. A couple of things:

The round robin logic was added to AbstractFetcherThread so that it would be used by both ReplicaFetcherThread and ConsumerFetcherThread. Are you saying that this doesn't work for some reason?

There was no shuffling before KIP-74, but it wasn't needed because there was no request level max bytes, so all partitions with data would be returned.

Closing since the old consumer was removed from the codebase.

authors: hachikuji ijuma toddpalino


text:
KAFKA-2718: Avoid reusing temporary directories in core unit tests

Retry to find new directory and cleanup on exit.

Thanks @rajinisivaram. @guozhangwang, could you please review this? We are getting a number of failures that seem related to this issue.

This is great. LGTM.
I think we can close https://issues.apache.org/jira/browse/KAFKA-2853 as well with this fix.

Sounds good @guozhangwang

Retry to find new directory and cleanup on exit.

authors: b-goyal guozhangwang ijuma rajinisivaram


text:
Support custom s3 endpoint

Feature Request
Do you support or plan to support custom s3 endpoint? So that we can use providers like minio/ceph-s3

We already have a bunch of drivers which are based on the S3 API (Google Cloud Storage, Aurora Objects, DigitalOcean Spaces, etc.) so it probably shouldn't be too hard to add a new S3 based provider driver for ceph-s3.

@puneetloya @Kami any news regarding this issue? I need to use cassandra medusa which uses libcloud storage on a minio object storage

@DrissiReda As per my comment above - I don't think it should take much work for to add support for custom endpoints as we already have other drivers such as Google Storage based on the S3 one.
I don't have access to any minio cluster to test it myself though. I guess I could try spinning it on minikube, but no idea when I'll get a chance to do that.

#1528.
I've used MinIO docker image to test it. I haven't done any extensive testing, but the basic operations I tested seem to work fine.

authors: DrissiReda Kami puneetloya

repo: apache/libcloud