text:
Help with parallel request

Any idea in how to handle Mixpanel::HTTPError: too many export requests in progress for this project while making parallel requests?
I'm using the last version of mix panel_client
Backtrace
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/mixpanel_client-4.1.6/lib/mixpanel/client.rb:130:in `block in prepare_parallel_request'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/request/callbacks.rb:129:in `call'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/request/callbacks.rb:129:in `block in execute_callbacks'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/request/callbacks.rb:128:in `map'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/request/callbacks.rb:128:in `execute_callbacks'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/request/operations.rb:35:in `finish'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/easy_factory.rb:105:in `block in set_callback'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/easy/response_callbacks.rb:65:in `call'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/easy/response_callbacks.rb:65:in `block in complete'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/easy/response_callbacks.rb:65:in `each'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/easy/response_callbacks.rb:65:in `complete'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/multi/operations.rb:148:in `check'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/multi/operations.rb:161:in `run'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/ethon-0.6.3/lib/ethon/multi/operations.rb:43:in `perform'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/hydra/runnable.rb:21:in `run'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/typhoeus-0.6.7/lib/typhoeus/hydra/memoizable.rb:51:in `run'
	from /Users/ruben/.rvm/gems/ruby-1.9.3-p547/gems/mixpanel_client-4.1.6/lib/mixpanel/client.rb:139:in `run_parallel_requests'

Sounds like there's some export data api limit. Maybe you could throttle the number of requests you're sending at a time or use a background job with exponential backoff (to retry failed requests)?


text:
Link overriding heading color

Is your feature request related to a problem? Please describe.
Using "Colorful headings" under "Features" in the minimal theme settings overrides the color for headings to orange. This is an issue as H3 headings (Amber colored) can be mistaken for H2 headings (orange colored) when this override of color occurs.
Screenshots

If it's of any help then I am using the Gruvbox color scheme
Describe the solution you'd like
I can think of 2 solutions:

Changing the color prioritory from links to headings.
Add a setting which allows an individual to choose which gets prioritory.

This is not really an issue as much as personal preference. Consider turning off colorful headings and using Style Settings to adjust your preferences for heading and link colors

That is the intended behavior. If you want to override it you would need to do it via a CSS snippet.

source: gharchive/issue

repo: kepano/obsidian-minimal-settings

license: MIT

license_type: permissive

license_source: github-api


text:
Problem with "Focus mode" and Obsidian Tabs plugin

Is the bug present when using the default Obsidian theme?
No
Is the bug present when snippets and plugins are disabled?
Yes
Minimal theme version
5.3.1
Describe the bug
First of all "Focus mode" is an amazing feature, but when used with Obsidian tabs plugin I can't no more know what tabs to look for because title is hidden. Here's an example:

Focus mode off

Focus mode on

As you can see if I want to change tab it's impossible to know which one it's the one I'm looking for. It would be nice to have the option to apply focus mode to everything but notes title or to hide notes title only on current note if there are multiple notes open.
Focus mode makes the use of obsidian much more pleasant and this is the only thing that's buggin me, hope I've explain the issue in a good way.
Thank's for your time and your contribution on here.
Debug info
SYSTEM INFO:
Obsidian version: v0.15.6
Installer version: v0.14.15
Operating system: Darwin Kernel Version 21.5.0: Tue Apr 26 21:08:29 PDT 2022; root:xnu-8020.121.3~4/RELEASE_ARM64_T8101 21.5.0
Login status: not logged in
Insider build toggle: off
Live preview: on
Legacy editor: off
Base theme: dark
Community theme: Minimal
Snippets enabled: 1
Safe mode: off
Plugins installed: 23
Plugins enabled: 23
1: Style Settings
2: File path to URI
3: Image Toolkit
4: Clear Unused Images
5: Paste URL into selection
6: Wikilinks to MDLinks
7: Highlightr
8: Hider
9: Zoom
10: Obsidian Tabs
11: Typewriter Scroll
12: Underline
13: Minimal Theme Settings
14: Natural Language Dates
15: Media Extended
16: Waypoint
17: Advanced Tables
18: Templater
19: Kindle Highlights
20: Dataview
21: Calendar
22: Cycle through Panes
23: Hotkeys for starred files and searches
RECOMMENDATIONS:
Custom theme: for cosmetic issues, please first try updating your theme to latest. If still not fixed, please try to make the issue happen in the Sandbox Vault or disable community theme and snippets.
Community plugins: for bugs, please first try updating all your plugins to latest. If still not fixed, please try to make the issue happen in the Sandbox Vault or disable community plugins.

This will probably not get fixed because the next version of Obsidian will include tabs natively

Well, good to know then!!! Thank's :)

authors: ironhak kepano

repo: kepano/obsidian-minimal


text:
MongoDB Connections: Deal with potential replica lags in mongodb

When using a mongodb replica set with multiple replicas the situation can occur where, if an entry is written to the database and read shortly after, it may not be availlable yet for the reader. That is because e.g. AWS DocumentDB has a potential replica lag of ~50-100ms (see https://docs.aws.amazon.com/documentdb/latest/developerguide/replication.html).
To tackle this, we should check where we can adapt our code to avoid situations where an entry that is written to the DB is read immediately afterwards, if possible. Also, to reduce the risk of this problem, mongodb provides the option of specifying WriteConcerns (https://docs.mongodb.com/manual/reference/write-concern/). In our scenario, the majority WriteConcern may be a reasonable option. In the mongo-go-driver, this can be set as follows:
m.Client, err = mongo.NewClient(options.Client().ApplyURI(connectionString).SetWriteConcern(writeconcern.New(writeconcern.WMajority())))

We could also consider using the writeConcern timeout option as a helm value parameter with a default of 30s.
This also impact the Bridge in storing/retrieving data for OAuth authentication.
Acceptance Criteria

[ ] Helm value to configure the timeout - defaults 30s
[x] MongoDatastore has the documentation updated
[ ] The writeconcerns are implemented in both core

Documentation
https://docs.aws.amazon.com/documentdb/latest/developerguide/transactions.html#transactions-isolation-level
https://docs.aws.amazon.com/documentdb/latest/developerguide/how-it-works.html#durability-consistency-isolation.read-consistency
https://docs.mongodb.com/manual/reference/write-concern/

According to the discussion inside the keptn-core team, we decided not to implement this feature. The reason is, that it does not make any sense to enable these options on the default installation, which runs only one replica of mongoDB. When running multiple replicas on a system with externally hosted MongoDB, there is a poccibility and also recommendation to enable any kinds of options by setting the external mongoDB connection string, as it is (will be) described in the docs[1]
PR for docs update available here [2].
[1] https://keptn.sh/docs/0.14.x/operate/advanced_install_options/#install-keptn-with-externally-hosted-mongodb
[2] https://github.com/keptn/keptn.github.io/pull/1215

authors: bacherfl odubajDT

repo: keptn/keptn


text:
“Only one input size may be -1, not both 0 and 2” error in Keras

This is summary of my model.

My model is basically similar to a convolution network.
I want my model to work regardless of the width of the input. So the width size appears as None.
and I want to attach a decoder to my model. However, when I attach the decoder, an error occurs. (If I don't attach the decoder, the program works fine)
This part is my decoder part (below)
if args.decoder==True:

    decoder = ConvCapsuleLayer(kernel_size=args.kernel_size, num_capsule=4, num_atoms=1, strides=1, padding='same',
                                  routings=0)(conv_cap)

    _, H, W, C, A = decoder.get_shape()

    y = layers.Input(shape=(n_class,))
    masked_by_y = Mask()([decoder, y])
    masked = Mask()(decoder)

    def shared_decoder(mask_layer):

        recon_1 = layers.Conv2DTranspose(4, (5,5), strides=(2, 2), padding='same',  kernel_initializer='he_normal', name='decoder_1', activation='relu')(mask_layer)
        recon_2 = layers.Conv2DTranspose(8, (5,5), strides=(2, 2), padding='same',  kernel_initializer='he_normal', name='decoder_2', activation='relu')(recon_1)
        recon_3 = layers.Conv2DTranspose(1, (1,1), strides=(1, 1), padding='same',  kernel_initializer='he_normal', name='decoder_3', activation='linear')(recon_2)
        return recon_3

if args.decoder==True:
    train_model = models.Model(inputs=[x, y], outputs=[out_seg, shared_decoder(masked_by_y)]) # [x:image,y: mask] // [out_seg:length, reconstruction output]
    eval_model = models.Model(x, [out_seg, shared_decoder(masked)])
else:
    train_model = models.Model(inputs=x, outputs=out_seg)
    eval_model = models.Model(inputs=x, outputs=out_seg)
return train_model, train_model

mask_1 is my Mask layer.
If a label is given, only the channel of the label is returned. (masked_by_y)
If a label is not given, this layer only returns channel with the largest sum of the element values in conv_capsule_layer_1. (masked)
The shape of conv_capsule_layer_1 is (batch_size = None, height = 50, width = None, num_channel = 4, 1)
That is, the mask layer returns a channel having the largest sum of the element values among the four channels.
Then, use Conv2DTranspose to make it equal to the size of the original input using the returned value (output of mask layer).
However, the following error occurs.

InvalidArgumentError (see above for traceback): Only one input size may be -1, not both 0 and 2 [[Node: mask_1/Reshape_1 = Reshape[T=DT_FLOAT, Tshape=DT_INT32, _device="/job:localhost/replica:0/task:0/device:CPU:0"](mask_1/boolean_mask/Gather, mask_1/Reshape_1/shape)]]

How can I make the length variable not using -1? I already tried that non_zero_masked = K.reshape(non_zero,[-1, masked.shape[1], masked.shaped[2],1])
This is function name is call in my Mask layer
    def call(self, inputs, **kwargs):
    if type(inputs) is list:  # true label is provided with shape = [None, n_classes], i.e. one-hot code.
        assert len(inputs) == 2
        inputs, mask = inputs
        inputs = K.squeeze(inputs, axis=-1) # [batch, input_height, input_width, num_cap, num_atom] -> [batch, input_height, input_width, num_cap]
    else:  # if no true label, mask by the max length of capsules. Mainly used for prediction

        inputs = K.squeeze(inputs, axis=-1) #[batch, input_height, input_width, num_cap]
        x = K.softmax(K.sqrt(K.sum(K.square(inputs), axis=(1,2)) + K.epsilon())) # x: [batch, 4]
        mask = K.one_hot(indices=K.argmax(x, 1), num_classes=x.get_shape().as_list()[1]) # mask: [batch,4]

    expand_mask = K.reshape(mask,[-1,1,1,mask.shape[1]]) #[batch_size, 1, 1, num_class]
    masked = inputs*expand_mask
    non_zero = tf.boolean_mask(masked, tf.not_equal(masked,0))
    non_zero_masked = K.reshape(non_zero,[-1, masked.shape[1], -1,1])
    return non_zero_masked

How can I solve it?

Please fill the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Along with the template, please provide as many details as possible to find the root cause of the issue. It would be great if you can provide a small code to reproduce the error. Thanks!

authors: jeonghwaYoo jvishnuvardhan

repo: keras-team/keras

license_source: bigquery


text:
ValueError: A target array with shape (180568, 80) was passed for an output of shape (None, 180568) while using as loss categorical_crossentropy. This loss expects targets to have the same shape as the output.

I am trying to implement a 1D  CNN from a network encrypted traffic classification and Intrusion detection dataset. Here is the snippet of my codes
# The next step is to split training and testing data. For this we will use sklearn function train_test_split().
features_train, features_test, labels_train, labels_test = train_test_split(features, labels, test_size=.2)

features_train.shape, features_test.shape, labels_train.shape, labels_test.shape

((180568, 80), (45143, 80), (180568,), (45143,))

# Here I'm assuming some dummy data
# Xtrain => [180568, 80, 1] (Note that you need Xtrain to be 3D not 2D - So we're adding a channel dimension of 1)
Xtrain = np.expand_dims(np.random.normal(size=(180568, 80)), axis=-1)
# Ytrain => [180568, 10]
Ytrain = np.random.choice([0,1], size=(180568, 80))

# check shape
Xtrain.shape, Ytrain.shape

((180568, 80, 1), (180568, 80))

n_timesteps, n_features, n_outputs = features_train.shape[0], features_train.shape[1], labels_train.shape[0]

model = Sequential()
model.add(Conv1D(filters=64, kernel_size=1, activation='relu',input_shape=(n_features, 1)))
model.add(Conv1D(filters=64, kernel_size=1, activation='relu'))
model.add(Dropout(0.5))
model.add(MaxPooling1D(pool_size=3))
model.add(Flatten())
model.add(Dense(80, activation='relu'))
model.add(Dense(n_outputs, activation='softmax'))

model.compile(loss='categorical_crossentropy', optimizer='adam', metrics=['accuracy'])

# fit network
model.fit(Xtrain, Ytrain, epochs=10, batch_size=10, verbose=0)

After I try to fit the model, i however get the following error.
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-101-da6e32acea16> in <module>
      1 # fit network
----> 2 model.fit(Xtrain, Ytrain, epochs=10, batch_size=10, verbose=0)

~/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_v1.py in fit(self, x, y, batch_size, epochs, verbose, callbacks, validation_split, validation_data, shuffle, class_weight, sample_weight, initial_epoch, steps_per_epoch, validation_steps, validation_freq, max_queue_size, workers, use_multiprocessing, **kwargs)
    783         max_queue_size=max_queue_size,
    784         workers=workers,
--> 785         use_multiprocessing=use_multiprocessing)
    786
    787   def evaluate(self,

~/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_arrays.py in fit(self, model, x, y, batch_size, epochs, verbose, callbacks, validation_split, validation_data, shuffle, class_weight, sample_weight, initial_epoch, steps_per_epoch, validation_steps, validation_freq, **kwargs)
    632         steps=steps_per_epoch,
    633         validation_split=validation_split,
--> 634         shuffle=shuffle)
    635
    636     if validation_data:

~/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_v1.py in _standardize_user_data(self, x, y, sample_weight, class_weight, batch_size, check_steps, steps_name, steps, validation_split, shuffle, extract_tensors_from_dataset)
   2306         is_dataset=is_dataset,
   2307         class_weight=class_weight,
-> 2308         batch_size=batch_size)
   2309
   2310   def _standardize_tensors(self, x, y, sample_weight, run_eagerly, dict_inputs,

~/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_v1.py in _standardize_tensors(self, x, y, sample_weight, run_eagerly, dict_inputs, is_dataset, class_weight, batch_size)
   2412           # Additional checks to avoid users mistakenly using improper loss fns.
   2413           training_utils.check_loss_and_target_compatibility(
-> 2414               y, self._feed_loss_fns, feed_output_shapes)
   2415
   2416       sample_weights, _, _ = training_utils.handle_partial_sample_weights(

~/anaconda3/lib/python3.7/site-packages/tensorflow/python/keras/engine/training_utils.py in check_loss_and_target_compatibility(targets, loss_fns, output_shapes)
    808           raise ValueError('A target array with shape ' + str(y.shape) +
    809                            ' was passed for an output of shape ' + str(shape) +
--> 810                            ' while using as loss `' + loss_name + '`. '
    811                            'This loss expects targets to have the same shape '
    812                            'as the output.')

ValueError: A target array with shape (180568, 80) was passed for an output of shape (None, 180568) while using as loss `categorical_crossentropy`. This loss expects targets to have the same shape as the output.

@jpandeinge
dimensions of Ytrain is not correct, try using Ytrain.shape=(180568,)

@jpandeinge
dimensions of Ytrain is not correct, try using Ytrain.shape=(180568,)

@yash-clear tried to change it as you suggested and it has been running for an hour now without any output

@yash-clear tried to change it as you suggested and it has been running for an hour now without any output

@jpandeinge
try this,
`import numpy as np
import tensorflow as tf
import pandas as pd
from tensorflow.keras import optimizers
from tensorflow.keras.preprocessing import sequence
from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense, Dropout, Activation, Conv1D, MaxPooling1D, Embedding,Flatten
from sklearn.model_selection import train_test_split
X_train = np.zeros((180568, 80, 1))
y_train = np.zeros((180568, 80))
n_timesteps, n_features, n_outputs =  X_train.shape[1], X_train.shape[2], y_train.shape[1]
n_samples = 1000
X = np.random.uniform(0,1, (n_samples, n_timesteps, n_features))
y = pd.get_dummies(np.random.randint(0,n_outputs, n_samples)).values
model = tf.keras.models.Sequential([
tf.keras.layers.Conv1D(input_shape=(n_timesteps, n_features), kernel_size=3, filters=16),
tf.keras.layers.GlobalAveragePooling1D(), # also GlobalMaxPooling1D() is ok
tf.keras.layers.Dense(256, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(n_outputs, activation='softmax')
])
model.compile('adam', 'categorical_crossentropy')
model.fit(X,y, epochs=2,verbose=1)
model.summary()`
output

@jpandeinge
try this,
`import numpy as np
import tensorflow as tf
import pandas as pd
from tensorflow.keras import optimizers
from tensorflow.keras.preprocessing import sequence
from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense, Dropout, Activation, Conv1D, MaxPooling1D, Embedding,Flatten
from sklearn.model_selection import train_test_split
X_train = np.zeros((180568, 80, 1))
y_train = np.zeros((180568, 80))
n_timesteps, n_features, n_outputs =  X_train.shape[1], X_train.shape[2], y_train.shape[1]
n_samples = 1000
X = np.random.uniform(0,1, (n_samples, n_timesteps, n_features))
y = pd.get_dummies(np.random.randint(0,n_outputs, n_samples)).values
model = tf.keras.models.Sequential([
tf.keras.layers.Conv1D(input_shape=(n_timesteps, n_features), kernel_size=3, filters=16),
tf.keras.layers.GlobalAveragePooling1D(), # also GlobalMaxPooling1D() is ok
tf.keras.layers.Dense(256, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(n_outputs, activation='softmax')
])
model.compile('adam', 'categorical_crossentropy')
model.fit(X,y, epochs=2,verbose=1)
model.summary()`
output

well I used GlobalAveragePooling1D() instead of MaxPooling1D which in turn  compresses the temporal dimension.

well I used GlobalAveragePooling1D() instead of MaxPooling1D which in turn  compresses the temporal dimension.

I want to make my first contribution ,tell me if it is ok then I will send pull request.

I want to make my first contribution ,tell me if it is ok then I will send pull request.

@jpandeinge
try this,
`import numpy as np
import tensorflow as tf
import pandas as pd
from tensorflow.keras import optimizers
from tensorflow.keras.preprocessing import sequence
from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense, Dropout, Activation, Conv1D, MaxPooling1D, Embedding,Flatten
from sklearn.model_selection import train_test_split
X_train = np.zeros((180568, 80, 1))
y_train = np.zeros((180568, 80))
n_timesteps, n_features, n_outputs = X_train.shape[1], X_train.shape[2], y_train.shape[1]
n_samples = 1000
X = np.random.uniform(0,1, (n_samples, n_timesteps, n_features))
y = pd.get_dummies(np.random.randint(0,n_outputs, n_samples)).values
model = tf.keras.models.Sequential([
tf.keras.layers.Conv1D(input_shape=(n_timesteps, n_features), kernel_size=3, filters=16),
tf.keras.layers.GlobalAveragePooling1D(), # also GlobalMaxPooling1D() is ok
tf.keras.layers.Dense(256, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(n_outputs, activation='softmax')
])
model.compile('adam', 'categorical_crossentropy')
model.fit(X,y, epochs=2,verbose=1)
model.summary()`
output

This is working and I really appreciate, just a few tweaks I need to do and shall be fine

@jpandeinge
try this,
`import numpy as np
import tensorflow as tf
import pandas as pd
from tensorflow.keras import optimizers
from tensorflow.keras.preprocessing import sequence
from tensorflow.keras.models import Sequential
from tensorflow.keras.layers import Dense, Dropout, Activation, Conv1D, MaxPooling1D, Embedding,Flatten
from sklearn.model_selection import train_test_split
X_train = np.zeros((180568, 80, 1))
y_train = np.zeros((180568, 80))
n_timesteps, n_features, n_outputs = X_train.shape[1], X_train.shape[2], y_train.shape[1]
n_samples = 1000
X = np.random.uniform(0,1, (n_samples, n_timesteps, n_features))
y = pd.get_dummies(np.random.randint(0,n_outputs, n_samples)).values
model = tf.keras.models.Sequential([
tf.keras.layers.Conv1D(input_shape=(n_timesteps, n_features), kernel_size=3, filters=16),
tf.keras.layers.GlobalAveragePooling1D(), # also GlobalMaxPooling1D() is ok
tf.keras.layers.Dense(256, activation='relu'),
tf.keras.layers.Dropout(0.2),
tf.keras.layers.Dense(n_outputs, activation='softmax')
])
model.compile('adam', 'categorical_crossentropy')
model.fit(X,y, epochs=2,verbose=1)
model.summary()`
output

This is working and I really appreciate, just a few tweaks I need to do and shall be fine

authors: jpandeinge yash-clear


text:
Added table of contents to README.md

[ ] This PR requires new unit tests [y/n] (make sure tests are included)
[ ] This PR requires to update the documentation [y/n] (make sure the docs are up-to-date)
[ ] This PR is backwards compatible [y/n]
[ ] This PR changes the current API [y/n] (all API changes need to be approved by fchollet)

Closing because readme is not long enough to justify table of contents

source: gharchive/pull-request


text:
Fix dtype test for trace

Additionally, fix the formatting error

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 56.39%. Comparing base (f12a205) to head (e63cdb8).
Report is 2 commits behind head on master.

:exclamation: Current head e63cdb8 differs from pull request most recent head d3dad08. Consider uploading reports for the commit d3dad08 to get more accurate results

Additional details and impacted files
@@             Coverage Diff             @@
##           master   #19686       +/-   ##
===========================================
- Coverage   78.41%   56.39%   -22.03%
===========================================
  Files         498      498
  Lines       45507    45513        +6
  Branches     8379     8381        +2
===========================================
- Hits        35686    25668    -10018
- Misses       8091    18264    +10173
+ Partials     1730     1581      -149

Flag
Coverage Δ

keras
56.39% <ø> (-21.88%)
:arrow_down:

keras-jax
?

keras-numpy
56.39% <ø> (-0.02%)
:arrow_down:

keras-tensorflow
?

keras-torch
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

I have enforced the result dtype for ops.trace to be int32 if the input dtype is uint8 or uint16 regardless of the jax version we are using.
It's impossible to get a common dtype because we run the tests with 0.4.23 for GPU and 0.4.27 for CPU.
We can fully resolve this once we have jax>=0.4.27 for GPU tests.


text:
🛑 Documentation is down

In efa4ac1, Documentation (https://doc.kerberos.io) was down:

HTTP code: 0
Response time: 0 ms

Resolved: Documentation is back up in 5ee4841 after 6 hours, 33 minutes.

repo: kerberos-io/upptime


text:
I got 404 Not Found when I test the RESTFul API with curl

What should I do to fix this problem.
curl -v --form input=@./TestPDF.pdf attlaspj.ddns.net:8080/processHeaderDocument

Hostname was NOT found in DNS cache
Trying 171.97.255.227...
Connected to attlaspj.ddns.net (171.97.255.227) port 8080 (#0)

POST /processHeaderDocument HTTP/1.1
User-Agent: curl/7.38.0
Host: attlaspj.ddns.net:8080
Accept: /
Content-Length: 155372
Expect: 100-continue
Content-Type: multipart/form-data; boundary=------------------------e8cd352b69b9f1cc

< HTTP/1.1 100 Continue
< HTTP/1.1 404 Not Found
< Date: Thu, 19 Jan 2017 19:54:19 GMT

Server Apache/2.4.10 (Raspbian) is not blacklisted
< Server: Apache/2.4.10 (Raspbian)
< Content-Length: 306
< Content-Type: text/html; charset=iso-8859-1
HTTP error before end of send, stop sending
<

404 Not Found

Not Found
The requested URL /processHeaderDocument was not found on this server.

Apache/2.4.10 (Raspbian) Server at attlaspj.ddns.net Port 8080

* Closing connection 0

Hi @AhaAhaz, looking at attlaspj.ddns.net:8080, it seems there is some problem with the configuration of the server, as the javascript/css seems not able to load.

Cheers
Luca

I already solve javascript/css problem on server and it still give
"Error encountered while requesting the server.
Not Found
The requested URL /processHeaderDocument was not found on this server." When I hit summit button.
And result on curl is the same as previous.

Hello!
The problem is very likely related to your server configuration. Check if the service is working locally on your server (localhost:8080 with a curl command on your server). Ensure that port 8080 is open on your server (it is generally blocked by default, e.g. sudo netstat -ntlp | grep :8080), check possible redirections if you are running apache.
As an alternative you can start the GROBID service on port 80 by modifying the pom.xml file under grobid-service (simply replace 8080 by 80).

@kermitt2 I test service on my local server (localhost:80) and modify the pom.xml file under grobid-service with port 80, it still give "Not Found"

@AhaAhaz I think there is something different with your interface. I see no text/file form to process the pdf for example.
Did you modify the javascript or this is the grobid plain version, cloned from github?

@lfoppiano This is version clone from github.

Did you run it with mvn jetty:run-war? Why the address has /grobid-master/grobid-service? This is not in the default configuration. Can you eventually post here your web.xml and the jetty plugin configuration in pom.xml?

This is web.xml under grobid-service/src/main/webapp/WEB-INF

grobid-service - a RESTful service for grobid

log4jConfigLocation
/WEB-INF/classes/log4j.properties

<servlet>
    <servlet-name>grobid-service</servlet-name>
    <servlet-class>com.sun.jersey.spi.container.servlet.ServletContainer</servlet-class>
    <init-param>
        <param-name>com.sun.jersey.config.property.resourceConfigClass</param-name>
        <param-value>com.sun.jersey.api.core.PackagesResourceConfig</param-value>
    </init-param>
    <init-param>
        <param-name>com.sun.jersey.config.property.packages</param-name>
        <param-value>org.grobid.service</param-value>
    </init-param>
    <load-on-startup>1</load-on-startup>
</servlet>

<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/admin</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/isalive</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/grobid</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processHeaderDocument</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processHeaderDocumentHTML</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processFulltextDocument</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processFulltextAssetDocument</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processFulltextDocumentHTML</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processDate</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processHeaderNames</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitationNames</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processAffiliations</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitation</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processReferences</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/sha1</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/allProperties</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/changePropertyValue</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitationPatentTEI</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitationPatentST36</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitationPatentTXT</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/processCitationPatentPDF</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/annotatePDF</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/referenceAnnotations</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/citationPatentAnnotations</url-pattern>
</servlet-mapping>
<servlet-mapping>
    <servlet-name>grobid-service</servlet-name>
    <url-pattern>/version</url-pattern>
</servlet-mapping>

<welcome-file-list>
    <welcome-file>grobid/index.html</welcome-file>
    <welcome-file>index.html</welcome-file>
</welcome-file-list>

<!-- Path to properties files and GROBID_HOME -->
<env-entry>
    <env-entry-name>org.grobid.property</env-entry-name>
    <env-entry-value>${_GROBID_PROPERTY}</env-entry-value>
    <env-entry-type>java.lang.String</env-entry-type>
</env-entry>

<env-entry>
    <env-entry-name>org.grobid.property.service</env-entry-name>
    <env-entry-value>${_GROBID_SERVICE_PROPERTY}</env-entry-value>
    <env-entry-type>java.lang.String</env-entry-type>
</env-entry>

<env-entry>
    <env-entry-name>org.grobid.home</env-entry-name>
    <env-entry-value>${_GROBID_HOME}</env-entry-value>
    <env-entry-type>java.lang.String</env-entry-type>
</env-entry>

<env-entry>
    <env-entry-name>org.grobid.version</env-entry-name>
    <env-entry-value>${project.version}</env-entry-value>
    <env-entry-type>java.lang.String</env-entry-type>
</env-entry>

This is pom.xml under grobid-service

4.0.0

org.grobid
grobid-parent
0.4.2-SNAPSHOT
../pom.xml

<groupId>org.grobid</groupId>
<artifactId>grobid-service</artifactId>
<name>${project.artifactId}</name>
<version>0.4.2-SNAPSHOT</version>
<packaging>war</packaging>

<dependencies>
    <!-- Testing -->
    <dependency>
        <!-- directory-naming included only with test scope (to use
            for tests but not to embed in libraries of the war) -->
        <groupId>directory-naming</groupId>
        <artifactId>naming-java</artifactId>
        <version>0.8</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>4.12</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.easymock</groupId>
        <artifactId>easymock</artifactId>
        <version>3.4</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.powermock</groupId>
        <artifactId>powermock-api-easymock</artifactId>
        <version>1.6.6</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.powermock</groupId>
        <artifactId>powermock-module-junit4</artifactId>
        <version>1.6.6</version>
        <scope>test</scope>
    </dependency>

    <dependency>
        <groupId>org.grobid</groupId>
        <artifactId>grobid-core</artifactId>
        <version>0.4.2-SNAPSHOT</version>
        <scope>compile</scope>
        <exclusions>
            <exclusion>
                <groupId>directory-naming</groupId>
                <artifactId>naming-java</artifactId>
            </exclusion>
        </exclusions>
    </dependency>
    <dependency>
        <groupId>com.sun.jersey</groupId>
        <artifactId>jersey-client</artifactId>
        <version>1.8</version>
    </dependency>
    <dependency>
        <groupId>com.sun.jersey</groupId>
        <artifactId>jersey-server</artifactId>
        <version>1.8</version>
    </dependency>
    <!--dependency>
        <groupId>com.sun.jersey</groupId>
        <artifactId>jersey-servlet</artifactId>
        <version>1.8</version>
    </dependency-->
    <dependency>
        <groupId>com.sun.jersey</groupId>
        <artifactId>jersey-core</artifactId>
        <version>1.8</version>
    </dependency>
    <dependency>
        <groupId>asm</groupId>
        <artifactId>asm</artifactId>
        <version>3.3.1</version>
    </dependency>
    <dependency>
        <groupId>org.jvnet</groupId>
        <artifactId>mimepull</artifactId>
        <version>1.6</version>
    </dependency>
    <dependency>
        <groupId>com.sun.jersey.contribs</groupId>
        <artifactId>jersey-multipart</artifactId>
        <version>1.8</version>
        <!--scope>compile</scope-->
    </dependency>
    <dependency>
        <groupId>org.slf4j</groupId>
        <artifactId>slf4j-api</artifactId>
        <version>1.7.21</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.slf4j</groupId>
        <artifactId>slf4j-log4j12</artifactId>
        <version>1.7.21</version>
    </dependency>
    <dependency>
        <groupId>log4j</groupId>
        <artifactId>log4j</artifactId>
        <version>1.2.17</version>
    </dependency>
    <dependency>
        <groupId>javax.ws.rs</groupId>
        <artifactId>jsr311-api</artifactId>
        <version>1.1.1</version>
    </dependency>
    <dependency>
        <groupId>javax.servlet</groupId>
        <artifactId>servlet-api</artifactId>
        <version>2.5</version>
        <scope>provided</scope>
    </dependency>
    <dependency>
        <groupId>javax.servlet.jsp</groupId>
        <artifactId>jsp-api</artifactId>
        <version>2.2</version>
        <scope>provided</scope>
    </dependency>
    <dependency>
        <groupId>org.apache.pdfbox</groupId>
        <artifactId>pdfbox</artifactId>
        <version>1.8.9</version>
    </dependency>
</dependencies>
<build>
    <plugins>
        <plugin>
            <inherited>true</inherited>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-surefire-plugin</artifactId>
            <version>2.19.1</version>
            <configuration>
                <argLine>-Xms256m -Xmx1024m</argLine>
            </configuration>
        </plugin>

        <!-- start: for generating license headers in source files. Run mvn license:format -->
        <plugin>
            <groupId>com.google.code.maven-license-plugin</groupId>
            <artifactId>maven-license-plugin</artifactId>
            <version>1.4.0</version>
            <configuration>
                <header>${basedir}/src/etc/header.txt</header>
                <includes>
                    <include>src/main/java/**</include>
                    <include>src/test/java/**</include>
                </includes>
            </configuration>
        </plugin>
        <!-- end: for generating license headers in source files. Run mvn license:format -->
        <plugin>
            <artifactId>maven-assembly-plugin</artifactId>
            <version>2.6</version>
            <configuration>
                <descriptors>
                    <descriptor>${assemblies.name}</descriptor>
                </descriptors>
                <appendAssemblyId>false</appendAssemblyId>
                <finalName>${project.groupId}.${project.artifactId}_${project.version}</finalName>
                <outputDirectory>target/distribution</outputDirectory>
                <workDirectory>target/assembly/work</workDirectory>
            </configuration>
        </plugin>
        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-compiler-plugin</artifactId>
            <version>2.5.1</version>
            <configuration>
                <source>1.7</source>
                <target>1.7</target>
            </configuration>
        </plugin>
        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-war-plugin</artifactId>
            <version>2.6</version>
            <configuration>
                <webResources>
                    <resource>
                        <directory>${basedir}/src/main/webapp/WEB-INF/</directory>
                        <excludes>
                            <exclude>${basedir}/src/main/resources/*.xml</exclude>
                        </excludes>
                        <includes>
                            <include>web.xml</include>
                        </includes>
                        <filtering>true</filtering>
                        <targetPath>WEB-INF</targetPath>
                    </resource>
                </webResources>
            </configuration>
        </plugin>
        <plugin>
            <groupId>org.eclipse.jetty</groupId>
            <artifactId>jetty-maven-plugin</artifactId>
            <version>9.3.14.v20161028</version>

            <configuration>
                <scanIntervalSeconds>0</scanIntervalSeconds>
                <stopKey/>
                <stopPort/>
                <systemProperties>
                    <!-- enable easy JMX connection to JConsole -->
                    <systemProperty>
                        <name>com.sun.management.jmxremote</name>
                        <value/>
                    </systemProperty>
                    <systemProperty>
                        <name>jetty.port</name>
                        <value>80</value>
                    </systemProperty>
                    <systemProperty>
                        <name>maxIdleTime</name>
                        <value>60000</value>
                    </systemProperty>
                    <systemProperty>
                        <name>log4j.configuration</name>
                        <value>log4j-jetty.properties</value>
                    </systemProperty>
                </systemProperties>
            </configuration>
        </plugin>
    </plugins>
</build>

<profiles>
    <profile>
        <id>default</id>
        <activation>
            <activeByDefault>true</activeByDefault>
        </activation>
        <build>
            <filters>
                <filter>profiles/default.properties</filter>
            </filters>
        </build>
    </profile>
    <profile>
        <id>docker</id>
        <build>
            <filters>
                <filter>profiles/docker.properties</filter>
            </filters>
        </build>
    </profile>
    <profile>
        <id>genericBuild</id>
    </profile>
</profiles>

except the port number, you did not modify anything else?
can you run maven with the option -e and shre the whole log?
From the small portioon I can see
[ERROR] Failed to execute goal org.eclipse.jetty:jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) on project grobid-service: Failure: Permission denied -> [Help 1]
looks there is some permission problem?

I'm not modify anything.
[INFO] Error stacktraces are turned on.
[INFO] Scanning for projects...
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building grobid-service 0.4.2-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] >>> jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) > package @ grobid-service >>>
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ grobid-service ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ grobid-service ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ grobid-service ---
[INFO] Not copying test resources
[INFO]
[INFO] --- maven-compiler-plugin:2.5.1:testCompile (default-testCompile) @ grobid-service ---
[INFO] Not compiling test sources
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ grobid-service ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-war-plugin:2.6:war (default-war) @ grobid-service ---
[INFO] Packaging webapp
[INFO] Assembling webapp [grobid-service] in [/var/www/html/grobid-service/target/grobid-service-0.4.2-SNAPSHOT]
[INFO] Processing war project
[INFO] Copying webapp webResources [/var/www/html/grobid-service/src/main/webapp/WEB-INF/] to [/var/www/html/grobid-service/target/grobid-service-0.4.2-SNAPSHOT]
[INFO] Copying webapp resources [/var/www/html/grobid-service/src/main/webapp]
[INFO] Webapp assembled in [19550 msecs]
[INFO] Building war: /var/www/html/grobid-service/target/grobid-service-0.4.2-SNAPSHOT.war
[INFO]
[INFO] <<< jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) < package @ grobid-service <<<
[INFO]
[INFO] --- jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) @ grobid-service ---
[INFO] Configuring Jetty for project: grobid-service
[INFO] Logging initialized @66839ms
[INFO] Context path = /
[INFO] Tmp directory = /var/www/html/grobid-service/target/tmp
[INFO] Web defaults = org/eclipse/jetty/webapp/webdefault.xml
[INFO] Web overrides =  none
[INFO] jetty-9.3.14.v20161028
[INFO] Scanning elapsed time=9671ms
Jan 24, 2017 12:31:26 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.grobid.service
Jan 24, 2017 12:31:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.grobid.service.GrobidRestService
Jan 24, 2017 12:31:26 PM com.sun.jersey.api.core.ScanningResourceConfig init
INFO: No provider classes found.
Jan 24, 2017 12:31:26 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.8 06/24/2011 12:17 PM'
[INFO ] org.grobid.service.GrobidRestService: Initiating Servlet GrobidRestService
[DEBUG] org.grobid.core.utilities.GrobidProperties: synchronized getNewInstance
[DEBUG] org.grobid.core.utilities.GrobidProperties: Initiating property loading
[DEBUG] org.grobid.core.utilities.GrobidProperties: loading GROBID_HOME path
[DEBUG] org.grobid.core.utilities.GrobidProperties: loading grobid.properties
[DEBUG] org.grobid.core.utilities.GrobidProperties: Checking Properties
[DEBUG] org.grobid.core.utilities.GrobidProperties: loading pdf2xml path
[DEBUG] org.grobid.core.utilities.GrobidProperties: pdf2xml home directory set to /var/www/html/grobid-home/pdf2xml/lin-32
[INFO ] org.grobid.core.main.LibraryLoader: Loading external native CRF library
[DEBUG] org.grobid.core.main.LibraryLoader: The property org.grobid.home already exists. No mocking of context made.
[DEBUG] org.grobid.core.main.LibraryLoader: /var/www/html/grobid-home/lib/lin-32
[INFO ] org.grobid.core.main.LibraryLoader: Loading Wapiti native library...
[WARNING] unavailable
com.sun.jersey.api.container.ContainerException: Unable to create resource
at com.sun.jersey.server.impl.resource.SingletonFactory$Singleton.init(SingletonFactory.java:139)
at com.sun.jersey.server.impl.application.WebApplicationImpl$10.f(WebApplicationImpl.java:584)
at com.sun.jersey.server.impl.application.WebApplicationImpl$10.f(WebApplicationImpl.java:581)
at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
at com.sun.jersey.server.impl.application.WebApplicationImpl.getResourceComponentProvider(WebApplicationImpl.java:581)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiateResource(WebApplicationImpl.java:658)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiateResource(WebApplicationImpl.java:653)
at com.sun.jersey.server.impl.application.RootResourceUriRules.(RootResourceUriRules.java:124)
at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1298)
at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:169)
at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:775)
at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:771)
at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:771)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:766)
at com.sun.jersey.spi.container.servlet.ServletContainer.initiate(ServletContainer.java:488)
at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:318)
at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:609)
at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:210)
at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:373)
at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:556)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:640)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:419)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:892)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:349)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.startWebapp(JettyWebAppContext.java:323)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart(JettyWebAppContext.java:398)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.server.Server.start(Server.java:422)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:389)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty(AbstractJettyMojo.java:460)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute(AbstractJettyMojo.java:328)
at org.eclipse.jetty.maven.plugin.JettyRunWarMojo.execute(JettyRunWarMojo.java:64)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at com.sun.jersey.server.spi.component.ResourceComponentConstructor._construct(ResourceComponentConstructor.java:191)
at com.sun.jersey.server.spi.component.ResourceComponentConstructor.construct(ResourceComponentConstructor.java:179)
at com.sun.jersey.server.impl.resource.SingletonFactory$Singleton.init(SingletonFactory.java:137)
... 73 more
Caused by: java.lang.UnsatisfiedLinkError: /var/www/html/grobid-home/lib/lin-32/libwapiti.so: /var/www/html/grobid-home/lib/lin-32/libwapiti.so: cannot open shared object file: No such file or directory (Possible cause: can't load IA 32-bit .so on a ARM-bit platform)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1938)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1821)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at org.grobid.core.main.LibraryLoader.load(LibraryLoader.java:94)
at org.grobid.core.factory.AbstractEngineFactory.init(AbstractEngineFactory.java:51)
at org.grobid.core.factory.AbstractEngineFactory.fullInit(AbstractEngineFactory.java:58)
at org.grobid.service.GrobidRestService.(GrobidRestService.java:78)
... 80 more
[WARNING] Failed startup of context o.e.j.m.p.JettyWebAppContext@14514d8{/,file:///var/www/html/grobid-service/target/grobid-service-0.4.2-SNAPSHOT/,UNAVAILABLE}{/var/www/html/grobid-service/target/grobid-service-0.4.2-SNAPSHOT.war}
javax.servlet.ServletException: grobid-service@41db9281==com.sun.jersey.spi.container.servlet.ServletContainer,1,false
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:661)
at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:419)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:892)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:349)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.startWebapp(JettyWebAppContext.java:323)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520)
at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart(JettyWebAppContext.java:398)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:113)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131)
at org.eclipse.jetty.server.Server.start(Server.java:422)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:389)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty(AbstractJettyMojo.java:460)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute(AbstractJettyMojo.java:328)
at org.eclipse.jetty.maven.plugin.JettyRunWarMojo.execute(JettyRunWarMojo.java:64)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: com.sun.jersey.api.container.ContainerException: Unable to create resource
at com.sun.jersey.server.impl.resource.SingletonFactory$Singleton.init(SingletonFactory.java:139)
at com.sun.jersey.server.impl.application.WebApplicationImpl$10.f(WebApplicationImpl.java:584)
at com.sun.jersey.server.impl.application.WebApplicationImpl$10.f(WebApplicationImpl.java:581)
at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
at com.sun.jersey.server.impl.application.WebApplicationImpl.getResourceComponentProvider(WebApplicationImpl.java:581)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiateResource(WebApplicationImpl.java:658)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiateResource(WebApplicationImpl.java:653)
at com.sun.jersey.server.impl.application.RootResourceUriRules.(RootResourceUriRules.java:124)
at com.sun.jersey.server.impl.application.WebApplicationImpl._initiate(WebApplicationImpl.java:1298)
at com.sun.jersey.server.impl.application.WebApplicationImpl.access$700(WebApplicationImpl.java:169)
at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:775)
at com.sun.jersey.server.impl.application.WebApplicationImpl$13.f(WebApplicationImpl.java:771)
at com.sun.jersey.spi.inject.Errors.processWithErrors(Errors.java:193)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:771)
at com.sun.jersey.server.impl.application.WebApplicationImpl.initiate(WebApplicationImpl.java:766)
at com.sun.jersey.spi.container.servlet.ServletContainer.initiate(ServletContainer.java:488)
at com.sun.jersey.spi.container.servlet.ServletContainer$InternalWebComponent.initiate(ServletContainer.java:318)
at com.sun.jersey.spi.container.servlet.WebComponent.load(WebComponent.java:609)
at com.sun.jersey.spi.container.servlet.WebComponent.init(WebComponent.java:210)
at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:373)
at com.sun.jersey.spi.container.servlet.ServletContainer.init(ServletContainer.java:556)
at javax.servlet.GenericServlet.init(GenericServlet.java:244)
at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:640)
... 51 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at com.sun.jersey.server.spi.component.ResourceComponentConstructor._construct(ResourceComponentConstructor.java:191)
at com.sun.jersey.server.spi.component.ResourceComponentConstructor.construct(ResourceComponentConstructor.java:179)
at com.sun.jersey.server.impl.resource.SingletonFactory$Singleton.init(SingletonFactory.java:137)
... 73 more
Caused by: java.lang.UnsatisfiedLinkError: /var/www/html/grobid-home/lib/lin-32/libwapiti.so: /var/www/html/grobid-home/lib/lin-32/libwapiti.so: cannot open shared object file: No such file or directory (Possible cause: can't load IA 32-bit .so on a ARM-bit platform)
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1938)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1821)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at org.grobid.core.main.LibraryLoader.load(LibraryLoader.java:94)
at org.grobid.core.factory.AbstractEngineFactory.init(AbstractEngineFactory.java:51)
at org.grobid.core.factory.AbstractEngineFactory.fullInit(AbstractEngineFactory.java:58)
at org.grobid.service.GrobidRestService.(GrobidRestService.java:78)
... 80 more
[INFO] Jetty server exiting.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:28 min
[INFO] Finished at: 2017-01-24T12:31:30+07:00
[INFO] Final Memory: 16M/43M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.eclipse.jetty:jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) on project grobid-service: Failure: Permission denied -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.eclipse.jetty:jetty-maven-plugin:9.3.14.v20161028:run-war (default-cli) on project grobid-service: Failure
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Failure
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty(AbstractJettyMojo.java:488)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute(AbstractJettyMojo.java:328)
at org.eclipse.jetty.maven.plugin.JettyRunWarMojo.execute(JettyRunWarMojo.java:64)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207)
... 20 more
Caused by: java.net.SocketException: Permission denied
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:317)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.maven.plugin.MavenServerConnector.doStart(MavenServerConnector.java:122)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:401)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty(AbstractJettyMojo.java:460)
... 24 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Ok, from this error is clear there is a problem of permissions (perhaps on your grobid-home,  but check on all your directories).
I don't know why your grobid-home is in /var/www, that's also usually owned by root...  I'd perhaps move that to another directory owned by a different user.
You can always place an apache reverse proxy in front of it.

How to solve this error. I check at  /var/www/html/grobid-home/lib/lin-32/libwapiti.so. It have that file in that directory.
I need to make the index.html online on the raspberry pi web server with Apache that must be in the var/www/html path.
How to  reverse proxy can you give some suddestion. I'm a very new user to use webserver and apache.

Well, I cannot really help on this as it's mostly dependent on your configuration settings.
My advice is to first run it correctly in local, and then think about how to deploy it online. By the way, we just noticed that the native libraries might not be compiled for your architecture, so you might need to recompile them from scratch (e.g. libwapiti).

Now I can run mvn -Dmaven.test.skip=true jetty:run-war with port 8080 and what should I do to run a test.

Very well.
Now before running a test, you have to compile wapiti (https://github.com/kermitt2/Wapiti) for your arm architecture (raspberryPI). Then you should place the file libwapiti.so in the same directory lin-32, for the time being could work.
If you can manage to do so, we could integrate the arm support to Grobid!

@AhaAhaz, I'm not an expert of RasperryPI, from what I've understood from @kermitt2 you will have problems with memory and compatibility (not only wapiti needs to be ported to ARM, also pdf2xml for example will be more complex). How much memory do you have on that computer? Grobid requires at least 2Gb (depending on which modules you want to use).
Perhaps you should use it on a real computer. ;-)

OK I will try to compile wapiti. Memory that I have is 16Gb.

Now I change to run on Ubuntu and it's work. Thanks for the help and I have some question, I want to save result as xml file (processHeader.xml), which path that grobid build xml for the result?

Sorry, I didn't understand  your question.
If you are asking how to save the results, I think you should call GROBID through the API. See documentation.

Not sure about the question too, but if you want to output the result in an XML file from the web service, you can do:

curl -v --form input=@./file.pdf localhost:8080/processHeaderDocument -o ./file.tei.xml

The batch mode also output results in XML (TEI) files, see the documentation about how to specify the paths.

I want to do something like
"$xml->save(processheader.xml)"
In code on the web service, can it work?

I'm going to close this issue, @AhaAhaz if you have more questions feel free to reopen it.

authors: AhaAhaz kermitt2 lfoppiano


text:
Empty data is provided to Wapiti tagger: java.lang.Throwable

On one of paper (available here: http://guillaumemuller1.free.fr/Articles/grizard_AAMAS_COIN_2006.pdf) I get the following Exception:
Empty data is provided to Wapiti tagger: java.lang.Throwable
at org.grobid.core.jni.WapitiWrapper.label(WapitiWrapper.java:18)
at org.grobid.core.jni.WapitiModel.label(WapitiModel.java:48)
at org.grobid.core.engines.tagging.WapitiTagger.label(WapitiTagger.java:28)
at org.grobid.core.engines.AbstractParser.label(AbstractParser.java:39)
at org.grobid.core.engines.FullTextParser.processing(FullTextParser.java:150)
at org.grobid.core.engines.Engine.fullTextToTEI(Engine.java:574)
at org.grobid.core.engines.ProcessEngine.processFullTextDirectory(ProcessEngine.java:163)
at org.grobid.core.engines.ProcessEngine.processFullText(ProcessEngine.java:145)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.grobid.core.utilities.Utilities.launchMethod(Utilities.java:359)
at org.grobid.core.main.batch.GrobidMain.main(GrobidMain.java:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.simontuffs.onejar.Boot.run(Boot.java:340)
at com.simontuffs.onejar.Boot.main(Boot.java:166)
This is not really important since I get a TEI with sufficient information, but just in case this would hide another problem...

Hi @liar666 , I've tested your pdf with the latest GROBID version, trying to extract the fulltext. I did not get the error.
Could you maybe give it another try with the latest version and tell if the exception is still occurring?
Thanks

Just tested with latest code from git repo.
That Works ! Thanks !


text:
fix(docs + code): corrections to docs for plugin-debezium

Added SCHEMA_ONLY_RECOVERY enum to MySQL SnapshotMode enums. Its documentation existed, but the enum was missing.

Made the requested change.

repo: kestra-io/plugin-debezium


text:
CI passing + package registration cleanup

Just a few things to clean up here:

get the CI passing
get the docs generated (partially linked to getting CI passing)

If we want julia LTS (1.6.7) support, we need to bump the LinearAlgebra and SparseArrays deps down to "1.10" @jack-champagne @andgoldschmidt

I think we should support the more recent Julia 1.10, and not worry about 1.6.7.

authors: andgoldschmidt jack-champagne


text:
dev commit

LGTM

okay!

repo: keumbi/solo-project


text:
what is the 29.1 file of million song?

do you refer the subset of one million songs?

did I mention 29.1 files somewhere? It is 29.1 second and they are preview clips of MSD.

On 29 Oct 2016, at 00:39, yk_data notifications@github.com wrote:
do you refer the subset of one million songs?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Oh, probably you mean those lines from readme.
More information about the files are in this repo

do you means just
git clone https://github.com/keunwoochoi/MSD_split_for_tagging under the music-auto_tagging-keras
?

Where to clone doesn't matter
I used about 22k songs from MSD
The repo only contains their ID's and labels, not the audio file or anything else.

I have a question related to this work. I am trying to figure out how to input audio to a CNN. In this work, are all audio clips the same size? Any tips on how to handle variable length audio (i.e, an entire song would be of differing lengths).

@keunwoochoi  22k? In the paper, you have mentioned about 214k clips.
The repository do not contain the clips. So I suppose, you have downloaded the preview clips, trimmed it to 29s and got the mel-spectogram. Right?

@VanushVaswani All audio clips are the same size. There could be some heuristics on how to get the 29s segments and how to merge the scores. E.g., random, middle, structure segmentation, ..

@as641651 Thanks for noting it, you're correct. It's 214k clips. Yes, that's correct.

authors: VanushVaswani as641651 keunwoochoi loveJasmine

license: mit


text:
No Edit Server

I'd like the option to make a server where nobody else can dig or place blocks. (unless I make them a mod?) Then I could set up a platformer level where everyone else has to try to jump to the end without falling into lava. I could share a link to randos on twitter who can't mess up my level. Like Mario Maker. Also, springs.

This is in

authors: curtastic kevglass

repo: kevglass/unearthed


text:
Create and manipulate posts

User Stories

As a user, I can create a post

As a user, I can retrieve all of my posts

As a user, I can retrieve a post by id

As a user, I can update the title of a post

As a user, I can delete a post

Added all post functionality, and order methods

repo: kevin-foreman/just-tech-news


text:
bright2dn function not edited for NIRSpec or NIRISS

The bright2dn function in Stage 3 has not been edited for NIRSpec or NIRISS observations, and so an ind variable is never defined, so any NIRISS or NIRSpec file that has had the photom step run on it in Stage 2 will crash. I'm not sure what the code should look like for NIRSpec and NIRISS, so for now I'm just going to add an error message and if others know what to do they should implement those changes

@jbrande just pointed out to me that if he ran the NIRSpec files with the photom step in S2 that he didn't get an error message like that mentioned in above which alerted me to the issue that no unit conversion is done at all if the photom step is run. At least for NIRSpec, the BUNIT FITS header ends up being MJy not MJy/sr, so no unit conversion happens (and so the above issue is avoided). This is definitely not the intended action. I have confirmed that MIRI run through S2 with the photom step gives MJy/sr, and I'd assume NIRCam does as well, so this seems unique to NIRSpec and perhaps NIRISS (can you confirm @afeinstein20). If someone that's more familar with these units (e.g. @kevin218) wants to write a slightly tweaked version of bright2dn for just MJy input units, that'd be good!


text:
🛑 My Home is down

In 0b16298, My Home (https://myhome.ctor.io) was down:

HTTP code: 500
Response time: 241 ms

Resolved: My Home is back up in 5bc879a.

repo: kevinbrechbuehl/upptime


text:
Cast RawOpcode to the internal ioctl_code type (c_uint)

The rustix RawOpcode type can vary depending on the target.
For example, targets that use the libc Linux configuration in rustix, the RawOpcode type is a type alias to c_ulong rather than c_uint.
I believe the UsbFsIoctl struct should remain the same in these configurations.
Discovered this while attempting to build for s390x-unknown-linux-gnu.
error[E0308]: mismatched types
  --> /root/.cargo/registry/src/index.crates.io-6f17d22bba15001f/nusb-0.1.6/src/platform/linux_usbfs/usbfs.rs:78:25
   |
78 |             ioctl_code: ioctl::NoneOpcode::<b'U', 23, ()>::OPCODE.raw(), // IOCTL_USBFS_CONNECT
   |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ expected `u32`, found `u64`

Thanks!

I don't think it actually matters, but the ioctl_code is a signed int in the kernel headers.

authors: jonlamb-gh kevinmehall

repo: kevinmehall/nusb


text:
Fixed wave color, now not only white

Fixed wave color, now you can set up color, which you want.
self.waveColor is never used...
Thanks.

+1, please merge!

cakl, you can use this fork.

thx. @maximbilan, I'm already doing this. But a merge by @kevinzhow would be nice anyway...

@cakl, I agree with you, would be great:)

@maximbilan Do you know why there's a difference in the height of the amplitude if you render it with initWithFrame and initWithCoder (storyboard)? I don't know how to fix this bug

@cakl I think that you need to override the initWithCoder method and call the setup method there, how it makes initWithFrame method.

thats already done with the awakeFromNib method. But the height of the amplitude is nearly the double

authors: cakl maximbilan

repo: kevinzhow/Waver


text:
🛑 FX corretor (kty) is down

In e3dafe8, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in ae24320 after 5 minutes.

repo: keviocastro/upptime


text:
🛑 FX perdigueiro (kty) is down

In 4f686f0, FX perdigueiro (kty) (https://perdigueiroimoveis.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX perdigueiro (kty) is back up in 6c5e367.


text:
🛑 FX blog (kty) is down

In d44302f, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in de13446 after 24 minutes.


text:
🛑 FX blog (kty) is down

In 0042952, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 39cc9e4 after 11 minutes.


text:
🛑 FX corretor (kty) is down

In c7ff842, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in 3ef4002 after 8 minutes.


text:
🛑 FX blog (kty) is down

In b395587, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in b34f1eb after 11 minutes.


text:
🛑 FX corretor (kty) is down

In 214ec0b, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in 891b58a after 6 minutes.


text:
🛑 FX corretor (kty) is down

In d93d550, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in eecae1e after 10 minutes.


text:
🛑 FX blog (kty) is down

In 7175acf, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 32f1213 after 6 minutes.


text:
🛑 FX blog (kty) is down

In 1dc5814, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 717d095 after 2 minutes.


text:
🛑 FX corretor (kty) is down

In e8df103, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in cc81672 after 42 minutes.


text:
🛑 FX corretor (kty) is down

In 8e1f72d, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in 6d683f4 after 12 minutes.


text:
🛑 FX blog (kty) is down

In 6466e79, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 1624d47 after 10 minutes.


text:
🛑 FX blog (kty) is down

In d6bbe49, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 97cde6e after 35 minutes.


text:
🛑 FX net (kty) is down

In b6310b0, FX net (kty) (https://foxter.net.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX net (kty) is back up in aa86878.


text:
🛑 FX net (kty) is down

In 04d60c4, FX net (kty) (https://foxter.net.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX net (kty) is back up in cba7f68.


text:
🛑 FX corretor (kty) is down

In 15016a6, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in d64859e after 38 minutes.


text:
🛑 FX blog (kty) is down

In 6ad57dd, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 5c56f71 after 14 minutes.


text:
🛑 FX corretor (kty) is down

In 6671b71, FX corretor (kty) (https://corretores.foxterciaimobiliaria.com.br) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX corretor (kty) is back up in f72fb02 after 11 minutes.


text:
🛑 FX blog (kty) is down

In 366bea4, FX blog (kty) (https://foxter-blogeditor.konecty.com) was down:

HTTP code: 0
Response time: 0 ms

Resolved: FX blog (kty) is back up in 989ea56 after 12 minutes.


text:
🛑 FX blog (kty) is down

In 1719ff6, FX blog (kty) (https://blog.foxterciaimobiliaria.com.br) was down:

HTTP code: 503
Response time: 357 ms

Resolved: FX blog (kty) is back up in 1f10f0f after .


text:
Occasional "read timeout in contents" or "read timeout in resources" notifications

I'm occasionally getting notifications like this on Keybase for macOS:

Is this something weird with my internet connection (e.g. could be something blocked by corporate firewall), or is this a bug in the client, or on your side?
my log id: 88736aebbd9c0794f11c1e1c

They appear to stem from network timeouts when trying to reach our API servers.  It's hard to say from the logs exactly why you can't reach the servers, but I suppose a corporate firewall is possible, as is just a generally unreliable network or moving a laptop around between wifi access points.
It's interesting that your computer is even trying to access KBFS files in the background, without your explicit browsing.  I think you might have a shell extension installed that looks up things like "contents" and "resources" and "support files" in any directory you cd into.  It's not exactly a problem by itself, but it triggers these extra KBFS requests when you're browsing around under /keybase.  Also, if that shell extension automatically loads anything it finds in those directories, you should be careful browsing public directories or shared directories from people you don't know, who could name directories/files like that and put bad stuff in them.  If you do have such an extension, and it's configurable, I'd recommend turning  off that behavior while under /keybase.

Hmm. That's strange.
I do use iTerm2 as my primary terminal, which I know has some kind of shell extension that does... stuff. So that would seem like a plausible explanation.
However, the issue was presenting itself without me browsing under /keybase.
Could also be a regular antivirus scan that's checking those directories.
I'll switch my laptop over to using the wired network while at work, and see if the issue continues. The wifi is known to be a little unreliable.

authors: lucymhdavies strib

repo: keybase/client


text:
Help me

why yesterday I have registered airdrop and suddenly told to join again, it can't even be helped

I have bug too. I join Airdrop but not recieve logo Stellar if complete join Airdrop

same problem

authors: 4eldovek nandhir reedniv


text:
Mobile app: add AmoLED theme

An AmoLED theme would certainly be a great way to save batter life. Specially for those who use the app for an extended period.
I would suggest keeping the current dark theme but also offer the complete AmoLED black theme as for the Reddit app, for example.

Dark theme already exists and measurements have shown that there's no significant benefit of black over dark gray.

Would be great to read about those measurements. Reddit sync power consumption between black and dark themes had a 41% decrease as far as I read about, but overall expected would vary from 15% to 20%. Well that's at least the information I got out a simple Google search from dark to AmoLED black themes power consumption comparison.

https://www.xda-developers.com/amoled-black-vs-gray-dark-mode/

authors: Avamander zanona


text:
uploads stopped working

Keybase GUI Version: 5.8.0-20210920151148+ac2177aec7
I queue 11 files (1.6mb) for uploading, but the upload is stuck. I'm using Windows 10.
Running "keybase fs uploads" will display
1.60 MB left to upload
Estimated time remaining: 11s
without any progress even after 10 minutes.
I tried rebooting, or closing keybase and deleting the two sub folders in AppData\Local\Keybase\kbfs_journal\v1
This will remove the files from the upload queue. But
once I retry uploading the files, the problem is there again.
I didn't have this problem in the past.

I'm currently having this problem on both Windows and Linux, with different files I'm trying to upload to the same folder. This folder was created earlier today, with no problems. (Both clients can see the folder.) But, each client has a different view of the contents of the folder.

Since @tfriedel and I had this issue on the same day, it could be an issue with their KBFS servers. Maybe it'll clear up in a day.

A comment on #24518 leads me to believe something might be corrupted, and offers instructions to fix it. After following those steps, I was able to get uploads to work again.

authors: jpaugh tfriedel


text:
Dependency weirdness w/ vendored "context" library

Someone sent me an encrypted message and it's been a while since I had keybase running on my computer so I decided to try building it. To do this I eventually happened upon these build instructions: https://github.com/keybase/client/tree/master/go#building
Unfortunately, I got this incomprehensible nonsense:
zsh/3 5703 % go install -tags production github.com/keybase/client/go/keybase
# github.com/keybase/client/go/teams
src/github.com/keybase/client/go/teams/handler.go:19: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/handler.go:131: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/handler.go:250: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/rename.go:40: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoErro

It looks like a conflict between vendored and standard library dependencies. This seems to fix the problem:
sed -ie 's/\"context\"/\"golang.org\/x\/net\/context\"/' $(grep -rl '\"context\"')

Run from the root of $GOPATH/src/github.com/keybase/client after running go get github.com/keybase/client/go/keybase per the instructions linked above. Of course it's necessary to undo the resulting changes in https://github.com/keybase/client/tree/master/go/vendor/golang.org/x/net/context
I don't know jack about go or why it's necessary to vendor dependencies like this. From an outsider's perspective it looks like a total mess.

Need a newer version of go
On Sat, Nov 25, 2017 at 3:00 PM wayne notifications@github.com wrote:

Someone sent me an encrypted message and it's been a while since I had
keybase running on my computer so I decided to try building it. To do this
I eventually happened upon these build instructions:
https://github.com/keybase/client/tree/master/go#building
Unfortunately, I got this incomprehensible nonsense:
zsh/3 5703 % go install -tags production github.com/keybase/client/go/keybase
github.com/keybase/client/go/teams
src/github.com/keybase/client/go/teams/handler.go:19 http://github.com/keybase/client/go/teamssrc/github.com/keybase/client/go/teams/handler.go:19: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/handler.go:131: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/handler.go:250: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoError
src/github.com/keybase/client/go/teams/rename.go:40: cannot use func literal (type func("context".Context, int) error) as type func("github.com/keybase/client/go/vendor/golang.org/x/net/context".Context, int) error in argument to RetryOnSigOldSeqnoErro
It looks like a conflict between vendored and standard library
dependencies. This seems to fix the problem:
sed -ie 's/"context"/"golang.org/x/net/context"/' $(grep -rl '"context"')
Run from the root of $GOPATH/src/github.com/keybase/client after running go
get github.com/keybase/client/go/keybase per the instructions linked
above. Of course it's necessary to undo the resulting changes in
https://github.com/keybase/client/tree/master/go/vendor/golang.org/x/net/context
I don't know jack about go or why it's necessary to vendor dependencies
like this. From an outsider's perspective it looks like a total mess.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/keybase/client/issues/9682, or mute the thread
https://github.com/notifications/unsubscribe-auth/AA05_-JduEXdlLfpQ3oO9vM806ubGNl2ks5s6HHJgaJpZM4QqifU
.

@maxtaco here's the output of go version:
go version go1.8.1 linux/amd64

How much newer should I aim for?

Also, even if it's true that I need a newer version of go to avoid the problem described in my original message, the documentation does say

You need to have both Git and Go 1.8 or higher installed.

Ok the doc is out of date.  I think you now need 1.9. It snuck in since we
all use 1.9.  We will update the docs. Sorry about that.
On Sat, Nov 25, 2017 at 3:24 PM wayne notifications@github.com wrote:

Also, even if it's true that I need a newer version of go to avoid the
problem described in my original message, the documentation does say
You need to have both Git and Go 1.8 or higher installed.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/keybase/client/issues/9682#issuecomment-346963903,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA05_9CmMUIXlHsZBIKbanQGJfAK09gKks5s6Hd_gaJpZM4QqifU
.

I've confirmed that using go1.9.x solves my problem, thanks for the help!

We've updated the docs too.  Thanks for your feedback
On Thu, Nov 30, 2017 at 9:04 AM, wayne notifications@github.com wrote:

Closed #9682 https://github.com/keybase/client/issues/9682.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/keybase/client/issues/9682#event-1365690673, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AA05_2X9OTblRdLQoQT88ePuyipUKM4aks5s7rXigaJpZM4QqifU
.

authors: maxtaco waynr


text:
Disallow --public and --exploding-lifetime

fixes error if you tried to send an ephemeral message with --public set for keybase chat send and keybase chat upload
Help:
$ kb chat send --help
Running `go install github.com/keybase/client/go/keybase`... Done.
NAME:
   keybase chat send - Send a message to a conversation

USAGE:
   keybase chat send [command options] [conversation [message]]

OPTIONS:
   --topic-type "chat"          Specify topic type of the conversation. Has to be chat or dev
   --channel                    Specify the conversation channel.
   --public                     Only select public conversations. Exclusive to --private
   --private                    Only select private conversations. Exclusive to --public. If both --public and --private are present, --private takes priority.
   --set-headline               Set the headline for the conversation
   --clear-headline             Clear the headline for the conversation
   --nonblock                   Send message without success confirmation
   --exploding-lifetime "0s"    Make this message an exploding message and set the lifetime for the given duration.
                                The maximum lifetime is 168h0m0s (one week) and the minimum lifetime is 30s. Cannot be used in conjunction with --public.

error handling:
$ kb chat send --exploding-lifetime=30s --public test3 hi
Running `go install github.com/keybase/client/go/keybase`... Done.
▶ WARNING Running in devel mode
▶ ERROR Cannot send ephemeral messages with --public set.

Curiosity peek
I still don't think I fully understand what --public does, so it's hard for me to grasp why this needs to throw an Error. If anyone has time to explain --public or link me to a doc explaining the difference (the help basically says it's the opposite of --private and is mutually exclusive, which doesn't help me understand much) and why this doesn't jive with exploding messages, I would appreciate it.
Thanks! Can't wait for these new features!


text:
Shim app with launcher window

@keybase/react-hackers
Notifications now look pretty terrible (on Mac they show up from "terminal-notifier") — that's because Electron has no support to show notifications from the main process, and the only Node module I can find to do it is terrible. We may have to write our own.
Otherwise, this adds a launcher window that's always open. You can click buttons in it to show/focus either the main window or a (dummy) tracker window. Closing the launcher window quits the whole app.

Bad branch name, new PR inbound.


text:
libkb: fix for foo.com@https assertion

fix suggested by patrick

@patrickxb FYI.  If C/I works I suggest we just run with it.

LGTM

authors: maxtaco patrickxb


text:
make the git hooks robust to symlinked repos

r? @patrickxb @cjb

:thumbsup:


text:
make sure tracking always blocks waiting for identify to complete

We were short circuiting early with an error when you ran a command
like:
keybase track malgorithms@twitter

See https://github.com/keybase/keybase-issues/issues/2465.
r? @maxtaco. @patrickxb discovered that this fixes the issue, but neither
of us is very clear on what unblock is doing and how to interpret the fact
that it's getting called in this case (here).

Oh yeah you definitely want this!

The point is to "unblock" KBFS on the identify as soon as possible.  In this case, you want to wait until the end.

👍

is it easy to write a test for this with any of our test users?

@patrickxb yes, just pushed some tweaks to make the existing t_bob tests run through this codepath.

@oconnor663 awesome

authors: maxtaco oconnor663 patrickxb


text:
fix the broken handle_distro_upgrade cronjob for Ubuntu 16.10

Users who have upgraded in-place to Ubuntu 16.10 before we ship this fix
will be stranded, with their /etc/apt/sources.list.d/keybase.list repos
disabled by the upgrade. The cronjob that's supposed to re-enable them
has broken on 16.10, because a config value that was assumed to have a
trailing slash stopped having one.
I want to do a lot of testing before we actually ship this, but hopefully we can review it now so that it's good to go as soon as I've finished testing. r? @cjb

I confirmed that this change works on my Ubuntu 16.10 VM, and also (still) works on an Ubuntu 16.04 docker image.

Final commit was 7894c1f57f3ca5ecb3b5fc87e4496769103b7fd4

I've filed a Chrome bug for this: https://bugs.chromium.org/p/chromium/issues/detail?id=660145


text:
parse team.invite links in team sigchain

sanity check the invites
inform the TeamSigChainState object about any changes, but....
no tests for now; to help patrick compile his PR
look for bugfixes and tests in an upcoming PR

The commits f157610eb14f...c703e4f18192 introduce visual changes on linux. :mag_right: 1 changed

Changed: Markdown-emoji (before) (after)

authors: keybase-ci-visdiff maxtaco


text:
test: set dir entries by block size, and add multi-block dir DSL tests

This adds a way to compute how many dir entries will fit in a block, and sets the max dir entry size to that for all tests.  That means if a test sets a low max block size, it will also allow a small number of entries per block.  In production, this function sets the number to 1456.
It also adds a number of new tests with small block sizes, that focus on directory operations.
Notably, it also bumps the min data version that can be read by the client.  This is needed for the tests, and we might as well enable reading for production clients now too.  (Actually dir splitting is still off until we start calling SetMaxDirEntriesByBlockSize during the regular init code.)
Issue: KBFS-3304

@jzila, @songgao: This is ready for review now, and is the last PR we need to get in before Monday's release.

repo: keybase/kbfs