text:
OmniSharp stopped working after update to 1.1.4

Environment data
dotnet --info output:

.NET Command Line Tools (1.0.0-preview1-002702)
Product Information:
Version:     1.0.0-preview1-002702
Commit Sha:  6cde21225e
Runtime Environment:
OS Name:     Windows
OS Version:  10.0.10586
OS Platform: Windows
RID:         win10-x64

VS Code version: 1.2.0
C# Extension version: 1.1.4
Steps to reproduce
dotnet new
dotnet restore
code .
Start typeing some code for autocomplete
Expected  behavior
Autocomplete work.
Actual behavior
No autocomplete, exception in omnisharp log:

[INFO] Starting OmniSharp at 'c:\Users\user\Desktop\Nowy folder'...
[INFO] Started OmniSharp from 'C:\Users\user.vscode\extensions\ms-vscode.csharp-1.1.4.omnisharp\OmniSharp.exe' with process id 8628...
OmniSharp: -s c:\Users\user\Desktop\Nowy folder --hostPID 4980 dnx:enablePackageRestore=false --stdio
[INFORMATION:OmniSharp.Startup] Omnisharp server running using Stdio at location 'c:\Users\user\Desktop\Nowy folder' on host 4980.
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Initializing in c:\Users\user\Desktop\Nowy folder
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Auto package restore: True
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Update workspace context
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Update project c:\Users\user\Desktop\Nowy folder
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Add project c:\Users\user\Desktop\Nowy folder\project.json => dfcbe7ac-86d0-45c7-87d3-30ecdd58ed53
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem] Resolving projects references
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem]   Processing [ProjectState] Nowy folder/.NETCoreApp,Version=v1.0
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem]     Added 74 and removed 0 file references
[INFORMATION:OmniSharp.DotNet.DotNetProjectSystem]     Added 1 and removed 0 documents.
[INFORMATION:OmniSharp.MSBuild.MSBuildProjectSystem] No solution files found in 'c:\Users\user\Desktop\Nowy folder'
[INFORMATION:OmniSharp.ScriptCs.ScriptCsProjectSystem] Detecting CSX files in 'c:\Users\user\Desktop\Nowy folder'.
[INFORMATION:OmniSharp.ScriptCs.ScriptCsProjectSystem] Could not find any CSX files
[INFORMATION:OmniSharp.Startup] Configuration finished.
[ERROR:Microsoft.AspNetCore.Diagnostics.ExceptionHandlerMiddleware] An unhandled exception has occurred: The type initializer for 'OmniSharp.CSharpSyntaxContext' threw an exception.
[INFORMATION:OmniSharp.Middleware.LoggingMiddleware] /autocomplete: 500 67ms
[ERROR:Microsoft.AspNetCore.Diagnostics.ExceptionHandlerMiddleware] An unhandled exception has occurred: The type initializer for 'OmniSharp.CSharpSyntaxContext' threw an exception.
[INFORMATION:OmniSharp.Middleware.LoggingMiddleware] /autocomplete: 500 12ms
[INFORMATION:OmniSharp.Middleware.LoggingMiddleware] /v2/getcodeactions: 200 824ms

It was working yesterday before update to 1.1.4 (1.0.11 if I remember right).

The same for me.

@troydai -- do you know anything about the exception being thrown in the log above?

FYI -- I can reproduce the problem. Thanks for the heads up!

I have no idea now. But I can take a look now.

Can't repo on mac. But the original repo is on Windows.

No worries. I'm looking too.

@troydai, note that the extension is using v1.9-beta4 of OmniSharp.

I can't repro on OSX either. One other thing @troydai, it's using the net451 build of v1.9-beta4 on Windows.

I can repo it. I suspect it is caused unmatched dotnet and project model.

Looks like the problem's been there awhile, but got fixed at some point. I sync'd back to v1.9-beta4 and rebuilt OmniSharp and can repro. I can't repro with the latest dev branch though.

I'll take a look at updating OmniSharp in the extension

FWIW, it looks like the class in question, CSharpSyntaxContext does a bunch of reflection calls in its static constructor.

Yup -- it fails right here: https://github.com/OmniSharp/omnisharp-roslyn/blob/dev/src/OmniSharp.Roslyn.CSharp/Workers/Intellisense/CSharpSyntaxContext.cs#L438

OK. I've pushed a new release (1.1.5) to the marketplace that fixes the problem. @sec and @PiterGoCompany, could you update the C# extension from within Visual Studio Code and let me know if you're up and running again? Thanks!

The new release seems to work for me.

Also working here. Thanks.

1.1.5 also working here

I think we can close this one then.

Yup! Thanks all for reporting this so quickly and helping us get this fixed.

source: gharchive/issue

authors: DustinCampbell PiterGoCompany Schnigle alexgwolff sec troydai

license: mit

license_type: permissive

license_source: bigquery


text:
Unity Intellisense not working at all anymore.

I have created multiple Unity projects, but to no avail. Console keeps logging whenever I type (more later), and I have tried updating to 1.23.6 beta and downgrading to 1.23.2. I have updated all of the Unity packages involving it, and the Unity version I am using is 2020.1.4f1.
Normal basic C# suggestions are coming up, like public and int but no unity objects like Transform or etc.

On load of OmniSharp, username redacted

Starting OmniSharp server at 11/9/2020, 11:06:59 AM
    Target: /Users/REDACTED/FPStry2/FPStry2.sln

OmniSharp server started.
    Path: /Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/run
    PID: 17213

[info]: OmniSharp.Stdio.Host
        Starting OmniSharp on MacOS 10.14.6 (x64)
[info]: OmniSharp.Services.DotNetCliService
        DotNetPath set to dotnet
[info]: OmniSharp.MSBuild.Discovery.MSBuildLocator
        Located 1 MSBuild instance(s)
            1: StandAlone 16.8.0 - "/Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild/Current/Bin"
[info]: OmniSharp.MSBuild.Discovery.MSBuildLocator
        MSBUILD_EXE_PATH environment variable set to '/Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild/Current/Bin/MSBuild.exe'
[info]: OmniSharp.MSBuild.Discovery.MSBuildLocator
        Registered MSBuild instance: StandAlone 16.8.0 - "/Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild/Current/Bin"
            CscToolExe = csc.exe
            MSBuildToolsPath = /Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild/Current/Bin
            CscToolPath = /Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild/Current/Bin/Roslyn
            BypassFrameworkInstallChecks = true
            MSBuildExtensionsPath = /Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.2/.omnisharp/1.37.1/omnisharp/.msbuild
[info]: OmniSharp.Cake.CakeProjectSystem
        Detecting Cake files in '/Users/REDACTED/FPStry2'.
[info]: OmniSharp.Cake.CakeProjectSystem
        Could not find any Cake files
[info]: OmniSharp.MSBuild.ProjectSystem
        Detecting projects in '/Users/REDACTED/FPStry2/FPStry2.sln'.
[info]: OmniSharp.Script.ScriptProjectSystem
        Detecting CSX files in '/Users/REDACTED/FPStry2'.
[info]: OmniSharp.Script.ScriptProjectSystem
        Could not find any CSX files
[info]: OmniSharp.WorkspaceInitializer
        Invoking Workspace Options Provider: OmniSharp.Roslyn.CSharp.Services.CSharpFormattingWorkspaceOptionsProvider, Order: 0
[info]: OmniSharp.WorkspaceInitializer
        Invoking Workspace Options Provider: OmniSharp.Roslyn.CSharp.Services.Completion.CompletionOptionsProvider, Order: 0
[info]: OmniSharp.WorkspaceInitializer
        Invoking Workspace Options Provider: OmniSharp.Roslyn.CSharp.Services.RenameWorkspaceOptionsProvider, Order: 100
[info]: OmniSharp.WorkspaceInitializer
        Invoking Workspace Options Provider: OmniSharp.Roslyn.CSharp.Services.ImplementTypeWorkspaceOptionsProvider, Order: 110
[info]: OmniSharp.WorkspaceInitializer
        Invoking Workspace Options Provider: OmniSharp.Roslyn.CSharp.Services.BlockStructureWorkspaceOptionsProvider, Order: 140
[info]: OmniSharp.WorkspaceInitializer
        Configuration finished.
[info]: OmniSharp.Stdio.Host
        Omnisharp server running using Stdio at location '/Users/REDACTED/FPStry2' on host 17113.
[info]: OmniSharp.OmniSharpWorkspace
        Miscellaneous file: /Users/REDACTED/FPStry2/Assets/PlayerMove.cs added to workspace

I used to get this on editing a file, but it doesn't seem to happen now, but that's probably because i am currently on 1.23.2.
[info]: OmniSharp.Roslyn.CSharp.Services.Completion.CompletionService Could not find document for file:  /Users/REDACTED/FPStry2/Assets/PlayerMove.cs
I have seen. similar issues and tried fixes, but to no avail.
Specs: MacBook Air 2017 13-inch
If this breaks any rules, inform me and I'll fix it.

Just got something new:
[fail]: OmniSharp.MSBuild.ProjectLoader
        The reference assemblies for .NETFramework,Version=v4.7.1 were not found. To resolve this, install the Developer Pack (SDK/Targeting Pack) for this framework version or retarget your application. You can download .NET Framework Developer Packs at https://aka.ms/msbuild/developerpacks
[warn]: OmniSharp.MSBuild.ProjectManager
        Failed to load project file '/Users/REDACTED/FPStry2/Assembly-CSharp.csproj'.
/Users/REDACTED/FPStry2/Assembly-CSharp.csproj
/Users/REDACTED/.vscode/extensions/ms-dotnettools.csharp-1.23.6/.omnisharp/1.37.3/omnisharp/.msbuild/Current/Bin/Microsoft.Common.CurrentVersion.targets(1180,5): Error: The reference assemblies for .NETFramework,Version=v4.7.1 were not found. To resolve this, install the Developer Pack (SDK/Targeting Pack) for this framework version or retarget your application. You can download .NET Framework Developer Packs at https://aka.ms/msbuild/developerpacks

[fail]: OmniSharp.MSBuild.ProjectManager
        Attempted to update project that is not loaded: /Users/REDACTED/FPStry2/Assembly-CSharp.csproj

Nevermind, my fix was either

Completely uninstalling and reinstalling the extension
Updating Visual Studio from their website

it was one of them, not sure which because I did both.

repo: OmniSharp/omnisharp-vscode


text:
Show explanatory message about scheduled arrivals on Bookmarks tab

Fixes #686 - The bookmarks tab should explain what an '*' means on a scheduled route

Add 'scheduled departure' string to OBAStrings and use it on bookmarks and stops view controllers
Show a 'scheduled departure' footer on the bookmarks view controller when one or more of its departures lacks real time data
Make it easier to add a footer to a table view when DZNEmptyDataSet is being used
Extract a helper method for determining if an ArrivalAndDepartureForStop object lacks real time data
Find another possible source of the "non-modular includes" errors and (fingers crossed) maybe actually fix it this time

👍

source: gharchive/pull-request

authors: aaronbrethorst chadsy

repo: OneBusAway/onebusaway-iphone


text:
HYOE is happy

bot should be happy when hyoe'd at. not sad.

The bot may be be happy but I am not. Hence the sadness :(

authors: Denneledoe LongarMD

license: MIT

license_source: github-api


text:
Enhancement: Number of retries criteria

Is your feature request related to a problem? Please describe.
When you have a monitor that polls very frequently (say every minute), network issues, or server priorities may prevent the ping from happening succesfully, causing false positive incidents to be created.
Describe the solution you'd like
It would be great if there was a retry option, either implemented in the following ways:

On a failed polling, retry up to X times. e.g. if a ping fails on a probe, imediately follow it with another ping before reporting back to the probe-api.
As part of the Criteria, choose if any or all probes need to report the monitor as offline. This could be as simple as a checkbox and a number field to a) select the probes, and b) choose how many probes need to report offline for the criteria to be met. This would create an excellent benefit where you could mark a service as degraded if not reachable from only one probe, and still have a criteria to mark as offline if not reachable from all probes.
Probe fails X times in a row. e.g. If you have a monitor with an interval of every minute, then you may want the criteria to only match if the probe fails 5 times in a row.
Delay incident creation by X minutes. e.g Very similar to X times in a row, however, could be used differently. This solution could try testing the monitor again in X minutes, then, and then open an incident if still reporting as offline. This would have the benefit of trying again (but not straight away like the first suggestion), allowing a monitor to have a longer interval (say 30 minutes) but still get an incident created within a couple of minutes if the retry time is set to a low value (such as 2 minutes).

Describe alternatives you've considered
I haven't been able to find any alternative to achieve this.
Additional context
As a new user of OneUpTime, I recieved a few hundred emails over night from a ping monitor which was monitoring a DNS server. The server was never actually down, it's just the ping packets didn't come through due to network load at the time of attempt.

Prior to writing this, I did look through the list of issues and didn't see anything like this, then I changed views and instantly saw #750 . So I'll close this and comment there.

repo: OneUptime/oneuptime


text:
Split _load_collection depending on FetchType

As this function is getting longer (which is why I get the creation of _load_collection_hybrid) we might consider splitting of the pre and post processing of the different fetchtypes. That way it might be easier to find the differences both as a user and future developer.
Not sure if this is in the scope of this PR however, we could create an issue for this.
Originally posted by @VictorVerhaert in https://github.com/Open-EO/openeo-gfmap/pull/130#discussion_r1645660252

https://github.com/Open-EO/openeo-gfmap/pulls#discussion_r1645666509

repo: Open-EO/openeo-gfmap


text:
Testing oni-ml

Hello,
I'm having an issue with oni-ml: when I launch ml_ops it stays in the next state:

./ml_ops.sh 20110812 dns
17/05/31 14:14:38 INFO Remoting: Starting remoting
17/05/31 14:14:38 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.18.0.4:33197]
spark.yarn.driver.memoryOverhead is set but does not apply in client mode.
spark.driver.cores is set but does not apply in client mode.
[Stage 0:>                                                          (0 + 0) / 2]

If I try to run oni-oa to get results there is no output from oni-ml:

python2.7 start_oa.py -d 20110812 -t dns -l 10000
2017-05-31 14:27:57,288 - OA - INFO - -------------------- STARTING OA ---------------------
2017-05-31 14:27:57,289 - OA - INFO - Validating input parameter values
2017-05-31 14:27:57,306 - OA.DATA - INFO - Reading data component configuration: /root/oni-oa/oa/components/data/engine.json
2017-05-31 14:27:57,307 - OA.DATA - INFO - Initializating hive instance
2017-05-31 14:27:57,307 - OA.DNS - INFO - Creating folder structure for OA (data and ipynb)
2017-05-31 14:27:57,307 - OA.DNS - INFO - Adding edge investigation IPython Notebook
2017-05-31 14:27:57,307 - OA.DNS - INFO - Adding threat investigation IPython Notebook
2017-05-31 14:27:57,308 - OA.DNS - INFO - Getting 20110812 Machine Learning Results from HDFS
get: `/user/duxbury/dns/scored_results/20110812/scores/dns_results.csv': No such file or directory
2017-05-31 14:27:59,460 - OA.DNS - INFO - hadoop fs -get /user/duxbury/dns/scored_results/20110812/scores/dns_results.csv /root/oni-oa/data/dns/20110812/.
2017-05-31 14:27:59,460 - OA.DNS - ERROR - There was an error getting ML results from HDFS

I've ingested a 100MB pcap from a botnet:

hadoop fs -ls /user/duxbury/dns/hive/y=2011/m=08/d=12/h=12/
Found 1 items
-rw-r--r--   2 root supergroup       2656 2017-05-31 14:14 /user/duxbury/dns/hive/y=2011/m=08/d=12/h=12/000000_0

Is there something wrong? What is the expected output from oni-ml?
Thanks,

Hi @jpferrero
ONI development has been moved into Apache Software Foundation under the name of Apache Spot (incubating). Thus you might be running an old version
You can find the links below:
Web site - http://spot.apache.org/
Git repo - https://github.com/apache/incubator-spot
Mailing list for issues reporting and contributions - http://spot.apache.org/community/
OA error refers that could not find a oni-ml results file.
get: `/user/duxbury/dns/scored_results/20110812/scores/dns_results.csv': No such file or directory
I would recommend to upgrade into latest code version

Thanks, that solved the problem. Now with the latest version of Apache Spot I get the following:

./ml_ops.sh 20170531 dns 1e-4
17/05/31 16:42:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/05/31 16:42:44 INFO Remoting: Starting remoting
17/05/31 16:42:44 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.18.0.4:33985]
17/05/31 16:42:54 WARN spark.SparkContext: Dynamic Allocation and num executors both set, thus dynamic allocation disabled.
17/05/31 16:42:59 INFO SuspiciousConnectsAnalysis: Loading data from: /user/spot/dns/hive/y=2017/m=05/d=31/
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Starting DNS suspicious connects analysis.
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Fitting probabilistic model to data
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Training DNS suspicious connects model from /user/spot/dns/hive/y=2017/m=05/d=31/
17/05/31 16:43:20 INFO SuspiciousConnectsAnalysis: Running Spark LDA with params alpha = 1.02 beta = 1.001 Max iterations = 20 Optimizer = em
Exception in thread "main" java.util.NoSuchElementException: next on empty iterator
at scala.collection.Iterator$$anon$2.next(Iterator.scala:39)
at scala.collection.Iterator$$anon$2.next(Iterator.scala:37)
at scala.collection.IndexedSeqLike$Elements.next(IndexedSeqLike.scala:64)
at scala.collection.IterableLike$class.head(IterableLike.scala:91)
at scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$head(ArrayOps.scala:108)
at scala.collection.IndexedSeqOptimized$class.head(IndexedSeqOptimized.scala:120)
at scala.collection.mutable.ArrayOps$ofRef.head(ArrayOps.scala:108)
at org.apache.spark.mllib.clustering.EMLDAOptimizer.initialize(LDAOptimizer.scala:141)
at org.apache.spark.mllib.clustering.LDA.run(LDA.scala:324)
at org.apache.spot.lda.SpotLDAWrapper$.runLDA(SpotLDAWrapper.scala:113)
at org.apache.spot.dns.model.DNSSuspiciousConnectsModel$.trainNewModel(DNSSuspiciousConnectsModel.scala:278)
at org.apache.spot.dns.DNSSuspiciousConnectsAnalysis$.scoreDNSRecords(DNSSuspiciousConnectsAnalysis.scala:99)
at org.apache.spot.dns.DNSSuspiciousConnectsAnalysis$.run(DNSSuspiciousConnectsAnalysis.scala:58)
at org.apache.spot.SuspiciousConnects$.main(SuspiciousConnects.scala:73)
at org.apache.spot.SuspiciousConnects.main(SuspiciousConnects.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

What does it mean?
Thanks,

Hi jpferrero,
Let’s move to Apache Spot user mailing list, it’s an interesting error what you got here and it’d worth it to share with all the community.
Thanks.
From: jpferrero notifications@github.com
Reply-To: Open-Network-Insight/open-network-insight reply@reply.github.com
Date: Wednesday, May 31, 2017 at 11:45 AM
To: Open-Network-Insight/open-network-insight open-network-insight@noreply.github.com
Cc: Subscribed subscribed@noreply.github.com
Subject: Re: [Open-Network-Insight/open-network-insight] Testing oni-ml (#182)
Thanks, that solved the problem. Now with the latest version of Apache Spot I get the following:
./ml_ops.sh 20170531 dns 1e-4
17/05/31 16:42:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/05/31 16:42:44 INFO Remoting: Starting remoting
17/05/31 16:42:44 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriverActorSystem@172.18.0.4:33985]
17/05/31 16:42:54 WARN spark.SparkContext: Dynamic Allocation and num executors both set, thus dynamic allocation disabled.
17/05/31 16:42:59 INFO SuspiciousConnectsAnalysis: Loading data from: /user/spot/dns/hive/y=2017/m=05/d=31/
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Starting DNS suspicious connects analysis.
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Fitting probabilistic model to data
17/05/31 16:43:07 INFO SuspiciousConnectsAnalysis: Training DNS suspicious connects model from /user/spot/dns/hive/y=2017/m=05/d=31/
17/05/31 16:43:20 INFO SuspiciousConnectsAnalysis: Running Spark LDA with params alpha = 1.02 beta = 1.001 Max iterations = 20 Optimizer = em
Exception in thread "main" java.util.NoSuchElementException: next on empty iterator
at scala.collection.Iterator$$anon$2.next(Iterator.scala:39)
at scala.collection.Iterator$$anon$2.next(Iterator.scala:37)
at scala.collection.IndexedSeqLike$Elements.next(IndexedSeqLike.scala:64)
at scala.collection.IterableLike$class.head(IterableLike.scala:91)
at scala.collection.mutable.ArrayOps$ofRef.scala$collection$IndexedSeqOptimized$$super$head(ArrayOps.scala:108)
at scala.collection.IndexedSeqOptimized$class.head(IndexedSeqOptimized.scala:120)
at scala.collection.mutable.ArrayOps$ofRef.head(ArrayOps.scala:108)
at org.apache.spark.mllib.clustering.EMLDAOptimizer.initialize(LDAOptimizer.scala:141)
at org.apache.spark.mllib.clustering.LDA.run(LDA.scala:324)
at org.apache.spot.lda.SpotLDAWrapper$.runLDA(SpotLDAWrapper.scala:113)
at org.apache.spot.dns.model.DNSSuspiciousConnectsModel$.trainNewModel(DNSSuspiciousConnectsModel.scala:278)
at org.apache.spot.dns.DNSSuspiciousConnectsAnalysis$.scoreDNSRecords(DNSSuspiciousConnectsAnalysis.scala:99)
at org.apache.spot.dns.DNSSuspiciousConnectsAnalysis$.run(DNSSuspiciousConnectsAnalysis.scala:58)
at org.apache.spot.SuspiciousConnects$.main(SuspiciousConnects.scala:73)
at org.apache.spot.SuspiciousConnects.main(SuspiciousConnects.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
What does it mean?
Thanks,
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/Open-Network-Insight/open-network-insight/issues/182#issuecomment-305246825, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AQR5rX2G1yOs0sEMUpm-1hfm3bBlmu8gks5r_ZkWgaJpZM4NruJb.

authors: jpferrero rabarona vgonzale78


text:
AndroidBuild

Hello,
I have some problems, could you please help me out?
I finish your tutorial and go to the next step AndroidBuild
I run
"lunch"
and it appears the menu like this
"    1. full-eng
2. full_x86-eng
3. vbox_x86-eng
"- only 3 options.
I chose 1 (also check with 2 and 3)
However, when I run "make clean && make ..."
the error shows
" PLATFORM_VERSION_CODENAME=REL
PLATFORM_VERSION=4.0.1
TARGET_PRODUCT=full
TARGET_BUILD_VARIANT=eng
TARGET_BUILD_TYPE=release
TARGET_BUILD_APPS=
TARGET_ARCH=arm
TARGET_ARCH_VARIANT=armv7-a
HOST_ARCH=x86
HOST_OS=linux
HOST_BUILD_TYPE=release
BUILD_ID=ITL41D
Checking build tools versions...
make: *** No rule to make target `opentee-engine'.  Stop.
"

The "no rule to make target...." error appears when the Android.mk files of opentee-engine are not visible in the android source tree you have.
Have you done the symlink step mentioned in the android tutorial?
The goal is to have the following directory structure
android_sourcetree/
------------------------->opentee/
------------------------------------->emulator/
------------------------------------->libtee/
etc....

The android make searches in all the subdirectories in it's root dir to find the makefiles for the specific modules mentioned.

Thanks for your reply,
I make a link already
I saw Android.mk in the following directory structure
(Android_Envi is the source)
/home/user/Android_Envi/Open-TEE
In my system, the directory structure look likes your mention:
Android_Envi
- Open-TEE
-emulator
- libtee
-Android.mk
etc.
I check and run it again. But it is still not work

This is weird.

Are you running all the commands from bash or from zsh? Only bash is compatible with the android build system for now.

Have you setup the following environment variables?
export ANDROID_ROOT="$HOME/Android_Envi"
$ANDROID_ROOT/prebuilts/misc/linux-x86/ccache/ccache -M 50G
source "$ANDROID_ROOT/build/envsetup.sh"

It seems weird that your sourcetree has only 3 lunch targets. Usually the official AOSP has >5 available. Have you tried with the AOSP tree as well?

I'm assuming you have synced opentee with the latest changes in the repos?

Thank you very much,
I have done all things which you mentioned but it still not working
I will re-setup my system, and do it again. I really want to work on TEE

Hello I am experiencing the following issue when I invoke make clean && make opentee-engine libManagerApi libInternalApi libLauncherApi libCommonApi libta_conn_test_app conn_test_app libtee
Which results in the following error:
Starting build with ninja
ninja: Entering directory `.'
ninja: error: unknown target 'opentee-engine'
build/core/ninja.mk:123: recipe for target 'ninja.intermediate' failed
make: *** [ninja.intermediate] Error 1

When I run lunch it outputs:
You're building on Linux

Lunch menu... pick a combo:
     1. aosp_arm-eng
     2. aosp_arm64-eng
     3. aosp_mips-eng
     4. aosp_mips64-eng
     5. aosp_x86-eng
     6. aosp_x86_64-eng

Which would you like? [aosp_arm-eng]

I have made a Symlink to Open-TEE project as opentee in my android_source folder. As mentioned above I have also set the environment variables inside of bash.
Any suggestions would be much appreciated.
Thanks.

For some reason it cannot find the Android.mk make file that contains the opentee-engine module. This file is in emulator/opentee-main/Android.mk and in each directory from $ANDROID_SOURCE_ROOT till opentee-main/ there should be an Android.mk file that instructs the build to continue to all subdirectories.
Can you do ls -la in your android_source/ folder  and then ls -laR android_source/Open-TEE/ so that the full structure is visible? If you just try to make libtee does it still fail?
I assume you run the lunch and make commands inside the android_source directory.

ls -la produces:
jorden@Phantom:~/Android/android_source$ ls -al
total 120
drwxrwxr-x  29 jorden jorden 4096 Sep 29 19:43 .
drwxrwxr-x   5 jorden jorden 4096 Sep 29 16:37 ..
drwxrwxr-x   3 jorden jorden 4096 Sep 29 12:03 abi
lrwxrwxrwx   1 jorden jorden   19 Sep 29 12:03 Android.bp -> build/soong/root.bp
drwxrwxr-x  19 jorden jorden 4096 Sep 29 12:03 art
drwxrwxr-x  12 jorden jorden 4096 Sep 29 12:03 bionic
drwxrwxr-x   3 jorden jorden 4096 Sep 29 12:03 bootable
lrwxrwxrwx   1 jorden jorden   26 Sep 29 12:03 bootstrap.bash -> build/soong/bootstrap.bash
drwxrwxr-x  10 jorden jorden 4096 Sep 29 12:03 build
drwxrwxr-x  18 jorden jorden 4096 Sep 29 15:31 .ccache
drwxrwxr-x  12 jorden jorden 4096 Sep 29 12:03 cts
drwxrwxr-x  10 jorden jorden 4096 Sep 29 12:03 dalvik
drwxrwxr-x   6 jorden jorden 4096 Sep 29 12:03 developers
drwxrwxr-x  21 jorden jorden 4096 Sep 29 12:03 development
drwxrwxr-x  11 jorden jorden 4096 Sep 29 12:03 device
drwxrwxr-x   3 jorden jorden 4096 Sep 29 12:03 docs
drwxrwxr-x 217 jorden jorden 4096 Sep 29 12:04 external
drwxrwxr-x  17 jorden jorden 4096 Sep 29 12:04 frameworks
drwxrwxr-x  13 jorden jorden 4096 Sep 29 12:04 hardware
drwxrwxr-x  17 jorden jorden 4096 Sep 29 12:04 libcore
drwxrwxr-x   5 jorden jorden 4096 Sep 29 12:04 libnativehelper
-r--r--r--   1 jorden jorden   87 Sep 29 12:03 Makefile
drwxrwxr-x   8 jorden jorden 4096 Sep 29 12:04 ndk
lrwxrwxrwx   1 jorden jorden   29 Sep 29 19:43 Open-TEE -> /home/jorden/Android/Open-TEE
drwxrwxr-x   4 jorden jorden 4096 Sep 29 16:43 out
drwxrwxr-x   9 jorden jorden 4096 Sep 29 12:04 packages
drwxrwxr-x   6 jorden jorden 4096 Sep 29 12:04 pdk
drwxrwxr-x  19 jorden jorden 4096 Sep 29 12:05 prebuilts
drwxrwxr-x   7 jorden jorden 4096 Sep 29 12:03 .repo
drwxrwxr-x  25 jorden jorden 4096 Sep 29 12:05 sdk
drwxrwxr-x  24 jorden jorden 4096 Sep 29 12:05 system
drwxrwxr-x   3 jorden jorden 4096 Sep 29 12:05 toolchain
drwxrwxr-x   3 jorden jorden 4096 Sep 29 12:05 tools

Then running ls -laR android_source/Open-TEE/ shows me the full structure as expected. I can post the output if you want but is large.
Yes I am running in the android_source folder. I have run lunch then make clean then make libtee I then get the following error:
Starting build with ninja
ninja: Entering directory `.'
ninja: error: unknown target 'libtee', did you mean 'libfec'?
build/core/ninja.mk:123: recipe for target 'ninja.intermediate' failed
make: *** [ninja.intermediate] Error 1

#### make failed to build some targets (23 seconds) ####

Any thoughts on why this might not build?
When I download the project with repo I did not use the -m developer.xml would this make a difference?

I always use the -m developer.xml option but it shouldn't make any difference. It's the same tree.
The Android.mk files in Open-TEE/ and Open-TEE/emulator should have
    LOCAL_PATH := $(my-dir)
    include $(call all-makefiles-under,$(LOCAL_PATH))

in them.

Both Android.mk have the exact content as shown above. The includes are when running make libtee are:
Checking build tools versions...
including ./abi/cpp/Android.mk ...
including ./art/Android.mk ...
including ./bionic/Android.mk ...
including ./bootable/recovery/Android.mk ...
including ./build/libs/host/Android.mk ...
including ./build/target/board/Android.mk ...
including ./build/target/product/security/Android.mk ...
including ./build/tools/Android.mk ...
including ./cts/Android.mk ...
including ./dalvik/Android.mk ...
including ./development/apps/BluetoothDebug/Android.mk ...
including ./development/apps/BuildWidget/Android.mk ...
including ./development/apps/CustomLocale/Android.mk ...
including ./development/apps/Development/Android.mk ...
including ./development/apps/DevelopmentSettings/Android.mk ...
including ./development/apps/Fallback/Android.mk ...
including ./development/apps/GestureBuilder/Android.mk ...
including ./development/apps/NinePatchLab/Android.mk ...
including ./development/apps/OBJViewer/Android.mk ...
including ./development/apps/SdkSetup/Android.mk ...
including ./development/apps/SettingInjectorSample/Android.mk ...
including ./development/apps/WidgetPreview/Android.mk ...
including ./development/apps/launchperf/Android.mk ...
including ./development/build/Android.mk ...
including ./development/cmds/monkey/Android.mk ...
including ./development/host/windows/prebuilt/usb/Android.mk ...
including ./development/ndk/Android.mk ...
including ./development/perftests/panorama/Android.mk ...
including ./development/samples/AccelerometerPlay/Android.mk ...
including ./development/samples/ActionBarCompat/Android.mk ...
including ./development/samples/AliasActivity/Android.mk ...
including ./development/samples/AndroidBeamDemo/Android.mk ...
including ./development/samples/ApiDemos/Android.mk ...
including ./development/samples/AppNavigation/Android.mk ...
including ./development/samples/BackupRestore/Android.mk ...
including ./development/samples/BasicGLSurfaceView/Android.mk ...
including ./development/samples/BluetoothChat/Android.mk ...
including ./development/samples/BluetoothHDP/Android.mk ...
including ./development/samples/BusinessCard/Android.mk ...
including ./development/samples/Compass/Android.mk ...
including ./development/samples/ContactManager/Android.mk ...
including ./development/samples/CubeLiveWallpaper/Android.mk ...
including ./development/samples/FixedGridLayout/Android.mk ...
including ./development/samples/HeavyWeight/Android.mk ...
including ./development/samples/HelloActivity/Android.mk ...
including ./development/samples/HelloEffects/Android.mk ...
including ./development/samples/Home/Android.mk ...
including ./development/samples/HoneycombGallery/Android.mk ...
including ./development/samples/JetBoy/Android.mk ...
including ./development/samples/KeyChainDemo/Android.mk ...
including ./development/samples/LunarLander/Android.mk ...
including ./development/samples/MultiResolution/Android.mk ...
including ./development/samples/MySampleRss/Android.mk ...
including ./development/samples/NotePad/Android.mk ...
including ./development/samples/Obb/Android.mk ...
including ./development/samples/RSSReader/Android.mk ...
including ./development/samples/RandomMusicPlayer/Android.mk ...
including ./development/samples/RenderScript/Android.mk ...
including ./development/samples/SampleSyncAdapter/Android.mk ...
including ./development/samples/SearchableDictionary/Android.mk ...
including ./development/samples/SimpleJNI/Android.mk ...
including ./development/samples/SipDemo/Android.mk ...
including ./development/samples/SkeletonApp/Android.mk ...
including ./development/samples/Snake/Android.mk ...
including ./development/samples/SoftKeyboard/Android.mk ...
including ./development/samples/SpellChecker/Android.mk ...
including ./development/samples/StackWidget/Android.mk ...
including ./development/samples/Support13Demos/Android.mk ...
including ./development/samples/Support4Demos/Android.mk ...
including ./development/samples/Support7Demos/Android.mk ...
including ./development/samples/SupportAppNavigation/Android.mk ...
including ./development/samples/SupportDesignDemos/Android.mk ...
including ./development/samples/SupportLeanbackDemos/Android.mk ...
including ./development/samples/ToyVpn/Android.mk ...
including ./development/samples/TtsEngine/Android.mk ...
including ./development/samples/USB/Android.mk ...
including ./development/samples/UiAutomator/Android.mk ...
including ./development/samples/Vault/Android.mk ...
including ./development/samples/VoiceRecognitionService/Android.mk ...
including ./development/samples/VoicemailProviderDemo/Android.mk ...
including ./development/samples/WeatherListWidget/Android.mk ...
including ./development/samples/WiFiDirectDemo/Android.mk ...
including ./development/samples/WiFiDirectServiceDiscovery/Android.mk ...
including ./development/samples/Wiktionary/Android.mk ...
including ./development/samples/WiktionarySimple/Android.mk ...
including ./development/samples/XmlAdapters/Android.mk ...
including ./development/samples/training/NsdChat/Android.mk ...
including ./development/testrunner/Android.mk ...
including ./development/tools/apkcheck/Android.mk ...
including ./development/tools/emulator/test-apps/SmokeTests/Android.mk ...
including ./development/tools/etc1tool/Android.mk ...
including ./development/tools/hosttestlib/Android.mk ...
including ./development/tools/idegen/Android.mk ...
including ./development/tools/line_endings/Android.mk ...
including ./development/tools/mkstubs/Android.mk ...
including ./development/tools/recovery_l10n/Android.mk ...
including ./development/tools/rmtypedefs/Android.mk ...
including ./development/tools/yuv420sp2rgb/Android.mk ...
including ./development/tutorials/MoarRam/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv1/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv1Solution/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv2/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv2Solution/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv3/Android.mk ...
including ./development/tutorials/NotepadCodeLab/Notepadv3Solution/Android.mk ...
including ./development/tutorials/ReverseDebug/Android.mk ...
including ./device/asus/deb/dumpstate/Android.mk ...
including ./device/asus/deb/self-extractors/Android.mk ...
including ./device/asus/flo/Android.mk ...
including ./device/asus/fugu/Android.mk ...
including ./device/asus/grouper/Android.mk ...
including ./device/asus/tilapia/recovery/Android.mk ...
including ./device/asus/tilapia/self-extractors/Android.mk ...
including ./device/generic/goldfish/audio/Android.mk ...
including ./device/generic/goldfish/camera/Android.mk ...
including ./device/generic/goldfish/gps/Android.mk ...
including ./device/generic/goldfish/lights/Android.mk ...
including ./device/generic/goldfish/opengl/Android.mk ...
including ./device/generic/goldfish/power/Android.mk ...
including ./device/generic/goldfish/qemu-props/Android.mk ...
including ./device/generic/goldfish/qemud/Android.mk ...
including ./device/generic/goldfish/sensors/Android.mk ...
including ./device/generic/goldfish/vibrator/Android.mk ...
including ./device/google/accessory/arduino/Android.mk ...
including ./device/google/accessory/demokit/Android.mk ...
including ./device/google/atv/LeanbackSampleApp/Android.mk ...
including ./device/google/atv/sdk/Android.mk ...
including ./device/htc/flounder/Android.mk ...
including ./device/lge/hammerhead/Android.mk ...
including ./device/lge/mako/Android.mk ...
including ./device/moto/shamu/Android.mk ...
including ./device/sample/Android.mk ...
including ./device/samsung/manta/Android.mk ...
including ./docs/source.android.com/Android.mk ...
including ./external/aac/Android.mk ...
including ./external/android-clat/Android.mk ...
including ./external/ant-glob/Android.mk ...
including ./external/antlr/Android.mk ...
including ./external/apache-harmony/Android.mk ...
including ./external/apache-xml/Android.mk ...
including ./external/avahi/Android.mk ...
including ./external/bison/Android.mk ...
including ./external/blktrace/Android.mk ...
including ./external/boringssl/Android.mk ...
including ./external/bouncycastle/Android.mk ...
including ./external/bsdiff/Android.mk ...
including ./external/bzip2/Android.mk ...
including ./external/c-ares/Android.mk ...
including ./external/cblas/Android.mk ...
including ./external/ceres-solver/Android.mk ...
including ./external/chromium-libpac/Android.mk ...
including ./external/chromium_org/Android.mk ...
including ./external/clang/Android.mk ...
including ./external/compiler-rt/Android.mk ...
including ./external/conscrypt/Android.mk ...
including ./external/cryptsetup/Android.mk ...
including ./external/curl/Android.mk ...
including ./external/dbus-binding-generator/Android.mk ...
including ./external/dbus/Android.mk ...
including ./external/deqp/Android.mk ...
including ./external/dexmaker/Android.mk ...
including ./external/dhcpcd-6.8.2/Android.mk ...
including ./external/dhcpcd/Android.mk ...
including ./external/dnsmasq/Android.mk ...
including ./external/doclava/Android.mk ...
including ./external/droiddriver/Android.mk ...
including ./external/e2fsprogs/Android.mk ...
including ./external/easymock/Android.mk ...
including ./external/eclipse-windowbuilder/propertysheet/Android.mk ...
including ./external/eigen/Android.mk ...
including ./external/elfutils/Android.mk ...
including ./external/emma/Android.mk ...
including ./external/expat/Android.mk ...
including ./external/eyes-free/Android.mk ...
including ./external/f2fs-tools/Android.mk ...
including ./external/fdlibm/Android.mk ...
including ./external/fec/Android.mk ...
including ./external/fio/Android.mk ...
including ./external/flac/Android.mk ...
including ./external/freetype/Android.mk ...
including ./external/fsck_msdos/Android.mk ...
including ./external/gemmlowp/Android.mk ...
including ./external/giflib/Android.mk ...
including ./external/glide/Android.mk ...
including ./external/gmock/Android.mk ...
including ./external/google-breakpad/Android.mk ...
including ./external/google-fonts/carrois-gothic-sc/Android.mk ...
including ./external/google-fonts/coming-soon/Android.mk ...
including ./external/google-fonts/cutive-mono/Android.mk ...
including ./external/google-fonts/dancing-script/Android.mk ...
including ./external/google-tv-pairing-protocol/Android.mk ...
including ./external/gtest/Android.mk ...
including ./external/guava/Android.mk ...
including ./external/hamcrest/Android.mk ...
including ./external/harfbuzz_ng/Android.mk ...
including ./external/icu/Android.mk ...
including ./external/iproute2/Android.mk ...
including ./external/ipsec-tools/Android.mk ...
including ./external/iptables/Android.mk ...
including ./external/iputils/Android.mk ...
including ./external/iw/Android.mk ...
including ./external/jarjar/Android.mk ...
including ./external/javasqlite/Android.mk ...
including ./external/javassist/Android.mk ...
including ./external/jdiff/Android.mk ...
including ./external/jemalloc/Android.mk ...
including ./external/jhead/Android.mk ...
including ./external/jmdns/Android.mk ...
including ./external/jpeg/Android.mk ...
including ./external/jsilver/Android.mk ...
including ./external/jsmn/Android.mk ...
including ./external/jsoncpp/Android.mk ...
including ./external/jsr305/Android.mk ...
including ./external/junit/Android.mk ...
including ./external/ksoap2/Android.mk ...
including ./external/libavc/Android.mk ...
including ./external/libcap-ng/Android.mk ...
including ./external/libcap/Android.mk ...
including ./external/libchrome/Android.mk ...
including ./external/libchromeos/Android.mk ...
including ./external/libcxx/Android.mk ...
including ./external/libcxxabi/Android.mk ...
including ./external/libdaemon/Android.mk ...
including ./external/libdivsufsort/Android.mk ...
including ./external/libedit/Android.mk ...
including ./external/libevent/Android.mk ...
including ./external/libexif/Android.mk ...
including ./external/libgsm/Android.mk ...
including ./external/libhevc/Android.mk ...
including ./external/liblzf/Android.mk ...
including ./external/libmicrohttpd/Android.mk ...
including ./external/libmpeg2/Android.mk ...
including ./external/libnfc-nci/Android.mk ...
including ./external/libnfc-nxp/Android.mk ...
including ./external/libnl/Android.mk ...
including ./external/libogg/Android.mk ...
including ./external/libopus/Android.mk ...
including ./external/libpcap/Android.mk ...
including ./external/libphonenumber/Android.mk ...
including ./external/libpng/Android.mk ...
including ./external/libselinux/Android.mk ...
including ./external/libunwind/Android.mk ...
including ./external/libunwind_llvm/Android.mk ...
including ./external/libutf/Android.mk ...
including ./external/libvorbis/Android.mk ...
including ./external/libvpx/Android.mk ...
including ./external/libvterm/Android.mk ...
including ./external/libweave/libweave/Android.mk ...
including ./external/libxml2/Android.mk ...
including ./external/libyuv/Android.mk ...
including ./external/linux-tools-perf/Android.mk ...
including ./external/littlemock/Android.mk ...
including ./external/lldb/Android.mk ...
including ./external/llvm/Android.mk ...
including ./external/lohit-fonts/Android.mk ...
including ./external/ltrace/Android.mk ...
including ./external/lvm2/Android.mk ...
including ./external/lz4/Android.mk ...
including ./external/lzma/C/Android.mk ...
including ./external/lzma/xz-embedded/Android.mk ...
including ./external/markdown/Android.mk ...
including ./external/mdnsresponder/Android.mk ...
including ./external/mesa3d/Android.mk ...
including ./external/messageformat/Android.mk ...
including ./external/minijail/Android.mk ...
including ./external/mksh/Android.mk ...
including ./external/mockito/Android.mk ...
including ./external/mockwebserver/Android.mk ...
including ./external/modp_b64/Android.mk ...
including ./external/mp4parser/Android.mk ...
including ./external/mtpd/Android.mk ...
including ./external/nanohttpd/Android.mk ...
including ./external/nanopb-c/Android.mk ...
including ./external/naver-fonts/Android.mk ...
including ./external/netcat/Android.mk ...
including ./external/netperf/Android.mk ...
including ./external/neven/Android.mk ...
including ./external/nfacct/Android.mk ...
including ./external/nist-pkits/Android.mk ...
including ./external/noto-fonts/Android.mk ...
including ./external/oauth/core/src/main/java/Android.mk ...
including ./external/objenesis/Android.mk ...
including ./external/okhttp/Android.mk ...
including ./external/opencv/Android.mk ...
including ./external/opencv3/Android.mk ...
including ./external/owasp/sanitizer/Android.mk ...
including ./external/pcre/Android.mk ...
including ./external/pdfium/core/Android.mk ...
including ./external/pdfium/fpdfsdk/Android.mk ...
including ./external/ppp/pppd/Android.mk ...
including ./external/proguard/Android.mk ...
including ./external/protobuf/Android.mk ...
including ./external/regex-re2/Android.mk ...
including ./external/replicaisland/Android.mk ...
including ./external/rmi4utils/Android.mk ...
including ./external/robolectric/Android.mk ...
including ./external/rootdev/Android.mk ...
including ./external/safe-iop/Android.mk ...
including ./external/scrypt/Android.mk ...
including ./external/selinux/Android.mk ...
including ./external/sepolicy/Android.mk ...
including ./external/sfntly/Android.mk ...
including ./external/skia/Android.mk ...
including ./external/smali/baksmali/Android.mk ...
including ./external/smali/deodexerant/Android.mk ...
including ./external/smali/dexlib2/Android.mk ...
including ./external/smali/smali/Android.mk ...
including ./external/sonivox/Android.mk ...
including ./external/speex/Android.mk ...
including ./external/sqlite/android/Android.mk ...
including ./external/sqlite/dist/Android.mk ...
including ./external/squashfs-tools/Android.mk ...
including ./external/srtp/Android.mk ...
including ./external/stlport/Android.mk ...
including ./external/strace/Android.mk ...
including ./external/svox/Android.mk ...
including ./external/tagsoup/Android.mk ...
including ./external/tcpdump/Android.mk ...
including ./external/tinyalsa/Android.mk ...
including ./external/tinycompress/Android.mk ...
including ./external/tinyxml/Android.mk ...
including ./external/tinyxml2/Android.mk ...
including ./external/tlsdate/Android.mk ...
including ./external/toybox/Android.mk ...
including ./external/tremolo/Android.mk ...
including ./external/v8/Android.mk ...
including ./external/valgrind/Android.mk ...
including ./external/vixl/Android.mk ...
including ./external/vogar/Android.mk ...
including ./external/webp/Android.mk ...
including ./external/webrtc/Android.mk ...
including ./external/wpa_supplicant_8/Android.mk ...
including ./external/xmlrpcpp/Android.mk ...
including ./external/xmp_toolkit/Android.mk ...
including ./external/zlib/Android.mk ...
including ./external/zopfli/Android.mk ...
including ./external/zxing/Android.mk ...
including ./frameworks/av/camera/Android.mk ...
including ./frameworks/av/cmds/screenrecord/Android.mk ...
including ./frameworks/av/cmds/stagefright/Android.mk ...
including ./frameworks/av/drm/common/Android.mk ...
including ./frameworks/av/drm/drmserver/Android.mk ...
including ./frameworks/av/drm/libdrmframework/Android.mk ...
including ./frameworks/av/drm/mediadrm/plugins/clearkey/Android.mk ...
including ./frameworks/av/drm/mediadrm/plugins/mock/Android.mk ...
including ./frameworks/av/media/common_time/Android.mk ...
including ./frameworks/av/media/img_utils/Android.mk ...
including ./frameworks/av/media/libcpustats/Android.mk ...
including ./frameworks/av/media/libeffects/downmix/Android.mk ...
including ./frameworks/av/media/libeffects/factory/Android.mk ...
including ./frameworks/av/media/libeffects/loudness/Android.mk ...
including ./frameworks/av/media/libeffects/lvm/lib/Android.mk ...
including ./frameworks/av/media/libeffects/lvm/wrapper/Android.mk ...
including ./frameworks/av/media/libeffects/preprocessing/Android.mk ...
including ./frameworks/av/media/libeffects/proxy/Android.mk ...
including ./frameworks/av/media/libeffects/visualizer/Android.mk ...
including ./frameworks/av/media/libmedia/Android.mk ...
including ./frameworks/av/media/libmediaplayerservice/Android.mk ...
including ./frameworks/av/media/libnbaio/Android.mk ...
including ./frameworks/av/media/libstagefright/Android.mk ...
including ./frameworks/av/media/mediaserver/Android.mk ...
including ./frameworks/av/media/mtp/Android.mk ...
including ./frameworks/av/media/ndk/Android.mk ...
including ./frameworks/av/services/audioflinger/Android.mk ...
including ./frameworks/av/services/audiopolicy/Android.mk ...
including ./frameworks/av/services/camera/libcameraservice/Android.mk ...
including ./frameworks/av/services/medialog/Android.mk ...
including ./frameworks/av/services/soundtrigger/Android.mk ...
including ./frameworks/av/soundtrigger/Android.mk ...
including ./frameworks/av/tools/resampler_tools/Android.mk ...
including ./frameworks/base/Android.mk ...
including ./frameworks/compile/libbcc/Android.mk ...
including ./frameworks/compile/mclinker/Android.mk ...
including ./frameworks/compile/slang/Android.mk ...
including ./frameworks/ex/camera2/Android.mk ...
including ./frameworks/ex/common/Android.mk ...
including ./frameworks/ex/framesequence/Android.mk ...
including ./frameworks/ex/variablespeed/Android.mk ...
including ./frameworks/minikin/libs/minikin/Android.mk ...
including ./frameworks/minikin/sample/Android.mk ...
including ./frameworks/ml/Android.mk ...
including ./frameworks/multidex/Android.mk ...
including ./frameworks/native/cmds/atrace/Android.mk ...
including ./frameworks/native/cmds/bugreport/Android.mk ...
including ./frameworks/native/cmds/dumpstate/Android.mk ...
including ./frameworks/native/cmds/dumpsys/Android.mk ...
including ./frameworks/native/cmds/flatland/Android.mk ...
including ./frameworks/native/cmds/installd/Android.mk ...
including ./frameworks/native/cmds/ip-up-vpn/Android.mk ...
including ./frameworks/native/cmds/rawbu/Android.mk ...
including ./frameworks/native/cmds/service/Android.mk ...
including ./frameworks/native/cmds/servicemanager/Android.mk ...
including ./frameworks/native/libs/binder/Android.mk ...
including ./frameworks/native/libs/diskusage/Android.mk ...
including ./frameworks/native/libs/gui/Android.mk ...
including ./frameworks/native/libs/input/Android.mk ...
including ./frameworks/native/libs/ui/Android.mk ...
including ./frameworks/native/opengl/libagl/Android.mk ...
including ./frameworks/native/opengl/libs/Android.mk ...
including ./frameworks/native/opengl/tests/Android.mk ...
including ./frameworks/native/services/batteryservice/Android.mk ...
including ./frameworks/native/services/inputflinger/Android.mk ...
including ./frameworks/native/services/powermanager/Android.mk ...
including ./frameworks/native/services/sensorservice/Android.mk ...
including ./frameworks/native/services/surfaceflinger/Android.mk ...
including ./frameworks/opt/bitmap/Android.mk ...
including ./frameworks/opt/bluetooth/Android.mk ...
including ./frameworks/opt/calendar/Android.mk ...
including ./frameworks/opt/chips/Android.mk ...
including ./frameworks/opt/colorpicker/Android.mk ...
including ./frameworks/opt/datetimepicker/Android.mk ...
including ./frameworks/opt/emoji/Android.mk ...
including ./frameworks/opt/inputmethodcommon/Android.mk ...
including ./frameworks/opt/mms/Android.mk ...
including ./frameworks/opt/net/ethernet/Android.mk ...
including ./frameworks/opt/net/ims/Android.mk ...
including ./frameworks/opt/net/voip/Android.mk ...
including ./frameworks/opt/net/wifi/service/Android.mk ...
including ./frameworks/opt/photoviewer/Android.mk ...
including ./frameworks/opt/setupwizard/navigationbar/Android.mk ...
including ./frameworks/opt/telephony/Android.mk ...
including ./frameworks/opt/timezonepicker/Android.mk ...
including ./frameworks/opt/vcard/Android.mk ...
including ./frameworks/rs/Android.mk ...
including ./frameworks/support/Android.mk ...
FindEmulator: find: `frameworks/support/design/dummy': No such file or directory
FindEmulator: find: `frameworks/support/v17/leanback/dummy': No such file or directory
including ./frameworks/volley/Android.mk ...
including ./frameworks/webview/Android.mk ...
including ./frameworks/wilhelm/src/Android.mk ...
including ./frameworks/wilhelm/tests/Android.mk ...
including ./hardware/akm/AK8975_FS/akmdfs/Android.mk ...
including ./hardware/akm/AK8975_FS/libsensors/Android.mk ...
including ./hardware/broadcom/libbt/Android.mk ...
including ./hardware/broadcom/wlan/bcmdhd/Android.mk ...
including ./hardware/intel/audio_media/hdmi/Android.mk ...
including ./hardware/intel/bootstub/Android.mk ...
including ./hardware/intel/common/libmix/Android.mk ...
including ./hardware/intel/common/libstagefrighthw/Android.mk ...
including ./hardware/intel/common/libva/Android.mk ...
including ./hardware/intel/common/libwsbm/src/Android.mk ...
including ./hardware/intel/common/omx-components/Android.mk ...
including ./hardware/intel/common/utils/ISV/Android.mk ...
including ./hardware/intel/common/utils/ituxd/Android.mk ...
including ./hardware/intel/common/wrs_omxil_core/Android.mk ...
including ./hardware/intel/img/hwcomposer/Android.mk ...
including ./hardware/intel/img/libdrm/Android.mk ...
including ./hardware/intel/img/psb_headers/Android.mk ...
including ./hardware/intel/img/psb_video/Android.mk ...
including ./hardware/invensense/Android.mk ...
including ./hardware/libhardware/Android.mk ...
including ./hardware/libhardware_legacy/Android.mk ...
including ./hardware/qcom/audio/Android.mk ...
including ./hardware/qcom/bt/Android.mk ...
including ./hardware/qcom/display/Android.mk ...
including ./hardware/qcom/gps/Android.mk ...
including ./hardware/qcom/keymaster/Android.mk ...
including ./hardware/qcom/media/Android.mk ...
including ./hardware/qcom/power/Android.mk ...
including ./hardware/qcom/wlan/qcwcn/Android.mk ...
including ./hardware/ril/libril/Android.mk ...
including ./hardware/ril/librilutils/Android.mk ...
including ./hardware/ril/reference-ril/Android.mk ...
including ./hardware/ril/rild/Android.mk ...
including ./hardware/samsung_slsi/exynos5/Android.mk ...
including ./hardware/ti/omap3/Android.mk ...
including ./hardware/ti/omap4-aah/Android.mk ...
including ./hardware/ti/omap4xxx/Android.mk ...
including ./libcore/Android.mk ...
including ./libnativehelper/Android.mk ...
including ./ndk/Android.mk ...
including ./packages/apps/BasicSmsReceiver/Android.mk ...
including ./packages/apps/Bluetooth/Android.mk ...
including ./packages/apps/Browser2/Android.mk ...
including ./packages/apps/Calculator/Android.mk ...
including ./packages/apps/Calendar/Android.mk ...
including ./packages/apps/Camera/Android.mk ...
including ./packages/apps/Camera2/Android.mk ...
including ./packages/apps/CellBroadcastReceiver/Android.mk ...
including ./packages/apps/CertInstaller/Android.mk ...
including ./packages/apps/Contacts/Android.mk ...
including ./packages/apps/ContactsCommon/Android.mk ...
including ./packages/apps/DeskClock/Android.mk ...
including ./packages/apps/Dialer/Android.mk ...
including ./packages/apps/Email/Android.mk ...
including ./packages/apps/Exchange/Android.mk ...
including ./packages/apps/FMRadio/Android.mk ...
including ./packages/apps/Gallery/Android.mk ...
including ./packages/apps/Gallery2/Android.mk ...
including ./packages/apps/HTMLViewer/Android.mk ...
including ./packages/apps/KeyChain/Android.mk ...
including ./packages/apps/Launcher2/Android.mk ...
including ./packages/apps/Launcher3/Android.mk ...
including ./packages/apps/LegacyCamera/Android.mk ...
including ./packages/apps/ManagedProvisioning/Android.mk ...
including ./packages/apps/Mms/Android.mk ...
including ./packages/apps/Music/Android.mk ...
including ./packages/apps/MusicFX/Android.mk ...
including ./packages/apps/Nfc/Android.mk ...
including ./packages/apps/OneTimeInitializer/Android.mk ...
including ./packages/apps/PackageInstaller/Android.mk ...
including ./packages/apps/PhoneCommon/Android.mk ...
including ./packages/apps/Protips/Android.mk ...
including ./packages/apps/Provision/Android.mk ...
including ./packages/apps/QuickSearchBox/Android.mk ...
including ./packages/apps/Settings/Android.mk ...
including ./packages/apps/SoundRecorder/Android.mk ...
including ./packages/apps/SpareParts/Android.mk ...
including ./packages/apps/SpeechRecorder/Android.mk ...
including ./packages/apps/Stk/Android.mk ...
including ./packages/apps/Tag/Android.mk ...
including ./packages/apps/Terminal/Android.mk ...
including ./packages/apps/TvSettings/QuickSettings/Android.mk ...
including ./packages/apps/TvSettings/Settings/Android.mk ...
including ./packages/apps/UnifiedEmail/Android.mk ...
including ./packages/experimental/Android.mk ...
including ./packages/inputmethods/LatinIME/Android.mk ...
including ./packages/inputmethods/OpenWnn/Android.mk ...
including ./packages/providers/BookmarkProvider/Android.mk ...
including ./packages/providers/CalendarProvider/Android.mk ...
including ./packages/providers/ContactsProvider/Android.mk ...
including ./packages/providers/DownloadProvider/Android.mk ...
including ./packages/providers/MediaProvider/Android.mk ...
including ./packages/providers/PartnerBookmarksProvider/Android.mk ...
including ./packages/providers/TelephonyProvider/Android.mk ...
including ./packages/providers/TvProvider/Android.mk ...
including ./packages/providers/UserDictionaryProvider/Android.mk ...
including ./packages/screensavers/Basic/Android.mk ...
including ./packages/screensavers/PhotoTable/Android.mk ...
including ./packages/screensavers/WebView/Android.mk ...
including ./packages/services/Mms/Android.mk ...
including ./packages/services/Telecomm/Android.mk ...
including ./packages/services/Telephony/Android.mk ...
including ./packages/wallpapers/Basic/Android.mk ...
including ./packages/wallpapers/Galaxy4/Android.mk ...
including ./packages/wallpapers/HoloSpiral/Android.mk ...
including ./packages/wallpapers/LivePicker/Android.mk ...
including ./packages/wallpapers/MagicSmoke/Android.mk ...
including ./packages/wallpapers/MusicVisualization/Android.mk ...
including ./packages/wallpapers/NoiseField/Android.mk ...
including ./packages/wallpapers/PhaseBeam/Android.mk ...
including ./pdk/apps/HelloPDK/Android.mk ...
including ./pdk/apps/TestingCamera/Android.mk ...
including ./pdk/apps/TestingCamera2/Android.mk ...
including ./prebuilts/gcc/darwin-x86/aarch64/aarch64-linux-android-4.9/Android.mk ...
including ./prebuilts/gcc/darwin-x86/arm/arm-linux-androideabi-4.9/Android.mk ...
including ./prebuilts/gcc/linux-x86/aarch64/aarch64-linux-android-4.9/Android.mk ...
including ./prebuilts/gcc/linux-x86/arm/arm-linux-androideabi-4.9/Android.mk ...
including ./prebuilts/misc/Android.mk ...
including ./prebuilts/ndk/Android.mk ...
including ./prebuilts/qemu-kernel/x86/pc-bios/Android.mk ...
including ./prebuilts/sdk/Android.mk ...
including ./prebuilts/tools/Android.mk ...
FindEmulator: find: `prebuilts/tools/android-arm': No such file or directory
including ./sdk/annotations/Android.mk ...
including ./sdk/avdlauncher/Android.mk ...
including ./sdk/dumpeventlog/Android.mk ...
including ./sdk/emulator/mksdcard/Android.mk ...
including ./sdk/eventanalyzer/Android.mk ...
including ./sdk/find_java/Android.mk ...
including ./sdk/find_lock/Android.mk ...
including ./sdk/hierarchyviewer/etc/Android.mk ...
including ./sdk/hierarchyviewer/src/Android.mk ...
including ./sdk/sdklauncher/Android.mk ...
including ./system/bt/Android.mk ...
including ./system/ca-certificates/Android.mk ...
including ./system/connectivity/apmanager/Android.mk ...
including ./system/connectivity/shill/Android.mk ...
including ./system/core/Android.mk ...
including ./system/extras/Android.mk ...
including ./system/firewalld/Android.mk ...
including ./system/gatekeeper/Android.mk ...
including ./system/keyguard/Android.mk ...
including ./system/keymaster/Android.mk ...
including ./system/media/audio_route/Android.mk ...
including ./system/media/audio_utils/Android.mk ...
including ./system/media/camera/src/Android.mk ...
including ./system/media/camera/tests/Android.mk ...
including ./system/nativepower/Android.mk ...
including ./system/netd/client/Android.mk ...
including ./system/netd/server/Android.mk ...
including ./system/peerd/Android.mk ...
including ./system/security/keystore-engine/Android.mk ...
including ./system/security/keystore/Android.mk ...
including ./system/security/softkeymaster/Android.mk ...
including ./system/tools/aidl/Android.mk ...
including ./system/update_engine/Android.mk ...
including ./system/vold/Android.mk ...
including ./system/weaved/Android.mk ...
including ./system/webservd/Android.mk ...
including ./tools/external/fat32lib/Android.mk ...

No sign of Open-TEE being included. So the Android.mk files in Open-TEE and Open-TEE/emulator are not being picked up by make.
Also my environment variables I set are:
export ANDROID_ROOT="$HOME/Android/android_source"
export USE_CCACHE=1
export CCACHE_DIR="$HOME/Android/android_source/.ccache"
$ANDROID_ROOT/prebuilts/misc/linux-x86/ccache/ccache -M 50G
source "$HOME/Android/android_source/build/envsetup.sh"

I'm really not sure what might be causing this. Could you rename your Open-TEE folder to just "opentee" ? It's a longshot but it might have an issue with caps or symbols like dash. I always named it just "opentee".

Deleted the symlink and recreated with name "opentee". I then run make clean then lunch then make libtee and it gave the following error:
Starting build with ninja
ninja: Entering directory `.'
ninja: error: unknown target 'libtee', did you mean 'libfec'?
build/core/ninja.mk:123: recipe for target 'ninja.intermediate' failed
make: *** [ninja.intermediate] Error 1

#### make failed to build some targets (34 seconds) ####

Again from inspecting the output from running make "opentee" does not appear.

I have tried to run and build this all on another machine of mine. It has a fresh install of Ubuntu 14.04 on and it still results in the same error as above when running make libtee. Any ideas?

I have it building and running just now. It appears that doing a symlink to opentee for me did not work. Instead I cloned Open-TEE directly into my android_source directory. Appears to be building. Weird...

It would be far-fetched but could you try with the cyanogenmod android tree? https://github.com/CyanogenMod/android
Here are some guides https://wiki.cyanogenmod.org/w/Development
Also try to run ./build/envsetup.sh from the android_source directory before doing lunch and make...  .  In case it doesn't recognize $HOME somehow.
If nothing works I'll redo the whole setup on my local machine during the weekend cause I'm busy now and try to debug this.

I tried to run envsetup.sh and place the symlink back but for me it didn't work. Currently pulling down the cyanogenMod source and I will try. I'll keep you posted.
Thank you for all your support so far it is very much appreciated :D

What operating system are you building on? I know that I had problems when I used zsh instead of bash in a similar case so I had to default to that. I always built on an Ubuntu x86_64 14.04 VM.

Ubuntu 14.04 LTS, 64-bit with Bash shell. Native install not on a VM but won't make a difference I am sure.  Will let you know the result of CM and I am happy to debug / try things for you if you need any assistance. :)

I have always had issues with symlinks in the Android tree once it is
outside of 'croot'. For small standalone projects it seems to work, but
when there are dependencies to other sub-projects within a project it seems
to fail. I have not really studied which pass and why, it is more of an
observation. So the "safe" option is to copy not link.
On Thu, Oct 1, 2015 at 5:09 PM, Jorden Whitefield notifications@github.com
wrote:

Ubuntu 14.04 LTS, 64-bit with Bash shell. Native install not on a VM but
won't make a difference I am sure. Will let you know the result of CM and I
am happy to debug / try things for you if you need any assistance. :)
—
Reply to this email directly or view it on GitHub
https://github.com/Open-TEE/project/issues/7#issuecomment-144738464.

@uberspot I have tried the same with CyanogenMod 12.1 and using the sym link it results in the same issue. It does work if I copy opentee in to the android_source root.

Hello everyone,
Like thinhlevinh I'm trying to build Open tee on Android but I'm using an Ubuntu 14.04 virtualbox.
I have some trouble during make command :
VirtualBox:~/android_source$ lunch
You're building on Linux
Lunch menu... pick a combo:
1. full-eng
2. full_x86-eng
3. vbox_x86-eng
I chose the third
then make clean && make opentee-engine pass without problem
But when I start to build libraries (libManagerApi libInternalApi libLauncherApi libCommonApi libta_conn_test_app) I have some issues :
VirtualBox:~/android_source$ make libManagerApi
PLATFORM_VERSION_CODENAME=REL
PLATFORM_VERSION=4.0.1
TARGET_PRODUCT=vbox_x86
TARGET_BUILD_VARIANT=eng
TARGET_BUILD_TYPE=release
TARGET_BUILD_APPS=
TARGET_ARCH=x86
TARGET_ARCH_VARIANT=x86
HOST_ARCH=x86
HOST_OS=linux
HOST_BUILD_TYPE=release
BUILD_ID=ITL41D
target  C: libManagerApi <= Open-TEE/emulator/manager/ext_storage_stream_api_posix.c
target  C: libManagerApi <= Open-TEE/emulator/manager/opentee_manager_storage_api.c
target  C: libManagerApi <= Open-TEE/emulator/manager/../internal_api/opentee_storage_common.c
target  C: libManagerApi <= Open-TEE/emulator/manager/io_thread.c
target  C: libManagerApi <= Open-TEE/emulator/manager/logic_thread.c
target  C: libManagerApi <= Open-TEE/emulator/manager/mainloop.c
target  C: libManagerApi <= Open-TEE/emulator/manager/ta_dir_watch.c
target  C: libManagerApi <= Open-TEE/emulator/manager/shm_mem.c
Open-TEE/emulator/manager/shm_mem.c: In function 'generate_random_path':
Open-TEE/emulator/manager/shm_mem.c:51: error: 'CLOCK_BOOTTIME' undeclared (first use in this function)
Open-TEE/emulator/manager/shm_mem.c:51: error: (Each undeclared identifier is reported only once
Open-TEE/emulator/manager/shm_mem.c:51: error: for each function it appears in.)
make: *** [out/target/product/vbox_x86/obj/SHARED_LIBRARIES/libManagerApi_intermediates/shm_mem.o] error 1
VirtualBox:~/android_source$
I have search on the web but nothing helped me.
Do you have an idea ?

shall take a look at it  next week

okay, it looks like those definitions have moved from libc/include/time.h to libc/kernel/common/linux/time.h
I don't have a proper dev env up at the moment so it'll take a little bit before I can try a fix. If anyone else feels up to the task please do :p

authors: Vincent37 brianmcgillion lordqwerty thinhlevinh uberspot xzr

repo: Open-TEE/project


text:
Exception during initialization

Android Studio 3.0 Beta 2
Plugin 'com.jetbrains.idear' failed to initialize and will be disabled.  Please restart Android Studio.

kotlin.KotlinNullPointerException
    at org.openasr.idear.Idear.initTTSService(Idear.kt:17)
    at org.openasr.idear.Idear.initComponent(Idear.kt:12)
    at com.intellij.openapi.components.impl.ComponentManagerImpl$ComponentConfigComponentAdapter.getComponentInstance(ComponentManagerImpl.java:491)
    at com.intellij.openapi.components.impl.ComponentManagerImpl.createComponents(ComponentManagerImpl.java:120)
    at com.intellij.openapi.application.impl.ApplicationImpl.lambda$createComponents$8(ApplicationImpl.java:466)
    at com.intellij.openapi.progress.impl.CoreProgressManager.lambda$runProcess$1(CoreProgressManager.java:176)
    at com.intellij.openapi.progress.impl.CoreProgressManager.registerIndicatorAndRun(CoreProgressManager.java:556)
    at com.intellij.openapi.progress.impl.CoreProgressManager.executeProcessUnderProgress(CoreProgressManager.java:501)
    at com.intellij.openapi.progress.impl.ProgressManagerImpl.executeProcessUnderProgress(ProgressManagerImpl.java:66)
    at com.intellij.openapi.progress.impl.CoreProgressManager.runProcess(CoreProgressManager.java:163)
    at com.intellij.openapi.application.impl.ApplicationImpl.createComponents(ApplicationImpl.java:473)
    at com.intellij.openapi.components.impl.ComponentManagerImpl.init(ComponentManagerImpl.java:104)
    at com.intellij.openapi.application.impl.ApplicationImpl.load(ApplicationImpl.java:425)
    at com.intellij.openapi.application.impl.ApplicationImpl.load(ApplicationImpl.java:411)
    at com.intellij.idea.IdeaApplication.run(IdeaApplication.java:206)
    at com.intellij.idea.MainImpl$1.lambda$null$0(MainImpl.java:49)
    at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:311)
    at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:762)
    at java.awt.EventQueue.access$500(EventQueue.java:98)
    at java.awt.EventQueue$3.run(EventQueue.java:715)
    at java.awt.EventQueue$3.run(EventQueue.java:709)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:732)
    at com.intellij.ide.IdeEventQueue.dispatchEvent(IdeEventQueue.java:343)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)

It occurs also on AS 3.0 Beta 4

Ocurring also for IntelliJ 2017.2.3 on Mac

There's other idea plugins that seem to have the same issue, and indications that the error is tied to a kotlin plugin 1.1 release.

authors: ekohlwey ghostbuster91 josuesbla

repo: OpenASR/idear


text:
chore(*): change installation of spacy weights to runtime

What kind of change does this PR introduce?

feature
Summary
Motivation: https://github.com/OpenAdaptAI/OpenAdapt/issues/461

Checklist

[x] My code follows the style guidelines of OpenAdapt
[x] I have performed a self-review of my code
[x] If applicable, I have added tests to prove my fix is functional/effective
[x] I have linted my code locally prior to submission
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation (e.g. README.md, requirements.txt)
[x] New and existing unit tests pass locally with my changes

How can your code be run and tested?
pip uninstall `en_core_web_trf`
# Follow Setup Instructions in README.md
pytest

Other information

This is how pytest will look like when we do not have the required spacy weight model installed:
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> pytest
============================================================================== test session starts ==============================================================================
platform win32 -- Python 3.10.11, pytest-7.1.3, pluggy-1.2.0
rootdir: P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt
plugins: anyio-3.7.1, Faker-19.2.0, cov-2.10.0
collected 10 items / 1 error

==================================================================================== ERRORS =====================================================================================
________________________________________________________________ ERROR collecting tests/openadapt/test_scrub.py _________________________________________________________________
tests\openadapt\test_scrub.py:9: in <module>
    from openadapt import config, scrub
openadapt\scrub.py:25: in <module>
    NLP_ENGINE_TRF = SCRUB_PROVIDER_TRF.create_engine()
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\presidio_analyzer\nlp_engine\nlp_engine_provider.py:91: in create_engine
    engine = nlp_engine_class(nlp_engine_opts)
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\presidio_analyzer\nlp_engine\spacy_nlp_engine.py:36: in __init__
    self.nlp = {
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\presidio_analyzer\nlp_engine\spacy_nlp_engine.py:37: in <dictcomp>
    lang_code: spacy.load(model_name, disable=["parser"])
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\spacy\__init__.py:51: in load
    return util.load_model(
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\spacy\util.py:472: in load_model
    raise IOError(Errors.E050.format(name=name))
E   OSError: [E050] Can't find model 'en_core_web_trf'. It doesn't seem to be a Python package or a valid path to a data directory.
=============================================================================== warnings summary ================================================================================
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
============================================================================ short test summary info ============================================================================
ERROR tests/openadapt/test_scrub.py - OSError: [E050] Can't find model 'en_core_web_trf'. It doesn't seem to be a Python package or a valid path to a data directory.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
========================================================================= 3 warnings, 1 error in 6.29s ==========================================================================
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt>

@abrichr Ready for review!

Some Screenshots:

This is be downloaded in runtime. So whenever the user had to use the scrub code  either via record or pytest or visualization, then it will check for the installation for the spacy weight and if not found it will install and then it will continue.

Thanks @KrishPatel13 !
What do you think about the approach mentioned here https://github.com/explosion/spaCy/issues/4592#issuecomment-704373657 :
import spacy

spacy_model_name = 'de_core_news_sm'
if not spacy.util.is_package(spacy_model_name):
    spacy.cli.download(spacy_model_name)

Also, what do you think about skipping tests which depend on spacy if the model is not installed with @pytest.mark.skipif ?

Good point, I will include that.

We will ahve to skip all of the test functions in test_scrub if the required spacy is not installed. Hence,
A better approach: https://docs.pytest.org/en/7.1.x/how-to/skipping.html#:~:text=Skip all test functions of a class or module&text=If you want to skip,skipif(...)

(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> pytest
================================ test session starts ================================
platform win32 -- Python 3.10.11, pytest-7.1.3, pluggy-1.2.0
rootdir: P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt
plugins: anyio-3.7.1, Faker-19.2.0, cov-2.10.0
collected 25 items

tests\openadapt\test_crop.py .                                                 [  4%]
tests\openadapt\test_events.py .......                                         [ 32%]
tests\openadapt\test_scrub.py sssssssssssssss                                  [ 92%]
tests\openadapt\test_summary.py ..                                             [100%]

================================= warnings summary ==================================
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=============== 10 passed, 15 skipped, 3 warnings in 96.82s (0:01:36) ===============
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt>

(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> pip uninstall en_core_web_trf
WARNING: Skipping en_core_web_trf as it is not installed.
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> pytest
================================ test session starts ================================
platform win32 -- Python 3.10.11, pytest-7.1.3, pluggy-1.2.0
rootdir: P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt
plugins: anyio-3.7.1, Faker-19.2.0, cov-2.10.0
collected 25 items

tests\openadapt\test_crop.py .                                                 [  4%]
tests\openadapt\test_events.py .......                                         [ 32%]
tests\openadapt\test_scrub.py sssssssssssssss                                  [ 92%]
tests\openadapt\test_summary.py ..                                             [100%]

================================= warnings summary ==================================
C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pycountry\__init__.py:10: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871
  C:\Users\Krish Patel\AppData\Local\pypoetry\Cache\virtualenvs\openadapt-DSRh12US-py3.10\lib\site-packages\pkg_resources\__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('sphinxcontrib')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
==================== 10 passed, 15 skipped, 3 warnings in 8.55s =====================
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> pip show en_core_web_trf
WARNING: Package(s) not found: en_core_web_trf
(openadapt-py3.10) PS P:\OpenAdapt AI - MLDS AI\cloned_repo\test_other\OpenAdapt> imestamp=

@abrichr Ready for merging ;-)
addressed your comment

repo: OpenAdaptAI/OpenAdapt


text:
Ensure openassetio-mediacreation compatibility with Python 3.7

What
Ensure this package is compatible with python 3.7
Why
3.7 is still in wide use in production
Notes
This will require https://github.com/OpenAssetIO/OpenAssetIO/pull/694, and is worth doing after #10

Closed via #17 + associated tests

repo: OpenAssetIO/OpenAssetIO-MediaCreation


text:
[BUG] MiniCPM-V2.0不支持zero3全量微调

一台机器，两张4090；一台机器，两张3090
v2.0在zero2下使用lora或者不适用lora仅训练vpm+resampler都是没问题的，但是一旦改成zero3就会报错；这个问题似乎只在v2.0上有。当我训练MiniCPM-V2.5使用zero3时可以正常运行并没有什么问题。
所以我觉得这可能是v2.0使用zero3的bug，在群里反馈也有人遇到同样的问题，不知道是否可以解决下。

您好，您说的是哪个群，请问能分享一下吗

@1SingleFeng MiniCPM他们自己提供的微信群

@1SingleFeng 你好，就是MiniCPM-V-16群。报下面这个错：
Traceback (most recent call last):
File "/home/project/CPM/MiniCPM-V/finetune/finetune.py", line 330, in
train()
File "/home/project/CPM/MiniCPM-V/finetune/finetune.py", line 320, in train
trainer.train()         # trainer.train(resume_from_checkpoint=True)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/transformers/trainer.py", line 1859, in train
return inner_training_loop(
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/transformers/trainer.py", line 2203, in _inner_training_loop
tr_loss_step = self.training_step(model, inputs)
File "/home/project/CPM/MiniCPM-V/finetune/trainer.py", line 206, in training_step
loss = self.compute_loss(model, inputs)
File "/home/project/CPM/MiniCPM-V/finetune/trainer.py", line 21, in compute_loss
outputs = self.model(data = inputs, use_cache=False)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1568, in _call_impl
result = forward_call(*args, **kwargs)
File "/home/.cache/huggingface/modules/transformers_modules/MiniCPM-V-2/modeling_minicpmv.py", line 141, in forward
vllm_embedding, vision_hidden_states = self.get_vllm_embedding(data)
File "/home/.cache/huggingface/modules/transformers_modules/MiniCPM-V-2/modeling_minicpmv.py", line 94, in get_vllm_embedding
vision_hidden_states.append(self.get_vision_embedding(pixel_values))
File "/home/.cache/huggingface/modules/transformers_modules/MiniCPM-V-2/modeling_minicpmv.py", line 82, in get_vision_embedding
vision_embedding = self.vpm.forward_features(pixel_value.unsqueeze(0).type(dtype))
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/timm/models/vision_transformer.py", line 663, in forward_features
x = self._pos_embed(x)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/timm/models/vision_transformer.py", line 582, in _pos_embed
pos_embed = resample_abs_pos_embed(
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/timm/layers/pos_embed.py", line 27, in resample_abs_pos_embed
num_pos_tokens = posemb.shape[1]
IndexError: tuple index out of range
0%|                                                                | 0/10000 [00:01<?, ?it/s]
[2024-06-17 10:42:35,698] torch.distributed.elastic.multiprocessing.api: [WARNING] Sending process 144191 closing signal SIGTERM
[2024-06-17 10:42:35,762] torch.distributed.elastic.multiprocessing.api: [ERROR] failed (exitcode: 1) local_rank: 0 (pid: 144190) of binary: /home/hncy/anaconda3/envs/MiniCPMV/bin/python
Traceback (most recent call last):
File "/home/anaconda3/envs/MiniCPMV/bin/torchrun", line 8, in
sys.exit(main())
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/distributed/elastic/multiprocessing/errors/init.py", line 346, in wrapper
return f(*args, **kwargs)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/distributed/run.py", line 806, in main
run(args)
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/distributed/run.py", line 797, in run
elastic_launch(
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/distributed/launcher/api.py", line 134, in call
return launch_agent(self._config, self._entrypoint, list(args))
File "/home/anaconda3/envs/MiniCPMV/lib/python3.9/site-packages/torch/distributed/launcher/api.py", line 264, in launch_agent
raise ChildFailedError(
torch.distributed.elastic.multiprocessing.errors.ChildFailedError:
finetune.py FAILED
Failures:
<NO_OTHER_FAILURES>
Root Cause (first observed failure):
[0]:
time      : 2024-06-17_10:42:35
host      : hncy-System-Product-Name
rank      : 0 (local_rank: 0)
exitcode  : 1 (pid: 144190)
error_file: <N/A>
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html

您好这个是代码问题，我们会更新huggingface的代码，如果着急您可以直接前往页面找到对应的pr修改自己的模型文件进行微调

感谢回复，期待你们的更新，我这边也找对应pr尝试下

@1SingleFeng 你好，我根据pr修改了两个文件的代码出现了新的报错信息：

这似乎是模型的张量处理的问题，请问是哪里的问题呢

@1SingleFeng 你好，我根据pr修改了两个文件的代码出现了新的报错信息：
这似乎是模型的张量处理的问题，请问是哪里的问题呢

你好，我暂时用不上minicpmv-2，所以对这些问题不太了解

@qyc-98 你好，请问上面这个报错是新代码的问题还是，什么原因呢

您好 如果您使用的是minicpmv2 您可以参考咱们这个仓库里的pr，里面对trainer等部分做了修改 https://github.com/OpenBMB/MiniCPM-V/pull/273

@qyc-98 你好，我按照pr也修改了trainer，这边依旧还是报上面第一个RunningError错误，但并没有出现后面的AssertionError错误，我检查了修改代码确实是按照pr的修改了，目前希望官方能够早点更新整体代码吧

你的bug是什么

@qyc-98  目前的报错信息如下：

我的ds.sh参数如下：

没有出现之前的AssertionError错误了。

bump, finetune with swift

@daihuidai  您好我目前对代码做了修改，这个bug的原因是vpm的pos_embed没有被deepspeed调用起来，导致forward和backward都需要强制的召唤这部分参数，模型代码里我们进行了修改，但是在trainer的代码里也需要做修改，目前我自己的pr是做了这个修改 你可以参考这个 https://github.com/OpenBMB/MiniCPM-V/pull/273，后续我们会更新到主分支里
I have made some modifications to the code. The cause of the bug was that the pos_embed of the VPM was not being invoked by DeepSpeed, resulting in both the forward and backward passes requiring explicit calls to this part of the parameters. We have made modifications in the model code, but changes are also needed in the trainer code. I have already made these changes in my pull request, which has been successfully executed. You can refer to it. We will update it to the main branch subsequently.

@qyc-98 你好，我似乎又发现问题了......，我按照最新的pr又修改了trainer的代码，目前并没有报错直接退出程序，但是出现了下面的报错信息，导致打印日志卡死在这里，并且显存一直被占用但没有变化，估计是程序卡死了。

@MrToy 你好，我试过swift，可以lora，但是没法full finetune，我是一台机器两张卡，当swift使用--lora_target_modules ALL --deepspeed default-zero3时会报错一台机器无法使用。

@qyc-98 请问Minicpmv2.0对zero3的支持有新的更新了吗

请问下解决了嘛？

repo: OpenBMB/MiniCPM-V


text:
💡 [REQUEST] - <现在MiniCPM-V能否支持纯文本的微调呢，没有image token>

起始日期 | Start Date
No response
实现PR | Implementation PR
No response
相关Issues | Reference Issues
No response
摘要 | Summary
希望能够支持纯文本的微调
基本示例 | Basic Example
[
{
"id": "0",
"conversations": [
{
'role': 'user',
'content': 'How's the weather?'
},
{
'role': 'assistant',
'content': 'xxxx.'
},
}
]
缺陷 | Drawbacks
no impact
未解决问题 | Unresolved questions
No response

我最近完成了一个demo级的纯文本微调，以及混合模态微调，到时候发给链接给你吧

非常感谢！
---- 回复的原邮件 ----
| 发件人 | @.> |
| 发送日期 | 2024年07月23日 15:26 |
| 收件人 | OpenBMB/MiniCPM-V @.> |
| 抄送人 | Nieyuanbi @.>,
Author @.> |
| 主题 | Re: [OpenBMB/MiniCPM-V] 💡 [REQUEST] - <现在MiniCPM-V能否支持纯文本的微调呢，没有image token> (Issue #358) |
我最近完成了一个demo级的纯文本微调，以及混合模态微调，到时候发给链接给你吧
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

https://github.com/LDLINGLINGLING/MiniCPM-V/tree/ft_language这个分支，用https://modelbest.feishu.cn/docx/I18Fd2HLRoESOYxuyc6cUZqvnhd?from=from_copylink这个教程，跑不起来跟我说，我本地是跑起来没有问题的，传文件的时候不知道传齐了没有

非常感谢您！
---- 回复的原邮件 ----
| 发件人 | @.> |
| 发送日期 | 2024年07月24日 08:32 |
| 收件人 | OpenBMB/MiniCPM-V @.> |
| 抄送人 | Nieyuanbi @.>,
Author @.> |
| 主题 | Re: [OpenBMB/MiniCPM-V] 💡 [REQUEST] - <现在MiniCPM-V能否支持纯文本的微调呢，没有image token> (Issue #358) |
https://github.com/LDLINGLINGLING/MiniCPM-V/tree/ft_language这个分支，用https://modelbest.feishu.cn/docx/I18Fd2HLRoESOYxuyc6cUZqvnhd?from=from_copylink这个教程，跑不起来跟我说，我本地是跑起来没有问题的，传文件的时候不知道传齐了没有
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

跑起来了说一声，我关闭issue

好的，我今晚跑一下
---- 回复的原邮件 ----
| 发件人 | @.> |
| 发送日期 | 2024年07月24日 14:34 |
| 收件人 | OpenBMB/MiniCPM-V @.> |
| 抄送人 | Nieyuanbi @.>,
Author @.> |
| 主题 | Re: [OpenBMB/MiniCPM-V] 💡 [REQUEST] - <现在MiniCPM-V能否支持纯文本的微调呢，没有image token> (Issue #358) |
跑起来了说一声，我关闭issue
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

您好，问题已解决，您可以关闭issue了！
非常感谢您的工作！
| |
聂远碧
|
|
@.***
|
---- 回复的原邮件 ----
| 发件人 | @.> |
| 发送日期 | 2024年7月24日 14:34 |
| 收件人 | @.> |
| 抄送人 | @.> ,
@.> |
| 主题 | Re: [OpenBMB/MiniCPM-V] 💡 [REQUEST] - <现在MiniCPM-V能否支持纯文本的微调呢，没有image token> (Issue #358) |
跑起来了说一声，我关闭issue
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: @.***>

请问MiniCPM-V 2.6有对应的纯文本微调方法嘛

authors: LDLINGLINGLING NieyYuanbi resi1ience


text:
MiniCPM-V-2.6 promp template的明文格式？

请教一下，MiniCPM-V-2.6 promp template 具体的明文格式是什么样的？是否可以提供一个具体的例子？下面是猜测的多轮对话的chat template，不知道是否正确？谢谢！
<|im_start|>system

{system_message}<|im_end|>

<|im_start|>user

{user_message_1}<|im_end|>

<|im_start|>assistant<|im_end|>

{assistant_message_1}<|im_end|>

<|im_start|>user

{user_message_2}<|im_end|>

<|im_start|>assistant<|im_end|>

看起来基本是这样的

不要需要用到 <|endoftext|> 吧？谢谢

@LDLINGLINGLING 还有几个问题想确认一下：

用户的问题和图片是以什么样式存放到 user_message 中
图片是需要转换为base64或者其他编码？

谢谢！

authors: LDLINGLINGLING apepkuss


text:
In which currency is price set?

Listing configuration doesn't inform how price is set.
If I set a price in USD, will it stay in USD or will it be converted to BTC and vary its price in USD according to market price?
Shouldn't both these options be available?

The price set in the listing will always be the price.
If the price is set in a fiat currency, it will be the converted to BTC at the time of purchase.
ie: if you set a listing to be $100 USD, when that item is purchased the equivalent amount of BTC will be paid, based on the conversion rate at that time.

This information should be displayed on edit listing page. User should also be able to set his listing prices in BTC while OB is set to display prices in fiat currency (without having to change his OB currency in settings).

FWIW, in v2 this is the case - you are able to specify the currency when creating / editing a listing.

I believe the API allows setting the currency per listing, so it would be possible to change the v1 client to do that.

authors: jjeffryes rhcastilhos rmisio

repo: OpenBazaar/OpenBazaar-Client


text:
Update README with the latest command flags help output

Removing a couple flags that don't exist anymore (bitcoincash and zcash) and adding forcekeypurge.

Coverage remained the same at 40.933% when pulling fd446368339080cba0b7f0316a33d517f61627bf on sz/updatereadme into 9e17a661e2afc25f7c630a79280bc99c51b77153 on master.

authors: coveralls szollo

repo: OpenBazaar/openbazaar-go


text:
feat: Add uris field for identifiers

originally opened in https://github.com/OpenBioML/chemnlp/pull/72
Dropped the addition of the examples as it was inconsistent with the transform.py approach some contributors used.

Thank you all!

authors: MicPie kjappelbaum

repo: OpenBioML/chemnlp


text:
fix: scroll to section on click

The section to be scrolled needs to have the corresponding id same as the href value in the Link component.

👏 Congratulations on your recent PR merge! 🚀 Your contribution is invaluable to our project. 🙌 Why not share your success with a post? 📢 It's inspiring and encourages others to join in. Keep up the fantastic work! 🌟
#OpenSource #CodingSuccess

repo: OpenCodeEra/first-contribution


text:
Remove metadata composer lock file

The vendor directory is .gitignored, because vendors are installed via composer. Therefore, the vendor directory and its contents should not be present in the repository.
It was removed earlier, in this commit, but possibly re-added by accident during the resolving of merge conflicts for this merge.

@thijskh, @relaxnow

repo: OpenConext/OpenConext-engineblock


text:
Create eduID from institution id

This issue is imported from pivotal
Just like the OneGini migration, it should be possible to create an eduID account by logging in with an institution id. The user opens a special landing-page (https://eduid/create-from-institution) and selects his institution in the WAYF. After logging in he is asked to enter and validate his personal email-address. After clicking in the magic link, his eduID is created. The new eduID account will immediately be linked (ALA) to the institution.

How to deal with existing eduID's? (Peter Havekes - Jan 19, 2021)

repo: OpenConext/OpenConext-myconext


text:
Translations update from Weblate

Translations update from Weblate for SDG Metadata/1-1-1a.

First merge for SDG Metadata Translation Project, Russian!

repo: OpenDataEnterprise/sdg-metadata


text:
Gamepad controls improvements (analog input)

What do you think about implementing an alternative analog input scheme for the gamepad (make both classic and alternative available via a switch)? The original seems to be using digital input even if dualshock is used.
RT (R2) = analog accelerate
LT (L2) = analog reverse
Left stick = analog steer
Right stick = control camera, either original R2, L2, R2+L2 mapped to left, right, down, or gta-sa style free camera
Also it seems the original game doesn't allow both dpad and left stick to be used simultaneously.
Emulated version chooses input type depending on the gamepad type (digital/dualshock)
Port uses a weird scheme where dpad works until any stick is touched, then dpad can't steer anymore. That's confusing at the very least.
My gamepad input is going through x360ce, everything mapped correctly, in case if it's important.

In addition to this, I would personally hope to see if it's possible to reintroduce something that was in the original Driver but inexplicably missing from the sequel: an option to toggle the Automatic Handbrake off. For me, it always triggers at all the wrong times and it makes driving with any semblance of full control a throw of the dice, since at any moment you could just instantly be facing backwards when you were only trying to avoid oncoming traffic.

hi mate,  could you help?, in redriver2 whenever i connect my ps2 controller, the  camera goes revers, like pressing L2 AND R2, any solution?

hi mate,  could you help?, in redriver2 whenever i connect my ps2 controller, the  camera goes revers, like pressing L2 AND R2, any solution?

@DCxDemo controller bindings now can be reassigned.

authors: DCxDemo SoapyMan alidayday slowriderxcorps