Building Kraken2 Databases Errors - bash

Currently running a metagenomic analysis of transcriptome reads using kraken2. Currently running into issues installing the required databases
Buildind kraken2 database code:
kraken2-build --download-library archaea --db archaea_DB
kraken2-build --download-library viral --db viral_DB
kraken2-build --download-library bacteria --db bacteria_DB
kraken2-build --download-library human --db human_DB
kraken2-build --download-library fungi --db fungi_DB
kraken2-build --download-library protozoa --db protozoa_DB
Errors:
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for archaea, exiting.
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for viral, exiting.
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for bacteria, exiting.
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for human, exiting.
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for fungi, exiting.
rsync: getaddrinfo: ftp.ncbi.nlm.nih.gov 873: Temporary failure in name resolution
rsync error: error in socket IO (code 10) at clientserver.c(138) [Receiver=3.2.6]
Error downloading assembly summary file for protozoa, exiting.

Ok so some adjustments I made was that I had to manually change the source code files of kraken2 through my anaconda environment.
I don't recall exactly what the changes were (you can look them up yourselves), but to access the files you can run the conda info -a command to find the directory where your conda environments are located. For example: find $(conda info -a) -name "rsync_from_ncbi.pl".
Once Files are edited then we can do the kraken2 process. The Errors I had was actually issues with the connection with the server (don't know why, but that's how it worked). Just wait for like 10 minutes or more and run the code and it should work.
Step 1: create a directory for the database
mkdir database
Step 2: Download taxonomy data to the database
kraken2-build --download-taxonomy --db database
Step 3: Download microbial data for the database
kraken2-build --download-library bacteria --db database
Step 4: Once the data is loaded to the library, build the database
kraken2-build --build --db database
These should be all the commands needed for kraken2

Related

NewRandomAccessFile failed to Create/Open

I am getting an error while running a code in TensorFlow for data pre-processing.
NotFoundError: NewRandomAccessFile failed to Create/Open: C:\Users\353\tensorflow_datasets\mnist\1.0.0\mnist-train.tfrecord-00005-of-00010 : The system cannot find the file specified.
; No such file or directory [Op:IteratorGetNextSync]

failed to install greenplum command center when running gpccinstall

I downloaded greenplum-cc-web-4.6.1-LINUX-x86_64.zip for my greenplum db with 5.18, and followed this link (https://gpcc.docs.pivotal.io/460/topics/setup-collection-agents.html) to install command center. Everything is OK while there is a failure about gpccinstall. It showed following errors:
RunCommandOnEachHost fail on host: client-gp03.bj
Error when unzip remote binary on sdw3 bin/gpccws
bin/ccagent
bin/gpcc
conf/app.conf
gpcc_path.sh
bin/start_agent.sh
bin/queryinfocat.sh
bin/gpcc_md5
ccdata/
alert-email/alertTemplate.html
alert-email/send_alert.sh.sample
languages/
languages/zh.json
languages/en.json
Error when unzip remote binary on client-gp00.bj bin/gpccws
bin/ccagent
bin/gpcc
conf/app.conf
gpcc_path.sh
bin/start_agent.sh
bin/queryinfocat.sh
bin/gpcc_md5
ccdata/
alert-email/alertTemplate.html
alert-email/send_alert.sh.sample
languages/
languages/zh.json
languages/en.json
Error when unzip remote binary on client-gp01.bj bin/gpccws
bin/ccagent
bin/gpcc
conf/app.conf
gpcc_path.sh
bin/start_agent.sh
bin/queryinfocat.sh
bin/gpcc_md5
ccdata/
alert-email/alertTemplate.html
alert-email/send_alert.sh.sample
languages/
languages/zh.json
languages/en.json
Error when unzip remote binary on client-gp02.bj bin/gpccws
bin/ccagent
bin/gpcc
conf/app.conf
gpcc_path.sh
bin/start_agent.sh
bin/queryinfocat.sh
bin/gpcc_md5
ccdata/
alert-email/alertTemplate.html
alert-email/send_alert.sh.sample
languages/
languages/zh.json
languages/en.json
Error when unzip remote binary on client-gp03.bj Warning: the ECDSA host key for 'client-gp03.bj' differs from the key for the IP address '10.136.173.8'
Offending key for IP in /home/gpadmin/.ssh/known_hosts:10
Matching host key in /home/gpadmin/.ssh/known_hosts:17
tar: bin/gpccws: Cannot open: File exists
tar: Exiting with failure status due to previous errors
RunCommandOnEachHost failure happened
Can anyone encounter this issue before? I did some search in google and pivotal community, but failed to find some solution. Any help is appreciated.
BTW, when I ignored above errors, and continued, I found the gpcc web server can be started successfully. And when I logged in, only "Query Monitor" UI section show one warning: "GPCC is no longer receiving updates. Check your network status or gpcc status and refresh this page.", other part of UI seems OK.
From here:
Error when unzip remote binary on client-gp03.bj Warning: the ECDSA host key for 'client-gp03.bj' differs from the key for the IP address '10.136.173.8'
Offending key for IP in /home/gpadmin/.ssh/known_hosts:10
Matching host key in /home/gpadmin/.ssh/known_hosts:17
tar: bin/gpccws: Cannot open: File exists
tar: Exiting with failure status due to previous errors
You have duplicate ssh fingerprint keys in your /home/gpadmin/.ssh/known_hosts file. I recommend removing both lines 10 and 17 from that file, then running ssh-keyscan client-gp03.bj >> /home/gpadmin/.ssh/known_hosts
After this is complete, try ssh-ing to the host, to see that the fingerprint error is cleared up, and if so, try the gpcc installation again.

How to run WebKit via the bisect-builds script?

WebKit has a script that is supposed to help bisect regressions as mentioned in this webkit blog post
I'm trying it out with
./bisect-builds -p mac-mojave -a x86_64 -c release -s 230000 -e 242118
and it downloads a release and runs the release but I can not navigate to any webpages regardless of which release it downloads. I can click a bookmark but typing a URL never works. I can not edit bookmarks (picking edit bookmarks does nothing)
When running I see the errors below in the terminal. That makes me wonder if I need to set some environment variables or something to tell webkit to not use ~/Library/Caches/com.apple.Safari and similar library folders but instead use some temp folder for all it's files since otherwise it would seem like they'd conflict with the system version of Safari.
This page on running webkit mentions nothing
I don't know those errors are the cause of not being able to navigate to pages but whatever the reason, so far it's been impossible to bisect if I can't load a test webpage.
How I can run the webkit bisect-builds script in a way that actually lets me test each webkit revision it launches?
Starting SafariForWebKitDevelopment with DYLD_FRAMEWORK_PATH set to point to built WebKit in /var/folders/7h/wyw4jhd933z5jmqzsdx6r0sr0000gn/T/tmp6D8gwS/Release.
2019-02-27 11:58:59.835 SafariForWebKitDevelopment[43176:20392508] NetworkStorageDB:_openDBReadConnections: failed to open read connection to DB # /Users/gregg/Library/Caches/com.apple.Safari/Cache.db. Error=14. Cause=unable to open database file
2019-02-27 11:58:59.835 SafariForWebKitDevelopment[43176:20392508] CacheRead: unable to open cache files in /Users/gregg/Library/Caches/com.apple.Safari
2019-02-27 11:58:59.836 SafariForWebKitDevelopment[43176:20392508] Failed to obtain sandbox extension for path=/Users/gregg/Library/Caches/com.apple.Safari. Errno:1
2019-02-27 11:58:59.836 SafariForWebKitDevelopment[43176:20392508] NetworkStorageDB:_openDBReadConnections: failed to open read connection to DB # /Users/gregg/Library/Caches/com.apple.Safari/Cache.db. Error=14. Cause=unable to open database file
2019-02-27 11:58:59.836 SafariForWebKitDevelopment[43176:20392508] CacheRead: unable to open cache files in /Users/gregg/Library/Caches/com.apple.Safari
2019-02-27 11:58:59.836 SafariForWebKitDevelopment[43176:20392508] Failed to obtain sandbox extension for path=/Users/gregg/Library/Caches/com.apple.Safari. Errno:1
Failed to open AutoFill corrections SQLite store at AutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
_RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
Failed to open cahce settings store at file:///Users/gregg/Library/Safari/Touch%20Icons%20Cache/TouchIconCacheSettings.db: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
2019-02-27 11:59:00.100 SafariForWebKitDevelopment[43176:20392508] NetworkStorageDB:_openDBReadConnections: failed to open read connection to DB # /Users/gregg/Library/Caches/com.apple.Safari/Cache.db. Error=14. Cause=unable to open database file
2019-02-27 11:59:00.100 SafariForWebKitDevelopment[43176:20392508] CacheRead: unable to open cache files in /Users/gregg/Library/Caches/com.apple.Safari
2019-02-27 11:59:00.100 SafariForWebKitDevelopment[43176:20392508] Failed to obtain sandbox extension for path=/Users/gregg/Library/Caches/com.apple.Safari. Errno:1
Failed to open AutoFill corrections SQLite store at CloudAutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
Failed to open AutoFill corrections SQLite store at AutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
Failed to open AutoFill corrections SQLite store at CloudAutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
2019-02-27 11:59:00.417 SafariForWebKitDevelopment[43176:20392529] +[NSXPCSharedListener endpointForReply:withListenerName:]: an error occurred while attempting to obtain endpoint for listener 'SandboxBroker': Connection invalid
Failed to open AutoFill corrections SQLite store at AutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
Failed to open AutoFill corrections SQLite store at CloudAutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
2019-02-27 11:59:00.560 SafariForWebKitDevelopment[43176:20392510] AOSKit ERROR: XPC CLIENT: Unauthorized client error received
Failed to open AutoFill corrections SQLite store at AutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
Failed to open AutoFill corrections SQLite store at CloudAutoFillCorrections.db. Error: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
_RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
_RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
Failed to open cahce settings store at file:///Users/gregg/Library/Safari/Touch%20Icons%20Cache/TouchIconCacheSettings.db: Error Domain=com.apple.Safari.SQLite Code=14 "unable to open database file"
_RegisterApplication(), FAILED TO establis...

How see what exactly cookbook were uploaded fail?

I try to upload cookbook with dependencies, here is a log:
[root#redhat cookbooks]# knife cookbook upload reference-app --include-dependencies
Uploading my-cookbook [0.1.0]
Uploading maven [1.2.0]
Uploading hipsnip-jetty [0.9.0]
Uploading ark [0.9.0]
Uploading java [1.29.0]
Uploading windows [1.34.8]
Uploading 7-zip [1.0.2]
Uploading chef_handler [1.1.6]
WARNING: Uploaded 8 cookbooks ok but 2 cookbooks upload failed.
It is all log. Is there a way to sse what cookbook were failed exactly?
Using the verbose flag will show you why it didn't upload correctly.
For instance I added some bad code to the apt cookbook...
[scarman#coldlight cookbooks]$ knife cookbook upload apt --include-dependencies -n -V
Uploading apt [2.6.0]
INFO: Validating ruby files
FATAL: Cookbook file recipes/default.rb has a ruby syntax error:
FATAL: /home/scarman/DevOps/cookbooks/apt/recipes/default.rb:29: `##' is not allowed as an instance variable name
FATAL: /home/scarman/DevOps/cookbooks/apt/recipes/default.rb:29: syntax error, unexpected end-of-input, expecting '('
FATAL: uha897*#S::##!!
FATAL: ^
And also turned my internet off for a moment...
[scarman#coldlight cookbooks]$ knife cookbook upload apt --include-dependencies -n -V
ERROR: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all, retry 1/5
ERROR: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all, retry 2/5
ERROR: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all, retry 3/5
ERROR: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all, retry 4/5
ERROR: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all, retry 5/5
ERROR: Network Error: Error connecting to https://api.opscode.com/organizations/cls-chef/cookbooks?num_versions=all - getaddrinfo: Name or service not known
Check your knife configuration and network settings
That should hopefully provide you with more insight as to why it's failing.

FATE rsync error

I am trying to rsync the fate-suite from the fate server to my local machine. When I run the following command:
make fate-rsync SAMPLES=fate-suite/
I get the following error:
rsync -vrltLW --timeout=60 --contimeout=60 rsync://fate-suite.ffmpeg.org/fate-suite/ fate-suite/
receiving incremental file list
created directory fate-suite
rsync: read error: Connection reset by peer (104)
rsync error: error in socket IO (code 10) at io.c(802) [receiver=3.1.0]
rsync: connection unexpectedly closed (15128 bytes received so far) [generator]
rsync error: error in rsync protocol data stream (code 12) at io.c(226) [generator=3.1.0]
make: *** [fate-rsync] Error 12
How do I resolve this error?

Resources