My program's attempt to load praw 5.0.0.dev0 is failing:
>>> import praw
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "C:\...\Anaconda3\lib\site-packages\praw\__init__.py", line 14, in <module>
from .reddit import Reddit # NOQA
File "C:\...\Anaconda3\lib\site-packages\praw\reddit.py", line 5, in <module>
from update_checker import update_check
File "C:\...\Anaconda3\lib\site-packages\update_checker.py", line 11, in <module>
import requests
File "C:\...\Anaconda3\lib\site-packages\requests\__init__.py", line 52, in <module>
from .packages.urllib3.contrib import pyopenssl
File "C:\...\Anaconda3\lib\site-packages\requests\packages\urllib3\contrib\pyopenssl.py", line 47, in <module>
import OpenSSL.SSL
File "C:\...\Anaconda3\lib\site-packages\OpenSSL\__init__.py", line 8, in <module>
from OpenSSL import rand, crypto, SSL
File "C:\...\Anaconda3\lib\site-packages\OpenSSL\crypto.py", line 13, in <module>
from cryptography.hazmat.primitives.asymmetric import dsa, rsa
File "C:\...\Anaconda3\lib\site-packages\cryptography\hazmat\primitives\asymmetric\rsa.py", line 14, in <module>
from cryptography.hazmat.backends.interfaces import RSABackend
File "C:\...\Anaconda3\lib\site-packages\cryptography\hazmat\backends\__init__.py", line 7, in <module>
import pkg_resources
File "<frozen importlib._bootstrap>", line 961, in _find_and_load
File "<frozen importlib._bootstrap>", line 950, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 646, in _load_unlocked
File "<frozen importlib._bootstrap>", line 616, in _load_backward_compatible
File "C:\...\Anaconda3\lib\site-packages\setuptools-27.2.0-py3.6.egg\pkg_resources\__init__.py", line 68, in <module>
File "<frozen importlib._bootstrap>", line 961, in _find_and_load
File "<frozen importlib._bootstrap>", line 950, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 646, in _load_unlocked
File "<frozen importlib._bootstrap>", line 616, in _load_backward_compatible
File "C:\...\Anaconda3\lib\site-packages\setuptools-27.2.0-py3.6.egg\pkg_resources\extern\__init__.py", line 43, in load_module
File "<frozen importlib._bootstrap>", line 961, in _find_and_load
File "<frozen importlib._bootstrap>", line 950, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 646, in _load_unlocked
File "<frozen importlib._bootstrap>", line 616, in _load_backward_compatible
File "C:\...\Anaconda3\lib\site-packages\setuptools-27.2.0-py3.6.egg\pkg_resources\_vendor\appdirs.py", line 510, in <module>
File "C:\...\Anaconda3\lib\site-packages\win32com\__init__.py", line 6, in <module>
import pythoncom
File "C:\...\Anaconda3\lib\site-packages\pythoncom.py", line 2, in <module>
import pywintypes
File "C:\...\Anaconda3\lib\site-packages\win32\lib\pywintypes.py", line 124, in <module>
__import_pywin32_system_module__("pywintypes", globals())
File "C:\...\Anaconda3\lib\site-packages\win32\lib\pywintypes.py", line 39, in __import_pywin32_system_module__
for suffix_item in imp.get_suffixes():
AttributeError: module 'imp' has no attribute 'get_suffixes'
I checked imp and found it does have a function get_suffixes() but it is marked as deprecated. Searching further I found that importlib should be used instead but have no idea how to do that. pywintypes.py is the file calling imp.get_suffixes(). I'm using anaconda3, python 3.5 with everything updated to latest compatible.
Related
I've created a Mac OS Catalina virtual machine at Oracle VM VirtualBox, and tried to build my application running py2app.
Here is the setup.py file:
"""
This is a setup.py script generated by py2applet
Usage:
python setup.py py2app
"""
from setuptools import setup
APP = ['app.py']
DATA_FiLES = [
'resources'
]
OPTIONS = {}
setup(
app=APP,
data_files=DATA_FILES,
options={'py2app': OPTIONS},
setup_requires=['py2app'],
)
At first, I ran in alias mode to see if the result works:
python setup.py py2app -A
and the application works just fine.
However, trying to build the application with the command:
python setup.py py2app
the resulting application throws an error:
Traceback (most recent call last):
File "<frozen zipimport>", line 259, in load_module
File "scipy/special/_ufuncs.pyc", line 14, in <module>
File "scipy/special/_ufuncs.pyc", line 10, in __load
File "imp.pyc", line 342, in load_dynamic
File "<frozen importlib._bootstrap>", line 711, in _load
File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 1181, in exec_module
File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
File "_ufuncs.pyx", line 1, in init scipy.special._ufuncs
ModuleNotFoundError: No module named 'scipy.special._ufuncs_cxx'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/__boot__.py", line 157, in <module>
_run()
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/__boot__.py", line 84, in _run
exec(compile(source, path, "exec"), globals(), globals())
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/app.py", line 3, in <module>
from source.controller.controller import Controller
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/lib/python39.zip/source/controller/controller.py", line 1, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/lib/python39.zip/source/controller/welcome_controller.py", line 3, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/lib/python39.zip/source/controller/wizard_controller.py", line 6, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/lib/python39.zip/source/view/wizard/pages/review_page.py", line 2, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "/Users/lavinia/Documents/GraphFilter/dist/app.app/Contents/Resources/lib/python39.zip/source/domain/utils.py", line 3, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "networkx/__init__.pyc", line 61, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "networkx/generators/__init__.pyc", line 8, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "networkx/generators/community.pyc", line 9, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 259, in load_module
File "scipy/special/__init__.pyc", line 633, in <module>
File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 664, in _load_unlocked
File "<frozen importlib._bootstrap>", line 627, in _load_backward_compatible
File "<frozen zipimport>", line 261, in load_module
KeyError: 'scipy.special._ufuncs'
2021-07-25 00:29:31.270 app[4178:141143] app Error
Unable to create basic Accelerated OpenGL renderer.
Unable to create basic Accelerated OpenGL renderer.
Core Image is now using the software OpenGL renderer. This will be slow.
I don't understand why was not possible to find this module.
Still unresolved，but have some attempts and progress:
Reinstall Scipy：pip uninstall scipy,then pip install scipy. error as before.
Downgrade python from 3.8 to 3.7, and downgrade py2app from 0.24 to 0.19, new error appeared.
Back to python3.8, use Pyinstaller 4.5.1. That's Ok, got a App, but size is 1.35GB.
use pipenv create virtual environment, still use Pyinstaller, got a small size APP about 205MB. That's fine for me.
My question is similar to this, however, the solutions provided for that question did not solve my problem.
I am using:
torch 1.5.1+cpu
torchvision 0.6.1+cpu
pyinstaller 4.0
pyinstaller-hooks-contrib 2020.7
I ran various commands for Pyinstaller but none of them worked.
Please give any information that may help to solve this problem.
Thank you.
d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py:493: MatplotlibDeprecationWarning:
The MATPLOTLIBDATA environment variable was deprecated in Matplotlib 3.1 and will be removed in 3.3.
exec(bytecode, module.__dict__)
Traceback (most recent call last):
File "torch\_utils_internal.py", line 46, in get_source_lines_and_file
filename = None # in case getsourcefile throws
File "inspect.py", line 955, in getsourcelines
File "inspect.py", line 786, in findsource
OSError: could not get source code
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "main.py", line 4, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "gui\guiUtils.py", line 9, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "detect.py", line 5, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "models.py", line 5, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "utils\utils.py", line 14, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\__init__.py", line 3, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\models\__init__.py", line 12, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\models\detection\__init__.py", line 1, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\models\detection\faster_rcnn.py", line 7, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\ops\__init__.py", line 8, in <module>
File "<frozen importlib._bootstrap>", line 983, in _find_and_load
File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "d:\add_yolov3\env\lib\site-packages\PyInstaller\loader\pyimod03_importers.py", line 493, in exec_module
exec(bytecode, module.__dict__)
File "torchvision\ops\poolers.py", line 41, in <module>
File "torch\jit\__init__.py", line 1280, in script
_compile_and_register_class(obj, _rcb, qualified_name)
File "torch\jit\__init__.py", line 1107, in _compile_and_register_class
ast = get_jit_class_def(obj, obj.__name__)
File "torch\jit\frontend.py", line 152, in get_jit_class_def
self_name=self_name) for method in methods]
File "torch\jit\frontend.py", line 152, in <listcomp>
self_name=self_name) for method in methods]
File "torch\jit\frontend.py", line 164, in get_jit_def
sourcelines, file_lineno, filename = get_source_lines_and_file(fn, torch._C.ErrorReport.call_stack())
File "torch\_utils_internal.py", line 53, in get_source_lines_and_file
print('obj:\t', obj)
OSError: Can't get source for <function LevelMapper.__call__ at 0x000001A8DF403708>. TorchScript requires source access in order to carry out compilation, make sure original .py files are available. Original error: could not get source code
[11512] Failed to execute script main
I have a Fabric task as follows:
#task
def getCrons():
timeStampNowServer = sudo("date +%s%3N", pty=False)
cronLogFiles = sudo(
"find /home/logs/cron/ -maxdepth 2 -type f -mtime -1 -name '*.log'", pty=False)
cronLogFiles = cronLogFiles.splitlines(True)
for cronLog in cronLogFiles:
info = sudo(
"awk '/END$/ {prev=$0; next}; /^#RETURN/ && $2>0 {cur=$0; pr=1; next}; pr {printf \" % s\n % s\n % s\n\", prev, cur, $0; pr=0}'{0}".format(cronLog), pty=False)
print(info)
I am having the following traceback:
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/fabric/main.py", line 743, in main
*args, **kwargs
File "/usr/lib/python2.7/site-packages/fabric/tasks.py", line 379, in execute
multiprocessing
File "/usr/lib/python2.7/site-packages/fabric/tasks.py", line 274, in _execute
return task.run(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/fabric/tasks.py", line 174, in run
return self.wrapped(*args, **kwargs)
File "/home/lbn/k.sewnundun/fabfile/kse/test.py", line 18, in getCrons
"awk '/END$/ {prev=$0; next}; /^#RETURN/ && $2>0 {cur=$0; pr=1; next}; pr {printf \"%s\n%s\n%s\n\", prev, cur, $0; pr=0}'{0}".format(cronLog), pty=False)
KeyError: 'prev=$0; next'
The command I want to execute on the server is:
awk '/END$/ {prev=$0; next}; /^#RETURN/ && $2>0 {cur=$0; pr=1; next}; pr {printf "%s\n%s\n%s\n", prev, cur, $0; pr=0}' mylog.LOG
However I am unable to escape the characters in the line:
info = sudo(
"awk '/END$/ {prev=$0; next}; /^#RETURN/ && $2>0 {cur=$0; pr=1; next}; pr {printf \" % s\n % s\n % s\n\", prev, cur, $0; pr=0}'{0}".format(cronLog), pty=False)
How do I make it run correctly?
The issue was solved by escaping the { and the awk new lines:
info = sudo("awk '/END$/ {{prev=$0; next}}; /^#RETURN/ && $2>0 {{cur=$0; pr=1; next}}; pr {{printf \"%s\\n%s\\n%s\\n\", prev, cur, $0; pr=0}}' {0}".format(cronLog), pty=False)
https://docs.python.org/2/library/string.html#format-string-syntax
Format strings contain “replacement fields” surrounded by curly braces {}. Anything that is not contained in braces is considered literal text, which is copied unchanged to the output. If you need to include a brace character in the literal text, it can be escaped by doubling: {{ and }}.
I have a file with the following header:
File 1:
location, nameA, nameB, nameC
and a second file with the format:
File2:
ID_number, names
101, nameA
102, nameB
103, nameC
I would like to match the row names from File1 to those in column 2 of File2, and if they match replace the names in the header with the ID number. So that in the end, the resulting file would like:
File 1:
location, 101, 102, 103
I've mostly being trying with awk to do this but I can't get it to produce anything and I'm not sure how to ask it to do the last part of what I want.
awk -F "," '{print $2}' file2.csv | while read i; do awk 'NR=1;{for (j=0;j<=NF;j++) {if ($j == $i) printF $j; }}' file1.csv;done > test.csv
It's a really large file with thousands of columns and rows, so I just put up a simplified version of the files in my question here.
Thanks!
This should work if your csv fields have no embedded commas. It also assumes that both files have a header line.
awk '
BEGIN { FS=","; OFS=", " }
FNR == 1 { # if it is the header line
if (NR != 1) # if it is the second file
print # print it
next # go to next line of file
}
{ gsub(/ +/, "") } # compress spaces
NR == FNR { # if it is the first file
a[$2] = $1 # save the info
next # go to next line of file
}
{
$2=a[$2]; $3=a[$3]; $4=a[$4] # swap names
print # print line
}
' file2.csv file1.csv
Test files:
file1.csv
location, nameA, nameB, nameC
Earth, Chuck, Edward, Bob
The Moon, Bob, Doris, Al
file2.csv
ID_number, names
101, Al
102, Bob
103, Chuck
104, Doris
105, Edward
Output:
location, nameA, nameB, nameC
Earth, 103, 105, 102
TheMoon, 102, 104, 101
I am doing the following, but have two issues with this (win 2003):
Output includes first and last line that is matching :-(
Output is not side by side
Can these two issues be solved? Suggestiongs (I tried /nnn and /lb options)
SCRIPT:
:bof
::Swith off echo - the # switch off echo for this line
#echo off
:: Clear screen
cls
:: Keep Locals contained to this batch file
setlocal
:: Set the two files and check that they exist
set fileA=X:\tst\pfsrc\alex.txt
set fileB=X:\tst\cbsrc\alex.txt
if not exist "%fileA%" echo %fileA% not found & goto :end
if not exist "%fileB%" echo %fileB% not found & goto :end
:: del .old file rename previous output file to .old
rem if exist X:\tst\cbsrc\resultPF1.old del X:\tst\cbsrc\resultPF1.old
rem if exist X:\tst\cbsrc\resultPF1.txt rename X:\tst\cbsrc\resultPF1.txt *.old
:: compare files
FC /c /l /n /w %fileA% %fileB%
:end
1st INPUT FILE:
new line
line1
line2
line3
line4
insert new line
and another new line
line5
line6
line7
and a line here
line8
line9
line10
what is this line?
line11
2nd INPUT FILE:
new line
alex
hart
was
here
line5
line6
line7
line8
line here
line9
line10
OUTPUT:
Comparing files X:\TST\PFSRC\alex.txt and X:\TST\CBSRC\ALEX.TXT
***** X:\TST\PFSRC\alex.txt
1: new line
2: line1
3: line2
4: line3
5: line4
6: insert new line
7: and another new line
8: line5
***** X:\TST\CBSRC\ALEX.TXT
1: new line
2: alex
3: hart
4: was
5: here
6: line5
*****
***** X:\TST\PFSRC\alex.txt
10: line7
11: and a line here
12: line8
13: line9
***** X:\TST\CBSRC\ALEX.TXT
8: line7
9: line8
10: line here
11: line9
*****
***** X:\TST\PFSRC\alex.txt
15: what is this line?
16: line11
***** X:\TST\CBSRC\ALEX.TXT
*****
The FC command always show differences as sets of lines listed one after the other; there is no way to show the differences side by side. You may get FC output and process it in a Batch program so the differences be displayed side by side, but you must realize that this program should identify different particular cases in order to correctly show two sections side by side.
Some time ago I wrote such a program; I called it "FComp.bat" and you may download it here. For example:
C:\> FComp.bat /C /L /N /W 1stInputFile.txt 2ndInputFile.txt
Comparing files 1stInputFile.txt and 2NDINPUTFILE.TXT
============================== SECTION MODIFIED =============================
1: new line | 1: new line
2: line1 | 2: alex
3: line2 | 3: hart
4: line3 | 4: was
5: line4 | 5: here
6: insert new line | 6: line5
7: and another new line
8: line5
============================== SECTION MODIFIED =============================
10: line7 | 8: line7
11: and a line here | 9: line8
12: line8 | 10: line here
13: line9 | 11: line9
OLD SECTION DELETED AT END OF FILE ===========================================
- 15: what is this line?
- 16: line11