unable to start scrapyd in windows cmd - windows

I am trying to start scrapyd in windows cmd using scrapyd, however error below occurred.
C:\Users\Zheyuuu>scrapyd
Traceback (most recent call last):
File "d:\anacaonda\lib\runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "d:\anacaonda\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "D:\Anacaonda\Scripts\scrapyd.exe\__main__.py", line 5, in <module>
File "d:\anacaonda\lib\site-packages\scrapyd\scripts\scrapyd_run.py", line 3, in <module>
from twisted.scripts.twistd import run
File "d:\anacaonda\lib\site-packages\twisted\scripts\twistd.py", line 17, in <module>
from twisted.scripts._twistw import ServerOptions, \
File "d:\anacaonda\lib\site-packages\twisted\scripts\_twistw.py", line 8, in <module>
from twisted.application import app, service, internet
File "d:\anacaonda\lib\site-packages\twisted\application\internet.py", line 54, in <module>
from automat import MethodicalMachine
File "d:\anacaonda\lib\site-packages\automat\__init__.py", line 2, in <module>
from ._methodical import MethodicalMachine
File "d:\anacaonda\lib\site-packages\automat\_methodical.py", line 34, in <module>
#attr.s(frozen=True)
TypeError: attributes() got an unexpected keyword argument 'frozen'
I have been searching for solutions in google but unfortunatelly figure out why it happened. What's more, I have reinstalled scrapyd but it didn't work. My packages are below.
Scrapy (1.3.3)
scrapyd (1.2.0)
scrapyd-client (1.1.0)
Twisted (17.5.0)
Python: 3.6.1 |Anaconda custom (64-bit)| (default, May 11 2017, 13:25:24) [MSC v.1900 64 bit (AMD64)]

Well, I have solved it. The bug lies in Twisted. I reinstalled it and everything runs perfectly.

Related

Pip not working; from 'ImportError: No module named urllib3' to non-admin windows user

I am facing some problems with pip. The original error message in my command prompt (windows, Python 2.7.14 and this is the version I must keep) when typing for instance pip was
Traceback (most recent call last):
File "c:\python27\lib\runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "c:\python27\lib\runpy.py", line 72, in _run_code
exec code in run_globals
File "C:\Python27\Scripts\pip.exe\__main__.py", line 5, in <module>
File "c:\python27\lib\site-packages\pip\__init__.py", line 21, in <module>
from pip._vendor.requests.packages.urllib3.exceptions import DependencyWarning
File "c:\python27\lib\site-packages\pip\_vendor\requests\__init__.py", line 62, in <module>
from .packages.urllib3.exceptions import DependencyWarning
File "c:\python27\lib\site-packages\pip\_vendor\requests\packages\__init__.py", line 29, in <module>
import urllib3
ImportError: No module named urllib3
My journey to solve/explore the problem:
This happend no matter which of the following prompt commands I was trying
pip
pip --version
pip list
pip freeze
pip install --upgrade requests
pip install urllib3
Other commands might have change the error message a little bit in terms of the files listed like
python -m pip install --upgrade pip
Traceback (most recent call last):
File "C:\Python27\lib\runpy.py", line 163, in _run_module_as_main
mod_name, _Error)
File "C:\Python27\lib\runpy.py", line 111, in _get_module_details
__import__(mod_name) # Do not catch exceptions initializing package
File "C:\Python27\lib\site-packages\pip\__init__.py", line 21, in <module>
from pip._vendor.requests.packages.urllib3.exceptions import DependencyWarning
File "C:\Python27\lib\site-packages\pip\_vendor\requests\__init__.py", line 62, in <module>
from .packages.urllib3.exceptions import DependencyWarning
File "C:\Python27\lib\site-packages\pip\_vendor\requests\packages\__init__.py", line 29, in <module>
import urllib3
ImportError: No module named urllib3
I have checked the following (according to several suggestions I found in related questions on stackoverflow)
a pip application can be found in C:\Python27\Scripts
dont have something called PYTHONPATH in system variables only Path
C:\Python27\Scripts is listed in system variables>Path
anaconda was installed by the user before me. I uninstalled as apparently this could cause troubles and deleted all remaining .condarc files,./conda & conda folders as well as the system variable>Path listing.
I have tried the solution which was voted for here by downloading and running python get-pip.py. This is the error message:
>python get-pip.py
Traceback (most recent call last):
File "get-pip.py", line 23974, in <module>
main()
File "get-pip.py", line 188, in main
tmpdir = tempfile.mkdtemp()
File "C:\Python27\lib\tempfile.py", line 331, in mkdtemp
dir = gettempdir()
File "C:\Python27\lib\tempfile.py", line 275, in gettempdir
tempdir = _get_default_tempdir()
File "C:\Python27\lib\tempfile.py", line 200, in _get_default_tempdir
with _io.open(fd, 'wb', closefd=False) as fp:
AttributeError: 'module' object has no attribute 'open'
I was told there were some problems noticed before: The computer has 2 users, an administrator and an additional user with '(user)' in its name. I was told that it was not possible to install anaconda for that user - it was installed by the administrator for all users but in the end spyder for instance and the anaconda prompt could only be ran as administrator, too. So I am not sure if there is a problem in general with the user setup?!
I ran the command prompt as administrator and pip --version worked
pip 9.0.1 from c:\python27\lib\site-packages (python 2.7)
So I ran python -m pip install --upgrade pip as administrator, opened the command prompt again (not as administrator and now the new error is
Traceback (most recent call last):
File "c:\python27\lib\runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "c:\python27\lib\runpy.py", line 72, in _run_code
exec code in run_globals
File "C:\Python27\Scripts\pip.exe\__main__.py", line 5, in <module>
File "c:\python27\lib\site-packages\pip\_internal\cli\main.py", line 10, in <module>
from pip._internal.cli.autocompletion import autocomplete
File "c:\python27\lib\site-packages\pip\_internal\cli\autocompletion.py", line 9, in <module>
from pip._internal.cli.main_parser import create_main_parser
File "c:\python27\lib\site-packages\pip\_internal\cli\main_parser.py", line 7, in <module>
from pip._internal.cli import cmdoptions
File "c:\python27\lib\site-packages\pip\_internal\cli\cmdoptions.py", line 25, in <module>
from pip._internal.cli.progress_bars import BAR_TYPES
File "c:\python27\lib\site-packages\pip\_internal\cli\progress_bars.py", line 12, in <module>
from pip._internal.utils.logging import get_indentation
File "c:\python27\lib\site-packages\pip\_internal\utils\logging.py", line 18, in <module>
from pip._internal.utils.misc import ensure_dir
File "c:\python27\lib\site-packages\pip\_internal\utils\misc.py", line 21, in <module>
from pip._vendor import pkg_resources
File "c:\python27\lib\site-packages\pip\_vendor\pkg_resources\__init__.py", line 26, in <module>
import zipfile
File "c:\python27\lib\zipfile.py", line 501, in <module>
class ZipExtFile(io.BufferedIOBase):
AttributeError: 'module' object has no attribute 'BufferedIOBase'
Tried step 3 again, same outcome
Now I am frustrated and I am hoping for help because I am not super experienced and I don't want to mess up things even more (probably already did by uninstalling anaconda).
Thank you for helping!
PS: I can not exclude that I did not miss the correct solution for this problem, as several topics are addressing pip and urllib3 already, however I have tried my best to cover all suggestions. I apologize if there is already a similar topic solving this problem out there.

Anaconda (latest version) not launching with python 3.6 on windows 10

I had Python 2.7 anaconda running perfectly fine, but when I uninstalled it and installed anaconda for 3.6 python on windows 10, it's not launching, neither Spyder is opening.
the following traceback I got from anaconda prompt.
I have deleted .lock files suggested in some earlier posts.
Traceback (most recent call last):
File "C:\Users\Being_Rohit\Anaconda3\Scripts\conda-script.py", line 3, in
<module>
import conda.cli
File "C:\Users\Being_Rohit\Anaconda3\lib\site-
packages\conda\cli\__init__.py", line 8, in <module>
from .main import main # NOQA
File "C:\Users\Being_Rohit\Anaconda3\lib\site-packages\conda\cli\main.py",
line 42, in <module>
from argparse import SUPPRESS
File "C:\Users\Being_Rohit\Anaconda3\lib\argparse.py", line 89, in <module>
import re as _re
File "C:\Users\Being_Rohit\Anaconda3\lib\re.py", line 142, in <module>
class RegexFlag(enum.IntFlag):
AttributeError: module 'enum' has no attribute 'IntFlag'

Install pip<v8 in python3.2

I fail to install pip in python3.2.
The newest version of pip (v8.x) seems to not support python3.2 any more.
So i tried: sudo python3 get-pip.py 'pip<8' but it still seems to install v8.x.
Output:
UserWarning: Support for Python 3.0-3.2 has been dropped. Future versions will fail here.
Traceback (most recent call last):
File "get-pip.py", line 19178, in <module>
main()
File "get-pip.py", line 195, in main
bootstrap(tmpdir=tmpdir)
File "get-pip.py", line 82, in bootstrap
import pip
File "/tmp/tmpec9tur/pip.zip/pip/__init__.py", line 16, in <module>
File "/tmp/tmpec9tur/pip.zip/pip/vcs/mercurial.py", line 9, in <module>
File "/tmp/tmpec9tur/pip.zip/pip/download.py", line 36, in <module>
File "/tmp/tmpec9tur/pip.zip/pip/utils/ui.py", line 15, in <module>
File "/tmp/tmpec9tur/pip.zip/pip/_vendor/progress/bar.py", line 48
empty_fill = u'∙'
^
SyntaxError: invalid syntax
Any ideas?
I found the solution:
I used the wrong get-pip, as per documentation of get-pip
use https://bootstrap.pypa.io/3.2/get-pip.py
As the bootstrap.pypa.io got updated so they changed the path of files or directories.
https://bootstrap.pypa.io/3.2/get-pip.py will not work
This link will work :
https://bootstrap.pypa.io/pip/3.2/

Error importing tensorflow because of wrong architecture

I am attempting to install TensorFlow on my Mac ( OSX El Capitan 10.11.2) following the instructions listed here
I used pip to install tensorflow for Python3 and it appears that everything installed successfully.
But when I go to test it, I am greeted with this error:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/__init__.py", line 23, in <module>
from tensorflow.python import *
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/python/__init__.py", line 45, in <module>
from tensorflow.python import pywrap_tensorflow
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/python/pywrap_tensorflow.py", line 28, in <module>
_pywrap_tensorflow = swig_import_helper()
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/python/pywrap_tensorflow.py", line 24, in swig_import_helper
_mod = imp.load_module('_pywrap_tensorflow', fp, pathname, description)
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/imp.py", line 243, in load_module
return load_dynamic(name, filename, file)
ImportError: dlopen(/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/python/_pywrap_tensorflow.so, 10): no suitable image found. Did find:
/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/site-packages/tensorflow/python/_pywrap_tensorflow.so: mach-o, but wrong architecture
This error is not listed on the common problems and I couldn't find anything conclusive on my own.
Update:
#mrry Alrighty, import sys; print(sys.maxsize) is returning 2147483647 so python is running in 32bit mode.

install pyshark on python 3.5

I've installed python 3.5 on mac os x (el capitan). I want to import pyshark module in python, but I get error.
I installed the pyshark requirement such as (logbook, lxml, trollies, py) but I couldn't import pyshark module.
pip3 list >>
syncio (3.4.3)
futures (3.0.3)
Logbook (0.12.3)
lxml (3.5.0)
pip (7.1.2)
py (1.4.30)
pyshark (0.3.6)
setuptools (18.2)
trollius (2.0)
Importing pyshark module error:
>>> import pyshark
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/pyshark/__init__.py", line 1, in <module>
from pyshark.capture.live_capture import LiveCapture
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/pyshark/capture/live_capture.py", line 1, in <module>
from pyshark.capture.capture import Capture
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/pyshark/capture/capture.py", line 6, in <module>
import trollius as asyncio
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/__init__.py", line 21, in <module>
from .base_events import *
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/base_events.py", line 39, in <module>
from . import coroutines
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/coroutines.py", line 15, in <module>
from . import futures
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/futures.py", line 116, in <module>
class Future(object):
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/futures.py", line 426, in Future
__await__ = __iter__ # make compatible with 'await' expression
NameError: name '__iter__' is not defined
Also importing trollies module has a error:
>>> import trollius
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/__init__.py", line 21, in <module>
from .base_events import *
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/base_events.py", line 39, in <module>
from . import coroutines
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/coroutines.py", line 15, in <module>
from . import futures
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/futures.py", line 116, in <module>
class Future(object):
File "/Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages/trollius/futures.py", line 426, in Future
__await__ = __iter__ # make compatible with 'await' expression
NameError: name '__iter__' is not defined
Could any one help me out? I can't figure out what is the problem.
This is reported as a bug in https://github.com/haypo/trollius/issues/4
Until it is resolved you can temporalily resolve it by installing an unofficial development version from ludios by doing:
pip install -U git+https://github.com/ludios/trollius#f757a29815c2c9f5c3a691135ff758649fe84098#egg=trollius
Remember that this is a temporary and unofficial solution only. So hit the "subscribe" button on the issue page: https://github.com/haypo/trollius/issues/4 to subscribe to notifications. When the issue is officially resolved, use the official solution.

Resources