Cannot install scrapy on my Mac using easy_install or pip - macos

I am using sudo easy_install Scrapy to try and install Scrapy on my Mac (running Mac OS 10.9.2).
The installation appears to be nearly complete when I receive the error below. I can't seem to figure it out. Can anyone help?
Installed /Library/Python/2.7/site-packages/cssselect-0.9.1-py2.7.egg
Searching for lxml
Reading http://pypi.python.org/simple/lxml/
Best match: lxml 3.3.3
Downloading https://pypi.python.org/packages/source/l/lxml/lxml-3.3.3.tar.gz#md5=f2675837b4358a5ecab5fd9a783fd0e5
Processing lxml-3.3.3.tar.gz
Running lxml-3.3.3/setup.py -q bdist_egg --dist-dir /tmp/easy_install-xwN2PB/lxml-3.3.3/egg-dist-tmp-CkAsXC
Building lxml version 3.3.3.
Building without Cython.
Using build configuration of libxslt 1.1.28
/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'bugtrack_url'
warnings.warn(msg)
clang: error: unknown argument: '-mno-fused-madd' [-Wunused-command-line-argument-hard-error-in-future]
clang: note: this will be a hard error (cannot be downgraded to a warning) in the future
error: Setup script exited with error: command 'cc' failed with exit status 1
Edit
Using pip install scrapy, I get the error below. So neither option works.
Installing collected packages: w3lib, queuelib, lxml
Running setup.py install for w3lib
error: could not create '/Library/Python/2.7/site-packages/w3lib': Permission denied
Complete output from command /usr/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/86/1mln902j0jx7698nxqk69_7r0000gn/T/pip_build_zacharygallinger/w3lib/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/86/1mln902j0jx7698nxqk69_7r0000gn/T/pip-hXKj0S-record/install-record.txt --single-version-externally-managed --compile:
running install
running build
running build_py
creating build
creating build/lib
creating build/lib/w3lib
copying w3lib/__init__.py -> build/lib/w3lib
copying w3lib/encoding.py -> build/lib/w3lib
copying w3lib/form.py -> build/lib/w3lib
copying w3lib/html.py -> build/lib/w3lib
copying w3lib/http.py -> build/lib/w3lib
copying w3lib/url.py -> build/lib/w3lib
copying w3lib/util.py -> build/lib/w3lib
running install_lib
creating /Library/Python/2.7/site-packages/w3lib
error: could not create '/Library/Python/2.7/site-packages/w3lib': Permission denied
----------------------------------------
Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/86/1mln902j0jx7698nxqk69_7r0000gn/T/pip_build_zacharygallinger/w3lib/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/86/1mln902j0jx7698nxqk69_7r0000gn/T/pip-hXKj0S-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /private/var/folders/86/1mln902j0jx7698nxqk69_7r0000gn/T/pip_build_zacharygallinger/w3lib
Storing debug log for failure in /Users/zacharygallinger/Library/Logs/pip.log

For the time being you might be able to get past this by doing the following before building it:
export CFLAGS=-Qunused-arguments
export CPPFLAGS=-Qunused-arguments
This should signal the compiler to turn these errors back into warnings. Eventually, as indicated by the error message these will be hard errors. Long term, the package maintainer will have to edit the package to not use -mno-fused-madd.
For reference: https://bitbucket.org/cffi/cffi/issue/46/unused-mno-fused-madd-clang-warnings-on-os

Related

how to download Flask-MySQLdb

I'm currently downloading Flask -MySQLdb to work on a log-in system project as a beginner, but when I tried to install it, it kept giving me this error, which I had no idea how to solve it.
Collecting Flask-MySQLdb
Using cached Flask-MySQLdb-0.2.0.tar.gz (2.1 kB)
Requirement already satisfied: Flask>=0.10 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Flask-MySQLdb) (1.1.2)
Collecting mysqlclient
Using cached mysqlclient-2.0.1.tar.gz (87 kB)
Requirement already satisfied: itsdangerous>=0.24 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Flask>=0.10->Flask-MySQLdb) (1.1.0)
Requirement already satisfied: Werkzeug>=0.15 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Flask>=0.10->Flask-MySQLdb) (1.0.1)
Requirement already satisfied: click>=5.1 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Flask>=0.10->Flask-MySQLdb) (7.1.2)
Requirement already satisfied: Jinja2>=2.10.1 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Flask>=0.10->Flask-MySQLdb) (2.11.2)
Requirement already satisfied: MarkupSafe>=0.23 in c:\users\고명수\pycharmprojects\myeongsoopython\venv\lib\site-packages (from Jinja2>=2.10.1->Flask>=0.10->Flask-MySQLdb) (1.1.1)
Using legacy setup.py install for Flask-MySQLdb, since package 'wheel' is not installed.
Using legacy setup.py install for mysqlclient, since package 'wheel' is not installed.
Installing collected packages: mysqlclient, Flask-MySQLdb
Running setup.py install for mysqlclient: started
Running setup.py install for mysqlclient: finished with status 'error'
ERROR: Command errored out with exit status 1:
command: 'C:\Users\고명수\PycharmProjects\MyeongsooPython\venv\Scripts\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\고명수\\AppData\\Local\\Temp\\pycharm-packaging\\mysqlclient\\setup.py'"'"'; __file__='"'"'C:\\Users\\고명수\\AppData\\Local\\Temp\\pycharm-packaging\\mysqlclient\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\고명수\AppData\Local\Temp\pip-record-_h_9brc2\install-record.txt' --single-version-externally-managed --compile --install-headers 'C:\Users\고명수\PycharmProjects\MyeongsooPython\venv\include\site\python3.8\mysqlclient'
cwd: C:\Users\고명수\AppData\Local\Temp\pycharm-packaging\mysqlclient\
Complete output (25 lines):
running install
running build
running build_py
creating build
creating build\lib.win32-3.8
creating build\lib.win32-3.8\MySQLdb
copying MySQLdb\__init__.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\_exceptions.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\connections.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\converters.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\cursors.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\release.py -> build\lib.win32-3.8\MySQLdb
copying MySQLdb\times.py -> build\lib.win32-3.8\MySQLdb
creating build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\__init__.py -> build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\CLIENT.py -> build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\CR.py -> build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\ER.py -> build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\FIELD_TYPE.py -> build\lib.win32-3.8\MySQLdb\constants
copying MySQLdb\constants\FLAG.py -> build\lib.win32-3.8\MySQLdb\constants
warning: build_py: byte-compiling is disabled, skipping.
running build_ext
building 'MySQLdb._mysql' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Build Tools for Visual Studio": https://visualstudio.microsoft.com/downloads/
----------------------------------------
ERROR: Command errored out with exit status 1: 'C:\Users\고명수\PycharmProjects\MyeongsooPython\venv\Scripts\python.exe' -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\\고명수\\AppData\\Local\\Temp\\pycharm-packaging\\mysqlclient\\setup.py'"'"'; __file__='"'"'C:\\Users\\고명수\\AppData\\Local\\Temp\\pycharm-packaging\\mysqlclient\\setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record 'C:\Users\고명수\AppData\Local\Temp\pip-record-_h_9brc2\install-record.txt' --single-version-externally-managed --compile --install-headers 'C:\Users\고명수\PycharmProjects\MyeongsooPython\venv\include\site\python3.8\mysqlclient' Check the logs for full command output.
WARNING: You are using pip version 20.1.1; however, version 20.2.2 is available.
You should consider upgrading via the 'C:\Users\고명수\PycharmProjects\MyeongsooPython\venv\Scripts\python.exe -m pip install --upgrade pip' command.
Well, the message suggested upgrading pip to the latest version, so I tried it but it is giving me this error again.

Errors in downloading the python modules using pip

often I face the same error during downloading the python modules using pip. Could you guys help me sort this out? FYI I am using python 3.7v.
C:\>pip install PyAudio
Collecting PyAudio
Downloading https://files.pythonhosted.org/packages/ab/42/b4f04721c5c5bfc196ce156b3c768998ef8c0ae3654ed29ea5020c749a6b/PyAudio-0.2.11.tar.gz
Building wheels for collected packages: PyAudio
Running setup.py bdist_wheel for PyAudio ... error
Complete output from command c:\users\avinash.tripathy\appdata\local\programs\python\python37-32\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\AVINAS~1.TRI\\AppData\\Local\\Temp\\pip-install-_qfc03y7\\PyAudio\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d C:\Users\AVINAS~1.TRI\AppData\Local\Temp\pip-wheel-fjb2zkz4 --python-tag cp37:
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win32-3.7
copying src\pyaudio.py -> build\lib.win32-3.7
running build_ext
building '_portaudio' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
----------------------------------------
Failed building wheel for PyAudio
Running setup.py clean for PyAudio
Failed to build PyAudio
Installing collected packages: PyAudio
Running setup.py install for PyAudio ... error
Complete output from command c:\users\avinash.tripathy\appdata\local\programs\python\python37-32\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\AVINAS~1.TRI\\AppData\\Local\\Temp\\pip-install-_qfc03y7\\PyAudio\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\AVINAS~1.TRI\AppData\Local\Temp\pip-record-h2e_hkyb\install-record.txt --single-version-externally-managed --compile:
running install
running build
running build_py
creating build
creating build\lib.win32-3.7
copying src\pyaudio.py -> build\lib.win32-3.7
running build_ext
building '_portaudio' extension
error: Microsoft Visual C++ 14.0 is required. Get it with "Microsoft Visual C++ Build Tools": https://visualstudio.microsoft.com/downloads/
----------------------------------------
Command "c:\users\avinash.tripathy\appdata\local\programs\python\python37-32\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\AVINAS~1.TRI\\AppData\\Local\\Temp\\pip-install-_qfc03y7\\PyAudio\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\AVINAS~1.TRI\AppData\Local\Temp\pip-record-h2e_hkyb\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\AVINAS~1.TRI\AppData\Local\Temp\pip-install-_qfc03y7\PyAudio\
It doesn't look like PyAudio has a binary package available under pip. Christoph Gohlke maintains Unofficial Windows Binaries for Python Extension Packages and it has PyAudio. Download an appropriate version, then install it directly with pip install.

Error when installing secp256k1 library on windows

I am trying to install the secp256k1 library on my windows 10 64-bit machine and I receive the following error
C:\Users\user\Downloads\http-ftp>pip3 install secp256k1
Collecting secp256k1
Using cached https://files.pythonhosted.org/packages/52/62/d7bf3829e126e517e253d2e22a63511c54bbaac34d7ddea316cde040fc49/secp256k1-0.13.2.tar.gz
Requirement already satisfied: cffi>=1.3.0 in c:\users\user\appdata\local\programs\python\python36\lib\site-packages (from secp256k1) (1.11.5)
Requirement already satisfied: pycparser in c:\users\user\appdata\local\programs\python\python36\lib\site-packages (from cffi>=1.3.0->secp256k1) (2.18)
Building wheels for collected packages: secp256k1
Running setup.py bdist_wheel for secp256k1 ... error
Complete output from command c:\users\user\appdata\local\programs\python\python36\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\user\\AppData\\Local\\Temp\\pip-install-ewfjmjoy\\secp256k1\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" bdist_wheel -d C:\Users\user\AppData\Local\Temp\pip-wheel-p9ijp41o --python-tag cp36:
0.28
Using bundled libsecp256k1
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win-amd64-3.6
creating build\lib.win-amd64-3.6\secp256k1
copying secp256k1\__init__.py -> build\lib.win-amd64-3.6\secp256k1
copying secp256k1\__main__.py -> build\lib.win-amd64-3.6\secp256k1
running build_clib
error: [WinError 193] %1 is not a valid Win32 application
----------------------------------------
Failed building wheel for secp256k1
Running setup.py clean for secp256k1
Failed to build secp256k1
Installing collected packages: secp256k1
Running setup.py install for secp256k1 ... error
Complete output from command c:\users\user\appdata\local\programs\python\python36\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\user\\AppData\\Local\\Temp\\pip-install-ewfjmjoy\\secp256k1\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\user\AppData\Local\Temp\pip-record-y6bxnsr0\install-record.txt --single-version-externally-managed --compile:
0.28
Using bundled libsecp256k1
running install
running build
running build_py
creating build
creating build\lib.win-amd64-3.6
creating build\lib.win-amd64-3.6\secp256k1
copying secp256k1\__init__.py -> build\lib.win-amd64-3.6\secp256k1
copying secp256k1\__main__.py -> build\lib.win-amd64-3.6\secp256k1
running build_clib
error: [WinError 193] %1 is not a valid Win32 application
----------------------------------------
Command "c:\users\user\appdata\local\programs\python\python36\python.exe -u -c "import setuptools, tokenize;__file__='C:\\Users\\user\\AppData\\Local\\Temp\\pip-install-ewfjmjoy\\secp256k1\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record C:\Users\user\AppData\Local\Temp\pip-record-y6bxnsr0\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in C:\Users\user\AppData\Local\Temp\pip-install-ewfjmjoy\secp256k1\
Any suggestions what can be wrong and how to correct it? I tried with pip3 and easy_install also but nothing seems to work.
You can use this one: https://github.com/jhtitor/secp256k1prp-py
from the repository README:
Windows 7+
install .NET Framework 4.6 or higher
install Visual C++ 14.0 from "Microsoft Visual C++ Build Tools"
install python 3.6.5 or later
Note: for python 3.5 builds, download and install Visual Studio 2015
Then try to install it again
Windows is not supported: https://github.com/hyperledger/sawtooth-sdk-python/blob/master/BUILD.md
"Supported operating systems: Ubuntu 18.04 and macOS
If you want to use a Windows system, we recommend that you install Ubuntu 18.04 in a virtual machine manager, such as Hyper-V or VirtualBox, and develop from the guest operating system."
I had the same problem in Ubuntu and I solved it with this solution:
sudo apt-get install libsecp256k1-dev
Source
You might want to use this lib
https://pypi.org/project/secp256k1Crypto/
pip3 install secp256k1Crypto
it's a fork of secp256k1-py (with the exact functionality) but with precompiled libraries from electrumsv-secp256k1 which supports Windows with easy installation.

installation of vpython using pip in High Sierra

I am having issue with installing vpython using pip. During the installation I get and error as if I do not have stdio.h, which I do
In file included from _scandir.c:14:
/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7/Python.h:33:10: fatal error: 'stdio.h' file not found
#include <stdio.h>
^~~~~~~~~
1 error generated.
error: command '/usr/bin/clang' failed with exit status 1
Command "/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/Python -u -c "import setuptools, tokenize;__file__='/private/var/folders/mf/h7c_zhyd7yl6t7nkgx10j6pw0000gq/T/pip-build-czavCr/scandir/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /var/folders/mf/h7c_zhyd7yl6t7nkgx10j6pw0000gq/T/pip-is5WM1-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/var/folders/mf/h7c_zhyd7yl6t7nkgx10j6pw0000gq/T/pip-build-czavCr/scandir/
I am running High Sierra, latest Xcode
Most posts on the web suggest to install the command line tools with
xcode-select --install but I did and I can compile some of my codes just fine.
Other things I have tried:
removing and reinstalling xcode+command line tools
remove the /Library/Developer/CommandLineTools/
CFLAGS=-stdlib=libc++ pip install vpython
MACOSX_DEPLOYMENT_TARGET=10.13 pip install vpython
but nothing works. I am completely out of ideas
I was unable to understand the problem above, but I have managed to find two workarounds to get a working version of vpython. Somehow the issue seems to be related to python package I installed from python.org and the pip included. I removed it and installed instead python2 and python3 using Homebrew and both pip2 and pip3 managed to install successfully the vpython and other modules.
Another alternative, which seems even better is to install Anaconda Python and then use conda to get vphyton.

"error code 1" Installing usaddress with Anaconda on Windows 7 32-bit

I am running Windows 7 and Anaconda. Attempting to install usaddress library found here: https://github.com/datamade/usaddress I have attempted this installation using a virtual env of Python 2.7 in my Anaconda3 installation, and a separately installed Anaconda 2.
I installed pip for Conda and navigated to my Scripts directory to attempt an install using pip install usaddress. It does not work, neither do many of the solutions that I have found on the internet. The error I get is this:
Command "C:\Users\User\Anaconda2\python.exe -u -c "import setuptools, tokenize;__file__='c:\users\user\appdata\local\temp\pip-build-0a_vd7\python-crfsuite\setup.py';exec(compile(getattr(tokenize, 'open'
, open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record c:\users\user\appdata\local\temp\pip-mtrojm-record\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in c:\users\user\appdata\local\temp\pip-build-0a_vd7\python-crfsuite
This is another error that seems to pop up:
Failed building wheel for python-crfsuite
Running setup.py clean for python-crfsuite
Failed to build python-crfsuite
I have also attempted to fix this error with no luck by searching Stack and other places on the internet.

Resources