spacy with zappa showing error on AWS lambda - aws-lambda

My API was working perfectly fine with AWS lambda using Zappa. But I need spacy for my code to run. The moment I install spacy==2.0.13 and update the zappa dev , the api stops working. It gives 502 error. Kindly help me regarding this. I have already increased the memory size to 3008.
Following is returned as the response body:
{'message': 'An uncaught exception happened while servicing this request. You can investigate this with the zappa tail command.', 'traceback': ['Traceback (most recent call last):\\n', ' File \"/var/task/handler.py\", line 531, in handler\\n with Response.from_app(self.wsgi_app, environ) as response:\\n', ' File \"/var/task/werkzeug/wrappers/base_response.py\", line 287, in from_app\\n return cls(*_run_wsgi_app(app, environ, buffered))\\n', ' File \"/var/task/werkzeug/wrappers/base_response.py\", line 26, in _run_wsgi_app\\n return _run_wsgi_app(*args)\\n', ' File \"/var/task/werkzeug/test.py\", line 1119, in run_wsgi_app\\n app_rv = app(environ, start_response)\\n', \"TypeError: 'NoneType' object is not callable\\n\"]}
Log from Zappa tail :
File "/var/task/handler.py", line 602, in lambda_handler
return LambdaHandler.lambda_handler(event, context)
File "/var/task/handler.py", line 245, in lambda_handler
handler = cls()
File "/var/task/handler.py", line 102, in __init__
self.load_remote_project_archive(project_archive_path)
File "/var/task/handler.py", line 174, in load_remote_project_archive
t.extractall(project_folder)
File "/var/lang/lib/python3.6/tarfile.py", line 2010, in extractall
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2052, in extract
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2122, in _extract_member
self.makefile(tarinfo, targetpath)
File "/var/lang/lib/python3.6/tarfile.py", line 2171, in makefile
copyfileobj(source, target, tarinfo.size, ReadError, bufsize)
File "/var/lang/lib/python3.6/tarfile.py", line 252, in copyfileobj
dst.write(buf)
Log from Cloudwatch Console:
[Errno 28] No space left on device: OSError
Traceback (most recent call last):
File "/var/task/handler.py", line 602, in lambda_handler
return LambdaHandler.lambda_handler(event, context)
File "/var/task/handler.py", line 245, in lambda_handler
handler = cls()
File "/var/task/handler.py", line 102, in __init__
self.load_remote_project_archive(project_archive_path)
File "/var/task/handler.py", line 174, in load_remote_project_archive
t.extractall(project_folder)
File "/var/lang/lib/python3.6/tarfile.py", line 2010, in extractall
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2052, in extract
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2122, in _extract_member
self.makefile(tarinfo, targetpath)
File "/var/lang/lib/python3.6/tarfile.py", line 2171, in makefile
copyfileobj(source, target, tarinfo.size, ReadError, bufsize)
File "/var/lang/lib/python3.6/tarfile.py", line 252, in copyfileobj
dst.write(buf)
OSError: [Errno 28] No space left on device

Your error is that there is no space left on the lambda function. SpaCy requires quite a lot of space. Therefore, follow the following suggestions:
AWS Lambda No Space Left on Device error

Related

pip error while installing django, kivy and other modules

I installed python 3.10 then tried to install django but it just starts downloading by after it reaches a certain point it crashes and shows this error Exception:
Traceback (most recent call last):
File
"c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\urllib3\response.py",
line 302, in _error_catcher
yield File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\urllib3\response.py",
line 384, in read
data = self._fp.read(amt) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\cachecontrol\filewrapper.py",
line 60, in read
data = self.__fp.read(amt) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\http\client.py",
line 447, in read
n = self.readinto(b) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\http\client.py",
line 491, in readinto
n = self.fp.readinto(b) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\socket.py",
line 589, in readinto
return self._sock.recv_into(b) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\ssl.py",
line 1049, in recv_into
return self.read(nbytes, buffer) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\ssl.py",
line 908, in read
return self._sslobj.read(len, buffer) socket.timeout: The read operation timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File
"c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\basecommand.py",
line 228, in main
status = self.run(options, args) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\commands\install.py",
line 291, in run
resolver.resolve(requirement_set) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\resolve.py",
line 103, in resolve
self._resolve_one(requirement_set, req) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\resolve.py",
line 257, in _resolve_one
abstract_dist = self._get_abstract_dist_for(req_to_install) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\resolve.py",
line 210, in _get_abstract_dist_for
self.require_hashes File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\operations\prepare.py",
line 310, in prepare_linked_requirement
progress_bar=self.progress_bar File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 837, in unpack_url
progress_bar=progress_bar File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 674, in unpack_http_url
progress_bar) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 898, in _download_http_url
_download_url(resp, link, content_file, hashes, progress_bar) File
"c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 618, in _download_url
hashes.check_against_chunks(downloaded_chunks) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\utils\hashes.py",
line 48, in check_against_chunks
for chunk in chunks: File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 586, in written_chunks
for chunk in chunks: File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\utils\ui.py",
line 159, in iter
for x in it: File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_internal\download.py",
line 575, in resp_read
decode_content=False): File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\urllib3\response.py",
line 436, in stream
data = self.read(amt=amt, decode_content=decode_content) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\urllib3\response.py",
line 401, in read
raise IncompleteRead(self._fp_bytes_read, self.length_remaining) File
"c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\contextlib.py",
line 130, in exit
self.gen.throw(type, value, traceback) File "c:\users\gabraham.aecigroup\appdata\local\programs\python\python37\lib\site-packages\pip_vendor\urllib3\response.py",
line 307, in _error_catcher
raise ReadTimeoutError(self._pool, None, 'Read timed out.') pip._vendor.urllib3.exceptions.ReadTimeoutError:
HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Read
timed out.
So I tried to replace python 3.10 with version 3.7.0 but I am still getting the same error. How do I avoid this error?
check here, probably you have bad connection to internet or the download takes too long...

ERROR: Could not install packages due to an OSError: [Errno 22]

Hi im trying to install voevent-parse via pip and run into the following error:
ERROR: Could not install packages due to an OSError. Traceback (most recent call last): File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\resolvers.py", line 171, in _merge_into_criterion
crit = self.state.criteria[name] KeyError: 'voevent-parse'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\commands\install.py", line 316, in run
requirement_set = resolver.resolve(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\resolver.py", line 121, in resolve
self._result = resolver.resolve(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\resolvers.py", line 453, in resolve
state = resolution.resolve(requirements, max_rounds=max_rounds)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\resolvers.py", line 318, in resolve
name, crit = self._merge_into_criterion(r, parent=None)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\resolvers.py", line 173, in _merge_into_criterion
crit = Criterion.from_requirement(self._p, requirement, parent)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\resolvers.py", line 82, in from_requirement
if not cands:
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_vendor\resolvelib\structs.py", line 124, in __bool__
return bool(self._sequence)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\found_candidates.py", line 99, in __bool__
return any(self)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\factory.py", line 237, in iter_index_candidates
candidate = self._make_candidate_from_link(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\factory.py", line 165, in _make_candidate_from_link
self._link_candidate_cache[link] = LinkCandidate(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\candidates.py", line 300, in __init__
super().__init__(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\candidates.py", line 144, in __init__
self.dist = self._prepare()
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\candidates.py", line 226, in _prepare
dist = self._prepare_distribution()
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\resolution\resolvelib\candidates.py", line 311, in _prepare_distribution
return self._factory.preparer.prepare_linked_requirement(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\operations\prepare.py", line 457, in prepare_linked_requirement
return self._prepare_linked_requirement(req, parallel_builds)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\operations\prepare.py", line 480, in _prepare_linked_requirement
local_file = unpack_url(
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\operations\prepare.py", line 240, in unpack_url
unpack_file(file.path, location, file.content_type)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\utils\unpacking.py", line 266, in unpack_file
untar_file(filename, location)
File "c:\users\timo\appdata\local\programs\python\python39\lib\site-packages\pip\_internal\utils\unpacking.py", line 230, in untar_file
with open(path, 'wb') as destfp:
OSError: [Errno 22] Invalid argument: 'C:\\Users\\Timo\\AppData\\Local\\Temp\\pip-install-wpb7xknq\\voevent-parse_090e9cbdcae64f31a771cb0698293f1a\\src/voeventparse/fixtures/MOA_Lensing_Event_2015-07-10T14:50:54.00.xml'
Removed build tracker: 'C:\\Users\\Timo\\AppData\\Local\\Temp\\pip-req-tracker-cmjrk9m4'
Im using the latest Windows 10 version and latest pip version
Please consider running your command line in administrator

Discord Bot crashing: typeerror __new__() got an unexpected keyword argument 'deny_new'

I was making a bot just for fun and tested it on my Test Server and everything worked perfect. But when I try to get it into another server it crashes.
I get this in the cmd:
Traceback (most recent call last):
File "botardo.py", line 19, in <module>
client.run('token')
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\client.py", line 598, in run
return future.result()
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\client.py", line 579, in runner
await self.start(*args, **kwargs)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\client.py", line 543, in start
await self.connect(reconnect=reconnect)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\client.py", line 457, in connect
await self._connect()
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\client.py", line 421, in _connect
await self.ws.poll_event()
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\gateway.py", line 469, in poll_event
await self.received_message(msg)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\gateway.py", line 423, in received_message
func(data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\state.py", line 663, in parse_guild_create
guild = self._get_create_guild(data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\state.py", line 641, in _get_create_guild
return self._add_guild_from_data(data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\state.py", line 255, in _add_guild_from_data
guild = Guild(data=guild, state=self)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\guild.py", line 280, in __init__
self._from_data(data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\guild.py", line 391, in _from_data
self._sync(guild)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\guild.py", line 420, in _sync
self._add_channel(VoiceChannel(guild=self, data=c, state=self._state))
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\channel.py", line 504, in __init__
self._update(guild, data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\channel.py", line 535, in _update
self._fill_overwrites(data)
File "C:\Users\kakob\AppData\Local\Programs\Python\Python38\lib\site-packages\discord\abc.py", line 271, in _fill_overwrites
self._overwrites.append(_Overwrites(id=overridden_id, **overridden))
TypeError: __new__() got an unexpected keyword argument 'deny_new'
I've seen some other posts about this error, but what most intrigues me is that it works on my Test server but not on any other. Any ideas?
Thanks!
Reinstalling discord.py should fix the problem

Pyinstaller no exe created, nothing in dist folder

When i try to run the pyinstall myFile.py, the build and dist folder are created, and the file myFIle.spec, but the dist folder is empty. In the shell I have a traceback at the end :
File "/home/indiana/anaconda3/bin/pyinstaller", line 11, in <module>
sys.exit(run())
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/__main__.py", line 111, in run
run_build(pyi_config, spec_file, **vars(args))
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/__main__.py", line 63, in run_build
PyInstaller.building.build_main.main(pyi_config, spec_file, **kwargs)
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/build_main.py", line 838, in main
build(specfile, kw.get('distpath'), kw.get('workpath'), kw.get('clean_build'))
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/build_main.py", line 784, in build
exec(text, spec_namespace)
File "<string>", line 31, in <module>
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/api.py", line 411, in __init__
strip_binaries=self.strip, upx_binaries=self.upx,
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/api.py", line 196, in __init__
self.__postinit__()
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/datastruct.py", line 158, in __postinit__
self.assemble()
File "/home/indiana/anaconda3/lib/python3.6/site-packages/PyInstaller/building/api.py", line 273, in assemble
pylib_name = os.path.basename(bindepend.get_python_library_path())
File "/home/indiana/anaconda3/lib/python3.6/posixpath.py", line 146, in basename
p = os.fspath(p)
TypeError: expected str, bytes or os.PathLike object, not NoneType
Futhermore, I have a warning during the process :
WARNING: Hidden import "PyQt5.sip" not found!
I'm more concern about the traceback ( since it seems it's not related to my code but more about the environment), so I wonder if somebody had seen this before and if someone has a kind of a solution.
Thanks in advance !

Celery not starting in OS X - dbm.error: db type is dbm.gnu, but the module is not available

I'm trying to run celery worker in OS X (Mavericks). I activated virtual environment (python 3.4) and tried to start Celery with this argument:
celery worker --app=scheduling -linfo
Where scheduling is my celery app.
But I ended up with this error: dbm.error: db type is dbm.gnu, but the module is not available
Complete stacktrace:
Traceback (most recent call last):
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/kombu/utils/__init__.py", line 320, in __get__
return obj.__dict__[self.__name__]
KeyError: 'db'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/other/PhoenixEnv/bin/celery", line 9, in <module>
load_entry_point('celery==3.1.9', 'console_scripts', 'celery')()
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/__main__.py", line 30, in main
main()
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/celery.py", line 80, in main
cmd.execute_from_commandline(argv)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/celery.py", line 768, in execute_from_commandline
super(CeleryCommand, self).execute_from_commandline(argv)))
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/base.py", line 308, in execute_from_commandline
return self.handle_argv(self.prog_name, argv[1:])
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/celery.py", line 760, in handle_argv
return self.execute(command, argv)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/celery.py", line 692, in execute
).run_from_argv(self.prog_name, argv[1:], command=argv[0])
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/worker.py", line 175, in run_from_argv
return self(*args, **options)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/base.py", line 271, in __call__
ret = self.run(*args, **kwargs)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bin/worker.py", line 209, in run
).start()
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/__init__.py", line 100, in __init__
self.setup_instance(**self.prepare_args(**kwargs))
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/__init__.py", line 141, in setup_instance
self.blueprint.apply(self, **kwargs)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bootsteps.py", line 221, in apply
step.include(parent)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bootsteps.py", line 347, in include
return self._should_include(parent)[0]
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/bootsteps.py", line 343, in _should_include
return True, self.create(parent)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/components.py", line 220, in create
w._persistence = w.state.Persistent(w.state, w.state_db, w.app.clock)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/state.py", line 161, in __init__
self.merge()
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/state.py", line 169, in merge
self._merge_with(self.db)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/kombu/utils/__init__.py", line 322, in __get__
value = obj.__dict__[self.__name__] = self.__get(obj)
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/state.py", line 238, in db
return self.open()
File "/Users/other/PhoenixEnv/lib/python3.4/site-packages/celery/worker/state.py", line 165, in open
self.filename, protocol=self.protocol, writeback=True,
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/shelve.py", line 239, in open
return DbfilenameShelf(filename, flag, protocol, writeback)
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/shelve.py", line 223, in __init__
Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback)
File "/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/dbm/__init__.py", line 91, in open
"available".format(result))
dbm.error: db type is dbm.gnu, but the module is not available
Please help.
I switched to python3.5 and got the same error. On Ubuntu I could fix it with
aptitude install python3.5-gdbm
I got the same error. On Macbook I could fix it with
brew install gdb

Resources