I've been using Anaconda as my package manager but was unaware that it is recommended to install additional packages within virtual environments rather than globally. As a result, I've been installing all packages in my base environment by simply opening a terminal window and running commands such as:
pip3 install requests_html
conda install sklearn
This seemed to work fine for a while until I recently decided to try updating my packages. I tried running
conda update --all
which then provided a list of all the packages that will be updated. However, it also said that some packages will be downgraded instead, which after some googling seems to be due to version conflicts which is why environments are recommended.
Sample output:
Collecting package metadata (current_repodata.json): done
Solving environment: done
## Package Plan ##
environment location: /Users/mahuja/opt/anaconda3
The following packages will be downloaded:
package | build
---------------------------|-----------------
_anaconda_depends-2020.07 | py38_0 6 KB
anaconda-custom | py38_1 35 KB
anaconda-navigator-1.10.0 | py38_0 6.2 MB
anaconda-project-0.9.1 | pyhd3eb1b0_1 215 KB
appdirs-1.4.4 | py_0 13 KB
appnope-0.1.2 |py38hecd8cb5_1001 10 KB
argon2-cffi-20.1.0 | py38haf1e3a3_1 44 KB
asn1crypto-1.4.0 | py_0 80 KB
backports-1.0 | pyhd3eb1b0_2 210 KB
backports.functools_lru_cache-1.6.1| pyhd3eb1b0_0 12 KB
backports.shutil_get_terminal_size-1.0.0| pyhd3eb1b0_3 10 KB
backports.tempfile-1.0 | pyhd3eb1b0_1 11 KB
beautifulsoup4-4.9.3 | pyha847dfd_0 86 KB
bitarray-1.6.3 | py38h9ed2024_1 92 KB
black-19.10b0 | py_0 86 KB
bleach-3.2.2 | pyhd3eb1b0_0 113 KB
blosc-1.20.1 | hab81aa3_0 56 KB
bokeh-2.2.3 | py38_0 5.3 MB
brotli-1.0.9 | hb1e8313_2 398 KB
brotlipy-0.7.0 |py38h9ed2024_1003 331 KB
gevent-21.1.1 | py38h9ed2024_1 1.5 MB
giflib-5.1.4 | h1de35cc_1 59 KB
glib-2.66.1 | h9bbe63b_0 2.7 MB
glob2-0.7 | pyhd3eb1b0_0 12 KB
greenlet-0.4.17 | py38haf1e3a3_0 20 KB
idna-2.10 | pyhd3eb1b0_0 52 KB
imagecodecs-2021.1.11 | py38h2ea9c00_1 5.4 MB
importlib-metadata-2.0.0 | py_1 35 KB
importlib_metadata-2.0.0 | 1 11 KB
iniconfig-1.1.1 | pyhd3eb1b0_0 8 KB
intervaltree-3.1.0 | py_0 26 KB
ipykernel-5.3.4 | py38h5ca1d4c_0 180 KB
ipython-7.19.0 | py38h01d92e1_1 991 KB
ipython_genutils-0.2.0 | pyhd3eb1b0_1 27 KB
ipywidgets-7.6.3 | pyhd3eb1b0_1 105 KB
isort-5.6.4 | py_0 78 KB
jedi-0.17.2 | py38hecd8cb5_1 923 KB
jinja2-2.11.2 | pyhd3eb1b0_0 93 KB
joblib-1.0.0 | pyhd3eb1b0_0 208 KB
jsonschema-3.2.0 | py_2 47 KB
jupyter_client-6.1.7 | py_0 77 KB
jupyter_console-6.2.0 | py_0 26 KB
jupyter_core-4.7.0 | py38hecd8cb5_0 68 KB
jupyterlab-2.2.6 | py_0 3.4 MB
jupyterlab_pygments-0.1.2 | py_0 8 KB
jupyterlab_widgets-1.0.0 | pyhd3eb1b0_1 109 KB
jxrlib-1.1 | haf1e3a3_2 206 KB
matplotlib-base-3.3.2 | py38h181983e_0 5.1 MB
mkl_fft-1.2.0 | py38hc64f4ea_0 143 KB
mock-4.0.3 | pyhd3eb1b0_0 29 KB
more-itertools-8.6.0 | pyhd3eb1b0_0 40 KB
msgpack-python-1.0.1 | py38hf7b0b51_0 75 KB
mypy_extensions-0.4.3 | py38_0 9 KB
nbclient-0.5.1 | py_0 58 KB
nbconvert-6.0.7 | py38_0 483 KB
nbformat-5.1.2 | pyhd3eb1b0_1 68 KB
nest-asyncio-1.4.3 | pyhd3eb1b0_0 11 KB
networkx-2.5 | py_0 1.1 MB
nose-1.3.7 | pyhd3eb1b0_1006 128 KB
notebook-6.2.0 | py38hecd8cb5_0 4.1 MB
numba-0.51.2 | py38h6440ff4_1 3.1 MB
numexpr-2.7.2 | py38h16bde0e_0 120 KB
numpy-1.19.2 | py38h456fd55_0 21 KB
numpy-base-1.19.2 | py38hcfb5961_0 4.0 MB
numpydoc-1.1.0 | pyhd3eb1b0_1 42 KB
openjpeg-2.3.0 | hb95cd4c_1 281 KB
openpyxl-3.0.6 | pyhd3eb1b0_0 159 KB
openssl-1.1.1i | h9ed2024_0 2.2 MB
packaging-20.8 | pyhd3eb1b0_0 36 KB
pandas-1.2.1 | py38hb2f4e1b_0 8.3 MB
pandoc-2.11 | h0dc7051_0 10.8 MB
pandocfilters-1.4.3 | py38hecd8cb5_1 14 KB
path-15.0.1 | py38hecd8cb5_0 37 KB
path.py-12.5.0 | 0 4 KB
pathlib2-2.3.5 | py38hecd8cb5_2 38 KB
pathspec-0.7.0 | py_0 26 KB
pexpect-4.8.0 | pyhd3eb1b0_3 53 KB
pickleshare-0.7.5 | pyhd3eb1b0_1003 13 KB
pillow-8.1.0 | py38h5270095_0 590 KB
pip-20.3.3 | py38hecd8cb5_0 1.8 MB
pkginfo-1.7.0 | py38hecd8cb5_0 43 KB
prometheus_client-0.9.0 | pyhd3eb1b0_0 45 KB
prompt-toolkit-3.0.8 | py_0 248 KB
prompt_toolkit-3.0.8 | 0 12 KB
psutil-5.7.2 | py38haf1e3a3_0 341 KB
ptyprocess-0.7.0 | pyhd3eb1b0_2 17 KB
py-1.10.0 | pyhd3eb1b0_0 76 KB
pycurl-7.43.0.6 | py38hddc9c9b_0 66 KB
pydocstyle-5.1.1 | py_0 38 KB
pyerfa-1.7.1.1 | py38h9ed2024_1 296 KB
pygments-2.7.4 | pyhd3eb1b0_0 676 KB
pylint-2.6.0 | py38_0 438 KB
pyls-black-0.4.6 | hd3eb1b0_0 9 KB
pyls-spyder-0.3.0 | pyhd3eb1b0_0 10 KB
pyopenssl-20.0.1 | pyhd3eb1b0_1 49 KB
pyparsing-2.4.7 | pyhd3eb1b0_0 59 KB
pyrsistent-0.17.3 | py38haf1e3a3_0 89 KB
pytest-6.2.1 | py38hecd8cb5_0 427 KB
python-3.8.5 | h26836e1_1 20.6 MB
python-jsonrpc-server-0.4.0| py_0 12 KB
python-language-server-0.36.2| pyhd3eb1b0_0 41 KB
python-libarchive-c-2.9 | pyhd3eb1b0_0 46 KB
python.app-3 | py38h9ed2024_0 20 KB
pytz-2020.5 | pyhd3eb1b0_0 182 KB
pywavelets-1.1.1 | py38haf1e3a3_2 3.4 MB
pyyaml-5.4.1 | py38h9ed2024_1 165 KB
pyzmq-20.0.0 | py38h23ab428_1 405 KB
qtawesome-1.0.1 | py_0 757 KB
qtconsole-4.7.7 | py_0 96 KB
regex-2020.11.13 | py38h9ed2024_0 310 KB
requests-2.25.1 | pyhd3eb1b0_0 52 KB
ripgrep-12.1.1 | 0 1.3 MB
rope-0.18.0 | py_0 126 KB
scikit-image-0.17.2 | py38h81aa140_0 8.9 MB
scikit-learn-0.23.2 | py38h959d312_0 4.7 MB
scipy-1.5.2 | py38h2515648_0 13.3 MB
seaborn-0.11.1 | pyhd3eb1b0_0 212 KB
send2trash-1.5.0 | pyhd3eb1b0_1 14 KB
setuptools-51.3.3 | py38hecd8cb5_4 727 KB
singledispatch-3.4.0.3 | py_1001 12 KB
six-1.15.0 | py38hecd8cb5_0 27 KB
snowballstemmer-2.1.0 | pyhd3eb1b0_0 62 KB
sortedcollections-2.1.0 | pyhd3eb1b0_0 12 KB
sortedcontainers-2.3.0 | pyhd3eb1b0_0 26 KB
soupsieve-2.1 | pyhd3eb1b0_0 31 KB
sphinx-3.4.3 | pyhd3eb1b0_0 1.1 MB
sphinxcontrib-websupport-1.2.4| py_0 34 KB
spyder-4.2.0 | py38hecd8cb5_0 5.7 MB
spyder-kernels-1.10.1 | py38hecd8cb5_0 101 KB
sqlalchemy-1.3.21 | py38h9ed2024_0 1.5 MB
sqlite-3.33.0 | hffcf06c_0 1.3 MB
statsmodels-0.12.1 | py38h9ed2024_0 8.2 MB
sympy-1.7.1 | py38hecd8cb5_0 8.8 MB
tbb-2020.3 | h879752b_0 147 KB
tblib-1.7.0 | py_0 16 KB
terminado-0.9.2 | py38hecd8cb5_0 25 KB
three-merge-0.1.1 | pyhd3eb1b0_0 10 KB
tifffile-2021.1.14 | pyhd3eb1b0_1 126 KB
toolz-0.11.1 | pyhd3eb1b0_0 46 KB
tornado-6.1 | py38h9ed2024_0 585 KB
tqdm-4.55.1 | pyhd3eb1b0_0 77 KB
traitlets-5.0.5 | py_0 83 KB
typed-ast-1.4.2 | py38h9ed2024_1 183 KB
typing_extensions-3.7.4.3 | py_0 28 KB
ujson-4.0.2 | py38h23ab428_0 46 KB
unixodbc-2.3.9 | haf1e3a3_0 251 KB
urllib3-1.26.2 | pyhd3eb1b0_0 105 KB
watchdog-0.10.4 | py38h9ed2024_0 96 KB
wheel-0.36.2 | pyhd3eb1b0_0 33 KB
wrapt-1.11.2 | py38h9ed2024_0 45 KB
xlrd-2.0.1 | pyhd3eb1b0_0 90 KB
xlsxwriter-1.3.7 | py_0 108 KB
xlwings-0.21.4 | py38hecd8cb5_0 446 KB
zeromq-4.3.3 | hb1e8313_3 414 KB
zfp-0.5.5 | h23ab428_4 147 KB
zipp-3.4.0 | pyhd3eb1b0_0 15 KB
zope.event-4.5.0 | py38_0 209 KB
zope.interface-5.2.0 | py38h9ed2024_0 281 KB
------------------------------------------------------------
Total: 201.5 MB
The following NEW packages will be INSTALLED:
_anaconda_depends pkgs/main/osx-64::_anaconda_depends-2020.07-py38_0
appdirs pkgs/main/noarch::appdirs-1.4.4-py_0
argon2-cffi pkgs/main/osx-64::argon2-cffi-20.1.0-py38haf1e3a3_1
async_generator pkgs/main/noarch::async_generator-1.10-py_0
black pkgs/main/noarch::black-19.10b0-py_0
brotli pkgs/main/osx-64::brotli-1.0.9-hb1e8313_2
brunsli pkgs/main/osx-64::brunsli-0.1-h23ab428_0
charls pkgs/main/osx-64::charls-2.1.0-hb1e8313_2
giflib pkgs/main/osx-64::giflib-5.1.4-h1de35cc_1
imagecodecs pkgs/main/osx-64::imagecodecs-2021.1.11-py38h2ea9c00_1
iniconfig pkgs/main/noarch::iniconfig-1.1.1-pyhd3eb1b0_0
jupyterlab_pygmen~ pkgs/main/noarch::jupyterlab_pygments-0.1.2-py_0
jupyterlab_widgets pkgs/main/noarch::jupyterlab_widgets-1.0.0-pyhd3eb1b0_1
jxrlib pkgs/main/osx-64::jxrlib-1.1-haf1e3a3_2
lerc pkgs/main/osx-64::lerc-2.2.1-h23ab428_0
libaec pkgs/main/osx-64::libaec-1.0.4-hb1e8313_1
libdeflate pkgs/main/osx-64::libdeflate-1.7-h9ed2024_5
libllvm10 pkgs/main/osx-64::libllvm10-10.0.1-h76017ad_5
libwebp pkgs/main/osx-64::libwebp-1.0.1-hd73b212_0
libzopfli pkgs/main/osx-64::libzopfli-1.0.3-hb1e8313_0
mypy_extensions pkgs/main/osx-64::mypy_extensions-0.4.3-py38_0
nbclient pkgs/main/noarch::nbclient-0.5.1-py_0
nest-asyncio pkgs/main/noarch::nest-asyncio-1.4.3-pyhd3eb1b0_0
openjpeg pkgs/main/osx-64::openjpeg-2.3.0-hb95cd4c_1
pathspec pkgs/main/noarch::pathspec-0.7.0-py_0
pyerfa pkgs/main/osx-64::pyerfa-1.7.1.1-py38h9ed2024_1
pyls-black pkgs/main/noarch::pyls-black-0.4.6-hd3eb1b0_0
pyls-spyder pkgs/main/noarch::pyls-spyder-0.3.0-pyhd3eb1b0_0
three-merge pkgs/main/noarch::three-merge-0.1.1-pyhd3eb1b0_0
tifffile pkgs/main/noarch::tifffile-2021.1.14-pyhd3eb1b0_1
typed-ast pkgs/main/osx-64::typed-ast-1.4.2-py38h9ed2024_1
zfp pkgs/main/osx-64::zfp-0.5.5-h23ab428_4
The following packages will be UPDATED:
anaconda-navigator 1.9.12-py38_0 --> 1.10.0-py38_0
anaconda-project 0.8.4-py_0 --> 0.9.1-pyhd3eb1b0_1
appnope 0.1.0-py38_1001 --> 0.1.2-py38hecd8cb5_1001
asn1crypto pkgs/main/osx-64::asn1crypto-1.3.0-py~ --> pkgs/main/noarch::asn1crypto-1.4.0-py_0
astropy 4.0.1.post1-py38h01d97ff_1 --> 4.2-py38h9ed2024_0
attrs 19.3.0-py_0 --> 20.3.0-pyhd3eb1b0_0
autopep8 1.5.3-py_0 --> 1.5.4-py_0
babel 2.8.0-py_0 --> 2.9.0-pyhd3eb1b0_0
backports.shutil_~ pkgs/main/osx-64::backports.shutil_ge~ --> pkgs/main/noarch::backports.shutil_get_terminal_size-1.0.0-pyhd3eb1b0_3
beautifulsoup4 pkgs/main/osx-64::beautifulsoup4-4.9.~ --> pkgs/main/noarch::beautifulsoup4-4.9.3-pyha847dfd_0
bitarray 1.4.0-py38haf1e3a3_0 --> 1.6.3-py38h9ed2024_1
bleach 3.1.5-py_0 --> 3.2.2-pyhd3eb1b0_0
blosc 1.19.0-hab81aa3_0 --> 1.20.1-hab81aa3_0
bokeh 2.1.1-py38_0 --> 2.2.3-py38_0
brotlipy 0.7.0-py38haf1e3a3_1000 --> 0.7.0-py38h9ed2024_1003
ca-certificates 2020.6.24-0 --> 2021.1.19-hecd8cb5_0
certifi 2020.6.20-py38_0 --> 2020.12.5-py38hecd8cb5_0
cffi 1.14.0-py38hc512035_1 --> 1.14.4-py38h2125817_0
chardet 3.0.4-py38_1003 --> 4.0.0-py38hecd8cb5_1003
cloudpickle 1.5.0-py_0 --> 1.6.0-py_0
colorama 0.4.3-py_0 --> 0.4.4-pyhd3eb1b0_0
conda-build 3.20.0-py38_0 --> 3.21.4-py38hecd8cb5_0
conda-package-han~ 1.6.1-py38h1de35cc_0 --> 1.7.2-py38h22f3db7_0
cryptography 2.9.2-py38ha12b0ac_0 --> 3.3.1-py38hbcfaee0_0
cytoolz 0.10.1-py38h1de35cc_0 --> 0.11.0-py38haf1e3a3_0
dask 2.20.0-py_0 --> 2020.12.0-pyhd3eb1b0_0
dask-core 2.20.0-py_0 --> 2020.12.0-pyhd3eb1b0_0
dbus 1.13.16-h18a8e69_0 --> 1.13.18-h18a8e69_0
distributed 2.20.0-py38_0 --> 2021.1.0-py38hecd8cb5_0
expat 2.2.9-hb1e8313_2 --> 2.2.10-hb1e8313_2
filelock 3.0.12-py_0 --> 3.0.12-pyhd3eb1b0_1
flake8 3.8.3-py_0 --> 3.8.4-py_0
freetype 2.10.2-ha233b18_0 --> 2.10.4-ha233b18_0
fsspec 0.7.4-py_0 --> 0.8.3-py_0
gevent 20.6.2-py38haf1e3a3_0 --> 21.1.1-py38h9ed2024_1
glib 2.65.0-hc5f4afa_0 --> 2.66.1-h9bbe63b_0
greenlet 0.4.16-py38haf1e3a3_0 --> 0.4.17-py38haf1e3a3_0
importlib-metadata pkgs/main/osx-64::importlib-metadata-~ --> pkgs/main/noarch::importlib-metadata-2.0.0-py_1
importlib_metadata 1.7.0-0 --> 2.0.0-1
intervaltree 3.0.2-py_1 --> 3.1.0-py_0
ipykernel 5.3.2-py38h5ca1d4c_0 --> 5.3.4-py38h5ca1d4c_0
ipython 7.16.1-py38h5ca1d4c_0 --> 7.19.0-py38h01d92e1_1
ipython_genutils pkgs/main/osx-64::ipython_genutils-0.~ --> pkgs/main/noarch::ipython_genutils-0.2.0-pyhd3eb1b0_1
ipywidgets 7.5.1-py_0 --> 7.6.3-pyhd3eb1b0_1
isort pkgs/main/osx-64::isort-4.3.21-py38_0 --> pkgs/main/noarch::isort-5.6.4-py_0
jedi 0.17.1-py38_0 --> 0.17.2-py38hecd8cb5_1
joblib 0.16.0-py_0 --> 1.0.0-pyhd3eb1b0_0
jsonschema pkgs/main/osx-64::jsonschema-3.2.0-py~ --> pkgs/main/noarch::jsonschema-3.2.0-py_2
jupyter_client 6.1.6-py_0 --> 6.1.7-py_0
jupyter_console 6.1.0-py_0 --> 6.2.0-py_0
jupyter_core 4.6.3-py38_0 --> 4.7.0-py38hecd8cb5_0
jupyterlab 2.1.5-py_0 --> 2.2.6-py_0
keyring 21.2.1-py38_0 --> 21.8.0-py38hecd8cb5_0
kiwisolver 1.2.0-py38h04f5b5a_0 --> 1.3.0-py38h23ab428_0
lazy-object-proxy 1.4.3-py38h1de35cc_0 --> 1.4.3-py38h9ed2024_2
libxml2 2.9.10-h3b9e6c8_1 --> 2.9.10-h7cdb67c_3
llvmlite 0.33.0-py38ha11be7d_1 --> 0.34.0-py38h739e7dc_4
locket 0.2.0-py38_1 --> 0.2.1-py38hecd8cb5_1
lxml 4.5.2-py38h63b7cb6_0 --> 4.6.2-py38h26b266a_0
lz4-c 1.9.2-h0a44026_0 --> 1.9.3-h23ab428_0
matplotlib 3.2.2-0 --> 3.3.2-hecd8cb5_0
matplotlib-base 3.2.2-py38h5670ca0_0 --> 3.3.2-py38h181983e_0
mkl_fft 1.1.0-py38hc64f4ea_0 --> 1.2.0-py38hc64f4ea_0
mock 4.0.2-py_0 --> 4.0.3-pyhd3eb1b0_0
more-itertools 8.4.0-py_0 --> 8.6.0-pyhd3eb1b0_0
msgpack-python 1.0.0-py38h04f5b5a_1 --> 1.0.1-py38hf7b0b51_0
nbconvert 5.6.1-py38_1 --> 6.0.7-py38_0
nbformat 5.0.7-py_0 --> 5.1.2-pyhd3eb1b0_1
networkx 2.4-py_1 --> 2.5-py_0
nose pkgs/main/osx-64::nose-1.3.7-py38_1004 --> pkgs/main/noarch::nose-1.3.7-pyhd3eb1b0_1006
notebook 6.0.3-py38_0 --> 6.2.0-py38hecd8cb5_0
numba 0.50.1-py38h959d312_1 --> 0.51.2-py38h6440ff4_1
numexpr 2.7.1-py38hce01a72_0 --> 2.7.2-py38h16bde0e_0
numpy 1.18.5-py38h1da2735_0 --> 1.19.2-py38h456fd55_0
numpy-base 1.18.5-py38h3304bdc_0 --> 1.19.2-py38hcfb5961_0
numpydoc 1.1.0-py_0 --> 1.1.0-pyhd3eb1b0_1
openpyxl 3.0.4-py_0 --> 3.0.6-pyhd3eb1b0_0
openssl 1.1.1g-h1de35cc_0 --> 1.1.1i-h9ed2024_0
packaging 20.4-py_0 --> 20.8-pyhd3eb1b0_0
pandas 1.0.5-py38h959d312_0 --> 1.2.1-py38hb2f4e1b_0
pandoc 2.10-0 --> 2.11-h0dc7051_0
pandocfilters 1.4.2-py38_1 --> 1.4.3-py38hecd8cb5_1
path 13.1.0-py38_0 --> 15.0.1-py38hecd8cb5_0
path.py 12.4.0-0 --> 12.5.0-0
pathlib2 2.3.5-py38_1 --> 2.3.5-py38hecd8cb5_2
pexpect pkgs/main/osx-64::pexpect-4.8.0-py38_1 --> pkgs/main/noarch::pexpect-4.8.0-pyhd3eb1b0_3
pickleshare pkgs/main/osx-64::pickleshare-0.7.5-p~ --> pkgs/main/noarch::pickleshare-0.7.5-pyhd3eb1b0_1003
pillow 7.2.0-py38ha54b6ba_0 --> 8.1.0-py38h5270095_0
pip 20.1.1-py38_1 --> 20.3.3-py38hecd8cb5_0
pkginfo 1.5.0.1-py38_0 --> 1.7.0-py38hecd8cb5_0
prometheus_client 0.8.0-py_0 --> 0.9.0-pyhd3eb1b0_0
prompt-toolkit 3.0.5-py_0 --> 3.0.8-py_0
prompt_toolkit 3.0.5-0 --> 3.0.8-0
psutil 5.7.0-py38h1de35cc_0 --> 5.7.2-py38haf1e3a3_0
ptyprocess pkgs/main/osx-64::ptyprocess-0.6.0-py~ --> pkgs/main/noarch::ptyprocess-0.7.0-pyhd3eb1b0_2
py 1.9.0-py_0 --> 1.10.0-pyhd3eb1b0_0
pycurl 7.43.0.5-py38ha12b0ac_0 --> 7.43.0.6-py38hddc9c9b_0
pydocstyle 5.0.2-py_0 --> 5.1.1-py_0
pygments 2.6.1-py_0 --> 2.7.4-pyhd3eb1b0_0
pylint 2.5.3-py38_0 --> 2.6.0-py38_0
pyopenssl 19.1.0-py_1 --> 20.0.1-pyhd3eb1b0_1
pyrsistent 0.16.0-py38h1de35cc_0 --> 0.17.3-py38haf1e3a3_0
pytest 5.4.3-py38_0 --> 6.2.1-py38hecd8cb5_0
python 3.8.3-h26836e1_2 --> 3.8.5-h26836e1_1
python-jsonrpc-se~ 0.3.4-py_1 --> 0.4.0-py_0
python-language-s~ pkgs/main/osx-64::python-language-ser~ --> pkgs/main/noarch::python-language-server-0.36.2-pyhd3eb1b0_0
python.app 2-py38_10 --> 3-py38h9ed2024_0
pytz 2020.1-py_0 --> 2020.5-pyhd3eb1b0_0
pywavelets 1.1.1-py38h1de35cc_0 --> 1.1.1-py38haf1e3a3_2
pyyaml 5.3.1-py38haf1e3a3_1 --> 5.4.1-py38h9ed2024_1
pyzmq 19.0.1-py38hb1e8313_1 --> 20.0.0-py38h23ab428_1
qtawesome 0.7.2-py_0 --> 1.0.1-py_0
qtconsole 4.7.5-py_0 --> 0.11.1-pyhd3eb1b0_0
send2trash pkgs/main/osx-64::send2trash-1.5.0-py~ --> pkgs/main/noarch::send2trash-1.5.0-pyhd3eb1b0_1
setuptools 49.2.0-py38_0 --> 51.3.3-py38hecd8cb5_4
singledispatch pkgs/main/osx-64::singledispatch-3.4.~ --> pkgs/main/noarch::singledispatch-3.4.0.3-py_1001
snowballstemmer 2.0.0-py_0 --> 2.1.0-pyhd3eb1b0_0
sortedcollections 1.2.1-py_0 --> 2.1.0-pyhd3eb1b0_0
sortedcontainers 2.2.2-py_0 --> 2.3.0-pyhd3eb1b0_0
soupsieve 2.0.1-py_0 --> 2.1-pyhd3eb1b0_0
sphinx 3.1.2-py_0 --> 3.4.3-pyhd3eb1b0_0
sphinxcontrib-web~ 1.2.3-py_0 --> 1.2.4-py_0
spyder 4.1.4-py38_0 --> 4.2.0-py38hecd8cb5_0
spyder-kernels 1.9.2-py38_0 --> 1.10.1-py38hecd8cb5_0
sqlalchemy 1.3.18-py38haf1e3a3_0 --> 1.3.21-py38h9ed2024_0
sqlite 3.32.3-hffcf06c_0 --> 3.33.0-hffcf06c_0
statsmodels 0.11.1-py38haf1e3a3_0 --> 0.12.1-py38h9ed2024_0
sympy 1.6.1-py38_0 --> 1.7.1-py38hecd8cb5_0
tbb 2020.0-h04f5b5a_0 --> 2020.3-h879752b_0
tblib 1.6.0-py_0 --> 1.7.0-py_0
terminado 0.8.3-py38_0 --> 0.9.2-py38hecd8cb5_0
toolz 0.10.0-py_0 --> 0.11.1-pyhd3eb1b0_0
tornado 6.0.4-py38h1de35cc_1 --> 6.1-py38h9ed2024_0
tqdm 4.47.0-py_0 --> 4.55.1-pyhd3eb1b0_0
traitlets pkgs/main/osx-64::traitlets-4.3.3-py3~ --> pkgs/main/noarch::traitlets-5.0.5-py_0
typing_extensions 3.7.4.2-py_0 --> 3.7.4.3-py_0
ujson 1.35-py38h1de35cc_0 --> 4.0.2-py38h23ab428_0
unixodbc 2.3.7-h1de35cc_0 --> 2.3.9-haf1e3a3_0
urllib3 1.25.9-py_0 --> 1.26.2-pyhd3eb1b0_0
watchdog 0.10.3-py38haf1e3a3_0 --> 0.10.4-py38h9ed2024_0
wheel pkgs/main/osx-64::wheel-0.34.2-py38_0 --> pkgs/main/noarch::wheel-0.36.2-pyhd3eb1b0_0
xlrd 1.2.0-py_0 --> 2.0.1-pyhd3eb1b0_0
xlsxwriter 1.2.9-py_0 --> 1.3.7-py_0
xlwings 0.19.5-py38_0 --> 0.21.4-py38hecd8cb5_0
zeromq 4.3.2-hb1e8313_2 --> 4.3.3-hb1e8313_3
zipp 3.1.0-py_0 --> 3.4.0-pyhd3eb1b0_0
zope.event 4.4-py38_0 --> 4.5.0-py38_0
zope.interface 4.7.1-py38h1de35cc_0 --> 5.2.0-py38h9ed2024_0
The following packages will be SUPERSEDED by a higher-priority channel:
six pkgs/main/noarch::six-1.15.0-py_0 --> pkgs/main/osx-64::six-1.15.0-py38hecd8cb5_0
The following packages will be DOWNGRADED:
anaconda 2020.07-py38_0 --> custom-py38_1
backports 1.0-py_2 --> 1.0-pyhd3eb1b0_2
backports.functoo~ 1.6.1-py_0 --> 1.6.1-pyhd3eb1b0_0
backports.tempfile 1.0-py_1 --> 1.0-pyhd3eb1b0_1
click 7.1.2-py_0 --> 7.1.2-pyhd3eb1b0_0
cython 0.29.21-py38hb1e8313_0 --> 0.29.21-py38h23ab428_0
glob2 0.7-py_0 --> 0.7-pyhd3eb1b0_0
idna 2.10-py_0 --> 2.10-pyhd3eb1b0_0
jinja2 2.11.2-py_0 --> 2.11.2-pyhd3eb1b0_0
lzo 2.10-h1de35cc_2 --> 2.10-haf1e3a3_2
mkl-service 2.3.0-py38hfbe908c_0 --> 2.3.0-py38h9ed2024_0
pyparsing 2.4.7-py_0 --> 2.4.7-pyhd3eb1b0_0
python-libarchive~ 2.9-py_0 --> 2.9-pyhd3eb1b0_0
wrapt 1.11.2-py38h1de35cc_0 --> 1.11.2-py38h9ed2024_0
Proceed ([y]/n)?
I was wondering is there any way to easily clean up all the packages I've installed globally so that I can start fresh with virtual environments? Otherwise is there any way I can update everything without the version conflicts?
Related
Recently I exploring jitsi meet with the latest version, and I try to build the application.
But, after compiling makefile using make on Windows 10, I got an error '.' is not recognized as an internal or external command,operable program or batch file.
Here is error message while compiling:
> jitsi-meet-load-test#0.0.0 build
> webpack -p
[BABEL] Note: The code generator has deoptimised the styling of G:\Project\Digi46Meet\jitsi-meet-master\node_modules\lodash\lodash.js as it exceeds the max of 500KB.
Hash: e8ebfddcdcd744634d50
Version: webpack 4.43.0
Child
Hash: e8ebfddcdcd744634d50
Time: 29243ms
Built at: 02/22/2022 15:25:25
Asset Size Chunks Chunk Names
load-test-participant.min.js 221 KiB 0 [emitted] load-test-participant
load-test-participant.min.map 1.1 MiB 0 [emitted] [dev] load-test-participant
Entrypoint load-test-participant = load-test-participant.min.js load-test-participant.min.map
[4] G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/logging/LogTransport.web.js 0 bytes {0} [built]
[5] (webpack)/buildin/global.js 475 bytes {0} [built]
[12] (webpack)/buildin/amd-options.js 80 bytes {0} [built]
[13] (webpack)/buildin/module.js 546 bytes {0} [built]
[15] G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/lib-jitsi-meet/_.web.js 27 bytes {0} [built]
[16] ./load-test-participant.js + 28 modules 83.2 KiB {0} [built]
| ./load-test-participant.js 11.3 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/util/parseURLParams.js 1.68 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/util/uri.js 16.7 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/functions.web.js 2.21 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/lastn/functions.js 2.78 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/constants.js 1.21 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/util/helpers.js 5.59 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/util/strings.web.js 631 bytes [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/functions.any.js 8.73 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/video-quality/constants.js 755 bytes [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/util/index.js 178 bytes [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/configWhitelist.js 5.69 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/interfaceConfigWhitelist.js 1.42 KiB [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/logger.js 99 bytes [built]
| G:/Project/Digi46Meet/jitsi-meet-master/react/features/base/config/getRoomName.js 389 bytes [built]
| + 14 hidden modules
+ 11 hidden modules
./node_modules/.bin/webpack
'.' is not recognized as an internal or external command,
operable program or batch file.
make: *** [Makefile:23: compile] Error 1
Looks like your makefile is invoking cmd.exe as the shell, and it's not able to parse the POSIX-style paths like ./... that use forward slashes instead of backslashes as directory separators.
You'll either have to write your make recipes to use cmd.exe syntax, or else install a POSIX shell on your system somewhere that make can find it (or set the make SHELL variable to the path).
I want to activate conda environment and install some packages in github actions. I tried source activate myenv and activate myenv but this step doesn't activate anything
upload_package(){
conda config --set anaconda_upload yes
apt-get update
apt-get install -y build-essential
conda init bash
conda create -n myenv python=3.6
conda activate myenv
echo $PWD
echo "$VIRTUAL_ENV"
conda install --yes pip
conda install --yes numpy cython
conda install --yes -c conda-forge nose mdtraj
anaconda login --username $INPUT_ANACONDAUSERNAME --password $INPUT_ANACONDAPASSWORD
echo $PWD
echo "$VIRTUAL_ENV"
conda build /github/workspace
anaconda logout
}
i tried to check with echo "$VIRTUAL_ENV" but it either gives empty screen (source activate myenv and activate myenv) or just gives an error below. I don't know how can i handle as I don't know how can I restart and close shell as it is on github actions. I would appreciate your help
2020-03-04T10:50:25.2340743Z + conda init bash
2020-03-04T10:50:25.3835655Z no change /opt/conda/condabin/conda
2020-03-04T10:50:25.3836003Z no change /opt/conda/bin/conda
2020-03-04T10:50:25.3836764Z no change /opt/conda/bin/conda-env
2020-03-04T10:50:25.3836919Z no change /opt/conda/bin/activate
2020-03-04T10:50:25.3837068Z no change /opt/conda/bin/deactivate
2020-03-04T10:50:25.3837223Z no change /opt/conda/etc/profile.d/conda.sh
2020-03-04T10:50:25.3837381Z no change /opt/conda/etc/fish/conf.d/conda.fish
2020-03-04T10:50:25.3837539Z no change /opt/conda/shell/condabin/Conda.psm1
2020-03-04T10:50:25.3837904Z no change /opt/conda/shell/condabin/conda-hook.ps1
2020-03-04T10:50:25.3838273Z no change /opt/conda/lib/python3.7/site-packages/xontrib/conda.xsh
2020-03-04T10:50:25.3838453Z no change /opt/conda/etc/profile.d/conda.csh
2020-03-04T10:50:25.3838607Z modified /github/home/.bashrc
2020-03-04T10:50:25.3838685Z
2020-03-04T10:50:25.3839039Z ==> For changes to take effect, close and re-open your current shell. <==
2020-03-04T10:50:25.3839151Z
2020-03-04T10:50:25.4034555Z + conda create -n myenv python=3.6
2020-03-04T10:50:25.9277471Z Collecting package metadata (current_repodata.json): ...working... done
2020-03-04T10:50:25.9642682Z Solving environment: ...working... done
2020-03-04T10:50:26.0490197Z
2020-03-04T10:50:26.0490460Z ## Package Plan ##
2020-03-04T10:50:26.0490535Z
2020-03-04T10:50:26.0490685Z environment location: /opt/conda/envs/myenv
2020-03-04T10:50:26.0490781Z
2020-03-04T10:50:26.0490926Z added / updated specs:
2020-03-04T10:50:26.0491662Z - python=3.6
2020-03-04T10:50:26.0491756Z
2020-03-04T10:50:26.0491824Z
2020-03-04T10:50:26.0491969Z The following packages will be downloaded:
2020-03-04T10:50:26.0492062Z
2020-03-04T10:50:26.0492460Z package | build
2020-03-04T10:50:26.0492845Z ---------------------------|-----------------
2020-03-04T10:50:26.0493211Z _libgcc_mutex-0.1 | main 3 KB
2020-03-04T10:50:26.0493583Z certifi-2019.11.28 | py36_0 153 KB
2020-03-04T10:50:26.0493961Z ld_impl_linux-64-2.33.1 | h53a641e_7 568 KB
2020-03-04T10:50:26.0494323Z libedit-3.1.20181209 | hc058e9b_0 163 KB
2020-03-04T10:50:26.0494679Z libffi-3.2.1 | hd88cf55_4 40 KB
2020-03-04T10:50:26.0495035Z libgcc-ng-9.1.0 | hdf63c60_0 5.1 MB
2020-03-04T10:50:26.0495392Z libstdcxx-ng-9.1.0 | hdf63c60_0 3.1 MB
2020-03-04T10:50:26.0495732Z ncurses-6.2 | he6710b0_0 1.1 MB
2020-03-04T10:50:26.0496087Z pip-20.0.2 | py36_1 1.7 MB
2020-03-04T10:50:26.0496448Z python-3.6.10 | h0371630_0 29.7 MB
2020-03-04T10:50:26.0496812Z readline-7.0 | h7b6447c_5 324 KB
2020-03-04T10:50:26.0497169Z setuptools-45.2.0 | py36_0 520 KB
2020-03-04T10:50:26.0497519Z sqlite-3.31.1 | h7b6447c_0 1.1 MB
2020-03-04T10:50:26.0497879Z tk-8.6.8 | hbc83047_0 2.8 MB
2020-03-04T10:50:26.0498229Z wheel-0.34.2 | py36_0 51 KB
2020-03-04T10:50:26.0498579Z xz-5.2.4 | h14c3975_4 283 KB
2020-03-04T10:50:26.0498931Z zlib-1.2.11 | h7b6447c_3 103 KB
2020-03-04T10:50:26.0499273Z ------------------------------------------------------------
2020-03-04T10:50:26.0499450Z Total: 46.7 MB
2020-03-04T10:50:26.0499541Z
2020-03-04T10:50:26.0499681Z The following NEW packages will be INSTALLED:
2020-03-04T10:50:26.0499758Z
2020-03-04T10:50:26.0500489Z _libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main
2020-03-04T10:50:26.0501110Z ca-certificates pkgs/main/linux-64::ca-certificates-2020.1.1-0
2020-03-04T10:50:26.0501722Z certifi pkgs/main/linux-64::certifi-2019.11.28-py36_0
2020-03-04T10:50:26.0502345Z ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7
2020-03-04T10:50:26.0502969Z libedit pkgs/main/linux-64::libedit-3.1.20181209-hc058e9b_0
2020-03-04T10:50:26.0503577Z libffi pkgs/main/linux-64::libffi-3.2.1-hd88cf55_4
2020-03-04T10:50:26.0504179Z libgcc-ng pkgs/main/linux-64::libgcc-ng-9.1.0-hdf63c60_0
2020-03-04T10:50:26.0504791Z libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-9.1.0-hdf63c60_0
2020-03-04T10:50:26.0505394Z ncurses pkgs/main/linux-64::ncurses-6.2-he6710b0_0
2020-03-04T10:50:26.0506278Z openssl pkgs/main/linux-64::openssl-1.1.1d-h7b6447c_4
2020-03-04T10:50:26.0506910Z pip pkgs/main/linux-64::pip-20.0.2-py36_1
2020-03-04T10:50:26.0507509Z python pkgs/main/linux-64::python-3.6.10-h0371630_0
2020-03-04T10:50:26.0508111Z readline pkgs/main/linux-64::readline-7.0-h7b6447c_5
2020-03-04T10:50:26.0508708Z setuptools pkgs/main/linux-64::setuptools-45.2.0-py36_0
2020-03-04T10:50:26.0509475Z sqlite pkgs/main/linux-64::sqlite-3.31.1-h7b6447c_0
2020-03-04T10:50:26.0510365Z tk pkgs/main/linux-64::tk-8.6.8-hbc83047_0
2020-03-04T10:50:26.0510964Z wheel pkgs/main/linux-64::wheel-0.34.2-py36_0
2020-03-04T10:50:26.0511551Z xz pkgs/main/linux-64::xz-5.2.4-h14c3975_4
2020-03-04T10:50:26.0512141Z zlib pkgs/main/linux-64::zlib-1.2.11-h7b6447c_3
2020-03-04T10:50:26.0512229Z
2020-03-04T10:50:26.0512313Z
2020-03-04T10:50:26.0512447Z Proceed ([y]/n)?
2020-03-04T10:50:26.0519068Z
2020-03-04T10:50:26.0519270Z Downloading and Extracting Packages
2020-03-04T10:50:26.0519494Z
2020-03-04T10:50:26.1318915Z libedit-3.1.20181209 | 163 KB | | 0%
2020-03-04T10:50:26.1319506Z libedit-3.1.20181209 | 163 KB | ########## | 100%
2020-03-04T10:50:26.1319646Z
2020-03-04T10:50:26.3010399Z libgcc-ng-9.1.0 | 5.1 MB | | 0%
2020-03-04T10:50:26.3016426Z libgcc-ng-9.1.0 | 5.1 MB | ########## | 100%
2020-03-04T10:50:26.3016551Z
2020-03-04T10:50:26.4178401Z tk-8.6.8 | 2.8 MB | | 0%
2020-03-04T10:50:26.4189777Z tk-8.6.8 | 2.8 MB | ########## | 100%
2020-03-04T10:50:26.4190390Z
2020-03-04T10:50:26.4512708Z zlib-1.2.11 | 103 KB | | 0%
2020-03-04T10:50:26.4513072Z zlib-1.2.11 | 103 KB | ########## | 100%
2020-03-04T10:50:26.4513153Z
2020-03-04T10:50:26.4688184Z _libgcc_mutex-0.1 | 3 KB | | 0%
2020-03-04T10:50:26.4694660Z _libgcc_mutex-0.1 | 3 KB | ########## | 100%
2020-03-04T10:50:26.4694795Z
2020-03-04T10:50:26.8854186Z ncurses-6.2 | 1.1 MB | | 0%
2020-03-04T10:50:26.8854823Z ncurses-6.2 | 1.1 MB | ########## | 100%
2020-03-04T10:50:26.8854969Z
2020-03-04T10:50:26.9238174Z ld_impl_linux-64-2.3 | 568 KB | | 0%
2020-03-04T10:50:26.9238718Z ld_impl_linux-64-2.3 | 568 KB | ########## | 100%
2020-03-04T10:50:26.9238853Z
2020-03-04T10:50:26.9544406Z libffi-3.2.1 | 40 KB | | 0%
2020-03-04T10:50:26.9545028Z libffi-3.2.1 | 40 KB | ########## | 100%
2020-03-04T10:50:26.9545172Z
2020-03-04T10:50:26.9767359Z certifi-2019.11.28 | 153 KB | | 0%
2020-03-04T10:50:26.9773520Z certifi-2019.11.28 | 153 KB | ########## | 100%
2020-03-04T10:50:26.9773720Z
2020-03-04T10:50:27.1019191Z pip-20.0.2 | 1.7 MB | | 0%
2020-03-04T10:50:27.1019873Z pip-20.0.2 | 1.7 MB | ########## | 100%
2020-03-04T10:50:27.1020024Z
2020-03-04T10:50:27.1284184Z wheel-0.34.2 | 51 KB | | 0%
2020-03-04T10:50:27.1284729Z wheel-0.34.2 | 51 KB | ########## | 100%
2020-03-04T10:50:27.1284982Z
2020-03-04T10:50:27.1635023Z xz-5.2.4 | 283 KB | | 0%
2020-03-04T10:50:27.1635574Z xz-5.2.4 | 283 KB | ########## | 100%
2020-03-04T10:50:27.1635690Z
2020-03-04T10:50:27.1957966Z readline-7.0 | 324 KB | | 0%
2020-03-04T10:50:27.1958452Z readline-7.0 | 324 KB | ########## | 100%
2020-03-04T10:50:27.1958592Z
2020-03-04T10:50:27.2419085Z sqlite-3.31.1 | 1.1 MB | | 0%
2020-03-04T10:50:27.2419569Z sqlite-3.31.1 | 1.1 MB | ########## | 100%
2020-03-04T10:50:27.2419671Z
2020-03-04T10:50:27.3421516Z python-3.6.10 | 29.7 MB | | 0%
2020-03-04T10:50:27.4422601Z python-3.6.10 | 29.7 MB | ##4 | 24%
2020-03-04T10:50:27.9656988Z python-3.6.10 | 29.7 MB | ####### | 71%
2020-03-04T10:50:27.9657727Z python-3.6.10 | 29.7 MB | ########## | 100%
2020-03-04T10:50:27.9657877Z
2020-03-04T10:50:28.0623746Z libstdcxx-ng-9.1.0 | 3.1 MB | | 0%
2020-03-04T10:50:28.0624544Z libstdcxx-ng-9.1.0 | 3.1 MB | ########## | 100%
2020-03-04T10:50:28.0624701Z
2020-03-04T10:50:28.1067800Z setuptools-45.2.0 | 520 KB | | 0%
2020-03-04T10:50:28.1068596Z setuptools-45.2.0 | 520 KB | ########## | 100%
2020-03-04T10:50:28.3879641Z Preparing transaction: ...working... done
2020-03-04T10:50:29.1497815Z Verifying transaction: ...working... done
2020-03-04T10:50:29.7835172Z Executing transaction: ...working... done
2020-03-04T10:50:29.7902932Z #
2020-03-04T10:50:29.7903104Z # To activate this environment, use
2020-03-04T10:50:29.7903242Z #
2020-03-04T10:50:29.7903364Z # $ conda activate myenv
2020-03-04T10:50:29.7903502Z #
2020-03-04T10:50:29.7903644Z # To deactivate an active environment, use
2020-03-04T10:50:29.7903785Z #
2020-03-04T10:50:29.7903919Z # $ conda deactivate
2020-03-04T10:50:29.7904010Z
2020-03-04T10:50:29.9029429Z + conda activate myenv
2020-03-04T10:50:30.0185463Z
2020-03-04T10:50:30.0186577Z CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
2020-03-04T10:50:30.0186790Z To initialize your shell, run
2020-03-04T10:50:30.0186898Z
2020-03-04T10:50:30.0187066Z $ conda init <SHELL_NAME>
2020-03-04T10:50:30.0187175Z
2020-03-04T10:50:30.0187334Z Currently supported shells are:
2020-03-04T10:50:30.0187683Z - bash
2020-03-04T10:50:30.0188017Z - fish
2020-03-04T10:50:30.0188343Z - tcsh
2020-03-04T10:50:30.0188668Z - xonsh
2020-03-04T10:50:30.0188995Z - zsh
2020-03-04T10:50:30.0189331Z - powershell
2020-03-04T10:50:30.0189418Z
2020-03-04T10:50:30.0189810Z See 'conda init --help' for more information and options.
2020-03-04T10:50:30.0190158Z
2020-03-04T10:50:30.0190604Z IMPORTANT: You may need to close and restart your shell after running 'conda init'.
I also faced the same issue while trying to activate the conda env. I small change to the command mentioned by #FlyingTeller, is to use something like
conda create -n <YOUR_ENV_NAME> python=3.6
conda info
$CONDA/bin/activate <YOUR_ENV_NAME> # to activate the env
It is an old question without an answer, but anyone like me who faced this issue recently can try the above solution.
This question used to be a part of this (now updated) question, but it seems like it should be another question, since it didn't help to get an answer to the other one.
My starting point is a loop doing 3 independent additions:
for (unsigned long i = 0; i < 2000000000; i++) {
asm volatile("" : "+r" (a), "+r" (b), "+r" (c), "+r" (d)); // prevents C compiler from optimizing out adds
a = a + d;
b = b + d;
c = c + d;
}
When this loop is not unrolled, it executes in 1 cycle (which is to be expected: it contains 4 instructions: the 3 additions, and the macro-fused increment/jump; all of which can be executed in one cycle on ports 0, 1, 5 and 6). When unrolling this loop, performances are surprising, and tend to be 25% slower than the non-unrolled version, which is probably due to uops scheduling, as suggested in the comments of the previous question.
In this question, I'm not asking about the performances, but rather about why in some cases, uops come from the MITE (legacy pipeline), and in other cases, from the DSB (uop cache). (note that I'm using a Skylake with the LSD (Loop Stream Detector) disabled)
Experimentally, when the jump is not quite aligned on 32 bytes, uops are issued from the MITE rather than the DSB. ("not quite 32 bytes" really means from 2 bytes before and 3 bytes after 32 bytes. Or put another way, starting from a 32-byte aligned jump, it means adding 1 to 3 bytes of padding, or removing 1 or 2 bytes of padding)
Compiling the C code above with Clang and (manually) unrolling it one time produces the following assembly code:
movl $2000000000, %esi
.p2align 4, 0x90
.LBB0_1:
addl %edi, %edx # 1
addl %edi, %ecx
addl %edi, %eax
addl %edi, %edx # 2
addl %edi, %ecx
addl %edi, %eax
addq $-2, %rsi
jne .LBB0_1
This code executes 2 cycles/iteration, as expected, and most uops are delivered by the DSB. Adding one byte of padding before the loop causes the loop to execute in 3 cycles/iteration, and all the uops are now delivered by the MITE.
In an effort to understand what is happening, I changed the align directive to .p2align 7 (thus aligning the loop on 128 bytes), and added some padding before the loop, thus changing the loop alignment. The results are as follows (long snippet ahead; explanations below):
| Padding | Jump offset | Cycles | MITE uops | DSB uops | DSB miss | DSB miss penalty |
| ------- | ----------- | ----------------- | ------------- | ------------- | ------------- | ---------------- |
| 0 | 16 | 2 453 942 151 | 1 589 440 | 7 000 531 761 | 73 681 | 33 419 |
| 1 | 17 | 2 454 623 799 | 2 002 088 | 7 000 493 234 | 107 433 | 28 686 |
| 2 | 18 | 2 454 010 264 | 1 611 181 | 7 000 580 070 | 72 372 | 34 963 |
| 3 | 19 | 2 455 016 743 | 1 531 428 | 7 001 271 720 | 76 240 | 42 493 |
| 4 | 20 | 2 454 056 088 | 1 592 150 | 7 000 571 537 | 71 691 | 29 677 |
| 5 | 21 | 2 455 111 497 | 1 701 204 | 7 001 068 440 | 85 117 | 41 744 |
| 6 | 22 | 2 454 558 860 | 2 081 244 | 7 000 362 980 | 105 388 | 29 829 |
| 7 | 23 | 2 454 351 179 | 1 765 720 | 7 000 472 785 | 81 903 | 39 022 |
| 8 | 24 | 2 454 470 296 | 2 045 062 | 7 000 337 694 | 107 763 | 30 750 |
| 9 | 25 | 2 454 395 853 | 1 748 525 | 7 000 560 730 | 82 773 | 37 030 |
| 10 | 26 | 2 453 920 970 | 1 500 801 | 7 000 562 016 | 70 144 | 36 559 |
| 11 | 27 | 2 453 748 551 | 1 485 784 | 7 000 530 064 | 66 535 | 32 019 |
| 12 | 28 | 2 453 973 841 | 1 601 708 | 7 000 562 754 | 72 601 | 31 970 |
| 13 | 29 | 2 454 749 106 | 2 085 092 | 7 000 539 751 | 109 862 | 30 977 |
| 14 | 30 | **3 003 289 033** | 7 001 845 873 | 358 240 | 1 000 075 874 | 37 506 |
| 15 | 31 | **4 003 748 994** | 7 002 171 254 | 372 672 | 1 000 086 939 | 39 679 |
| 16 | 32 | **3 003 810 021** | 7 002 294 170 | 295 736 | 1 000 114 704 | 28 974 |
| 17 | 33 | **3 002 912 972** | 7 001 752 747 | 350 755 | 1 000 071 698 | 32 249 |
| 18 | 34 | **3 003 392 542** | 7 001 941 076 | 360 439 | 1 000 076 887 | 45 663 |
| 19 | 35 | **3 003 040 266** | 7 001 759 091 | 343 693 | 1 000 072 685 | 38 703 |
| 20 | 36 | 2 453 764 603 | 1 511 899 | 7 000 546 442 | 66 912 | 32 996 |
| 21 | 37 | 2 454 889 754 | 1 946 579 | 7 000 713 787 | 102 922 | 31 852 |
| 22 | 38 | 2 454 700 423 | 1 961 612 | 7 000 581 288 | 100 281 | 30 364 |
| 23 | 39 | 2 454 398 236 | 1 974 415 | 7 000 350 258 | 103 015 | 30 855 |
| 24 | 40 | 2 452 285 702 | 1 562 028 | 7 000 416 473 | 67 622 | 38 783 |
| 25 | 41 | 2 454 500 700 | 2 013 917 | 7 000 384 154 | 102 906 | 31 165 |
| 26 | 42 | 2 454 666 446 | 1 928 032 | 7 000 572 245 | 99 613 | 35 813 |
| 27 | 43 | 2 453 929 241 | 1 565 110 | 7 000 588 419 | 70 027 | 31 336 |
| 28 | 44 | 2 453 852 431 | 1 595 897 | 7 000 633 247 | 71 735 | 35 984 |
| 29 | 45 | 2 454 664 111 | 2 039 338 | 7 000 534 894 | 105 225 | 30 043 |
| 30 | 46 | 2 454 523 184 | 1 876 338 | 7 000 592 928 | 88 020 | 48 456 |
| 31 | 47 | 2 454 091 130 | 1 560 821 | 7 000 631 532 | 70 150 | 37 773 |
| 32 | 48 | 2 453 813 400 | 1 535 557 | 7 000 556 686 | 70 196 | 33 268 |
| 33 | 49 | 2 453 772 578 | 1 501 716 | 7 000 526 938 | 67 747 | 33 492 |
| 34 | 50 | 2 455 308 730 | 1 643 047 | 7 001 287 728 | 80 148 | 43 035 |
| 35 | 51 | 2 453 790 620 | 1 506 869 | 7 000 529 450 | 66 903 | 35 315 |
| 36 | 52 | 2 453 509 109 | 1 534 817 | 7 000 405 227 | 67 344 | 30 526 |
| 37 | 53 | 2 453 516 412 | 1 469 184 | 7 000 430 367 | 65 040 | 30 686 |
| 38 | 54 | 2 453 851 033 | 1 556 722 | 7 000 581 363 | 69 098 | 36 605 |
| 39 | 55 | 2 454 916 648 | 2 089 549 | 7 000 572 462 | 111 448 | 30 435 |
| 40 | 56 | 2 455 089 502 | 1 991 232 | 7 000 799 155 | 104 559 | 30 724 |
| 41 | 57 | 2 454 744 425 | 2 002 307 | 7 000 532 096 | 105 221 | 32 393 |
| 42 | 58 | 2 454 543 686 | 1 960 042 | 7 000 500 103 | 101 409 | 27 943 |
| 43 | 59 | 2 453 893 848 | 1 561 182 | 7 000 607 528 | 73 192 | 33 645 |
| 44 | 60 | 2 453 989 634 | 1 629 949 | 7 000 556 378 | 74 704 | 34 821 |
| 45 | 61 | 2 453 879 092 | 1 551 181 | 7 000 561 022 | 70 233 | 36 191 |
| 46 | 62 | **3 003 015 120** | 7 001 772 138 | 348 243 | 1 000 073 404 | 35 333 |
| 47 | 63 | **4 004 092 512** | 7 002 359 576 | 380 452 | 2 000 097 711 | 50 376 |
| 48 | 64 | **2 234 898 441** | 109 006 411 | 7 893 398 716 | 109 108 | 35 075 |
| 49 | 65 | **3 003 182 414** | 7 001 843 757 | 357 954 | 2 000 075 494 | 36 281 |
| 50 | 66 | **3 003 280 054** | 7 001 876 384 | 358 097 | 2 000 075 630 | 39 301 |
| 51 | 67 | **3 004 086 641** | 7 002 384 321 | 307 480 | 2 000 114 067 | 32 242 |
| 52 | 68 | 2 461 587 458 | 15 841 141 | 6 986 174 099 | 70 725 | 29 985 |
| 53 | 69 | 2 454 704 936 | 2 019 734 | 7 000 530 774 | 123 110 | 32 717 |
| 54 | 70 | **2 629 777 063** | 639 698 105 | 6 362 945 524 | 121 313 | 29 648 |
| 55 | 71 | 2 452 517 518 | 21 196 356 | 6 980 899 385 | 5 689 504 | 27 618 |
| 56 | 72 | 2 457 056 675 | 79 539 769 | 6 922 550 909 | 23 953 203 | 32 238 |
| 57 | 73 | 2 453 966 239 | 1 486 894 | 7 000 608 597 | 72 506 | 36 799 |
| 58 | 74 | 2 461 391 665 | 53 426 497 | 6 948 932 999 | 13 034 546 | 37 883 |
| 59 | 75 | 2 454 091 521 | 1 537 438 | 7 000 613 720 | 73 256 | 38 003 |
| 60 | 76 | 2 550 237 671 | 312 611 365 | 6 689 536 750 | 62 278 250 | 41 078 |
| 61 | 77 | 2 454 371 129 | 1 915 411 | 7 000 545 114 | 107 086 | 30 133 |
| 62 | 78 | 2 462 015 450 | 32 874 270 | 6 969 244 698 | 5 296 338 | 37 506 |
| 63 | 79 | 2 453 810 530 | 1 588 073 | 7 000 489 720 | 70 291 | 36 915 |
| 64 | 80 | 2 453 510 981 | 1 521 322 | 7 000 384 678 | 67 219 | 30 114 |
| 65 | 81 | 2 454 659 220 | 1 531 897 | 7 001 004 411 | 74 567 | 41 201 |
| 66 | 82 | 2 453 984 834 | 1 570 182 | 7 000 624 664 | 72 914 | 39 483 |
| 67 | 83 | 2 454 127 882 | 1 638 057 | 7 000 590 289 | 75 623 | 33 755 |
| 68 | 84 | 2 453 781 071 | 1 575 812 | 7 000 535 270 | 74 337 | 34 094 |
| 69 | 85 | 2 453 947 163 | 1 595 272 | 7 000 545 139 | 71 584 | 38 966 |
| 70 | 86 | 2 453 948 945 | 1 594 376 | 7 000 552 806 | 71 096 | 34 265 |
| 71 | 87 | 2 453 888 591 | 1 540 673 | 7 000 536 024 | 71 123 | 33 350 |
| 72 | 88 | 2 453 838 422 | 1 539 740 | 7 000 540 957 | 71 776 | 33 191 |
| 73 | 89 | 2 454 013 271 | 1 532 577 | 7 000 534 226 | 69 794 | 32 287 |
| 74 | 90 | 2 453 959 044 | 1 549 283 | 7 000 562 495 | 71 483 | 35 739 |
| 75 | 91 | 2 454 357 932 | 2 062 771 | 7 000 290 377 | 111 481 | 28 864 |
| 76 | 92 | 2 454 258 445 | 1 937 218 | 7 000 338 810 | 101 760 | 27 475 |
| 77 | 93 | 2 454 156 149 | 1 738 764 | 7 000 400 563 | 82 207 | 38 130 |
| 78 | 94 | **3 003 245 905** | 7 001 947 715 | 356 496 | 1 000 078 668 | 38 983 |
| 79 | 95 | **4 003 498 969** | 7 002 106 621 | 361 236 | 1 000 087 167 | 41 197 |
| 80 | 96 | **3 003 440 683** | 7 001 915 914 | 340 975 | 1 000 081 844 | 36 174 |
| 81 | 97 | **3 003 192 020** | 7 001 848 864 | 354 371 | 1 000 076 474 | 37 465 |
| 82 | 98 | **3 004 231 542** | 7 002 423 726 | 327 973 | 1 000 119 668 | 34 498 |
| 83 | 99 | **3 003 204 122** | 7 001 869 410 | 341 860 | 1 000 075 913 | 34 005 |
| 84 | 100 | 2 453 903 936 | 1 509 757 | 7 000 577 662 | 70 586 | 38 383 |
| 85 | 101 | 2 454 444 592 | 1 649 275 | 7 000 764 725 | 76 185 | 37 481 |
| 86 | 102 | 2 455 551 786 | 2 094 483 | 7 000 919 108 | 115 683 | 33 599 |
| 87 | 103 | 2 454 090 830 | 1 644 299 | 7 000 554 367 | 76 131 | 37 986 |
| 88 | 104 | 2 452 263 286 | 1 982 058 | 7 000 594 326 | 105 011 | 32 747 |
| 89 | 105 | 2 453 938 066 | 1 552 994 | 7 000 560 184 | 71 781 | 38 307 |
| 90 | 106 | 2 453 839 657 | 1 591 329 | 7 000 534 174 | 71 493 | 32 464 |
| 91 | 107 | 2 456 284 290 | 1 721 752 | 7 001 608 059 | 87 228 | 62 810 |
| 92 | 108 | 2 453 706 579 | 1 577 941 | 7 000 431 429 | 70 517 | 33 684 |
| 93 | 109 | 2 453 714 638 | 1 484 598 | 7 000 514 337 | 66 443 | 34 239 |
| 94 | 110 | 2 453 814 023 | 1 619 443 | 7 000 418 813 | 74 924 | 34 831 |
| 95 | 111 | 2 453 734 759 | 1 502 260 | 7 000 447 611 | 66 790 | 36 660 |
| 96 | 112 | 2 456 304 117 | 1 636 949 | 7 001 903 454 | 87 894 | 45 984 |
| 97 | 113 | 2 454 764 375 | 2 032 245 | 7 000 503 166 | 111 873 | 36 308 |
| 98 | 114 | 2 453 930 372 | 1 641 970 | 7 000 527 807 | 75 164 | 36 817 |
| 99 | 115 | 2 453 596 195 | 1 577 533 | 7 000 528 820 | 74 424 | 35 428 |
| 100 | 116 | 2 453 774 301 | 1 490 781 | 7 000 546 047 | 71 040 | 31 462 |
| 101 | 117 | 2 453 808 290 | 1 472 783 | 7 000 563 094 | 68 497 | 30 214 |
| 102 | 118 | 2 453 927 668 | 1 578 700 | 7 000 547 988 | 72 499 | 36 894 |
| 103 | 119 | 2 453 881 334 | 1 538 221 | 7 000 556 688 | 73 651 | 38 630 |
| 104 | 120 | 2 454 620 311 | 2 049 316 | 7 000 459 876 | 110 210 | 30 452 |
| 105 | 121 | 2 453 793 013 | 1 553 815 | 7 000 448 812 | 70 690 | 35 146 |
| 106 | 122 | 2 453 516 549 | 1 477 303 | 7 000 369 210 | 66 462 | 32 381 |
| 107 | 123 | 2 453 679 941 | 1 558 433 | 7 000 399 585 | 71 027 | 37 700 |
| 108 | 124 | 2 453 984 832 | 1 591 183 | 7 000 558 547 | 74 810 | 32 532 |
| 109 | 125 | 2 453 972 231 | 1 585 644 | 7 000 573 173 | 73 159 | 39 583 |
| 110 | 126 | **3 003 167 043** | 7 001 793 152 | 341 345 | 1 000 076 047 | 41 811 |
| 111 | 127 | **4 004 031 670** | 7 002 344 014 | 394 950 | 2 000 094 647 | 42 345 |
| 112 | 128 | **2 017 184 284** | 2 397 032 | 7 999 676 604 | 97 555 | 23 614 |
| 113 | 129 | **3 003 231 942** | 7 001 876 887 | 355 548 | 2 000 078 108 | 35 462 |
| 114 | 130 | **3 003 073 797** | 7 001 763 748 | 343 879 | 2 000 073 914 | 36 604 |
| 115 | 131 | **3 003 066 183** | 7 001 799 239 | 334 265 | 2 000 076 089 | 37 578 |
| 116 | 132 | 2 459 437 822 | 11 831 880 | 6 990 241 198 | 69 673 | 31 901 |
| 117 | 133 | 2 453 833 994 | 1 520 407 | 7 000 579 352 | 72 385 | 39 387 |
| 118 | 134 | 2 453 582 104 | 1 508 309 | 7 000 462 005 | 70 623 | 30 954 |
| 119 | 135 | 2 453 607 456 | 1 520 805 | 7 000 426 804 | 69 833 | 35 969 |
| 120 | 136 | 2 453 516 773 | 218 632 117 | 6 783 760 256 | 64 474 484 | 29 161 |
| 121 | 137 | 2 454 656 532 | 2 135 434 | 7 000 368 481 | 121 168 | 29 070 |
| 122 | 138 | 2 464 943 252 | 76 396 888 | 6 926 141 929 | 18 701 369 | 29 401 |
| 123 | 139 | 2 454 713 076 | 1 945 881 | 7 000 526 215 | 113 113 | 32 864 |
| 124 | 140 | 2 459 197 278 | 17 602 061 | 6 984 668 329 | 3 270 690 | 39 930 |
| 125 | 141 | 2 453 811 452 | 1 546 333 | 7 000 539 142 | 71 850 | 32 204 |
| 126 | 142 | 2 453 943 973 | 1 557 203 | 7 000 570 909 | 74 167 | 34 542 |
| 127 | 143 | 2 453 989 607 | 1 490 927 | 7 000 599 022 | 67 774 | 32 994 |
| 128 | 144 | 2 455 332 089 | 1 619 032 | 7 001 303 644 | 83 418 | 43 983 |
padding represents how many bytes of padding were added before the loop. Jump offset represents the alignment of the jump: it occurs 16 bytes after the start of the loop, and its value is thus always padding+16 (but it helps visualizing to have a column for it). Cycles is the number of cycles to execute the program. MITE uops is the number of uops delivered by the MITE. DSB uops is the number of uops delivered by the DSB. DSB miss is the number of DSB misses. DSB miss penalty is the number penalty cycles due to DSB-to-MITE switches. Those number were obtained using perf stat -e idq.dsb_uops,idq.mite_uops,frontend_retired.dsb_miss,dsb2mite_switches.penalty_cycles,cycles.
In the case of the loop unrolled once, performances vary quite a lot depending on whether uops are delivered by the MITE or the DSB. However, in the case of the same loop unrolled 4 times, the exact same MITE/DSB pattern can be observed, and bearly affect performances:
| Padding | Jump offset | Cycles | MITE uops | DSB uops | DSB miss | DSB miss penalty |
| ------- | ----------- | ----------------- | ------------- | ------------- | ------------- | ---------------- |
| 0 | 34 | 2 443 059 894 | 6 404 874 796 | 324 866 | 557 007 | 58 270 |
| 1 | 35 | 2 469 823 874 | 6 402 845 671 | 359 397 | 242 913 | 44 004 |
| 2 | 36 | 2 509 831 578 | 2 428 288 | 6 400 917 619 | 126 454 | 35 718 |
| 3 | 37 | 2 516 899 098 | 2 183 357 | 6 401 715 038 | 115 461 | 42 722 |
| 4 | 38 | 2 535 785 420 | 3 596 045 | 6 405 592 898 | 193 088 | 145 459 |
| 5 | 39 | 2 536 888 998 | 4 544 195 | 6 407 929 337 | 270 307 | 141 847 |
| 6 | 40 | 2 514 898 947 | 3 500 301 | 6 404 310 391 | 168 683 | 103 966 |
| 7 | 41 | 2 497 731 601 | 2 860 409 | 6 402 485 570 | 136 201 | 70 007 |
| 8 | 42 | 2 519 396 945 | 3 373 375 | 6 405 438 970 | 180 768 | 96 499 |
| 9 | 43 | 2 519 959 317 | 3 038 180 | 6 401 766 682 | 163 982 | 57 217 |
| 10 | 44 | 2 518 862 677 | 2 556 957 | 6 400 557 326 | 127 913 | 33 141 |
| 11 | 45 | 2 505 211 679 | 1 982 925 | 6 400 617 993 | 95 689 | 33 755 |
| 12 | 46 | 2 520 256 213 | 1 764 948 | 6 401 331 329 | 79 917 | 49 950 |
| 13 | 47 | 2 528 859 616 | 2 865 395 | 6 402 516 447 | 156 550 | 51 970 |
| 14 | 48 | 2 526 844 155 | 2 334 728 | 6 402 255 285 | 122 589 | 49 508 |
| 15 | 49 | 2 526 623 614 | 2 617 350 | 6 401 419 706 | 141 028 | 39 374 |
| 16 | 50 | 2 508 159 432 | 2 293 737 | 6 400 708 049 | 110 325 | 38 407 |
| 17 | 51 | 2 505 715 666 | 2 646 431 | 6 401 083 574 | 137 684 | 41 563 |
| 18 | 52 | 2 499 124 059 | 2 407 547 | 6 400 350 409 | 127 750 | 33 880 |
| 19 | 53 | 2 519 671 512 | 2 875 080 | 6 401 825 044 | 151 559 | 45 711 |
| 20 | 54 | 2 519 382 271 | 2 178 986 | 6 400 787 103 | 94 733 | 44 873 |
| 21 | 55 | 2 494 177 992 | 1 953 404 | 6 400 469 971 | 94 724 | 32 348 |
| 22 | 56 | 2 488 166 104 | 1 865 899 | 6 400 788 908 | 89 963 | 32 295 |
| 23 | 57 | 2 473 667 778 | 1 883 684 | 6 400 516 105 | 88 080 | 31 822 |
| 24 | 58 | 2 491 983 809 | 1 964 243 | 6 401 141 418 | 95 559 | 38 009 |
| 25 | 59 | 2 523 682 312 | 2 179 584 | 6 402 528 236 | 115 550 | 51 286 |
| 26 | 60 | 2 468 826 280 | 1 568 693 | 6 400 555 529 | 69 083 | 39 205 |
| 27 | 61 | 2 468 128 275 | 2 474 660 | 6 400 400 765 | 128 799 | 32 787 |
| 28 | 62 | 2 461 792 136 | 6 401 675 319 | 325 130 | 91 908 | 31 537 |
| 29 | 63 | 2 413 473 869 | 6 401 891 263 | 308 719 | 474 886 616 | 30 068 |
| 30 | 64 | 2 442 178 183 | 2 412 150 | 6 800 327 022 | 137 335 | 33 005 |
| 31 | 65 | 2 512 670 489 | 6 402 475 993 | 321 507 | 82 884 937 | 30 439 |
| 32 | 66 | 2 438 295 147 | 6 402 583 033 | 320 775 | 193 935 | 32 813 |
| 33 | 67 | 2 465 431 142 | 6 402 487 498 | 300 367 | 192 554 | 29 581 |
| 34 | 68 | 2 510 544 922 | 1 664 395 | 6 400 550 345 | 79 102 | 35 757 |
| 35 | 69 | 2 492 243 510 | 2 598 101 | 6 400 252 944 | 137 725 | 30 489 |
| 36 | 70 | 2 477 042 696 | 2 701 036 | 6 400 305 241 | 157 174 | 29 164 |
| 37 | 71 | 2 514 818 722 | 1 666 562 | 6 400 550 483 | 79 761 | 42 464 |
| 38 | 72 | 2 458 949 815 | 2 697 410 | 6 400 122 020 | 148 539 | 30 023 |
| 39 | 73 | 2 473 858 051 | 1 653 601 | 6 400 523 949 | 76 190 | 40 743 |
| 40 | 74 | 2 437 856 049 | 2 644 658 | 6 400 220 386 | 146 309 | 27 825 |
| 41 | 75 | 2 502 432 002 | 1 700 199 | 6 400 535 604 | 79 871 | 43 243 |
| 42 | 76 | 2 493 675 148 | 2 622 476 | 6 400 171 037 | 153 333 | 31 309 |
| 43 | 77 | 2 484 286 254 | 1 700 755 | 6 400 512 732 | 80 362 | 50 028 |
| 44 | 78 | 2 494 745 100 | 2 713 187 | 6 400 363 559 | 159 990 | 31 604 |
| 45 | 79 | 2 525 806 102 | 3 195 503 | 6 401 041 048 | 193 130 | 66 443 |
| 46 | 80 | 2 525 084 219 | 2 901 188 | 6 400 857 107 | 171 471 | 48 662 |
| 47 | 81 | 2 525 023 891 | 2 503 546 | 6 400 362 906 | 151 389 | 31 424 |
| 48 | 82 | 2 516 945 604 | 1 818 682 | 6 400 778 875 | 83 134 | 41 091 |
| 49 | 83 | 2 503 330 074 | 2 295 094 | 6 400 936 466 | 127 778 | 37 184 |
| 50 | 84 | 2 515 257 599 | 1 998 408 | 6 401 086 057 | 103 812 | 36 661 |
| 51 | 85 | 2 515 704 687 | 2 203 920 | 6 400 816 810 | 103 168 | 48 042 |
| 52 | 86 | 2 521 414 196 | 2 112 029 | 6 401 272 207 | 101 158 | 52 608 |
| 53 | 87 | 2 516 900 368 | 1 597 896 | 6 400 570 586 | 73 608 | 40 296 |
| 54 | 88 | 2 471 915 311 | 1 991 994 | 6 400 413 877 | 92 759 | 35 733 |
| 55 | 89 | 2 478 161 240 | 2 757 067 | 6 400 671 792 | 141 983 | 42 998 |
| 56 | 90 | 2 468 575 551 | 1 893 460 | 6 400 361 170 | 91 596 | 32 235 |
| 57 | 91 | 2 516 481 566 | 1 936 691 | 6 400 335 059 | 97 668 | 25 221 |
| 58 | 92 | 2 482 788 158 | 2 873 305 | 6 400 470 197 | 157 875 | 35 177 |
| 59 | 93 | 2 472 664 516 | 3 482 867 | 6 401 550 404 | 199 835 | 49 199 |
| 60 | 94 | 2 522 537 958 | 5 604 672 405 | 800 614 280 | 35 268 930 | 12 965 365 |
| 61 | 95 | 2 521 875 392 | 5 604 350 958 | 800 642 890 | 34 500 749 | 12 985 188 |
| 62 | 96 | 2 475 386 582 | 6 006 074 137 | 400 581 950 | 27 625 952 | 8 251 826 |
| 63 | 97 | 2 480 407 320 | 6 007 748 529 | 400 687 290 | 21 488 812 | 8 386 755 |
| 64 | 98 | 2 451 562 172 | 6 406 359 632 | 369 366 | 687 803 | 59 309 |
| 65 | 99 | 2 469 472 059 | 6 407 104 495 | 365 022 | 821 782 | 63 981 |
| 66 | 100 | 2 525 647 143 | 2 627 685 | 6 404 609 372 | 148 635 | 53 376 |
| 67 | 101 | 2 533 208 849 | 4 294 575 | 6 405 154 176 | 224 516 | 174 959 |
| 68 | 102 | 2 522 792 300 | 2 297 167 | 6 404 309 702 | 128 216 | 62 867 |
| 69 | 103 | 2 528 134 912 | 3 877 072 | 6 405 083 855 | 204 813 | 147 178 |
| 70 | 104 | 2 480 455 890 | 2 144 317 | 6 401 555 634 | 102 192 | 34 375 |
| 71 | 105 | 2 457 138 962 | 2 871 586 | 6 400 323 955 | 138 739 | 46 120 |
| 72 | 106 | 2 476 839 093 | 2 554 822 | 6 400 518 957 | 127 515 | 32 344 |
| 73 | 107 | 2 522 202 654 | 2 698 007 | 6 401 714 270 | 136 845 | 39 610 |
| 74 | 108 | 2 529 648 028 | 2 591 016 | 6 402 573 048 | 124 463 | 77 588 |
| 75 | 109 | 2 504 833 699 | 2 099 386 | 6 400 941 244 | 102 431 | 33 246 |
| 76 | 110 | 2 509 193 033 | 2 244 590 | 6 402 859 463 | 118 633 | 44 816 |
| 77 | 111 | 2 526 808 490 | 3 075 036 | 6 401 267 531 | 168 516 | 50 367 |
| 78 | 112 | 2 525 662 170 | 2 076 530 | 6 401 870 313 | 109 810 | 44 704 |
| 79 | 113 | 2 523 356 566 | 1 647 814 | 6 400 602 452 | 74 710 | 39 700 |
| 80 | 114 | 2 490 947 127 | 2 618 819 | 6 400 769 586 | 139 588 | 38 773 |
| 81 | 115 | 2 525 323 899 | 2 433 800 | 6 401 805 576 | 113 498 | 77 057 |
| 82 | 116 | 2 528 753 531 | 3 317 116 | 6 402 358 198 | 151 306 | 132 752 |
| 83 | 117 | 2 517 309 668 | 1 923 449 | 6 401 356 394 | 89 733 | 79 670 |
| 84 | 118 | 2 519 588 707 | 1 620 560 | 6 400 866 891 | 74 881 | 53 689 |
| 85 | 119 | 2 487 765 769 | 2 620 064 | 6 400 321 476 | 134 480 | 33 623 |
...
For both loops (the one unrolled once, and the one unrolled 4 times), note the exception when the jump is aligned exactly on 64 bytes: in such cases, macro-fusion does not happen (documented in Intel Optimization manual, Section 2.5.2.1 SandyBridge Legacy Pipeline), and for some reason, this causes uops to be delivered by the MITE rather than the DSB.
Question: What causes uops to be delivered by the MITE rather than the DSB when the alignment of the jump instruction is close to 32 bytes?
We have 4 nodes Hadoop cluster.
2 Master nodes
2 data nodes
After sometimes we found that our data nodes are failing. then, we go and see the log section it always tell cannot allocate memory.
ENV
HDP 2.3.6 VERSION
HAWQ 2.0.0 VERSION
linux os : centos 6.0
Getting following error
Data nodes are crashing WITH following logs
os::commit_memory(0x00007fec816ac000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)
Memory Info
vm_overcommit ratio is 2
MemTotal: 30946088 kB
MemFree: 11252496 kB
Buffers: 496376 kB
Cached: 11938144 kB
SwapCached: 0 kB
Active: 15023232 kB
Inactive: 3116316 kB
Active(anon): 5709860 kB
Inactive(anon): 394092 kB
Active(file): 9313372 kB
Inactive(file): 2722224 kB
Unevictable: 0 kB
Mlocked: 0 kB
SwapTotal: 15728636 kB
SwapFree: 15728636 kB
Dirty: 280 kB
Writeback: 0 kB
AnonPages: 5705052 kB
Mapped: 461876 kB
Shmem: 398936 kB
Slab: 803936 kB
SReclaimable: 692240 kB
SUnreclaim: 111696 kB
KernelStack: 33520 kB
PageTables: 342840 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 31201680 kB
Committed_AS: 26896520 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 73516 kB
VmallocChunk: 34359538628 kB
HardwareCorrupted: 0 kB
AnonHugePages: 2887680 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 6132 kB
DirectMap2M: 2091008 kB
DirectMap1G: 29360128 kB
Given this text
affiliates 1038 680 KB
article_ratings 699 168 KB
authors 30 40 KB
fs.chunks 3401 633.89 MB
fs.files 1476 680 KB
nodes 1432 24.29 MB
nodes_search 91 2.8 MB
nodes_tags 272 40 KB
page_views 107769 16.37 MB
page_views_map 212 40 KB
recommendations 34305 45.1 MB
rewrite_rules 209 168 KB
sign_ups 10331 12.52 MB
sitemaps 1 14.84 MB
suppliers 13 8 KB
tariff_price_check_reports 34 540 KB
tariff_price_checks 1129 968 KB
tariffs 5 680 KB
users 17 64 KB
users_tags 2 8 KB
versions 18031 156.64 MB
How can I sort by the 4th and then 3rd column so that it's sorted by file size?
I've tried :%!sort -k4 -k3n which partially works, but seems to fail on the 3rd size column.
What am I doing wrong?
I think I've figured it out.
:%!sort -k4 -bk3g
I sort by the the 4th column (-k4), followed by the 3rd column. We ignore leading blank spaces (b), and this time we sort using a general numeric sort (g).
I blogged about this too
I don't know how to handle it with sort(). I've found problems with the decimal point, although I changed the LC_NUMERIC environment variable, so I would switch to perl to solve it, like:
:%!perl -0777 -ne '
#l = map { [ $_, split " ", $_ ] } split /\n/, $_;
#l = sort { $a->[-1] cmp $b->[-1] or $a->[-2] <=> $b->[-2] } #l;
print "$_->[0]\n" for #l
'
Put it in the same line to run if from inside vim. It yields:
suppliers 13 8 KB
users_tags 2 8 KB
authors 30 40 KB
nodes_tags 272 40 KB
page_views_map 212 40 KB
users 17 64 KB
article_ratings 699 168 KB
rewrite_rules 209 168 KB
tariff_price_check_reports 34 540 KB
affiliates 1038 680 KB
fs.files 1476 680 KB
tariffs 5 680 KB
tariff_price_checks 1129 968 KB
nodes_search 91 2.8 MB
sign_ups 10331 12.52 MB
sitemaps 1 14.84 MB
page_views 107769 16.37 MB
nodes 1432 24.29 MB
recommendations 34305 45.1 MB
versions 18031 156.64 MB
fs.chunks 3401 633.89 MB