WARNING: markdown-it-py 0.1.0 does not provide the extra 'plugins'

[stromal]

Apache Airflow version

Other Airflow 2 version

What happened

Describe the bug

expectation

• GOAL: install this to a apytnon venve and use this as envionemnt for DAGs in the Docker Airflow
• I expected not to give an error and I can smothly install my python libraries.
• When I want to install packages from a requirements.txt
• I have a blank python virtual environemnt with the latest pip
• pip 22.2.2 from /home/ubuntu/.../..../lib/python3.8/site-packages/pip (python 3.8)
• python version 3.8.10
• Ubuntu 20.04 LTS

bug

Command:

python3 -m pip install -r requirements.txt

Infinitly loops the final part:

MANY ALRADY SATIFIED INSTALLS
...
Requirement already satisfied: sniffio in ./airv/lib/python3.8/site-packages (from httpx->apache-airflow==2.3.3->-r requirements.txt (line 1)) (1.3.0)
Collecting markdown-it-py[linkify,plugins]
  Using cached markdown_it_py-2.0.1-py3-none-any.whl (84 kB)
  Using cached markdown_it_py-2.0.0-py3-none-any.whl (83 kB)
  Using cached markdown_it_py-1.1.0-py3-none-any.whl (83 kB)
  Using cached markdown_it_py-1.0.0-py3-none-any.whl (83 kB)
  Using cached markdown_it_py-0.6.2-py3-none-any.whl (81 kB)
WARNING: markdown-it-py 0.6.2 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.6.1-py3-none-any.whl (81 kB)
WARNING: markdown-it-py 0.6.1 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.6.0-py3-none-any.whl (80 kB)
WARNING: markdown-it-py 0.6.0 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.8-py3-none-any.whl (110 kB)
WARNING: markdown-it-py 0.5.8 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.7-py3-none-any.whl (108 kB)
WARNING: markdown-it-py 0.5.7 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.7 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.6-py3-none-any.whl (115 kB)
WARNING: markdown-it-py 0.5.6 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.6 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.5-py3-none-any.whl (114 kB)
WARNING: markdown-it-py 0.5.5 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.5 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.4-py3-none-any.whl (113 kB)
WARNING: markdown-it-py 0.5.4 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.4 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.3-py3-none-any.whl (111 kB)
WARNING: markdown-it-py 0.5.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.3 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.2-py3-none-any.whl (110 kB)
WARNING: markdown-it-py 0.5.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.2 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.1-py3-none-any.whl (110 kB)
WARNING: markdown-it-py 0.5.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.1 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.5.0-py3-none-any.whl (110 kB)
WARNING: markdown-it-py 0.5.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.0 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.4.9-py3-none-any.whl (96 kB)
WARNING: markdown-it-py 0.4.9 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.9 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.4.8-py3-none-any.whl (96 kB)
WARNING: markdown-it-py 0.4.8 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.8 does not provide the extra 'plugins'
  Using cached markdown_it_py-0.4.7-py3-none-any.whl (96 kB)
WARNING: markdown-it-py 0.4.7 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.7 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.6.tar.gz (116 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.6 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.6 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.5.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.5 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.5 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.4.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.4 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.4 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.3.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.3 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.2.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.2 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.1.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.1 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.4.0.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.4.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.0 does not provide the extra 'plugins'
  Using cached markdown-it-py-0.3.3.tar.gz (117 kB)
  Preparing metadata (setup.py) ... done
WARNING: markdown-it-py 0.3.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.3 does not provide the extra 'plugins'
....
WARNING: markdown-it-py 0.4.9 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.8 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.8 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.7 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.7 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.6 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.6 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.5 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.5 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.4 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.4 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.1.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.1.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.1.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.1.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.6.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.6.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.6.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.8 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.7 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.7 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.6 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.6 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.5 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.5 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.4 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.4 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.5.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.5.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.9 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.9 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.8 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.8 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.7 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.7 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.6 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.6 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.5 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.5 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.4 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.4 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.4.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.4.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.3.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.3.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.3 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.3 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.2 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.2 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.2.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.2.0 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.1.1 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.1.1 does not provide the extra 'plugins'
WARNING: markdown-it-py 0.1.0 does not provide the extra 'linkify'
WARNING: markdown-it-py 0.1.0 does not provide the extra 'plugins'

What you think should happen instead

problem

This is a problem for people doing becasue I am not sure if the main libraries has this a sub dependncy library and tehy may fail. Becasue I ahev verything installed and way more packages tahn the original requirements list.

Installed packages

Package                             Version
----------------------------------- -----------
aiohttp                             3.8.3
aiosignal                           1.2.0
alembic                             1.8.1
analytics-python                    1.4.0
anyio                               3.6.1
apache-airflow                      2.3.3
apache-airflow-providers-common-sql 1.2.0
apache-airflow-providers-ftp        3.1.0
apache-airflow-providers-http       4.0.0
apache-airflow-providers-imap       3.0.0
apache-airflow-providers-sqlite     3.2.1
apispec                             3.3.2
argcomplete                         2.0.0
async-timeout                       4.0.2
attrs                               20.3.0
Babel                               2.10.3
backoff                             1.10.0
bcrypt                              4.0.0
beautifulsoup4                      4.11.1
bingads                             13.0.13
blinker                             1.5
boto                                2.49.0
boto3                               1.15.16
botocore                            1.18.18
bs4                                 0.0.1
cached-property                     1.5.2
cachelib                            0.9.0
cachetools                          4.2.4
cattrs                              1.10.0
certifi                             2022.9.24
cffi                                1.15.1
charset-normalizer                  2.0.12
click                               8.1.3
clickclick                          20.10.2
cloudpickle                         2.2.0
colorama                            0.4.5
colorlog                            4.8.0
commonmark                          0.9.1
connexion                           2.14.1
contourpy                           1.0.5
cron-descriptor                     1.2.31
croniter                            1.3.7
cryptography                        38.0.1
cycler                              0.11.0
dask                                2021.9.1
deepdiff                            5.7.0
Deprecated                          1.2.13
dill                                0.3.5.1
dnspython                           2.2.1
docopt                              0.4.0
docutils                            0.19
email-validator                     1.3.0
et-xmlfile                          1.1.0
fastapi                             0.85.0
ffmpy                               0.3.0
Flask                               2.2.2
Flask-AppBuilder                    4.1.2
Flask-Babel                         2.0.0
Flask-Caching                       2.0.1
Flask-JWT-Extended                  4.4.4
Flask-Login                         0.6.2
Flask-Session                       0.4.0
Flask-SQLAlchemy                    2.5.1
Flask-WTF                           1.0.1
fonttools                           4.37.3
frozenlist                          1.3.1
fsspec                              2022.8.2
furl                                2.1.3
future                              0.18.2
google-auth                         1.35.0
google-auth-oauthlib                0.5.3
googleads                           26.0.0
gradio                              3.0.26
graphviz                            0.20.1
greenlet                            1.1.3
gspread                             5.4.0
gunicorn                            20.1.0
h11                                 0.12.0
hashids                             1.3.1
httpagentparser                     1.9.0
httpcore                            0.15.0
httplib2                            0.20.4
httpx                               0.23.0
idna                                3.4
importlib-metadata                  4.12.0
importlib-resources                 5.9.0
inflection                          0.5.1
isodate                             0.6.1
itsdangerous                        2.1.2
Jinja2                              3.1.2
jmespath                            0.10.0
joblib                              1.2.0
jsonschema                          4.16.0
kiwisolver                          1.4.4
lazy-object-proxy                   1.7.1
linkify-it-py                       2.0.0
locket                              1.0.0
lockfile                            0.12.2
lxml                                4.6.1
mailsnake                           1.6.4
Mako                                1.2.3
mandrill                            1.0.59
Markdown                            3.4.1
markdown-it-py                      2.1.0
MarkupSafe                          2.1.1
marshmallow                         3.18.0
marshmallow-enum                    1.5.1
marshmallow-oneofschema             3.0.1
marshmallow-sqlalchemy              0.26.1
matplotlib                          3.6.0
mdit-py-plugins                     0.3.1
mdurl                               0.1.2
monotonic                           1.6
multidict                           6.0.2
nltk                                3.5
numpy                               1.23.3
oauth2client                        4.1.3
oauthlib                            3.2.1
openpyxl                            3.0.7
ordered-set                         4.0.2
orderedmultidict                    1.0.1
orjson                              3.8.0
packaging                           21.3
pandas                              1.1.3
paramiko                            2.11.0
partd                               1.3.0
pathspec                            0.9.0
pendulum                            2.1.2
Pillow                              9.2.0
pip                                 22.2.2
pkg_resources                       0.0.0
pkgutil_resolve_name                1.3.10
platformdirs                        2.5.2
pluggy                              1.0.0
prison                              0.2.1
psutil                              5.9.2
pyasn1                              0.4.8
pyasn1-modules                      0.2.8
pycparser                           2.21
pycryptodome                        3.15.0
pydantic                            1.10.2
pydub                               0.25.1
Pygments                            2.13.0
PyJWT                               2.5.0
pymongo                             3.11.0
PyNaCl                              1.5.0
pyparsing                           3.0.9
pyrsistent                          0.18.1
pysftp                              0.2.9
python-daemon                       2.3.1
python-dateutil                     2.8.2
python-multipart                    0.0.5
python-nvd3                         0.15.0
python-slugify                      6.1.2
pytz                                2020.1
pytzdata                            2020.1
PyYAML                              6.0
redis                               3.5.3
regex                               2022.9.13
requests                            2.27.1
requests-file                       1.5.1
requests-oauthlib                   1.3.1
requests-toolbelt                   0.9.1
rfc3986                             1.5.0
rich                                12.5.1
rsa                                 4.9
s3transfer                          0.3.7
scikit-learn                        1.1.2
scipy                               1.9.1
selenium                            3.141.0
setproctitle                        1.3.2
setuptools                          44.0.0
six                                 1.16.0
sklearn                             0.0
sniffio                             1.3.0
soupsieve                           2.3.2.post1
SQLAlchemy                          1.4.41
SQLAlchemy-JSONField                1.0.0
SQLAlchemy-Utils                    0.38.3
sqlparse                            0.4.3
starlette                           0.20.4
suds-community                      1.1.2
swagger-ui-bundle                   0.0.9
tabulate                            0.8.10
tenacity                            8.1.0
termcolor                           2.0.1
text-unidecode                      1.3
threadpoolctl                       3.1.0
toolz                               0.12.0
tqdm                                4.64.1
tweepy                              3.9.0
typing_extensions                   4.3.0
uc-micro-py                         1.0.1
unicodecsv                          0.14.1
untangle                            1.1.1
urllib3                             1.26.12
uvicorn                             0.18.3
Werkzeug                            2.2.2
wrapt                               1.14.1
WTForms                             2.3.3
xmltodict                           0.12.0
yarl                                1.8.1
zeep                                4.1.0
zipp                                3.8.1

How to reproduce

Reproduce the bug

context

• When I want to install packages from a requirements.txt
• I have a blank python virtual environemnt with the latest pip
• pip 22.2.2 from /home/ubuntu/.../..../lib/python3.8/site-packages/pip (python 3.8)
• python version 3.8.10
• Ubuntu 20.04 LTS

requirements.txt

apache-airflow==2.3.3
pendulum==2.1.2
bingads==13.0.13
boto==2.49.0
boto3==1.15.16
beautifulsoup4==4.11.1
dask==2021.9.1
deepdiff==5.7.0
furl==2.1.3
googleads==26.0.0
gradio==3.0.26
gspread==5.4.0
hashids==1.3.1
httpagentparser==1.9.0
lxml==4.6.1
mailsnake==1.6.4
mandrill==1.0.59
nltk==3.5
numpy==1.23.3
oauth2client==4.1.3
openpyxl==3.0.7
pandas==1.1.3
pymongo==3.11.0
pysftp==0.2.9
pytz==2020.1
redis==3.5.3
requests==2.27.1
selenium==3.141.0
sklearn==0.0
tweepy==3.9.0
untangle==1.1.1
xmltodict==0.12.0

Operating System

Ubuntu 20.04 LTS

Versions of Apache Airflow Providers

2.3.3

Deployment

Virtualenv installation

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[potiuk]

Some of your requirement have conflicting dependencies and use a markdown-it.py version that has no extras that are used by another requirement. You need to track it down.

Also what might guide you are the constraints files - the only supported version of installing airflow is with constraint files: https://airflow.apache.org/docs/apache-airflow/stable/installation/installing-from-pypi.html and you should use it.

If you use it following the documentation, you will be able to see which of your requirements conflicts with Airflow constraints and you will be able to make a decision whether to stick with the airflow "constraint" version for the rquirement, or to separately upgrade your dependency - and you can make such decision one-by-one for each of the packages you will have conflicts with - you will need to understand if you "really" need the version that you have pinned in your requirements or whether you can use the one that is "golden standard" for the version of Airflow which you install.

Converting into discussion as this is not a bug - just not following the docuementation.,