Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Your dockerfile for airflow-spark docker doesn't work #1

Open
quangbilly79 opened this issue Nov 18, 2022 · 5 comments
Open

Your dockerfile for airflow-spark docker doesn't work #1

quangbilly79 opened this issue Nov 18, 2022 · 5 comments

Comments

@quangbilly79
Copy link

I can't build this Dockerfile: https://github.com/pyjaime/docker-airflow-spark/blob/master/airflow/Dockerfile
Error at line 68: && pip install --use-feature=2020-resolver apache-airflow[crypto,celery,postgres,hive,jdbc,mysql,ssh${AIRFLOW_DEPS:+,}${AIRFLOW_DEPS}]==${AIRFLOW_VERSION} \

especially at the --use-feature=2020-resolve part
Please check again

@lijoabraham
Copy link

lijoabraham commented Dec 29, 2022

@quangbilly79 Please use --use-feature=fast-deps. There might be some other issues
I had to add below lines as well to the Dockerfile
&& pip install black==20.8b1 \ && pip install --upgrade click==8.0.2 \

@Kukreti12
Copy link

I am getting image errror
image

@ronniemo
Copy link

ronniemo commented Sep 6, 2023

Same on:

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=22.04
DISTRIB_CODENAME=jammy
DISTRIB_DESCRIPTION="Ubuntu 22.04.2 LTS"
PRETTY_NAME="Ubuntu 22.04.2 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.2 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

netcat -> netcat-traditional
openjdk-8-jdk -> default-jre
pip install --use-feature=2020 -> --use-feature=fast-deps

airflow-webserver_1 | /usr/bin/env: ‘bash\r’: No such file or directory
airflow-webserver_1 | /usr/bin/env: use -[v]S to pass options in shebang lines

@weldermartins
Copy link

I'm doing something different from what's in README.md

image

@ronniemo
Copy link

I got the same because I tried to run it on a new Ubuntu version. When I first installed it in Turbolader Ubuntu version it worked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants