Skip to content

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented May 29, 2025

As we are working on a longer-term solution for example-dags, the short-term one is to bring the standard example_dags back to the airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest main version (but those dags don't change) while not requiring to duplicate the dags and keep them in standard provider where the documentation for them is kept.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.
@potiuk potiuk force-pushed the bring-back-standard-exeamples-to-airflow-package branch from b1c73d0 to 3ff93fa Compare May 29, 2025 17:04
@potiuk potiuk marked this pull request as ready for review May 29, 2025 17:42
@potiuk potiuk requested review from Lee-W, kaxil and jscheffl May 29, 2025 17:42
@potiuk potiuk added this to the Airflow 3.0.2 milestone May 29, 2025
@potiuk potiuk added the backport-to-v3-0-test Mark PR with this label to backport to v3-0-test branch label May 29, 2025
Copy link
Contributor

@jscheffl jscheffl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM and sort out the examples (hopefully soon) in general

@potiuk potiuk merged commit 46908a1 into apache:main May 29, 2025
178 of 187 checks passed
@potiuk potiuk deleted the bring-back-standard-exeamples-to-airflow-package branch May 29, 2025 19:01
github-actions bot pushed a commit that referenced this pull request May 29, 2025
…ckage (#51192)

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.
(cherry picked from commit 46908a1)

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Kaxil Naik <[email protected]>
Copy link

Backport successfully created: v3-0-test

Status Branch Result
v3-0-test PR Link

potiuk added a commit that referenced this pull request May 29, 2025
…ckage (#51192) (#51220)

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.
(cherry picked from commit 46908a1)

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Kaxil Naik <[email protected]>
potiuk added a commit to potiuk/airflow that referenced this pull request May 31, 2025
Folow up after apache#51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the apache#51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
potiuk added a commit to potiuk/airflow that referenced this pull request May 31, 2025
Folow up after apache#51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the apache#51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
potiuk added a commit to potiuk/airflow that referenced this pull request May 31, 2025
Folow up after apache#51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the apache#51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
potiuk added a commit that referenced this pull request Jun 1, 2025
…1260)

Folow up after #51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the #51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
potiuk added a commit to potiuk/airflow that referenced this pull request Jun 1, 2025
… sources (apache#51260)

Folow up after apache#51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the apache#51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
(cherry picked from commit cc29e02)

Co-authored-by: Jarek Potiuk <[email protected]>
potiuk added a commit that referenced this pull request Jun 1, 2025
… sources (#51260) (#51275)

Folow up after #51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the #51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
(cherry picked from commit cc29e02)
kaxil added a commit that referenced this pull request Jun 3, 2025
…ckage (#51192) (#51220)

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.
(cherry picked from commit 46908a1)

Co-authored-by: Jarek Potiuk <[email protected]>
Co-authored-by: Kaxil Naik <[email protected]>
kaxil pushed a commit that referenced this pull request Jun 3, 2025
… sources (#51260) (#51275)

Folow up after #51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the #51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
(cherry picked from commit cc29e02)
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
…e#51192)

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.

Co-authored-by: Kaxil Naik <[email protected]>
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
…ache#51260)

Folow up after apache#51192.

Actually choosing the same approach as for system tests was
pretty wrong and even before attempting to have final solution
for example_dags/system tests we should move the standard examples
out of "tests.system" as rightfully pointed out by Jed in
the apache#51192.

The snippets of code to run the tests as pytests are not neeeded
and they are actually even harmful as they cause import errors
when no tests_common is around
jose-lehmkuhl pushed a commit to jose-lehmkuhl/airflow that referenced this pull request Jul 11, 2025
…e#51192)

As we are working on a longer-term solution for example-dags, the
short-term one is to bring the standard example_dags back to the
airflow-core via symbolic link to the standard package folder.

This makes the dags to be copied to the airflow-core from the latest
main version (but those dags don't change) while not requiring to
duplicate the dags and keep them in standard provider where the
documentation for them is kept.

Co-authored-by: Kaxil Naik <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:DAG-processing backport-to-v3-0-test Mark PR with this label to backport to v3-0-test branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants