Repository navigation
Conversation
tnazarew
force-pushed
the
ci/pr-coverage
branch
from
November 12, 2026 13:16
0445bd7 to
8f79e0b
Compare
- scripts/check_scenario_coverage.py warns (PR check and release run summary) about scenarios whose version ranges match no tested version (today: spark_dataproc/bigtable, capped at OpenLineage 1.0.0) and tested component versions no scenario covers (today: dbt 1.12.6, the release the release check tracks; csv_to_postgres is gated to 1.8.0, so those runs test nothing). - check_structure.sh requires scenario.md to be non-empty; fills the two empty ones (spark_dataproc_bigquery_shakespare, the producer template). - .gitignore: .DS_Store, *.jar, dbt's .user.yml; removes the tracked producer/dbt/runner/.user.yml (a per-machine anonymous id). - Removes generated-files/historical_reports/: nothing ever wrote to it (collect never uploads updated-new-report.json); report.json's git history already holds every run's report. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: tnazarew <tomasz.nazarewicz@getindata.com>
tnazarew
force-pushed
the
hygiene/repo-cleanup
branch
from
November 12, 2026 13:16
0e5e30f to
e45ba4e
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #352 (base
ci/pr-coverage, for the pytest setup); retarget tomainafter #352 merges.What
scripts/check_scenario_coverage.py(warnings only, exits 0), run in the PR check's structure step and in the release check's initialize job (job summary). The tested matrix isversions.jsonplus the latest OpenLineage release and, whenreleases.jsontracks it, the latest component release. It reports:spark_dataproc/bigtable, capped at OpenLineage 1.0.0, so it's never tested.csv_to_postgresis gated to dbt 1.8.0, so every "new dbt release" run tests nothing (both steps skipped in run 41619028964).check_structure.shrequiresscenario.mdto be non-empty (consumer, dataplex and producer scenarios). Fills the two empty ones:consumer/scenarios/spark_dataproc_bigquery_shakespare(described from its events) and the producer template..gitignore:.DS_Store,*.jar, dbt's.user.yml. Removes the trackedproducer/dbt/runner/.user.yml(dbt's per-machine anonymous id).generated-files/historical_reports/: nothing ever wrote to it (collect never uploadsupdated-new-report.json).report.json's git history already holds every run's report.The stricter run-script checks (non-empty, executable,
bash -n) come with the PR that makes the emptyrun_hive_dataproc_tests.sha working script, so this PR's own check stays green.Verification
pytest scripts/tests→ 34 passed: coverage (never-running scenario, uncovered version, latest OL counts, CLI on the real repo), structure check on a copy of the repo tree (passes; emptyscenario.mdin producer/consumer/dataplex scenarios fails; missing still fails). The empty-scenario.mdcases failed before the change../scripts/check_structure.sh→ exit 0;python3 scripts/check_scenario_coverage.py→ the two warnings above.🤖 Generated with Claude Code