Skip to content

Commit 6e8f093

Browse files
committed
debug
1 parent 7569f33 commit 6e8f093

File tree

57 files changed

+643
-79
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

57 files changed

+643
-79
lines changed

.github/workflows/e2e.yml

Lines changed: 13 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -74,15 +74,20 @@ jobs:
7474
- name: Run all e2e tests
7575
if: github.event_name == 'workflow_dispatch' || github.event_name == 'push' || steps.filter.outputs.e2e-test == 'true'
7676
run: python3 e2e/src/main/scripts/run_e2e_test.py --testRunner **/${{ matrix.tests }}/**/TestRunner.java
77-
# Step to check if there were failures and run retry runner if needed
78-
- name: Check for Failed Tests and Run Retry Runner
77+
# Step to check if there were failures and list contents of target directory for debugging
78+
- name: List target directory contents for debugging
79+
run: ls -al ./plugin/target
80+
# Step to check if there were failures and run retry runner if needed
81+
- name: Check for Failed Tests and Run Retry Test Runner
7982
if: always() # Always run this step to check for failures
80-
run: if [ -f ./plugin/target/failed_scenarios.txt ]; then
81-
echo "Found failed scenarios. Running retry tests."
82-
python3 e2e/src/main/scripts/run_e2e_test.py --testRunner **/${{ matrix.tests }}/**/RetryTestRunner.java
83-
else
84-
echo "No failed scenarios found."
85-
fi
83+
run: |
84+
echo "Checking for failed_scenarios.txt"
85+
if [ -f ./plugin/target/failed_scenarios.txt ]; then
86+
echo "Found failed scenarios. Running retry tests."
87+
python3 e2e/src/main/scripts/run_e2e_test.py --testRunner **/${{ matrix.tests }}/**/RetryTestRunner.java
88+
else
89+
echo "No failed scenarios found."
90+
fi
8691
- name: Upload debug files
8792
uses: actions/upload-artifact@v3
8893
if: always()

src/e2e-test/features/bigquery/sink/GCSToBigQuery.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ Feature: BigQuery sink - Verification of GCS to BigQuery successful data transfe
5757
Then Enter BigQuery property reference name
5858
Then Enter BigQuery property projectId "projectId"
5959
Then Enter BigQuery property datasetProjectId "projectId"
60-
Then Override Service account details if set in environment variables
60+
Then Override Service account details if set in environment variablesss
6161
Then Enter BigQuery property dataset "dataset"
6262
Then Enter BigQuery sink property table name
6363
Then Toggle BigQuery sink property truncateTable to true

src/e2e-test/features/bigquery/sink/GCSToBigQuery_WithMacro.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ Feature: BigQuery sink - Verification of GCS to BigQuery successful data transfe
66
Given Open Datafusion Project to configure pipeline
77
When Source is GCS
88
When Sink is BigQuery
9-
Then Open GCS source properties
9+
Then Open GCS source propertiess
1010
Then Enter GCS property reference name
1111
Then Enter GCS property "projectId" as macro argument "gcsProjectId"
1212
Then Enter GCS property "serviceAccountType" as macro argument "serviceAccountType"

src/e2e-test/features/bigquery/source/BigQuerySourceError.feature

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ Feature: BigQuery source - Validate BigQuery source plugin error scenarios
33

44
Scenario Outline:Verify BigQuery Source properties validation errors for mandatory fields
55
Given Open Datafusion Project to configure pipeline
6-
When Source is BigQuery
6+
When Source is BigQuerys
77
Then Open BigQuery source properties
88
Then Enter the BigQuery properties with blank property "<property>"
99
Then Validate mandatory property error for "<property>"
@@ -29,7 +29,7 @@ Feature: BigQuery source - Validate BigQuery source plugin error scenarios
2929

3030
Scenario Outline:Verify BigQuery Source properties validation errors for incorrect format of projectIds
3131
Given Open Datafusion Project to configure pipeline
32-
When Source is BigQuery
32+
When Source is BigQuerys
3333
Then Open BigQuery source properties
3434
Then Enter BigQuery property reference name
3535
Then Enter BigQuery property projectId "<ProjectID>"

src/e2e-test/features/bigqueryexecute/BQExecute.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
@BQExecute
1+
@BQExecutes
22
Feature: BigQueryExecute - Verify data transfer using BigQuery Execute plugin
33

44
@BQ_SOURCE_TEST @BQ_SINK_TEST @BQ_EXECUTE_SQL @BQExecute_Required

src/e2e-test/features/bigqueryexecute/BQExecuteErrorScenarios.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
@BQExecute
1+
@BQExecutes
22
Feature: BigQueryExecute - Verify BigQueryExecute plugin error scenarios
33

44
Scenario: Verify BigQueryExecute validation error for mandatory field SQL Query

src/e2e-test/features/bigqueryexecute/BQExecute_WithMacro.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
@BQExecute
1+
@BQExecutes
22
Feature: BigQueryExecute - Verify data transfer using BigQuery Execute plugin with macro arguments
33

44
@BQ_SOURCE_TEST @BQ_SINK_TEST @BQ_EXECUTE_SQL

src/e2e-test/features/bigtable/BigTableToBigTable.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
1212
# License for the specific language governing permissions and limitations under
1313
# the License.
14-
@BigTable @BIGTABLE_SOURCE_TEST
14+
@BigTables @BIGTABLE_SOURCE_TEST
1515
Feature: BigTable source - Verification of BigTable to BigTable Successful Data Transfer
1616

1717
@BIGTABLE_SINK_TEST @bigtable_Required

src/e2e-test/features/datastore/runtime.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212
# License for the specific language governing permissions and limitations under
1313
# the License.
1414

15-
@DataStore
15+
@DataStores
1616
Feature: DataStore - Verification of Datastore to Datastore Successful Data Transfer
1717

1818
@DATASTORE_SOURCE_ENTITY @datastore_Required

src/e2e-test/features/gcs/sink/GCSSink.feature

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
@GCS_Sink
1+
@GCS_Sinks
22
Feature: GCS sink - Verification of GCS Sink plugin
33

44
@CMEK @GCS_SINK_TEST @BQ_SOURCE_TEST

0 commit comments

Comments
 (0)