Skip to content

Commit 3dc690b

Browse files
committed
Requried field as we don't want it to ever be null, still works without providing the config value in config.json so this isn't breaking
1 parent d1f01b7 commit 3dc690b

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,7 @@ pipx install git+https://github.com/MeltanoLabs/tap-universal-file.git
2323
| file_path | True | None | The path to obtain files from. Example: `/foo/bar`. Or, for `protocol==s3`, use `s3-bucket-name` instead. |
2424
| file_regex | False | None | A regex pattern to only include certain files. Example: `.*\.csv`. |
2525
| file_type | False | delimited | Must be one of `delimited`, `jsonl`, or `avro`. Indicates the type of file to sync, where `delimited` is for CSV/TSV files and similar. Note that *all* files will be read as that type, regardless of file extension. To only read from files with a matching file extension, appropriately configure `file_regex`. |
26+
| fail_when_no_files_found | True | true | Fail when no files are found |
2627
| compression | False | detect | The encoding used to decompress data. Must be one of `none`, `zip`, `bz2`, `gzip`, `lzma`, `xz`, or `detect`. If set to `none` or any encoding, that setting will be applied to *all* files, regardless of file extension. If set to `detect`, encodings will be applied based on file extension. |
2728
| additional_info | False | 1 | If `True`, each row in tap's output will have three additional columns: `_sdc_file_name`, `_sdc_line_number`, and `_sdc_last_modified`. If `False`, these columns will not be present. Incremental replication requires `additional_info==True`. |
2829
| start_date | False | None | Used in place of state. Files that were last modified before the `start_date` wwill not be synced. |

tap_universal_file/tap.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -94,6 +94,7 @@ class TapUniversalFile(Tap):
9494
"fail_when_no_files_found",
9595
th.BooleanType,
9696
default=True,
97+
required=True,
9798
description="Fail when no files are found",
9899
),
99100
th.Property(

0 commit comments

Comments
 (0)