Skip to content

oai.yosemite map_page errors for all 3 NPS collections - ENRICHMENT ERROR: 'NoneType' object has no attribute 'isdigit' #1199

@aturner

Description

@aturner

Registry ID: 27632

Registry ID: 27631

Registry ID: 27016

Error snippet:

[2024-10-09, 19:10:54 UTC] {{logging_mixin.py:151}} INFO - ENRICHMENT ERROR: 'NoneType' object has no attribute 'isdigit'
Traceback (most recent call last):
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/mapper.py", line 147, in enrich
    return func(**kwargs)
           ^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/mapper.py", line 546, in enrich_earliest_date
    converted_dates = convert_dates(date_values)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 322, in convert_dates
    if is_year_range_list(date_values):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 303, in is_year_range_list
    all(v.isdigit() for v in date_values) and \
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 303, in <genexpr>
    all(v.isdigit() for v in date_values) and \
        ^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'isdigit'
[2024-10-09, 19:10:54 UTC] {{taskinstance.py:1937}} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/mapper.py", line 147, in enrich
    return func(**kwargs)
           ^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/mapper.py", line 546, in enrich_earliest_date
    converted_dates = convert_dates(date_values)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 322, in convert_dates
    if is_year_range_list(date_values):
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 303, in is_year_range_list
    all(v.isdigit() for v in date_values) and \
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/date_enrichments.py", line 303, in <genexpr>
    all(v.isdigit() for v in date_values) and \
        ^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'isdigit'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/decorators/base.py", line 221, in execute
    return_value = super().execute(context)
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/operators/python.py", line 192, in execute
    return_value = self.execute_callable()
                   ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/operators/python.py", line 209, in execute_callable
    return self.python_callable(*self.op_args, **self.op_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/dags/shared_tasks/mapping_tasks.py", line 80, in map_page_task
    mapped_page_status = map_page(
                         ^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/lambda_function.py", line 141, in map_page
    mapped_records = run_enrichments(
                     ^^^^^^^^^^^^^^^^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/lambda_function.py", line 71, in run_enrichments
    records = [
              ^
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/lambda_function.py", line 72, in <listcomp>
    record.enrich(enrichment_func, **kwargs)
  File "/usr/local/airflow/dags/rikolti/metadata_mapper/mappers/mapper.py", line 150, in enrich
    raise Exception(f"ENRICHMENT ERROR for enrichment: `{enrichment_function_name}` "
Exception: ENRICHMENT ERROR for enrichment: `enrich_earliest_date` with kwargs: `{}` 

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions