While using airflow.providers.microsoft.azure.hooks.data_lake got error: request() got an unexpected keyword argument 'kwargs'

[sahilb4772]

Hi,
I need help to resolve the issue.
Airflow version: 2.6.2
python: 3.9

I have created one default connection "azure_data_lake_default" so that I can connect to Azure ADLS and upload files using "airflow.providers.microsoft.azure.hooks.data_lake".

While doing that I got below error:

File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/uploads.py", line 78, in
range_ids = [uploader.process_chunk(result) for result in uploader.get_chunk_streams()]
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/uploads.py", line 194, in process_chunk
return self._upload_chunk_with_progress(chunk_offset, chunk_bytes)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/uploads.py", line 210, in _upload_chunk_with_progress
range_id = self._upload_chunk(chunk_offset, chunk_data)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/uploads.py", line 353, in _upload_chunk
self.response_headers = self.service.append_data(
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
return func(*args, **kwargs)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_generated/operations/_path_operations.py", line 2625, in append_data
pipeline_response: PipelineResponse = self._client._pipeline.run( # pylint: disable=protected-access
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 227, in run
return first_node.send(pipeline_request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
[Previous line repeated 2 more times]
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/policies/_redirect.py", line 184, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/policies.py", line 520, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/policies/_authentication.py", line 126, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/policies.py", line 313, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 89, in send
response = self.next.send(request)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/_base.py", line 122, in send
self._sender.send(request.http_request, **request.context.options),
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/base_client.py", line 329, in send
return self._transport.send(request, **kwargs)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/storage/filedatalake/_shared/base_client.py", line 329, in send
return self._transport.send(request, **kwargs)
File "/home/airflow/.local/lib/python3.9/site-packages/azure/core/pipeline/transport/_requests_basic.py", line 338, in send
response = self.session.request( # type: ignore
TypeError: request() got an unexpected keyword argument 'kwargs'

[sahilb4772]

I just got this error while uploading a file to ADLS rest all functions of "airflow.providers.microsoft.azure.hooks.data_lake" is working fine.

[azizkatlane]

Hello , i run into the same error , any ideas ?

[seniut]

the same error I get. How do you fix this?