SUMO-236061: Azure Append Blob Collection (#3979)

* SUMO-236061: Azure Storage

* SUMO-236061: Update sidebar ids

* SUMO-236061: troubleshoot file

* Fix broken links and add redirects for renamed docs/URLs

* link fixes

* links

* Update network-watcher.md

* SUMO-236061: Navigation and title Update

* SUMO-236061: Update Append Blob collection logs

* SUMO-236061: Updated Azure-Sumo pipeline

* SUMO-236061: index update

* path fix

* minor fix

* minor URL update

* minor fix

* redirect path removed

* minor fix

* minor fix

* Updates from review

* Update blog-service/2019/12-31.md

Co-authored-by: Kim (Sumo Logic) <56411016+kimsauce@users.noreply.github.com>

* updated azure append blob

* removed the video link

* updated limitations section

* added release notes

* fixed table rendering and note

* updated the doc

* added limitation and missing system topic

* updated image

* Rename 2024-06-16-collection.md to 2024-06-12-collection.md

---------

Co-authored-by: Kim <56411016+kimsauce@users.noreply.github.com>
Co-authored-by: Jagadisha V <129049263+JV0812@users.noreply.github.com>
Co-authored-by: John Pipkin <jpipkin@sumologic.com>
Co-authored-by: Himanshu Pal <hp.iiita@gmail.com>

Author: 5 people

blog-service/2018/12-31.md

@@ -550,7 +550,7 @@ The [Sumo Logic App for Amazon Redshift ULM](/docs/integrations/amazon-aws/redsh
 ---
 ## June 1, 2018 (Integration)
 
-New - An integration for [Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage) is now available. The new integration provides a event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic. This solution is good for monitoring Azure services that do not support exporting logs to Azure Monitor, for example, Azure Web Apps and Azure Storage Accounts.
+New - An integration for [Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs) is now available. The new integration provides a event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic. This solution is good for monitoring Azure services that do not support exporting logs to Azure Monitor, for example, Azure Web Apps and Azure Storage Accounts.
 
 ---
 ## May 22, 2018 (New Google Apps Options in Google Source Audit UI)

blog-service/2019/12-31.md

@@ -423,7 +423,7 @@ Update - The [Cylance App](/docs/integrations/security-threat-detection/cylance
 ---
 ## February 22, 2019 (Apps)
 
-Update - The [Azure Network Watcher App](/docs/integrations/microsoft-azure/network-watcher) and [Azure Blob Storage App](/docs/send-data/collect-from-other-data-sources/azure-blob-storage) have an enhanced collection processes. The SumoLogic App for Azure Network Watcher leverages Network Security Group (NSG) flow logs to provide real-time visibility and analysis of your Azure Network. The Sumo Logic App for Azure Blob Storage is a Sumo integration that provides a event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic.
+Update - The Sumo Logic apps for [Azure Network Watcher](/docs/integrations/microsoft-azure/network-watcher) and [Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs) now have an enhanced collection processes. Our Azure Network Watcher app leverages Network Security Group (NSG) flow logs to provide real-time visibility and analysis of your Azure Network. The Azure Blob Storage app provides an event-based pipeline for shipping and monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic.
 
 ---
 ## February 20, 2019 (Apps)

blog-service/2023/12-31.md

@@ -202,7 +202,7 @@ The new setup guides for Azure services are:
 - [Azure Automation](/docs/integrations/microsoft-azure/azure-automation)
 - [Azure Backup](/docs/integrations/microsoft-azure/azure-backup)
 - [Azure Batch](/docs/integrations/microsoft-azure/azure-batch)
-- [Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage)
+- [Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs)
 - [Azure Cache for Redis](/docs/integrations/microsoft-azure/azure-cache-for-redis)
 - [Azure Cognitive Search](/docs/integrations/microsoft-azure/azure-cognitive-search)
 - [Azure Cosmos DB](/docs/integrations/microsoft-azure/azure-cosmos-db)
@@ -772,7 +772,7 @@ We are excited to announce the update of Azure Blob Storage Collector, featuring
 - **Support for Azure storage accounts in different regions**. Previously, the collection resources deployment and storage account region had to match. With this release, we have introduced a new user parameter called **StorageAccountRegion**, which allows you to specify a storage account in a different region than the collection resources deployment region, providing greater flexibility and scalability.
 - **JSON lines format support**. You can upload any JSON file in JSON lines format to send data to Sumo Logic. This update enables seamless integration, which allows you to efficiently process and analyze JSON line data for your application's needs.
 
-Check out our technical documentation [here](/docs/send-data/collect-from-other-data-sources/azure-blob-storage) to learn more about the updates in Azure Blob Storage Collector.
+Check out our technical documentation [here](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs) to learn more about the updates in Azure Blob Storage Collector.
 
 
 ---

blog-service/2024-02-09-apps.md

@@ -18,4 +18,4 @@ We're happy to announce an update of the Azure Blob Storage collection framework
 - Updated function application logging with log levels.
 - Provides necessary security updates.
 
-For upgrade instructions, refer to the [changelog](https://github.com/SumoLogic/sumologic-azure-function/releases/tag/v4.0.0). For information on collecting logs from Azure Blob Storage, see our [documentation](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage).
+For upgrade instructions, refer to the [changelog](https://github.com/SumoLogic/sumologic-azure-function/releases/tag/v4.0.0). For information on collecting logs from Azure Blob Storage, see our [documentation](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs).

blog-service/2024-06-12-collection.md

@@ -0,0 +1,15 @@
+---
+title: Azure Blob Storage (Collection)
+image: https://help.sumologic.com/img/sumo-square.png
+keywords:
+  - collection
+  - azure-blob-storage
+  - append-blob
+hide_table_of_contents: true
+authors:
+  - url: https://help.sumologic.com/release-notes-service/rss.xml
+    image_url: /img/release-notes/rss-orange.png
+---
+
+We're excited to announce the release of our new Azure Blob Storage collection. This new integration provides a event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic. This solution can be used to monitor Azure services that do not support exporting logs to Azure Monitor. [Learn more](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/append-blob/).
+

cid-redirects.json

@@ -101,9 +101,9 @@
   "/03Send-Data/Collect-from-Other-Data-Sources/Amazon-CloudWatch-Logs/Collect-Amazon-CloudWatch-Logs-using-Amazon-Kinesis": "/docs/send-data/collect-from-other-data-sources/amazon-cloudwatch-logs",
   "/03Send-Data/Collect-from-Other-Data-Sources/Auto-Subscribe_AWS_Log_Groups_to_a_Lambda_Function": "/docs/send-data/collect-from-other-data-sources/autosubscribe-arn-destination",
   "/03Send-Data/Collect-from-Other-Data-Sources/AWS_Fargate_log_collection": "/docs/send-data/collect-from-other-data-sources/aws-fargate-log-collection",
-  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage",
-  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Collect_Logs_from_Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage",
-  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Troubleshoot_Azure_Blob_Storage_Log_Collection": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-azure-blob-storage-log-collection",
+  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs",
+  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Collect_Logs_from_Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs",
+  "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Troubleshoot_Azure_Blob_Storage_Log_Collection": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-log-collection",
   "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Monitoring": "/docs/send-data/collect-from-other-data-sources/azure-monitoring",
   "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Monitoring/Collect_Logs_from_Azure_Monitor": "/docs/send-data/collect-from-other-data-sources/azure-monitoring/collect-logs-azure-monitor",
   "/03Send-Data/Collect-from-Other-Data-Sources/Azure_Monitoring/Collect_Metrics_from_Azure_Monitor": "/docs/send-data/collect-from-other-data-sources/azure-monitoring/collect-metrics-azure-monitor",
@@ -3280,7 +3280,7 @@
   "/Send-Data/Applications-and-Other-Data-Sources/Azure-Audit/02Collect-Logs-for-Azure-Audit-from-Event-Hub": "/docs/integrations/microsoft-azure/audit",
   "/Send-Data/Collect-from-Other-Data-Sources/Azure_Monitoring/Collect_Logs_from_Azure_Monitor": "/docs/send-data/collect-from-other-data-sources/azure-monitoring/collect-logs-azure-monitor",
   "/Send-Data/Collect-from-Other-Data-Sources/Azure_Monitoring/Collect_Metrics_from_Azure_Monitor": "/docs/send-data/collect-from-other-data-sources/azure-monitoring/collect-metrics-azure-monitor",
-"/Send_Data/Setup_Wizard/About_Streaming_Data_Collection/Collect_from_Custom_Apps/Collect_Streaming_Data_From_a_Local_File": "/docs/send-data/installed-collectors/sources/streaming-metrics-source",
+  "/Send_Data/Setup_Wizard/About_Streaming_Data_Collection/Collect_from_Custom_Apps/Collect_Streaming_Data_From_a_Local_File": "/docs/send-data/installed-collectors/sources/streaming-metrics-source",
   "/Send_Data/Sources/Script_Source": "/docs/send-data/installed-collectors/sources/script-source",
   "/Send_Data/Sources/Script_Source/Cron_Examples_and_Reference": "/docs/send-data/installed-collectors/sources/script-source/cron-examples-reference",
   "/Send_Data/Sources/AWS_S3_Source": "/docs/send-data/hosted-collectors/amazon-aws/aws-s3-source",
@@ -3700,8 +3700,8 @@
   "/Send-Data/Applications-and-Other-Data-Sources/Oracle/00Collect_Logs_for_Oracle": "/docs/send-data/collect-from-other-data-sources/collect-logs-oracle-cloud-infrastructure",
   "/Send-Data/Applications-and-Other-Data-Sources/Threat-Intel-Quick-Analysis": "/docs/integrations/security-threat-detection/threat-intel-quick-analysis",
   "/Send-Data/Applications-and-Other-Data-Sources/Threat-Intel-Quick-Analysis/Threat-Intel-FAQ": "/docs/integrations/security-threat-detection/threat-intel-quick-analysis",
-  "/Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage",
-  "/Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Collect_Logs_from_Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage",
+  "/Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs",
+  "/Send-Data/Collect-from-Other-Data-Sources/Azure_Blob_Storage/Collect_Logs_from_Azure_Blob_Storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs",
   "/Send-Data/Data-Types-and-Applications/Docker/01-Collect-Events-and-Statistics-for-the-Docker-App": "/docs/send-data/installed-collectors/sources/docker-sources",
   "/Send-Data/Data-Types-and-Applications/Amazon-EC2-Container-Service-(ECS)/01-Collect-ECS-Logs-and-Metrics": "/docs/integrations/amazon-aws/elastic-container-service",
   "/Send-Data/Data-Types/Azure-Web-Apps": "/docs/integrations/microsoft-azure/web-apps",
@@ -3885,6 +3885,8 @@
   "/docs/cse/automation-service/automation-service-bridge": "/docs/platform-services/automation-service/automation-service-bridge",
   "/docs/cse/automation-service/automation-service-integration-framework": "/docs/platform-services/automation-service/automation-service-integration-framework",
   "/docs/send-data/collect-from-other-data-sources/kubernetes": "/docs/send-data/kubernetes",
+  "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs",
+  "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-azure-blob-storage-log-collection": "/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-log-collection",
   "/docs/cloud-soar/mssp": "/docs/cloud-soar/legacy/legacy-cloud-soar-mssp",
   "/docs/cloud-soar/cloud-soar-delivery-2": "/release-notes-csoar/2024/02/06/application-update",
   "/docs/metrics/metrics-queries/metrics-queries-classic": "/docs/metrics/metrics-queries/metrics-explorer",

docs/integrations/microsoft-azure/arm-integration-faq.md

@@ -20,7 +20,7 @@ This guide provides answers to frequently asked questions (FAQ) about integratin
 
 For an introduction to Sumo Logic’s solution for obtaining application and infrastructure data (logs and metrics) for Azure services using Azure Monitor, see [Azure Monitoring](/docs/send-data/collect-from-other-data-sources/azure-monitoring).
 
-For an introduction to Sumo Logic's solution for obtaining logs and metrics using an event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic, see [Azure Blog Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage).
+For an introduction to Sumo Logic's solution for obtaining logs and metrics using an event-based pipeline for shipping monitoring data from Azure Blob Storage to an HTTP source on Sumo Logic, see [Azure Blog Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs).
 
 
 ## General FAQ
@@ -200,7 +200,7 @@ FileOffsetMap is a table created in Azure Table Storage that is used for interna
 
 ### How does the collection mechanism work?
 
-For a summary of how various components are stitched together in the pipeline, see the [Monitoring data flow](/docs/send-data/collect-from-other-data-sources/azure-blob-storage#monitoring-data-flow) section of the Azure Blog Storage page.
+For a summary of how various components are stitched together in the pipeline, see the [Monitoring data flow](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs) section of the Azure Blog Storage page.
 
 
 ### How do I scale the function?
@@ -263,7 +263,7 @@ Solution: Increase the maxBatchSize in BlobTaskProducer's host.json This will fe
 Error: HTDECK-JOBCOSTING-API__BE93-2019-05-08-14-e5260b.log"": [48255]} Exception while executing function: Functions.BlobTaskProducer Microsoft.Azure.WebJobs.Host. FunctionInvocationException : Exception while executing function: Functions.BlobTaskProducer ---> System.Exception : StorageError: The table specified does not exist. RequestId:3914a31a-e002-000e-1dad-05a995000000 Time:2019-05-08T14:48:29.9940095Z at async Microsoft.Azure.WebJobs.Script.Description.NodeFunctionInvoker.InvokeCore(Object[] parameters,FunctionInvocationContext context) at C:\projects\azure-webjobs-sdk-script\src\WebJobs.Script\Description\Node\NodeFunctionInvoker.cs : 196
 ```
 
-Solution: This error comes when FileOffsetMap does not exists. Check and confirm whether you have created the following table in [Step 3: Configure Azure resources using ARM template](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage#step-3-configure-azure-resources-using-arm-template), substep 11.
+Solution: This error comes when FileOffsetMap does not exists. Check and confirm whether you have created the following table in [Step 3: Configure Azure resources using ARM template](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs/#step-3-configure-azure-resources-using-arm-template), substep 11.
 
 Error: You'll see a Deployment Failed error when roleAssignment is not unique but we are already using resourcegroup.id in a name that is unique. The error details are:  
 

docs/integrations/microsoft-azure/network-watcher.md

@@ -115,7 +115,7 @@ To configure an HTTP source for Azure, do the following:
 
 ### Step 3: Configure Azure Resources using ARM template
 
-To deploy the ARM template-based Blob Storage collection, refer to step 3 of [Collect Logs from Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/collect-logs-azure-blob-storage/#step-3-configure-azure-resources-using-arm-template).
+To deploy the ARM template-based Blob Storage collection, refer to step 3 of [Collect Logs from Azure Blob Storage](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/block-blob/collect-logs#step-3-configure-azure-resources-using-arm-template).
 
 ### Step 4: Enable NSG flow logs via the Azure Portal
 
@@ -125,7 +125,7 @@ In this step, you enable NSG flow logs with the Azure portal.
 
 ### Troubleshooting
 
-If logs do not start flowing into Sumo Logic after you perform the configuration above, see [Troubleshoot Azure Blob Storage Log Collection](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-azure-blob-storage-log-collection.md).
+If logs do not start flowing into Sumo Logic after you perform the configuration above, see [Troubleshoot Azure Blob Storage Log Collection](/docs/send-data/collect-from-other-data-sources/azure-blob-storage/troubleshoot-log-collection).
 
 ## Installing the Azure Network Watcher app